title: Hardware Realization of Neuromorphic Computing with a 4-Port Photonic Reservoir for Modulation Format Identification

abstract: The fields of machine learning and artificial intelligence drive researchers to explore energy-efficient, brain-inspired new hardware. Reservoir computing encompasses recurrent neural networks for sequential data processing and matches the performance of other recurrent networks with less training and lower costs. However, traditional software-based neural networks suffer from high energy consumption due to computational demands and massive data transfer needs. Photonic reservoir computing overcomes this challenge with energy-efficient neuromorphic photonic integrated circuits or NeuroPICs. Here, we introduce a reservoir NeuroPIC used for modulation format identification in C-band telecommunication network monitoring. It is built on a silicon-on-insulator platform with a 4-port reservoir architecture consisting of a set of physical nodes connected via delay lines. We comprehensively describe the NeuroPIC design and fabrication, experimentally demonstrate its performance, and compare it with simulations. The NeuroPIC incorporates non-linearity through a simple digital readout and achieves close to 100% accuracy in identifying several configurations of quadrature amplitude modulation formats transmitted over 20 km of optical fiber at 32 GBaud symbol rate. The NeuroPIC performance is robust against fabrication imperfections like waveguide propagation loss, phase randomization, etc. and delay line length variations. Furthermore, the experimental results exceeded numerical simulations, which we attribute to enhanced signal interference in the experimental NeuroPIC output. Our energy-efficient photonic approach has the potential for high-speed temporal data processing in a variety of applications.


title: Local structure maturation in high entropy oxide (Mg,Co,Ni,Cu,Zn)1-x(Cr,Mn)xO thin films

abstract: High entropy oxides (HEO)s have garnered much interest due to their available high degree of tunability. Here, we study the local structure of (MgNiCuCoZn)0.167(MnCr)0.083O, a composition based on the parent HEO (MgNiCuCoZn)0.2O.We synthesized a series of thin films via pulsed laser deposition at incremental oxygen partial pressures. X-ray diffraction shows lattice parameter to decrease with increased pO2 pressures until the onset of phase separation. X-ray absorption fine structure shows that specific atomic species in the composition dictate the global structure of the material as Cr, Co, and Mn shift to energetically favorable coordination with increasing pressure. Transmission electron microscopy analysis on a lower-pressure sample exhibits a rock salt structure, but the higher-pressure sample reveals reflections reminiscent of the spinel structure. In all, these findings give a more complete picture on how (MgNiCuCoZn)0.167(MnCr)0.083O forms with varying initial conditions and advances fundamental knowledge of cation behavior in high entropy oxides.


title: Mitigating Social Biases in Language Models through Unlearning

abstract: Mitigating bias in language models (LMs) has become a critical problem due to the widespread deployment of LMs. Numerous approaches revolve around data pre-processing and fine-tuning of language models, tasks that can be both time-consuming and computationally demanding. Consequently, there is a growing interest in machine unlearning techniques given their capacity to induce the forgetting of undesired behaviors of the existing pre-trained or fine-tuned models with lower computational cost. In this work, we explore two unlearning methods, (1) Partitioned Contrastive Gradient Unlearning (PCGU) applied on decoder models and (2) Negation via Task Vector, to reduce social biases in state-of-the-art and open-source LMs such as LLaMA-2 and OPT. We also implement distributed PCGU for large models. It is empirically shown, through quantitative and qualitative analyses, that negation via Task Vector method outperforms PCGU in debiasing with minimum deterioration in performance and perplexity of the models. On LLaMA-27B, negation via Task Vector reduces the bias score by 11.8%


title: Standardness Fogs Meaning: A Position Regarding the Informed Usage of Standard Datasets

abstract: Standard datasets are frequently used to train and evaluate Machine Learning models. However, the assumed standardness of these datasets leads to a lack of in-depth discussion on how their labels match the derived categories for the respective use case. In other words, the standardness of the datasets seems to fog coherency and applicability, thus impeding the trust in Machine Learning models. We propose to adopt Grounded Theory and Hypotheses Testing through Visualization as methods to evaluate the match between use case, derived categories, and labels of standard datasets. To showcase the approach, we apply it to the 20 Newsgroups dataset and the MNIST dataset. For the 20 Newsgroups dataset, we demonstrate that the labels are imprecise. Therefore, we argue that neither a Machine Learning model can learn a meaningful abstraction of derived categories nor one can draw conclusions from achieving high accuracy. For the MNIST dataset, we demonstrate how the labels can be confirmed to be defined well. We conclude that a concept of standardness of a dataset implies that there is a match between use case, derived categories, and class labels, as in the case of the MNIST dataset. We argue that this is necessary to learn a meaningful abstraction and, thus, improve trust in the Machine Learning model.


title: Mining United Nations General Assembly Debates

abstract: This project explores the application of Natural Language Processing (NLP) techniques to analyse United Nations General Assembly (UNGA) speeches. Using NLP allows for the efficient processing and analysis of large volumes of textual data, enabling the extraction of semantic patterns, sentiment analysis, and topic modelling. Our goal is to deliver a comprehensive dataset and a tool (interface with descriptive statistics and automatically extracted topics) from which political scientists can derive insights into international relations and have the opportunity to have a nuanced understanding of global diplomatic discourse.


title: The emergence of the Star Formation Main Sequence with redshift unfolded by JWST

abstract: We investigate the correlation between stellar mass (M*) and star formation rate (SFR) across the stellar mass range log10(M*/Msun)~6-11. We consider almost 50,000 star-forming galaxies at z~3-7, leveraging data from COSMOS/SMUVS, JADES/GOODS-SOUTH, and MIDIS/XDF. This is the first study spanning such a wide stellar mass range without relying on gravitational lensing effects. We locate our galaxies on the SFR-M* plane to assess how the location of galaxies in the star-formation main sequence (MS) and starburst (SB) region evolves with stellar mass and redshift. We find that the two star-forming modes tend to converge at log10(M*/Msun) < 7, with all galaxies found in the SB mode. By dissecting our galaxy sample in stellar mass and redshift, we show that the emergence of the star-formation MS is stellar-mass dependent: while in galaxies with log10(M*/Msun) > 9 the MS is already well in place at z = 5-7, for galaxies with log10(M*/Msun)~7-8 it only becomes significant at z<4. Overall, our results are in line with previous findings that the SB mode dominates amongst low stellar-mass galaxies. The earlier emergence of the MS for massive galaxies is consistent with galaxy downsizing.


title: BiLD: Bi-directional Logits Difference Loss for Large Language Model Distillation

abstract: In recent years, large language models (LLMs) have shown exceptional capabilities across various natural language processing (NLP) tasks. However, such impressive performance often comes with the trade-off of an increased parameter size, posing significant challenges for widespread deployment. Knowledge distillation (KD) provides a solution by transferring knowledge from a large teacher model to a smaller student model. In this paper, we explore the task-specific distillation of LLMs at the logit level. Our investigation reveals that the logits of fine-tuned LLMs exhibit a more extreme long-tail distribution than those from vision models, with hidden "noise" in the long tail affecting distillation performance. Furthermore, existing logits distillation methods often struggle to effectively utilize the internal ranking information from the logits. To address these, we propose the Bi-directional Logits Difference (BiLD) loss. The BiLD loss filters out the long-tail noise by utilizing only top-$k$ teacher and student logits, and leverages the internal logits ranking information by constructing logits differences. To evaluate BiLD loss, we conduct comprehensive experiments on 13 datasets using two types of LLMs. Our results show that the BiLD loss, with only the top-8 logits, outperforms supervised fine-tuning (SFT), vanilla KL loss, and five other distillation methods from both NLP and CV fields.


title: Evaluating Short-Term Temporal Fluctuations of Social Biases in Social Media Data and Masked Language Models

abstract: Social biases such as gender or racial biases have been reported in language models (LMs), including Masked Language Models (MLMs). Given that MLMs are continuously trained with increasing amounts of additional data collected over time, an important yet unanswered question is how the social biases encoded with MLMs vary over time. In particular, the number of social media users continues to grow at an exponential rate, and it is a valid concern for the MLMs trained specifically on social media data whether their social biases (if any) would also amplify over time. To empirically analyse this problem, we use a series of MLMs pretrained on chronologically ordered temporal snapshots of corpora. Our analysis reveals that, although social biases are present in all MLMs, most types of social bias remain relatively stable over time (with a few exceptions). To further understand the mechanisms that influence social biases in MLMs, we analyse the temporal corpora used to train the MLMs. Our findings show that some demographic groups, such as male, obtain higher preference over the other, such as female on the training corpora constantly.


title: satsuma: Structure-based Symmetry Breaking in SAT

abstract: Symmetry reduction is crucial for solving many interesting SAT instances in practice. Numerous approaches have been proposed, which try to strike a balance between symmetry reduction and computational overhead. Arguably the most readily applicable method is the computation of static symmetry breaking constraints: a constraint restricting the search-space to non-symmetrical solutions is added to a given SAT instance. A distinct advantage of static symmetry breaking is that the SAT solver itself is not modified. A disadvantage is that the strength of symmetry reduction is usually limited. In order to boost symmetry reduction, the state-of-the-art tool BreakID [Devriendt et. al] pioneered the identification and tailored breaking of a particular substructure of symmetries, the so-called row interchangeability groups. In this paper, we propose a new symmetry breaking tool called satsuma. The core principle of our tool is to exploit more diverse but frequently occurring symmetry structures. This is enabled by new practical detection algorithms for row interchangeability, row-column symmetry, Johnson symmetry, and various combinations. Based on the resulting structural description, we then produce symmetry breaking constraints. We compare this new approach to BreakID on a range of instance families exhibiting symmetry. Our benchmarks suggest improved symmetry reduction in the presence of Johnson symmetry and comparable performance in the presence of row-column symmetry. Moreover, our implementation runs significantly faster, even though it identifies more diverse structures.


title: Enhancing Travel Choice Modeling with Large Language Models: A Prompt-Learning Approach

abstract: Travel choice analysis is crucial for understanding individual travel behavior to develop appropriate transport policies and recommendation systems in Intelligent Transportation Systems (ITS). Despite extensive research, this domain faces two critical challenges: a) modeling with limited survey data, and b) simultaneously achieving high model explainability and accuracy. In this paper, we introduce a novel prompt-learning-based Large Language Model(LLM) framework that significantly improves prediction accuracy and provides explicit explanations for individual predictions. This framework involves three main steps: transforming input variables into textual form; building of demonstrations similar to the object, and applying these to a well-trained LLM. We tested the framework's efficacy using two widely used choice datasets: London Passenger Mode Choice (LPMC) and Optima-Mode collected in Switzerland. The results indicate that the LLM significantly outperforms state-of-the-art deep learning methods and discrete choice models in predicting people's choices. Additionally, we present a case of explanation illustrating how the LLM framework generates understandable and explicit explanations at the individual level.


title: Solarcast-ML: Per Node GraphCast Extension for Solar Energy Production

abstract: This project presents an extension to the GraphCast model, a state-of-the-art graph neural network (GNN) for global weather forecasting, by integrating solar energy production forecasting capabilities. The proposed approach leverages the weather forecasts generated by GraphCast and trains a neural network model to predict the ratio of actual solar output to potential solar output based on various weather conditions. The model architecture consists of an input layer corresponding to weather features (temperature, humidity, dew point, wind speed, rain, barometric pressure, and altitude), two hidden layers with ReLU activations, and an output layer predicting solar radiation. The model is trained using a mean absolute error loss function and Adam optimizer. The results demonstrate the model's effectiveness in accurately predicting solar radiation, with its convergence behavior, decreasing training loss, and accurate prediction of solar radiation patterns suggesting successful learning of the underlying relationships between weather conditions and solar radiation. The integration of solar energy production forecasting with GraphCast offers valuable insights for the renewable energy sector, enabling better planning and decision-making based on expected solar energy production. Future work could explore further model refinements, incorporation of additional weather variables, and extension to other renewable energy sources.


title: Lexically Grounded Subword Segmentation

abstract: We present three innovations in tokenization and subword segmentation. First, we propose to use unsupervised morphological analysis with Morfessor as pre-tokenization. Second, we present an algebraic method for obtaining subword embeddings grounded in a word embedding space. Based on that, we design a novel subword segmentation algorithm that uses the embeddings, ensuring that the procedure considers lexical meaning. Third, we introduce an efficient segmentation algorithm based on a subword bigram model that can be initialized with the lexically aware segmentation method to avoid using Morfessor and large embedding tables at inference time. We evaluate the proposed approaches using two intrinsic metrics and measure their performance on two downstream tasks: part-of-speech tagging and machine translation. Our experiments show significant improvements in the morphological plausibility of the segmentation when evaluated using segmentation precision on morpheme boundaries and improved R\'enyi efficiency in 8 languages. Although the proposed tokenization methods do not have a large impact on automatic translation quality, we observe consistent performance gains in the arguably more morphological task of part-of-speech tagging.


title: Shape and Size Tunability of Sheets of Interlocked Ring Copolymers

abstract: Mechanically bonded membranes of interlocked ring polymers are a significant generalization of conventional elastic sheets, where connectivity is provided by covalent bonding, and represent a promising class of topological meta-materials. In this context, two open questions regard the large-scale reverberations of the heterogeneous composition of the rings and the inequivalent modes of interlocking neighboring rings. We address these questions with Langevin dynamics simulations of chainmails with honeycomb-lattice connectivity, where the rings are block copolymers with two segments of different rigidity. We considered various combinations of the relative lengths of the two segments and the patterns of the over- and under-passes linking neighboring rings. We find that varying ring composition and linking patterns have independent and complementary effects. While the former sets the overall size of the chainmail, the latter defines the shape, enabling the selection of starkly different conformation types. Notably, one of the considered linking patterns favors saddle-shaped membranes, providing a first example of spontaneous negative Gaussian curvature in mechanically bonded sheets. The results help establish the extent to which mechanically bonded membranes can differ from conventional elastic membranes, particularly for the achievable shape and size tunability.


title: Non-Weight modules over affine Nappi-Witten Lie algebras

abstract: In this paper, we study the representation theory of affine Nappi-Witten Lie algebra $\widehat{H_4}$ corresponding to the Nappi-Witten Lie algebra $H_4$. We completely classify all Cartan-free modules of rank one for the Nappi-Witten Lie algebra $H_4$. With the help of Cartan free $H_4$ modules we classify all Cartan-free modules of rank one over affine Nappi Witten Lie algebra. We also give a necessary and sufficient condition for these modules to be irreducible. Finally as an application we classify Cartan free modules of rank one for affine-Virasoro Nappi-Witten Lie algebras.


title: Serotonin as a Creativity Pump

abstract: The location of Western Civilization defined nations in Europe and in the United States within the largest global pollen environments on the planet is proposed as a key factor leading to their success. Environments with dense pollen concentrations will cause large up and down changes in serum histamine directly causing reductions and increases in brain serotonin i.e., a larger serotonin slope, linked to higher levels of creativity. The pollen ecosystem in northern latitude nations is thus considered the hidden driver of the success of these populations as the biochemical interaction between histamine and serotonin leads to a creativity pump that is proposed as the fundamental driver of intelligence in micro and macro human populations.


title: Is AI fun? HumorDB: a curated dataset and benchmark to investigate graphical humor

abstract: Despite significant advancements in computer vision, understanding complex scenes, particularly those involving humor, remains a substantial challenge. This paper introduces HumorDB, a novel image-only dataset specifically designed to advance visual humor understanding. HumorDB consists of meticulously curated image pairs with contrasting humor ratings, emphasizing subtle visual cues that trigger humor and mitigating potential biases. The dataset enables evaluation through binary classification(Funny or Not Funny), range regression(funniness on a scale from 1 to 10), and pairwise comparison tasks(Which Image is Funnier?), effectively capturing the subjective nature of humor perception. Initial experiments reveal that while vision-only models struggle, vision-language models, particularly those leveraging large language models, show promising results. HumorDB also shows potential as a valuable zero-shot benchmark for powerful large multimodal models. We open-source both the dataset and code under the CC BY 4.0 license.


title: Exploring Multi-view Pixel Contrast for General and Robust Image Forgery Localization

abstract: Image forgery localization, which aims to segment tampered regions in an image, is a fundamental yet challenging digital forensic task. While some deep learning-based forensic methods have achieved impressive results, they directly learn pixel-to-label mappings without fully exploiting the relationship between pixels in the feature space. To address such deficiency, we propose a Multi-view Pixel-wise Contrastive algorithm (MPC) for image forgery localization. Specifically, we first pre-train the backbone network with the supervised contrastive loss to model pixel relationships from the perspectives of within-image, cross-scale and cross-modality. That is aimed at increasing intra-class compactness and inter-class separability. Then the localization head is fine-tuned using the cross-entropy loss, resulting in a better pixel localizer. The MPC is trained on three different scale training datasets to make a comprehensive and fair comparison with existing image forgery localization algorithms. Extensive experiments on the small, medium and large scale training datasets show that the proposed MPC achieves higher generalization performance and robustness against post-processing than the state-of-the-arts. Code will be available at https://github.com/multimediaFor/MPC.


title: Parametric finite element approximation of two-phase Navier--Stokes flow with viscoelasticity

abstract: In this work, we present a parametric finite element approximation of two-phase Navier-Stokes flow with viscoelasticity. The free boundary problem is given by the viscoelastic Navier-Stokes equations in the two fluid phases, connected by jump conditions across the interface. The elasticity in the fluids is characterised using the Oldroyd-B model with possible stress diffusion. The model was originally introduced to approximate fluid-structure interaction problems between an incompressible Newtonian fluid and a hyperelastic neo-Hookean solid, which are possible limit cases of the model. We approximate a variational formulation of the model with an unfitted finite element method that uses piecewise linear parametric finite elements. The two-phase Navier-Stokes-Oldroyd-B system in the bulk regions is discretised in a way that guarantees unconditional solvability and stability for the coupled bulk-interface system. Good volume conservation properties for the two phases are observed in the case where the pressure approximation space is enriched with the help of an XFEM function. We show the applicability of our method with some numerical results.


title: Galerkin Neural Network-POD for Acoustic and Electromagnetic Wave Propagation in Parametric Domains

abstract: We investigate reduced-order models for acoustic and electromagnetic wave problems in parametrically defined domains. The parameter-to-solution maps are approximated following the so-called Galerkin POD-NN method, which combines the construction of a reduced basis via proper orthogonal decomposition (POD) with neural networks (NNs). As opposed to the standard reduced basis method, this approach allows for the swift and efficient evaluation of reduced-order solutions for any given parametric input. As is customary in the analysis of problems in random or parametrically defined domains, we start by transporting the formulation to a reference domain. This yields a parameter-dependent variational problem set on parameter-independent functional spaces. In particular, we consider affine-parametric domain transformations characterized by a high-dimensional, possibly countably infinite, parametric input. To keep the number of evaluations of the high-fidelity solutions manageable, we propose using low-discrepancy sequences to sample the parameter space efficiently. Then, we train an NN to learn the coefficients in the reduced representation. This approach completely decouples the offline and online stages of the reduced basis paradigm. Numerical results for the three-dimensional Helmholtz and Maxwell equations confirm the method's accuracy up to a certain barrier and show significant gains in online speed-up compared to the traditional Galerkin POD method.


title: Trapezoidal Gradient Descent for Effective Reinforcement Learning in Spiking Networks

abstract: With the rapid development of artificial intelligence technology, the field of reinforcement learning has continuously achieved breakthroughs in both theory and practice. However, traditional reinforcement learning algorithms often entail high energy consumption during interactions with the environment. Spiking Neural Network (SNN), with their low energy consumption characteristics and performance comparable to deep neural networks, have garnered widespread attention. To reduce the energy consumption of practical applications of reinforcement learning, researchers have successively proposed the Pop-SAN and MDC-SAN algorithms. Nonetheless, these algorithms use rectangular functions to approximate the spike network during the training process, resulting in low sensitivity, thus indicating room for improvement in the training effectiveness of SNN. Based on this, we propose a trapezoidal approximation gradient method to replace the spike network, which not only preserves the original stable learning state but also enhances the model's adaptability and response sensitivity under various signal dynamics. Simulation results show that the improved algorithm, using the trapezoidal approximation gradient to replace the spike network, achieves better convergence speed and performance compared to the original algorithm and demonstrates good training stability.


title: Bayes' capacity as a measure for reconstruction attacks in federated learning

abstract: Within the machine learning community, reconstruction attacks are a principal attack of concern and have been identified even in federated learning, which was designed with privacy preservation in mind. In federated learning, it has been shown that an adversary with knowledge of the machine learning architecture is able to infer the exact value of a training element given an observation of the weight updates performed during stochastic gradient descent. In response to these threats, the privacy community recommends the use of differential privacy in the stochastic gradient descent algorithm, termed DP-SGD. However, DP has not yet been formally established as an effective countermeasure against reconstruction attacks. In this paper, we formalise the reconstruction threat model using the information-theoretic framework of quantitative information flow. We show that the Bayes' capacity, related to the Sibson mutual information of order infinity, represents a tight upper bound on the leakage of the DP-SGD algorithm to an adversary interested in performing a reconstruction attack. We provide empirical results demonstrating the effectiveness of this measure for comparing mechanisms against reconstruction threats.


title: System Immersion of a Driving Simulator Affects the Oscillatory Brain Activity

abstract: The technological properties of a system delivering simulation experience are a crucial dimension of immersion. To create a sense of presence and reproduce drivers behaviour as realistically as possible, we need reliable driving simulators that allow drivers to become highly immersed. This study investigates the impact of a system immersion of a driving simulator on the drivers' brain activity while operating a conditionally automated vehicle. Nineteen participants drove approximately 40 minutes while their brain activity was recorded using electroencephalography (EEG). We found a significant effect of the system immersion in the occipital and parietal areas, primarily in the high-Beta bandwidth. No effect was found in the Theta, Alpha, and low-Beta bandwidths. These findings suggest that the system immersion might influence the drivers' physiological arousal, consequently influencing their cognitive and emotional processes.


title: Bootstrap of the defect 1/2 BPS Wilson lines in N=4 Chern-Simons-matter theories

abstract: We compute correlation functions of local operator insertions on the 1/2 BPS Wilson lines of N=4 Chern-Simons-matter theories in 3 dimensions. We study the algebra preserved by the defect CFT supported on the line, identify the superdisplacement multiplet and discuss some of its weak-coupling realizations. By employing a superspace description, we present the 4-point functions of the superdisplacement and show how they are determined by functions of cross-ratios. Within an analytic bootstrap approach, we derive these functions at leading and next-to-leading order at strong coupling, obtaining a result in agreement with appropriate orbifolds of the ABJM case considered in arXiv:2004.07849.


title: Entanglement source and quantum memory analysis for zero added-loss multiplexing

abstract: High-rate, high-fidelity entanglement distribution is essential to the creation of a quantum internet, but recent achievements in fiber and satellite-based entanglement distribution fall far short of what is needed. Chen et al. [Phys. Rev. Appl. 19, 054209 (2023)] proposed a means for dramatically increasing entanglement-distribution rates via zero added-loss multiplexing (ZALM). ZALM's quantum transmitter employs a pair of Sagnac-configured spontaneous parametric downconverters (SPDCs), channelization via dense wavelength-division multiplexing (DWDM) filtering, and partial Bell-state measurements (BSMs) to realize a near-deterministic, heralded source of frequency-multiplexed polarization-entangled biphotons. Each biphoton is transmitted to Alice and Bob with a classical message identifying its frequency channel and the heralded entangled state. Their quantum receivers use DWDM filtering and mode conversion to interface their received biphotons to intra-cavity color-center quantum memories. This paper delves deeply into ZALM's SPDCs, partial-BSMs, and loading of Alice and Bob's quantum memories. It derives the density operators for the SPDC sources and the quantum memories, allowing heralding probability, heralding efficiency, and fidelity to be evaluated for both the polarization-entangled biphotons and the loaded quantum memories, thus enabling exploration of the parameter space for optimizing ZALM performance. Even without optimization analysis, the paper already demonstrates two critical features of the ZALM architecture: the necessity of achieving a near-separable channelized biphoton wave function to ensure the biphoton sent to Alice and Bob is of high purity; and the premium placed on Alice and Bob's temporal-mode converters' enabling narrowband push-pull memory loading to ensure the arriving biphoton's state is faithfully transferred to the intra-cavity color centers.


title: Improved Bounds for Fully Dynamic Matching via Ordered Ruzsa-Szemer\'edi Graphs

abstract: In a very recent breakthrough, Behnezhad and Ghafari [arXiv'24] developed a novel fully dynamic randomized algorithm for maintaining a $(1-\epsilon)$-approximation of maximum matching with amortized update time potentially much better than the trivial $O(n)$ update time. The runtime of the BG algorithm is parameterized via the following graph theoretical concept: * For any $n$, define $ORS(n)$ -- standing for Ordered RS Graph -- to be the largest number of edge-disjoint matchings $M_1,\ldots,M_t$ of size $\Theta(n)$ in an $n$-vertex graph such that for every $i \in [t]$, $M_i$ is an induced matching in the subgraph $M_{i} \cup M_{i+1} \cup \ldots \cup M_t$. Then, for any fixed $\epsilon > 0$, the BG algorithm runs in \[ O\left( \sqrt{n^{1+O(\epsilon)} \cdot ORS(n)} \right) \] amortized update time with high probability, even against an adaptive adversary. $ORS(n)$ is a close variant of a more well-known quantity regarding RS graphs (which require every matching to be induced regardless of the ordering). It is currently only known that $n^{o(1)} \leqslant ORS(n) \leqslant n^{1-o(1)}$, and closing this gap appears to be a notoriously challenging problem. In this work, we further strengthen the result of Behnezhad and Ghafari and push it to limit to obtain a randomized algorithm with amortized update time of \[ n^{o(1)} \cdot ORS(n) \] with high probability, even against an adaptive adversary. In the limit, i.e., if current lower bounds for $ORS(n) = n^{o(1)}$ are almost optimal, our algorithm achieves an $n^{o(1)}$ update time for $(1-\epsilon)$-approximation of maximum matching, almost fully resolving this fundamental question. In its current stage also, this fully reduces the algorithmic problem of designing dynamic matching algorithms to a purely combinatorial problem of upper bounding $ORS(n)$ with no algorithmic considerations.


title: Scalar sector of the Myers and Pospelov model: thermal and size effects

abstract: The scalar sector of the Myers and Pospelov model is considered. This theory introduces a dimension 5 operator with a preferred four-vector which breaks Lorentz symmetry. We investigate various applications using the TFD formalism, a topological field theory that allows the study of thermal and size effects on an equal footing. In this context, Lorentz-violating corrections to the Casimir effect and Stefan-Boltzmann law have been calculated.


title: Renormalization group flows and emergent symmetries

abstract: We discuss the following proposition: Renormalization Group flow of quantum theory with a biased symmetry exhibits a fixed hypersurface at which the symmetry is exact. Such emergent symmetries may have important phenomenological implications, including supersymmetric models, gauge theories, and massive gravity. Most interesting example is an emergent supersymmetry in non-abelian gauge theories with appropriate field content, in the IR limit i.e. strong coupling regime.


title: Trusted Video Inpainting Localization via Deep Attentive Noise Learning

abstract: Digital video inpainting techniques have been substantially improved with deep learning in recent years. Although inpainting is originally designed to repair damaged areas, it can also be used as malicious manipulation to remove important objects for creating false scenes and facts. As such it is significant to identify inpainted regions blindly. In this paper, we present a Trusted Video Inpainting Localization network (TruVIL) with excellent robustness and generalization ability. Observing that high-frequency noise can effectively unveil the inpainted regions, we design deep attentive noise learning in multiple stages to capture the inpainting traces. Firstly, a multi-scale noise extraction module based on 3D High Pass (HP3D) layers is used to create the noise modality from input RGB frames. Then the correlation between such two complementary modalities are explored by a cross-modality attentive fusion module to facilitate mutual feature learning. Lastly, spatial details are selectively enhanced by an attentive noise decoding module to boost the localization performance of the network. To prepare enough training samples, we also build a frame-level video object segmentation dataset of 2500 videos with pixel-level annotation for all frames. Extensive experimental results validate the superiority of TruVIL compared with the state-of-the-arts. In particular, both quantitative and qualitative evaluations on various inpainted videos verify the remarkable robustness and generalization ability of our proposed TruVIL. Code and dataset will be available at https://github.com/multimediaFor/TruVIL.


title: Genuine Multipartite Entanglement induced by a Thermal Acoustic Reservoir

abstract: Genuine multipartite entanglement (GME) is not only fundamental interesting for the study of quantum-to-classical transition, but also is essential for realizing universal quantum computing and quantum networks. Here we investigate the multipartite entanglement (ME) dynamics in a linear chain of N LC resonators interacting optomechanically with a common thermal acoustic reservoir. By presenting the exact analytical solutions of system evolution, we predict the periodic generation of non-Gaussian ME, including the discrete and continuous variables entanglement. Interestingly, the GME is obtained even though the system is in a heat bath. The mechanism relies on the special acoustic environment featuring frequency comb structure. More importantly, our proposed model also allows the periodic generation of entangled multipartite cat states (MCSs), i.e., a typical GHZ state, with high fidelity. This work fundamentally broadens the fields of ME, and have wide applications in implementing thermal-noise-resistant quantum information processing and many-body quantum simulation.


title: Enhancing Distractor Generation for Multiple-Choice Questions with Retrieval Augmented Pretraining and Knowledge Graph Integration

abstract: In this paper, we tackle the task of distractor generation (DG) for multiple-choice questions. Our study introduces two key designs. First, we propose \textit{retrieval augmented pretraining}, which involves refining the language model pretraining to align it more closely with the downstream task of DG. Second, we explore the integration of knowledge graphs to enhance the performance of DG. Through experiments with benchmarking datasets, we show that our models significantly outperform the state-of-the-art results. Our best-performing model advances the F1@3 score from 14.80 to 16.47 in MCQ dataset and from 15.92 to 16.50 in Sciq dataset.


title: Automated Bioacoustic Monitoring for South African Bird Species on Unlabeled Data

abstract: Analyses for biodiversity monitoring based on passive acoustic monitoring (PAM) recordings is time-consuming and challenged by the presence of background noise in recordings. Existing models for sound event detection (SED) worked only on certain avian species and the development of further models required labeled data. The developed framework automatically extracted labeled data from available platforms for selected avian species. The labeled data were embedded into recordings, including environmental sounds and noise, and were used to train convolutional recurrent neural network (CRNN) models. The models were evaluated on unprocessed real world data recorded in urban KwaZulu-Natal habitats. The Adapted SED-CRNN model reached a F1 score of 0.73, demonstrating its efficiency under noisy, real-world conditions. The proposed approach to automatically extract labeled data for chosen avian species enables an easy adaption of PAM to other species and habitats for future conservation projects.


title: Wilf's question in numerical semigroups $S_3$ revisited and inequalities for higher genera

abstract: We consider numerical semigroups $S_3 = \langle d_1,d_2,d_3 \rangle$, minimally generated by three positive integers. We revisit the Wilf question in $S_3$ and, making use of identities for degrees of syzygies of such semigroups, give a short proof of existence of an affirmative answer. We find also the lower bound for Frobenius numbers of $S_3$ and upper and lower bounds for higher genera.


title: Optimal constants in concentration inequalities on the sphere and in the Gauss space

abstract: We show several variants of concentration inequalities on the sphere stated as subgaussian estimates with optimal constants. For a Lipschitz function, we give one-sided and two-sided bounds for deviation from the median as well as from the mean. For example, we show that if $\mu$ is the normalized surface measure on $S^{n-1}$ with $n\geq 3$, $f : S^{n-1} \to \mathbb{R}$ is $1$-Lipschitz, $M$ is the median of $f$, and $t >0$, then $\mu\big(f \geq M +t\big) \leq \frac 12 e^{-nt^2/2}$. If $M$ is the mean of $f$, we have a two-sided bound $\mu\big(|f - M| \geq t\big) \leq e^{-nt^2/2}$. Consequently, if $\gamma$ is the standard Gaussian measure on $\mathbb{R}^n$ and $f : \mathbb{R}^{n} \to \mathbb{R}$ (again, $1$-Lipschitz, with the mean equal to $M$), then $\gamma \big(|f - M| \geq t\big) \leq e^{-t^2/2}$. These bounds are slightly better and arguably more elegant than those available elsewhere in the literature.


title: Endomorphism rings of simple modules and block decomposition

abstract: A left and right noetherian semiperfect ring R is known to be indecomposable if and only if its factor by the second power of Jacobson radical is. This characterisation is used to study simple R-modules in terms of their Ext groups. It is shown that if R is indecomposable, all its simple modules are either finite or have the same infinite cardinality and their endomorphism rings have the same characteristics. The results are further strengthened in the case when R is quasi-Frobenius.


title: Low-Rank Mixture-of-Experts for Continual Medical Image Segmentation

abstract: The primary goal of continual learning (CL) task in medical image segmentation field is to solve the "catastrophic forgetting" problem, where the model totally forgets previously learned features when it is extended to new categories (class-level) or tasks (task-level). Due to the privacy protection, the historical data labels are inaccessible. Prevalent continual learning methods primarily focus on generating pseudo-labels for old datasets to force the model to memorize the learned features. However, the incorrect pseudo-labels may corrupt the learned feature and lead to a new problem that the better the model is trained on the old task, the poorer the model performs on the new tasks. To avoid this problem, we propose a network by introducing the data-specific Mixture of Experts (MoE) structure to handle the new tasks or categories, ensuring that the network parameters of previous tasks are unaffected or only minimally impacted. To further overcome the tremendous memory costs caused by introducing additional structures, we propose a Low-Rank strategy which significantly reduces memory cost. We validate our method on both class-level and task-level continual learning challenges. Extensive experiments on multiple datasets show our model outperforms all other methods.


title: Explaining time series models using frequency masking

abstract: Time series data is fundamentally important for describing many critical domains such as healthcare, finance, and climate, where explainable models are necessary for safe automated decision-making. To develop eXplainable AI (XAI) in these domains therefore implies explaining salient information in the time series. Current methods for obtaining saliency maps assumes localized information in the raw input space. In this paper, we argue that the salient information of a number of time series is more likely to be localized in the frequency domain. We propose FreqRISE, which uses masking based methods to produce explanations in the frequency and time-frequency domain, which shows the best performance across a number of tasks.


title: MEV Ecosystem Evolution From Ethereum 1.0

abstract: Smart contracts led to the emergence of the decentralized finance (DeFi) marketplace within blockchain ecosystems, where diverse participants engage in financial activities. In traditional finance, there are possibilities to create values, e.g., arbitrage offers to create value from market inefficiencies or front-running offers to extract value for the participants having privileged roles. Such opportunities are readily available -- searching programmatically in DeFi. It is commonly known as Maximal Extractable Value (MEV) in the literature. In this survey, first, we show how lucrative such opportunities can be. Next, we discuss how protocol-following participants trying to capture such opportunities threaten to sabotage blockchain's performance and the core tenets of decentralization, transparency, and trustlessness that blockchains are based on. Then, we explain different attempts by the community in the past to address these issues and the problems introduced by these solutions. Finally, we review the current state of research trying to restore trustlessness and decentralization to provide all DeFi participants with a fair marketplace.


title: Submodular Participatory Budgeting

abstract: Participatory budgeting refers to the practice of allocating public resources by collecting and aggregating individual preferences. Most existing studies in this field often assume an additive utility function, where each individual holds a private utility for each candidate project, and the total utility of a set of funded projects is simply the sum of the utilities of all projects. We argue that this assumption does not always hold in reality. For example, building two playgrounds in the same neighborhood does not necessarily lead to twice the utility of building a single playground. To address this, we extend the existing study by proposing a submodular participatory budgeting problem, assuming that the utility function of each individual is a monotone and submodular function over funded projects. We propose and examine three preference elicitation methods, including \emph{ranking-by-marginal-values}, \emph{ranking-by-values} and \emph{threshold approval votes}, and analyze their performances in terms of distortion. Notably, if the utility function is addicative, our aggregation rule designed for threshold approval votes achieves a better distortion than the state-of-the-art approach.


title: The Precursor Small Aperture Telescope (PreSAT) CMB polarimeter

abstract: The search for the polarized imprint of primordial gravitational waves in the cosmic microwave background (CMB) as direct evidence of cosmic inflation requires exquisite sensitivity and control over systematics. The next-generation CMB-S4 project intends to improve upon current-generation experiments by deploying a significantly greater number of highly-sensitive detectors, combined with refined instrument components based on designs from field-proven instruments. The Precursor Small Aperture Telescope (PreSAT) is envisioned as an early step to this next generation, which will test prototype CMB-S4 components and technologies within an existing BICEP Array receiver, with the aim of enabling full-stack laboratory testing and early risk retirement, along with direct correlation of laboratory component-level performance measurements with deployed system performance. The instrument will utilize new 95/155GHz dichroic dual-linear-polarization prototype detectors developed for CMB-S4, cooled to 100mK via the installation of an adiabatic demagnetization refrigerator, along with a prototype readout chain and prototype optics manufactured with wide-band anti-reflection coatings. The experience gained by integrating, deploying, and calibrating PreSAT will also help inform planning for CMB-S4 small aperture telescope commissioning, calibration, and operations well in advance of the fabrication of CMB-S4 production hardware.


title: CNN Based Flank Predictor for Quadruped Animal Species

abstract: The bilateral asymmetry of flanks of animals with visual body marks that uniquely identify an individual, complicates tasks like population estimations. Automatically generated additional information on the visible side of the animal would improve the accuracy for individual identification. In this study we used transfer learning on popular CNN image classification architectures to train a flank predictor that predicts the visible flank of quadruped mammalian species in images. We automatically derived the data labels from existing datasets originally labeled for animal pose estimation. We trained the models in two phases with different degrees of retraining. The developed models were evaluated in different scenarios of different unknown quadruped species in known and unknown environments. As a real-world scenario, we used a dataset of manually labeled Eurasian lynx (Lynx lynx) from camera traps in the Bavarian Forest National Park to evaluate the model. The best model, trained on an EfficientNetV2 backbone, achieved an accuracy of 88.70 % for the unknown species lynx in a complex habitat.


title: Hydrodynamic simulation of Cygnus OB2: the absence of a cluster wind termination shock

abstract: We perform a large-scale hydrodynamic simulation of a massive star cluster whose stellar population mimics that of the Cygnus OB2 association. The main-sequence stars are first simulated during 1.6 Myr, until a quasi-stationary state is reached. At this time the three Wolf-Rayet stars observed in Cygnus OB2 are added to the simulation, which continues to 2 Myr. Using a high-resolution grid in the centre of the domain, we can resolve the most massive stars individually, which allows us to probe the kinetic structures at small (parsec) scales. We find that, although the cluster excavates a spherical "superbubble" cavity, the stellar population is too loosely distributed to blow a large-scale cluster wind termination shock, and that collective effects from wind-wind interactions are much less efficient than usually assumed. This challenges our understanding of the ultra-high energy emission observed from the region.


title: Chirality Effects in Molecular Chainmail

abstract: Motivated by the observation of positive Gaussian curvature in kinetoplast DNA networks, we consider the effect of linking chirality in square lattice molecular chainmail networks using Langevin dynamics simulations and constrained gradient optimization. Linking chirality here refers to ordering of over-under versus under-over linkages between a loop and its neighbors. We consider fully alternating linking, maximally non-alternating, and partially non-alternating linking chiralities. We find that in simulations of polymer chainmail networks, the linking chirality dictates the sign of the Gaussian curvature of the final state of the chainmail membranes. Alternating networks have positive Gaussian curvature, similar to what is observed in kinetoplast DNA networks. Maximally non-alternating networks form isotropic membranes with negative Gaussian curvature. Partially non-alternating networks form flat diamond-shaped sheets which undergo a thermal folding transition when sufficiently large, similar to the crumpling transition in tethered membranes. We further investigate this topology-curvature relationship on geometric grounds by considering the tightest possible configurations and the constraints that must be satisfied to achieve them.

categories: cond-mat.soft cond-mat.stat-mech math.DG math.GN


title: Highly Sensitive Label-free Biomolecular Detection Using Au-WS2 Nanohybrid Based SERS Substrates

abstract: Recent advancements in nanotechnology have led to the development of surface-enhanced Raman spectroscopy (SERS) based rapid and low-cost technologies for ultra-sensitive label-free detection and identification of molecular analytes. Herein, we utilized the synergistic plasmonic and chemical enhancement effects of Au-WS2 nanohybrids to attain the high-intensity Raman signals of targeted analytes. To develop these nanohybrids, a series of monodispersed Au nanoparticles (NPs) of varying diameters from 20 to 80 nm was chemically synthesized and successively blended with liquid-phase exfoliated WS2 nano-flakes of average lateral size 90 nm. They provided a maximum enhancement factor (EF) of ~1.80 109 corresponding to the characteristic peaks at 1364 cm-1 and 1512 cm-1 for R6G analyte molecules. Theoretical studies based on the finite-difference time-domain simulations on Au-WS2 nanohybrid systems revealed a huge field-intensity enhancement with an EF of more than 1000 at the plasmonic hotspots, which was induced by the strong coupling of individual plasmon oscillations of the adjacent Au NPs upon light interactions. These electromagnetic effects along with the chemical enhancement effects of WS2 nanoflakes were found to be mainly responsible for such huge enhancement in Raman signals. Furthermore, these hybrids were successfully employed for achieving highly sensitive detection of the E. coli ATCC 35218 bacterial strain with a concentration of 104 CFU/mL in phosphate-buffered saline media, indicating their real capabilities for practical scenarios. The findings of the present study will indeed provide vital information in the development of innovative nanomaterial-based biosensors, that will offer new possibilities for addressing critical public health concerns.


title: The Alexander and Markov theorems for strongly involutive links

abstract: The Alexander theorem (1923) and the Markov theorem (1936) are two classical results in knot theory that show respectively that every link is the closure of a braid and that braids that have the same closure are related by a finite number of operations called Markov moves. This paper presents specialized versions of these two classical theorems for a class of links in S3 preserved by an involution, that we call strongly involutive links. When connected, these links are known as strongly invertible knots, and have been extensively studied. We develop an equivariant closure map that, given two palindromic braids, produces a strongly involutive link. We demonstrate that this map is surjective up to equivalence of strongly involutive links. Furthermore, we establish that pairs of palindromic braids that have the same equivariant closure are related by an equivariant version of the original Markov moves.


title: Neutrino trident scattering at the LHC energy regime

abstract: The neutrino trident scattering process in neutrino - tungsten interactions at the LHC energy regime is investigated, and the cross-sections for different leptonic final states in coherent and incoherent interactions are estimated. Furthermore, the associated number of eventsat FASER$\nu$2 detector is estimated considering different predictions for the flux of incident neutrinos on the detector, based on distinct hadronic models for the particle production in $pp$ collisions at ultra-forward rapidities. Our results indicate that the observation of the neutrino trident process is, in principle, feasible at the Forward Physics Facility.


title: Supergeometric Quantum Effective Action

abstract: Supergeometric Quantum Field Theories (SG-QFTs) are theories that go beyond the standard supersymmetric framework, since they allow for general scalar-fermion field transformations on the configuration space of a supermanifold, without requiring an equality between bosonic and fermionic degrees of freedom. After revisiting previous considerations, we extend them by calculating the one-loop effective action of minimal SG-QFTs that feature non-zero fermionic curvature in two and four spacetime dimensions. By employing an intuitive approach to the Schwinger-DeWitt heat-kernel technique and a novel field-space generalised Clifford algebra, we derive the ultra-violet structure of all effective-field-theory (EFT) operators up to four spacetime derivatives that emerge at the one-loop order. Upon minimising the impact of potential ambiguities due to the so-called multiplicative anomalies, we find that the EFT interactions resulting from the one-loop supergeometric effective action are manifestly diffeomorphically invariant in configuration space. The extension of our approach to evaluating higher-loops of the supergeometric quantum effective action is described. The emerging landscape of theoretical and phenomenological directions for further research of SG-QFTs is discussed.


title: Topological representations for frame-valued domains via $L$-sobriety

abstract: With a frame $L$ as the truth value table, we study the topological representations for frame-valued domains. We introduce the notions of locally super-compact $L$-topological space and strong locally super-compact $L$-topological space. Using these concepts, continuous $L$-dcpos and algebraic $L$-dcpos are successfully represented via $L$-sobriety. By means of Scott $L$-topology and specialization $L$-order, we establish a categorical isomorphism between the category of the continuous (resp., algebraic) $L$-dcpos with Scott continuous maps and that of the locally super-compact (resp., strong locally super-compact) $L$-sober spaces with continuous maps. As an application, for a continuous $L$-poset $P$, we obtain a categorical isomorphism between the category of directed completions of $P$ with Scott continuous maps and that of the $L$-sobrifications of $(P, \sigma_{L}(P))$ with continuous maps.


title: SDR Common View on Generic Signals for Time Transfer Applications

abstract: This paper presents a new time transfer system that works with any radio signal with sufficient bandwidth, regardless of its content and modulation, by adopting the common view approach. This system, based on a network client-server architecture with SDR receivers offers a number of advantages. It can compare remote atomic clocks or disseminate reference time scales to end users with precision at the level of tens of nanoseconds. Its improved features in terms of flexibility, robustness, reliability, and security will potentially make positive contributions in the field of time transfer, as an alternative or complement to existing methods.


title: GraphKAN: Enhancing Feature Extraction with Graph Kolmogorov Arnold Networks

abstract: Massive number of applications involve data with underlying relationships embedded in non-Euclidean space. Graph neural networks (GNNs) are utilized to extract features by capturing the dependencies within graphs. Despite groundbreaking performances, we argue that Multi-layer perceptrons (MLPs) and fixed activation functions impede the feature extraction due to information loss. Inspired by Kolmogorov Arnold Networks (KANs), we make the first attempt to GNNs with KANs. We discard MLPs and activation functions, and instead used KANs for feature extraction. Experiments demonstrate the effectiveness of GraphKAN, emphasizing the potential of KANs as a powerful tool. Code is available at https://github.com/Ryanfzhang/GraphKan.


title: Cryogenic cesium iodide as a potential PET material

abstract: Total-body PET (TB-PET) scanners, with axial lengths exceeding 1 meter, provide significantly higher sensitivity than conventional PET scanners due to their greater acceptance of gamma pairs. However, this increased sensitivity often comes from gamma rays detected at oblique angles, leading to substantial multiple scattering along the patient's body. Additionally, the cost of TB-PET scanners scales with their extended detector length, often costing 5 to 10 times more than conventional scanners. Therefore, optimizing TB-PET performance requires crystals that enhance energy resolution and control costs. Cesium iodide (CsI), though historically less favored for PET due to its lower stopping power and light yield compared to crystals like LYSO, shows remarkable improvement when operated at cryogenic temperatures ($\sim$100 K). Under these conditions, CsI light yield rises dramatically to about 100 photons/keV, providing excellent energy resolution and good coincidence time resolution at a lower cost - typically 3 to 5 times cheaper than other crystals at parity of radiation length. In our study, cryogenic CsI crystals achieved an energy resolution better than 7% FWHM at 511 keV and a coincidence time resolution of less than 2 ns. These results demonstrate the potential of cryogenic CsI as a cost-effective, high-performance material for TB-PET scanners.


title: Defying the Odds: Solana's Unexpected Resilience in Spite of the Security Challenges Faced by Developers

abstract: Solana gained considerable attention as one of the most popular blockchain platforms for deploying decentralized applications. Compared to Ethereum, however, we observe a lack of research on how Solana smart contract developers handle security, what challenges they encounter, and how this affects the overall security of the ecosystem. To address this, we conducted the first comprehensive study on the Solana platform consisting of a 90-minute Solana smart contract code review task with 35 participants followed by interviews with a subset of seven participants. Our study shows, quite alarmingly, that none of the participants could detect all important security vulnerabilities in a code review task and that 83% of the participants are likely to release vulnerable smart contracts. Our study also sheds light on the root causes of developers' challenges with Solana smart contract development, suggesting the need for better security guidance and resources. In spite of these challenges, our automated analysis on currently deployed Solana smart contracts surprisingly suggests that the prevalence of vulnerabilities - especially those pointed out as the most challenging in our developer study - is below 0.3%. We explore the causes of this counter-intuitive resilience and show that frameworks, such as Anchor, are aiding Solana developers in deploying secure contracts.


title: CoDreamer: Communication-Based Decentralised World Models

abstract: Sample efficiency is a critical challenge in reinforcement learning. Model-based RL has emerged as a solution, but its application has largely been confined to single-agent scenarios. In this work, we introduce CoDreamer, an extension of the Dreamer algorithm for multi-agent environments. CoDreamer leverages Graph Neural Networks for a two-level communication system to tackle challenges such as partial observability and inter-agent cooperation. Communication is separately utilised within the learned world models and within the learned policies of each agent to enhance modelling and task-solving. We show that CoDreamer offers greater expressive power than a naive application of Dreamer, and we demonstrate its superiority over baseline methods across various multi-agent environments.


title: Self-normalized Sums in Free Probability Theory

abstract: We show that the distribution of self-normalized sums of free self-adjoint random variables converges weakly to Wigner's semicircle law under appropriate conditions and estimate the rate of convergence in terms of the Kolmogorov distance. In the case of free identically distributed self-adjoint bounded random variables, we retrieve the standard rate of order $n^{-1/2}$ up to a logarithmic factor, whereas we obtain a rate of order $n^{-1/4}$ in the corresponding unbounded setting. These results provide free versions of certain self-normalized limit theorems in classical probability theory.


title: Parameter Training Efficiency Aware Resource Allocation for AIGC in Space-Air-Ground Integrated Networks

abstract: With the evolution of artificial intelligence-generated content (AIGC) techniques and the development of space-air-ground integrated networks (SAGIN), there will be a growing opportunity to enhance more users' mobile experience with customized AIGC applications. This is made possible through the use of parameter-efficient fine-tuning (PEFT) training alongside mobile edge computing. In this paper, we formulate the optimization problem of maximizing the parameter training efficiency of the SAGIN system over wireless networks under limited resource constraints. We propose the Parameter training efficiency Aware Resource Allocation (PARA) technique to jointly optimize user association, data offloading, and communication and computational resource allocation. Solid proofs are presented to solve this difficult sum of ratios problem based on quadratically constrained quadratic programming (QCQP), semidefinite programming (SDP), graph theory, and fractional programming (FP) techniques. Our proposed PARA technique is effective in finding a stationary point of this non-convex problem. The simulation results demonstrate that the proposed PARA method outperforms other baselines.


title: Formation of a Magnetic Cloud from the Merging of Two Successive Coronal Mass Ejections

abstract: On 2022 March 28 two successive coronal mass ejections (CMEs) were observed by multiple spacecraft and resulted in a magnetic cloud (MC) at 1 AU. We investigate the propagation and interaction properties of the two CMEs correlated with the MC using coordinated multi-point remote sensing and in situ observations from Solar Orbiter, STEREO A, SOHO, and Wind. The first CME was triggered by a filament eruption with a high inclination angle. Roughly 9 hr later, the second CME originating from the same active region erupted with a smaller tilt angle and faster speed compared to the first one. The second CME overtook the preceding CME and formed a merged front at approximately 75 \rsun{}, which developed into a complex ejecta at 1 AU. The descending speed and low proton temperature inside the complex ejecta suggest that the two CMEs have fully merged before reaching 1 AU, leading them to begin expanding rather than compressing against each other. The complex ejecta appears to have the magnetic field and plasma signatures of an MC, although there is a discontinuity in the magnetic field implying previous interactions. The cross section of the complex ejecta, reconstructed from in situ data using a Grad-Shafranov technique, exhibits a right--handed flux rope structure. These results highlight that an MC--like complex ejecta lacking interaction features could arise from the complete merging of two CMEs.


title: Root Cause Localization for Microservice Systems in Cloud-edge Collaborative Environments

abstract: With the development of cloud-native technologies, microservice-based software systems face challenges in accurately localizing root causes when failures occur. Additionally, the cloud-edge collaborative environment introduces more difficulties, such as unstable networks and high latency across network segments. Accurately identifying the root cause of microservices in a cloud-edge collaborative environment has thus become an urgent problem. In this paper, we propose MicroCERCL, a novel approach that pinpoints root causes at the kernel and application level in the cloud-edge collaborative environment. Our key insight is that failures propagate through direct invocations and indirect resource-competition dependencies in a cloud-edge collaborative environment characterized by instability and high latency. This will become more complex in the hybrid deployment that simultaneously involves multiple microservice systems. Leveraging this insight, we extract valid contents from kernel-level logs to prioritize localizing the kernel-level root cause. Moreover, we construct a heterogeneous dynamic topology stack and train a graph neural network model to accurately localize the application-level root cause without relying on historical data. Notably, we released the first benchmark hybrid deployment microservice system in a cloud-edge collaborative environment (the largest and most complex within our knowledge). Experiments conducted on the dataset collected from the benchmark show that MicroCERCL can accurately localize the root cause of microservice systems in such environments, significantly outperforming state-of-the-art approaches with an increase of at least 24.1% in top-1 accuracy.


title: Nicer Than Humans: How do Large Language Models Behave in the Prisoner's Dilemma?

abstract: The behavior of Large Language Models (LLMs) as artificial social agents is largely unexplored, and we still lack extensive evidence of how these agents react to simple social stimuli. Testing the behavior of AI agents in classic Game Theory experiments provides a promising theoretical framework for evaluating the norms and values of these agents in archetypal social situations. In this work, we investigate the cooperative behavior of Llama2 when playing the Iterated Prisoner's Dilemma against random adversaries displaying various levels of hostility. We introduce a systematic methodology to evaluate an LLM's comprehension of the game's rules and its capability to parse historical gameplay logs for decision-making. We conducted simulations of games lasting for 100 rounds, and analyzed the LLM's decisions in terms of dimensions defined in behavioral economics literature. We find that Llama2 tends not to initiate defection but it adopts a cautious approach towards cooperation, sharply shifting towards a behavior that is both forgiving and non-retaliatory only when the opponent reduces its rate of defection below 30%. In comparison to prior research on human participants, Llama2 exhibits a greater inclination towards cooperative behavior. Our systematic approach to the study of LLMs in game theoretical scenarios is a step towards using these simulations to inform practices of LLM auditing and alignment.


title: DDLNet: Boosting Remote Sensing Change Detection with Dual-Domain Learning

abstract: Remote sensing change detection (RSCD) aims to identify the changes of interest in a region by analyzing multi-temporal remote sensing images, and has an outstanding value for local development monitoring. Existing RSCD methods are devoted to contextual modeling in the spatial domain to enhance the changes of interest. Despite the satisfactory performance achieved, the lack of knowledge in the frequency domain limits the further improvement of model performance. In this paper, we propose DDLNet, a RSCD network based on dual-domain learning (i.e., frequency and spatial domains). In particular, we design a Frequency-domain Enhancement Module (FEM) to capture frequency components from the input bi-temporal images using Discrete Cosine Transform (DCT) and thus enhance the changes of interest. Besides, we devise a Spatial-domain Recovery Module (SRM) to fuse spatiotemporal features for reconstructing spatial details of change representations. Extensive experiments on three benchmark RSCD datasets demonstrate that the proposed method achieves state-of-the-art performance and reaches a more satisfactory accuracy-efficiency trade-off. Our code is publicly available at https://github.com/xwmaxwma/rschange.


title: Ultra-High-Definition Restoration: New Benchmarks and A Dual Interaction Prior-Driven Solution

abstract: Ultra-High-Definition (UHD) image restoration has acquired remarkable attention due to its practical demand. In this paper, we construct UHD snow and rain benchmarks, named UHD-Snow and UHD-Rain, to remedy the deficiency in this field. The UHD-Snow/UHD-Rain is established by simulating the physics process of rain/snow into consideration and each benchmark contains 3200 degraded/clear image pairs of 4K resolution. Furthermore, we propose an effective UHD image restoration solution by considering gradient and normal priors in model design thanks to these priors' spatial and detail contributions. Specifically, our method contains two branches: (a) feature fusion and reconstruction branch in high-resolution space and (b) prior feature interaction branch in low-resolution space. The former learns high-resolution features and fuses prior-guided low-resolution features to reconstruct clear images, while the latter utilizes normal and gradient priors to mine useful spatial features and detail features to guide high-resolution recovery better. To better utilize these priors, we introduce single prior feature interaction and dual prior feature interaction, where the former respectively fuses normal and gradient priors with high-resolution features to enhance prior ones, while the latter calculates the similarity between enhanced prior ones and further exploits dual guided filtering to boost the feature interaction of dual priors. We conduct experiments on both new and existing public datasets and demonstrate the state-of-the-art performance of our method on UHD image low-light enhancement, UHD image desonwing, and UHD image deraining. The source codes and benchmarks are available at \url{https://github.com/wlydlut/UHDDIP}.


title: Wiretapped Commitment over Binary Channels

abstract: We propose the problem of wiretapped commitment, where two parties, say committer Alice and receiver Bob, engage in a commitment protocol using a noisy channel as a resource, in the presence of an eavesdropper, say Eve. Noisy versions of Alice's transmission over the wiretap channel are received at both Bob and Eve. We seek to determine the maximum commitment throughput in the presence of an eavesdropper, i.e., wiretapped commitment capacity, where in addition to the standard security requirements for two-party commitment, one seeks to ensure that Eve doesn't learn about the commit string. A key interest in this work is to explore the effect of collusion (or lack of it) between the eavesdropper Eve and either Alice or Bob. Toward the same, we present results on the wiretapped commitment capacity under the so-called 1-private regime (when Alice or Bob cannot collude with Eve) and the 2-private regime (when Alice or Bob may possibly collude with Eve).


title: 3D Visualization Reveals the Cooling Rate Dependent Crystallization near a Wall in Dense Microgel Systems

abstract: Controlled crystallization, melting and vitrification are important fundamental processes in nature and technology. However, the microscopic details of these fundamental phenomena still lack understanding, in particular how the cooling rate and presence of a wall influence the crystal nucleation and glass formation. Thermoresponsive microgels provide the possibility to study phase transitions on a single-particle level, owing to the ability to tune the particle size with temperature. In this study, we employ composite microgels consisting of a hard core and a crosslinked poly(N-isopropyl acrylamide-co-methacrylic acid) shell to study the crystallization of dense suspensions of soft colloids near a wall using confocal microscopy. We investigate the effect of cooling rate on the fluid-to-solid transition close to the sample wall. The structures formed during cooling range from glassy in case of a rapid temperature quench, to crystalline when a slow cooling rate is used. Detailed analysis of the final structure reveals that the cooling rate also sets the degree of alignment of the crystal domains with the wall as a result of a balance between homogeneous and heterogenous crystal nucleation. The results presented here yield valuable insight into the microscopic details of temperature-controlled crystallization near a wall. This understanding will help pave the way towards optimal crystallization conditions for microgel applications.


title: Towards the optimization of a perovskite-based room temperature ozone sensor: A multifaceted approach in pursuit of sensitivity, stability, and understanding of mechanism

abstract: Metal halide perovskites (MHPs) have attracted significant attention owing to their simple manufacturing process and unique optoelectronic properties. Their reversible electrical or optical properties changes in response to oxidizing or reducing environments make them prospective materials for gas detection technologies. Despite advancements in perovskite-based sensor research, the mechanisms behind perovskite-gas interactions, vital for sensor performance, are still unexclusive. This work presents the first evaluation of the sensing performance and long-term stability of MHPs, considering factors such as halide composition variation and Mn doping levels. The research reveals a clear correlation between halide composition and sensing behavior, with Br-rich sensors displaying a p-type response to O3 gas, while Cl-based counterparts exhibit an n-type sensing behavior. Notably, Mn-doping significantly enhances the O3 sensing performance by facilitating the gas adsorption process, as supported by both atomistic simulations and experimental evidence. Long-term evaluation of the sensors provides valuable insights into evolving sensing behaviors, highlighting the impact of dynamic instabilities over time. Overall, this research offers insights into optimal halide combination and Mn-doping levels, representing a significant step forward in engineering room temperature perovskite-based gas sensors that are not only low-cost and high-performing but also durable, marking a new era in sensor technology.


title: Solving k-SAT problems with generalized quantum measurement

abstract: We generalize the projection-based quantum measurement-driven $k$-SAT algorithm of Benjamin, Zhao, and Fitzsimons (BZF, arxiv:1711.02687) to arbitrary strength quantum measurements, including the limit of continuous monitoring. In doing so, we clarify that this algorithm is a particular case of the measurement-driven quantum control strategy elsewhere referred to as "Zeno dragging". We argue that the algorithm is most efficient with finite time and measurement resources in the continuum limit, where measurements have an infinitesimal strength and duration. Moreover, for solvable $k$-SAT problems, the dynamics generated by the algorithm converge deterministically towards target dynamics in the long-time (Zeno) limit, implying that the algorithm can successfully operate autonomously via Lindblad dissipation, without detection. We subsequently study both the conditional and unconditional dynamics of the algorithm implemented via generalized measurements, quantifying the advantages of detection for heralding errors. These strategies are investigated first in a computationally-trivial $2$-qubit $2$-SAT problem to build intuition, and then we consider the scaling of the algorithm on $3$-SAT problems encoded with $4 - 10$ qubits. The average number of shots needed to obtain a solution scales with qubit number as $\lambda^n$. For vanishing dragging time (with final readout only), we find $\lambda = 2$ (corresponding to a brute-force search over possible solutions). However, the deterministic (autonomous) property of the algorithm in the adiabatic (Zeno) limit implies that we can drive $\lambda$ arbitrarily close to $1$, at the cost of a growing pre-factor. We numerically investigate the tradeoffs in these scalings with respect to algorithmic runtime and assess their implications for using this analog measurement-driven approach to quantum computing in practice.


title: On Computation of Approximate Solutions to Large-Scale Backstepping Kernel Equations via Continuum Approximation

abstract: We provide two methods for computation of continuum backstepping kernels that arise in control of continua (ensembles) of linear hyperbolic PDEs and which can approximate backstepping kernels arising in control of a large-scale, PDE system counterpart (with computational complexity that does not grow with the number of state components of the large-scale system). In the first method, we identify a class of systems for which the solution to the continuum (and hence, also an approximate solution to the respective large-scale) kernel equations can be constructed in closed form. In the second method, we provide explicit formulae for the solution to the continuum kernels PDEs, employing a (triple) power series representation of the continuum kernel and establishing its convergence properties. In this case, we also provide means for reducing computational complexity by properly truncating the power series (in the powers of the ensemble variable). We also present numerical examples to illustrate computational efficiency/accuracy of the approaches, as well as to validate the stabilization properties of the approximate control kernels, constructed based on the continuum.


title: Einasto gravitational potentials have difficulty to hold spherically symmetric stellar systems with cores

abstract: It was known that an ideal spherically symmetric stellar system with isotropic velocities and an inner core cannot reside in a Navarro, Frenk, and White (NFW) gravitational potential. The incompatibility can be pinned down to the radial gradient of the NFW potential in the very center of the system, which differs from zero. The gradient is identically zero in an Einasto potential, also an alternative representation of the dark matter (DM) halos created by the kind of cold DM (CDM) defining the current cosmological model. Here we show that, despite the inner gradient being zero, stellar cores are also inconsistent with Einasto potentials. This result may have implications to constrain the nature of DM through interpreting the stellar cores often observed in dwarf galaxies.


title: Relative Time-of-Flight Measurement in an Ultrafast Electron Microscope

abstract: Efforts to push the spatiotemporal imaging-resolution limits of femtosecond (fs) laser-driven ultrafast electron microscopes (UEMs) to the combined angstrom-fs range will benefit from stable sources capable of generating high bunch charges. Recent demonstration of unconventional off-axis photoemitting geometries are promising, but connections to the observed onset of structural dynamics are yet to be established. Here we use the in-situ photoexcitation of coherent phonons to quantify the relative time-of-flight (r-TOF) of photoelectron packets generated from the Ni Wehnelt aperture and from a Ta cathode set-back from the aperture plane. We further support the UEM experiments with particle-tracing simulations of the precise electron-gun architecture and photoemitting geometries. In this way, we measure discernable shifts in electron-packet TOF of tens of picoseconds for the two photoemitting surfaces. These shifts arise from the impact the Wehnelt-aperture off-axis orientation has on the electron-momentum distribution, which modifies both the collection efficiency and the temporal-packet distribution relative to on-axis emission. Future needs are identified; we expect this and other developments in UEM electron-gun configuration to expand the range of materials phenomena that can be directly imaged on scales commensurate with fundamental structural dynamics.


title: Landau Level Single-Electron Pumping

abstract: We present the first detailed study of the effect of a strong magnetic field on single-electron pumping in a device utilising a finger-gate split-gate configuration. In the quantum Hall regime, we demonstrate electron pumping from Landau levels in the leads, where the measurements exhibit pronounced oscillations in the lengths of the pumping plateaus with the magnetic field, reminiscent of Shubnikov-de Haas oscillations. This similarity indicates that the pumping process is dependent on the density of states of the 2D electron gas over a narrow energy window. Based on these observations, we develop a new theoretical description of the operation of single-electron pumps which for the first time allows for the determination of the physical parameters of the experiment; such as the capture energy of the electrons, the broadening of the quantised Landau levels in the leads, and the quantum lifetime of the electrons.


title: Entangled Matter-waves for Quantum Enhanced Sensing

abstract: The ability to create and harness entanglement is crucial to the fields of quantum sensing andsimulation, and ultracold atom-cavity systems offer pristine platforms for this undertaking. Recently, an experiment demonstrated an effective momentum-exchange interaction between atoms in a common cavity mode. Here, we derive this interaction from a general atom-cavity model, and discuss the role of the cavity frequency shift in response to atomic motion. We show the cavity response leads to many different squeezing interactions between the atomic momentum states. Furthermore, when the atoms form a density grating, the collective motion leads to one-axis twisting, a many-body energy gap, and metrologically useful entanglement even in the presence of noise. This system offers a highly tunable, many-body quantum sensor and simulator.


title: Optimizing Psychological Counseling with Instruction-Tuned Large Language Models

abstract: The advent of large language models (LLMs) has significantly advanced various fields, including natural language processing and automated dialogue systems. This paper explores the application of LLMs in psychological counseling, addressing the increasing demand for mental health services. We present a method for instruction tuning LLMs with specialized prompts to enhance their performance in providing empathetic, relevant, and supportive responses. Our approach involves developing a comprehensive dataset of counseling-specific prompts, refining them through feedback from professional counselors, and conducting rigorous evaluations using both automatic metrics and human assessments. The results demonstrate that our instruction-tuned model outperforms several baseline LLMs, highlighting its potential as a scalable and accessible tool for mental health support.


title: In-Context Former: Lightning-fast Compressing Context for Large Language Model

abstract: With the rising popularity of Transformer-based large language models (LLMs), reducing their high inference costs has become a significant research focus. One effective approach is to compress the long input contexts. Existing methods typically leverage the self-attention mechanism of the LLM itself for context compression. While these methods have achieved notable results, the compression process still involves quadratic time complexity, which limits their applicability. To mitigate this limitation, we propose the In-Context Former (IC-Former). Unlike previous methods, IC-Former does not depend on the target LLMs. Instead, it leverages the cross-attention mechanism and a small number of learnable digest tokens to directly condense information from the contextual word embeddings. This approach significantly reduces inference time, which achieves linear growth in time complexity within the compression range. Experimental results indicate that our method requires only 1/32 of the floating-point operations of the baseline during compression and improves processing speed by 68 to 112 times while achieving over 90% of the baseline performance on evaluation metrics. Overall, our model effectively reduces compression costs and makes real-time compression scenarios feasible.


title: Generative Modeling by Minimizing the Wasserstein-2 Loss

abstract: This paper approaches the unsupervised learning problem by minimizing the second-order Wasserstein loss (the $W_2$ loss). The minimization is characterized by a distribution-dependent ordinary differential equation (ODE), whose dynamics involves the Kantorovich potential between a current estimated distribution and the true data distribution. A main result shows that the time-marginal law of the ODE converges exponentially to the true data distribution. To prove that the ODE has a unique solution, we first construct explicitly a solution to the associated nonlinear Fokker-Planck equation and show that it coincides with the unique gradient flow for the $W_2$ loss. Based on this, a unique solution to the ODE is built from Trevisan's superposition principle and the exponential convergence results. An Euler scheme is proposed for the distribution-dependent ODE and it is shown to correctly recover the gradient flow for the $W_2$ loss in the limit. An algorithm is designed by following the scheme and applying persistent training, which is natural in our gradient-flow framework. In both low- and high-dimensional experiments, our algorithm converges much faster than and outperforms Wasserstein generative adversarial networks, by increasing the level of persistent training appropriately.


title: An Algorithm for the Assignment Game Beyond Additive Valuations

abstract: The assignment game, introduced by Shapley and Shubik (1971), is a classic model for two-sided matching markets between buyers and sellers. In the original assignment game, it is assumed that payments lead to transferable utility and that buyers have unit-demand valuations for the items being sold. Two important and mostly independent lines of work have studied more general settings with imperfectly transferable utility and gross substitutes valuations. Multiple efficient algorithms have been proposed for computing a competitive equilibrium, the standard solution concept in assignment games, in these two settings. Our main result is an efficient algorithm for computing competitive equilibria in a setting with both imperfectly transferable utility and gross substitutes valuations. Our algorithm combines augmenting path techniques from maximum matching and algorithms for matroid intersection. We also show that, in a mild generalization of our model, computing a competitive equilibrium is NP-hard.


title: Improving Visual Commonsense in Language Models via Multiple Image Generation

abstract: Commonsense reasoning is fundamentally based on multimodal knowledge. However, existing large language models (LLMs) are primarily trained using textual data only, limiting their ability to incorporate essential visual information. In contrast, Visual Language Models, which excel at visually-oriented tasks, often fail at non-visual tasks such as basic commonsense reasoning. This divergence highlights a critical challenge - the integration of robust visual understanding with foundational text-based language reasoning. To this end, we introduce a method aimed at enhancing LLMs' visual commonsense. Specifically, our method generates multiple images based on the input text prompt and integrates these into the model's decision-making process by mixing their prediction probabilities. To facilitate multimodal grounded language modeling, we employ a late-fusion layer that combines the projected visual features with the output of a pre-trained LLM conditioned on text only. This late-fusion layer enables predictions based on comprehensive image-text knowledge as well as text only when this is required. We evaluate our approach using several visual commonsense reasoning tasks together with traditional NLP tasks, including common sense reasoning and reading comprehension. Our experimental results demonstrate significant superiority over existing baselines. When applied to recent state-of-the-art LLMs (e.g., Llama3), we observe improvements not only in visual common sense but also in traditional NLP benchmarks. Code and models are available under https://github.com/guyyariv/vLMIG.


title: A Sound and Complete Substitution Algorithm for Multimode Type Theory: Technical Report

abstract: This is the technical report accompanying the paper "A Sound and Complete Substitution Algorithm for Multimode Type Theory" [Ceulemans, Nuyts and Devriese, 2024]. It contains a full definition of Well-Scoped Multimode Type Theory (WSMTT) in Section 2, including many rules for $\sigma$-equivalence and a description of all rules that have been omitted. Furthermore, we present completeness and soundness proofs of the substitution algorithm in full detail. These can be found in Sections 4 and 5 respectively. In order to make this document relatively self-contained, we also include a description of Substitution-Free Multimode Type Theory (SFMTT) in Section 3.


title: Revealing the burning and soft heart of the bright bare AGN ESO 141-G55: X-ray broadband and SED analysis

abstract: [Abridged] ESO 141-G55 is a nearby X-ray bright BLS1, which has been classified as a bare AGN due to the lack of warm absorption along its line-of-sight, providing an unhampered view into its disc-corona system. We aim to probe its disc-corona system thanks to the first simultaneous XMM-Newton and NuSTAR observation obtained on October 1-2, 2022. We carry out the X-ray broadband spectral analysis to determine the dominant process(es) at work, as well as the SED analysis to determine the disc-corona properties. The simultaneous broadband X-ray spectrum of ESO 141-G55 is characterised by the presence of a prominent smooth soft X-ray excess, a broad Fe K emission line and a significant Compton hump. The RGS spectra confirmed the lack of intrinsic warm-absorbing gas along our line of sight in the AGN rest frame, confirming that it is still in a bare state. However, soft X-ray emission lines are observed indicating substantial warm gas out of our line of sight. The intermediate inclination of the disc-corona system, ~43{\deg}, may offer us a favourable configuration to observe UFOs from the disc, but none is found in this 2022 observation, contrary to a previous 2007 XMM-Newton one. Relativistic reflection alone on a standard disc is ruled out from the X-ray broadband analysis, while a combination of soft and hard Comptonisation by a warm and hot corona (relagn), plus relativistic reflection (reflkerrd) reproduces its SED quite well. The hot corona temperature is very hot, ~140 keV, much higher than about 80% of the AGNs, whereas the warm corona temperature, ~0.3 keV, is similar to the values found in other sub-Eddington AGNs. ESO 141-G55 is accreting at a moderate Eddington accretion rate (~10--20%). Our analysis points to a significant contribution of an optically-thick warm corona to both the soft X-ray and UV emission in ESO 141-G55.


title: Generalized $ \widetilde{W} $ algebras

abstract: Recently, a new generalized family of infinite-dimensional $ \widetilde{W} $ algebras, each associated with a particular element of a commutative subalgebra of the $ W_{1+\infty} $ algebra, was described. This paper provides a comprehensive account of the aforementioned association, accompanied by the requisite proofs and illustrative examples. This approach allows a derivation of Ward identities for selected WLZZ matrix models and the expansion of corresponding $ W $-operators in terms of an infinite set of variables $ p_k $.


title: Enhance the Image: Super Resolution using Artificial Intelligence in MRI

abstract: This chapter provides an overview of deep learning techniques for improving the spatial resolution of MRI, ranging from convolutional neural networks, generative adversarial networks, to more advanced models including transformers, diffusion models, and implicit neural representations. Our exploration extends beyond the methodologies to scrutinize the impact of super-resolved images on clinical and neuroscientific assessments. We also cover various practical topics such as network architectures, image evaluation metrics, network loss functions, and training data specifics, including downsampling methods for simulating low-resolution images and dataset selection. Finally, we discuss existing challenges and potential future directions regarding the feasibility and reliability of deep learning-based MRI super-resolution, with the aim to facilitate its wider adoption to benefit various clinical and neuroscientific applications.


title: Fine-Tuning Gemma-7B for Enhanced Sentiment Analysis of Financial News Headlines

abstract: In this study, we explore the application of sentiment analysis on financial news headlines to understand investor sentiment. By leveraging Natural Language Processing (NLP) and Large Language Models (LLM), we analyze sentiment from the perspective of retail investors. The FinancialPhraseBank dataset, which contains categorized sentiments of financial news headlines, serves as the basis for our analysis. We fine-tuned several models, including distilbert-base-uncased, Llama, and gemma-7b, to evaluate their effectiveness in sentiment classification. Our experiments demonstrate that the fine-tuned gemma-7b model outperforms others, achieving the highest precision, recall, and F1 score. Specifically, the gemma-7b model showed significant improvements in accuracy after fine-tuning, indicating its robustness in capturing the nuances of financial sentiment. This model can be instrumental in providing market insights, risk management, and aiding investment decisions by accurately predicting the sentiment of financial news. The results highlight the potential of advanced LLMs in transforming how we analyze and interpret financial information, offering a powerful tool for stakeholders in the financial industry.


title: Can AI be enabled to dynamical downscaling? Training a Latent Diffusion Model to mimic km-scale COSMO-CLM downscaling of ERA5 over Italy

abstract: Downscaling techniques are one of the most prominent applications of Deep Learning (DL) in Earth System Modeling. A robust DL downscaling model can generate high-resolution fields from coarse-scale numerical model simulations, saving the timely and resourceful applications of regional/local models. Additionally, generative DL models have the potential to provide uncertainty information, by generating ensemble-like scenario pools, a task that is computationally prohibitive for traditional numerical simulations. In this study, we apply a Latent Diffusion Model (LDM) to downscale ERA5 data over Italy up to a resolution of 2 km. The high-resolution target data consists of results from a high-resolution dynamical downscaling performed with COSMO-CLM. Our goal is to demonstrate that recent advancements in generative modeling enable DL-based models to deliver results comparable to those of numerical dynamical downscaling models, given the same input data (i.e., ERA5 data), preserving the realism of fine-scale features and flow characteristics. The training and testing database consists of hourly data from 2000 to 2020. The target variables of this study are 2-m temperature and 10-m horizontal wind components. A selection of predictors from ERA5 is used as input to the LDM, and a residual approach against a reference UNET is leveraged in applying the LDM. The performance of the generative LDM is compared with reference baselines of increasing complexity: quadratic interpolation of ERA5, a UNET, and a Generative Adversarial Network (GAN) built on the same reference UNET. Results highlight the improvements introduced by the LDM architecture and the residual approach over these baselines. The models are evaluated on a yearly test dataset, assessing the models' performance through deterministic metrics, spatial distribution of errors, and reconstruction of frequency and power spectra distributions.


title: Stability of extremal domains for the first eigenvalue of the Laplacian operator

abstract: In this paper, we compute the second variation of the first Dirichlet eigenvalue on extremal domains and establish criteria for stability. We classify the stable extremal domains in the 2-sphere and in higher-dimensional spheres when the boundary is minimal. We also prove topological bounds for stable domains with nonnegative total Gaussian curvature in a general compact Riemannian surface.