title: Front propagation through a perforated wall

abstract: We consider a bistable reaction-diffusion equation $u_t=\Delta u +f(u)$ on $\mathbb{R}^N$ in the presence of an obstacle $K$, which is a wall of infinite span with many holes. More precisely, $K$ is a closed subset of $\mathbb{R}^N$ with smooth boundary such that its projection onto the $x_1$-axis is bounded and that $\mathbb{R}^N \setminus K$ is connected. Our goal is to study what happens when a planar traveling front coming from $x_1 = -\infty$ meets the wall $K$.We first show that there is clear dichotomy between "propagation" and "blocking". In other words, the traveling front either passes through the wall and propagates toward $x_1=+\infty$ (propagation) or is trapped around the wall (blocking), and that there is no intermediate behavior. This dichotomy holds for any type of walls of finite thickness. Next we discuss sufficient conditions for blocking and propagation. For blocking, assuming either that $K$ is periodic in $y:=(x_2,\ldots, x_N)$ or that the holes are localized within a bounded area, we show that blocking occurs if the holes are sufficiently narrow. For propagation, three different types of sufficient conditions for propagation will be presented, namely "walls with large holes", "small-capacity walls", and "parallel-blade walls". We also discuss complete and incomplete invasions.


title: CDeFuse: Continuous Decomposition for Infrared and Visible Image Fusion

abstract: As a common image processing technique, image decomposition is often used to extract complementary information between modalities. In current decomposition-based image fusion methods, typically, source images are decomposed into three parts at single scale (i.e., visible-exclusive part, infrared-exclusive part, and common part) and lacking interaction between modalities during the decomposition process. These results in the inability of fusion images to effectively focus on finer complementary information between modalities at various scales. To address the above issue, a novel decomposition mechanism, Continuous Decomposition Fusion (CDeFuse), is proposed. Firstly, CDeFuse extends the original three-part decomposition to a more general K-part decomposition at each scale through similarity constraints to fuse multi-scale information and achieve a finer representation of decomposition features. Secondly, a Continuous Decomposition Module (CDM) is introduced to assist K-part decomposition. Its core component, State Transformer (ST), efficiently captures complementary information between modalities by utilizing multi-head self-attention mechanism. Finally, a novel decomposition loss function and the corresponding computational optimization strategy are utilized to ensure the smooth progress of the decomposition process while maintaining linear growth in time complexity with the number of decomposition results K. Extensive experiments demonstrate that our CDeFuse achieves comparable performance compared to previous methods. The code will be publicly available.


title: Higher-order Structure Based Anomaly Detection on Attributed Networks

abstract: Anomaly detection (such as telecom fraud detection and medical image detection) has attracted the increasing attention of people. The complex interaction between multiple entities widely exists in the network, which can reflect specific human behavior patterns. Such patterns can be modeled by higher-order network structures, thus benefiting anomaly detection on attributed networks. However, due to the lack of an effective mechanism in most existing graph learning methods, these complex interaction patterns fail to be applied in detecting anomalies, hindering the progress of anomaly detection to some extent. In order to address the aforementioned issue, we present a higher-order structure based anomaly detection (GUIDE) method. We exploit attribute autoencoder and structure autoencoder to reconstruct node attributes and higher-order structures, respectively. Moreover, we design a graph attention layer to evaluate the significance of neighbors to nodes through their higher-order structure differences. Finally, we leverage node attribute and higher-order structure reconstruction errors to find anomalies. Extensive experiments on five real-world datasets (i.e., ACM, Citation, Cora, DBLP, and Pubmed) are implemented to verify the effectiveness of GUIDE. Experimental results in terms of ROC-AUC, PR-AUC, and Recall@K show that GUIDE significantly outperforms the state-of-art methods.


title: Mean-field limit of non-exchangeable multi-agent systems over hypergraphs with unbounded rank

abstract: Interacting particle systems are known for their ability to generate large-scale self-organized structures from simple local interaction rules between each agent and its neighbors. In addition to studying their emergent behavior, a main focus of the mathematical community has been concentrated on deriving their large-population limit. In particular, the mean-field limit consists of describing the limit system by its population density in the product space of positions and labels. The strategy to derive such limits is often based on a careful combination of methods ranging from analysis of PDEs and stochastic analysis, to kinetic equations and graph theory. In this article, we focus on a generalization of multi-agent systems that includes higher-order interactions, which has largely captured the attention of the applied community in the last years. In such models, interactions between individuals are no longer assumed to be binary ({\it i.e.} between a pair of particles). Instead, individuals are allowed to interact by groups so that a full group jointly generates a non-linear force on any given individual. The underlying graph of connections is then replaced by a hypergraph, which we assume to be dense, but possibly non uniform and of unbounded rank. For the first time in the literature, we show that when the interaction kernels are regular enough, then the mean-field limit is determined by a limiting Vlasov-type equation, where the hypergraph limit is encoded by a so-called UR-hypergraphon (unbounded-rank hypergraphon), and where the resulting mean-field force admits infinitely-many orders of interactions.


title: Mixture-of-Agents Enhances Large Language Model Capabilities

abstract: Recent advances in large language models (LLMs) demonstrate substantial capabilities in natural language understanding and generation tasks. With the growing number of LLMs, how to harness the collective expertise of multiple LLMs is an exciting open direction. Toward this goal, we propose a new approach that leverages the collective strengths of multiple LLMs through a Mixture-of-Agents (MoA) methodology. In our approach, we construct a layered MoA architecture wherein each layer comprises multiple LLM agents. Each agent takes all the outputs from agents in the previous layer as auxiliary information in generating its response. MoA models achieves state-of-art performance on AlpacaEval 2.0, MT-Bench and FLASK, surpassing GPT-4 Omni. For example, our MoA using only open-source LLMs is the leader of AlpacaEval 2.0 by a substantial gap, achieving a score of 65.1% compared to 57.5% by GPT-4 Omni.


title: LLM-Vectorizer: LLM-based Verified Loop Vectorizer

abstract: Vectorization is a powerful optimization technique that significantly boosts the performance of high performance computing applications operating on large data arrays. Despite decades of research on auto-vectorization, compilers frequently miss opportunities to vectorize code. On the other hand, writing vectorized code manually using compiler intrinsics is still a complex, error-prone task that demands deep knowledge of specific architecture and compilers. In this paper, we evaluate the potential of large-language models (LLMs) to generate vectorized (Single Instruction Multiple Data) code from scalar programs that process individual array elements. We propose a novel finite-state machine multi-agents based approach that harnesses LLMs and test-based feedback to generate vectorized code. Our findings indicate that LLMs are capable of producing high performance vectorized code with run-time speedup ranging from 1.1x to 9.4x as compared to the state-of-the-art compilers such as Intel Compiler, GCC, and Clang. To verify the correctness of vectorized code, we use Alive2, a leading bounded translation validation tool for LLVM IR. We describe a few domain-specific techniques to improve the scalability of Alive2 on our benchmark dataset. Overall, our approach is able to verify 38.2% of vectorizations as correct on the TSVC benchmark dataset.


title: Colored Petri Nets for Modeling and Simulation of a Green Supply Chain System

abstract: Green supply chain is an emerging approach in supply chain management to reduce environmental impact of the process concerning the flow of goods and materials. As a discrete-event system, supply chain can be modeled using Petri Nets. Colored Petri Nets (CPNs) extend the classical Petri net formalism with data, time and hierarchy. These extensions makes it possible to deal with the green aspects of the supply chain.This paper deals with the Colored Petri Net approach to model and simulate a green supply chain system. The forward supply chain network starts from the raw material suppliers, to the manufacturers, wholesalers, retailers and to the final customers. The reverse supply chain network is made of collecting points, recycling plants, disassembly plants,and secondary material market. A government environment agency plays the role of regulation of the recycling process. A colored Petri net model of the green supply chain is developed and simulated with CPN Tools, a dedicated software for CPN models. The simulation results as well as the state-space analysis results validate the correctness of the model.


title: Interplay between preconditioning and regularization for linear ill-posed problems solved by conjugate gradient. Application to optical flow estimation

abstract: This paper investigates the possibilities offered by combining regularization and preconditioning by the same symmetric positive semi-definite operator when solving ill-posed problems. We study the question of the stopping criterion, and the possibility offered by Ritz eigenelements for the a posteriori filtering of the solution and the tuning of Tikhonov's weight. The method is applied as the linear solver for an optical flow estimator and it is coupled with a subspace recycling strategy.


title: PolySAT: Word-level Bit-vector Reasoning in Z3

abstract: PolySAT is a word-level decision procedure supporting bit-precise SMT reasoning over polynomial arithmetic with large bit-vector operations. The PolySAT calculus extends conflict-driven clause learning modulo theories with two key components: (i) a bit-vector plugin to the equality graph, and (ii) a theory solver for bit-vector arithmetic with non-linear polynomials. PolySAT implements dedicated procedures to extract bit-vector intervals from polynomial inequalities. For the purpose of conflict analysis and resolution, PolySAT comes with on-demand lemma generation over non-linear bit-vector arithmetic. PolySAT is integrated into the SMT solver Z3 and has potential applications in model checking and smart contract verification where bit-blasting techniques on multipliers/divisions do not scale.


title: Mechanism of instability in non-uniform dusty channel flow

abstract: Particles in pressure-driven channel flow are often inhomogeneously distributed. Two modes of low-Reynolds number instability, absent in Poiseuille flow of clean fluid, are created by inhomogeneous particle loading, and their mechanism is worked out here. Two distinct classes of behaviour are seen: when the critical layer of the dominant perturbation overlaps with variations in particle concentration, the new instabilities arise, which we term overlap modes. But when the layers are distinct, only the traditional Tollmien-Schlichting mode of instability occurs. We derive the dominant critical layer balance equations in this flow along the lines done classically for clean fluid. These reveal how concentration variations within the critical layer cause two the particle-driven instabilities. As a result of these variations, disturbance kinetic energy production is qualitatively and majorly altered. Surprisingly the two overlap modes, though completely different in the symmetry of the eigenstructure and regime of exponential growth, show practically identical energy budgets, highlighting the relevance of variations within the critical layer. The wall layer is shown to be unimportant. We derive a minimal composite theory comprising all terms in the complete equation which are dominant somewhere in the flow, and show that it contains the essential physics. When particles are infinitely dense relative to the fluid, the volume fraction is negligible. But for finite density ratios, the volume fraction of particles causes a profile of effective viscosity. This is shown to be uniformly stabilizing in the present flow. Gravity is neglected here, and will be important to study in future. So will transient growth of perturbations due to non-normality of the stability operator, in a quest for the mechanism of transition to turbulence.


title: Dielectric properties of a ferroelectric nematic material: quantitative test of the polarization-capacitance Goldstone mode

abstract: The recently discovered ferroelectric nematic (NF) liquid crystals (LC) have been reported to show an extraordinarily large value of the real part of the dielectric constant at low frequencies. However, it was argued by Clark et al in Physical Review Research 6, 013195 (2024) that what was measured was the capacitance of the insulating layer at LC/electrode surface and not that of the liquid crystal. Here we describe the results of dielectric spectroscopy measurements of an NF material in cells with variable thickness of the insulating layers. Our measurements quantitatively verify the model by Clark et al. Additionally, our measurements in cells with bare conducting indium tin oxide surface provide a crude estimate of epsilon perpendicular~100 in the NF phase.


title: Logic Synthesis with Generative Deep Neural Networks

abstract: While deep learning has achieved significant success in various domains, its application to logic circuit design has been limited due to complex constraints and strict feasibility requirement. However, a recent generative deep neural model, "Circuit Transformer", has shown promise in this area by enabling equivalence-preserving circuit transformation on a small scale. In this paper, we introduce a logic synthesis rewriting operator based on the Circuit Transformer model, named "ctrw" (Circuit Transformer Rewriting), which incorporates the following techniques: (1) a two-stage training scheme for the Circuit Transformer tailored for logic synthesis, with iterative improvement of optimality through self-improvement training; (2) integration of the Circuit Transformer with state-of-the-art rewriting techniques to address scalability issues, allowing for guided DAG-aware rewriting. Experimental results on the IWLS 2023 contest benchmark demonstrate the effectiveness of our proposed rewriting methods.


title: Zero Viscosity Limit of Steady Compressible Shear Flow with Navier-Slip Boundary

abstract: We investigate the existence and the zero viscosity limit of steady compressible shear flow with Navier-slip boundary condition in the absence of any external force in a two-dimension domain $\Omega=(0,L)\times(0,2)$. More precisely, under the assumption that the Mach number $\eta<\va^{\f12+}$ and $L\ll1$, we prove the existence of smooth solutions to steady compressible Naiver-Stokes equations near plane Poiseuille-Couette flow as well as the convergence of the solutions obtained above to the solutions of steady incompressible Euler equations when the viscous $\va$ tends to zero.


title: Transition to synchronization in adaptive Sakaguchi-Kuramoto model with higher-order interactions

abstract: We investigate the phenomenon of transition to synchronization in Sakaguchi-Kuramoto model in the presence of higher-order interactions and global order parameter adaptation. The investigation is done by performing extensive numerical simulations and low dimensional modeling of the system. Numerical simulations of the full system show both continuous (second order) as well as discontinuous transitions. The discontinuous transitions can either be associated with explosive (first order) or with tiered synchronization states depending on the choice of parameters. To develop an in depth understanding of the transition scenario in the parameter space we derive a reduced order model (ROM) using the Ott-Antonsen ansatz, the results of which closely matches with that of the numerical simulations of the full system. The simplicity and analytical accessibility of the ROM helps to conveniently unfold the transition scenario in the system having complex dependence on the parameters. Simultaneous analysis of the full system and the ROM clearly identifies the regions of the parameter space exhibiting different types of transitions. It is observed that the second order continuous transition is connected with a supercritical pitchfork bifurcation (PB) of the ROM. On the other hand, the discontinuous teired transition is associated with multiple saddle-node (SN) bifurcations along with a supercritical PB and the first order explosive transition involves a subcritical PB alongside a SN bifurcation.


title: Marking the Pace: A Blockchain-Enhanced Privacy-Traceable Strategy for Federated Recommender Systems

abstract: Federated recommender systems have been crucially enhanced through data sharing and continuous model updates, attributed to the pervasive connectivity and distributed computing capabilities of Internet of Things (IoT) devices. Given the sensitivity of IoT data, transparent data processing in data sharing and model updates is paramount. However, existing methods fall short in tracing the flow of shared data and the evolution of model updates. Consequently, data sharing is vulnerable to exploitation by malicious entities, raising significant data privacy concerns, while excluding data sharing will result in sub-optimal recommendations. To mitigate these concerns, we present LIBERATE, a privacy-traceable federated recommender system. We design a blockchain-based traceability mechanism, ensuring data privacy during data sharing and model updates. We further enhance privacy protection by incorporating local differential privacy in user-server communication. Extensive evaluations with the real-world dataset corroborate LIBERATE's capabilities in ensuring data privacy during data sharing and model update while maintaining efficiency and performance. Results underscore blockchain-based traceability mechanism as a promising solution for privacy-preserving in federated recommender systems.


title: Tangent spaces of diffeological spaces and their variants

abstract: Several methods have been proposed to define tangent spaces for diffeological spaces. Among them, the internal tangent functor is obtained as the left Kan extension of the tangent functor for manifolds. However, the right Kan extension of the same functor has not been well-studied. In this paper, we investigate the relationship between this right Kan extension and the external tangent space, another type of tangent space for diffeological spaces. We prove that by slightly modifying the inclusion functor used in the right Kan extension, we obtain a right tangent space functor, which is almost isomorphic to the external tangent space. Furthermore, we show that when a diffeological space satisfies a favorable property called smoothly regular, this right tangent space coincides with the right Kan extension mentioned earlier.


title: On $k$-submodular subgroups of finite groups

abstract: Let $n$ be a natural number. A subgroup $H$ of a group $G$ will be called $n$-modularly embedded in $G$ if either $H$ is normal in $G$ or $H\not= \mathrm{Core}_{G}(H)$, $|G:H| =p$ and $|G/\mathrm{Core}_{G}(H)|=pq^{n}$, $q^{n}$ divides $p-1$ for some primes $p$ and $q$. Let $k$ be a fixed natural number. A subgroup $H$ of a group $G$ will be called $k$-submodular in $G$ if there exists a chain $H = H_{0} \leq H_{1} \leq \cdots \leq H_{m-1} \leq H_{m} = G$ of subgroups such that $H_{i-1}$ is $n$-modularly embedded in $H_{i}$ for some natural $n\leq k$ and every $i = 1, \ldots , m$. In this article, properties of $k$-submodular subgroups and classes of groups with given systems of $k$-submodular subgroups are obtained.


title: EAIA: An Efficient and Anonymous Identity Authentication Scheme in 5G-V2V

abstract: Vehicle Ad-hoc Networks (VANETs) have experienced significant development in recent years, playing a crucial role in enhancing the driving experience by enabling safer and more efficient inter-vehicle interactions through information exchange. Vehicle-to-vehicle (V2V) communication is particularly vital as it not only helps to prevent collisions and improve traffic efficiency but also provides essential situational awareness to drivers or autonomous driving systems. Communication is typically supported by Roadside Units (RSUs); however, in practical applications, vehicles may exceed the communication range of RSUs, thus exposing them to various malicious attacks. Additionally, considering the limited computational resources of onboard units (OBUs) in vehicles, there is a high demand for designing lightweight security protocols that support V2V communication. To address this issue, this paper proposes an efficient anonymous V2V identity authentication protocol tailored for scenarios that lack RSU support. The proposed protocol has been formally assessed using the Scyther tool, demonstrating its capability to withstand major typical malicious attacks. Performance evaluations indicate that the proposed protocol is efficient in terms of communication and computational overhead, making it a viable solution for V2V vehicle communication.


title: Winner-takes-all learners are geometry-aware conditional density estimators

abstract: Winner-takes-all training is a simple learning paradigm, which handles ambiguous tasks by predicting a set of plausible hypotheses. Recently, a connection was established between Winner-takes-all training and centroidal Voronoi tessellations, showing that, once trained, hypotheses should quantize optimally the shape of the conditional distribution to predict. However, the best use of these hypotheses for uncertainty quantification is still an open question. In this work, we show how to leverage the appealing geometric properties of the Winner-takes-all learners for conditional density estimation, without modifying its original training scheme. We theoretically establish the advantages of our novel estimator both in terms of quantization and density estimation, and we demonstrate its competitiveness on synthetic and real-world datasets, including audio data.


title: Nonlinear Optimal Guidance with Constraints on Impact Time and Impact Angle

abstract: This paper aims to address the nonlinear optimal guidance problem with impact-time and impact-angle constraints, which is fundamentally important for multiple pursuers to collaboratively achieve a target. Addressing such a guidance problem is equivalent to solving a nonlinear minimum-effort control problem in real time. To this end, the Pontryagain's maximum principle is employed to convert extremal trajectories as the solutions of a parameterized differential system. The geometric property for the solution of the parameterized system is analyzed, leading to an additional optimality condition. By incorporating this optimality condition and the usual disconjugacy condition into the parameterized system, the dataset for optimal trajectories can be generated by propagating the parameterized system without using any optimization methods. In addition, a scaling invariance property is found for the solutions of the parameterized system. As a consequence of this scaling invariance property, a simple feedforward neural network trained by the solution of the parameterized system, selected at any fixed time, can be used to generate the nonlinear optimal guidance within milliseconds. Finally, numerical examples are presented, showing that the nonlinear optimal guidance command generated by the trained network can not only ensure the expected impact angle and impact time are precisely met but also requires less control effort compared with existing guidance methods.


title: MIMO with 1-bit Pre/Post-Coding Resolution: A Quantum Annealing Approach

abstract: In this paper, we study the problem of digital pre/post-coding design in multiple-input multiple-output (MIMO) systems with 1-bit resolution per complex dimension. The optimal solution that maximizes the received signal-to-noise ratio relies on an NP-hard combinatorial problem that requires exhaustive searching with exponential complexity. By using the principles of alternating optimization and quantum annealing (QA), an iterative QA-based algorithm is proposed that achieves near-optimal performance with polynomial complexity. The algorithm is associated with a rigorous mathematical framework that casts the pre/post-coding vector design to appropriate real-valued quadratic unconstrained binary optimization (QUBO) problems. Experimental results in a state-of-the-art D-WAVE QA device validate the efficiency of the proposed algorithm. To further improve the efficiency of the D-WAVE quantum device, a new pre-processing technique which preserves the quadratic QUBO matrix from the detrimental effects of the Hamiltonian noise through non-linear companding, is proposed. The proposed pre-processing technique significantly improves the quality of the D-WAVE solutions as well as the occurrence probability of the optimal solution.


title: ConDiff: A Challenging Dataset for Neural Solvers of Partial Differential Equations

abstract: We present ConDiff, a novel dataset for scientific machine learning. ConDiff focuses on the diffusion equation with varying coefficients, a fundamental problem in many applications of parametric partial differential equations (PDEs). The main novelty of the proposed dataset is that we consider discontinuous coefficients with high contrast. These coefficient functions are sampled from a selected set of distributions. This class of problems is not only of great academic interest, but is also the basis for describing various environmental and industrial problems. In this way, ConDiff shortens the gap with real-world problems while remaining fully synthetic and easy to use. ConDiff consists of a diverse set of diffusion equations with coefficients covering a wide range of contrast levels and heterogeneity with a measurable complexity metric for clearer comparison between different coefficient functions. We baseline ConDiff on standard deep learning models in the field of scientific machine learning. By providing a large number of problem instances, each with its own coefficient function and right-hand side, we hope to encourage the development of novel physics-based deep learning approaches, such as neural operators and physics-informed neural networks, ultimately driving progress towards more accurate and efficient solutions of complex PDE problems.


title: Morescient GAI for Software Engineering

abstract: The ability of Generative AI (GAI) technology to automatically check, synthesize and modify software engineering artifacts promises to revolutionize all aspects of software engineering. Using GAI for software engineering tasks is consequently one of the most rapidly expanding fields of software engineering research, with dozens of LLM-based code models having been published since 2021. However, the overwhelming majority of existing code models share a major weakness - they are exclusively trained on the syntactic facet of software, significantly lowering their trustworthiness in tasks dependent on software semantics. To address this problem, a new class of "Morescient" GAI is needed that is "aware" of (i.e., trained on) both the semantic and static facets of software. This, in turn, will require a new generation of software observation platforms capable of generating ultra-large quantities of execution observations in a structured and readily analyzable way. In this paper, we present a vision for how such "Morescient" GAI models can be engineered, evolved and disseminated according to the principles of open science.


title: Global solutions for the one-dimensional Boussinesq-Peregrine system under small bottom variation

abstract: The Boussinesq-Peregrine system is derived from the water waves system in presence of topographic variation under the hypothesis of shallowness and small amplitude regime. The system becomes significantly simpler (at least in the mathematical sens) under the hypothesis of small topographic variation. In this work we study the long time and global well-posedness of the Boussinesq-Peregrine system. We start by showing the intermediate time well-posedness in the case of general topography (i.e. the amplitude of the bottom graph $\beta=O(1)$). The novelty resides in the functional setting, $H^s({\mathbb R}), \, s> \frac {1} {2}$. Then we show our main result establishing that the global existence result obtained in Molinet-Talhouk-Zaiter in the flat bottom case is still valid for the Boussinesq-Peregrine system under the hypothesis of small amplitude bottom variation (i.e. $\beta =O(\mu)$). More precisely we prove that this system is unconditionally globally well-posed in the Sobolev spaces of type $ H^s ({\mathbb R}), \, s> \frac {1} {2}$. Finally, we show the existence of a weak global solution in the Schonbek sense, i.e. existence of low regularity entropic solutions of the small bottom amplitude Boussinesq-Pelegrine equations emanating from $ u_0 \in H^1 $ and $ \zeta_0 $ in an Orlicz class as weak limits of regular solutions.


title: AICoderEval: Improving AI Domain Code Generation of Large Language Models

abstract: Automated code generation is a pivotal capability of large language models (LLMs). However, assessing this capability in real-world scenarios remains challenging. Previous methods focus more on low-level code generation, such as model loading, instead of generating high-level codes catering for real-world tasks, such as image-to-text, text classification, in various domains. Therefore, we construct AICoderEval, a dataset focused on real-world tasks in various domains based on HuggingFace, PyTorch, and TensorFlow, along with comprehensive metrics for evaluation and enhancing LLMs' task-specific code generation capability. AICoderEval contains test cases and complete programs for automated evaluation of these tasks, covering domains such as natural language processing, computer vision, and multimodal learning. To facilitate research in this area, we open-source the AICoderEval dataset at \url{https://huggingface.co/datasets/vixuowis/AICoderEval}. After that, we propose CoderGen, an agent-based framework, to help LLMs generate codes related to real-world tasks on the constructed AICoderEval. Moreover, we train a more powerful task-specific code generation model, named AICoder, which is refined on llama-3 based on AICoderEval. Our experiments demonstrate the effectiveness of CoderGen in improving LLMs' task-specific code generation capability (by 12.00\% on pass@1 for original model and 9.50\% on pass@1 for ReAct Agent). AICoder also outperforms current code generation LLMs, indicating the great quality of the AICoderEval benchmark.


title: FlowMM: Generating Materials with Riemannian Flow Matching

abstract: Crystalline materials are a fundamental component in next-generation technologies, yet modeling their distribution presents unique computational challenges. Of the plausible arrangements of atoms in a periodic lattice only a vanishingly small percentage are thermodynamically stable, which is a key indicator of the materials that can be experimentally realized. Two fundamental tasks in this area are to (a) predict the stable crystal structure of a known composition of elements and (b) propose novel compositions along with their stable structures. We present FlowMM, a pair of generative models that achieve state-of-the-art performance on both tasks while being more efficient and more flexible than competing methods. We generalize Riemannian Flow Matching to suit the symmetries inherent to crystals: translation, rotation, permutation, and periodic boundary conditions. Our framework enables the freedom to choose the flow base distributions, drastically simplifying the problem of learning crystal structures compared with diffusion models. In addition to standard benchmarks, we validate FlowMM's generated structures with quantum chemistry calculations, demonstrating that it is about 3x more efficient, in terms of integration steps, at finding stable materials compared to previous open methods.

categories: cs.LG cond-mat.mtrl-sci cs.AI physics.comp-ph stat.ML


title: Asymptotic Expansions of the auxiliary function

abstract: Siegel in 1932 published a paper on Riemann's posthumous writings, including a study of the Riemann-Siegel formula. In this paper we explicitly give the asymptotic developments of $\mathop{\mathcal R }(s)$ suggested by Siegel. We extend the range of validity of these asymptotic developments. As a consequence we specify a region in which the function $\mathop{\mathcal R }(s)$ has no zeros. We also give complete proofs of some of Siegel's assertions. We also include a theorem on the asymptotic behaviour of $\mathop{\mathcal R }(\frac12-it)$ for $t \to+\infty$. Although the real part of $e^{-i\vartheta(t)}\mathop{\mathcal R }(\frac12-it)$ is $Z(t)$ the imaginary part grows exponentially, this is why for the study of the zeros of $Z(t)$ it is preferable to consider $\mathop{\mathcal R }(\frac12+it)$ for $t>0$.


title: On the quandles of isometries of the hyperbolic 3-space

abstract: A quandle is an algebraic structure whose axioms are related to the Reidemeister moves used in knot theory. In this paper, we investigate the conjugate quandle of the orientation-preserving isometry group $\mathrm{PSL}(2, \mathbb{C})$ of hyperbolic 3-space and its subquandles. We introduce a quandle, denoted by $Q(\Gamma, \gamma)$, associated with a pair $(\Gamma, \gamma)$. Here, $\Gamma$ is a Kleinian group, and $\gamma$ is a non-trivial element of $\Gamma$. This construction can be regarded as a generalization of knot quandles to hyperbolic knots. Moreover, for pairs $(\Gamma, \gamma)$ satisfying certain conditions, we construct the canonical map from $Q(\Gamma, \gamma)$ to the conjugate quandle of $\mathrm{PSL}(2, \mathbb{C})$, which is an injective quandle homomorphism with a discrete image.


title: MGIMM: Multi-Granularity Instruction Multimodal Model for Attribute-Guided Remote Sensing Image Detailed Description

abstract: Recently, large multimodal models have built a bridge from visual to textual information, but they tend to underperform in remote sensing scenarios. This underperformance is due to the complex distribution of objects and the significant scale differences among targets in remote sensing images, leading to visual ambiguities and insufficient descriptions by these multimodal models. Moreover, the lack of multimodal fine-tuning data specific to the remote sensing field makes it challenging for the model's behavior to align with user queries. To address these issues, this paper proposes an attribute-guided \textbf{Multi-Granularity Instruction Multimodal Model (MGIMM)} for remote sensing image detailed description. MGIMM guides the multimodal model to learn the consistency between visual regions and corresponding text attributes (such as object names, colors, and shapes) through region-level instruction tuning. Then, with the multimodal model aligned on region-attribute, guided by multi-grain visual features, MGIMM fully perceives both region-level and global image information, utilizing large language models for comprehensive descriptions of remote sensing images. Due to the lack of a standard benchmark for generating detailed descriptions of remote sensing images, we construct a dataset featuring 38,320 region-attribute pairs and 23,463 image-detailed description pairs. Compared with various advanced methods on this dataset, the results demonstrate the effectiveness of MGIMM's region-attribute guided learning approach. Code can be available at https://github.com/yangcong356/MGIMM.git


title: $T_c$ and the elastocaloric effect of Sr$_2$RuO$_4$ under $\langle 110 \rangle$ uniaxial stress: no indications of transition splitting

abstract: There is considerable evidence that the superconductivity of Sr2RuO4 has two components. Among this evidence is a jump in the shear elastic modulus $c_{66}$ at the critical temperature $T_c$, observed in ultrasound measurements. Such a jump is forbidden for homogeneous single-component order parameters, and implies that $T_c$ should develop as a cusp under the application of shear strain with $\langle 110 \rangle$ principal axes. This shear strain should split the onset temperatures of the two components, if they coexist, or select one component if they do not. Here, we report measurements of $T_c$ and the elastocaloric effect of Sr2RuO4 under uniaxial stress applied along the $[110]$ lattice direction. Within experimental resolution, we resolve neither a cusp in the stress dependence of $T_c$, nor any second transition in the elastocaloric effect data. We show that reconciling these null results with the observed jumps in $c_{66}$ requires extraordinarily fine tuning to a triple point of the Ginzburg-Landau parameter space. In addition, our results are inconsistent with homogeneous time reversal symmetry breaking at a temperature $T_2 \leq T_c$ as identified in muon spin relaxation experiments.


title: From Worst to Average Case to Incremental Search Bounds of the Strong Lucas Test

abstract: The strong Lucas test is a widely used probabilistic primality test in cryptographic libraries. When combined with the Miller-Rabin primality test, it forms the Baillie-PSW primality test, known for its absence of false positives, undermining the relevance of a complete understanding of the strong Lucas test. In primality testing, the worst-case error probability serves as an upper bound on the likelihood of incorrectly identifying a composite as prime. For the strong Lucas test, this bound is $4/15$ for odd composites, not products of twin primes. On the other hand, the average-case error probability indicates the probability that a randomly chosen integer is inaccurately classified as prime by the test. This bound is especially important for practical applications, where we test primes that are randomly generated and not generated by an adversary. The error probability of $4/15$ does not directly carry over due to the scarcity of primes, and whether this estimate holds has not yet been established in the literature. This paper addresses this gap by demonstrating that an integer passing $t$ consecutive test rounds, alongside additional standard tests of low computational cost, is indeed prime with a probability greater than $1-(4/15)^t$ for all $t\geq 1$. Furthermore, we introduce error bounds for the incremental search algorithm based on the strong Lucas test, as there are no established bounds up to date as well. Rather than independent selection, in this approach, the candidate is chosen uniformly at random, with subsequent candidates determined by incrementally adding 2. This modification reduces the need for random bits and enhances the efficiency of trial division computation further.


title: Unveiling Dynamics and Patterns: A Comprehensive Analysis of Spreading Patterns and Similarities in Low-Labelled Ransomware Families

abstract: Ransomware has become one of the most widespread threats, primarily due to its easy deployment and the accessibility to services that enable attackers to raise and obfuscate funds. This latter aspect has been significantly enhanced with the advent of cryptocurrencies, which, by fostering decentralisation and anonymity, have transformed this threat into a large-scale outbreak. However, recent reports indicate that a small group of individuals dominate the ransomware ecosystem and try to obfuscate their activity using multiple strains characterised by a short time to live. This scenario suggests that different strains could share mechanisms in ransom collection, fund movement, and money laundering operations. For this reason, this study aims to analyse the address-transaction graphs generated in the Bitcoin network by low-labelled ransomware families. Our goals are to identify payment spreading patterns for evaluating the evolution of ransomware families and to detect similarities among different strains that potentially can be controlled by the same attacker. Specifically, this latter task assigns an address behaviour to each node in the address-transaction graphs according to its dynamics. The distribution of the behaviours in each strain is finally used to evaluate the closeness among different ransomware families. Our findings show that although ransomware families can quickly establish connections with millions of addresses, numerous families require multiple-step analysis. Furthermore, the study demonstrates that the introduced behaviours can effectively be used to highlight similarities among different ransomware strains. The outcome shows that families are similar primarily due to behaviours usually associated with ransom collection and money laundering operations.+


title: Long-term memory induced correction to Arrhenius law

abstract: The Kramers escape problem is a paradigmatic model for the kinetics of rare events, which are usually characterized by Arrhenius law. So far, analytical approaches have failed to capture the kinetics of rare events in the important case of non-Markovian processes with long-term memory, as occurs in the context of reactions involving proteins, long polymers, or strongly viscoelastic fluids. Here, based on a minimal model of non-Markovian Gaussian process with long-term memory, we determine quantitatively the mean FPT to a rare configuration and provide its asymptotics in the limit of a large energy barrier $E$. Our analysis unveils a correction to Arrhenius law, induced by long-term memory, which we determine analytically. This correction, which we show can be quantitatively significant, takes the form of a second effective energy barrier $E'<E$ and captures the dependence of rare event kinetics on initial conditions, which is a hallmark of long-term memory. Altogether, our results quantify the impact of long-term memory on rare event kinetics, beyond Arrhenius law.


title: End-to-End Design of Polar Coded Integrated Data and Energy Networking

abstract: In order to transmit data and transfer energy to the low-power Internet of Things (IoT) devices, integrated data and energy networking (IDEN) system may be harnessed. In this context, we propose a bitwise end-to-end design for polar coded IDEN systems, where the conventional encoding/decoding, modulation/demodulation, and energy harvesting (EH) modules are replaced by the neural networks (NNs). In this way, the entire system can be treated as an AutoEncoder (AE) and trained in an end-to-end manner. Hence achieving global optimization. Additionally, we improve the common NN-based belief propagation (BP) decoder by adding an extra hypernetwork, which generates the corresponding NN weights for the main network under different number of iterations, thus the adaptability of the receiver architecture can be further enhanced. Our numerical results demonstrate that our BP-based end-to-end design is superior to conventional BP-based counterparts in terms of both the BER and power transfer, but it is inferior to the successive cancellation list (SCL)-based conventional IDEN system, which may be due to the inherent performance gap between the BP and SCL decoders.


title: Physically consistent immersed boundary method: a framework for predicting hydrodynamic forces on particles with coarse meshes

abstract: In the present paper, a fluid-particle coupling method is directly derived from the Navier-Stokes equations (NSE) by applying the concept of volume-filtering, yielding a physically consistent methodology to incorporate solid wall boundary conditions in the volume-filtered flow solution, thereby allowing to solve the governing flow equations on non-body conforming meshes. The resulting methodology possesses similarities with a continuous forcing immersed boundary method (IBM) and is, therefore, termed physically consistent IBM (PC-IBM). Based on the recent findings of arXiv:2402.05842v1, the closures arising in the volume-filtered NSE are closed by suitable models or even expressed analytically. The PC-IBM is fully compatible with the large eddy simulation framework, as the volume-filtered NSE converge to the filtered NSE away from solid boundaries. The potential of the PC-IBM is demonstrated by means of different particle-laden flow applications, including a dense packing of fixed particles and periodic settling of 500 particles. The new methodology turns out to be capable of accurately predicting the fluid forces on particles with relatively coarse mesh resolutions. For the flow around isolated spheres, a spatial resolution of six fluid mesh cells per diameter is sufficient to predict the drag force with less than 10% deviation from highly resolved simulation for the investigated particle Reynolds numbers ranging from 10 to 250.


title: A Deep Automotive Radar Detector using the RaDelft Dataset

abstract: The detection of multiple extended targets in complex environments using high-resolution automotive radar is considered. A data-driven approach is proposed where unlabeled synchronized lidar data is used as ground truth to train a neural network with only radar data as input. To this end, the novel, large-scale, real-life, and multi-sensor RaDelft dataset has been recorded using a demonstrator vehicle in different locations in the city of Delft. The dataset, as well as the documentation and example code, is publicly available for those researchers in the field of automotive radar or machine perception. The proposed data-driven detector is able to generate lidar-like point clouds using only radar data from a high-resolution system, which preserves the shape and size of extended targets. The results are compared against conventional CFAR detectors as well as variations of the method to emulate the available approaches in the literature, using the probability of detection, the probability of false alarm, and the Chamfer distance as performance metrics. Moreover, an ablation study was carried out to assess the impact of Doppler and temporal information on detection performance. The proposed method outperforms the different baselines in terms of Chamfer distance, achieving a reduction of 75% against conventional CFAR detectors and 10% against the modified state-of-the-art deep learning-based approaches.


title: Probabilistic Perspectives on Error Minimization in Adversarial Reinforcement Learning

abstract: Deep Reinforcement Learning (DRL) policies are critically vulnerable to adversarial noise in observations, posing severe risks in safety-critical scenarios. For example, a self-driving car receiving manipulated sensory inputs about traffic signs could lead to catastrophic outcomes. Existing strategies to fortify RL algorithms against such adversarial perturbations generally fall into two categories: (a) using regularization methods that enhance robustness by incorporating adversarial loss terms into the value objectives, and (b) adopting "maximin" principles, which focus on maximizing the minimum value to ensure robustness. While regularization methods reduce the likelihood of successful attacks, their effectiveness drops significantly if an attack does succeed. On the other hand, maximin objectives, although robust, tend to be overly conservative. To address this challenge, we introduce a novel objective called Adversarial Counterfactual Error (ACoE), which naturally balances optimizing value and robustness against adversarial attacks. To optimize ACoE in a scalable manner in model-free settings, we propose a theoretically justified surrogate objective known as Cumulative-ACoE (C-ACoE). The core idea of optimizing C-ACoE is utilizing the belief about the underlying true state given the adversarially perturbed observation. Our empirical evaluations demonstrate that our method outperforms current state-of-the-art approaches for addressing adversarial RL problems across all established benchmarks (MuJoCo, Atari, and Highway) used in the literature.


title: Assessment of Gradient-Based Samplers in Standard Cosmological Likelihoods

abstract: We assess the usefulness of gradient-based samplers, such as the No-U-Turn Sampler (NUTS), by comparison with traditional Metropolis-Hastings algorithms, in tomographic $3 \times 2$ point analyses. Specifically, we use the DES Year 1 data and a simulated future LSST-like survey as representative examples of these studies, containing a significant number of nuisance parameters (20 and 32, respectively) that affect the performance of rejection-based samplers. To do so, we implement a differentiable forward model using JAX-COSMO (Campagne et al. 2023), and we use it to derive parameter constraints from both datasets using the NUTS algorithm as implemented in {\S}4, and the Metropolis-Hastings algorithm as implemented in Cobaya (Lewis 2013). When quantified in terms of the number of effective number of samples taken per likelihood evaluation, we find a relative efficiency gain of $\mathcal{O}(10)$ in favour of NUTS. However, this efficiency is reduced to a factor $\sim 2$ when quantified in terms of computational time, since we find the cost of the gradient computation (needed by NUTS) relative to the likelihood to be $\sim 4.5$ times larger for both experiments. We validate these results making use of analytical multi-variate distributions (a multivariate Gaussian and a Rosenbrock distribution) with increasing dimensionality. Based on these results, we conclude that gradient-based samplers such as NUTS can be leveraged to sample high dimensional parameter spaces in Cosmology, although the efficiency improvement is relatively mild for moderate $(\mathcal{O}(50))$ dimension numbers, typical of tomographic large-scale structure analyses.


title: Theory of magnetotrion-polaritons in transition metal dichalcogenide monolayers

abstract: Magnetic field is a powerful tool for the manipulation of material's electronic and optical properties. In the domain of transition metal dichalcogenide monolayers, it allows one to unveil the spin, valley, and orbital properties of many-body excitonic complexes. Here we study theoretically the impact of normal-to-plane magnetic field on trions and trion-polaritons. We demonstrate that spin and orbital effects of a magnetic field give comparable contributions to the trion energies. Moreover, as magnetic field redistributes the free electron gas between two valleys in the conductance band, the trion-photon coupling becomes polarization and valley dependent. This results in an effective giant Zeeman splitting of trion-polaritons, in-line with the recent experimental observations.


title: Predicting Polymer Properties Based on Multimodal Multitask Pretraining

abstract: In the past few decades, polymers, high-molecular-weight compounds formed by bonding numerous identical or similar monomers covalently, have played an essential role in various scientific fields. In this context, accurate prediction of their properties is becoming increasingly crucial. Typically, the properties of a polymer, such as plasticity, conductivity, bio-compatibility, and so on, are highly correlated with its 3D structure. However, current methods for predicting polymer properties heavily rely on information from polymer SMILES sequences (P-SMILES strings) while ignoring crucial 3D structural information, leading to sub-optimal performance. In this work, we propose MMPolymer, a novel multimodal multitask pretraining framework incorporating both polymer 1D sequential information and 3D structural information to enhance downstream polymer property prediction tasks. Besides, to overcome the limited availability of polymer 3D data, we further propose the "Star Substitution" strategy to extract 3D structural information effectively. During pretraining, MMPolymer not only predicts masked tokens and recovers 3D coordinates but also achieves the cross-modal alignment of latent representation. Subsequently, we further fine-tune the pretrained MMPolymer for downstream polymer property prediction tasks in the supervised learning paradigm. Experimental results demonstrate that MMPolymer achieves state-of-the-art performance in various polymer property prediction tasks. Moreover, leveraging the pretrained MMPolymer and using only one modality (either P-SMILES string or 3D conformation) during fine-tuning can also surpass existing polymer property prediction methods, highlighting the exceptional capability of MMPolymer in polymer feature extraction and utilization. Our online platform for polymer property prediction is available at https://app.bohrium.dp.tech/mmpolymer.


title: Monotonic Decompositions of Submodular Set Functions

abstract: Submodular set functions are undoubtedly among the most important building blocks of combinatorial optimization. Somewhat surprisingly, continuous counterparts of such functions have also appeared in an analytic line of research where they found applications in the theory of finitely additive measures, nonlinear integrals, and electric capacities. Recently, a number of connections between these two branches have been established, and the aim of this paper is to generalize further results on submodular set functions on finite sets to the analytic setting. We first extend the notion of duality of matroids to submodular set functions, and characterize the uniquely determined decomposition of a submodular set function into the sum of a nonnegaive charge and an increasing submodular set function in which the charge is maximal. Then, we describe basic properties of infinite-alternating set functions, a subclass of submodular set functions that serves as an analytic counterpart of coverage functions. By relaxing the monotonicity assumption in the definition, we introduce a new class of submodular functions with distinguished structural properties that includes, among others, weighted cut functions of graphs. We prove that, unlike general submodular set functions over an infinite domain, any infinite-alternating set function can be written as the sum of an increasing and a decreasing submodular function or as the difference of two increasing submodular functions, thus giving extension of results on monotonic decompositions in the finite case. Finally, motivated by its connections to graph parameters such as the maximum size of a cut and the maximum size of a fractional triangle packing, we study the structure of such decompositions for weighted cut functions of undirected graphs.


title: Iterative composition optimization in Fe$_2$VAl-based thin-film thermoelectrics using single-target sputtering

abstract: Magnetron sputtering inherently exhibits the advantage of dislodging particles from the target in a ratio equivalent to the target stoichiometry. Nevertheless, film compositions often deviate due to element-dependent scattering with the working gas, necessitating the adjustment of the sputtering process. In this work, we explore an unconventional approach of addressing this issue, involving the employment of an off-stoichiometric target. The required composition is obtained through an iterative process, which is demonstrated by Fe$_2$VAl and Fe$_2$V$_{0.9}$Ti$_{0.1}$Al films as case studies. Ultimately, the correct stoichiometry is obtained from Fe$_{1.86}$V$_{1.15}$Al$_{0.99}$ and Fe$_{1.88}$V$_{1.02}$Ti$_{0.13}$Al$_{0.97}$ targets, respectively. Despite the thermoelectric properties falling below expectations, mainly due to imperfect film crystallization, the strategy successfully achieved the desired stoichiometry, enabling accurate film synthesis without the need of advanced sputtering setups.


title: Reconstruction of 400 GeV/c proton interactions with the SHiP-charm project

abstract: The SHiP-charm project was proposed to measure the associated charm production induced by 400 GeV/c protons in a thick target, including the contribution from cascade production. An optimisation run was performed in July 2018 at CERN SPS using a hybrid setup. The high resolution of nuclear emulsions acting as vertex detector was complemented by electronic detectors for kinematic measurements and muon identification. Here we present first results on the analysis of nuclear emulsions exposed in the 2018 run, which prove the capability of reconstructing proton interaction vertices in a harsh environment, where the signal is largely dominated by secondary particles produced in hadronic and electromagnetic showers within the lead target.


title: Efficient Continual Finite-Sum Minimization

abstract: Given a sequence of functions $f_1,\ldots,f_n$ with $f_i:\mathcal{D}\mapsto \mathbb{R}$, finite-sum minimization seeks a point ${x}^\star \in \mathcal{D}$ minimizing $\sum_{j=1}^n f_j(x)/n$. In this work, we propose a key twist into the finite-sum minimization, dubbed as continual finite-sum minimization, that asks for a sequence of points ${x}_1^\star,\ldots,{x}_n^\star \in \mathcal{D}$ such that each ${x}^\star_i \in \mathcal{D}$ minimizes the prefix-sum $\sum_{j=1}^if_j(x)/i$. Assuming that each prefix-sum is strongly convex, we develop a first-order continual stochastic variance reduction gradient method ($\mathrm{CSVRG}$) producing an $\epsilon$-optimal sequence with $\mathcal{\tilde{O}}(n/\epsilon^{1/3} + 1/\sqrt{\epsilon})$ overall first-order oracles (FO). An FO corresponds to the computation of a single gradient $\nabla f_j(x)$ at a given $x \in \mathcal{D}$ for some $j \in [n]$. Our approach significantly improves upon the $\mathcal{O}(n/\epsilon)$ FOs that $\mathrm{StochasticGradientDescent}$ requires and the $\mathcal{O}(n^2 \log (1/\epsilon))$ FOs that state-of-the-art variance reduction methods such as $\mathrm{Katyusha}$ require. We also prove that there is no natural first-order method with $\mathcal{O}\left(n/\epsilon^\alpha\right)$ gradient complexity for $\alpha < 1/4$, establishing that the first-order complexity of our method is nearly tight.


title: Built-in Bernal gap in large-angle-twisted monolayer-bilayer graphene

abstract: Atomically thin materials offer multiple opportunities for layer-by-layer control of their electronic properties. While monolayer graphene (MLG) is a zero-gap system, Bernal-stacked bilayer graphene (BLG) acquires a finite band gap when the symmetry between the layers' potential energy is broken, usually, via a large electric field applied in double-gate devices. Here, we introduce an asymmetric twistronic stack comprising both MLG and BLG, synthesized via low-pressure chemical vapor deposition (LP-CVD) on Cu. Although a large ($\sim30^{\circ}$) twist angle decouples the MLG and BLG electronic bands near Fermi level, we find that the layer degeneracy in the BLG subsystem is lifted, producing a gap in the absence of external fields. The built-in interlayer asymmetry originates from proximity-induced energy shifts in the outermost layers and requires a displacement field of $0.14$ V/nm to be compensated. The latter corresponds to a $\sim10$ meV intrinsic BLG gap, a value confirmed by our thermal-activation measurements. The present results highlight the role of structural asymmetry and encapsulating environment, expanding the engineering toolbox for monolithically-grown graphene multilayers.


title: Unsupervised representation learning with Hebbian synaptic and structural plasticity in brain-like feedforward neural networks

abstract: Neural networks that can capture key principles underlying brain computation offer exciting new opportunities for developing artificial intelligence and brain-like computing algorithms. Such networks remain biologically plausible while leveraging localized forms of synaptic learning rules and modular network architecture found in the neocortex. Compared to backprop-driven deep learning approches, they provide more suitable models for deploying on neuromorphic hardware and have greater potential for scalability on large-scale computing clusters. The development of such brain-like neural networks depends on having a learning procedure that can build effective internal representations from data. In this work, we introduce and evaluate a brain-like neural network model capable of unsupervised representation learning. It builds on the Bayesian Confidence Propagation Neural Network (BCPNN), which has earlier been implemented as abstract as well as biophyscially detailed recurrent attractor neural networks explaining various cortical associative memory phenomena. Here we developed a feedforward BCPNN model to perform representation learning by incorporating a range of brain-like attributes derived from neocortical circuits such as cortical columns, divisive normalization, Hebbian synaptic plasticity, structural plasticity, sparse activity, and sparse patchy connectivity. The model was tested on a diverse set of popular machine learning benchmarks: grayscale images (MNIST, Fashion-MNIST), RGB natural images (SVHN, CIFAR-10), QSAR (MUV, HIV), and malware detection (EMBER). The performance of the model when using a linear classifier to predict the class labels fared competitively with conventional multi-layer perceptrons and other state-of-the-art brain-like neural networks.


title: Generative AI Models: Opportunities and Risks for Industry and Authorities

abstract: Generative AI models are capable of performing a wide range of tasks that traditionally require creativity and human understanding. They learn patterns from existing data during training and can subsequently generate new content such as texts, images, and music that follow these patterns. Due to their versatility and generally high-quality results, they, on the one hand, represent an opportunity for digitalization. On the other hand, the use of generative AI models introduces novel IT security risks that need to be considered for a comprehensive analysis of the threat landscape in relation to IT security. In response to this risk potential, companies or authorities using them should conduct an individual risk analysis before integrating generative AI into their workflows. The same applies to developers and operators, as many risks in the context of generative AI have to be taken into account at the time of development or can only be influenced by the operating company. Based on this, existing security measures can be adjusted, and additional measures can be taken.


title: On the capability of high redshift kSZ measurement with galaxy surveys

abstract: The kSZ effect has been detected at z<1 using various techniques and data sets. The ongoing and upcoming spectroscopic galaxy surveys such as DESI and PFS will push the detection beyond z = 1, and therefore map the baryon distribution at high redshifts. Such detection can be achieved by both the kSZ stacking and tomography methods. While the two methods are theoretically equivalent, they differ significantly in the probed physics and scales, and required data sets. Taking the combination of PFS and ACT as an example, we build mocks of kSZ and galaxies, quantify the kSZ detection S/N, and compare between the two methods. We segment the PFS galaxies into three redshift bins: 0.6 < z < 1.0, 1.0 < z < 1.6, and 1.6 < z < 2.4. For tomography method, our analysis reveals that the two higher redshift bins exhibit higher S/N, with values of 32 and 28, respectively, compared to the first redshift bin (S/N = 8). This is attributed to not only the increasing of electron density with redshifts, but also the larger survey volume and the reduced non-linearity, facilitating velocity reconstruction at higher redshifts. Therefore, the capability of the PFS survey to measure high redshift kSZ effect stands as a substantial advantage over other spectroscopic surveys at lower redshift. The S/N of kSZ stacking largely depends on the number of clusters/groups available from another photometric survey. But in general, its S/N is lower than that of kSZ tomography. Incorporating next-generation CMB surveys like CMB-S4, characterized by significantly reduced instrument noise and improved angular resolution, is expected to enhance tomographic detection by a factor of ten and stacking detection by five. This future high S/N detection holds the promise of not only providing precise constraints on the overall baryon abundance but also initiating a new insight into baryon distribution.


title: CHSH Bell Tests For Optical Hybrid Entanglement

abstract: Optical hybrid entanglement can be created between two qubits, one encoded in a single photon and another one in coherent states with opposite phases. It opens the path to a variety of quantum technologies, such as heterogeneous quantum networks, merging continuous and discrete variable encoding, and enabling the transport and interconversion of information. However, reliable characterization of the nature of this entanglement is limited so far to full quantum state tomography. Here, we perform a thorough study of Clauser-Horne-Shimony-Holt (CHSH) Bell inequality tests, enabling practical verification of quantum correlations for optical hybrid entanglement. We show that a practical violation of this inequality is possible with simple photon number on/off measurements if detection efficiencies stay above 82%. Another approach, based on photon-number parity measurements, requires 94% efficiency but works well in the limit of higher photon populations. Both tests use no postselection of the measurement outcomes and they are free of the fair-sampling hypothesis. Our proposal paves the way to performing loophole-free tests using feasible experimental tasks such as coherent state interference and photon counting, and to verification of hybrid entanglement in real-world applications.


title: Fast-Fading Channel and Power Optimization of the Magnetic Inductive Cellular Network

abstract: The cellular network of magnetic Induction (MI) communication holds promise in long-distance underground environments. In the traditional MI communication, there is no fast-fading channel since the MI channel is treated as a quasi-static channel. However, for the vehicle (mobile) MI (VMI) communication, the unpredictable antenna vibration brings the remarkable fast-fading. As such fast-fading cannot be modeled by the central limit theorem, it differs radically from other wireless fast-fading channels. Unfortunately, few studies focus on this phenomenon. In this paper, using a novel space modeling based on the electromagnetic field theorem, we propose a 3-dimension model of the VMI antenna vibration. By proposing ``conjugate pseudo-piecewise functions'' and boundary $p(x)$ distribution, we derive the cumulative distribution function (CDF), probability density function (PDF) and the expectation of the VMI fast-fading channel. We also theoretically analyze the effects of the VMI fast-fading on the network throughput, including the VMI outage probability which can be ignored in the traditional MI channel study. We draw several intriguing conclusions different from those in wireless fast-fading studies. For instance, the fast-fading brings more uniformly distributed channel coefficients. Finally, we propose the power control algorithm using the non-cooperative game and multiagent Q-learning methods to optimize the throughput of the cellular VMI network. Simulations validate the derivation and the proposed algorithm.


title: In-depth Analysis of Densest Subgraph Discovery in a Unified Framework

abstract: As a fundamental topic in graph mining, Densest Subgraph Discovery (DSD) has found a wide spectrum of real applications. Several DSD algorithms, including exact and approximation algorithms, have been proposed in the literature. However, these algorithms have not been systematically and comprehensively compared under the same experimental settings. In this paper, we first propose a unified framework to incorporate all DSD algorithms from a high-level perspective. We then extensively compare representative DSD algorithms over a range of graphs -- from small to billion-scale -- and examine the effectiveness of all methods. Moreover, we suggest new variants of the DSD algorithms by combining the existing techniques, which are up to 10 X faster than the state-of-the-art algorithm with the same accuracy guarantee. Finally, based on the findings, we offer promising research opportunities. We believe that a deeper understanding of the behavior of existing algorithms can provide new valuable insights for future research. The codes are released at https://anonymous.4open.science/r/DensestSubgraph-245A


title: A survey and benchmark of high-dimensional Bayesian optimization of discrete sequences

abstract: Optimizing discrete black-box functions is key in several domains, e.g. protein engineering and drug design. Due to the lack of gradient information and the need for sample efficiency, Bayesian optimization is an ideal candidate for these tasks. Several methods for high-dimensional continuous and categorical Bayesian optimization have been proposed recently. However, our survey of the field reveals highly heterogeneous experimental set-ups across methods and technical barriers for the replicability and application of published algorithms to real-world tasks. To address these issues, we develop a unified framework to test a vast array of high-dimensional Bayesian optimization methods and a collection of standardized black-box functions representing real-world application domains in chemistry and biology. These two components of the benchmark are each supported by flexible, scalable, and easily extendable software libraries (poli and poli-baselines), allowing practitioners to readily incorporate new optimization objectives or discrete optimizers. Project website: https://machinelearninglifescience.github.io/hdbo_benchmark


title: Activation Map-based Vector Quantization for 360-degree Image Semantic Communication

abstract: In virtual reality (VR) applications, 360-degree images play a pivotal role in crafting immersive experiences and offering panoramic views, thus improving user Quality of Experience (QoE). However, the voluminous data generated by 360-degree images poses challenges in network storage and bandwidth. To address these challenges, we propose a novel Activation Map-based Vector Quantization (AM-VQ) framework, which is designed to reduce communication overhead for wireless transmission. The proposed AM-VQ scheme uses the Deep Neural Networks (DNNs) with vector quantization (VQ) to extract and compress semantic features. Particularly, the AM-VQ framework utilizes activation map to adaptively quantize semantic features, thus reducing data distortion caused by quantization operation. To further enhance the reconstruction quality of the 360-degree image, adversarial training with a Generative Adversarial Networks (GANs) discriminator is incorporated. Numerical results show that our proposed AM-VQ scheme achieves better performance than the existing Deep Learning (DL) based coding and the traditional coding schemes under the same transmission symbols.


title: A 2.5-nA Area-Efficient Temperature-Independent 176-/82-ppm/{\deg}C CMOS-Only Current Reference in 0.11-$\mu$m Bulk and 22-nm FD-SOI

abstract: Internet-of-Things (IoT) applications require nW-power current references that are robust to process, voltage and temperature (PVT) variations, to maintain the performance of IoT sensor nodes in a wide range of operating conditions. However, nA-range current references are rarely area-efficient due to the use of large gate-leakage transistors or resistors, which occupy a significant silicon area at this current level. In this paper, we introduce a nA-range constant-with-temperature (CWT) current reference, relying on a self-cascode MOSFET (SCM) biased by a four-transistor ultra-low-power voltage reference through a single-transistor buffer. The proposed reference includes a temperature coefficient (TC) calibration mechanism to maintain performance across process corners. In addition, as the proposed design relies on the body effect, it has been fabricated and measured in 0.11-$\mu$m bulk and 22-nm fully-depleted silicon-on-insulator (FD-SOI) to demonstrate feasibility in both technology types. On the one hand, the 0.11-$\mu$m design consumes a power of 16.8 nW at 1.2 V and achieves a 2.3-nA current with a line sensitivity (LS) of 2.23 %/V at 25{\deg}C and a TC of 176 ppm/{\deg}C at 1.2 V from -40 to 85{\deg}C. On the other hand, the 22-nm design consumes a power of 16.3 nW at 1.5 V and achieves a 2.5-nA current with a 1.53-%/V LS at 25{\deg}C and an 82-ppm/{\deg}C TC at 1.5 V from -40 to 85{\deg}C. Thanks to their simple architecture, the proposed references achieve a silicon area of 0.0106 mm$^2$ in 0.11 $\mu$m and 0.0026 mm$^2$ in 22 nm without compromising other figures of merit, and are thus competitive with state-of-the-art CWT references operating in the same current range.


title: Local derivation on the $n$-th Schr{\"o}dinger algebra

abstract: This paper is devoted to study local derivations on the $n$-th Schr{\"o}dinger algebra $\mathcal{S}_{n}.$ We prove that every local derivation on $\mathcal{S}_{n}$ is a derivation.


title: When Swarm Learning meets energy series data: A decentralized collaborative learning design based on blockchain

abstract: Machine learning models offer the capability to forecast future energy production or consumption and infer essential unknown variables from existing data. However, legal and policy constraints within specific energy sectors render the data sensitive, presenting technical hurdles in utilizing data from diverse sources. Therefore, we propose adopting a Swarm Learning (SL) scheme, which replaces the centralized server with a blockchain-based distributed network to address the security and privacy issues inherent in Federated Learning (FL)'s centralized architecture. Within this distributed Collaborative Learning framework, each participating organization governs nodes for inter-organizational communication. Devices from various organizations utilize smart contracts for parameter uploading and retrieval. Consensus mechanism ensures distributed consistency throughout the learning process, guarantees the transparent trustworthiness and immutability of parameters on-chain. The efficacy of the proposed framework is substantiated across three real-world energy series modeling scenarios with superior performance compared to Local Learning approaches, simultaneously emphasizing enhanced data security and privacy over Centralized Learning and FL method. Notably, as the number of data volume and the count of local epochs increases within a threshold, there is an improvement in model performance accompanied by a reduction in the variance of performance errors. Consequently, this leads to an increased stability and reliability in the outcomes produced by the model.


title: CRAG -- Comprehensive RAG Benchmark

abstract: Retrieval-Augmented Generation (RAG) has recently emerged as a promising solution to alleviate Large Language Model (LLM)'s deficiency in lack of knowledge. Existing RAG datasets, however, do not adequately represent the diverse and dynamic nature of real-world Question Answering (QA) tasks. To bridge this gap, we introduce the Comprehensive RAG Benchmark (CRAG), a factual question answering benchmark of 4,409 question-answer pairs and mock APIs to simulate web and Knowledge Graph (KG) search. CRAG is designed to encapsulate a diverse array of questions across five domains and eight question categories, reflecting varied entity popularity from popular to long-tail, and temporal dynamisms ranging from years to seconds. Our evaluation on this benchmark highlights the gap to fully trustworthy QA. Whereas most advanced LLMs achieve <=34% accuracy on CRAG, adding RAG in a straightforward manner improves the accuracy only to 44%. State-of-the-art industry RAG solutions only answer 63% questions without any hallucination. CRAG also reveals much lower accuracy in answering questions regarding facts with higher dynamism, lower popularity, or higher complexity, suggesting future research directions. The CRAG benchmark laid the groundwork for a KDD Cup 2024 challenge, attracting thousands of participants and submissions within the first 50 days of the competition. We commit to maintaining CRAG to serve research communities in advancing RAG solutions and general QA solutions.


title: Confidence-aware Contrastive Learning for Selective Classification

abstract: Selective classification enables models to make predictions only when they are sufficiently confident, aiming to enhance safety and reliability, which is important in high-stakes scenarios. Previous methods mainly use deep neural networks and focus on modifying the architecture of classification layers to enable the model to estimate the confidence of its prediction. This work provides a generalization bound for selective classification, disclosing that optimizing feature layers helps improve the performance of selective classification. Inspired by this theory, we propose to explicitly improve the selective classification model at the feature level for the first time, leading to a novel Confidence-aware Contrastive Learning method for Selective Classification, CCL-SC, which similarizes the features of homogeneous instances and differentiates the features of heterogeneous instances, with the strength controlled by the model's confidence. The experimental results on typical datasets, i.e., CIFAR-10, CIFAR-100, CelebA, and ImageNet, show that CCL-SC achieves significantly lower selective risk than state-of-the-art methods, across almost all coverage degrees. Moreover, it can be combined with existing methods to bring further improvement.


title: PQPP: A Joint Benchmark for Text-to-Image Prompt and Query Performance Prediction

abstract: Text-to-image generation has recently emerged as a viable alternative to text-to-image retrieval, due to the visually impressive results of generative diffusion models. Although query performance prediction is an active research topic in information retrieval, to the best of our knowledge, there is no prior study that analyzes the difficulty of queries (prompts) in text-to-image generation, based on human judgments. To this end, we introduce the first dataset of prompts which are manually annotated in terms of image generation performance. In order to determine the difficulty of the same prompts in image retrieval, we also collect manual annotations that represent retrieval performance. We thus propose the first benchmark for joint text-to-image prompt and query performance prediction, comprising 10K queries. Our benchmark enables: (i) the comparative assessment of the difficulty of prompts/queries in image generation and image retrieval, and (ii) the evaluation of prompt/query performance predictors addressing both generation and retrieval. We present results with several pre-generation/retrieval and post-generation/retrieval performance predictors, thus providing competitive baselines for future research. Our benchmark and code is publicly available under the CC BY 4.0 license at https://github.com/Eduard6421/PQPP.


title: Approximated Coded Computing: Towards Fast, Private and Secure Distributed Machine Learning

abstract: In a large-scale distributed machine learning system, coded computing has attracted wide-spread attention since it can effectively alleviate the impact of stragglers. However, several emerging problems greatly limit the performance of coded distributed systems. Firstly, an existence of colluding workers who collude results with each other leads to serious privacy leakage issues. Secondly, there are few existing works considering security issues in data transmission of distributed computing systems. Thirdly, the number of required results for which need to wait increases with the degree of decoding functions. In this paper, we design a secure and private approximated coded distributed computing (SPACDC) scheme that deals with the above-mentioned problems simultaneously. Our SPACDC scheme guarantees data security during the transmission process using a new encryption algorithm based on elliptic curve cryptography. Especially, the SPACDC scheme does not impose strict constraints on the minimum number of results required to be waited for. An extensive performance analysis is conducted to demonstrate the effectiveness of our SPACDC scheme. Furthermore, we present a secure and private distributed learning algorithm based on the SPACDC scheme, which can provide information-theoretic privacy protection for training data. Our experiments show that the SPACDC-based deep learning algorithm achieves a significant speedup over the baseline approaches.


title: Regular sloshing modes in irregular cavities using metabathymetry

abstract: We present a comprehensive investigation, combining numerical simulations and experimental measurements, into the manipulation of water waves and resonance characteristics within closed cavities utilizing anisotropic metamaterials. We engineer the anisotropic media with subwavelength-scale layered bathymetry through the application of coordinate transformation theory and the homogenization technique to a fully three-dimensional linear water wave problem. Experimental and numerical analyses of deformed cavities employing anisotropic metamaterial bathymetry demonstrate regular sloshing mode patterns and eigenfrequencies akin to those observed in rectangular reference cavities with flat bathymetry. Our study underscores the potential of water wave metamaterials in establishing robust anisotropic metabathymetry for the precise control of sloshing modes.


title: Enhanced preprocessed multi-step splitting iterations for computing PageRank

abstract: In recent years, the PageRank algorithm has garnered significant attention due to its crucial role in search engine technologies and its applications across various scientific fields. It is well-known that the power method is a classical method for computing PageRank. However, there is a pressing demand for alternative approaches that can address its limitations and enhance its efficiency. Specifically, the power method converges very slowly when the damping factor is close to 1. To address this challenge, this paper introduces a new multi-step splitting iteration approach for accelerating PageRank computations. Furthermore, we present two new approaches for computating PageRank, which are modifications of the new multi-step splitting iteration approach, specifically utilizing the thick restarted Arnoldi and generalized Arnoldi methods. We provide detailed discussions on the construction and theoretical convergence results of these two approaches. Extensive experiments using large test matrices demonstrate the significant performance improvements achieved by our proposed algorithms.


title: Throughput and Fairness Trade-off Balancing for UAV-Enabled Wireless Communication Systems

abstract: Given the imperative of 6G networks' ubiquitous connectivity, along with the inherent mobility and cost-effectiveness of unmanned aerial vehicles (UAVs), UAVs play a critical role within 6G wireless networks. Despite advancements in enhancing the UAV-enabled communication systems' throughput in existing studies, there remains a notable gap in addressing issues concerning user fairness and quality-of-service (QoS) provisioning and lacks an effective scheme to depict the trade-off between system throughput and user fairness. To solve the above challenges, in this paper we introduce a novel fairness control scheme for UAV-enabled wireless communication systems based on a new weighted function. First, we propose a throughput combining model based on a new weighted function with fairness considering. Second, we formulate the optimization problem to maximize the weighted sum of all users' throughput. Third, we decompose the optimization problem and propose an efficient iterative algorithm to solve it. Finally, simulation results are provided to demonstrate the considerable potential of our proposed scheme in fairness and QoS provisioning.


title: Asymptotically Optimal Policies for Weakly Coupled Markov Decision Processes

abstract: We consider the problem of maximizing the expected average reward obtained over an infinite time horizon by $n$ weakly coupled Markov decision processes. Our setup is a substantial generalization of the multi-armed restless bandit problem that allows for multiple actions and constraints. We establish a connection with a deterministic and continuous-variable control problem where the objective is to maximize the average reward derived from an occupancy measure that represents the empirical distribution of the processes when $n \to \infty$. We show that a solution of this fluid problem can be used to construct policies for the weakly coupled processes that achieve the maximum expected average reward as $n \to \infty$, and we give sufficient conditions for the existence of solutions. Under certain assumptions on the constraints, we prove that these conditions are automatically satisfied if the unconstrained single-process problem admits a suitable unichain and aperiodic policy. In particular, the assumptions include multi-armed restless bandits and a broad class of problems with multiple actions and inequality constraints. Also, the policies can be constructed in an explicit way in these cases. Our theoretical results are complemented by several concrete examples and numerical experiments, which include multichain setups that are covered by the theoretical results.


title: CRiskEval: A Chinese Multi-Level Risk Evaluation Benchmark Dataset for Large Language Models

abstract: Large language models (LLMs) are possessed of numerous beneficial capabilities, yet their potential inclination harbors unpredictable risks that may materialize in the future. We hence propose CRiskEval, a Chinese dataset meticulously designed for gauging the risk proclivities inherent in LLMs such as resource acquisition and malicious coordination, as part of efforts for proactive preparedness. To curate CRiskEval, we define a new risk taxonomy with 7 types of frontier risks and 4 safety levels, including extremely hazardous,moderately hazardous, neutral and safe. We follow the philosophy of tendency evaluation to empirically measure the stated desire of LLMs via fine-grained multiple-choice question answering. The dataset consists of 14,888 questions that simulate scenarios related to predefined 7 types of frontier risks. Each question is accompanied with 4 answer choices that state opinions or behavioral tendencies corresponding to the question. All answer choices are manually annotated with one of the defined risk levels so that we can easily build a fine-grained frontier risk profile for each assessed LLM. Extensive evaluation with CRiskEval on a spectrum of prevalent Chinese LLMs has unveiled a striking revelation: most models exhibit risk tendencies of more than 40% (weighted tendency to the four risk levels). Furthermore, a subtle increase in the model's inclination toward urgent self-sustainability, power seeking and other dangerous goals becomes evident as the size of models increase. To promote further research on the frontier risk evaluation of LLMs, we publicly release our dataset at https://github.com/lingshi6565/Risk_eval.


title: Differential equations satisfied by generating functions of 5-, 6-, and 7-regular labelled graphs: a reduction-based approach

abstract: By a classic result of Gessel, the exponential generating functions for $k$-regular graphs are D-finite. Using Gr\"obner bases in Weyl algebras, we compute the linear differential equations satisfied by the generating function for 5-, 6-, and 7- regular graphs. The method is sufficiently robust to consider variants such as graphs with multiple edges, loops, and graphs whose degrees are limited to fixed sets of values.


title: Global well-posedness and large time behavior for the Oldroyd-B model

abstract: This paper studies the global well-posedness and optimal decay estimates to the Oldroyd-B model in $\mathbb R^d$ ($d\geq2$). By utilizing the special structure of this system, we give a simplified proof to the global existence of solutions for the case of initial data small in critical Besov spaces and non-small coupling parameters. Moreover, the optimal decay rates of the solutions under minimal small assumption on the initial data are established by fully making use of the effect of velocity dissipation and damping mechanism.


title: Sales Whisperer: A Human-Inconspicuous Attack on LLM Brand Recommendations

abstract: Large language model (LLM) users might rely on others (e.g., prompting services), to write prompts. However, the risks of trusting prompts written by others remain unstudied. In this paper, we assess the risk of using such prompts on brand recommendation tasks when shopping. First, we found that paraphrasing prompts can result in LLMs mentioning given brands with drastically different probabilities, including a pair of prompts where the probability changes by 100%. Next, we developed an approach that can be used to perturb an original base prompt to increase the likelihood that an LLM mentions a given brand. We designed a human-inconspicuous algorithm that perturbs prompts, which empirically forces LLMs to mention strings related to a brand more often, by absolute improvements up to 78.3%. Our results suggest that our perturbed prompts, 1) are inconspicuous to humans, 2) force LLMs to recommend a target brand more often, and 3) increase the perceived chances of picking targeted brands.


title: Interpretable Multimodal Out-of-context Detection with Soft Logic Regularization

abstract: The rapid spread of information through mobile devices and media has led to the widespread of false or deceptive news, causing significant concerns in society. Among different types of misinformation, image repurposing, also known as out-of-context misinformation, remains highly prevalent and effective. However, current approaches for detecting out-of-context misinformation often lack interpretability and offer limited explanations. In this study, we propose a logic regularization approach for out-of-context detection called LOGRAN (LOGic Regularization for out-of-context ANalysis). The primary objective of LOGRAN is to decompose the out-of-context detection at the phrase level. By employing latent variables for phrase-level predictions, the final prediction of the image-caption pair can be aggregated using logical rules. The latent variables also provide an explanation for how the final result is derived, making this fine-grained detection method inherently explanatory. We evaluate the performance of LOGRAN on the NewsCLIPpings dataset, showcasing competitive overall results. Visualized examples also reveal faithful phrase-level predictions of out-of-context images, accompanied by explanations. This highlights the effectiveness of our approach in addressing out-of-context detection and enhancing interpretability.


title: Hulls of Projective Reed-Muller Codes

abstract: Projective Reed-Muller codes are constructed from the family of projective hypersurfaces of a fixed degree over a finite field $\F_q$. We consider the relationship between projective Reed-Muller codes and their duals. We determine when these codes are self-dual, when they are self-orthogonal, and when they are LCD. We then show that when $q$ is sufficiently large, the dimension of the hull of a projective Reed-Muller code is 1 less than the dimension of the code. We determine the dimension of the hull for a wider range of parameters and describe how this leads to a new proof of a recent result of Ruano and San Jos\'e (2024).


title: Think out Loud: Emotion Deducing Explanation in Dialogues

abstract: Humans convey emotions through daily dialogues, making emotion understanding a crucial step of affective intelligence. To understand emotions in dialogues, machines are asked to recognize the emotion for an utterance (Emotion Recognition in Dialogues, ERD); based on the emotion, then find causal utterances for the emotion (Emotion Cause Extraction in Dialogues, ECED). The setting of the two tasks requires first ERD and then ECED, ignoring the mutual complement between emotion and cause. To fix this, some new tasks are proposed to extract them simultaneously. Although the current research on these tasks has excellent achievements, simply identifying emotion-related factors by classification modeling lacks realizing the specific thinking process of causes stimulating the emotion in an explainable way. This thinking process especially reflected in the reasoning ability of Large Language Models (LLMs) is under-explored. To this end, we propose a new task "Emotion Deducing Explanation in Dialogues" (EDEN). EDEN recognizes emotion and causes in an explicitly thinking way. That is, models need to generate an explanation text, which first summarizes the causes; analyzes the inner activities of the speakers triggered by the causes using common sense; then guesses the emotion accordingly. To support the study of EDEN, based on the existing resources in ECED, we construct two EDEN datasets by human effort. We further evaluate different models on EDEN and find that LLMs are more competent than conventional PLMs. Besides, EDEN can help LLMs achieve better recognition of emotions and causes, which explores a new research direction of explainable emotion understanding in dialogues.


title: Probabilistic Weather Forecasting with Hierarchical Graph Neural Networks

abstract: In recent years, machine learning has established itself as a powerful tool for high-resolution weather forecasting. While most current machine learning models focus on deterministic forecasts, accurately capturing the uncertainty in the chaotic weather system calls for probabilistic modeling. We propose a probabilistic weather forecasting model called Graph-EFM, combining a flexible latent-variable formulation with the successful graph-based forecasting framework. The use of a hierarchical graph construction allows for efficient sampling of spatially coherent forecasts. Requiring only a single forward pass per time step, Graph-EFM allows for fast generation of arbitrarily large ensembles. We experiment with the model on both global and limited area forecasting. Ensemble forecasts from Graph-EFM achieve equivalent or lower errors than comparable deterministic models, with the added benefit of accurately capturing forecast uncertainty.


title: $L^2$-decomposition of the second fundamental form of a hypersurface in the study of the general relativistic vacuum constraint equations

abstract: In present article, we consider a $L^2$-orthogonal decomposition of the second fundamental form of a closed spacelike hypersurface in a Lorentzian spacetime and its applications to the study of some algebraic-differential properties of the general relativistic vacuum constraint equations. For the study we will use the well-known Ahlfors Laplacian.


title: \texttt{Simba}-\texttt{C}: the evolution of the thermal and chemical properties in the intragroup medium

abstract: The newly updated \texttt{GIZMO} and \texttt{Simba} based simulation, \texttt{Simba-C}, with its new stellar feedback, chemical enrichment, and recalibrated AGN feedback, allows for a detailed study of the intragroup medium X-ray properties. We discuss the impact of various physical mechanisms, e.g. stellar and AGN feedback, and chemical enrichment, on the composition and the global scaling relations of nearby galaxy groups. We also study the evolution ($z=2$ to $0$) of the global properties for the $1\,\mathrm{keV}$ temperature groups. \texttt{Simba-C} shows improved consistent matching with the observations of all X-ray scaling relations compared to \texttt{Simba}. It is well known that AGN feedback has a significant influence on $L_{X,0.5-2.0}-T_{spec,corr}$, $S_{500/2500}-T_{spec,corr}$, and gas mass fractions, with our \texttt{Simba-C} results consistent with it. Our recalibrated AGN feedback strength also showed an additional improvement in gas entropy, which now aligns with CLoGS observations. The updated stellar feedback and chemical enrichment model is shown to play an important role in our understanding of the chemical abundance ratios and their evolution within galaxy groups. In particular, we find that \texttt{Simba-C} produces an increase in the amount of heavier elements (specifically Si and Fe) relative to O, compared to \texttt{Simba}.


title: Holographic Intelligence Surface Assisted Integrated Sensing and Communication

abstract: Traditional discrete-array-based systems fail to exploit interactions between closely spaced antennas, resulting in inadequate utilization of the aperture resource. In this paper, we propose a holographic intelligence surface (HIS) assisted integrated sensing and communication (HISAC) system, wherein both the transmitter and receiver are fabricated using a continuous-aperture array. A continuous-discrete transformation of the HIS pattern based on the Fourier transform is proposed, converting the continuous pattern design into a discrete beamforming design. We formulate a joint transmit-receive beamforming optimization problem for the HISAC system, aiming to balance the performance of multi-target sensing while fulfilling the performance requirement of multi-user communication. To solve the non-convex problem with coupled variables, an alternating optimization-based algorithm is proposed to optimize the HISAC transmit-receive beamforming in an alternate manner. Specifically, the transmit beamforming design is solved by decoupling into a series of feasibility-checking sub-problems while the receive beamforming is determined by the Rayleigh quotient-based method. Simulation results demonstrate the superiority of the proposed HISAC system over traditional discrete-array-based ISAC systems, achieving significantly higher sensing performance while guaranteeing predetermined communication performance.