title: DMoERM: Recipes of Mixture-of-Experts for Effective Reward Modeling

abstract: The performance of the reward model (RM) is a critical factor in improving the effectiveness of the large language model (LLM) during alignment fine-tuning. There remain two challenges in RM training: 1) training the same RM using various categories of data may cause its generalization performance to suffer from multi-task disturbance, and 2) the human annotation consistency rate is generally only $60\%$ to $75\%$, causing training data to contain a lot of noise. To tackle these two challenges, we introduced the idea of Mixture-of-Experts (MoE) into the field of RM for the first time. We propose the Double-Layer MoE RM (DMoERM). The outer layer MoE is a sparse model. After classifying an input into task categories, we route it to the corresponding inner layer task-specific model. The inner layer MoE is a dense model. We decompose the specific task into multiple capability dimensions and individually fine-tune a LoRA expert on each one. Their outputs are then synthesized by an MLP to compute the final rewards. To minimize costs, we call a public LLM API to obtain the capability preference labels. The validation on manually labeled datasets confirms that our model attains superior consistency with human preference and outstrips advanced generative approaches. Meanwhile, through BoN sampling and RL experiments, we demonstrate that our model outperforms state-of-the-art ensemble methods of RM and mitigates the overoptimization problem. Our code and dataset are available at: https://github.com/quanshr/DMoERM-v1.


title: Organic solvent boosts charge storage and charging dynamics of conductive MOF supercapacitors

abstract: Conductive metal-organic frameworks (c-MOFs) and ionic liquids (ILs) have emerged as auspicious combinations for high-performance supercapacitors. However, the nanoconfinement from c-MOFs and high viscosity of ILs slow down the charging process. This hindrance can, however, be resolved by adding solvent. Here, we performed constant-potential molecular simulations to scrutinize the solvent impact on charge storage and charging dynamics of MOF-IL-based supercapacitors. We find conditions for >100% enhancement in capacity and ~6 times increase in charging speed. These improvements were confirmed by synthesizing near-ideal c-MOFs and developing multiscale models linking molecular simulations to electrochemical measurements. Fundamentally, our findings elucidate that the solvent acts as an ionophobic agent to induce a substantial enhancement in charge storage, and as an ion traffic police to eliminate convoluted counterion and co-ion motion paths and create two distinct ion transport highways to accelerate charging dynamics. This work paves the way for the optimal design of MOF supercapacitors.


title: The Case for Animal-Friendly AI

abstract: Artificial intelligence is seen as increasingly important, and potentially profoundly so, but the fields of AI ethics and AI engineering have not fully recognized that these technologies, including large language models (LLMs), will have massive impacts on animals. We argue that this impact matters, because animals matter morally. As a first experiment in evaluating animal consideration in LLMs, we constructed a proof-of-concept Evaluation System, which assesses LLM responses and biases from multiple perspectives. This system evaluates LLM outputs by two criteria: their truthfulness, and the degree of consideration they give to the interests of animals. We tested OpenAI ChatGPT 4 and Anthropic Claude 2.1 using a set of structured queries and predefined normative perspectives. Preliminary results suggest that the outcomes of the tested models can be benchmarked regarding the consideration they give to animals, and that generated positions and biases might be addressed and mitigated with more developed and validated systems. Our research contributes one possible approach to integrating animal ethics in AI, opening pathways for future studies and practical applications in various fields, including education, public policy, and regulation, that involve or relate to animals and society. Overall, this study serves as a step towards more useful and responsible AI systems that better recognize and respect the vital interests and perspectives of all sentient beings.


title: Embedding Theorems for Calabi--Yau Conifolds

abstract: We prove that compact Calabi--Yau varieties with certain isolated singularities are projective. In dimension 3 we do this by analysis, supposing given conifold metrics. In higher dimensions it follows more readily from Ohsawa's degenerate spectral sequence.


title: Modelling ion acceleration and transport in corotating interaction regions: the mass-to-charge ratio dependence of the particle spectrum

abstract: We investigate the role of perpendicular diffusion in shaping energetic ion spectrum in corotating interaction regions (CIRs), focusing on its mass-to-charge ($A/Q$) dependence. We simulate a synthetic CIR using the EUropean Heliospheric FORcasting Information Asset (EUHFORIA) and model the subsequent ion acceleration and transport by solving the focused transport equation incorporating both parallel and perpendicular diffusion. Our results reveal distinct differences in ion spectra between scenarios with and without perpendicular diffusion. In the absence of perpendicular diffusion, ion spectra near CIRs show a strong $(A/Q)^{\epsilon}$ dependence with $\epsilon$ depending on the turbulence spectral index, agreeing with theoretical predictions. In contrast, the incorporation of perpendicular diffusion, characterized by a weak $A/Q$ dependence, leading to similar spectra for different ion species. This qualitatively agrees with observations of energetic particles in CIRs.


title: Atacama Large Aperture Submillimeter Telescope (AtLAST) science: Gas and dust in nearby galaxies

abstract: Understanding the physical processes that regulate star formation and galaxy evolution are major areas of activity in modern astrophysics. Nearby galaxies offer unique opportunities to inspect interstellar medium (ISM), star formation (SF), radiative, dynamic and magnetic physics in great detail from sub-galactic (kpc) scales to sub-cloud (sub-pc) scales, from quiescent galaxies to starbursts, and from field galaxies to overdensities. In this case study, we discuss the major breakthroughs in this area of research that will be enabled by the Atacama Large Aperture Submillimeter Telescope (AtLAST), a proposed 50-m single-dish submillimeter telescope. The new discovery space of AtLAST comes from its exceptional sensitivity, in particular to extended low surface brightness emission, a very large 2 degree field of view, and correspondingly high mapping efficiency. This paper focuses on four themes which will particularly benefit from AtLAST: 1) the LMC and SMC, 2) extragalactic magnetic fields, 3) the physics and chemistry of the interstellar medium, and 4) star formation and galaxy evolution. With ~1000-2000h surveys each, AtLAST could deliver deep dust continuum maps of the entire LMC and SMC fields at parsec-scale resolution, high-resolution maps of the magnetic field structure, gas density, temperature and composition of the dense and diffuse ISM in ~100 nearby galaxies, as well as the first large-scale blind CO survey in the nearby Universe, delivering molecular gas masses for up to 10^6 galaxies (3 orders of magnitude more than current samples). Through such observing campaigns, AtLAST will have a profound impact on our understanding of the baryon cycle and star formation across a wide range of environments.


title: Pseudo-Label Calibration Semi-supervised Multi-Modal Entity Alignment

abstract: Multi-modal entity alignment (MMEA) aims to identify equivalent entities between two multi-modal knowledge graphs for integration. Unfortunately, prior arts have attempted to improve the interaction and fusion of multi-modal information, which have overlooked the influence of modal-specific noise and the usage of labeled and unlabeled data in semi-supervised settings. In this work, we introduce a Pseudo-label Calibration Multi-modal Entity Alignment (PCMEA) in a semi-supervised way. Specifically, in order to generate holistic entity representations, we first devise various embedding modules and attention mechanisms to extract visual, structural, relational, and attribute features. Different from the prior direct fusion methods, we next propose to exploit mutual information maximization to filter the modal-specific noise and to augment modal-invariant commonality. Then, we combine pseudo-label calibration with momentum-based contrastive learning to make full use of the labeled and unlabeled data, which improves the quality of pseudo-label and pulls aligned entities closer. Finally, extensive experiments on two MMEA datasets demonstrate the effectiveness of our PCMEA, which yields state-of-the-art performance.


title: Stochastic gradient descent for streaming linear and rectified linear systems with Massart noise

abstract: We propose SGD-exp, a stochastic gradient descent approach for linear and ReLU regressions under Massart noise (adversarial semi-random corruption model) for the fully streaming setting. We show novel nearly linear convergence guarantees of SGD-exp to the true parameter with up to $50\%$ Massart corruption rate, and with any corruption rate in the case of symmetric oblivious corruptions. This is the first convergence guarantee result for robust ReLU regression in the streaming setting, and it shows the improved convergence rate over previous robust methods for $L_1$ linear regression due to a choice of an exponentially decaying step size, known for its efficiency in practice. Our analysis is based on the drift analysis of a discrete stochastic process, which could also be interesting on its own.


title: Control of cascading failures using protective measures

abstract: Cascading failures, triggered by a local perturbation, can be catastrophic and cause irreparable damages in a wide area. Hence, blocking the devastating cascades is an important issue in real world networks. One of the ways to control the cascade is to use protective measures, so that the agents decide to be protected against failure. Here, we consider a coevolution of the linear threshold model for the spread of cascading failures and a decision-making game based on the perceived risk of failure. Protected agents are less vulnerable to failure and in return the size of the cascade affects the agent's decision to get insured. We find at what range of protection efficiency and cost of failure, the global cascades stop. Also we observe that in some range of protection efficiency, a bistable region emerges for the size of cascade and the prevalence of protected agents. Moreover, we show how savings or the ability of agents to repair can prevent cascades from occurring


title: Boosting the Efficiency of Quantum Divider through Effective Design Space Exploration

abstract: Rapid progress in the design of scalable, robust quantum computing necessitates efficient quantum circuit implementation for algorithms with practical relevance. For several algorithms, arithmetic kernels, in particular, division plays an important role. In this manuscript, we focus on enhancing the performance of quantum slow dividers by exploring the design choices of its sub-blocks, such as, adders. Through comprehensive design space exploration of state-of-the-art quantum addition building blocks, our work have resulted in an impressive achievement: a reduction in Toffoli Depth of up to 94.06%, accompanied by substantial reductions in both Toffoli and Qubit Count of up to 91.98% and 99.37%, respectively. This paper offers crucial perspectives on efficient design of quantum dividers, and emphasizes the importance of adopting a systematic design space exploration approach.


title: Self-Lubricating Drops

abstract: Over the past decade, there has been a growing interest in the study of multicomponent drops. These drops exhibit unique phenomena, as the interplay between hydrodynamics and the evolving physicochemical properties of the mixture gives rise to distinct and often unregulated behaviors. Of particular interest is the complex dynamic behavior of the drop contact line, which can display self-lubrication effect. The presence of a slipping contact line in self-lubricating multicomponent drops can suppress the coffee-stain effect, conferring valuable technological applications. This review will explain the current understanding of the self-lubrication effect of drops, and cover an analysis of fundamental concepts and recent advances in colloidal assembly. The potential applications of self-lubricating drops across different fields will also be highlighted.


title: Position: Insights from Survey Methodology can Improve Training Data

abstract: Whether future AI models are fair, trustworthy, and aligned with the public's interests rests in part on our ability to collect accurate data about what we want the models to do. However, collecting high-quality data is difficult, and few AI/ML researchers are trained in data collection methods. Recent research in data-centric AI has show that higher quality training data leads to better performing models, making this the right moment to introduce AI/ML researchers to the field of survey methodology, the science of data collection. We summarize insights from the survey methodology literature and discuss how they can improve the quality of training and feedback data. We also suggest collaborative research ideas into how biases in data collection can be mitigated, making models more accurate and human-centric.


title: Data-free Multi-label Image Recognition via LLM-powered Prompt Tuning

abstract: This paper proposes a novel framework for multi-label image recognition without any training data, called data-free framework, which uses knowledge of pre-trained Large Language Model (LLM) to learn prompts to adapt pretrained Vision-Language Model (VLM) like CLIP to multilabel classification. Through asking LLM by well-designed questions, we acquire comprehensive knowledge about characteristics and contexts of objects, which provides valuable text descriptions for learning prompts. Then we propose a hierarchical prompt learning method by taking the multi-label dependency into consideration, wherein a subset of category-specific prompt tokens are shared when the corresponding objects exhibit similar attributes or are more likely to co-occur. Benefiting from the remarkable alignment between visual and linguistic semantics of CLIP, the hierarchical prompts learned from text descriptions are applied to perform classification of images during inference. Our framework presents a new way to explore the synergies between multiple pre-trained models for novel category recognition. Extensive experiments on three public datasets (MS-COCO, VOC2007, and NUS-WIDE) demonstrate that our method achieves better results than the state-of-the-art methods, especially outperforming the zero-shot multi-label recognition methods by 4.7% in mAP on MS-COCO.


title: SAR-AE-SFP: SAR Imagery Adversarial Example in Real Physics domain with Target Scattering Feature Parameters

abstract: Deep neural network-based Synthetic Aperture Radar (SAR) target recognition models are susceptible to adversarial examples. Current adversarial example generation methods for SAR imagery primarily operate in the 2D digital domain, known as image adversarial examples. Recent work, while considering SAR imaging scatter mechanisms, fails to account for the actual imaging process, rendering attacks in the three-dimensional physical domain infeasible, termed pseudo physics adversarial examples. To address these challenges, this paper proposes SAR-AE-SFP-Attack, a method to generate real physics adversarial examples by altering the scattering feature parameters of target objects. Specifically, we iteratively optimize the coherent energy accumulation of the target echo by perturbing the reflection coefficient and scattering coefficient in the scattering feature parameters of the three-dimensional target object, and obtain the adversarial example after echo signal processing and imaging processing in the RaySAR simulator. Experimental results show that compared to digital adversarial attack methods, SAR-AE-SFP Attack significantly improves attack efficiency on CNN-based models (over 30\%) and Transformer-based models (over 13\%), demonstrating significant transferability of attack effects across different models and perspectives.


title: Electric polarization evolution equation for antiferromagnetic multiferroics with the polarization proportional to the scalar product of the spins

abstract: The spin current model of electric polarization of multiferroics is justified via the quantum hydrodynamic method and the mean-field part of the spin-orbit interaction. The spin current model is applied to derive the electric polarization proportional to the scalar product of the spins of the near by ions, which appears to be caused by the Dzylaoshinskii-Moriya interaction. Symmetric tensor spin structure of the polarization is discussed as well. We start our derivations for the ferromagnetic multiferroic materials and present the further generalization for the antiferromagnetic multiferroic materials. We rederive the operator of the electric dipole moment, which provides the macroscopic polarization obtained via the spin current model. Finally, we use the quantum average of the found electric dipole moment operator in order to derive the polarization evolution equation for the antiferromagnetic multiferroic materials. Possibility of spiral spin structures is analyzed.


title: TCIG: Two-Stage Controlled Image Generation with Quality Enhancement through Diffusion

abstract: In recent years, significant progress has been made in the development of text-to-image generation models. However, these models still face limitations when it comes to achieving full controllability during the generation process. Often, specific training or the use of limited models is required, and even then, they have certain restrictions. To address these challenges, A two-stage method that effectively combines controllability and high quality in the generation of images is proposed. This approach leverages the expertise of pre-trained models to achieve precise control over the generated images, while also harnessing the power of diffusion models to achieve state-of-the-art quality. By separating controllability from high quality, This method achieves outstanding results. It is compatible with both latent and image space diffusion models, ensuring versatility and flexibility. Moreover, This approach consistently produces comparable outcomes to the current state-of-the-art methods in the field. Overall, This proposed method represents a significant advancement in text-to-image generation, enabling improved controllability without compromising on the quality of the generated images.


title: On the family of elliptic curves $y^2=x^3-m^2x + (pqr)^2$

abstract: In this article, we consider a family of elliptic curves defined by $E_{m}: y^2= x^3 -m^2 x + (pqr)^2 $ where $m $ is a positive integer and $p, q, ~\text{and}~ r$ are distinct odd primes and study the torsion as well the rank of $E_{m}(\mathbb{Q})$. More specifically, we proved that if $m \not \equiv 0 \pmod{3}, m \not \equiv 0 \pmod{4} ~\text{and}~ m \equiv 2 \pmod {2^{k}}$ where $k \geq 5$, then the torsion subgroup of $E_{m}(\mathbb{Q})$ is trivial and lower bound of the $\mathbb{Q}$ rank of this family of elliptic curves is $2$.


title: Boosting Box-supervised Instance Segmentation with Pseudo Depth

abstract: The realm of Weakly Supervised Instance Segmentation (WSIS) under box supervision has garnered substantial attention, showcasing remarkable advancements in recent years. However, the limitations of box supervision become apparent in its inability to furnish effective information for distinguishing foreground from background within the specified target box. This research addresses this challenge by introducing pseudo-depth maps into the training process of the instance segmentation network, thereby boosting its performance by capturing depth differences between instances. These pseudo-depth maps are generated using a readily available depth predictor and are not necessary during the inference stage. To enable the network to discern depth features when predicting masks, we integrate a depth prediction layer into the mask prediction head. This innovative approach empowers the network to simultaneously predict masks and depth, enhancing its ability to capture nuanced depth-related information during the instance segmentation process. We further utilize the mask generated in the training process as supervision to distinguish the foreground from the background. When selecting the best mask for each box through the Hungarian algorithm, we use depth consistency as one calculation cost item. The proposed method achieves significant improvements on Cityscapes and COCO dataset.


title: Efficient Algorithm Level Error Detection for Number-Theoretic Transform Assessed on FPGAs

abstract: Polynomial multiplication stands out as a highly demanding arithmetic process in the development of post-quantum cryptosystems. The importance of number-theoretic transform (NTT) extends beyond post-quantum cryptosystems, proving valuable in enhancing existing security protocols such as digital signature schemes and hash functions. Due to the potential for errors to significantly disrupt the operation of secure, cryptographically-protected systems, compromising data integrity, and safeguarding against side-channel attacks initiated through faults it is essential to incorporate mitigating error detection schemes. This paper introduces algorithm level fault detection schemes in NTT multiplication, representing a significant enhancement compared to previous research. We evaluate this through the simulation of a fault model, ensuring that the conducted assessments accurately mirror the obtained results. Consequently, we attain a notably comprehensive coverage of errors. Finally, we assess the performance of our efficient error detection scheme on FPGAs to showcase its implementation and resource requirements. Through implementation of our error detection approach on Xilinx/AMD Zynq Ultrascale+ and Artix-7, we achieve a comparable throughput with just a 9% increase in area and 13% increase in latency compared to the original hardware implementations.


title: API Is Enough: Conformal Prediction for Large Language Models Without Logit-Access

abstract: This study aims to address the pervasive challenge of quantifying uncertainty in large language models (LLMs) without logit-access. Conformal Prediction (CP), known for its model-agnostic and distribution-free features, is a desired approach for various LLMs and data distributions. However, existing CP methods for LLMs typically assume access to the logits, which are unavailable for some API-only LLMs. In addition, logits are known to be miscalibrated, potentially leading to degraded CP performance. To tackle these challenges, we introduce a novel CP method that (1) is tailored for API-only LLMs without logit-access; (2) minimizes the size of prediction sets; and (3) ensures a statistical guarantee of the user-defined coverage. The core idea of this approach is to formulate nonconformity measures using both coarse-grained (i.e., sample frequency) and fine-grained uncertainty notions (e.g., semantic similarity). Experimental results on both close-ended and open-ended Question Answering tasks show our approach can mostly outperform the logit-based CP baselines.


title: The origin of lopsided satellite galaxy distribution around isolated systems in MillenniumTNG

abstract: Dwarf satellites in galaxy groups are distributed in an anisotropic and asymmetric manner, which is called the ``lopsided satellite distribution''. This lopsided signal has been observed not only in galaxy pairs but also in isolated systems. However, the physical origin of the lopsided signal in isolated systems is still unknown. In this work, we investigate this in the state-of-the-art hydrodynamical simulation of the MillenniumTNG Project by tracing each system back to high redshift. We find that the lopsided signal is dominated by satellites located in the outer regions of the halo and is also dominated by recently accreted satellites. The lopsided signal originates from the anisotropic accretion of galaxies from the surrounding large-scale structure and that, after accretion, the nonlinear evolution of satellites inside the dark-matter halo weakens the lopsidedness. The signal decreases as cosmic time passes because of a competition between anisotropic accretion and internal evolution within dark matter halos. Our findings provide a useful perspective for the study of galaxy evolution, especially for the origin of the spatial satellite galaxy distributions.


title: Inexact Unlearning Needs More Careful Evaluations to Avoid a False Sense of Privacy

abstract: The high cost of model training makes it increasingly desirable to develop techniques for unlearning. These techniques seek to remove the influence of a training example without having to retrain the model from scratch. Intuitively, once a model has unlearned, an adversary that interacts with the model should no longer be able to tell whether the unlearned example was included in the model's training set or not. In the privacy literature, this is known as membership inference. In this work, we discuss adaptations of Membership Inference Attacks (MIAs) to the setting of unlearning (leading to their "U-MIA" counterparts). We propose a categorization of existing U-MIAs into "population U-MIAs", where the same attacker is instantiated for all examples, and "per-example U-MIAs", where a dedicated attacker is instantiated for each example. We show that the latter category, wherein the attacker tailors its membership prediction to each example under attack, is significantly stronger. Indeed, our results show that the commonly used U-MIAs in the unlearning literature overestimate the privacy protection afforded by existing unlearning techniques on both vision and language models. Our investigation reveals a large variance in the vulnerability of different examples to per-example U-MIAs. In fact, several unlearning algorithms lead to a reduced vulnerability for some, but not all, examples that we wish to unlearn, at the expense of increasing it for other examples. Notably, we find that the privacy protection for the remaining training examples may worsen as a consequence of unlearning. We also discuss the fundamental difficulty of equally protecting all examples using existing unlearning schemes, due to the different rates at which examples are unlearned. We demonstrate that naive attempts at tailoring unlearning stopping criteria to different examples fail to alleviate these issues.


title: Proton Resonance Shift Thermometry: A review of modern clinical practices

abstract: Magnetic Resonance Imaging (MRI) has become a popular modality in guiding minimally invasive thermal therapies, due to its advanced, non-ionizing, imaging capabilities and its ability to record changes in temperature. A variety of MR thermometry techniques have been developed over the years, and Proton Resonance Frequency (PRF) Shift Thermometry is the current clinical gold standard to treat a variety of cancers. It is used extensively to guide hyperthermic thermal ablation techniques such as high-intensity focused ultrasound (HIFU) and laser-induced thermal therapy (LITT). Essential attributes of PRF Shift Thermometry include excellent linearity with temperature, good sensitivity, and independence from tissue type. This non-invasive temperature mapping method gives accurate quantitative measures of the temperature evolution inside biological tissues. In this review, the current status and new developments in the fields of MR-guided HIFU and LITT are presented with an emphasis on breast, prostate, bone, uterine and brain treatments.


title: Stability of graph pairs involving cycles

abstract: A graph pair $(\Gamma, \Sigma)$ is called stable if $\aut(\Gamma)\times\aut(\Sigma)$ is isomorphic to $\aut(\Gamma\times\Sigma)$ and unstable otherwise, where $\Gamma\times\Sigma$ is the direct product of $\Gamma$ and $\Sigma$. A graph is called $R$-thin if distinct vertices have different neighbourhoods. $\Gamma$ and $\Sigma$ are said to be coprime if there is no nontrivial graph $\Delta$ such that $\Gamma \cong \Gamma_1 \times \Delta$ and $\Sigma \cong \Sigma_1 \times \Delta$ for some graphs $\Gamma_1$ and $\Sigma_1$. An unstable graph pair $(\Gamma, \Sigma)$ is called nontrivially unstable if $\Gamma$ and $\Sigma$ are $R$-thin connected coprime graphs and at least one of them is non-bipartite. This paper contributes to the study of the stability of graph pairs with a focus on the case when $\Sigma = C_n$ is a cycle. We give two sufficient conditions for $(\Gamma, C_n)$ to be nontrivially unstable, where $n \ne 4$ and $\Gamma$ is an $R$-thin connected graph. In the case when $\Gamma$ is an $R$-thin connected non-bipartite graph, we obtain the following results: (i) if $(\Gamma, K_2)$ is unstable, then $(\Gamma, C_{n})$ is unstable for every even integer $n \geq 4$; (ii) if an even integer $n \ge 6$ is compatible with $\Gamma$ in some sense, then $(\Gamma, C_{n})$ is nontrivially unstable if and only if $(\Gamma, K_2)$ is unstable; (iii) if there is an even integer $n \ge 6$ compatible with $\Gamma$ such that $(\Gamma, C_{n})$ is nontrivially unstable, then $(\Gamma, C_{m})$ is unstable for all even integers $m \ge 6$. We also prove that if $\Gamma$ is an $R$-thin connected graph and $n \ge 3$ is an odd integer compatible with $\Gamma$, then $(\Gamma, C_{n})$ is stable.


title: A Two-Stage Algorithm for Cost-Efficient Multi-instance Counterfactual Explanations

abstract: Counterfactual explanations constitute among the most popular methods for analyzing black-box systems since they can recommend cost-efficient and actionable changes to the input of a system to obtain the desired system output. While most of the existing counterfactual methods explain a single instance, several real-world problems, such as customer satisfaction, require the identification of a single counterfactual that can satisfy multiple instances (e.g. customers) simultaneously. To address this limitation, in this work, we propose a flexible two-stage algorithm for finding groups of instances and computing cost-efficient multi-instance counterfactual explanations. The paper presents the algorithm and its performance against popular alternatives through a comparative evaluation.


title: Emotion Analysis in NLP: Trends, Gaps and Roadmap for Future Directions

abstract: Emotions are a central aspect of communication. Consequently, emotion analysis (EA) is a rapidly growing field in natural language processing (NLP). However, there is no consensus on scope, direction, or methods. In this paper, we conduct a thorough review of 154 relevant NLP publications from the last decade. Based on this review, we address four different questions: (1) How are EA tasks defined in NLP? (2) What are the most prominent emotion frameworks and which emotions are modeled? (3) Is the subjectivity of emotions considered in terms of demographics and cultural factors? and (4) What are the primary NLP applications for EA? We take stock of trends in EA and tasks, emotion frameworks used, existing datasets, methods, and applications. We then discuss four lacunae: (1) the absence of demographic and cultural aspects does not account for the variation in how emotions are perceived, but instead assumes they are universally experienced in the same manner; (2) the poor fit of emotion categories from the two main emotion theories to the task; (3) the lack of standardized EA terminology hinders gap identification, comparison, and future goals; and (4) the absence of interdisciplinary research isolates EA from insights in other fields. Our work will enable more focused research into EA and a more holistic approach to modeling emotions in NLP.


title: The generalised Mooney space for modelling the response of rubber-like materials

abstract: Soft materials such as rubbers, silicones, gels and biological tissues have a nonlinear response to large deformations, a phenomenon which in principle can be captured by hyperelastic models. The suitability of a candidate hyperelastic strain energy function is then determined by comparing its predicted response to the data gleaned from tests and adjusting the material parameters to get a good fit, an exercise which can be deceptive because of nonlinearity. Here we propose to generalise the approach of Rivlin and Saunders [Phil Trans A 243 (1951) 251-288] who, instead of reporting the data as stress against stretch, manipulated these measures to create the 'Mooney plot', where the Mooney-Rivlin model is expected to produce a linear fit. We show that extending this idea to other models and modes of deformation (tension, shear, torsion, etc.) is advantageous, not only (a) for the fitting procedure, but also to (b) delineate trends in the deformation which are not obvious from the raw data (and may be interpreted in terms of micro-, meso-, and macro-structures) and (c) obtain a bounded condition number \k{appa} over the whole range of deformation; a robustness which is lacking in other plots and spaces.


title: Study of identified particle production as a function of transverse event activity classifier, $S_{T}$ in p$-$p collisions

abstract: A new observable, $S_{T}$, is introduced in terms of the sum of the transverse momentum of charged particles ($\sum_{i} p_{T_{i}}$ ) produced in proton proton (p$-$p) collisions at LHC energies to probe the underlying events (UE). The UE are defined as those aspects of proton-proton collisions that are not attributed to the primary hard scattering process, but rather to the accompanying interactions of the rest of the proton. The conventional approach of studying underlying events is usually carried out by defining topological regions with respect to the leading particle in an event. The transverse region is generally sensitive to UE and various classifiers have been used to discriminate the extent of UE activity regions. The production of identified particles like $\pi^{\pm}$, $K^{\pm}$, p , $K_{S}^{0}$, and $\Lambda^{0}$ are studied in different ranges of transverse activity classifier in p$-$p collisions at $\sqrt{s} = 13 $ TeV using pQCD inspired PYTHIA 8 event generator. A comparative analysis of the identified particle spectra, mean multiplicity and mean transverse momentum has been carried out with respect to $S_{T}$ and the performance of this new observable is gauged by comparing the results with previously defined $R_{T}$ observable.


title: A Cost-Effective Cooperative Exploration and Inspection Strategy for Heterogeneous Aerial System

abstract: In this paper, we propose a cost-effective strategy for heterogeneous UAV swarm systems for cooperative aerial inspection. Unlike previous swarm inspection works, the proposed method does not rely on precise prior knowledge of the environment and can complete full 3D surface coverage of objects in any shape. In this work, agents are partitioned into teams, with each drone assign a different task, including mapping, exploration, and inspection. Task allocation is facilitated by assigning optimal inspection volumes to each team, following best-first rules. A voxel map-based representation of the environment is used for pathfinding, and a rule-based path-planning method is the core of this approach. We achieved the best performance in all challenging experiments with the proposed approach, surpassing all benchmark methods for similar tasks across multiple evaluation trials. The proposed method is open source at https://github.com/ntu-aris/caric_baseline and used as the baseline of the Cooperative Aerial Robots Inspection Challenge at the 62nd IEEE Conference on Decision and Control 2023.


title: DiffSal: Joint Audio and Video Learning for Diffusion Saliency Prediction

abstract: Audio-visual saliency prediction can draw support from diverse modality complements, but further performance enhancement is still challenged by customized architectures as well as task-specific loss functions. In recent studies, denoising diffusion models have shown more promising in unifying task frameworks owing to their inherent ability of generalization. Following this motivation, a novel Diffusion architecture for generalized audio-visual Saliency prediction (DiffSal) is proposed in this work, which formulates the prediction problem as a conditional generative task of the saliency map by utilizing input audio and video as the conditions. Based on the spatio-temporal audio-visual features, an extra network Saliency-UNet is designed to perform multi-modal attention modulation for progressive refinement of the ground-truth saliency map from the noisy map. Extensive experiments demonstrate that the proposed DiffSal can achieve excellent performance across six challenging audio-visual benchmarks, with an average relative improvement of 6.3\% over the previous state-of-the-art results by six metrics.


title: Plane-polarised finite-amplitude shear waves in deformed incompressible materials

abstract: We investigate how two finite-amplitude, transverse, plane body waves may be superposed to propagate in a deformed hyperelastic incompressible solid. We find that the equations of motion reduce to a well-determined system of partial differential equations, making the motion controllable for all solids. We find that in deformed Mooney-Rivlin materials, they may travel along any direction and be polarised along any transverse direction, an extension of a result by Boulanger and Hayes [Quart. J. Mech. Appl. Math. 45 (1992) 575]. Furthermore, their motion is governed by a linear system of partial differential equations, making the Mooney-Rivlin special in that respect. We select another model to show that for other materials, the equations are nonlinear. We use asymptotic equations to reveal the onset of nonlinearity for the waves, paying particular attention to how close the propagation direction is to the principal axes of pre-deformation.


title: Characterizations of $e^\star$-open sets and nearby open sets on Infra topological spaces

abstract: The study of infra-topological spaces focuses on characterizations of $e^\star$-open sets and nearby open sets in infra-topological spaces. The $e^\star$-open sets, a variation of open sets, are explored for their unique properties and relationships within the infra-topological framework. Additionally, nearby open sets, which capture the notion of points being close to each other, are investigated to provide a comprehensive understanding of the topological structure. The research aims to contribute to the broader field of topology by extending traditional concepts to infra-topological spaces, offering new perspectives on openness and proximity. The findings not only deepen our understanding of mathematical structures but also open avenues for applications in various scientific and engineering disciplines.


title: REWIND Dataset: Privacy-preserving Speaking Status Segmentation from Multimodal Body Movement Signals in the Wild

abstract: Recognizing speaking in humans is a central task towards understanding social interactions. Ideally, speaking would be detected from individual voice recordings, as done previously for meeting scenarios. However, individual voice recordings are hard to obtain in the wild, especially in crowded mingling scenarios due to cost, logistics, and privacy concerns. As an alternative, machine learning models trained on video and wearable sensor data make it possible to recognize speech by detecting its related gestures in an unobtrusive, privacy-preserving way. These models themselves should ideally be trained using labels obtained from the speech signal. However, existing mingling datasets do not contain high quality audio recordings. Instead, speaking status annotations have often been inferred by human annotators from video, without validation of this approach against audio-based ground truth. In this paper we revisit no-audio speaking status estimation by presenting the first publicly available multimodal dataset with high-quality individual speech recordings of 33 subjects in a professional networking event. We present three baselines for no-audio speaking status segmentation: a) from video, b) from body acceleration (chest-worn accelerometer), c) from body pose tracks. In all cases we predict a 20Hz binary speaking status signal extracted from the audio, a time resolution not available in previous datasets. In addition to providing the signals and ground truth necessary to evaluate a wide range of speaking status detection methods, the availability of audio in REWIND makes it suitable for cross-modality studies not feasible with previous mingling datasets. Finally, our flexible data consent setup creates new challenges for multimodal systems under missing modalities.


title: Projectional entropy for actions of amenable groups

abstract: In the current paper we attempt to transfer the notion of the projectional entropy, originally defined for multidimensional subshifts, to the case of actions of amenable groups. The main theorem states that if a system is strongly irreducible the equality of the entropy and the projectional entropy implies that the system has a product-like structure.


title: Benchmarking Segmentation Models with Mask-Preserved Attribute Editing

abstract: When deploying segmentation models in practice, it is critical to evaluate their behaviors in varied and complex scenes. Different from the previous evaluation paradigms only in consideration of global attribute variations (e.g. adverse weather), we investigate both local and global attribute variations for robustness evaluation. To achieve this, we construct a mask-preserved attribute editing pipeline to edit visual attributes of real images with precise control of structural information. Therefore, the original segmentation labels can be reused for the edited images. Using our pipeline, we construct a benchmark covering both object and image attributes (e.g. color, material, pattern, style). We evaluate a broad variety of semantic segmentation models, spanning from conventional close-set models to recent open-vocabulary large models on their robustness to different types of variations. We find that both local and global attribute variations affect segmentation performances, and the sensitivity of models diverges across different variation types. We argue that local attributes have the same importance as global attributes, and should be considered in the robustness evaluation of segmentation models. Code: https://github.com/PRIS-CV/Pascal-EA.


title: Polynormer: Polynomial-Expressive Graph Transformer in Linear Time

abstract: Graph transformers (GTs) have emerged as a promising architecture that is theoretically more expressive than message-passing graph neural networks (GNNs). However, typical GT models have at least quadratic complexity and thus cannot scale to large graphs. While there are several linear GTs recently proposed, they still lag behind GNN counterparts on several popular graph datasets, which poses a critical concern on their practical expressivity. To balance the trade-off between expressivity and scalability of GTs, we propose Polynormer, a polynomial-expressive GT model with linear complexity. Polynormer is built upon a novel base model that learns a high-degree polynomial on input features. To enable the base model permutation equivariant, we integrate it with graph topology and node features separately, resulting in local and global equivariant attention models. Consequently, Polynormer adopts a linear local-to-global attention scheme to learn high-degree equivariant polynomials whose coefficients are controlled by attention scores. Polynormer has been evaluated on $13$ homophilic and heterophilic datasets, including large graphs with millions of nodes. Our extensive experiment results show that Polynormer outperforms state-of-the-art GNN and GT baselines on most datasets, even without the use of nonlinear activation functions.


title: Results and Lessons Learned from Autonomous Driving Transportation Services in Airfield, Crowded Indoor, and Urban Environments

abstract: Autonomous vehicles have been actively investigated over the past few decades. Several recent works show the potential of autonomous vehicles in urban environments with impressive experimental results. However, these works note that autonomous vehicles are still occasionally inferior to expert drivers in complex scenarios. Furthermore, they do not focus on the possibilities of autonomous driving transportation services in other areas beyond urban environments. This paper presents the research results and lessons learned from autonomous driving transportation services in airfield, crowded indoor, and urban environments. We discuss how we address several unique challenges in these diverse environments. We also offer an overview of remaining challenges that have not received much attention but must be addressed. This paper aims to share our unique experience to support researchers who are interested in exploring autonomous driving transportation services in various real-world environments.


title: Active Deep Kernel Learning of Molecular Functionalities: Realizing Dynamic Structural Embeddings

abstract: Exploring molecular spaces is crucial for advancing our understanding of chemical properties and reactions, leading to groundbreaking innovations in materials science, medicine, and energy. This paper explores an approach for active learning in molecular discovery using Deep Kernel Learning (DKL), a novel approach surpassing the limits of classical Variational Autoencoders (VAEs). Employing the QM9 dataset, we contrast DKL with traditional VAEs, which analyze molecular structures based on similarity, revealing limitations due to sparse regularities in latent spaces. DKL, however, offers a more holistic perspective by correlating structure with properties, creating latent spaces that prioritize molecular functionality. This is achieved by recalculating embedding vectors iteratively, aligning with the experimental availability of target properties. The resulting latent spaces are not only better organized but also exhibit unique characteristics such as concentrated maxima representing molecular functionalities and a correlation between predictive uncertainty and error. Additionally, the formation of exclusion regions around certain compounds indicates unexplored areas with potential for groundbreaking functionalities. This study underscores DKL's potential in molecular research, offering new avenues for understanding and discovering molecular functionalities beyond classical VAE limitations.

categories: cs.LG physics.chem-ph physics.comp-ph physics.data-an


title: Integrable and superintegrable quantum mechanical systems with position dependent masses invariant with respect to one parametric Lie groups. 1. Systems with cylindric symmetry

abstract: Cylindrically symmetric quantum mechanical systems with position dependent masses (PDM) admitting at least one second order integral of motion are classified. It is proved that there exist 68 such systems which are inequivalent. Among them there are twenty seven superintegrable and twelve maximally superintegrable. The arbitrary elements of the correspondinding Hamiltonians (i.e.,masses and potentials) are presented explicitly.


title: Performance evaluation of acceleration of convolutional layers on OpenEdgeCGRA

abstract: Recently, efficiently deploying deep learning solutions on the edge has received increasing attention. New platforms are emerging to support the increasing demand for flexibility and high performance. In this work, we explore the efficient mapping of convolutional layers on an open-hardware, low-power Coarse-Grain Reconfigurable Array (CGRA), namely OpenEdgeCGRA. We explore both direct implementations of convolution and solutions that transform it into a matrix multiplication through an Im2col transformation, and experiment with various tensor parallelism axes. We show that for this hardware target, direct convolution, coupled with weight parallelism reaches the best latency and energy efficiency, outperforming a CPU implementation by 3.4x and 9.9x in terms of energy and latency, respectively.


title: Ultra-high numerical aperture waveguide-integrated meta beam shaper

abstract: Integration of metasurfaces with guided mode sources like waveguides have opened new frontiers for on-chip optical integration. However, the state-of-the-art in the field has targeted applications where long focal distances over thousands of light wavelengths are needed. This regime where the paraxial approximation holds enables inverse design of the metasurfaces with weakly confining elements that are typically thicker than the wavelength in the material. For short-focal length applications at distances less than 100{\lambda} where the paraxial approximation fails, and high numerical apertures (NA) are necessary, a different approach is required. Here we designed and experimentally demonstrated single-mode waveguide-integrated meta beam shapers capable of redirecting the confined light into the free space and focusing it at focal distances less than 100{\lambda} above the chip surface into a tightly focused spot. Focal spot characteristics measured at 460nm operating wavelength are approaching diffraction limited focusing across a range of focal lengths, device footprints, and numerical apertures demonstrating the robustness of our approach. Focal volumes smaller than 1{\mu}m^3 are demonstrated for a range of focal distances below 50{\mu}m. For a device with some of the highest NA amongst integrated metasurfaces of 0.95 the measured focal volume is as small as just 0.06{\mu}m^3 at a focal distance of 13{\mu}m. These on-chip integrated ultra-high NA meta beam shapers have the potential to unlock new applications in quantum optical computing with trapped ions, localized optogenetic neurostimulation, and high resolution in-situ microscopy.


title: On the Road to Portability: Compressing End-to-End Motion Planner for Autonomous Driving

abstract: End-to-end motion planning models equipped with deep neural networks have shown great potential for enabling full autonomous driving. However, the oversized neural networks render them impractical for deployment on resource-constrained systems, which unavoidably requires more computational time and resources during reference.To handle this, knowledge distillation offers a promising approach that compresses models by enabling a smaller student model to learn from a larger teacher model. Nevertheless, how to apply knowledge distillation to compress motion planners has not been explored so far. In this paper, we propose PlanKD, the first knowledge distillation framework tailored for compressing end-to-end motion planners. First, considering that driving scenes are inherently complex, often containing planning-irrelevant or even noisy information, transferring such information is not beneficial for the student planner. Thus, we design an information bottleneck based strategy to only distill planning-relevant information, rather than transfer all information indiscriminately. Second, different waypoints in an output planned trajectory may hold varying degrees of importance for motion planning, where a slight deviation in certain crucial waypoints might lead to a collision. Therefore, we devise a safety-aware waypoint-attentive distillation module that assigns adaptive weights to different waypoints based on the importance, to encourage the student to accurately mimic more crucial waypoints, thereby improving overall safety. Experiments demonstrate that our PlanKD can boost the performance of smaller planners by a large margin, and significantly reduce their reference time.


title: First-principle event reconstruction by time-charge readouts for the Taishan Antineutrino Observatory

abstract: The Taishan Antineutrino Observatory (TAO) is a liquid-scintillator satellite experiment of the Jiangmen Underground Neutrino Observatory (JUNO) to measure the reference reactor neutrino spectrum with sub-percent energy resolution. We use inhomogeous Poisson process and Tweedie generalized linear model (GLM) to calibrate the detector response and the charge distribution of a SiPM. We develop a pure probabilistic method using time and charge of SiPMs from first principles to reconstruct point-like events in the TAO central detector. Thanks to our precise model and the high photo-coverage and quantum efficiency of the SiPM tiles at TAO, we achieve a vertex position resolution better than 16 mm and an energy resolution of about 2% at 1 MeV, marking the world's best performance of liquid scintillator detectors. Our methodology is applicable to other experiments that utilize PMTs for time and charge readouts.


title: Analyzing the transport coefficients and observables of a rotating QGP medium in kinetic theory framework with a novel approach to the collision integral

abstract: In the present work, we have studied how the rotation of the QGP medium affects the transport coefficients and observables in heavy ion collisions. For the noncentral collisions, although most of the angular momentum gets carried away by the spectators, there still remains a finite angular momentum with a finite range of angular velocity, which thus incites rotation in the produced matter. As a result, various properties of the QGP medium are likely to be modulated by the rotation. We have calculated the transport coefficients and observables, such as electrical conductivity, thermal conductivity, Knudsen number, elliptic flow, specific heat at constant pressure, specific heat at constant volume, trace anomaly, thermal diffusion constant and isothermal compressibility using the kinetic theory to see the effect of rotation on them. In particular, we have used the novel relaxation time approximation for the collision integral in the relativistic Boltzmann transport equation to derive the transport coefficients and compared them with their values in the relaxation time approximation within the kinetic theory approach in conjunction with the finite angular velocity. We have found that the angular velocity plays an important role and enhances the flow of charge and heat in the medium. Further, as compared to the relaxation time approximation, the electrical and thermal conductivities have smaller values in the novel relaxation time approximation and these differences between the conductivities in the said approximations are more pronounced at high temperature than at low temperature. Furthermore, all the aforesaid observables are found to be sensitive to the rotation of the QGP medium.


title: IntactKV: Improving Large Language Model Quantization by Keeping Pivot Tokens Intact

abstract: Large language models (LLMs) excel in natural language processing but demand intensive computation. To mitigate this, various quantization methods have been explored, yet they compromise LLM performance. This paper unveils a previously overlooked type of outliers in LLMs. Such outliers are found to allocate most of the attention scores on initial tokens of input, termed as pivot tokens, which are crucial to the performance of quantized LLMs. Given that, we propose IntactKV to generate the KV cache of pivot tokens losslessly from the full-precision model. The approach is simple and easy to combine with existing quantization solutions with no extra inference overhead. Besides, IntactKV can be calibrated as additional LLM parameters to boost the quantized LLMs further with minimal training costs. Mathematical analysis also proves that IntactKV effectively reduces the upper bound of quantization error. Empirical results show that IntactKV brings consistent improvement over various quantization methods across different LLMs and downstream tasks, leading to the new state-of-the-art for LLM quantization. The codes are available at https://github.com/ruikangliu/IntactKV.


title: Augmenting Automation: Intent-Based User Instruction Classification with Machine Learning

abstract: Electric automation systems offer convenience and efficiency in controlling electrical circuits and devices. Traditionally, these systems rely on predefined commands for control, limiting flexibility and adaptability. In this paper, we propose a novel approach to augment automation by introducing intent-based user instruction classification using machine learning techniques. Our system represents user instructions as intents, allowing for dynamic control of electrical circuits without relying on predefined commands. Through a machine learning model trained on a labeled dataset of user instructions, our system classifies intents from user input, enabling a more intuitive and adaptable control scheme. We present the design and implementation of our intent-based electric automation system, detailing the development of the machine learning model for intent classification. Experimental results demonstrate the effectiveness of our approach in enhancing user experience and expanding the capabilities of electric automation systems. Our work contributes to the advancement of smart technologies by providing a more seamless interaction between users and their environments.


title: Simulating chiral spin liquids with fermionic Projected Entangled Paired States

abstract: Chiral Spin Liquids (CSL) based on spin-1/2 fermionic Projected Entangled Pair States (fPEPS) are considered on the square lattice. First, fPEPS approximants of Gutzwiller-projected Chern insulators (GPCI) are investigated by Variational Monte Carlo (VMC) techniques on finite size tori. We show that such fPEPS of finite bond dimension can correctly capture the topological properties of the chiral spin liquid, as the exact GPCI, with the correct topological ground state degeneracy on the torus. Further, more general fPEPS are considered and optimized (on the infinite plane) to describe the CSL phase of a chiral frustrated Heisenberg antiferromagnet. The chiral modes are computed on the edge of a semi-infinite cylinder (of finite circumference) and shown to follow the predictions from Conformal Field Theory. In contrast to their bosonic analogs the (optimized) fPEPS do not suffer from the replication of the chiral edge mode in the odd topological sector.


title: Mitigating Catastrophic Forgetting in Large Language Models with Self-Synthesized Rehearsal

abstract: Large language models (LLMs) suffer from catastrophic forgetting during continual learning. Conventional rehearsal-based methods rely on previous training data to retain the model's ability, which may not be feasible in real-world applications. When conducting continual learning based on a publicly-released LLM checkpoint, the availability of the original training data may be non-existent. To address this challenge, we propose a framework called Self-Synthesized Rehearsal (SSR) that uses the LLM to generate synthetic instances for rehearsal. Concretely, we first employ the base LLM for in-context learning to generate synthetic instances. Subsequently, we utilize the latest LLM to refine the instance outputs based on the synthetic inputs, preserving its acquired ability. Finally, we select diverse high-quality synthetic instances for rehearsal in future stages. Experimental results demonstrate that SSR achieves superior or comparable performance compared to conventional rehearsal-based approaches while being more data-efficient. Besides, SSR effectively preserves the generalization capabilities of LLMs in general domains.


title: AcME-AD: Accelerated Model Explanations for Anomaly Detection

abstract: Pursuing fast and robust interpretability in Anomaly Detection is crucial, especially due to its significance in practical applications. Traditional Anomaly Detection methods excel in outlier identification but are often black-boxes, providing scant insights into their decision-making process. This lack of transparency compromises their reliability and hampers their adoption in scenarios where comprehending the reasons behind anomaly detection is vital. At the same time, getting explanations quickly is paramount in practical scenarios. To bridge this gap, we present AcME-AD, a novel approach rooted in Explainable Artificial Intelligence principles, designed to clarify Anomaly Detection models for tabular data. AcME-AD transcends the constraints of model-specific or resource-heavy explainability techniques by delivering a model-agnostic, efficient solution for interoperability. It offers local feature importance scores and a what-if analysis tool, shedding light on the factors contributing to each anomaly, thus aiding root cause analysis and decision-making. This paper elucidates AcME-AD's foundation, its benefits over existing methods, and validates its effectiveness with tests on both synthetic and real datasets. AcME-AD's implementation and experiment replication code is accessible in a public repository.


title: Dual Graph Attention based Disentanglement Multiple Instance Learning for Brain Age Estimation

abstract: Deep learning techniques have demonstrated great potential for accurately estimating brain age by analyzing Magnetic Resonance Imaging (MRI) data from healthy individuals. However, current methods for brain age estimation often directly utilize whole input images, overlooking two important considerations: 1) the heterogeneous nature of brain aging, where different brain regions may degenerate at different rates, and 2) the existence of age-independent redundancies in brain structure. To overcome these limitations, we propose a Dual Graph Attention based Disentanglement Multi-instance Learning (DGA-DMIL) framework for improving brain age estimation. Specifically, the 3D MRI data, treated as a bag of instances, is fed into a 2D convolutional neural network backbone, to capture the unique aging patterns in MRI. A dual graph attention aggregator is then proposed to learn the backbone features by exploiting the intra- and inter-instance relationships. Furthermore, a disentanglement branch is introduced to separate age-related features from age-independent structural representations to ameliorate the interference of redundant information on age prediction. To verify the effectiveness of the proposed framework, we evaluate it on two datasets, UK Biobank and ADNI, containing a total of 35,388 healthy individuals. Our proposed model demonstrates exceptional accuracy in estimating brain age, achieving a remarkable mean absolute error of 2.12 years in the UK Biobank. The results establish our approach as state-of-the-art compared to other competing brain age estimation models. In addition, the instance contribution scores identify the varied importance of brain areas for aging prediction, which provides deeper insights into the understanding of brain aging.


title: On q-series and the moment problem associated to local factors

abstract: We investigate the moment problem and Jacobi matrix associated -- by the operator theoretic framework of the semilocal trace formula -- to each finite set $S$ of places of $\mathbb Q$ containing the archimedean place. The measure is given by the absolute value squared of the product over $S$ of local factors restricted to the critical line. We treat the case $S=\{p,\infty\}$, where a single prime $p$ is adjoined to the archimedean place. We find that all the key ingredients such as the moments, the orthogonal polynomials and the Jacobi matrices can be expressed as power series in terms of the parameter $q:=1/p$. We show that the series which appear for the moments themselves are Lambert series. The study of the $q$-series for the coefficients of the Jacobi matrix, and for the associated orthogonal polynomials reveals an intriguing integrality result: all those coefficients belong to the ring $\mathbb Z[\frac{1}{\sqrt{2}}]$ obtained by adjoining $1 / \sqrt{2}$ to the ring of integers. The main result of this paper is the conceptual explanation of this integrality property using Catalan numbers.


title: SceneCraft: An LLM Agent for Synthesizing 3D Scene as Blender Code

abstract: This paper introduces SceneCraft, a Large Language Model (LLM) Agent converting text descriptions into Blender-executable Python scripts which render complex scenes with up to a hundred 3D assets. This process requires complex spatial planning and arrangement. We tackle these challenges through a combination of advanced abstraction, strategic planning, and library learning. SceneCraft first models a scene graph as a blueprint, detailing the spatial relationships among assets in the scene. SceneCraft then writes Python scripts based on this graph, translating relationships into numerical constraints for asset layout. Next, SceneCraft leverages the perceptual strengths of vision-language foundation models like GPT-V to analyze rendered images and iteratively refine the scene. On top of this process, SceneCraft features a library learning mechanism that compiles common script functions into a reusable library, facilitating continuous self-improvement without expensive LLM parameter tuning. Our evaluation demonstrates that SceneCraft surpasses existing LLM-based agents in rendering complex scenes, as shown by its adherence to constraints and favorable human assessments. We also showcase the broader application potential of SceneCraft by reconstructing detailed 3D scenes from the Sintel movie and guiding a video generative model with generated scenes as intermediary control signal.


title: Blockage-Aware Robust Beamforming in RIS-Aided Mobile Millimeter Wave MIMO Systems

abstract: Millimeter wave (mmWave) communications are sensitive to blockage over radio propagation paths. The emerging paradigm of reconfigurable intelligent surface (RIS) has the potential to overcome this issue by its ability to arbitrarily reflect the incident signals toward desired directions. This paper proposes a Neyman-Pearson (NP) criterion-based blockage-aware algorithm to improve communication resilience against blockage in mobile mmWave multiple input multiple output (MIMO) systems. By virtue of this pragmatic blockage-aware technique, we further propose an outage-constrained beamforming design for downlink mmWave MIMO transmission to achieve outage probability minimization and achievable rate maximization. To minimize the outage probability, a robust RIS beamformer with variant beamwidth is designed to combat uncertain channel state information (CSI). For the rate maximization problem, an accelerated projected gradient descent (PGD) algorithm is developed to solve the computational challenge of high-dimensional RIS phase-shift matrix (PSM) optimization. Particularly, we leverage a subspace constraint to reduce the scope of the projection operation and formulate a new Nesterov momentum acceleration scheme to speed up the convergence process of PGD. Extensive experiments confirm the effectiveness of the proposed blockage-aware approach, and the proposed accelerated PGD algorithm outperforms a number of representative baseline algorithms in terms of the achievable rate.


title: Resilient Mobile Energy Storage Resources Based Distribution Network Restoration in Interdependent Power-Transportation-Information Networks

abstract: The interactions between power, transportation, and information networks (PTIN), are becoming more profound with the advent of smart city technologies. Existing mobile energy storage resource (MESR)-based power distribution network (PDN) restoration schemes often neglect the interdependencies among PTIN, thus, efficient PDN restoration cannot be achieved. This paper outlines the interacting factors of power supply demand, traffic operation efficiency, communication coverage, electric vehicle (EV) deployment capability, and PDN controllability among PTIN and further develops a PTIN-interacting model to reflect the chained recovery effect of the MESR-based restoration process. On this basis, a two-stage PDN restoration scheme is proposed that utilizes three emergency resources, including EVs, mobile energy storage systems (MESSs), and unmanned aerial vehicles (UAVs), to restore the power supply and communication of PDNs. This scheme first improves the distribution automation function, EV deployment capability, and traffic operation efficiency by prioritizing the recovery of communication network (CN) and urban traffic network (UTN) loads. Then, EVs and MESSs are further scheduled to achieve a better PDN restoration effect with the support of the restored CNs and UTNs. Case studies on a PDN, CN, and UTN integrated test system are conducted to verify the effectiveness of the proposed scheme. The results show that the prioritized load recovery operation for CN and UTN facilities in this scheme greatly improves the PDN restoration effect.


title: Accelerating Greedy Coordinate Gradient via Probe Sampling

abstract: Safety of Large Language Models (LLMs) has become a critical issue given their rapid progresses. Greedy Coordinate Gradient (GCG) is shown to be effective in constructing adversarial prompts to break the aligned LLMs, but optimization of GCG is time-consuming. To reduce the time cost of GCG and enable more comprehensive studies of LLM safety, in this work, we study a new algorithm called $\texttt{Probe sampling}$. At the core of the algorithm is a mechanism that dynamically determines how similar a smaller draft model's predictions are to the target model's predictions for prompt candidates. When the target model is similar to the draft model, we rely heavily on the draft model to filter out a large number of potential prompt candidates. Probe sampling achieves up to $5.6$ times speedup using Llama2-7b-chat and leads to equal or improved attack success rate (ASR) on the AdvBench. Furthermore, probe sampling is also able to accelerate other prompt optimization techniques and adversarial methods, leading to acceleration of $1.8\times$ for AutoPrompt, $2.4\times$ for APE and $2.4\times$ for AutoDAN.


title: Real plane sextics without real points

abstract: We prove that the equisingular deformation type of a simple real plane sextic curve with smooth real part is determined by its real homological type, \ie, the polarization, exceptional divisors, and real structure recorded in the homology of the covering $K3$-surface. As an illustration, we obtain an equisingular deformation classification of real plane sextics with empty real part (for completeness, we consider the few non-simple ones as well).


title: Strategic SDN-based Microgrid Formation for Managing Communication Failures in Distribution System Restoration

abstract: Grid modernization has increased the reliance of power networks on cyber networks within distribution systems (DSs), heightening their vulnerability to disasters. Communication network failures significantly impede DS load recovery by diminishing observation and control. Prior research has largely ignored the need for integrated recovery of DS power and cyber networks' centralized control. Indeed, communication network restoration is critical for speedy load recovery through DS automation based microgrid formation. This paper exploits the data routing capabilities of software-defined networking (SDN) to enhance centralized control recovery in DS communication networks, incorporating it into a comprehensive DS restoration model. This model, tailored to the control requirements of load restoration, strategically allocates limited communication resources to re-establish connections between the operation center and terminal devices. Subsequently, DS automation is employed to orchestrate DS microgrid formation for power resupply. Additionally, we introduce a cyclic algorithm designed to optimize the load recovery via a multi-step, cooperative process. The efficacy of the proposed method is demonstrated on IEEE 33-node and IEEE 123-node test feeders.


title: RKHS-BA: A Semantic Correspondence-Free Multi-View Registration Framework with Global Tracking

abstract: This work reports a novel Bundle Adjustment (BA) formulation using a Reproducing Kernel Hilbert Space (RKHS) representation called RKHS-BA. The proposed formulation is correspondence-free, enables the BA to use RGB-D/LiDAR and semantic labels in the optimization directly, and provides a generalization for the photometric loss function commonly used in direct methods. RKHS-BA can incorporate appearance and semantic labels within a continuous spatial-semantic functional representation that does not require optimization via image pyramids. We demonstrate its applications in sliding-window odometry and global LiDAR mapping, which show highly robust performance in extremely challenging scenes and the best trade-off of generalization and accuracy.


title: Automatic Speech Recognition using Advanced Deep Learning Approaches: A survey

abstract: Recent advancements in deep learning (DL) have posed a significant challenge for automatic speech recognition (ASR). ASR relies on extensive training datasets, including confidential ones, and demands substantial computational and storage resources. Enabling adaptive systems improves ASR performance in dynamic environments. DL techniques assume training and testing data originate from the same domain, which is not always true. Advanced DL techniques like deep transfer learning (DTL), federated learning (FL), and reinforcement learning (RL) address these issues. DTL allows high-performance models using small yet related datasets, FL enables training on confidential data without dataset possession, and RL optimizes decision-making in dynamic environments, reducing computation costs. This survey offers a comprehensive review of DTL, FL, and RL-based ASR frameworks, aiming to provide insights into the latest developments and aid researchers and professionals in understanding the current challenges. Additionally, transformers, which are advanced DL techniques heavily used in proposed ASR frameworks, are considered in this survey for their ability to capture extensive dependencies in the input ASR sequence. The paper starts by presenting the background of DTL, FL, RL, and Transformers and then adopts a well-designed taxonomy to outline the state-of-the-art approaches. Subsequently, a critical analysis is conducted to identify the strengths and weaknesses of each framework. Additionally, a comparative study is presented to highlight the existing challenges, paving the way for future research opportunities.


title: Resilient Microgrid Formation Considering Communication Interruptions

abstract: Distribution system (DS) communication failures following extreme events often degrade monitoring and control functions, thus preventing the acquisition of complete global DS component state information, on which existing post-disaster DS restoration methods are based. This letter proposes methods of inferring the states of DS components in the case of incomplete component state information. By using the known DS information, the operating states of unobservable DS branches and buses can be inferred, providing complete information for DS performance restoration before full communication recovery


title: Secure and Scalable Network Slicing with Plug-and-Play Support for Power Distribution System Communication Networks

abstract: With the rapid development of power distribution systems (PDSs), the number of terminal devices and the types of delivered services involved are constantly growing. These trends make the operations of PDSs highly dependent on the support of advanced communication networks, which face two related challenges. The first is to provide sufficient flexibility, resilience, and security to meet varying demands and ensure the proper operation of gradually diversifying network services. The second is to realize the automatic identification of terminal devices, thus reducing the network maintenance burden. To solve these problems, this paper presents a novel multiservice network integration and device authentication slice-based network slicing scheme. In this scheme, the integration of PDS communication networks enables network resource sharing, and recovery from communication interruption is achieved through network slicing in the integrated network. Authentication servers periodically poll terminal devices, adjusting network slice ranges based on authentication results, thereby facilitating dynamic network slicing. Additionally, secure plug-and-play support for PDS terminal devices and network protection are achieved through device identification and dynamic adjustment of network slices. On this basis, a network optimization and upgrading methodology for load balancing and robustness enhancement is further proposed. This approach is designed to improve the performance of PDS communication networks, adapting to ongoing PDS development and the evolution of PDS services. The simulation results show that the proposed schemes endow a PDS communication network with favorable resource utilization, fault recovery, terminal device plug-and-play support, load balancing, and improved network robustness.


title: Feedback and ionized gas outflows in four low-radio power AGN at z $\sim$0.15

abstract: An increasing number of observations and simulations suggests that low-power (<10$^{44}$ erg s$^{-1}$) jets may be a significant channel of feedback produced by active galactic nuclei (AGN), but little is known about their actual effect on their host galaxies from the observational point of view. We targeted four luminous type 2 AGN hosting moderately powerful radio emission ($\sim$10$^{44}$ erg s$^{-1}$), two of which and possibly a third are associated with jets, with optical integral field spectroscopy observations from the Multi Unit Spectroscopic Explorer (MUSE) at the Very Large Telescope (VLT) to analyze the properties of their ionized gas as well as the properties and effects of ionized outflows. We combined these observations with Very Large Array (VLA) and e-MERLIN data to investigate the relations and interactions between the radio jets and host galaxies. We detected ionized outflows as traced by the fast bulk motion of the gas. The outflows extended over kiloparsec scales in the direction of the jet, when present. In the two sources with resolved radio jets, we detected a strong enhancement in the emission-line velocity dispersion (up to 1000 km s$^{-1}$) perpendicular to the direction of the radio jets. We also found a correlation between the mass and the energetics of this high-velocity dispersion gas and the radio power, which supports the idea that the radio emission may cause the enhanced turbulence. This phenomenon, which is now being observed in an increasing number of objects, might represent an important channel for AGN feedback on galaxies.


title: Improved Modelling of Detector Response Effects in Phonon-based Crystal Detectors used for Dark Matter Searches

abstract: Various dark matter search experiments employ phonon-based crystal detectors operated at cryogenic temperatures. Some of these detectors, including certain silicon detectors used by the SuperCDMS Collaboration, are able to achieve single-charge sensitivity when a voltage bias is applied across the detector. The total amount of phonon energy measured by such a detector is proportional to the number of electron-hole pairs created by the interaction. However, crystal impurities and surface effects can cause propagating charges to either become trapped inside the crystal or create additional unpaired charges, producing non-quantized measured energy as a result. A new analytical model for describing these detector response effects in phonon-based crystal detectors is presented. This model improves upon previous versions by demonstrating how the detector response, and thus the measured energy spectrum, is expected to differ depending on the source of events. We use this model to extract detector response parameters for SuperCDMS HVeV detectors, and illustrate how this robust modelling can help statistically discriminate between sources of events in order to improve the sensitivity of dark matter search experiments.


title: Decentralized Implicit Differentiation

abstract: The ability to differentiate through optimization problems has unlocked numerous applications, from optimization-based layers in machine learning models to complex design problems formulated as bilevel programs. It has been shown that exploiting problem structure can yield significant computation gains for optimization and, in some cases, enable distributed computation. One should expect that this structure can be similarly exploited for gradient computation. In this work, we discuss a decentralized framework for computing gradients of constraint-coupled optimization problems. First, we show that this framework results in significant computational gains, especially for large systems, and provide sufficient conditions for its validity. Second, we leverage exponential decay of sensitivities in graph-structured problems towards building a fully distributed algorithm with convergence guarantees. Finally, we use the methodology to rigorously estimate marginal emissions rates in power systems models. Specifically, we demonstrate how the distributed scheme allows for accurate and efficient estimation of these important emissions metrics on large dynamic power system models.


title: GSL-LPA: Fast Label Propagation Algorithm (LPA) for Community Detection with no Internally-Disconnected Communities

abstract: Community detection is the problem of identifying tightly connected clusters of nodes within a network. Efficient parallel algorithms for this play a crucial role in various applications, especially as datasets expand to significant sizes. The Label Propagation Algorithm (LPA) is commonly employed for this purpose due to its ease of parallelization, rapid execution, and scalability. However, it may yield internally disconnected communities. This technical report introduces GSL-LPA, derived from our parallelization of LPA, namely GVE-LPA. Our experiments on a system with two 16-core Intel Xeon Gold 6226R processors show that GSL-LPA not only mitigates this issue but also surpasses FLPA, igraph LPA, and NetworKit LPA by 55x, 10,300x, and 5.8x, respectively, achieving a processing rate of 844 M edges/s on a 3.8 B edge graph. Additionally, GSL-LPA scales at a rate of 1.6x for every doubling of threads.


title: Solvability of a group based on its number of subgroups

abstract: In this paper, we provide some conditions of (super)-solvability and nilpotency of a finite group $G$ based on its number of subgroups $Sub(G)$. Our results generalize the classification of finite groups with less than $20$ subgroups by Betz and Nash. We also provide an application of our results in studying comaximal subgroup graph of a group. Finally, we conclude with some open issues.


title: Single-image camera calibration with model-free distortion correction

abstract: Camera calibration is a process of paramount importance in computer vision applications that require accurate quantitative measurements. The popular method developed by Zhang relies on the use of a large number of images of a planar grid of fiducial points captured in multiple poses. Although flexible and easy to implement, Zhang's method has some limitations. The simultaneous optimization of the entire parameter set, including the coefficients of a predefined distortion model, may result in poor distortion correction at the image boundaries or in miscalculation of the intrinsic parameters, even with a reasonably small reprojection error. Indeed, applications involving image stitching (e.g. multi-camera systems) require accurate mapping of distortion up to the outermost regions of the image. Moreover, intrinsic parameters affect the accuracy of camera pose estimation, which is fundamental for applications such as vision servoing in robot navigation and automated assembly. This paper proposes a method for estimating the complete set of calibration parameters from a single image of a planar speckle pattern covering the entire sensor. The correspondence between image points and physical points on the calibration target is obtained using Digital Image Correlation. The effective focal length and the extrinsic parameters are calculated separately after a prior evaluation of the principal point. At the end of the procedure, a dense and uniform model-free distortion map is obtained over the entire image. Synthetic data with different noise levels were used to test the feasibility of the proposed method and to compare its metrological performance with Zhang's method. Real-world tests demonstrate the potential of the developed method to reveal aspects of the image formation that are hidden by averaging over multiple images.


title: Efficient Alternative Finite Difference WENO Schemes for Hyperbolic Conservation Laws

abstract: Higher order finite difference Weighted Essentially Non-Oscillatory (WENO) schemes for conservation laws are extremely popular because, for multidimensional problems, they offer high order accuracy at a fraction of the cost of finite volume WENO or DG schemes. Such schemes come in two formulations. The very popular classical finite difference WENO (FD-WENO) method (Shu and Osher, J. Comput. Phys., 83 (1989) 32-78) relies two reconstruction steps applied to two split fluxes. However, the method cannot accommodate different types of Riemann solvers and cannot preserve free stream boundary conditions on curvilinear meshes. This limits its utility. The alternative finite difference WENO (AFD-WENO) method can overcome these deficiencies, however, much less work has been done on this method. The reasons are three-fold. First, it is difficult for the casual reader to understand the intricate logic that requires higher order derivatives of the fluxes to be evaluated at zone boundaries. The analytical methods for deriving the update equation for AFD-WENO schemes are somewhat recondite. To overcome that difficulty, we provide an easily accessible script that is based on a computer algebra system in Appendix A of this paper. Second, the method relies on interpolation rather than reconstruction, and WENO interpolation formulae have not been documented in the literature as thoroughly as WENO reconstruction formulae. In this paper, we explicitly provide all necessary WENO interpolation formulae that are needed for implementing AFD-WENO up to ninth order. The third reason is that AFD-WENO requires higher order derivatives of the fluxes to be available at zone boundaries. Since those derivatives are usually obtained by finite differencing the zone-centered fluxes, they become susceptible to a Gibbs phenomenon when the solution ...

categories: math.NA cs.NA math-ph math.MP physics.flu-dyn


title: Smooth Computation without Input Delay: Robust Tube-Based Model Predictive Control for Robot Manipulator Planning

abstract: Model Predictive Control (MPC) has exhibited remarkable capabilities in optimizing objectives and meeting constraints. However, the substantial computational burden associated with solving the Optimal Control Problem (OCP) at each triggering instant introduces significant delays between state sampling and control application. These delays limit the practicality of MPC in resource-constrained systems when engaging in complex tasks. The intuition to address this issue in this paper is that by predicting the successor state, the controller can solve the OCP one time step ahead of time thus avoiding the delay of the next action. To this end, we compute deviations between real and nominal system states, predicting forthcoming real states as initial conditions for the imminent OCP solution. Anticipatory computation stores optimal control based on current nominal states, thus mitigating the delay effects. Additionally, we establish an upper bound for linearization error, effectively linearizing the nonlinear system, reducing OCP complexity, and enhancing response speed. We provide empirical validation through two numerical simulations and corresponding real-world robot tasks, demonstrating significant performance improvements and augmented response speed (up to $90\%$) resulting from the seamless integration of our proposed approach compared to conventional time-triggered MPC strategies.


title: Efficient Alternative Finite Difference WENO Schemes for Hyperbolic Systems with Non-Conservative Products

abstract: Higher order finite difference Weighted Essentially Non-Oscillatory (WENO) schemes for conservation laws represent a technology that has been reasonably consolidated. They are extremely popular because, when applied to multidimensional problems, they offer high order accuracy at a fraction of the cost of finite volume WENO or DG schemes. They come in two flavors. There is the classical finite difference WENO (FD-WENO) method (Shu and Osher, J. Comput. Phys., 83 (1989) 32-78). However, in recent years there is also an alternative finite difference WENO (AFD-WENO) method which has recently been formalized into a very useful general-purpose algorithm for conservation laws (Balsara et al., Efficient Alternative Finite Difference WENO Schemes for Hyperbolic Conservation Laws, submitted to CAMC (2023)). However, the FD-WENO algorithm has only very recently been formulated for hyperbolic systems with non-conservative products (Balsara et al., Efficient Finite Difference WENO Scheme for Hyperbolic Systems with Non-Conservative Products, to appear CAMC (2023)). In this paper we show that there are substantial advantages in obtaining an AFD-WENO algorithm for hyperbolic systems with non-conservative products. Such an algorithm is documented in this paper. We present an AFD-WENO formulation in fluctuation form that is carefully engineered to retrieve the flux form when that is warranted and nevertheless extends to non-conservative products. The method is flexible because it allows any Riemann solver to be used. The formulation we arrive at is such that when non-conservative products are absent it reverts exactly to the formulation in the second citation above which is in exact flux conservation form. The ability to transition to a precise conservation form when non-conservative products are absent ensures, via the Lax-Wendroff theorem, that shock locations will be exactly ...


title: Dissecting Language Models: Machine Unlearning via Selective Pruning

abstract: Understanding and shaping the behaviour of Large Language Models (LLMs) is increasingly important as applications become more powerful and more frequently adopted. This paper introduces a machine unlearning method specifically designed for LLMs. We introduce a selective pruning method for LLMs that removes neurons based on their relative importance on a targeted capability compared to overall network performance. This approach is a compute- and data-efficient method for identifying and removing neurons that enable specific behaviours. Our findings reveal that both feed-forward and attention neurons in LLMs are specialized; that is, for specific tasks, certain neurons are more crucial than others.


title: Defending Against Data Reconstruction Attacks in Federated Learning: An Information Theory Approach

abstract: Federated Learning (FL) trains a black-box and high-dimensional model among different clients by exchanging parameters instead of direct data sharing, which mitigates the privacy leak incurred by machine learning. However, FL still suffers from membership inference attacks (MIA) or data reconstruction attacks (DRA). In particular, an attacker can extract the information from local datasets by constructing DRA, which cannot be effectively throttled by existing techniques, e.g., Differential Privacy (DP). In this paper, we aim to ensure a strong privacy guarantee for FL under DRA. We prove that reconstruction errors under DRA are constrained by the information acquired by an attacker, which means that constraining the transmitted information can effectively throttle DRA. To quantify the information leakage incurred by FL, we establish a channel model, which depends on the upper bound of joint mutual information between the local dataset and multiple transmitted parameters. Moreover, the channel model indicates that the transmitted information can be constrained through data space operation, which can improve training efficiency and the model accuracy under constrained information. According to the channel model, we propose algorithms to constrain the information transmitted in a single round of local training. With a limited number of training rounds, the algorithms ensure that the total amount of transmitted information is limited. Furthermore, our channel model can be applied to various privacy-enhancing techniques (such as DP) to enhance privacy guarantees against DRA. Extensive experiments with real-world datasets validate the effectiveness of our methods.


title: Network analysis using Krylov subspace trajectories

abstract: We describe a set of network analysis methods based on the rows of the Krylov subspace matrix computed from a network adjacency matrix via power iteration using a non-random initial vector. We refer to these node-specific row vectors as Krylov subspace trajectories. While power iteration using a random initial starting vector is commonly applied to the network adjacency matrix to compute eigenvector centrality values, this application only uses the final vector generated after numerical convergence. Importantly, use of a random initial vector means that the intermediate results of power iteration are also random and lack a clear interpretation. To the best of our knowledge, use of intermediate power iteration results for network analysis has been limited to techniques that leverage just a single pre-convergence solution, e.g., Power Iteration Clustering. In this paper, we explore methods that apply power iteration with a non-random inital vector to the network adjacency matrix to generate Krylov subspace trajectories for each node. These non-random trajectories provide important information regarding network structure, node importance, and response to perturbations. We have created this short preprint in part to generate feedback from others in the network analysis community who might be aware of similar existing work.


title: A comprehensive cross-language framework for harmful content detection with the aid of sentiment analysis

abstract: In today's digital world, social media plays a significant role in facilitating communication and content sharing. However, the exponential rise in user-generated content has led to challenges in maintaining a respectful online environment. In some cases, users have taken advantage of anonymity in order to use harmful language, which can negatively affect the user experience and pose serious social problems. Recognizing the limitations of manual moderation, automatic detection systems have been developed to tackle this problem. Nevertheless, several obstacles persist, including the absence of a universal definition for harmful language, inadequate datasets across languages, the need for detailed annotation guideline, and most importantly, a comprehensive framework. This study aims to address these challenges by introducing, for the first time, a detailed framework adaptable to any language. This framework encompasses various aspects of harmful language detection. A key component of the framework is the development of a general and detailed annotation guideline. Additionally, the integration of sentiment analysis represents a novel approach to enhancing harmful language detection. Also, a definition of harmful language based on the review of different related concepts is presented. To demonstrate the effectiveness of the proposed framework, its implementation in a challenging low-resource language is conducted. We collected a Persian dataset and applied the annotation guideline for harmful detection and sentiment analysis. Next, we present baseline experiments utilizing machine and deep learning methods to set benchmarks. Results prove the framework's high performance, achieving an accuracy of 99.4% in offensive language detection and 66.2% in sentiment analysis.


title: Employing LLMs for Incident Response Planning and Review

abstract: Incident Response Planning (IRP) is essential for effective cybersecurity management, requiring detailed documentation (or playbooks) to guide security personnel during incidents. Yet, creating comprehensive IRPs is often hindered by challenges such as complex systems, high turnover rates, and legacy technologies lacking documentation. This paper argues that, despite these obstacles, the development, review, and refinement of IRPs can be significantly enhanced through the utilization of Large Language Models (LLMs) like ChatGPT. By leveraging LLMs for tasks such as drafting initial plans, suggesting best practices, and identifying documentation gaps, organizations can overcome resource constraints and improve their readiness for cybersecurity incidents. We discuss the potential of LLMs to streamline IRP processes, while also considering the limitations and the need for human oversight in ensuring the accuracy and relevance of generated content. Our findings contribute to the cybersecurity field by demonstrating a novel approach to enhancing IRP with AI technologies, offering practical insights for organizations seeking to bolster their incident response capabilities.


title: Can a Confident Prior Replace a Cold Posterior?

abstract: Benchmark datasets used for image classification tend to have very low levels of label noise. When Bayesian neural networks are trained on these datasets, they often underfit, misrepresenting the aleatoric uncertainty of the data. A common solution is to cool the posterior, which improves fit to the training data but is challenging to interpret from a Bayesian perspective. We explore whether posterior tempering can be replaced by a confidence-inducing prior distribution. First, we introduce a "DirClip" prior that is practical to sample and nearly matches the performance of a cold posterior. Second, we introduce a "confidence prior" that directly approximates a cold likelihood in the limit of decreasing temperature but cannot be easily sampled. Lastly, we provide several general insights into confidence-inducing priors, such as when they might diverge and how fine-tuning can mitigate numerical instability.