title: Bayesian Learned Models Can Detect Adversarial Malware For Free

abstract: The vulnerability of machine learning-based malware detectors to adversarial attacks has prompted the need for robust solutions. Adversarial training is an effective method but is computationally expensive to scale up to large datasets and comes at the cost of sacrificing model performance for robustness. We hypothesize that adversarial malware exploits the low-confidence regions of models and can be identified using epistemic uncertainty of ML approaches -- epistemic uncertainty in a machine learning-based malware detector is a result of a lack of similar training samples in regions of the problem space. In particular, a Bayesian formulation can capture the model parameters' distribution and quantify epistemic uncertainty without sacrificing model performance. To verify our hypothesis, we consider Bayesian learning approaches with a mutual information-based formulation to quantify uncertainty and detect adversarial malware in Android, Windows domains and PDF malware. We found, quantifying uncertainty through Bayesian learning methods can defend against adversarial malware. In particular, Bayesian models: (1) are generally capable of identifying adversarial malware in both feature and problem space, (2) can detect concept drift by measuring uncertainty, and (3) with a diversity-promoting approach (or better posterior approximations) lead to parameter instances from the posterior to significantly enhance a detectors' ability.


title: A thermodynamically consistent physics-informed deep learning material model for short fiber/polymer nanocomposites

abstract: This work proposes a physics-informed deep learning (PIDL)-based constitutive model for investigating the viscoelastic-viscoplastic behavior of short fiber-reinforced nanoparticle-filled epoxies under various ambient conditions. The deep-learning model is trained to enforce thermodynamic principles, leading to a thermodynamically consistent constitutive model. To accomplish this, a long short-term memory network is combined with a feed-forward neural network to predict internal variables required for characterizing the internal dissipation of the nanocomposite materials. In addition, another feed-forward neural network is used to indicate the free-energy function, which enables defining the thermodynamic state of the entire system. The PIDL model is initially developed for the three-dimensional case by generating synthetic data from a classical constitutive model. The model is then trained by extracting the data directly from cyclic loading-unloading experimental tests. Numerical examples show that the PIDL model can accurately predict the mechanical behavior of epoxy-based nanocomposites for different volume fractions of fibers and nanoparticles under various hygrothermal conditions.


title: UAV Corridor Coverage Analysis with Base Station Antenna Uptilt and Strongest Signal Association

abstract: Unmanned aerial vehicle (UAV) corridors are sky lanes where UAVs fly through safely between their origin and destination. To ensure the successful operation of UAV corridors, beyond visual line of sight (BVLOS) wireless connectivity within the corridor is crucial. One promising solution to support this is the use of cellular-connected UAV (C-UAV) networks, which offer long-range and seamless wireless coverage. However, conventional terrestrial base stations (BSs) that typically employ down-tilted sector antennas to serve ground users are not ideally suited to serve the aerial vehicles positioned above the BSs. In our previous work, we focused on studying the optimal uptilt angle of BS antennas to maximize the wireless coverage probability in UAV corridors. However, the association of BSs with UAVs was restricted to the nearest BS association, which limits the potential coverage benefits. In this paper, we address this limitation by considering the strongest BS signal association in UAV corridors, which enables enhanced coverage within the corridor compared to the nearest BS association. The strongest BS association allows UAVs to connect with the second nearest BSs while also accounting for interference from the third nearest BSs. Closed-form expression analysis and simulation results show that the strongest BSs association in UAV corridors yields a superior coverage probability when compared to the nearest BS association.


title: Cepheids with giant companions: A new, abundant source of Cepheid astrophysics

abstract: We present a progress report of our project aiming to increase the number of known Cepheids in double-lined binary (SB2) systems from six to 100 or more. This will allow us, among other goals, to accurately measure masses for a large sample of Cepheids. Currently, only six accurate Cepheid masses are available, which hinders our understanding of their physical properties and renders the Cepheid mass--luminosity relation poorly constrained. At the same time, Cepheids are widely used for essential measurements (e.g., extragalactic distances, the Hubble constant). To examine Cepheid period--luminosity relations, we selected as binary candidates Cepheids that are too bright for their periods. To date, we have confirmed 56 SB2 systems, including the detection of significant orbital motions of the components for 32. We identified systems with orbital periods up to five times shorter than the shortest reported period to date, as well as systems with mass ratios significantly different from unity (suggesting past merger events). Both features are essential to understand how multiplicity affects the formation and destruction of Cepheid progenitors and what effect this has on global Cepheid properties. We also present eight new systems composed of two Cepheids (only one such system was known before). Among confirmed SB2 Cepheids, there are also several wide-orbit systems. In the future, these may facilitate independent accurate geometric distance measurements to the Large and Small Magellanic Clouds.


title: Demonstration of Near-Epithermal Neutron Reflective Optics

abstract: Specular reflection of neutrons on material surfaces has been demonstrated in the energy range of 0.09-0.7 eV. The results suggest that the applicable energy range of reflective neutron optics can be extended to the near-epithermal region by using existing techniques.


title: Chinese Offensive Language Detection:Current Status and Future Directions

abstract: Despite the considerable efforts being made to monitor and regulate user-generated content on social media platforms, the pervasiveness of offensive language, such as hate speech or cyberbullying, in the digital space remains a significant challenge. Given the importance of maintaining a civilized and respectful online environment, there is an urgent and growing need for automatic systems capable of detecting offensive speech in real time. However, developing effective systems for processing languages such as Chinese presents a significant challenge, owing to the language's complex and nuanced nature, which makes it difficult to process automatically. This paper provides a comprehensive overview of offensive language detection in Chinese, examining current benchmarks and approaches and highlighting specific models and tools for addressing the unique challenges of detecting offensive language in this complex language. The primary objective of this survey is to explore the existing techniques and identify potential avenues for further research that can address the cultural and linguistic complexities of Chinese.


title: Topological Vector Spaces: a non-standard approach with monads and galaxies

abstract: A new and extensive formalism is developed for monads and galaxies in non-standard enlargements. It is shown that monads and galaxies can be manipulated using order-preserving and order-reversing set-to-set maps, and that set properties associated with these maps can be extended not only to internal sets but to all monads and galaxies. An abstract theory of Intersections of Galaxies is introduced. These concepts are applied to basic topology as well (locally convex) topological vector spaces, their various properties and completions, allowing these to be effortlessly defined and characterized. Duality theory is studied in this framework, allowing in particular to formulate new brief and insightful proofs for the theorems of Mackey-Arens and Grothendieck completeness without any technicalities.


title: Multi-Modal Contrastive Learning for Online Clinical Time-Series Applications

abstract: Electronic Health Record (EHR) datasets from Intensive Care Units (ICU) contain a diverse set of data modalities. While prior works have successfully leveraged multiple modalities in supervised settings, we apply advanced self-supervised multi-modal contrastive learning techniques to ICU data, specifically focusing on clinical notes and time-series for clinically relevant online prediction tasks. We introduce a loss function Multi-Modal Neighborhood Contrastive Loss (MM-NCL), a soft neighborhood function, and showcase the excellent linear probe and zero-shot performance of our approach.


title: A Situation-aware Enhancer for Personalized Recommendation

abstract: When users interact with Recommender Systems (RecSys), current situations, such as time, location, and environment, significantly influence their preferences. Situations serve as the background for interactions, where relationships between users and items evolve with situation changes. However, existing RecSys treat situations, users, and items on the same level. They can only model the relations between situations and users/items respectively, rather than the dynamic impact of situations on user-item associations (i.e., user preferences). In this paper, we provide a new perspective that takes situations as the preconditions for users' interactions. This perspective allows us to separate situations from user/item representations, and capture situations' influences over the user-item relationship, offering a more comprehensive understanding of situations. Based on it, we propose a novel Situation-Aware Recommender Enhancer (SARE), a pluggable module to integrate situations into various existing RecSys. Since users' perception of situations and situations' impact on preferences are both personalized, SARE includes a Personalized Situation Fusion (PSF) and a User-Conditioned Preference Encoder (UCPE) to model the perception and impact of situations, respectively. We conduct experiments of applying SARE on seven backbones in various settings on two real-world datasets. Experimental results indicate that SARE improves the recommendation performances significantly compared with backbones and SOTA situation-aware baselines.


title: Uncertainty-Aware SAR ATR: Defending Against Adversarial Attacks via Bayesian Neural Networks

abstract: Adversarial attacks have demonstrated the vulnerability of Machine Learning (ML) image classifiers in Synthetic Aperture Radar (SAR) Automatic Target Recognition (ATR) systems. An adversarial attack can deceive the classifier into making incorrect predictions by perturbing the input SAR images, for example, with a few scatterers attached to the on-ground objects. Therefore, it is critical to develop robust SAR ATR systems that can detect potential adversarial attacks by leveraging the inherent uncertainty in ML classifiers, thereby effectively alerting human decision-makers. In this paper, we propose a novel uncertainty-aware SAR ATR for detecting adversarial attacks. Specifically, we leverage the capability of Bayesian Neural Networks (BNNs) in performing image classification with quantified epistemic uncertainty to measure the confidence for each input SAR image. By evaluating the uncertainty, our method alerts when the input SAR image is likely to be adversarially generated. Simultaneously, we also generate visual explanations that reveal the specific regions in the SAR image where the adversarial scatterers are likely to to be present, thus aiding human decision-making with hints of evidence of adversarial attacks. Experiments on the MSTAR dataset demonstrate that our approach can identify over 80% adversarial SAR images with fewer than 20% false alarms, and our visual explanations can identify up to over 90% of scatterers in an adversarial SAR image.


title: Doppler-assisted quantum resonances through swappable excitation pathways in Potassium vapor

abstract: We report the observation of two additional sub-natural line width quantum interference in the $D_2$ manifold of $^{39}K$ vapor, in addition to the usual single Electromagnetically induced transparency peak. The other two features appear exclusively because $^{39}K$ ground hyperfine splitting is smaller than the Doppler broadened absorption profile. This allows probe and control beams to swap their transition pathways. The control beam detuning captures the nature of the coherence, therefore an unusual phenomenon of conversion from perfect transparency to enhanced absorption is observed and explained by utilizing adiabatic elimination of the excited state in the Master equation. Controlling such dark and bright resonances leads to new applications in quantum technologies viz. frequency offset laser stabilization and long-lived quantum memory.


title: Online Prediction for Streaming Tensor Time Series

abstract: Real-time prediction plays a vital role in various control systems, such as traffic congestion control and wireless channel resource allocation. In these scenarios, the predictor usually needs to track the evolution of the latent statistical patterns in the modern high-dimensional streaming time series continuously and quickly, which presents new challenges for traditional prediction methods. This paper proposes a novel algorithm based on tensor factorization to predict streaming tensor time series online. The proposed algorithm updates the predictor in a low-complexity online manner to adapt to the time-evolving data. Additionally, an automatically adaptive version of the algorithm is presented to mitigate the negative impact of stale data. Simulation results demonstrate that our proposed methods achieve prediction accuracy similar to that of conventional offline tensor prediction methods, while being much faster than them during long-term online prediction. Therefore, our proposed algorithm provides an effective and efficient solution for the online prediction of streaming tensor time series.


title: Implementation of the Principal Component Analysis onto High-Performance Computer Facilities for Hyperspectral Dimensionality Reduction: Results and Comparisons

abstract: Dimensionality reduction represents a critical preprocessing step in order to increase the efficiency and the performance of many hyperspectral imaging algorithms. However, dimensionality reduction algorithms, such as the Principal Component Analysis (PCA), suffer from their computationally demanding nature, becoming advisable for their implementation onto high-performance computer architectures for applications under strict latency constraints. This work presents the implementation of the PCA algorithm onto two different high-performance devices, namely, an NVIDIA Graphics Processing Unit (GPU) and a Kalray manycore, uncovering a highly valuable set of tips and tricks in order to take full advantage of the inherent parallelism of these high-performance computing platforms, and hence, reducing the time that is required to process a given hyperspectral image. Moreover, the achieved results obtained with different hyperspectral images have been compared with the ones that were obtained with a field programmable gate array (FPGA)-based implementation of the PCA algorithm that has been recently published, providing, for the first time in the literature, a comprehensive analysis in order to highlight the pros and cons of each option.


title: Quantum Algorithms: A New Frontier in Financial Crime Prevention

abstract: Financial crimes fast proliferation and sophistication require novel approaches that provide robust and effective solutions. This paper explores the potential of quantum algorithms in combating financial crimes. It highlights the advantages of quantum computing by examining traditional and Machine Learning (ML) techniques alongside quantum approaches. The study showcases advanced methodologies such as Quantum Machine Learning (QML) and Quantum Artificial Intelligence (QAI) as powerful solutions for detecting and preventing financial crimes, including money laundering, financial crime detection, cryptocurrency attacks, and market manipulation. These quantum approaches leverage the inherent computational capabilities of quantum computers to overcome limitations faced by classical methods. Furthermore, the paper illustrates how quantum computing can support enhanced financial risk management analysis. Financial institutions can improve their ability to identify and mitigate risks, leading to more robust risk management strategies by exploiting the quantum advantage. This research underscores the transformative impact of quantum algorithms on financial risk management. By embracing quantum technologies, organisations can enhance their capabilities to combat evolving threats and ensure the integrity and stability of financial systems.


title: How to Cache Important Contents for Multi-modal Service in Dynamic Networks: A DRL-based Caching Scheme

abstract: With the continuous evolution of networking technologies, multi-modal services that involve video, audio, and haptic contents are expected to become the dominant multimedia service in the near future. Edge caching is a key technology that can significantly reduce network load and content transmission latency, which is critical for the delivery of multi-modal contents. However, existing caching approaches only rely on a limited number of factors, e.g., popularity, to evaluate their importance for caching, which is inefficient for caching multi-modal contents, especially in dynamic network environments. To overcome this issue, we propose a content importance-based caching scheme which consists of a content importance evaluation model and a caching model. By leveraging dueling double deep Q networks (D3QN) model, the content importance evaluation model can adaptively evaluate contents' importance in dynamic networks. Based on the evaluated contents' importance, the caching model can easily cache and evict proper contents to improve caching efficiency. The simulation results show that the proposed content importance-based caching scheme outperforms existing caching schemes in terms of caching hit ratio (at least 15% higher), reduced network load (up to 22% reduction), average number of hops (up to 27% lower), and unsatisfied requests ratio (more than 47% reduction).


title: Shaping entangled photons through thick scattering media using an advanced wave beacon

abstract: Entangled photons provide transformative new paths in the fields of communication, sensing, and computing. However, when entangled photons propagate through a complex medium such as a biological tissue or a turbulent atmosphere, their correlations are scrambled. Using wavefront shaping to compensate for the scattering and retrieve the two-photon correlations is challenging due to the low signal-to-noise ratio of the two-photon signal. While previous works partly addressed this challenge by using feedback from a strong classical laser beam that co-propagates with the entangled photons, such methods frequently depend on assumptions about the complex medium, limiting the applicability of quantum wavefront shaping. In this work, we propose and demonstrate a new feedback mechanism that is inspired by Klyshko's advanced wave picture, in which the classical laser beam counter-propagates with one of the entangled photons and co-propagates with the other. The new Klyshko feedback allows compensation of scattering in thick samples and even in situations where each photon propagates through a different scattering medium. Since the advanced wave picture applies whenever optical reciprocity is valid, such Klyshko optimization can be utilized across a wide range of configurations, offering a robust and alignment-free setup. We therefore believe this protocol will open the door for real-world applications of quantum wavefront shaping.


title: Common Sense Enhanced Knowledge-based Recommendation with Large Language Model

abstract: Knowledge-based recommendation models effectively alleviate the data sparsity issue leveraging the side information in the knowledge graph, and have achieved considerable performance. Nevertheless, the knowledge graphs used in previous work, namely metadata-based knowledge graphs, are usually constructed based on the attributes of items and co-occurring relations (e.g., also buy), in which the former provides limited information and the latter relies on sufficient interaction data and still suffers from cold start issue. Common sense, as a form of knowledge with generality and universality, can be used as a supplement to the metadata-based knowledge graph and provides a new perspective for modeling users' preferences. Recently, benefiting from the emergent world knowledge of the large language model, efficient acquisition of common sense has become possible. In this paper, we propose a novel knowledge-based recommendation framework incorporating common sense, CSRec, which can be flexibly coupled to existing knowledge-based methods. Considering the challenge of the knowledge gap between the common sense-based knowledge graph and metadata-based knowledge graph, we propose a knowledge fusion approach based on mutual information maximization theory. Experimental results on public datasets demonstrate that our approach significantly improves the performance of existing knowledge-based recommendation models.


title: Privacy-Preserving Distributed Nonnegative Matrix Factorization

abstract: Nonnegative matrix factorization (NMF) is an effective data representation tool with numerous applications in signal processing and machine learning. However, deploying NMF in a decentralized manner over ad-hoc networks introduces privacy concerns due to the conventional approach of sharing raw data among network agents. To address this, we propose a privacy-preserving algorithm for fully-distributed NMF that decomposes a distributed large data matrix into left and right matrix factors while safeguarding each agent's local data privacy. It facilitates collaborative estimation of the left matrix factor among agents and enables them to estimate their respective right factors without exposing raw data. To ensure data privacy, we secure information exchanges between neighboring agents utilizing the Paillier cryptosystem, a probabilistic asymmetric algorithm for public-key cryptography that allows computations on encrypted data without decryption. Simulation results conducted on synthetic and real-world datasets demonstrate the effectiveness of the proposed algorithm in achieving privacy-preserving distributed NMF over ad-hoc networks.


title: Can LLMs Converse Formally? Automatically Assessing LLMs in Translating and Interpreting Formal Specifications

abstract: Stakeholders often describe system requirements using natural language which are then converted to formal syntax by a domain-expert leading to increased design costs. This paper assesses the capabilities of Large Language Models (LLMs) in converting between natural language descriptions and formal specifications. Existing work has evaluated the capabilities of LLMs in generating formal syntax such as source code but such experiments are typically hand-crafted and use problems that are likely to be in the training set of LLMs, and often require human-annotated datasets. We propose an approach that can use two copies of an LLM in conjunction with an off-the-shelf verifier to automatically evaluate its translation abilities without any additional human input. Our approach generates formal syntax using language grammars to automatically generate a dataset. We conduct an empirical evaluation to measure the accuracy of this translation task and show that SOTA LLMs cannot adequately solve this task, limiting their current utility in the design of complex systems.


title: PIPNet3D: Interpretable Detection of Alzheimer in MRI Scans

abstract: Information from neuroimaging examinations (CT, MRI) is increasingly used to support diagnoses of dementia, e.g., Alzheimer's disease. While current clinical practice is mainly based on visual inspection and feature engineering, Deep Learning approaches can be used to automate the analysis and to discover new image-biomarkers. Part-prototype neural networks (PP-NN) are an alternative to standard blackbox models, and have shown promising results in general computer vision. PP-NN's base their reasoning on prototypical image regions that are learned fully unsupervised, and combined with a simple-to-understand decision layer. We present PIPNet3D, a PP-NN for volumetric images. We apply PIPNet3D to the clinical case study of Alzheimer's Disease diagnosis from structural Magnetic Resonance Imaging (sMRI). We assess the quality of prototypes under a systematic evaluation framework, propose new metrics to evaluate brain prototypes and perform an evaluation with domain experts. Our results show that PIPNet3D is an interpretable, compact model for Alzheimer's diagnosis with its reasoning well aligned to medical domain knowledge. Notably, PIPNet3D achieves the same accuracy as its blackbox counterpart; and removing the remaining clinically irrelevant prototypes from its decision process does not decrease predictive performance.


title: Bulk condensation by an active interface

abstract: We present experiments, supported by mechanically detailed simulations, establishing bulk vapor-liquid condensation of a hard-bead fluid by a tiny population of orientable motile grains that self-assembles into a moving polarized monolayer. In a quasi-1D geometry two such layers, oppositely aligned, immobilize the condensed non-motile component. We account for our observations through a continuum theory with a naturally non-reciprocal Cahn-Hilliard structure, whose predicted trends as a function of packing fraction are consistent with our observations.


title: Tracking-Assisted Object Detection with Event Cameras

abstract: Event-based object detection has recently garnered attention in the computer vision community due to the exceptional properties of event cameras, such as high dynamic range and no motion blur. However, feature asynchronism and sparsity cause invisible objects due to no relative motion to the camera, posing a significant challenge in the task. Prior works have studied various memory mechanisms to preserve as many features as possible at the current time, guided by temporal clues. While these implicit-learned memories retain some short-term information, they still struggle to preserve long-term features effectively. In this paper, we consider those invisible objects as pseudo-occluded objects and aim to reveal their features. Firstly, we introduce visibility attribute of objects and contribute an auto-labeling algorithm to append additional visibility labels on an existing event camera dataset. Secondly, we exploit tracking strategies for pseudo-occluded objects to maintain their permanence and retain their bounding boxes, even when features have not been available for a very long time. These strategies can be treated as an explicit-learned memory guided by the tracking objective to record the displacements of objects across frames. Lastly, we propose a spatio-temporal feature aggregation module to enrich the latent features and a consistency loss to increase the robustness of the overall pipeline. We conduct comprehensive experiments to verify our method's effectiveness where still objects are retained but real occluded objects are discarded. The results demonstrate that (1) the additional visibility labels can assist in supervised training, and (2) our method outperforms state-of-the-art approaches with a significant improvement of 7.9% absolute mAP.


title: Neighbor-Environment Observer: An Intelligent Agent for Immersive Working Companionship

abstract: Human-computer symbiosis is a crucial direction for the development of artificial intelligence. As intelligent systems become increasingly prevalent in our work and personal lives, it is important to develop strategies to support users across physical and virtual environments. While technological advances in personal digital devices, such as personal computers and virtual reality devices, can provide immersive experiences, they can also disrupt users' awareness of their surroundings and enhance the frustration caused by disturbances. In this paper, we propose a joint observation strategy for artificial agents to support users across virtual and physical environments. We introduce a prototype system, neighbor-environment observer (NEO), that utilizes non-invasive sensors to assist users in dealing with disruptions to their immersive experience. System experiments evaluate NEO from different perspectives and demonstrate the effectiveness of the joint observation strategy. A user study is conducted to evaluate its usability. The results show that NEO could lessen users' workload with the learned user preference. We suggest that the proposed strategy can be applied to various smart home scenarios.


title: THz probing of non-trivial topological states in Co2MnGe Heusler alloy thin films

abstract: Co2MnGe (CMG) has been demonstrated recently as a half-metallic ferromagnetic Heusler alloy which possesses a topologically non-trivial band structure. This behavior is unique to such systems and hence warrants extensive experimental exploration for potential spintronic and chirality sensitive optoelectonic applications. Here, we demonstrate that an epitaxial thin film of CMG acts as a source of THz radiation upon photoexcitation by optical femtosecond laser pulses. Detailed experiments have revealed that a large contribution to THz emission occurs due to nonmagnetic or spin-independent origin, however, significant contribution in the THz generation is evidenced through excitation light helicity dependent circular photogalvanic effect (CPGE) confirming the presence of topologically non-trivial carriers. Furthermore, we show that not only the topological contribution is easily suppressed but also the overall THz generation efficiency is also affected adversely for the epitaxial films grown at high substrate temperatures.


title: Quantum gravity of the Heisenberg algebra

abstract: We consider a simplified model of double scaled SYK (DSSYK) in which the Hamiltonian is the position operator of the Harmonic oscillator. This model captures the high temperature limit of DSSYK but could also be defined as a quantum theory in its own right. We study properties of the emergent geometry including its dynamics in response to inserting matter particles. In particular, we find that the model displays de Sitter-like properties such as that infalling matter reduces the rate of growth of geodesic slices between the two boundaries. The simplicity of the model allows us to compute the full generating functional for correlation functions of the length mode or any number of matter operators. We provide evidence that the effective action of the geodesic length between boundary points is non-local. Furthermore, we use the on-shell solution for the geodesic lengths between any two boundary points to reconstruct an effective bulk metric and reverse engineer the dilaton gravity theory that generates this metric as a solution.


title: DODA: Diffusion for Object-detection Domain Adaptation in Agriculture

abstract: The diverse and high-quality content generated by recent generative models demonstrates the great potential of using synthetic data to train downstream models. However, in vision, especially in objection detection, related areas are not fully explored, the synthetic images are merely used to balance the long tails of existing datasets, and the accuracy of the generated labels is low, the full potential of generative models has not been exploited. In this paper, we propose DODA, a data synthesizer that can generate high-quality object detection data for new domains in agriculture. Specifically, we improve the controllability of layout-to-image through encoding layout as an image, thereby improving the quality of labels, and use a visual encoder to provide visual clues for the diffusion model to decouple visual features from the diffusion model, and empowering the model the ability to generate data in new domains. On the Global Wheat Head Detection (GWHD) Dataset, which is the largest dataset in agriculture and contains diverse domains, using the data synthesized by DODA improves the performance of the object detector by 12.74-17.76 AP$_{50}$ in the domain that was significantly shifted from the training data.


title: Arc-transitive maps with coprime Euler characteristic and edge number

abstract: This is one of a series of papers which aim towards a classification of edge-transitive maps of which the Euler characteristic and the edge number are coprime. This one carries out the classification work for arc-transitive maps with nonsolvable automorphism groups, which illustrates how the edge number impacts on the Euler characteristic for maps. The classification is involved with the construction of some new and interesting arc-regular maps.


title: A Dataset for Pharmacovigilance in German, French, and Japanese: Annotating Adverse Drug Reactions across Languages

abstract: User-generated data sources have gained significance in uncovering Adverse Drug Reactions (ADRs), with an increasing number of discussions occurring in the digital world. However, the existing clinical corpora predominantly revolve around scientific articles in English. This work presents a multilingual corpus of texts concerning ADRs gathered from diverse sources, including patient fora, social media, and clinical reports in German, French, and Japanese. Our corpus contains annotations covering 12 entity types, four attribute types, and 13 relation types. It contributes to the development of real-world multilingual language models for healthcare. We provide statistics to highlight certain challenges associated with the corpus and conduct preliminary experiments resulting in strong baselines for extracting entities and relations between these entities, both within and across languages.


title: Macroscale fracture surface segmentation via semi-supervised learning considering the structural similarity

abstract: To this date the safety assessment of materials, used for example in the nuclear power sector, commonly relies on a fracture mechanical analysis utilizing macroscopic concepts, where a global load quantity K or J is compared to the materials fracture toughness curve. Part of the experimental effort involved in these concepts is dedicated to the quantitative analysis of fracture surfaces. Within the scope of this study a methodology for the semi-supervised training of deep learning models for fracture surface segmentation on a macroscopic level was established. Therefore, three distinct and unique datasets were created to analyze the influence of structural similarity on the segmentation capability. The structural similarity differs due to the assessed materials and specimen, as well as imaging-induced variance due to fluctuations in image acquisition in different laboratories. The datasets correspond to typical isolated laboratory conditions, complex real-world circumstances, and a curated subset of the two. We implemented a weak-to-strong consistency regularization for semi-supervised learning. On the heterogeneous dataset we were able to train robust and well-generalizing models that learned feature representations from images across different domains without observing a significant drop in prediction quality. Furthermore, our approach reduced the number of labeled images required for training by a factor of 6. To demonstrate the success of our method and the benefit of our approach for the fracture mechanics assessment, we utilized the models for initial crack size measurements with the area average method. For the laboratory setting, the deep learning assisted measurements proved to have the same quality as manual measurements. For models trained on the heterogeneous dataset, very good measurement accuracies with mean deviations smaller than 1 % could be achieved...


title: mALBERT: Is a Compact Multilingual BERT Model Still Worth It?

abstract: Within the current trend of Pretained Language Models (PLM), emerge more and more criticisms about the ethical andecological impact of such models. In this article, considering these critical remarks, we propose to focus on smallermodels, such as compact models like ALBERT, which are more ecologically virtuous than these PLM. However,PLMs enable huge breakthroughs in Natural Language Processing tasks, such as Spoken and Natural LanguageUnderstanding, classification, Question--Answering tasks. PLMs also have the advantage of being multilingual, and,as far as we know, a multilingual version of compact ALBERT models does not exist. Considering these facts, wepropose the free release of the first version of a multilingual compact ALBERT model, pre-trained using Wikipediadata, which complies with the ethical aspect of such a language model. We also evaluate the model against classicalmultilingual PLMs in classical NLP tasks. Finally, this paper proposes a rare study on the subword tokenizationimpact on language performances.


title: H2ASeg: Hierarchical Adaptive Interaction and Weighting Network for Tumor Segmentation in PET/CT Images

abstract: Positron emission tomography (PET) combined with computed tomography (CT) imaging is routinely used in cancer diagnosis and prognosis by providing complementary information. Automatically segmenting tumors in PET/CT images can significantly improve examination efficiency. Traditional multi-modal segmentation solutions mainly rely on concatenation operations for modality fusion, which fail to effectively model the non-linear dependencies between PET and CT modalities. Recent studies have investigated various approaches to optimize the fusion of modality-specific features for enhancing joint representations. However, modality-specific encoders used in these methods operate independently, inadequately leveraging the synergistic relationships inherent in PET and CT modalities, for example, the complementarity between semantics and structure. To address these issues, we propose a Hierarchical Adaptive Interaction and Weighting Network termed H2ASeg to explore the intrinsic cross-modal correlations and transfer potential complementary information. Specifically, we design a Modality-Cooperative Spatial Attention (MCSA) module that performs intra- and inter-modal interactions globally and locally. Additionally, a Target-Aware Modality Weighting (TAMW) module is developed to highlight tumor-related features within multi-modal features, thereby refining tumor segmentation. By embedding these modules across different layers, H2ASeg can hierarchically model cross-modal correlations, enabling a nuanced understanding of both semantic and structural tumor features. Extensive experiments demonstrate the superiority of H2ASeg, outperforming state-of-the-art methods on AutoPet-II and Hecktor2022 benchmarks. The code is released at https://github.com/JinPLu/H2ASeg.


title: The Metric Distortion of Randomized Social Choice Functions: C1 Maximal Lottery Rules and Simulations

abstract: The metric distortion of a randomized social choice function (RSCF) quantifies its worst-case approximation ratio of the optimal social cost when the voters' costs for alternatives are given by distances in a metric space. This notion has recently attracted significant attention as numerous RSCFs that aim to minimize the metric distortion have been suggested. However, such tailored voting rules usually have little appeal other than their low metric distortion. In this paper, we will thus study the metric distortion of well-established RSCFs. In more detail, we first show that C1 maximal lottery rules, a well-known class of RSCFs, have a metric distortion of $4$ and furthermore prove that this is optimal within the class of majoritarian RSCFs (which only depend on the majority relation). As our second contribution, we perform extensive computer experiments on the metric distortion of established RSCFs to obtain insights into their average-case performance. These computer experiments are based on a new linear program for computing the metric distortion of a lottery on a given profile and reveal that some classical RSCFs perform almost as well as the currently best known RSCF with respect to the metric distortion on randomly sampled profiles.


title: IterAlign: Iterative Constitutional Alignment of Large Language Models

abstract: With the rapid development of large language models (LLMs), aligning LLMs with human values and societal norms to ensure their reliability and safety has become crucial. Reinforcement learning with human feedback (RLHF) and Constitutional AI (CAI) have been proposed for LLM alignment. However, these methods require either heavy human annotations or explicitly pre-defined constitutions, which are labor-intensive and resource-consuming. To overcome these drawbacks, we study constitution-based LLM alignment and propose a data-driven constitution discovery and self-alignment framework called IterAlign. IterAlign leverages red teaming to unveil the weaknesses of an LLM and automatically discovers new constitutions using a stronger LLM. These constitutions are then used to guide self-correction of the base LLM. Such a constitution discovery pipeline can be run iteratively and automatically to discover new constitutions that specifically target the alignment gaps in the current LLM. Empirical results on several safety benchmark datasets and multiple base LLMs show that IterAlign successfully improves truthfulness, helpfulness, harmlessness and honesty, improving the LLM alignment by up to $13.5\%$ in harmlessness.


title: Learning Inclusion Matching for Animation Paint Bucket Colorization

abstract: Colorizing line art is a pivotal task in the production of hand-drawn cel animation. This typically involves digital painters using a paint bucket tool to manually color each segment enclosed by lines, based on RGB values predetermined by a color designer. This frame-by-frame process is both arduous and time-intensive. Current automated methods mainly focus on segment matching. This technique migrates colors from a reference to the target frame by aligning features within line-enclosed segments across frames. However, issues like occlusion and wrinkles in animations often disrupt these direct correspondences, leading to mismatches. In this work, we introduce a new learning-based inclusion matching pipeline, which directs the network to comprehend the inclusion relationships between segments rather than relying solely on direct visual correspondences. Our method features a two-stage pipeline that integrates a coarse color warping module with an inclusion matching module, enabling more nuanced and accurate colorization. To facilitate the training of our network, we also develope a unique dataset, referred to as PaintBucket-Character. This dataset includes rendered line arts alongside their colorized counterparts, featuring various 3D characters. Extensive experiments demonstrate the effectiveness and superiority of our method over existing techniques.


title: The Artificial Neural Twin -- Process Optimization and Continual Learning in Distributed Process Chains

abstract: Industrial process optimization and control is crucial to increase economic and ecologic efficiency. However, data sovereignty, differing goals, or the required expert knowledge for implementation impede holistic implementation. Further, the increasing use of data-driven AI-methods in process models and industrial sensory often requires regular fine-tuning to accommodate distribution drifts. We propose the Artificial Neural Twin, which combines concepts from model predictive control, deep learning, and sensor networks to address these issues. Our approach introduces differentiable data fusion to estimate the state of distributed process steps and their dependence on input data. By treating the interconnected process steps as a quasi neural-network, we can backpropagate loss gradients for process optimization or model fine-tuning to process parameters or AI models respectively. The concept is demonstrated on a virtual machine park simulated in Unity, consisting of bulk material processes in plastic recycling.


title: LC-LLM: Explainable Lane-Change Intention and Trajectory Predictions with Large Language Models

abstract: To ensure safe driving in dynamic environments, autonomous vehicles should possess the capability to accurately predict the lane change intentions of surrounding vehicles in advance and forecast their future trajectories. Existing motion prediction approaches have ample room for improvement, particularly in terms of long-term prediction accuracy and interpretability. In this paper, we address these challenges by proposing LC-LLM, an explainable lane change prediction model that leverages the strong reasoning capabilities and self-explanation abilities of Large Language Models (LLMs). Essentially, we reformulate the lane change prediction task as a language modeling problem, processing heterogeneous driving scenario information in natural language as prompts for input into the LLM and employing a supervised fine-tuning technique to tailor the LLM specifically for our lane change prediction task. This allows us to utilize the LLM's powerful common sense reasoning abilities to understand complex interactive information, thereby improving the accuracy of long-term predictions. Furthermore, we incorporate explanatory requirements into the prompts in the inference stage. Therefore, our LC-LLM model not only can predict lane change intentions and trajectories but also provides explanations for its predictions, enhancing the interpretability. Extensive experiments on the large-scale highD dataset demonstrate the superior performance and interpretability of our LC-LLM in lane change prediction task. To the best of our knowledge, this is the first attempt to utilize LLMs for predicting lane change behavior. Our study shows that LLMs can encode comprehensive interaction information for driving behavior understanding.


title: Compactifications of the Eisenstein ancestral Deligne-Mostow variety

abstract: All arithmetic non-compact ball quotients by Deligne-Mostow's unitary monodromy group arise as sub-ball quotients of either of two spaces called ancestral cases, corresponding to Gaussian or Eisenstein Hermitian forms respectively. In our previous paper, we investigated the compactifications of the Gaussian Deligne-Mostow variety. Here we work on the remaining case, namely the ring of Eisenstein integers, which is related to the moduli space of unordered 12 points on $\mathbb P^1$. In particular, we show that Kirwan's partial resolution of the moduli space is not a semi-toroidal compactification and Deligne-Mostow's period map does not lift to the unique toroidal compactification. We give two interpretations of these phenomena in terms of the log minimal model program and automorphic forms. As an application, we prove that the above two compactifications are not (stacky) derived equivalent, as the $DK$-conjecture predicts. Furthermore, we construct an automorphic form on the moduli space of non-hyperelliptic curves of genus 4, which is isogenous to the Eisenstein Deligne-Mostow variety, giving another intrinsic proof, independent of lattice embeddings, of a result by Casalaina-Martin, Jensen and Laza.


title: Quantifying and Mitigating Unimodal Biases in Multimodal Large Language Models: A Causal Perspective

abstract: Recent advancements in Large Language Models (LLMs) have facilitated the development of Multimodal LLMs (MLLMs). Despite their impressive capabilities, MLLMs often suffer from an over-reliance on unimodal biases (e.g., language bias and vision bias), leading to incorrect answers in complex multimodal tasks. To investigate this issue, we propose a causal framework to interpret the biases in Visual Question Answering (VQA) problems. Within our framework, we devise a causal graph to elucidate the predictions of MLLMs on VQA problems, and assess the causal effect of biases through an in-depth causal analysis. Motivated by the causal graph, we introduce a novel MORE dataset, consisting of 12,000 VQA instances. This dataset is designed to challenge MLLMs' abilities, necessitating multi-hop reasoning and the surmounting of unimodal biases. Furthermore, we propose two strategies to mitigate unimodal biases and enhance MLLMs' reasoning capabilities, including a Decompose-Verify-Answer (DeVA) framework for limited-access MLLMs and the refinement of open-source MLLMs through fine-tuning. Extensive quantitative and qualitative experiments offer valuable insights for future research. Our project page is at https://opencausalab.github.io/MORE.


title: A Quantum Fuzzy-based Approach for Real-Time Detection of Solar Coronal Holes

abstract: The detection and analysis of the solar coronal holes (CHs) is an important field of study in the domain of solar physics. Mainly, it is required for the proper prediction of the geomagnetic storms which directly or indirectly affect various space and ground-based systems. For the detection of CHs till date, the solar scientist depends on manual hand-drawn approaches. However, with the advancement of image processing technologies, some automated image segmentation methods have been used for the detection of CHs. In-spite of this, fast and accurate detection of CHs are till a major issues. Here in this work, a novel quantum computing-based fast fuzzy c-mean technique has been developed for fast detection of the CHs region. The task has been carried out in two stages, in first stage the solar image has been segmented using a quantum computing based fast fuzzy c-mean (QCFFCM) and in the later stage the CHs has been extracted out from the segmented image based on image morphological operation. In the work, quantum computing has been used to optimize the cost function of the fast fuzzy c-mean (FFCM) algorithm, where quantum approximate optimization algorithm (QAOA) has been used to optimize the quadratic part of the cost function. The proposed method has been tested for 193 \AA{} SDO/AIA full-disk solar image datasets and has been compared with the existing techniques. The outcome shows the comparable performance of the proposed method with the existing one within a very lesser time.


title: Sequential Recommendation with Latent Relations based on Large Language Model

abstract: Sequential recommender systems predict items that may interest users by modeling their preferences based on historical interactions. Traditional sequential recommendation methods rely on capturing implicit collaborative filtering signals among items. Recent relation-aware sequential recommendation models have achieved promising performance by explicitly incorporating item relations into the modeling of user historical sequences, where most relations are extracted from knowledge graphs. However, existing methods rely on manually predefined relations and suffer the sparsity issue, limiting the generalization ability in diverse scenarios with varied item relations. In this paper, we propose a novel relation-aware sequential recommendation framework with Latent Relation Discovery (LRD). Different from previous relation-aware models that rely on predefined rules, we propose to leverage the Large Language Model (LLM) to provide new types of relations and connections between items. The motivation is that LLM contains abundant world knowledge, which can be adopted to mine latent relations of items for recommendation. Specifically, inspired by that humans can describe relations between items using natural language, LRD harnesses the LLM that has demonstrated human-like knowledge to obtain language knowledge representations of items. These representations are fed into a latent relation discovery module based on the discrete state variational autoencoder (DVAE). Then the self-supervised relation discovery tasks and recommendation tasks are jointly optimized. Experimental results on multiple public datasets demonstrate our proposed latent relations discovery method can be incorporated with existing relation-aware sequential recommendation models and significantly improve the performance. Further analysis experiments indicate the effectiveness and reliability of the discovered latent relations.


title: Rejection Improves Reliability: Training LLMs to Refuse Unknown Questions Using RL from Knowledge Feedback

abstract: Large Language Models (LLMs) often generate erroneous outputs, known as hallucinations, due to their limitations in discerning questions beyond their knowledge scope. While addressing hallucination has been a focal point in research, previous efforts primarily concentrate on enhancing correctness without giving due consideration to the significance of rejection mechanisms. In this paper, we conduct a comprehensive examination of the role of rejection, introducing the notion of model reliability along with corresponding metrics. These metrics measure the model's ability to provide accurate responses while adeptly rejecting questions exceeding its knowledge boundaries, thereby minimizing hallucinations. To improve the inherent reliability of LLMs, we present a novel alignment framework called Reinforcement Learning from Knowledge Feedback (RLKF). RLKF leverages knowledge feedback to dynamically determine the model's knowledge boundary and trains a reliable reward model to encourage the refusal of out-of-knowledge questions. Experimental results on mathematical questions affirm the substantial efficacy of RLKF in significantly enhancing LLM reliability.


title: Evaluation of Semantic Search and its Role in Retrieved-Augmented-Generation (RAG) for Arabic Language

abstract: The latest advancements in machine learning and deep learning have brought forth the concept of semantic similarity, which has proven immensely beneficial in multiple applications and has largely replaced keyword search. However, evaluating semantic similarity and conducting searches for a specific query across various documents continue to be a complicated task. This complexity is due to the multifaceted nature of the task, the lack of standard benchmarks, whereas these challenges are further amplified for Arabic language. This paper endeavors to establish a straightforward yet potent benchmark for semantic search in Arabic. Moreover, to precisely evaluate the effectiveness of these metrics and the dataset, we conduct our assessment of semantic search within the framework of retrieval augmented generation (RAG).


title: Generating Diverse Agricultural Data for Vision-Based Farming Applications

abstract: We present a specialized procedural model for generating synthetic agricultural scenes, focusing on soybean crops, along with various weeds. This model is capable of simulating distinct growth stages of these plants, diverse soil conditions, and randomized field arrangements under varying lighting conditions. The integration of real-world textures and environmental factors into the procedural generation process enhances the photorealism and applicability of the synthetic data. Our dataset includes 12,000 images with semantic labels, offering a comprehensive resource for computer vision tasks in precision agriculture, such as semantic segmentation for autonomous weed control. We validate our model's effectiveness by comparing the synthetic data against real agricultural images, demonstrating its potential to significantly augment training data for machine learning models in agriculture. This approach not only provides a cost-effective solution for generating high-quality, diverse data but also addresses specific needs in agricultural vision tasks that are not fully covered by general-purpose models.


title: Deciphering autism heterogeneity: a molecular stratification approach in four mouse models

abstract: Autism spectrum disorder (ASD) is a complex neurodevelopmental condition characterized by impairments in social interaction, communication, as well as restrained or stereotyped behaviors. The inherent heterogeneity within the autism spectrum poses challenges for developing effective pharmacological treatments targeting core features. Successful clinical trials require the identification of robust markers to enable patient stratification. In this study, we explored molecular markers within the oxytocin and immediate early gene families across five interconnected brain structures of the social circuit in four distinct ASD mouse models, each exhibiting unique behavioral features along the autism spectrum. While dysregulations in the oxytocin family were model-specific, immediate early genes displayed widespread alterations, reflecting global changes in social plasticity. Through integrative analysis, we identified Egr1, Foxp1, Homer1a, Oxt and Oxtr as five robust and discriminant molecular markers facilitating successful stratification of the four models. Importantly, our stratification demonstrated predictive values when challenged with a fifth mouse model or identifying subgroups of mice potentially responsive to oxytocin treatment. Beyond providing insights into oxytocin and immediate early gene mRNA dynamics, this proof-of-concept study represents a significant step toward potential stratification of individuals with ASD. The implications extend to enhancing the success of clinical trials and guiding personalized medicine for distinct subgroups of individuals with autism.


title: Early Stopping for Ensemble Kalman-Bucy Inversion

abstract: Bayesian linear inverse problems aim to recover an unknown signal from noisy observations, incorporating prior knowledge. This paper analyses a data dependent method to choose the scale parameter of a Gaussian prior. The method we study arises from early stopping methods, which have been successfully applied to a range of problems for statistical inverse problems in the frequentist setting. These results are extended to the Bayesian setting. We study the use of a discrepancy based stopping rule in the setting of random noise. Our proposed stopping rule results in optimal rates under certain conditions on the prior covariance operator. We furthermore derive for which class of signals this method is adaptive. It is also shown that the associated posterior contracts at the optimal rate and provides a conservative measure of uncertainty. We implement the proposed stopping rule using the continuous-time ensemble Kalman--Bucy filter (EnKBF). The fictitious time parameter replaces the scale parameter, and the ensemble size is appropriately adjusted in order to not lose statistical optimality of the computed estimator. The EnKBF, then, gives a continuous process from the prior distribution to the posterior which is terminated using the proposed stopping rule.


title: Magnetic helicity evolution during active region emergence and subsequent flare productivity

abstract: Aims. Solar active regions (ARs), which are formed by flux emergence, serve as the primary sources of solar eruptions. However, the specific physical mechanism that governs the emergence process and its relationship with flare productivity remains to be thoroughly understood. Methods. We examined 136 emerging ARs, focusing on the evolution of their magnetic helicity and magnetic energy during the emergence phase. Based on the relation between helicity accumulation and magnetic flux evolution, we categorized the samples and investigated their flare productivity. Results. The emerging ARs we studied can be categorized into three types, Type-I, Type-II, and Type-III, and they account for 52.2%, 25%, and 22.8% of the total number in our sample, respectively. Type-I ARs exhibit a synchronous increase in both the magnetic flux and magnetic helicity, while the magnetic helicity in Type-II ARs displays a lag in increasing behind the magnetic flux. Type-III ARs show obvious helicity injections of opposite signs. Significantly, 90% of the flare-productive ARs (flare index > 6) were identified as Type-I ARs, suggesting that this type of AR has a higher potential to become flare productive. In contrast, Type-II and Type-III ARs exhibited a low and moderate likelihood of becoming active, respectively. Our statistical analysis also revealed that Type-I ARs accumulate more magnetic helicity and energy, far beyond what is found in Type-II and Type-III ARs. Moreover, we observed that flare-productive ARs consistently accumulate a significant amount of helicity and energy during their emergence phase. Conclusions. These findings provide valuable insight into the flux emergence phenomena, offering promising possibilities for early-stage predictions of solar eruptions.


title: Supervised Multiple Kernel Learning approaches for multi-omics data integration

abstract: Advances in high-throughput technologies have originated an ever-increasing availability of omics datasets. The integration of multiple heterogeneous data sources is currently an issue for biology and bioinformatics. Multiple kernel learning (MKL) has shown to be a flexible and valid approach to consider the diverse nature of multi-omics inputs, despite being an underused tool in genomic data mining.We provide novel MKL approaches based on different kernel fusion strategies.To learn from the meta-kernel of input kernels, we adaptedunsupervised integration algorithms for supervised tasks with support vector machines.We also tested deep learning architectures for kernel fusion and classification.The results show that MKL-based models can compete with more complex, state-of-the-art, supervised multi-omics integrative approaches. Multiple kernel learning offers a natural framework for predictive models in multi-omics genomic data. Our results offer a direction for bio-data mining research and further development of methods for heterogeneous data integration.


title: MonoHair: High-Fidelity Hair Modeling from a Monocular Video

abstract: Undoubtedly, high-fidelity 3D hair is crucial for achieving realism, artistic expression, and immersion in computer graphics. While existing 3D hair modeling methods have achieved impressive performance, the challenge of achieving high-quality hair reconstruction persists: they either require strict capture conditions, making practical applications difficult, or heavily rely on learned prior data, obscuring fine-grained details in images. To address these challenges, we propose MonoHair,a generic framework to achieve high-fidelity hair reconstruction from a monocular video, without specific requirements for environments. Our approach bifurcates the hair modeling process into two main stages: precise exterior reconstruction and interior structure inference. The exterior is meticulously crafted using our Patch-based Multi-View Optimization (PMVO). This method strategically collects and integrates hair information from multiple views, independent of prior data, to produce a high-fidelity exterior 3D line map. This map not only captures intricate details but also facilitates the inference of the hair's inner structure. For the interior, we employ a data-driven, multi-view 3D hair reconstruction method. This method utilizes 2D structural renderings derived from the reconstructed exterior, mirroring the synthetic 2D inputs used during training. This alignment effectively bridges the domain gap between our training data and real-world data, thereby enhancing the accuracy and reliability of our interior structure inference. Lastly, we generate a strand model and resolve the directional ambiguity by our hair growth algorithm. Our experiments demonstrate that our method exhibits robustness across diverse hairstyles and achieves state-of-the-art performance. For more results, please refer to our project page https://keyuwu-cs.github.io/MonoHair/.


title: Minimax density estimation in the adversarial framework under local differential privacy

abstract: We consider the problem of nonparametric density estimation under privacy constraints in an adversarial framework. To this end, we study minimax rates under local differential privacy over Sobolev spaces. We first obtain a lower bound which allows us to quantify the impact of privacy compared with the classical framework. Next, we introduce a new Coordinate block privacy mechanism that guarantees local differential privacy, which, coupled with a projection estimator, achieves the minimax optimal rates.


title: Imaging radar and LiDAR image translation for 3-DOF extrinsic calibration

abstract: The integration of sensor data is crucial in the field of robotics to take full advantage of the various sensors employed. One critical aspect of this integration is determining the extrinsic calibration parameters, such as the relative transformation, between each sensor. The use of data fusion between complementary sensors, such as radar and LiDAR, can provide significant benefits, particularly in harsh environments where accurate depth data is required. However, noise included in radar sensor data can make the estimation of extrinsic calibration challenging. To address this issue, we present a novel framework for the extrinsic calibration of radar and LiDAR sensors, utilizing CycleGAN as amethod of image-to-image translation. Our proposed method employs translating radar bird-eye-view images into LiDAR-style images to estimate the 3-DOF extrinsic parameters. The use of image registration techniques, as well as deskewing based on sensor odometry and B-spline interpolation, is employed to address the rolling shutter effect commonly present in spinning sensors. Our method demonstrates a notable improvement in extrinsic calibration compared to filter-based methods using the MulRan dataset.


title: Dynamical properties of magnetized low angular momentum accretion flow around a Kerr black hole

abstract: An essential factor in determining the flow characteristics of an accretion flow is its angular momentum. According to the angular momentum of the flow, semi-analytical analysis suggests various types of accretion solutions. It is critical to test it with numerical simulations using the most advanced framework available (general relativistic magnetohydrodynamics) to understand how flow changes with different angular momentum. By changing the initial condition of the accretion torus minimally, we can simulate steady, low angular momentum accretion flow around a Kerr black hole. We focus primarily on the lower limits of angular momentum and come upon that accretion flow with an intermediate range of angular momentum differs significantly from high or very low angular momentum flow. The intermediate angular momentum accretion flow has the highest density, pressure, and temperature near the black hole, making it easier to observe. We find that the density and pressure have power-law scalings $\rho\propto r^{n-3/2}$ and $p_g\propto r^{n-5/2}$ which only hold for very low angular momentum cases. With the increase in flow angular momentum, it develops a non-axisymmetric nature. In this case, simple self-similarity does not hold. We also find that the sonic surface moves away from the innermost stable circular orbit as its angular momentum decreases. Finally, we emphasize that intermediate angular momentum flow could provide a possible solution to explain the complex observation features of the supermassive black hole Sgr~A$^*$ at our galactic center.


title: Learning CNN on ViT: A Hybrid Model to Explicitly Class-specific Boundaries for Domain Adaptation

abstract: Most domain adaptation (DA) methods are based on either a convolutional neural networks (CNNs) or a vision transformers (ViTs). They align the distribution differences between domains as encoders without considering their unique characteristics. For instance, ViT excels in accuracy due to its superior ability to capture global representations, while CNN has an advantage in capturing local representations. This fact has led us to design a hybrid method to fully take advantage of both ViT and CNN, called Explicitly Class-specific Boundaries (ECB). ECB learns CNN on ViT to combine their distinct strengths. In particular, we leverage ViT's properties to explicitly find class-specific decision boundaries by maximizing the discrepancy between the outputs of the two classifiers to detect target samples far from the source support. In contrast, the CNN encoder clusters target features based on the previously defined class-specific boundaries by minimizing the discrepancy between the probabilities of the two classifiers. Finally, ViT and CNN mutually exchange knowledge to improve the quality of pseudo labels and reduce the knowledge discrepancies of these models. Compared to conventional DA methods, our ECB achieves superior performance, which verifies its effectiveness in this hybrid model. The project website can be found https://dotrannhattuong.github.io/ECB/website.


title: ViTAR: Vision Transformer with Any Resolution

abstract: This paper tackles a significant challenge faced by Vision Transformers (ViTs): their constrained scalability across different image resolutions. Typically, ViTs experience a performance decline when processing resolutions different from those seen during training. Our work introduces two key innovations to address this issue. Firstly, we propose a novel module for dynamic resolution adjustment, designed with a single Transformer block, specifically to achieve highly efficient incremental token integration. Secondly, we introduce fuzzy positional encoding in the Vision Transformer to provide consistent positional awareness across multiple resolutions, thereby preventing overfitting to any single training resolution. Our resulting model, ViTAR (Vision Transformer with Any Resolution), demonstrates impressive adaptability, achieving 83.3\% top-1 accuracy at a 1120x1120 resolution and 80.4\% accuracy at a 4032x4032 resolution, all while reducing computational costs. ViTAR also shows strong performance in downstream tasks such as instance and semantic segmentation and can easily combined with self-supervised learning techniques like Masked AutoEncoder. Our work provides a cost-effective solution for enhancing the resolution scalability of ViTs, paving the way for more versatile and efficient high-resolution image processing.


title: Fractional variational integrators based on convolution quadrature

abstract: Fractional dissipation is a powerful tool to study non-local physical phenomena such as damping models. The design of geometric, in particular, variational integrators for the numerical simulation of such systems relies on a variational formulation of the model. In [19], a new approach is proposed to deal with dissipative systems including fractionally damped systems in a variational way for both, the continuous and discrete setting. It is based on the doubling of variables and their fractional derivatives. The aim of this work is to derive higher-order fractional variational integrators by means of convolution quadrature (CQ) based on backward difference formulas. We then provide numerical methods that are of order 2 improving a previous result in [19]. The convergence properties of the fractional variational integrators and saturation effects due to the approximation of the fractional derivatives by CQ are studied numerically.


title: Computing safe bicycle routes -- Berechnung sicherer Fahrradwege

abstract: The safety of streets is difficult to quantify numerically. However, it is possible to sort streets regarding their safety into ordered categories, like safe, neutral and unsafe. In this paper we model the computation of safe bicycle routes as an optimization problem with ordinal coefficients. We describe an appropriate optimality concept for ordinal optimization problems and introduce a solution strategy for ordinal routing problems. Furthermore, we introduce a concept to incorporate safety preferences by introducing weights such that longer path with a higher safety rating are preferred. We apply the concept of ordinal routing to compute safe bicycle routes in Stuttgart, Germany, based on dates from OpenStreetMaps. We show that the choice of the weights does not only represent the trade-off of safety vs. path length, but has also an impact on the number of alternative solutions and thus on the computation time. -- Die Sicherheit von Wegen ist nur eingeschr\"ankt messbar und daher schwierig zu quantifizieren. Dahingegen ist es verh\"altnism\"a{\ss}ig leicht Wege bez\"uglich ihrer Sicherheit in geordnete Kategorien, wie beispielsweise sicher, neutral und gef\"ahrlich einzuordnen. In diesem Beitrag werden Optimierungsprobleme mit geordneten Kategorien formuliert und Optimalit\"at f\"ur diese definiert. Daraus wird eine L\"osungsstrategie f\"ur solche Probleme abgeleitet. Dar\"uber hinaus wird erkl\"art, wie die Abgrenzung zwischen den Kategorien erh\"oht werden kann, sodass l\"angere aber daf\"ur sicherere Wege mit Hilfe von Gewichten berechnet werden k\"onnen. Diese theoretischen Ergebnisse werden in der Praxis angewendet und es werden auf Grundlage von Daten von OpenStreetMaps sichere Fahrradwege in Stuttgart berechnet. Dabei zeigt sich, dass eine gute Wahl der Gewichte zu weniger L\"osungen und k\"urzeren Rechenzeiten f\"uhrt.


title: Intent-Aware DRL-Based Uplink Dynamic Scheduler for 5G-NR

abstract: We investigate the problem of supporting Industrial Internet of Things user equipment (IIoT UEs) with intent (i.e., requested quality of service (QoS)) and random traffic arrival. A deep reinforcement learning (DRL) based centralized dynamic scheduler for time-frequency resources is proposed to learn how to schedule the available communication resources among the IIoT UEs. The proposed scheduler leverages an RL framework to adapt to the dynamic changes in the wireless communication system and traffic arrivals. Moreover, a graph-based reduction scheme is proposed to reduce the state and action space of the RL framework to allow fast convergence and a better learning strategy. Simulation results demonstrate the effectiveness of the proposed intelligent scheduler in guaranteeing the expressed intent of IIoT UEs compared to several traditional scheduling schemes, such as round-robin, semi-static, and heuristic approaches. The proposed scheduler also outperforms the contention-free and contention-based schemes in maximizing the number of successfully computed tasks.


title: BLADE: Enhancing Black-box Large Language Models with Small Domain-Specific Models

abstract: Large Language Models (LLMs) like ChatGPT and GPT-4 are versatile and capable of addressing a diverse range of tasks. However, general LLMs, which are developed on open-domain data, may lack the domain-specific knowledge essential for tasks in vertical domains, such as legal, medical, etc. To address this issue, previous approaches either conduct continuous pre-training with domain-specific data or employ retrieval augmentation to support general LLMs. Unfortunately, these strategies are either cost-intensive or unreliable in practical applications. To this end, we present a novel framework named BLADE, which enhances Black-box LArge language models with small Domain-spEcific models. BLADE consists of a black-box LLM and a small domain-specific LM. The small LM preserves domain-specific knowledge and offers specialized insights, while the general LLM contributes robust language comprehension and reasoning capabilities. Specifically, our method involves three steps: 1) pre-training the small LM with domain-specific data, 2) fine-tuning this model using knowledge instruction data, and 3) joint Bayesian optimization of the general LLM and the small LM. Extensive experiments conducted on public legal and medical benchmarks reveal that BLADE significantly outperforms existing approaches. This shows the potential of BLADE as an effective and cost-efficient solution in adapting general LLMs for vertical domains.


title: On the M87 jet structure near the central engine

abstract: At present, there is no doubt that relativistic jets observed in active galactic nuclei pass from highly magnetized to weakly magnetized stage, which is observed as a break in the dependence on their width $d_{\rm jet}(z)$ on the distance $z$ to the central engine. In this paper, we discuss the possibility of observing another break, which should be located at shorter distances. The position of this break can be associated with the region of formation of the dense central core near the jet axis which was predicted both analytically and numerically more than a decade ago, but has not yet received sufficient attention. In this case, the observed width should be determined by the dense core, and not by the total transverse size of the jet. The calculations carried out in this paper, which took into account both the transverse electromagnetic structure of the jet and the change in the spectrum of emitting particles along its axis, indeed showed such behaviour. We also found the evidence of the predicted break in the jet expansion profile using stacked 15 GHz VLBA image of M87 radio jet and constrain the light cylinder radius.


title: Merits of Time-Domain Computing for VMM -- A Quantitative Comparison

abstract: Vector-matrix-multiplication (VMM) accel-erators have gained a lot of traction, especially due to therise of convolutional neural networks (CNNs) and the desireto compute them on the edge. Besides the classical digitalapproach, analog computing has gone through a renais-sance to push energy efficiency further. A more recent ap-proach is called time-domain (TD) computing. In contrastto analog computing, TD computing permits easy technol-ogy as well as voltage scaling. As it has received limitedresearch attention, it is not yet clear which scenarios aremost suitable to be computed in the TD. In this work, weinvestigate these scenarios, focussing on energy efficiencyconsidering approximative computations that preserve ac-curacy. Both goals are addressed by a novel efficiency met-ric, which is used to find a baseline design. We use SPICEsimulation data which is fed into a python framework toevaluate how performance scales for VMM computation.We see that TD computing offers best energy efficiency forsmall to medium sized arrays. With throughput and sili-con footprint we investigate two additional metrics, givinga holistic comparison.


title: The Mercer-Young Theorem for Matrix-Valued Kernels on Separable Metric Spaces

abstract: We generalize the characterization theorem going back to Mercer and Young, which states that a symmetric and continuous kernel is positive definite if and only if it is integrally positive definite. More precisely, we extend the result from real-valued kernels on compact intervals to matrix-valued kernels on separable metric spaces. We also demonstrate the applications of the generalized theorem to the field of convex optimization.


title: Damage Mechanics Challenge: Predictions based on the phase field fracture model

abstract: In this work, we describe our contribution to the Purdue-SANDIA-LLNL \emph{Damage Mechanics Challenge}. The phase field fracture model is adopted to blindly estimate the failure characteristics of the challenge test, an unconventional three-point bending experiment on an additively manufactured rock resembling a type of gypsum. The model is formulated in a variationally consistent fashion, incorporating a volumetric-deviatoric strain energy decomposition, and the numerical implementation adopts a monolithic unconditionally stable solution scheme. Our focus is on providing an efficient and simple yet rigorous approach capable of delivering accurate predictions based solely on physical parameters. Model inputs are Young's modulus $E$, Poisson's ratio $\nu$, toughness $G_c$ and strength $\sigma_c$ (as determined by the choice of phase field length scale $\ell$). We show that a single mode I three-point bending test is sufficient to calibrate the model, and that the calibrated model can then reliably predict the force versus displacement responses, crack paths and surface crack morphologies of more intricate three-point bending experiments that are inherently mixed-mode. Importantly, our peak load, crack trajectory and crack surface morphology predictions for the challenge test, submitted before the experimental data was released, show a remarkable agreement with experiments. The characteristics of the challenge, and how changes in these can impact the predictive abilities of phase field fracture models, are also discussed.


title: Ship in Sight: Diffusion Models for Ship-Image Super Resolution

abstract: In recent years, remarkable advancements have been achieved in the field of image generation, primarily driven by the escalating demand for high-quality outcomes across various image generation subtasks, such as inpainting, denoising, and super resolution. A major effort is devoted to exploring the application of super-resolution techniques to enhance the quality of low-resolution images. In this context, our method explores in depth the problem of ship image super resolution, which is crucial for coastal and port surveillance. We investigate the opportunity given by the growing interest in text-to-image diffusion models, taking advantage of the prior knowledge that such foundation models have already learned. In particular, we present a diffusion-model-based architecture that leverages text conditioning during training while being class-aware, to best preserve the crucial details of the ships during the generation of the super-resoluted image. Since the specificity of this task and the scarcity availability of off-the-shelf data, we also introduce a large labeled ship dataset scraped from online ship images, mostly from ShipSpotting\footnote{\url{www.shipspotting.com}} website. Our method achieves more robust results than other deep learning models previously employed for super resolution, as proven by the multiple experiments performed. Moreover, we investigate how this model can benefit downstream tasks, such as classification and object detection, thus emphasizing practical implementation in a real-world scenario. Experimental results show flexibility, reliability, and impressive performance of the proposed framework over state-of-the-art methods for different tasks. The code is available at: https://github.com/LuigiSigillo/ShipinSight .


title: Multivariable control of modular multilevel converters with convergence and safety guarantees

abstract: Well-designed current control is a key factor in ensuring the efficient and safe operation of modular multilevel converters (MMCs). Even though this control problem involves multiple control objectives, conventional current control schemes are comprised of independently designed decoupled controllers, e.g., proportional-integral (PI) or proportional-resonant (PR). Due to the bilinearity of the MMC dynamics, tuning PI and PR controllers so that good performance and constraint satisfaction are guaranteed is quite challenging. This challenge becomes more relevant in an AC/AC MMC configuration due to the complexity of tracking the single-phase sinusoidal components of the MMC output. In this paper, we propose a method to design a multivariable controller, i.e., a static feedback gain, to regulate the MMC currents. We use a physics-informed transformation to model the MMC dynamics linearly and synthesise the proposed controller. We use this linear model to formulate a linear matrix inequality that computes a feedback gain that guarantees safe and effective operation, including (i) limited tracking error, (ii) stability, and (iii) meeting all constraints. To test the efficacy of our method, we examine its performance in a direct AC/AC MMC simulated in Simulink/PLECS and in a scaled-down AC/AC MMC prototype to investigate the ultra-fast charging of electric vehicles.


title: Bulk-entanglement-spectrum correspondence in $PT$- and $PC$-symmetric topological insulators

abstract: In this study, we discuss a new type of bulk-boundary correspondence which holds for topological insulators when the parity-time ($PT$) and/or parity-particle-hole ($PC$) symmetry are present. In these systems, even when the bulk topology is nontrivial, the edge spectrum is generally gapped, and thus the conventional bulk-boundary correspondence does not hold. We find that, instead of the edge spectrum, the single-particle entanglement spectrum becomes gapless when the bulk topology is nontrivial: i.e., the {\it bulk-entanglement-spectrum correspondence} holds in $PT$- and/or $PC$-symmetric topological insulators. After showing the correspondence using $K$-theoretic approach, we provide concrete models for each symmetry class up to three dimensions where nontrivial topology due to $PT$ and/or $PC$ is expected. An implication of our results is that, when the bulk topology under $PT$ and/or $PC$ symmetry is nontrivial, the many-body entanglement spectrum is multiply degenerate in one dimension and is gapless in two or higher dimensions.


title: BAM: Box Abstraction Monitors for Real-time OoD Detection in Object Detection

abstract: Out-of-distribution (OoD) detection techniques for deep neural networks (DNNs) become crucial thanks to their filtering of abnormal inputs, especially when DNNs are used in safety-critical applications and interact with an open and dynamic environment. Nevertheless, integrating OoD detection into state-of-the-art (SOTA) object detection DNNs poses significant challenges, partly due to the complexity introduced by the SOTA OoD construction methods, which require the modification of DNN architecture and the introduction of complex loss functions. This paper proposes a simple, yet surprisingly effective, method that requires neither retraining nor architectural change in object detection DNN, called Box Abstraction-based Monitors (BAM). The novelty of BAM stems from using a finite union of convex box abstractions to capture the learned features of objects for in-distribution (ID) data, and an important observation that features from OoD data are more likely to fall outside of these boxes. The union of convex regions within the feature space allows the formation of non-convex and interpretable decision boundaries, overcoming the limitations of VOS-like detectors without sacrificing real-time performance. Experiments integrating BAM into Faster R-CNN-based object detection DNNs demonstrate a considerably improved performance against SOTA OoD detection techniques.


title: Optimizing Communication for Latency Sensitive HPC Applications on up to 48 FPGAs Using ACCL

abstract: Most FPGA boards in the HPC domain are well-suited for parallel scaling because of the direct integration of versatile and high-throughput network ports. However, the utilization of their network capabilities is often challenging and error-prone because the whole network stack and communication patterns have to be implemented and managed on the FPGAs. Also, this approach conceptually involves a trade-off between the performance potential of improved communication and the impact of resource consumption for communication infrastructure, since the utilized resources on the FPGAs could otherwise be used for computations. In this work, we investigate this trade-off, firstly, by using synthetic benchmarks to evaluate the different configuration options of the communication framework ACCL and their impact on communication latency and throughput. Finally, we use our findings to implement a shallow water simulation whose scalability heavily depends on low-latency communication. With a suitable configuration of ACCL, good scaling behavior can be shown to all 48 FPGAs installed in the system. Overall, the results show that the availability of inter-FPGA communication frameworks as well as the configurability of framework and network stack are crucial to achieve the best application performance with low latency communication.


title: Stragglers-Aware Low-Latency Synchronous Federated Learning via Layer-Wise Model Updates

abstract: Synchronous federated learning (FL) is a popular paradigm for collaborative edge learning. It typically involves a set of heterogeneous devices locally training neural network (NN) models in parallel with periodic centralized aggregations. As some of the devices may have limited computational resources and varying availability, FL latency is highly sensitive to stragglers. Conventional approaches discard incomplete intra-model updates done by stragglers, alter the amount of local workload and architecture, or resort to asynchronous settings; which all affect the trained model performance under tight training latency constraints. In this work, we propose straggler-aware layer-wise federated learning (SALF) that leverages the optimization procedure of NNs via backpropagation to update the global model in a layer-wise fashion. SALF allows stragglers to synchronously convey partial gradients, having each layer of the global model be updated independently with a different contributing set of users. We provide a theoretical analysis, establishing convergence guarantees for the global model under mild assumptions on the distribution of the participating devices, revealing that SALF converges at the same asymptotic rate as FL with no timing limitations. This insight is matched with empirical observations, demonstrating the performance gains of SALF compared to alternative mechanisms mitigating the device heterogeneity gap in FL.


title: Extensible Hook System for Rendesvouz and Docking of a Cubesat Swarm

abstract: The use of cubesat swarms is being proposed for different missions where cooperation between satellites is required. Commonly, the cube swarm requires formation flight and even rendezvous and docking, which are very challenging tasks since they required more energy and the use of advanced guidance, navigation and control techniques. In this paper, we propose the use of an extensible hook system to mitigate these drawbacks,i.e. it allows to save fuel and reduce the system complexity by including techniques that have been previously demonstrated on Earth. This system is based on a scissor boom structure, which could reach up to five meters for a 4U dimension, including three degrees of freedom to place the end effector at any pose within the system workspace. We simulated the dynamic behaviour of a cubesat with the proposed system, demonstrating the required power for a 16U cubesat equipped with one extensible hook system is considered acceptable according to the current state of the art actuators.


title: Nuclear shape evolution of neutron-deficient Au and kink structure of Pb isotopes

abstract: Recent experiments using advanced laser spectroscopy technique revealed that the charge radii of neutron-deficient gold (Au) isotopes exhibit significant changes in ground state deformation: odd-even shape staggering in the $N = 98 \sim 100$ region and abrupt change of charge radii from $N =$ 108. In this study, we examine the abnormal shape evolution of the nuclear charge radii. To understand the nuclear structure underlying this phenomenon, we exploit the deformed relativistic Hartree-Bogoliubov theory in continuum (DRHBc). The significant change in mean-squared charge radii ($\delta {< r^2 >}$) turns out to originate from nuclear shape transitions between prolate deformation and small oblate deformation due to the shape coexistence possibility. We elucidate the nuclear shape evolution by analyzing the evolution of occupation probability for single-particle states. In addition, the abrupt kink structure in the nuclear charge radius of lead (Pb) isotopes near the $N =$ 126 shell is also investigated and reproduced quite well.


title: Improvements to the theoretical estimates of the Schwarz preconditioner with $\Delta$-GenEO coarse space for the indefinite Helmholtz problem

abstract: The purpose of this work is to improve the estimates for the $\Delta$-GenEO method from the paper "Overlapping Schwarz methods with GenEO coarse spaces for indefinite and nonself-adjoint problems" by N. Bootland, V. Dolean, I. G Graham, C. Ma, R. Scheichl (https://doi.org/10.1093/imanum/drac036) when applied to the indefinite Helmholtz equation. We derive k-dependent estimates of quantities of interest ensuring the robustness of the method.


title: IIP-Mixer:Intra-Inter Patch Mixing Architecture for Battery Remaining Useful Life Prediction

abstract: Accurately estimating the Remaining Useful Life (RUL) of lithium-ion batteries is crucial for maintaining the safe and stable operation of rechargeable battery management systems. However, this task is often challenging due to the complex temporal dynamics involved. Recently, attention-based networks, such as Transformers and Informer, have been the popular architecture in time series forecasting. Despite their effectiveness, these models with abundant parameters necessitate substantial training time to unravel temporal patterns. To tackle these challenges, we propose a simple MLP-Mixer-based architecture named 'Intra-Inter Patch Mixer' (IIP-Mixer), which is an architecture based exclusively on multi-layer perceptrons (MLPs), extracting information by mixing operations along both intra-patch and inter-patch dimensions for battery RUL prediction. The proposed IIP-Mixer comprises parallel dual-head mixer layers: the intra-patch mixing MLP, capturing local temporal patterns in the short-term period, and the inter-patch mixing MLP, capturing global temporal patterns in the long-term period. Notably, to address the varying importance of features in RUL prediction, we introduce a weighted loss function in the MLP-Mixer-based architecture, marking the first time such an approach has been employed. Our experiments demonstrate that IIP-Mixer achieves competitive performance in battery RUL prediction, outperforming other popular time-series frameworks


title: Unraveling the collinearity in short-range order parameters for lattice configurations arising from topological constraints

abstract: In multicomponent lattice problems, e.g., in alloys, and at crystalline surfaces and interfaces, atomic arrangements exhibit spatial correlations that dictate the kinetic and thermodynamic phase behavior. These correlations emerge from interparticle interactions and are frequently reported in terms of the short-range order (SRO) parameter. Expressed usually in terms of pair distributions and other cluster probabilities, the SRO parameter gives the likelihood of finding atoms/molecules of a particular type in the vicinity of others atoms. This study focuses on fundamental constraints involving the SRO parameters that are imposed by the underlying lattice topology. Using a data-driven approach, we uncover the interrelationships between different SRO parameters (e.g., pairs, triplets, quadruplets, etc.) on a lattice. The main finding is that while some SRO parameters are independent, the remaining are collinear, i.e., the latter are dictated by the independent ones through linear relationships. A kinetic and thermodynamic modeling framework based on these constraints is introduced.


title: Improving Attributed Text Generation of Large Language Models via Preference Learning

abstract: Large language models have been widely adopted in natural language processing, yet they face the challenge of generating unreliable content. Recent works aim to reduce misinformation and hallucinations by resorting to attribution as a means to provide evidence (i.e., citations). However, current attribution methods usually focus on the retrieval stage and automatic evaluation that neglect mirroring the citation mechanisms in human scholarly writing to bolster credibility. In this paper, we address these challenges by modelling the attribution task as preference learning and introducing an Automatic Preference Optimization (APO) framework. First, we create a curated collection for post-training with 6,330 examples by collecting and filtering from existing datasets. Second, considering the high cost of labelling preference data, we further propose an automatic method to synthesize attribution preference data resulting in 95,263 pairs. Moreover, inspired by the human citation process, we further propose a progressive preference optimization method by leveraging fine-grained information. Extensive experiments on three datasets (i.e., ASQA, StrategyQA, and ELI5) demonstrate that APO achieves state-of-the-art citation F1 with higher answer quality.


title: Joint distribution of $L$-values and orders of Sha groups of quadratic twists of elliptic curves

abstract: We study the joint distribution of central $L$-values and orders of Tate-Shafarevich groups of quadratic twists of elliptic curves. In particular, adapting Radziwill and Soundararajan's principles of establishing upper and lower bounds for the distribution of central values in families of $L$-functions, we obtain conditional upper and lower bounds for such a joint distribution for rank zero twists. These lead us to a conjecture on the full asymptotic for the joint distribution.


title: Generative Multi-modal Models are Good Class-Incremental Learners

abstract: In class-incremental learning (CIL) scenarios, the phenomenon of catastrophic forgetting caused by the classifier's bias towards the current task has long posed a significant challenge. It is mainly caused by the characteristic of discriminative models. With the growing popularity of the generative multi-modal models, we would explore replacing discriminative models with generative ones for CIL. However, transitioning from discriminative to generative models requires addressing two key challenges. The primary challenge lies in transferring the generated textual information into the classification of distinct categories. Additionally, it requires formulating the task of CIL within a generative framework. To this end, we propose a novel generative multi-modal model (GMM) framework for class-incremental learning. Our approach directly generates labels for images using an adapted generative model. After obtaining the detailed text, we use a text encoder to extract text features and employ feature matching to determine the most similar label as the classification prediction. In the conventional CIL settings, we achieve significantly better results in long-sequence task scenarios. Under the Few-shot CIL setting, we have improved by at least 14\% accuracy over all the current state-of-the-art methods with significantly less forgetting. Our code is available at \url{https://github.com/DoubleClass/GMM}.