title: Sparse MIMO for ISAC: New Opportunities and Challenges

abstract: Multiple-input multiple-output (MIMO) has been a key technology of wireless communications for decades. A typical MIMO system employs antenna arrays with the inter-antenna spacing being half of the signal wavelength, which we term as compact MIMO. Looking forward towards the future sixth-generation (6G) mobile communication networks, MIMO system will achieve even finer spatial resolution to not only enhance the spectral efficiency of wireless communications, but also enable more accurate wireless sensing. To this end, by removing the restriction of half-wavelength antenna spacing, sparse MIMO has been proposed as a new architecture that is able to significantly enlarge the array aperture as compared to conventional compact MIMO with the same number of array elements. In addition, sparse MIMO leads to a new form of virtual MIMO systems for sensing with their virtual apertures considerably larger than physical apertures. As sparse MIMO is expected to be a viable technology for 6G, we provide in this article a comprehensive overview of it, especially focusing on its appealing advantages for integrated sensing and communication (ISAC) towards 6G. Specifically, assorted sparse MIMO architectures are first introduced, followed by their new benefits as well as challenges. We then discuss the main design issues of sparse MIMO, including beam pattern synthesis, signal processing, grating lobe suppression, beam codebook design, and array geometry optimization. Last, we provide numerical results to evaluate the performance of sparse MIMO for ISAC and point out promising directions for future research.


title: Agriculture-Vision Challenge 2024 -- The Runner-Up Solution for Agricultural Pattern Recognition via Class Balancing and Model Ensemble

abstract: The Agriculture-Vision Challenge at CVPR 2024 aims at leveraging semantic segmentation models to produce pixel level semantic segmentation labels within regions of interest for multi-modality satellite images. It is one of the most famous and competitive challenges for global researchers to break the boundary between computer vision and agriculture sectors. However, there is a serious class imbalance problem in the agriculture-vision dataset, which hinders the semantic segmentation performance. To solve this problem, firstly, we propose a mosaic data augmentation with a rare class sampling strategy to enrich long-tail class samples. Secondly, we employ an adaptive class weight scheme to suppress the contribution of the common classes while increasing the ones of rare classes. Thirdly, we propose a probability post-process to increase the predicted value of the rare classes. Our methodology achieved a mean Intersection over Union (mIoU) score of 0.547 on the test set, securing second place in this challenge.


title: Slot State Space Models

abstract: Recent State Space Models (SSMs) such as S4, S5, and Mamba have shown remarkable computational benefits in long-range temporal dependency modeling. However, in many sequence modeling problems, the underlying process is inherently modular and it is of interest to have inductive biases that mimic this modular structure. In this paper, we introduce SlotSSMs, a novel framework for incorporating independent mechanisms into SSMs to preserve or encourage separation of information. Unlike conventional SSMs that maintain a monolithic state vector, SlotSSMs maintains the state as a collection of multiple vectors called slots. Crucially, the state transitions are performed independently per slot with sparse interactions across slots implemented via the bottleneck of self-attention. In experiments, we evaluate our model in object-centric video understanding, 3D visual reasoning, and video prediction tasks, which involve modeling multiple objects and their long-range temporal dependencies. We find that our proposed design offers substantial performance gains over existing sequence modeling methods.


title: Exploring Galaxy Evolution Time-Scales in Clusters: Insights from the Projected Phase Space

abstract: Galaxies infalling into clusters undergo both star-formation quenching and morphological transformation due to environmental effects. We investigate these processes and their timescales using a local sample of 20,191 cluster and 11,674 field galaxies from SDSS. By analysing morphology as a function of distance from the star-formation main sequence, we show that environmental influence is especially pronounced for low-mass galaxies, which emerge from the green valley with early-type morphologies before their star formation is fully suppressed. Using the galaxies' positions in the clusters' Projected Phase Space, we examine the evolution of blue cloud, green valley, and red sequence fractions as a function of time since infall. Interestingly, the green valley fraction remains constant with time since infall, suggesting a balanced flow of galaxies in and out of this class. We estimate that galaxies less massive than $10^{10}\rm M_{\odot}$ spend approximately 0.4 Gyr in the green valley. By comparing quenched and early-type populations, we provide further evidence for the ``slow-then-rapid'' quenching model and suggest that it can also be applied to morphological transitions. Our results indicate that morphological transformation occurs at larger radii than complete star-formation quenching. About 75% of galaxies undergoing morphological transition in clusters are spirals evolving into S0s, suggesting that infalling galaxies retain their disks, while massive ellipticals are relics of early merger events. Finally, we show it takes approximately 2.5 and 1.2 Gyr after the delay-time ($\sim 3.8 {\rm Gyr}$) for the population of low mass galaxies in clusters to reach a 50% threshold in quenched and early-type fraction, respectively. These findings suggest morphological transition precedes full star formation quenching, with both processes possibly being causally linked.


title: SafeInfer: Context Adaptive Decoding Time Safety Alignment for Large Language Models

abstract: Safety-aligned language models often exhibit fragile and imbalanced safety mechanisms, increasing the likelihood of generating unsafe content. In addition, incorporating new knowledge through editing techniques to language models can further compromise safety. To address these issues, we propose SafeInfer, a context-adaptive, decoding-time safety alignment strategy for generating safe responses to user queries. SafeInfer comprises two phases: the safety amplification phase, which employs safe demonstration examples to adjust the model's hidden states and increase the likelihood of safer outputs, and the safety-guided decoding phase, which influences token selection based on safety-optimized distributions, ensuring the generated content complies with ethical guidelines. Further, we present HarmEval, a novel benchmark for extensive safety evaluations, designed to address potential misuse scenarios in accordance with the policies of leading AI tech giants.


title: VoCo-LLaMA: Towards Vision Compression with Large Language Models

abstract: Vision-Language Models (VLMs) have achieved remarkable success in various multi-modal tasks, but they are often bottlenecked by the limited context window and high computational cost of processing high-resolution image inputs and videos. Vision compression can alleviate this problem by reducing the vision token count. Previous approaches compress vision tokens with external modules and force LLMs to understand the compressed ones, leading to visual information loss. However, the LLMs' understanding paradigm of vision tokens is not fully utilised in the compression learning process. We propose VoCo-LLaMA, the first approach to compress vision tokens using LLMs. By introducing Vision Compression tokens during the vision instruction tuning phase and leveraging attention distillation, our method distill how LLMs comprehend vision tokens into their processing of VoCo tokens. VoCo-LLaMA facilitates effective vision compression and improves the computational efficiency during the inference stage. Specifically, our method achieves minimal performance loss with a compression ratio of 576$\times$, resulting in up to 94.8$\%$ fewer FLOPs and 69.6$\%$ acceleration in inference time. Furthermore, through continuous training using time-series compressed token sequences of video frames, VoCo-LLaMA demonstrates the ability to understand temporal correlations, outperforming previous methods on popular video question-answering benchmarks. Our approach presents a promising way to unlock the full potential of VLMs' contextual window, enabling more scalable multi-modal applications. The project page, along with the associated code, can be accessed via $\href{https://yxxxb.github.io/VoCo-LLaMA-page/}{\text{this https URL}}$.


title: CodeNav: Beyond tool-use to using real-world codebases with LLM agents

abstract: We present CodeNav, an LLM agent that navigates and leverages previously unseen code repositories to solve user queries. In contrast to tool-use LLM agents that require ``registration'' of all relevant tools via manual descriptions within the LLM context, CodeNav automatically indexes and searches over code blocks in the target codebase, finds relevant code snippets, imports them, and uses them to iteratively generate a solution with execution feedback. To highlight the core-capabilities of CodeNav, we first showcase three case studies where we use CodeNav for solving complex user queries using three diverse codebases. Next, on three benchmarks, we quantitatively compare the effectiveness of code-use (which only has access to the target codebase) to tool-use (which has privileged access to all tool names and descriptions). Finally, we study the effect of varying kinds of tool and library descriptions on code-use performance, as well as investigate the advantage of the agent seeing source code as opposed to natural descriptions of code. All code will be made open source under a permissive license.


title: What Matters in Learning Facts in Language Models? Multifaceted Knowledge Probing with Diverse Multi-Prompt Datasets

abstract: Large language models (LLMs) face issues in handling factual knowledge, making it vital to evaluate their true ability to understand facts. In this study, we introduce knowledge probing frameworks, BELIEF(-ICL), to evaluate the knowledge understanding ability of not only encoder-based PLMs but also decoder-based PLMs from diverse perspectives. BELIEFs utilize a multi-prompt dataset to evaluate PLM's accuracy, consistency, and reliability in factual knowledge understanding. To provide a more reliable evaluation with BELIEFs, we semi-automatically create MyriadLAMA, which has more diverse prompts than existing datasets. We validate the effectiveness of BELIEFs in correctly and comprehensively evaluating PLM's factual understanding ability through extensive evaluations. We further investigate key factors in learning facts in LLMs, and reveal the limitation of the prompt-based knowledge probing. The dataset is anonymously publicized.


title: Persuasion and Optimal Stopping

abstract: We provide a unified analysis of how dynamic information should be designed in optimal stopping problems: a principal controls the flow of information about a payoff relevant state to persuade an agent to stop at the right time, in the right state, and choose the right action. We further show that for arbitrary preferences, intertemporal commitment is unnecessary: optimal dynamic information designs can always be made revision-proof.


title: Strategy-proof Selling: a Geometric Approach

abstract: We consider one buyer and one seller. For a bundle $(t,q)\in [0,\infty[\times [0,1]=\mathbb{Z}$, $q$ either refers to the wining probability of an object or a share of a good, and $t$ denotes the payment that the buyer makes. We define classical and restricted classical preferences of the buyer on $\mathbb{Z}$; they incorporate quasilinear, non-quasilinear, risk averse preferences with multidimensional pay-off relevant parameters. We define rich single-crossing subsets of the two classes, and characterize strategy-proof mechanisms by using monotonicity of the mechanisms and continuity of the indirect preference correspondences. We also provide a computationally tractable optimization program to compute the optimal mechanism. We do not use revenue equivalence and virtual valuations as tools in our proofs. Our proof techniques bring out the geometric interaction between the single-crossing property and the positions of bundles $(t,q)$s. Our proofs are simple and provide computationally tractable optimization program to compute the optimal mechanism. The extension of the optimization program to the $n-$ buyer environment is immediate.


title: Uncertainty relations based on state-dependent norm of commutator

abstract: We introduce two uncertainty relations based on the state-dependent norm of commutators, utilizing generalizations of the B\"ottcher-Wenzel inequality. The first relation is mathematically proven, while the second, tighter relation is strongly supported by numerical evidence. Both relations surpass the conventional Robertson and Schr\"odinger bounds, particularly as the quantum state becomes increasingly mixed. This reveals a previously undetected complementarity of quantum uncertainty, stemming from the non-commutativity of observables. We also compare our results with the Luo-Park uncertainty relation, demonstrating that our bounds can outperform especially for mutually unbiased observables.


title: Projected gravitational wave constraints on primordial black hole abundance for extended mass distributions

abstract: We investigate the projected minimum constraints set by next-generation gravitational wave detectors Einstein Telescope and LISA on the abundance of primordial black holes relative to dark matter for extended primordial black hole mass distributions. We consider broad power law distributions for a range of negative and positive exponents $\gamma$ and use the IMRPhenomXAS waveforms to simulate binary sources up to mass ratios $q = 1000$ and redshifts $z=300$. Our results show that power law mass distributions loosen the $f_\mathrm{PBH}$ constraint for increasing power law exponents, suggesting that extended distributions do not help in evading existing constraints. Interestingly, very negative values of $\gamma$ yield constraints close to ones derived from a monochromatic distribution.


title: SAGDFN: A Scalable Adaptive Graph Diffusion Forecasting Network for Multivariate Time Series Forecasting

abstract: Time series forecasting is essential for our daily activities and precise modeling of the complex correlations and shared patterns among multiple time series is essential for improving forecasting performance. Spatial-Temporal Graph Neural Networks (STGNNs) are widely used in multivariate time series forecasting tasks and have achieved promising performance on multiple real-world datasets for their ability to model the underlying complex spatial and temporal dependencies. However, existing studies have mainly focused on datasets comprising only a few hundred sensors due to the heavy computational cost and memory cost of spatial-temporal GNNs. When applied to larger datasets, these methods fail to capture the underlying complex spatial dependencies and exhibit limited scalability and performance. To this end, we present a Scalable Adaptive Graph Diffusion Forecasting Network (SAGDFN) to capture complex spatial-temporal correlation for large-scale multivariate time series and thereby, leading to exceptional performance in multivariate time series forecasting tasks. The proposed SAGDFN is scalable to datasets of thousands of nodes without the need of prior knowledge of spatial correlation. Extensive experiments demonstrate that SAGDFN achieves comparable performance with state-of-the-art baselines on one real-world dataset of 207 nodes and outperforms all state-of-the-art baselines by a significant margin on three real-world datasets of 2000 nodes.


title: A generalization of the Titchmarsh divisor problem

abstract: Let $d^{(k)}(n)$ be the $k$-free divisor function for integer $k\ge2$. Let $a$ be a nonzero integer. In this paper, we establish an asymptotic formula \begin{equation*} \sum_{p\leq x} d^{(k)}(p-a) =b_k \cdot x+O\left(\frac{x}{\log x}\right) \end{equation*} related to the Titchmarsh divisor problem, where $b_k$ is a positive constant dependent on $k$ and $a$. For the proof, we apply a result of Felix and show a general asymptotic formula for a class of arithmetic functions including the unitary divisor function, $k$-free divisor function and the proper Pillai's function.


title: Demystifying the Recency Heuristic in Temporal-Difference Learning

abstract: The recency heuristic in reinforcement learning is the assumption that stimuli that occurred closer in time to an acquired reward should be more heavily reinforced. The recency heuristic is one of the key assumptions made by TD($\lambda$), which reinforces recent experiences according to an exponentially decaying weighting. In fact, all other widely used return estimators for TD learning, such as $n$-step returns, satisfy a weaker (i.e., non-monotonic) recency heuristic. Why is the recency heuristic effective for temporal credit assignment? What happens when credit is assigned in a way that violates this heuristic? In this paper, we analyze the specific mathematical implications of adopting the recency heuristic in TD learning. We prove that any return estimator satisfying this heuristic: 1) is guaranteed to converge to the correct value function, 2) has a relatively fast contraction rate, and 3) has a long window of effective credit assignment, yet bounded worst-case variance. We also give a counterexample where on-policy, tabular TD methods violating the recency heuristic diverge. Our results offer some of the first theoretical evidence that credit assignment based on the recency heuristic facilitates learning.


title: DASSF: Dynamic-Attention Scale-Sequence Fusion for Aerial Object Detection

abstract: The detection of small objects in aerial images is a fundamental task in the field of computer vision. Moving objects in aerial photography have problems such as different shapes and sizes, dense overlap, occlusion by the background, and object blur, however, the original YOLO algorithm has low overall detection accuracy due to its weak ability to perceive targets of different scales. In order to improve the detection accuracy of densely overlapping small targets and fuzzy targets, this paper proposes a dynamic-attention scale-sequence fusion algorithm (DASSF) for small target detection in aerial images. First, we propose a dynamic scale sequence feature fusion (DSSFF) module that improves the up-sampling mechanism and reduces computational load. Secondly, a x-small object detection head is specially added to enhance the detection capability of small targets. Finally, in order to improve the expressive ability of targets of different types and sizes, we use the dynamic head (DyHead). The model we proposed solves the problem of small target detection in aerial images and can be applied to multiple different versions of the YOLO algorithm, which is universal. Experimental results show that when the DASSF method is applied to YOLOv8, compared to YOLOv8n, on the VisDrone-2019 and DIOR datasets, the model shows an increase of 9.2% and 2.4% in the mean average precision (mAP), respectively, and outperforms the current mainstream methods.


title: VIRL: Volume-Informed Representation Learning towards Few-shot Manufacturability Estimation

abstract: Designing for manufacturing poses significant challenges in part due to the computation bottleneck of Computer-Aided Manufacturing (CAM) simulations. Although deep learning as an alternative offers fast inference, its performance is dependently bounded by the need for abundant training data. Representation learning, particularly through pre-training, offers promise for few-shot learning, aiding in manufacturability tasks where data can be limited. This work introduces VIRL, a Volume-Informed Representation Learning approach to pre-train a 3D geometric encoder. The pretrained model is evaluated across four manufacturability indicators obtained from CAM simulations: subtractive machining (SM) time, additive manufacturing (AM) time, residual von Mises stress, and blade collisions during Laser Power Bed Fusion process. Across all case studies, the model pre-trained by VIRL shows substantial enhancements on demonstrating improved generalizability with limited data and superior performance with larger datasets. Regarding deployment strategy, case-specific phenomenon exists where finetuning VIRL-pretrained models adversely affects AM tasks with limited data but benefits SM time prediction. Moreover, the efficacy of Low-rank adaptation (LoRA), which balances between probing and finetuning, is explored. LoRA shows stable performance akin to probing with limited data, while achieving a higher upper bound than probing as data size increases, without the computational costs of finetuning. Furthermore, static normalization of manufacturing indicators consistently performs well across tasks, while dynamic normalization enhances performance when a reliable task dependent input is available.


title: $L^2$-type invariants for complex smooth quasi-projective varieties -- a survey

abstract: Let $X$ be a complex smooth quasi-projective variety with an epimorphism $\nu \colon \pi_1(X)\twoheadrightarrow \mathbb{Z}^n$. We survey recent developments about the asymptotic behaviour of Betti numbers with any field coefficients and the order of the torsion part of singular integral homology of finite abelian covers of $X$ associated to $\nu$, known as the $L^2$-type invariants. We give relations between $L^2$-type invariants, Alexander invariants and cohomology jump loci. When $\nu$ is orbifold effective, we give explicit formulas for $L^2$-invariants at homological degree one in terms of geometric information of $X$. We also propose several related open questions for hyperplane arrangement complement.


title: An Investigation of Neuron Activation as a Unified Lens to Explain Chain-of-Thought Eliciting Arithmetic Reasoning of LLMs

abstract: Large language models (LLMs) have shown strong arithmetic reasoning capabilities when prompted with Chain-of-Thought (CoT) prompts. However, we have only a limited understanding of how they are processed by LLMs. To demystify it, prior work has primarily focused on ablating different components in the CoT prompt and empirically observing their resulting LLM performance change. Yet, the reason why these components are important to LLM reasoning is not explored. To fill this gap, in this work, we investigate ``neuron activation'' as a lens to provide a unified explanation to observations made by prior work. Specifically, we look into neurons within the feed-forward layers of LLMs that may have activated their arithmetic reasoning capabilities, using Llama2 as an example. To facilitate this investigation, we also propose an approach based on GPT-4 to automatically identify neurons that imply arithmetic reasoning. Our analyses revealed that the activation of reasoning neurons in the feed-forward layers of an LLM can explain the importance of various components in a CoT prompt, and future research can extend it for a more complete understanding.


title: Stability of Data-Dependent Ridge-Regularization for Inverse Problems

abstract: Theoretical guarantees for the robust solution of inverse problems have important implications for applications. To achieve both guarantees and high reconstruction quality, we propose to learn a pixel-based ridge regularizer with a data-dependent and spatially-varying regularization strength. For this architecture, we establish the existence of solutions to the associated variational problem and the stability of its solution operator. Further, we prove that the reconstruction forms a maximum-a-posteriori approach. Simulations for biomedical imaging and material sciences demonstrate that the approach yields high-quality reconstructions even if only a small instance-specific training set is available.


title: Improving Behrend's construction: Sets without arithmetic progressions in integers and over finite fields

abstract: We prove new lower bounds on the maximum size of subsets $A\subseteq \{1,\dots,N\}$ or $A\subseteq \mathbb{F}_p^n$ not containing three-term arithmetic progressions. In the setting of $\{1,\dots,N\}$, this is the first improvement upon a classical construction of Behrend from 1946 beyond lower-order factors (in particular, it is the first quasipolynomial improvement). In the setting of $\mathbb{F}_p^n$ for a fixed prime $p$ and large $n$, we prove a lower bound of $(cp)^n$ for some absolute constant $c>1/2$ (for $c = 1/2$, such a bound can be obtained via classical constructions from the 1940s, but improving upon this has been a well-known open problem).


title: Electronic correlations arising from anti-Stoner spin excitations: an ab initio study of itinerant ferro- and antiferromagnet

abstract: The anti-Stoner excitations are a spin-flips in which, effectively, an electron is promoted from a minority to a majority spin state, i.e., complementary to Stoner excitations and spin-waves. Since their spectral power is negligible in strong itinerant ferromagnets and they are identically absent in the ferromagnetic Heisenberg model, their properties and role in correlating electrons were hardly investigated so far. On the other hand, they are present in weak ferromagnets, fcc Ni being a prominent example, and both types of spin-flips (down-to-up and up-to-down) must be treated on the equal footing in systems with the degenerate spin up and down bands, in particular antiferromagnets in which case we choose CrSb as a model system. For these two materials we evaluate the strength of the effective interaction between the quasiparticles and the gas of virtual spin-flip excitations. To this end, we compute the corresponding self-energy taking advantage of our novel efficient \textit{ab initio} numerical scheme. We find that in Ni the band-structure renormalization due to the anti-Stoner processes is weaker than the one due to Stoner-type magnons in the majority spin channel but the two become comparable in the minority one. The effect can be traced back primarily to the spectral strength of the respective spin excitations and the densities of the final available quasiparticle states in the scattering process. For the antiferromagnet, the situation is more complex and we observe that the electron-magnon interaction is sensitive not only to these densities of states but critically to the spatial shapes of the coupling magnonic modes as well.


title: JEN-1 DreamStyler: Customized Musical Concept Learning via Pivotal Parameters Tuning

abstract: Large models for text-to-music generation have achieved significant progress, facilitating the creation of high-quality and varied musical compositions from provided text prompts. However, input text prompts may not precisely capture user requirements, particularly when the objective is to generate music that embodies a specific concept derived from a designated reference collection. In this paper, we propose a novel method for customized text-to-music generation, which can capture the concept from a two-minute reference music and generate a new piece of music conforming to the concept. We achieve this by fine-tuning a pretrained text-to-music model using the reference music. However, directly fine-tuning all parameters leads to overfitting issues. To address this problem, we propose a Pivotal Parameters Tuning method that enables the model to assimilate the new concept while preserving its original generative capabilities. Additionally, we identify a potential concept conflict when introducing multiple concepts into the pretrained model. We present a concept enhancement strategy to distinguish multiple concepts, enabling the fine-tuned model to generate music incorporating either individual or multiple concepts simultaneously. Since we are the first to work on the customized music generation task, we also introduce a new dataset and evaluation protocol for the new task. Our proposed Jen1-DreamStyler outperforms several baselines in both qualitative and quantitative evaluations. Demos will be available at https://www.jenmusic.ai/research#DreamStyler.


title: Unleashing the Potential of Open-set Noisy Samples Against Label Noise for Medical Image Classification

abstract: The challenge of addressing mixed closed-set and open-set label noise in medical image classification remains largely unexplored. Unlike natural image classification where there is a common practice of segregation and separate processing of closed-set and open-set noisy samples from clean ones, medical image classification faces difficulties due to high inter-class similarity which complicates the identification of open-set noisy samples. Moreover, prevailing methods do not leverage the full potential of open-set noisy samples for label noise mitigation, often leading to their exclusion or application of uniform soft labels. To address these issues, we propose an Extended Noise-robust Contrastive and Open-set Feature Augmentation (ENCOFA) framework. ENCOFA includes the Extended Noise-robust Supervised Contrastive (ENSC) Loss, which aids in distinguishing features across classes. The ENSC loss regards open-set noisy samples as an extended class and mitigates label noise by weighting contrastive pairs with label reliability. Furthermore, we develop an Open-set Feature Augmentation (OSFeatAug) module that enriches the features of open-set samples, utilizing the model's extra capacity to prevent overfitting to noisy data. We conducted experiments on a synthetic noisy dataset and a real-world noisy dataset. Our results indicate the superiority of ENCOFA and the effectiveness of leveraging the open-set noisy samples to combat label noise.


title: Hadronic resonance production with ALICE at the LHC

abstract: Recent results on short-lived hadronic resonances obtained with the ALICE detector at LHC energies are presented. These results include system-size and collision-energy evolution of transverse momentum spectra, yields and the ratios of resonance yields to those of longer-lived particles, and nuclear modification factors. Results will be compared with model predictions.


title: Fast and Slow Generating: An Empirical Study on Large and Small Language Models Collaborative Decoding

abstract: Large Language Models (LLMs) demonstrate impressive performance in diverse applications, yet they face significant drawbacks, including high inference latency, expensive training cost, and generation of hallucination. Collaborative decoding between large and small language models (SLMs) offers a novel approach to address these challenges. Inspired by dual-process cognitive theory, we integrate these methods into a unified framework termed Fast and Slow Generating (FS-GEN). This paper explores several techniques within the FS-GEN framework, including speculative decoding, contrastive decoding, and emulator or proxy fine-tuning. We provide a comprehensive analysis of these methodologies, offering insights into their similarities and differences under this framework. Our study delves into the differential knowledge capabilities of LLMs versus SLMs through the FS-GEN lens, revealing that fewer than 20% of collaborative interactions are required across various methods. These interactions adhere to a scaling law relative to the parameter ratios, thereby facilitating predictable collaboration. Furthermore, we investigate the specific positions where collaboration is most effective from an uncertainty perspective, yielding novel insights that could refine FS-GEN methods. Our findings reveal that the essential difference between models of different sizes lies in the uncertainty of the next token prediction, where interventions by larger models are most needed to assist the smaller ones. Code for Reproduction: https://github.com/TsinghuaC3I/FS-GEN


title: Generative Artificial Intelligence-Guided User Studies: An Application for Air Taxi Services

abstract: User studies are crucial for meeting user needs. In user studies, real experimental scenarios and participants are constructed and recruited. However, emerging and unfamiliar studies face limitations, including safety concerns and iterative efficiency. To address these challenges, this study utilizes a large language model (LLM) to create generative AI virtual scenarios for user experience. By recruiting real users to evaluate this experience, we can collect feedback that enables rapid iteration in the early design phase. The air taxi is particularly representative of these challenges and has been chosen as the case study for this research. The key contribution was designing a virtual ATJ using OpenAI's GPT-4 model and AI image and video generators. Based on the LLM-generated scripts, key visuals were created for the air taxi, and the ATJ was evaluated by 72 participants. Furthermore, the LLM demonstrated the ability to identify and suggest environments that significantly improve participants' attitudes toward air taxis. Education level and gender significantly influenced participants' attitudes and their satisfaction with the ATJ. Our study confirms the capability of generative AI to support user studies, providing a feasible approach and valuable insights for designing air taxi user experiences in the early design phase.


title: Faithful Density-Peaks Clustering via Matrix Computations on MPI Parallelization System

abstract: Density peaks clustering (DP) has the ability of detecting clusters of arbitrary shape and clustering non-Euclidean space data, but its quadratic complexity in both computing and storage makes it difficult to scale for big data. Various approaches have been proposed in this regard, including MapReduce based distribution computing, multi-core parallelism, presentation transformation (e.g., kd-tree, Z-value), granular computing, and so forth. However, most of these existing methods face two limitations. One is their target datasets are mostly constrained to be in Euclidian space, the other is they emphasize only on local neighbors while ignoring global data distribution due to restriction to cut-off kernel when computing density. To address the two issues, we present a faithful and parallel DP method that makes use of two types of vector-like distance matrices and an inverse leading-node-finding policy. The method is implemented on a message passing interface (MPI) system. Extensive experiments showed that our method is capable of clustering non-Euclidean data such as in community detection, while outperforming the state-of-the-art counterpart methods in accuracy when clustering large Euclidean data. Our code is publicly available at https://github.com/alanxuji/FaithPDP.


title: Research on Dangerous Flight Weather Prediction based on Machine Learning

abstract: With the continuous expansion of the scale of air transport, the demand for aviation meteorological support also continues to grow. The impact of hazardous weather on flight safety is critical. How to effectively use meteorological data to improve the early warning capability of flight dangerous weather and ensure the safe flight of aircraft is the primary task of aviation meteorological services. In this work, support vector machine (SVM) models are used to predict hazardous flight weather, especially for meteorological conditions with high uncertainty such as storms and turbulence. SVM is a supervised learning method that distinguishes between different classes of data by finding optimal decision boundaries in a high-dimensional space. In order to meet the needs of this study, we chose the radial basis function (RBF) as the kernel function, which helps to deal with nonlinear problems and enables the model to better capture complex meteorological data structures. During the model training phase, we used historical meteorological observations from multiple weather stations, including temperature, humidity, wind speed, wind direction, and other meteorological indicators closely related to flight safety. From this data, the SVM model learns how to distinguish between normal and dangerous flight weather conditions.


title: Exploiting and Securing ML Solutions in Near-RT RIC: A Perspective of an xApp

abstract: Open Radio Access Networks (O-RAN) are emerging as a disruptive technology, revolutionising traditional mobile network architecture and deployments in the current 5G and the upcoming 6G era. Disaggregation of network architecture, inherent support for AI/ML workflows, cloud-native principles, scalability, and interoperability make O-RAN attractive to network providers for beyond-5G and 6G deployments. Notably, the ability to deploy custom applications, including Machine Learning (ML) solutions as xApps or rApps on the RAN Intelligent Controllers (RICs), has immense potential for network function and resource optimisation. However, the openness, nascent standards, and distributed architecture of O-RAN and RICs introduce numerous vulnerabilities exploitable through multiple attack vectors, which have not yet been fully explored. To address this gap and ensure robust systems before large-scale deployments, this work analyses the security of ML-based applications deployed on the RIC platform. We focus on potential attacks, defence mechanisms, and pave the way for future research towards a more robust RIC platform.


title: IR2QSM: Quantitative Susceptibility Mapping via Deep Neural Networks with Iterative Reverse Concatenations and Recurrent Modules

abstract: Quantitative susceptibility mapping (QSM) is an MRI phase-based post-processing technique to extract the distribution of tissue susceptibilities, demonstrating significant potential in studying neurological diseases. However, the ill-conditioned nature of dipole inversion makes QSM reconstruction from the tissue field prone to noise and artifacts. In this work, we propose a novel deep learning-based IR2QSM method for QSM reconstruction. It is designed by iterating four times of a reverse concatenations and middle recurrent modules enhanced U-net, which could dramatically improve the efficiency of latent feature utilization. Simulated and in vivo experiments were conducted to compare IR2QSM with several traditional algorithms (MEDI and iLSQR) and state-of-the-art deep learning methods (U-net, xQSM, and LPCNN). The results indicated that IR2QSM was able to obtain QSM images with significantly increased accuracy and mitigated artifacts over other methods. Particularly, IR2QSM demonstrated on average the best NRMSE (27.59%) in simulated experiments, which is 15.48%, 7.86%, 17.24%, 9.26%, and 29.13% lower than iLSQR, MEDI, U-net, xQSM, LPCNN, respectively, and led to improved QSM results with fewer artifacts for the in vivo data.


title: Double-pole approximation for leading-order semi-leptonic vector-boson scattering at the LHC

abstract: Measuring vector-boson scattering beyond the fully-leptonic final state is becoming possible at the LHC, which demands to have a solid control on the theory predictions for all final states of this class of processes. In this work we present a full off-shell leading-order calculation for the process $\mathrm{p}\mathrm{p} \to \ell \nu_\ell + 4\mathrm{j}$ in two fiducial regions which are particularly relevant for its experimental measurement. In addition to the fully electroweak order, i.e. $\mathcal{O}(\alpha^6)$, we complement our results with $\mathcal{O}(\alpha_\mathrm{s}\alpha^5)$ and $\mathcal{O}(\alpha_\mathrm{s}^2\alpha^4)$ for inclusive predictions. At $\mathcal{O}(\alpha^6)$ we present for the first time a systematic treatment of the process in double-pole approximation and we perform a detailed study of its range of validity by considering inclusive and differential predictions compared to the full off-shell calculation.


title: A Step Towards a Universal Method for Modeling and Implementing Cross-Organizational Business Processes

abstract: The widely adopted Business Process Model and Notation (BPMN) is a cornerstone of industry standards for business process modeling. However, its ambiguous execution semantics often result in inconsistent interpretations, depending on the software used for implementation. In response, the Process Specification Language (PASS) provides formally defined semantics to overcome these interpretational challenges. Despite its clear advantages, PASS has not reached the same level of industry penetration as BPMN. This feasibility study proposes using PASS as an intermediary framework to translate and execute BPMN models. It describes the development of a prototype translator that converts specific BPMN elements into a format compatible with PASS. These models are then transformed into source code and executed in a bespoke workflow environment, marking a departure from traditional BPMN implementations. Our findings suggest that integrating PASS enhances compatibility across different modeling and execution tools and offers a more robust methodology for implementing business processes across organizations. This study lays the groundwork for more accurate and unified business process model executions, potentially transforming industry standards for process modeling and execution.


title: Immiscible Diffusion: Accelerating Diffusion Training with Noise Assignment

abstract: In this paper, we point out suboptimal noise-data mapping leads to slow training of diffusion models. During diffusion training, current methods diffuse each image across the entire noise space, resulting in a mixture of all images at every point in the noise layer. We emphasize that this random mixture of noise-data mapping complicates the optimization of the denoising function in diffusion models. Drawing inspiration from the immiscible phenomenon in physics, we propose Immiscible Diffusion, a simple and effective method to improve the random mixture of noise-data mapping. In physics, miscibility can vary according to various intermolecular forces. Thus, immiscibility means that the mixing of the molecular sources is distinguishable. Inspired by this, we propose an assignment-then-diffusion training strategy. Specifically, prior to diffusing the image data into noise, we assign diffusion target noise for the image data by minimizing the total image-noise pair distance in a mini-batch. The assignment functions analogously to external forces to separate the diffuse-able areas of images, thus mitigating the inherent difficulties in diffusion training. Our approach is remarkably simple, requiring only one line of code to restrict the diffuse-able area for each image while preserving the Gaussian distribution of noise. This ensures that each image is projected only to nearby noise. To address the high complexity of the assignment algorithm, we employ a quantized-assignment method to reduce the computational overhead to a negligible level. Experiments demonstrate that our method achieve up to 3x faster training for consistency models and DDIM on the CIFAR dataset, and up to 1.3x faster on CelebA datasets for consistency models. Besides, we conduct thorough analysis about the Immiscible Diffusion, which sheds lights on how it improves diffusion training speed while improving the fidelity.


title: COT: A Generative Approach for Hate Speech Counter-Narratives via Contrastive Optimal Transport

abstract: Counter-narratives, which are direct responses consisting of non-aggressive fact-based arguments, have emerged as a highly effective approach to combat the proliferation of hate speech. Previous methodologies have primarily focused on fine-tuning and post-editing techniques to ensure the fluency of generated contents, while overlooking the critical aspects of individualization and relevance concerning the specific hatred targets, such as LGBT groups, immigrants, etc. This research paper introduces a novel framework based on contrastive optimal transport, which effectively addresses the challenges of maintaining target interaction and promoting diversification in generating counter-narratives. Firstly, an Optimal Transport Kernel (OTK) module is leveraged to incorporate hatred target information in the token representations, in which the comparison pairs are extracted between original and transported features. Secondly, a self-contrastive learning module is employed to address the issue of model degeneration. This module achieves this by generating an anisotropic distribution of token representations. Finally, a target-oriented search method is integrated as an improved decoding strategy to explicitly promote domain relevance and diversification in the inference process. This strategy modifies the model's confidence score by considering both token similarity and target relevance. Quantitative and qualitative experiments have been evaluated on two benchmark datasets, which demonstrate that our proposed model significantly outperforms current methods evaluated by metrics from multiple aspects.


title: Robust dividend policy: Equivalence of Epstein-Zin and Maenhout preferences

abstract: In a continuous-time economy, this study formulates the Epstein-Zin (EZ) preference for the discounted dividend (or cash payouts) of stockholders as an EZ singular control utility. We show that such a problem is well-defined and equivalent to the robust dividend policy set by the firm's executive in the sense of Maenhout's ambiguity-averse preference. While the firm's executive announces the expected future earnings in financial reports, they also signal the firm's confidence in the expected earnings through dividend or cash payouts. The robust dividend policy can then be characterized by a Hamilton-Jacobi-Bellman (HJB) variational inequality (VI). By constructing a novel shooting method for the HJB-VI, we theoretically prove that the robust dividend policy is a threshold strategy on the firm's surplus process. Therefore, dividend-caring investors can choose firms that match their preferences by examining stock's dividend policies and financial statements, whereas executives can make use of dividend to signal their confidence, in the form of ambiguity aversion, on realizing the earnings implied by their financial statements.


title: Interacting Mathieu equation, synchronization dynamics and collision-induced velocity exchange in trapped ions

abstract: Recently, large-scale trapped ion systems have been realized in experiments for quantum simulation and quantum computation. They are the simplest systems for dynamical stability and parametric resonance. In this model, the Mathieu equation plays the most fundamental role for us to understand the stability and instability of a single ion. In this work, we investigate the dynamics of trapped ions with the Coulomb interaction based on the Hamiltonian equation. We show that the many-body interaction will not influence the phase diagram for instability. Then, the dynamics of this model in the large damping limit will also be analytically calculated using few trapped ions. Furthermore, we find that in the presence of modulation, synchronization dynamics can be observed, showing an exchange of velocities between distant ions on the left side and on the right side of the trap. These dynamics resemble to that of the exchange of velocities in Newton's cradle for the collision of balls at the same time. These dynamics are independent of their initial conditions and the number of ions. As a unique feature of the interacting Mathieu equation, we hope this behavior, which leads to a quasi-periodic solution, can be measured in current experimental systems. Finally, we have also discussed the effect of anharmonic trapping potential, showing the desynchronization during the collision process. It is hopped that the dynamics in this many-body Mathieu equation with damping may find applications in quantum simulations. This model may also find interesting applications in dynamics systems as a pure mathematical problem, which may be beyond the results in the Floquet theorem.


title: Can Tool-augmented Large Language Models be Aware of Incomplete Conditions?

abstract: Recent advancements in integrating large language models (LLMs) with tools have allowed the models to interact with real-world environments. However, these tool-augmented LLMs often encounter incomplete scenarios when users provide partial information or the necessary tools are unavailable. Recognizing and managing such scenarios is crucial for LLMs to ensure their reliability, but this exploration remains understudied. This study examines whether LLMs can identify incomplete conditions and appropriately determine when to refrain from using tools. To this end, we address a dataset by manipulating instances from two datasets by removing necessary tools or essential information for tool invocation. We confirm that most LLMs are challenged to identify the additional information required to utilize specific tools and the absence of appropriate tools. Our research can contribute to advancing reliable LLMs by addressing scenarios that commonly arise during interactions between humans and LLMs.


title: Status of Astronomy Education in India: A Baseline Survey

abstract: We present the results of a nation-wide baseline survey, conducted by us, for the status of Astronomy education among secondary school students in India. The survey was administered in 10 different languages to over 2000 students from diverse backgrounds, and it explored multiple facets of their perspectives on astronomy. The topics included students' views on the incorporation of astronomy in curricula, their grasp of fundamental astronomical concepts, access to educational resources, cultural connections to astronomy, and their levels of interest and aspirations in the subject. We find notable deficiencies in students' knowledge of basic astronomical principles, with only a minority demonstrating proficiency in key areas such as celestial sizes, distances, and lunar phases. Furthermore, access to resources such as telescopes and planetariums remain limited across the country. Despite these challenges, a significant majority of students expressed a keen interest in astronomy. We further analyze the data along socioeconomic and gender lines. Particularly striking were the socioeconomic disparities, with students from resource-poor backgrounds often having lower levels of access and proficiency. Some differences were observed between genders, although not very pronounced. The insights gleaned from this study hold valuable implications for the development of a more robust astronomy curriculum and the design of effective teacher training programs in the future.


title: Adaptive Safe Reinforcement Learning-Enabled Optimization of Battery Fast-Charging Protocols

abstract: Optimizing charging protocols is critical for reducing battery charging time and decelerating battery degradation in applications such as electric vehicles. Recently, reinforcement learning (RL) methods have been adopted for such purposes. However, RL-based methods may not ensure system (safety) constraints, which can cause irreversible damages to batteries and reduce their lifetime. To this end, this work proposes an adaptive and safe RL framework to optimize fast charging strategies while respecting safety constraints with a high probability. In our method, any unsafe action that the RL agent decides will be projected into a safety region by solving a constrained optimization problem. The safety region is constructed using adaptive Gaussian process (GP) models, consisting of static and dynamic GPs, that learn from online experience to adaptively account for any changes in battery dynamics. Simulation results show that our method can charge the batteries rapidly with constraint satisfaction under varying operating conditions.


title: Emergence and evolution of electronic modes with temperature in spin-gapped Mott and Kondo insulators

abstract: Electronic modes emerge within the band gap at nonzero temperature in strongly correlated insulators such as Mott and Kondo insulators, exhibiting momentum-shifted magnetic dispersion relations from the band edges. As the temperature increases, the emergent modes gain considerable spectral weights and form robust bands that differ from the zero-temperature bands. Here, the origin of the emergent modes, their relation to doping-induced modes, and how their spectral weights increase with temperature are clarified in the ladder and bilayer Hubbard models and one- and two-dimensional Kondo lattice models using effective theory for weak inter-unit-cell hopping and numerical calculations. The results indicate that the temperature-driven change in the band structure reflecting spin excitation, including the change in the number of bands, can be observed in various strongly correlated insulators even with a spin gap, provided that the temperature increases up to about spin-excitation energies. The controlled analyses developed in this study significantly contribute to the fundamental understanding of the band structure of strongly correlated insulators at nonzero temperature.


title: Mixture of Scales: Memory-Efficient Token-Adaptive Binarization for Large Language Models

abstract: Binarization, which converts weight parameters to binary values, has emerged as an effective strategy to reduce the size of large language models (LLMs). However, typical binarization techniques significantly diminish linguistic effectiveness of LLMs. To address this issue, we introduce a novel binarization technique called Mixture of Scales (BinaryMoS). Unlike conventional methods, BinaryMoS employs multiple scaling experts for binary weights, dynamically merging these experts for each token to adaptively generate scaling factors. This token-adaptive approach boosts the representational power of binarized LLMs by enabling contextual adjustments to the values of binary weights. Moreover, because this adaptive process only involves the scaling factors rather than the entire weight matrix, BinaryMoS maintains compression efficiency similar to traditional static binarization methods. Our experimental results reveal that BinaryMoS surpasses conventional binarization techniques in various natural language processing tasks and even outperforms 2-bit quantization methods, all while maintaining similar model size to static binarization techniques.


title: Regulating spin dynamics of dipolar and spinor atoms

abstract: Systems of atoms or molecules can possess nonzero total spins that can be employed in spintronics, for instance for creating memory devices, which requires to be able to efficiently regulate spin directions. This article presents some methods of regulating spin dynamics, developed by the authors. These methods can be applied for different physical systems, described by different Hamiltonians including the interactions of spins with magnetic fields. The principal feature of the methods is the use of the feedback fields formed by moving spins.


title: A framework for developing a knowledge management platform

abstract: Knowledge management (KM) involves collecting, organizing, storing, and disseminating information to improve decision-making, innovation, and performance. Implementing KM at scale has become essential for organizations to effectively leverage vast accessible data. This paper is a compilation of concepts that emerged from KM workshops hosted by EMBL-EBI, attended by SMEs and industry. We provide guidance on envisioning, executing, evaluating, and evolving knowledge management platforms. We emphasize essential considerations such as setting knowledge domain boundaries and measuring success, as well as the importance of making knowledge accessible for downstream applications and non-computational users and highlights necessary personal and organizational skills for success. We stress the importance of collaboration and the need for convergence on shared principles and commitment to provide or seek resources to advance KM. The community is invited to join the journey of KM and contribute to the advancement of the field by applying and improving on the guidelines described.


title: Gravitational attraction of ultra-relativistic matter: A new testbed for modified gravity at the Large Hadron Collider

abstract: We derive the scalar-tensor modification of the gravitational field of an ultrarelativistic particle beam and its effect on a test particle that is used as sensor. To do so, we solve the linearized scalar-tensor gravity field equations sourced by an energy-momentum tensor of a moving point particle. The geodesic equation and the geodesic deviation equation then predict the acceleration of the test particle as well as the momentum transfer due to a passing source. Comparing the momentum transfer predicted by general relativity and scalar tensor gravity, we find that there exists a relevant parameter regime where this difference increases significantly with the velocity of the source particle. Since ultrarelativistic particles are available at accelerators like the Large Hadron Collider, ultra-precise acceleration sensors in the vicinity of the particle beam could potentially detect deviations from general relativity or constrain modified gravity models.


title: PruningBench: A Comprehensive Benchmark of Structural Pruning

abstract: Structural pruning has emerged as a promising approach for producing more efficient models. Nevertheless, the community suffers from a lack of standardized benchmarks and metrics, leaving the progress in this area not fully comprehended. To fill this gap, we present the first comprehensive benchmark, termed \textit{PruningBench}, for structural pruning. PruningBench showcases the following three characteristics: 1) PruningBench employs a unified and consistent framework for evaluating the effectiveness of diverse structural pruning techniques; 2) PruningBench systematically evaluates 16 existing pruning methods, encompassing a wide array of models (e.g., CNNs and ViTs) and tasks (e.g., classification and detection); 3) PruningBench provides easily implementable interfaces to facilitate the implementation of future pruning methods, and enables the subsequent researchers to incorporate their work into our leaderboards. We provide an online pruning platform http://pruning.vipazoo.cn for customizing pruning tasks and reproducing all results in this paper. Codes will be made publicly available.


title: Enhancing Visible-Infrared Person Re-identification with Modality- and Instance-aware Visual Prompt Learning

abstract: The Visible-Infrared Person Re-identification (VI ReID) aims to match visible and infrared images of the same pedestrians across non-overlapped camera views. These two input modalities contain both invariant information, such as shape, and modality-specific details, such as color. An ideal model should utilize valuable information from both modalities during training for enhanced representational capability. However, the gap caused by modality-specific information poses substantial challenges for the VI ReID model to handle distinct modality inputs simultaneously. To address this, we introduce the Modality-aware and Instance-aware Visual Prompts (MIP) network in our work, designed to effectively utilize both invariant and specific information for identification. Specifically, our MIP model is built on the transformer architecture. In this model, we have designed a series of modality-specific prompts, which could enable our model to adapt to and make use of the specific information inherent in different modality inputs, thereby reducing the interference caused by the modality gap and achieving better identification. Besides, we also employ each pedestrian feature to construct a group of instance-specific prompts. These customized prompts are responsible for guiding our model to adapt to each pedestrian instance dynamically, thereby capturing identity-level discriminative clues for identification. Through extensive experiments on SYSU-MM01 and RegDB datasets, the effectiveness of both our designed modules is evaluated. Additionally, our proposed MIP performs better than most state-of-the-art methods.


title: Finding Task-specific Subnetworks in Multi-task Spoken Language Understanding Model

abstract: Recently, multi-task spoken language understanding (SLU) models have emerged, designed to address various speech processing tasks. However, these models often rely on a large number of parameters. Also, they often encounter difficulties in adapting to new data for a specific task without experiencing catastrophic forgetting of previously trained tasks. In this study, we propose finding task-specific subnetworks within a multi-task SLU model via neural network pruning. In addition to model compression, we expect that the forgetting of previously trained tasks can be mitigated by updating only a task-specific subnetwork. We conduct experiments on top of the state-of-the-art multi-task SLU model ``UniverSLU'', trained for several tasks such as emotion recognition (ER), intent classification (IC), and automatic speech recognition (ASR). We show that pruned models were successful in adapting to additional ASR or IC data with minimal performance degradation on previously trained tasks.


title: Riemann problem for Aw-Rascle model with more realistic version of extended Chaplygin gas

abstract: The motivation of this study is to find the Riemann solutions of Aw-Rascle model with friction for a more realistic version of extended Chaplygin gas. Firstly, we established the $ \delta $-shock wave in its solutions; indeed, by using generalized Rankine Hugoniot jump conditions the position, strength, and velocity of $ \delta $-shock are obtained. Further, by analyzing the limiting behavior, it is found that one of the Riemann solutions converges to $ \delta $-shock solution as the pressure approaches to generalized Chaplygin gas pressure. Moreover, we obtained that our Riemann solutions converge to the corresponding solutions of the transport equations as pressure tends to zero. Furthermore, we explicitly construct the Riemann solutions of the inhomogeneous Aw-Rascle model.


title: PRePair: Pointwise Reasoning Enhance Pairwise Evaluating for Robust Instruction-Following Assessments

abstract: Pairwise evaluation using large language models (LLMs) is widely used for evaluating natural language generation (NLG) tasks. However, the reliability of LLMs is often compromised by biases, such as favoring verbosity and authoritative tone. In the study, we focus on the comparison of two LLM-based evaluation approaches, pointwise and pairwise. Our findings demonstrate that pointwise evaluators exhibit more robustness against undesirable preferences. Further analysis reveals that pairwise evaluators can accurately identify the shortcomings of low-quality outputs even when their judgment is incorrect. These results indicate that LLMs are more severely influenced by their bias in a pairwise evaluation setup. To mitigate this, we propose a hybrid method that integrates pointwise reasoning into pairwise evaluation. Experimental results show that our method enhances the robustness of pairwise evaluators against adversarial samples while preserving accuracy on normal samples.


title: On semi-implicit schemes for the incompressible Euler equations via the vanishing viscosity limit

abstract: A new type of systematic approach to study the incompressible Euler equations numerically via the vanishing viscosity limit is proposed in this work. We show the new strategy is unconditionally stable that the $L^2$-energy dissipates and $H^s$-norm is uniformly bounded in time without any restriction on the time step. Moreover, first-order convergence of the proposed method is established including both low regularity and high regularity error estimates. The proposed method is extended to full discretization with a newly developed iterative Fourier spectral scheme. Another main contributions of this work is to propose a new integration by parts technique to lower the regularity requirement from $H^4$ to $H^3$ in order to perform the $L^2$-error estimate. To our best knowledge, this is one of the very first work to study incompressible Euler equations by designing stable numerical schemes via the inviscid limit with rigorous analysis. Furthermore, we will present both low and high regularity errors from numerical experiments and demonstrate the dynamics in several benchmark examples.


title: Automatic benchmarking of large multimodal models via iterative experiment programming

abstract: Assessing the capabilities of large multimodal models (LMMs) often requires the creation of ad-hoc evaluations. Currently, building new benchmarks requires tremendous amounts of manual work for each specific analysis. This makes the evaluation process tedious and costly. In this paper, we present APEx, Automatic Programming of Experiments, the first framework for automatic benchmarking of LMMs. Given a research question expressed in natural language, APEx leverages a large language model (LLM) and a library of pre-specified tools to generate a set of experiments for the model at hand, and progressively compile a scientific report. The report drives the testing procedure: based on the current status of the investigation, APEx chooses which experiments to perform and whether the results are sufficient to draw conclusions. Finally, the LLM refines the report, presenting the results to the user in natural language. Thanks to its modularity, our framework is flexible and extensible as new tools become available. Empirically, APEx reproduces the findings of existing studies while allowing for arbitrary analyses and hypothesis testing.


title: Orbit-blocking words and the average-case complexity of Whitehead's problem in the free group of rank 2

abstract: Let F_2 denote the free group of rank 2. Our main technical result of independent interest is: for any element u of F_2, there is g in F_2 such that no cyclically reduced image of u under an automorphism of F_2 contains g as a subword. We then address computational complexity of the following version of the Whitehead automorphism problem: given a fixed u in F_2, decide, on an input v in F_2 of length n, whether or not v is an automorphic image of u. We show that there is an algorithm that solves this problem and has constant (i.e., independent of n) average-case complexity.


title: Hybrid Beamforming Design for Near-Field ISAC with Modular XL-MIMO

abstract: A novel modular extremely large-scale multiple-input-multiple-output (XL-MIMO) integrated sensing and communication (ISAC) framework is proposed in this paper. We consider a downlink ISAC scenario and exploit the modular array architecture to enhance the communication spectral efficiency and sensing resolution while reducing the channel modeling complexity by employing the hybrid spherical and planar wavefront model. Considering the hybrid digital-analog structure inherent to modular arrays, we formulate a joint analog-digital beamforming design problem based on the communication spectral efficiency and sensing signal-to-clutter-plus-noise ratio (SCNR). By exploring the structural similarity of the communication and sensing channels, it is proved that the optimal transmit covariance matrix lies in the subspace spanned by the subarray response vectors, yielding a closed-form solution for the optimal analog beamformer. Consequently, the joint design problem is transformed into a low-dimensional rank-constrained digital beamformer optimization. We first propose a manifold optimization method that directly optimizes the digital beamformer on the rank-constrained Stiefel manifold. Additionally, we develop an semidefinite relaxation (SDR)-based approach that relaxes the rank constraint and employ the randomization technique to obtain a near-optimal solution. Simulation results demonstrate the effectiveness of the proposed modular XL-MIMO ISAC framework and algorithms.


title: AutoDSL: Automated domain-specific language design for structural representation of procedures with constraints

abstract: Accurate representation of procedures in restricted scenarios, such as non-standardized scientific experiments, requires precise depiction of constraints. Unfortunately, Domain-specific Language (DSL), as an effective tool to express constraints structurally, often requires case-by-case hand-crafting, necessitating customized, labor-intensive efforts. To overcome this challenge, we introduce the AutoDSL framework to automate DSL-based constraint design across various domains. Utilizing domain specified experimental protocol corpora, AutoDSL optimizes syntactic constraints and abstracts semantic constraints. Quantitative and qualitative analyses of the DSLs designed by AutoDSL across five distinct domains highlight its potential as an auxiliary module for language models, aiming to improve procedural planning and execution.


title: Dynamics of the conserved net-baryon density near QCD critical point within QGP profile

abstract: This paper investigates the dynamics of the net-baryon multiplicity fluctuations near the QCD critical point, within the inhomogeneous temperature and baryon chemical potential profile of quark-gluon plasma from the hydrodynamics. We numerically solve the Langevin dynamics of conserved net-baryon density and borrow the temperature and chemical potential profile from hydrodynamic simulation. It is found that the local systems at different rapidities reach the critical point at different proper times, owing to the inhomogeneous temperature and chemical potential. As a result, we find the pronounced enhancement of the magnitude for the net-baryon multiplicity fluctuations with large rapidity acceptance at the freeze-out surface, which is the consequence of the combined effect of critical slowing down and inhomogeneous profile.


title: Toward Exploring the Code Understanding Capabilities of Pre-trained Code Generation Models

abstract: Recently, large code generation models trained in a self-supervised manner on extensive unlabeled programming language data have achieved remarkable success. While these models acquire vast amounts of code knowledge, they perform poorly on code understanding tasks, such as code search and clone detection, as they are specifically trained for generation. Pre-training a larger encoder-only architecture model from scratch on massive code data can improve understanding performance. However, this approach is costly and time-consuming, making it suboptimal. In this paper, we pioneer the transfer of knowledge from pre-trained code generation models to code understanding tasks, significantly reducing training costs. We examine effective strategies for enabling decoder-only models to acquire robust code representations. Furthermore, we introduce CL4D, a contrastive learning method designed to enhance the representation capabilities of decoder-only models. Comprehensive experiments demonstrate that our approach achieves state-of-the-art performance in understanding tasks such as code search and clone detection. Our analysis shows that our method effectively reduces the distance between semantically identical samples in the representation space. These findings suggest the potential for unifying code understanding and generation tasks using a decoder-only structured model.


title: Gravastar model in Krori-Barua metric under $f(Q)$ gravity

abstract: In this paper, we explore the characteristics of a gravastar in $f(\mathcal{Q})$ gravity, which is upheld by Krori-Barua (KB) metric. We have used Krori-Barua (KB) metric for the interior and shell regions of the gravastar. We deduced our field equations by using Krori-Barua metric. In the outside regions of the gravastar, we have taken two regular black hole metrics. Additionally, we have applied the Israel junction condition to calculate the potential difference across the thin shell concerning different types of regular black holes, such as Bardeen and Hayward. We have also discussed the physical properties like proper length, entropy, energy, EoS and stability.


title: Can one condition a killed random walk to survive?

abstract: We consider the simple random walk on $\mathbb{Z}^d$ killed with probability $p(|x|)$ at site $x$ for a function $p$ decaying at infinity. Due to recurrence in dimension $d=2$, the killed random walk (KRW) dies almost surely if $p$ is positive, while in dimension $d \geq 3$ it is known that the KRW dies almost surely if and only if $\int_0^{\infty}rp(r)dr = \infty$, under mild technical assumptions on $p$. In this paper we consider, for any $d \geq 2$, functions $p$ for which the KRW dies almost surely and we ask ourselves if the KRW conditioned to survive is well-defined. More precisely, given an exhaustion $(\Lambda_R)_{R \in \mathbb{N}}$ of $\mathbb{Z}^d$, does the KRW conditioned to leave $\Lambda_R$ before dying converges in distribution towards a limit which does not depend on the exhaustion? We first prove that this conditioning is well-defined for $p(r) = o(r^{-2})$, and that it is not for $p(r) = \min(1, r^{-\alpha})$ for $\alpha \in (14/9,2)$. This question is connected to branching random walks and the infinite snake. More precisely, in dimension $d=4$, the infinite snake is related to the KRW with $p(r) \asymp (r^2\log(r))^{-1}$, therefore our results imply that the infinite snake conditioned to avoid the origin in four dimensions is well-defined.


title: SNAP: Unlearning Selective Knowledge in Large Language Models with Negative Instructions

abstract: Instruction-following large language models (LLMs), such as ChatGPT, have become increasingly popular with the general audience, many of whom are incorporating them into their daily routines. However, these LLMs inadvertently disclose personal or copyrighted information, which calls for a machine unlearning method to remove selective knowledge. Previous attempts sought to forget the link between the target information and its associated entities, but it rather led to generating undesirable responses about the target, compromising the end-user experience. In this work, we propose SNAP, an innovative framework designed to selectively unlearn information by 1) training an LLM with negative instructions to generate obliterated responses, 2) augmenting hard positives to retain the original LLM performance, and 3) applying the novel Wasserstein regularization to ensure adequate deviation from the initial weights of the LLM. We evaluate our framework on various NLP benchmarks and demonstrate that our approach retains the original LLM capabilities, while successfully unlearning the specified information.


title: Security and Privacy of 6G Federated Learning-enabled Dynamic Spectrum Sharing

abstract: Spectrum sharing is increasingly vital in 6G wireless communication, facilitating dynamic access to unused spectrum holes. Recently, there has been a significant shift towards employing machine learning (ML) techniques for sensing spectrum holes. In this context, federated learning (FL)-enabled spectrum sensing technology has garnered wide attention, allowing for the construction of an aggregated ML model without disclosing the private spectrum sensing information of wireless user devices. However, the integrity of collaborative training and the privacy of spectrum information from local users have remained largely unexplored. This article first examines the latest developments in FL-enabled spectrum sharing for prospective 6G scenarios. It then identifies practical attack vectors in 6G to illustrate potential AI-powered security and privacy threats in these contexts. Finally, the study outlines future directions, including practical defense challenges and guidelines.


title: Retrieval Meets Reasoning: Dynamic In-Context Editing for Long-Text Understanding

abstract: Current Large Language Models (LLMs) face inherent limitations due to their pre-defined context lengths, which impede their capacity for multi-hop reasoning within extensive textual contexts. While existing techniques like Retrieval-Augmented Generation (RAG) have attempted to bridge this gap by sourcing external information, they fall short when direct answers are not readily available. We introduce a novel approach that re-imagines information retrieval through dynamic in-context editing, inspired by recent breakthroughs in knowledge editing. By treating lengthy contexts as malleable external knowledge, our method interactively gathers and integrates relevant information, thereby enabling LLMs to perform sophisticated reasoning steps. Experimental results demonstrate that our method effectively empowers context-limited LLMs, such as Llama2, to engage in multi-hop reasoning with improved performance, which outperforms state-of-the-art context window extrapolation methods and even compares favorably to more advanced commercial long-context models. Our interactive method not only enhances reasoning capabilities but also mitigates the associated training and computational costs, making it a pragmatic solution for enhancing LLMs' reasoning within expansive contexts.


title: Congruences for sums of MacMahon's $q$-Catalan polynomials

abstract: One variant of the $q$-Catalan polynomials is defined in terms of Gaussian polynomials by $\mathcal{C}_k(q)=\genfrac{[}{]}{0pt}{}{2k}{k}_q-q\genfrac{[}{]}{0pt}{}{2k}{k+1}_q$. Liu studied congruences of the form $\sum_{k=0}^{n-1} q^k\mathcal{C}_k$ modulo the cyclotomic polynomial $\Phi_n(q)^2$, provided that $n\equiv\pm 1\pmod3$. Apparently the case $n\equiv 0\pmod3$ has been missing from the literature. It is our primary purpose to fill this gap by the current work. In addition, we discuss certain fascinating link to Dirichlet character sum identities.


title: Permeability distribution of gas drainage of borehole with the different moisture content caused polar permeability effect

abstract: In order to study the penetration characteristics in areas with different water content and different stress distributions in the radial direction of the hole after hydraulicization measures, an improved LFTD1812 triaxial permeability meter was used to conduct a test to measure the polar permeability characteristics of coal with different water content combinations were measured by permeability instrument, and the porosity, permeability, pressure gradient and seepage velocity of different samples were analyzed. The relationship between sample porosity, permeability, pressure gradient and seepage velocity was discussed, the influence of moisture content on permeability was discussed, and the directionality and the directivity and polarization effect of permeability were found.. Result shows that The relationship between permeability and porosity shows two trends of exponential type and logarithmic type, and the porosity-permeability({\phi}-k) plane is divided into three influence regions: super index (I), index (II) and logarithm (III).


title: What Did I Do Wrong? Quantifying LLMs' Sensitivity and Consistency to Prompt Engineering

abstract: Large Language Models (LLMs) changed the way we design and interact with software systems. Their ability to process and extract information from text has drastically improved productivity in a number of routine tasks. Developers that want to include these models in their software stack, however, face a dreadful challenge: debugging their inconsistent behavior across minor variations of the prompt. We therefore introduce two metrics for classification tasks, namely sensitivity and consistency, which are complementary to task performance. First, sensitivity measures changes of predictions across rephrasings of the prompt, and does not require access to ground truth labels. Instead, consistency measures how predictions vary across rephrasings for elements of the same class. We perform an empirical comparison of these metrics on text classification tasks, using them as guideline for understanding failure modes of the LLM. Our hope is that sensitivity and consistency will be powerful allies in automatic prompt engineering frameworks to obtain LLMs that balance robustness with performance.


title: Attention Score is not All You Need for Token Importance Indicator in KV Cache Reduction: Value Also Matters

abstract: Scaling the context size of large language models (LLMs) enables them to perform various new tasks, e.g., book summarization. However, the memory cost of the Key and Value (KV) cache in attention significantly limits the practical applications of LLMs. Recent works have explored token pruning for KV cache reduction in LLMs, relying solely on attention scores as a token importance indicator. However, our investigation into value vector norms revealed a notably non-uniform pattern questioning their reliance only on attention scores. Inspired by this, we propose a new method: Value-Aware Token Pruning (VATP) which uses both attention scores and the $ \ell_{1} $ norm of value vectors to evaluate token importance. Extensive experiments on LLaMA2-7B-chat and Vicuna-v1.5-7B across 16 LongBench tasks demonstrate VATP's superior performance.


title: A Compass for Navigating the World of Sentence Embeddings for the Telecom Domain

abstract: A plethora of sentence embedding models makes it challenging to choose one, especially for domains such as telecom, rich with specialized vocabulary. We evaluate multiple embeddings obtained from publicly available models and their domain-adapted variants, on both point retrieval accuracies as well as their (95\%) confidence intervals. We establish a systematic method to obtain thresholds for similarity scores for different embeddings. We observe that fine-tuning improves mean bootstrapped accuracies as well as tightens confidence intervals. The pre-training combined with fine-tuning makes confidence intervals even tighter. To understand these variations, we analyse and report significant correlations between the distributional overlap between top-$K$, correct and random sentence similarities with retrieval accuracies and similarity thresholds. Following current literature, we analyze if retrieval accuracy variations can be attributed to isotropy of embeddings. Our conclusions are that isotropy of embeddings (as measured by two independent state-of-the-art isotropy metric definitions) cannot be attributed to better retrieval performance. However, domain adaptation which improves retrieval accuracies also improves isotropy. We establish that domain adaptation moves domain specific embeddings further away from general domain embeddings.


title: Evolution Dynamics Toward the Limit Cycle of a Quantum Self-Sustained Oscillator

abstract: The dynamics of a quantum self-sustained oscillator as it evolves toward its limit cycle may be useful in solving related problems like those in quantum synchronization, yet is inadequately studied. Here we investigate the evolution of a quantum Rayleigh-van der Pol (RvdP) oscillator, the simplest form of a self-sustained oscillator exhibiting a quasiharmonic limit cycle, starting from Fock, thermal, and coherent states. We find that the phase-space dynamics significantly differ depending on the initial state -- one evolution toward the limit cycle may take much longer than another and a least-time parameter may be present. We describe the resulting dynamics in terms of the coherence decay and the redistribution of eigenstate occupation.


title: PARAFAC2-based Coupled Matrix and Tensor Factorizations with Constraints

abstract: Data fusion models based on Coupled Matrix and Tensor Factorizations (CMTF) have been effective tools for joint analysis of data from multiple sources. While the vast majority of CMTF models are based on the strictly multilinear CANDECOMP/PARAFAC (CP) tensor model, recently also the more flexible PARAFAC2 model has been integrated into CMTF models. PARAFAC2 tensor models can handle irregular/ragged tensors and have shown to be especially useful for modelling dynamic data with unaligned or irregular time profiles. However, existing PARAFAC2-based CMTF models have limitations in terms of possible regularizations on the factors and/or types of coupling between datasets. To address these limitations, in this paper we introduce a flexible algorithmic framework that fits PARAFAC2-based CMTF models using Alternating Optimization (AO) and the Alternating Direction Method of Multipliers (ADMM). The proposed framework allows to impose various constraints on all modes and linear couplings to other matrix-, CP- or PARAFAC2-models. Experiments on various simulated and a real dataset demonstrate the utility and versatility of the proposed framework as well as its benefits in terms of accuracy and efficiency in comparison with state-of-the-art methods.


title: Implementation Of Dynamic De Bruijn Graphs Via Learned Index

abstract: De Bruijn graphs are essential for sequencing data analysis and must be efficiently constructed and stored for large-scale population studies. They also need to be dynamic to allow updates such as adding or removing edges and nodes. Existing dynamic implementations include DynamicBOSS and dynamicDBG. In 2018, a new family of data structures called learned indexes was introduced by Tim Kraska and Alex Beutel, with a particularly efficient implementation proposed by Paolo Ferragina and Giorgio Vinciguerra in 2020. This paper presents a new method for implementing De Bruijn graphs using learned indexes and compares its performance with current implementations. The new method shows improved time and memory efficiency for edge and node insertions, particularly with large datasets (over 110 million k-mers).


title: Sequential giant planet formation initiated by disc substructure

abstract: Planet formation models are necessary to understand the origins of diverse planetary systems. Circumstellar disc substructures have been proposed as preferred locations of planet formation but a complete formation scenario has not been covered by a single model so far. We aim to study the formation of giant planets facilitated by disc substructure and starting with sub-micron-sized dust. We connect dust coagulation and drift, planetesimal formation, $N$-body gravity, pebble accretion, planet migration, planetary gas accretion and gap opening in one consistent modelling framework. We find rapid formation of multiple gas giants from the initial disc substructure. The migration trap near the substructure allows the formation of cold gas giants. A new pressure maximum is created at the outer edge of the planetary gap, which triggers the next generation of planet formation resulting in a compact chain of giant planets. A high planet formation efficiency is achieved as the first gas giants are effective in preventing dust from drifting further inwards, which preserves materials for planet formation. Sequential planet formation is a promising framework to explain the formation of chains of gas and ice giants.


title: The modulated soliton fields in the Goldstone boson model

abstract: It is well known that massless Goldstone bosons have not yet been observed. In the Goldstone boson model, after the spontaneous symmetry breaking under $U(1)$, two coupled nonlinear equations are obtained for which we present the exact solitonic solutions. These solutions completely localize the energy density of the model and show the existence of two boson fields, one massive and the other massless. Also, it is seen that the solitonic waves are modulated and the massless wave rides on the massive wave. Finally, we calculate the charge density of the model, which again confirms the neutrality of these boson fields. Since massive bosons can be observed in the laboratory, these solitonic waves may be useful in tracking and detecting Goldstone bosons.


title: Classical and quantum KMS states on spin lattice systems

abstract: We study the classical and quantum KMS conditions within the context of spin lattice systems. Specifically, we define a strict deformation quantization (SDQ) for a $\mathbb{S}^2$-valued spin lattice system over $\mathbb{Z}^d$ generalizing the renown Berezin SDQ for a single sphere. This allows to promote a classical dynamics on the algebra of classical observables to a quantum dynamics on the algebra of quantum observables. We then compare the notion of classical and quantum thermal equilibrium by showing that any weak*-limit point of a sequence of quantum KMS states fulfils the classical KMS condition. In short, this proves that the semiclassical limit of quantum thermal states describes classical thermal equilibrium, strenghtening the physical interpretation of the classical KMS condition. Finally we provide two sufficient conditions ensuring uniqueness of classical and quantum KMS states: The latter are based on an version of the Kirkwood-Salzburg equations adapted to the system of interest. As a consequence we identify a mild condition which ensures uniqueness of classical KMS states and of quantum KMS states for the quantized dynamics for a common sufficiently high temperature.


title: A note on improvement by iteration for the approximate solutions of second kind Fredholm integral equations with Green's kernels

abstract: Consider a linear operator equation $x - Kx = f$, where $f$ is given and $K$ is a Fredholm integral operator with a Green's function type kernel defined on $C[0, 1]$. For $r \geq 1$, we employ the interpolatory projection at $2r + 1$ collocation points (not necessarily Gauss points) onto a space of piecewise polynomials of degree $\leq 2r$ with respect to a uniform partition of $[0, 1]$. Previous researchers have established that the iteration in case of the collocation method improves the order of convergence by projection methods and its variants in the case of smooth kernel with piecewise polynomials of even degree only. In this article, we demonstrate the improvement in order of convergence by modified collocation method when the kernel is of Green's function type.


title: Infinite Product of the Riemann auxiliary function

abstract: We obtain the product for the auxiliary function $\mathop{\mathcal R}(s)$ and study some related functions as its phase $\omega(t)$ at the critical line. The function $\omega(t)$ determines the zeros of $\zeta(s)$ on the critical line. We study the influence of the zeros of $\mathop{\mathcal R}(s)$ on $\omega(t)$. Thus, the relationship between the zeros of $\mathop{\mathcal R}(s)$ and those of $\zeta(s)$ is determined.


title: Navigating Knowledge Management Implementation Success in Government Organizations: A type-2 fuzzy approach

abstract: Optimal information and knowledge management is crucial for organizations to achieve their objectives efficiently. As a rare and valuable resource, effective knowledge management provides a strategic advantage and has become a key determinant of organizational success. The study aims to identify critical success and failure factors for implementing knowledge management systems in government organizations. This research employs a descriptive survey methodology, collecting data through random interviews and questionnaires. The study highlights the critical success factors for knowledge management systems in government organizations, including cooperation, an open atmosphere, staff training, creativity and innovation, removal of organizational constraints, reward policies, role modeling, and focus. Conversely, failure to consider formality, staff participation, collaboration technologies, network and hardware infrastructure, complexity, IT staff, and trust can pose significant obstacles to successful implementation.


title: Towards the Certification of Hybrid Architectures: Analysing Interference on Hardware Accelerators through PML

abstract: The emergence of Deep Neural Network (DNN) and machine learning-based applications paved the way for a new generation of hybrid hardware platforms. Hybrid platforms embed several cores and accelerators in a small package. However, in order to satisfy the Size, Weight and Power (SWaP) constraints, limited and shared resources are integrated. This paper presents an overview of the standards applicable to the certification of hybrid platforms and an early mapping of their objectives to said platforms. In particular, we consider how the classification of AMC20-152A for airborne electronic hardware applies to hybrid platforms. We also consider AMC20-193 for multi-core platforms, and how this standard fits different types of accelerators.


title: Interpreting Bias in Large Language Models: A Feature-Based Approach

abstract: Large Language Models (LLMs) such as Mistral and LLaMA have showcased remarkable performance across various natural language processing (NLP) tasks. Despite their success, these models inherit social biases from the diverse datasets on which they are trained. This paper investigates the propagation of biases within LLMs through a novel feature-based analytical approach. Drawing inspiration from causal mediation analysis, we hypothesize the evolution of bias-related features and validate them using interpretability techniques like activation and attribution patching. Our contributions are threefold: (1) We introduce and empirically validate a feature-based method for bias analysis in LLMs, applied to LLaMA-2-7B, LLaMA-3-8B, and Mistral-7B-v0.3 with templates from a professions dataset. (2) We extend our method to another form of gender bias, demonstrating its generalizability. (3) We differentiate the roles of MLPs and attention heads in bias propagation and implement targeted debiasing using a counterfactual dataset. Our findings reveal the complex nature of bias in LLMs and emphasize the necessity for tailored debiasing strategies, offering a deeper understanding of bias mechanisms and pathways for effective mitigation.


title: Never Gonna Give You Up: Exploring Deprecated NULL Ciphers in Commercial VoWiFi Deployments

abstract: In today's cellular network evolutions, such as 4G and 5G, the IMS (IP Multimedia Subsystem) serves as a crucial component in managing voice calls and handling short messages. Besides accessing the IMS over the traditional radio layer, many operators use Voice over Wi-Fi (VoWiFi) allowing customers to dial into their core network over the public Internet using an (insecure) Wi-Fi connection. To protect against malicious actors on the WiFi or Internet domain, the traffic is sent over a series of IPsec tunnels, ensuring confidentiality and integrity. Similar to other encrypted protocols (e.g. TLS), the client and server use a handshake protocol (i.e., IKEv2) to communicate their supported security configurations and to agree upon the used parameters (e.g., keys or an encryption algorithm) for the ongoing session. This however opens the door for security vulnerabilities introduced by misconfiguration. We want to analyze security configurations within commercial VoWiFi deployments, both on the client and server side, spotting deprecated configurations that undermine communication security.


title: Effective Generation of Feasible Solutions for Integer Programming via Guided Diffusion

abstract: Feasible solutions are crucial for Integer Programming (IP) since they can substantially speed up the solving process. In many applications, similar IP instances often exhibit similar structures and shared solution distributions, which can be potentially modeled by deep learning methods. Unfortunately, existing deep-learning-based algorithms, such as Neural Diving and Predict-and-search framework, are limited to generating only partial feasible solutions, and they must rely on solvers like SCIP and Gurobi to complete the solutions for a given IP problem. In this paper, we propose a novel framework that generates complete feasible solutions end-to-end. Our framework leverages contrastive learning to characterize the relationship between IP instances and solutions, and learns latent embeddings for both IP instances and their solutions. Further, the framework employs diffusion models to learn the distribution of solution embeddings conditioned on IP representations, with a dedicated guided sampling strategy that accounts for both constraints and objectives. We empirically evaluate our framework on four typical datasets of IP problems, and show that it effectively generates complete feasible solutions with a high probability (> 89.7 \%) without the reliance of Solvers and the quality of solutions is comparable to the best heuristic solutions from Gurobi. Furthermore, by integrating our method's sampled partial solutions with the CompleteSol heuristic from SCIP, the resulting feasible solutions outperform those from state-of-the-art methods across all datasets, exhibiting a 3.7 to 33.7\% improvement in the gap to optimal values, and maintaining a feasible ratio of over 99.7\% for all datasets.


title: Encoding Matching Criteria for Cross-domain Deformable Image Registration

abstract: Most existing deep learning-based registration methods are trained on single-type images to address same-domain tasks.However, cross-domain deformable registration remains challenging.We argue that the tailor-made matching criteria in traditional registration methods is one of the main reason they are applicable in different domains.Motivated by this, we devise a registration-oriented encoder to model the matching criteria of image features and structural features, which is beneficial to boost registration accuracy and adaptability.Specifically, a general feature encoder (Encoder-G) is proposed to capture comprehensive medical image features, while a structural feature encoder (Encoder-S) is designed to encode the structural self-similarity into the global representation.Extensive experiments on images from three different domains prove the efficacy of the proposed method. Moreover, by updating Encoder-S using one-shot learning, our method can effectively adapt to different domains.The code is publicly available at https://github.com/JuliusWang-7/EncoderReg.


title: Hida family of theta lift from U(1) to definite U(2)

abstract: Let K/F be a CM extension satisfying the ordinary assumption for an odd prime p. In this article, we construct Hida families that interpolate theta lifts of algebraic Hecke characters to a definite unitary group U(2) defined from skew-Hermitian spaces over K, and show that the Hida family is primitive when the central L-value of the branch character of the family satisfies certain non-vanishing modulo p conditions.