title: BlockLLM: Memory-Efficient Adaptation of LLMs by Selecting and Optimizing the Right Coordinate Blocks

abstract: Training large language models (LLMs) for pretraining or adapting to new tasks and domains has become increasingly critical as their applications expand. However, as the model and the data sizes grow, the training process presents significant memory challenges, often requiring a prohibitive amount of GPU memory that may not be readily available. Existing methods such as low-rank adaptation (LoRA) add trainable low-rank matrix factorizations, altering the training dynamics and limiting the model's parameter search to a low-rank subspace. GaLore, a more recent method, employs Gradient Low-Rank Projection to reduce the memory footprint, in the full parameter training setting. However GaLore can only be applied to a subset of the LLM layers that satisfy the "reversibility" property, thus limiting their applicability. In response to these challenges, we introduce BlockLLM, an approach inspired by block coordinate descent. Our method carefully selects and updates a very small subset of the trainable parameters without altering any part of its architecture and training procedure. BlockLLM achieves state-of-the-art performance in both finetuning and pretraining tasks, while reducing the memory footprint of the underlying optimization process. Our experiments demonstrate that fine-tuning with only less than 5% of the parameters, BlockLLM achieves state-of-the-art perplexity scores on the GLUE benchmarks. On Llama model pretrained on C4 dataset, BlockLLM is able to train with significantly less memory than the state-of-the-art, while still maintaining competitive performance.


title: Towards Open-set Camera 3D Object Detection

abstract: Traditional camera 3D object detectors are typically trained to recognize a predefined set of known object classes. In real-world scenarios, these detectors may encounter unknown objects outside the training categories and fail to identify them correctly. To address this gap, we present OS-Det3D (Open-set Camera 3D Object Detection), a two-stage training framework enhancing the ability of camera 3D detectors to identify both known and unknown objects. The framework involves our proposed 3D Object Discovery Network (ODN3D), which is specifically trained using geometric cues such as the location and scale of 3D boxes to discover general 3D objects. ODN3D is trained in a class-agnostic manner, and the provided 3D object region proposals inherently come with data noise. To boost accuracy in identifying unknown objects, we introduce a Joint Objectness Selection (JOS) module. JOS selects the pseudo ground truth for unknown objects from the 3D object region proposals of ODN3D by combining the ODN3D objectness and camera feature attention objectness. Experiments on the nuScenes and KITTI datasets demonstrate the effectiveness of our framework in enabling camera 3D detectors to successfully identify unknown objects while also improving their performance on known objects.


title: Towards Efficient and Scalable Training of Differentially Private Deep Learning

abstract: Differentially private stochastic gradient descent (DP-SGD) is the standard algorithm for training machine learning models under differential privacy (DP). The major drawback of DP-SGD is the drop in utility which prior work has comprehensively studied. However, in practice another major drawback that hinders the large-scale deployment is the significantly higher computational cost. We conduct a comprehensive empirical study to quantify the computational cost of training deep learning models under DP and benchmark methods that aim at reducing the cost. Among these are more efficient implementations of DP-SGD and training with lower precision. Finally, we study the scaling behaviour using up to 80 GPUs.


title: Measuring quantum relative entropy with finite-size effect

abstract: We study the estimation of relative entropy $D(\rho\|\sigma)$ when $\sigma$ is known. We show that the Cram\'{e}r-Rao type bound equals the relative varentropy. Our estimator attains the Cram\'{e}r-Rao type bound when the dimension $d$ is fixed. It also achieves the sample complexity $O(d^2)$ when the dimension $d$ increases. This sample complexity is optimal when $\sigma$ is the complexity mixed state. Also, it has time complexity $O(d^5 \polylog d)$. Our proposed estimator unifiedly works under both settings.


title: CausalScore: An Automatic Reference-Free Metric for Assessing Response Relevance in Open-Domain Dialogue Systems

abstract: Automatically evaluating the quality of responses in open-domain dialogue systems is a challenging but crucial task. Current evaluation metrics often fail to align with human judgments, especially when assessing responses that are grammatically correct. To address this issue, we propose a novel metric, called CausalScore, which assesses the relevance of responses by measuring the causal strength between dialogue histories and responses. The causal strength is estimated by utilizing both unconditional dependence and conditional dependencies from the dialogue history to responses. We compare our metric with the existing competitive metrics in terms of their alignment with human judgements. Our experimental results demonstrate that CausalScore significantly surpasses existing state-of-the-art metrics by aligning better with human judgements. Additionally, we collect a new dialogue dataset CGDIALOG+ with human-annotated causal relations and a set of pairwise human judgements to facilitate the development of future automatic metrics.


title: Thermodynamics of a Non-canonical $f(\bar{R},\bar{T})$ gravity

abstract: This work comprises a study of the thermodynamic behavior of modified $f(\bar{R},\bar{T})$ gravity, which had been developed based on a non-canonical theory known as K-essence theory. In this development, we use the Dirac-Born-Infeld (DBI) type of non-standard Lagrangian. We develop a modified first law and generalized second law of thermodynamics (GSLT) within the modified $f(\bar{R},\bar{T})$ gravity, where we consider the background metric to be the usual Friedmann-Lema$\hat{\text{i}}$tre-Robertson-Walker (FLRW) type. A graphical analysis of surface gravity has been performed for the modified FLRW metric via the $f(\bar{R},\bar{T})$ theory, which is different from the usual FLRW gravity through the usual $f(R,T)$ gravity. In the study of the thermodynamic behavior of the cosmos, we use two distinct kinds of scale factors: exponential and power law. Through the investigation of the modified GSLT, we have seen that during the initial phase of the universe, the entropy's rate of change may be either negative or positive, contingent upon the value of the curvature constant. The negativity of the entropy change indicates that the modified GSLT is not feasible in that particular area for a particular curvature constant. These traits suggest that during the inflationary period, entropy might have been either negative or positive. It has also been seen that entropy saturates every curvature value at different time ranges, which indicates the heat death of the universe.


title: HD snapshot diffractive spectral imaging and inferencing

abstract: We present a novel high-definition (HD) snapshot diffractive spectral imaging system utilizing a diffractive filter array (DFA) to capture a single image that encodes both spatial and spectral information. This single diffractogram can be computationally reconstructed into a spectral image cube, providing a high-resolution representation of the scene across 25 spectral channels in the 440-800 nm range at 1304x744 spatial pixels (~1 MP). This unique approach offers numerous advantages including snapshot capture, a form of optical compression, flexible offline reconstruction, the ability to select the spectral basis after capture, and high light throughput due to the absence of lossy filters. We demonstrate a 30-50 nm spectral resolution and compared our reconstructed spectra against ground truth obtained by conventional spectrometers. Proof-of-concept experiments in diverse applications including biological tissue classification, food quality assessment, and simulated stellar photometry validate our system's capability to perform robust and accurate inference. These results establish the DFA-based imaging system as a versatile and powerful tool for advancing scientific and industrial imaging applications.


title: Learnings from Implementation of a BDI Agent-based Battery-less Wireless Sensor

abstract: Battery-less embedded devices powered by energy harvesting are increasingly being used in wireless sensing applications. However, their limited and often uncertain energy availability challenges designing application programs. To examine if BDI-based agent programming can address this challenge, we used it for a real-life application involving an environmental sensor that works on energy harvested from ambient light. This yielded the first ever implementation of a BDI agent on a low-power battery-less and energy-harvesting embedded system. Furthermore, it uncovered conceptual integration challenges between embedded systems and BDI-based agent programming that, if overcome, will simplify the deployment of more autonomous systems on low-power devices with non-deterministic energy availability. Specifically, we (1) mapped essential device states to default \textit{internal} beliefs, (2) recognized and addressed the need for beliefs in general to be \textit{short-} or \textit{long-term}, and (3) propose dynamic annotation of intentions with their run-time energy impact. We show that incorporating these extensions not only simplified the programming but also improved code readability and understanding of its behavior.


title: Leveraging LLMs for Dialogue Quality Measurement

abstract: In task-oriented conversational AI evaluation, unsupervised methods poorly correlate with human judgments, and supervised approaches lack generalization. Recent advances in large language models (LLMs) show robust zeroshot and few-shot capabilities across NLP tasks. This paper explores using LLMs for automated dialogue quality evaluation, experimenting with various configurations on public and proprietary datasets. Manipulating factors such as model size, in-context examples, and selection techniques, we examine "chain-of-thought" (CoT) reasoning and label extraction procedures. Our results show that (1) larger models yield more accurate dialogue labels; (2) algorithmic selection of in-context examples outperforms random selection; (3) CoT reasoning where an LLM is asked to provide justifications before outputting final labels improves performance; and (4) fine-tuned LLMs outperform out-of-the-box ones. Our results indicate that LLMs that are suitably fine-tuned and have sufficient reasoning capabilities can be leveraged for automated dialogue evaluation.


title: Retrieval Augmented Instruction Tuning for Open NER with Large Language Models

abstract: The strong capability of large language models (LLMs) has been applied to information extraction (IE) through either retrieval augmented prompting or instruction tuning (IT). However, the best way to incorporate information with LLMs for IE remains an open question. In this paper, we explore Retrieval Augmented Instruction Tuning (RA-IT) for IE, focusing on the task of open named entity recognition (NER). Specifically, for each training sample, we retrieve semantically similar examples from the training dataset as the context and prepend them to the input of the original instruction. To evaluate our RA-IT approach more thoroughly, we construct a Chinese IT dataset for open NER and evaluate RA-IT in both English and Chinese scenarios. Experimental results verify the effectiveness of RA-IT across various data sizes and in both English and Chinese scenarios. We also conduct thorough studies to explore the impacts of various retrieval strategies in the proposed RA-IT framework. Code and data are available at: https://github.com/Emma1066/Retrieval-Augmented-IT-OpenNER


title: Eluding Zeno effect via dephasing and detuning

abstract: We analyze some variants of the Zeno effect in which the frequent observation of the population of an intermediate state does not prevent the transition of the system from the initial state to a certain final state. The Zeno effect is eluded by means of phase shifts or detunings that tailor the dynamics by suitably altering the interference governing quantum evolution.


title: Scalable Sampling of Truncated Multivariate Normals Using Sequential Nearest-Neighbor Approximation

abstract: We propose a linear-complexity method for sampling from truncated multivariate normal (TMVN) distributions with high fidelity by applying nearest-neighbor approximations to a product-of-conditionals decomposition of the TMVN density. To make the sequential sampling based on the decomposition feasible, we introduce a novel method that avoids the intractable high-dimensional TMVN distribution by sampling sequentially from $m$-dimensional TMVN distributions, where $m$ is a tuning parameter controlling the fidelity. This allows us to overcome the existing methods' crucial problem of rapidly decreasing acceptance rates for increasing dimension. Throughout our experiments with up to tens of thousands of dimensions, we can produce high-fidelity samples with $m$ in the dozens, achieving superior scalability compared to existing state-of-the-art methods. We study a tetrachloroethylene concentration dataset that has $3{,}971$ observed responses and $20{,}730$ undetected responses, together modeled as a partially censored Gaussian process, where our method enables posterior inference for the censored responses through sampling a $20{,}730$-dimensional TMVN distribution.


title: Improving Realized LGD Approximation: A Novel Framework with XGBoost for Handling Missing Cash-Flow Data

abstract: The scope for the accurate calculation of the Loss Given Default (LGD) parameter is comprehensive in terms of financial data. In this research, we aim to explore methods for improving the approximation of realized LGD in conditions of limited access to the cash-flow data. We enhance the performance of the method which relies on the differences between exposure values (delta outstanding approach) by employing machine learning (ML) techniques. The research utilizes the data from the mortgage portfolio of one of the European countries and assumes a close resemblance to similar economic contexts. It incorporates non-financial variables and macroeconomic data related to the housing market, improving the accuracy of loss severity approximation. The proposed methodology attempts to mitigate the country-specific (related to the local legal) or portfolio-specific factors in aim to show the general advantage of applying ML techniques, rather than case-specific relation. We developed an XGBoost model that does not rely on cash-flow data yet enhances the accuracy of realized LGD estimation compared to results obtained with the delta outstanding approach. A novel aspect of our work is the detailed exploration of the delta outstanding approach and the methodology for addressing conditions of limited access to cash-flow data through machine learning models.


title: Zero-Shot Long-Form Video Understanding through Screenplay

abstract: The Long-form Video Question-Answering task requires the comprehension and analysis of extended video content to respond accurately to questions by utilizing both temporal and contextual information. In this paper, we present MM-Screenplayer, an advanced video understanding system with multi-modal perception capabilities that can convert any video into textual screenplay representations. Unlike previous storytelling methods, we organize video content into scenes as the basic unit, rather than just visually continuous shots. Additionally, we developed a ``Look Back'' strategy to reassess and validate uncertain information, particularly targeting breakpoint mode. MM-Screenplayer achieved highest score in the CVPR'2024 LOng-form VidEo Understanding (LOVEU) Track 1 Challenge, with a global accuracy of 87.5% and a breakpoint accuracy of 68.8%.


title: High Fidelity Text-to-Speech Via Discrete Tokens Using Token Transducer and Group Masked Language Model

abstract: We propose a novel two-stage text-to-speech (TTS) framework with two types of discrete tokens, i.e., semantic and acoustic tokens, for high-fidelity speech synthesis. It features two core components: the Interpreting module, which processes text and a speech prompt into semantic tokens focusing on linguistic contents and alignment, and the Speaking module, which captures the timbre of the target voice to generate acoustic tokens from semantic tokens, enriching speech reconstruction. The Interpreting stage employs a transducer for its robustness in aligning text to speech. In contrast, the Speaking stage utilizes a Conformer-based architecture integrated with a Grouped Masked Language Model (G-MLM) to boost computational efficiency. Our experiments verify that this innovative structure surpasses the conventional models in the zero-shot scenario in terms of speech quality and speaker similarity.


title: Operator splitting for coupled linear port-Hamiltonian systems

abstract: Operator splitting methods tailored to coupled linear port-Hamiltonian systems are developed. We present algorithms that are able to exploit scalar coupling, as well as multirate potential of these coupled systems. The obtained algorithms preserve the dissipative structure of the overall system and are convergent of second order. Numerical results for coupled mass-spring-damper chains illustrate the computational efficiency of the splitting methods compared to a straight-forward application of the implicit midpoint rule to the overall system.


title: Not All Preference Pairs Are Created Equal: A Recipe for Annotation-Efficient Iterative Preference Learning

abstract: Iterative preference learning, though yielding superior performances, requires online annotated preference labels. In this work, we study strategies to select worth-annotating response pairs for cost-efficient annotation while achieving competitive or even better performances compared with the random selection baseline for iterative preference learning. Built on assumptions regarding uncertainty and distribution shifts, we propose a comparative view to rank the implicit reward margins as predicted by DPO to select the response pairs that yield more benefits. Through extensive experiments, we show that annotating those response pairs with small margins is generally better than large or random, under both single- and multi-iteration scenarios. Besides, our empirical results suggest allocating more annotation budgets in the earlier iterations rather than later across multiple iterations.


title: Modelling and Hovering Stabilisation of a Free-Rotating Wing UAV

abstract: We propose a multibody model of a freewing UAV. This model allows obtaining simulations of the UAV's behaviour and, in the future, to design a control law stabilising the entire flight envelope (hovering and forward flight). We also describe the realisation of a prototype and a comparison of possible methods for estimating the UAV's states. With this prototype, we report on experimental hovering flights with a non-linear incremental dynamic inversion controller to stabilise the wing and a proportional derivative controller for the fuselage stabilization.


title: Consistent Spectrogram Separation from Nonstationary Mixture

abstract: We present a spectrogram separation method tailored for mixtures comprising two nonstationary components. By exploiting the unique characteristics of their time-frequency representations, we propose an inverse problem formulation to estimate the spectrograms of the components. We then introduce an alternating optimization algorithm that ensures the consistency of the estimated spectrograms. The efficacy of the algorithm is evaluated through testing on synthetic mixtures and is applied to a bioacoustic signal.


title: Games with backtracking options corresponding to the ordinal analysis of $PA$

abstract: We give another proof of ordinal analysis of $I\Sigma_{k}$-fragments of Peano Arithmetic which is free from cut-elimination of $\omega$-logic. Our main tool is a direct witnessing argument utilizing game notion, motivated from the realm of proof complexity and bounded arithmetic.


title: A review of unsupervised learning in astronomy

abstract: This review summarizes popular unsupervised learning methods, and gives an overview of their past, current, and future uses in astronomy. Unsupervised learning aims to organise the information content of a dataset, in such a way that knowledge can be extracted. Traditionally this has been achieved through dimensionality reduction techniques that aid the ranking of a dataset, for example through principal component analysis or by using auto-encoders, or simpler visualisation of a high dimensional space, for example through the use of a self organising map. Other desirable properties of unsupervised learning include the identification of clusters, i.e. groups of similar objects, which has traditionally been achieved by the k-means algorithm and more recently through density-based clustering such as HDBSCAN. More recently, complex frameworks have emerged, that chain together dimensionality reduction and clustering methods. However, no dataset is fully unknown. Thus, nowadays a lot of research has been directed towards self-supervised and semi-supervised methods that stand to gain from both supervised and unsupervised learning.


title: Continuous-time optimal control for trajectory planning under uncertainty

abstract: This paper presents a continuous-time optimal control framework for the generation of reference trajectories in driving scenarios with uncertainty. A previous work presented a discrete-time stochastic generator for autonomous vehicles; those results are extended to continuous time to ensure the robustness of the generator in a real-time setting. We show that the stochastic model in continuous time can capture the uncertainty of information by producing better results, limiting the risk of violating the problem's constraints compared to a discrete approach. Dynamic solvers provide faster computation and the continuous-time model is more robust to a wider variety of driving scenarios than the discrete-time model, as it can handle further time horizons, which allows trajectory planning outside the framework of urban driving scenarios.


title: Model Uncertainty in Latent Gaussian Models with Univariate Link Function

abstract: We consider a class of latent Gaussian models with a univariate link function (ULLGMs). These are based on standard likelihood specifications (such as Poisson, Binomial, Bernoulli, Erlang, etc.) but incorporate a latent normal linear regression framework on a transformation of a key scalar parameter. We allow for model uncertainty regarding the covariates included in the regression. The ULLGM class typically accommodates extra dispersion in the data and has clear advantages for deriving theoretical properties and designing computational procedures. We formally characterize posterior existence under a convenient and popular improper prior and propose an efficient Markov chain Monte Carlo algorithm for Bayesian model averaging in ULLGMs. Simulation results suggest that the framework provides accurate results that are robust to some degree of misspecification. The methodology is successfully applied to measles vaccination coverage data from Ethiopia and to data on bilateral migration flows between OECD countries.


title: DMF-Net: Image-Guided Point Cloud Completion with Dual-Channel Modality Fusion and Shape-Aware Upsampling Transformer

abstract: In this paper we study the task of a single-view image-guided point cloud completion. Existing methods have got promising results by fusing the information of image into point cloud explicitly or implicitly. However, given that the image has global shape information and the partial point cloud has rich local details, We believe that both modalities need to be given equal attention when performing modality fusion. To this end, we propose a novel dual-channel modality fusion network for image-guided point cloud completion(named DMF-Net), in a coarse-to-fine manner. In the first stage, DMF-Net takes a partial point cloud and corresponding image as input to recover a coarse point cloud. In the second stage, the coarse point cloud will be upsampled twice with shape-aware upsampling transformer to get the dense and complete point cloud. Extensive quantitative and qualitative experimental results show that DMF-Net outperforms the state-of-the-art unimodal and multimodal point cloud completion works on ShapeNet-ViPC dataset.


title: Relaxed Multi-Tx DDM Online Calibration

abstract: In multiple-input and multiple-output (MIMO) radar systems based on Doppler-division multiplexing (DDM), phase shifters are employed in the transmit paths and require calibration strategies to maintain optimal performance all along the radar system's life cycle. In this paper, we propose a novel family of DDM codes that enable an online calibration of the phase shifters that scale realistically to any number of simultaneously activated transmit (Tx)-channels during the calibration frames. To achieve this goal we employ the previously developed odd-DDM (ODDM) sequences to design calibration DDM codes with reduced inter-Tx leakage. The proposed calibration sequence is applied to an automotive radar data set modulated with erroneous phase shifters.


title: Shortcut to adiabaticity improvement of STIRAP based qubit rotation

abstract: Robust quantum control is essential for the development of quantum computers, which rely on precise manipulation of qubits. One form of quantum control is stimulated Raman adiabatic passage (STIRAP), which ordinarily is a state transfer protocol but was extended by Kis and Renzoni (Phys. Rev. A 65, 032318 (2002)) to perform qubit rotations. Shortcut methods to adiabaticity for STIRAP have been shown to speed up adiabatic processes, beyond the adiabatic criterion, with high fidelity. Here, we apply shortcut to adiabaticity methods to the STIRAP qubit rotation scheme to improve the performance of quantum logic gates. The scheme can be implemented via direct connections between ground states in a 4-level $\Lambda$ system or effective connections in a 5-level $\Lambda$ system with modified pulses that implement transitionless quantum driving via the addition of a counterdiabatic driving term. We show that the extended shortcut to adiabaticity method serves to improve the fidelity of qubit rotations in the diabatic regime.


title: ALPBench: A Benchmark for Active Learning Pipelines on Tabular Data

abstract: In settings where only a budgeted amount of labeled data can be afforded, active learning seeks to devise query strategies for selecting the most informative data points to be labeled, aiming to enhance learning algorithms' efficiency and performance. Numerous such query strategies have been proposed and compared in the active learning literature. However, the community still lacks standardized benchmarks for comparing the performance of different query strategies. This particularly holds for the combination of query strategies with different learning algorithms into active learning pipelines and examining the impact of the learning algorithm choice. To close this gap, we propose ALPBench, which facilitates the specification, execution, and performance monitoring of active learning pipelines. It has built-in measures to ensure evaluations are done reproducibly, saving exact dataset splits and hyperparameter settings of used algorithms. In total, ALPBench consists of 86 real-world tabular classification datasets and 5 active learning settings, yielding 430 active learning problems. To demonstrate its usefulness and broad compatibility with various learning algorithms and query strategies, we conduct an exemplary study evaluating 9 query strategies paired with 8 learning algorithms in 2 different settings. We provide ALPBench here: https://github.com/ValentinMargraf/ActiveLearningPipelines.


title: XAMI -- A Benchmark Dataset for Artefact Detection in XMM-Newton Optical Images

abstract: Reflected or scattered light produce artefacts in astronomical observations that can negatively impact the scientific study. Hence, automated detection of these artefacts is highly beneficial, especially with the increasing amounts of data gathered. Machine learning methods are well-suited to this problem, but currently there is a lack of annotated data to train such approaches to detect artefacts in astronomical observations. In this work, we present a dataset of images from the XMM-Newton space telescope Optical Monitoring camera showing different types of artefacts. We hand-annotated a sample of 1000 images with artefacts which we use to train automated ML methods. We further demonstrate techniques tailored for accurate detection and masking of artefacts using instance segmentation. We adopt a hybrid approach, combining knowledge from both convolutional neural networks (CNNs) and transformer-based models and use their advantages in segmentation. The presented method and dataset will advance artefact detection in astronomical observations by providing a reproducible baseline. All code and data are made available (https://github.com/ESA-Datalabs/XAMI-model and https://github.com/ESA-Datalabs/XAMI-dataset).


title: Delving into the Utilisation of ChatGPT in Scientific Publications in Astronomy

abstract: Rapid progress in the capabilities of machine learning approaches in natural language processing has culminated in the rise of large language models over the last two years. Recent works have shown unprecedented adoption of these for academic writing, especially in some fields, but their pervasiveness in astronomy has not been studied sufficiently. To remedy this, we extract words that ChatGPT uses more often than humans when generating academic text and search a total of 1 million articles for them. This way, we assess the frequency of word occurrence in published works in astronomy tracked by the NASA Astrophysics Data System since 2000. We then perform a statistical analysis of the occurrences. We identify a list of words favoured by ChatGPT and find a statistically significant increase for these words against a control group in 2024, which matches the trend in other disciplines. These results suggest a widespread adoption of these models in the writing of astronomy papers. We encourage organisations, publishers, and researchers to work together to identify ethical and pragmatic guidelines to maximise the benefits of these systems while maintaining scientific rigour.


title: AI Tool Use and Adoption in Software Development by Individuals and Organizations: A Grounded Theory Study

abstract: AI assistance tools such as ChatGPT, Copilot, and Gemini have dramatically impacted the nature of software development in recent years. Numerous studies have studied the positive benefits that practitioners have achieved from using these tools in their work. While there is a growing body of knowledge regarding the usability aspects of leveraging AI tools, we still lack concrete details on the issues that organizations and practitioners need to consider should they want to explore increasing adoption or use of AI tools. In this study, we conducted a mixed methods study involving interviews with 26 industry practitioners and 395 survey respondents. We found that there are several motives and challenges that impact individuals and organizations and developed a theory of AI Tool Adoption. For example, we found creating a culture of sharing of AI best practices and tips as a key motive for practitioners' adopting and using AI tools. In total, we identified 2 individual motives, 4 individual challenges, 3 organizational motives, and 3 organizational challenges, and 3 interleaved relationships. The 3 interleaved relationships act in a push-pull manner where motives pull practitioners to increase the use of AI tools and challenges push practitioners away from using AI tools.


title: The State-Action-Reward-State-Action Algorithm in Spatial Prisoner's Dilemma Game

abstract: Cooperative behavior is prevalent in both human society and nature. Understanding the emergence and maintenance of cooperation among self-interested individuals remains a significant challenge in evolutionary biology and social sciences. Reinforcement learning (RL) provides a suitable framework for studying evolutionary game theory as it can adapt to environmental changes and maximize expected benefits. In this study, we employ the State-Action-Reward-State-Action (SARSA) algorithm as the decision-making mechanism for individuals in evolutionary game theory. Initially, we apply SARSA to imitation learning, where agents select neighbors to imitate based on rewards. This approach allows us to observe behavioral changes in agents without independent decision-making abilities. Subsequently, SARSA is utilized for primary agents to independently choose cooperation or betrayal with their neighbors. We evaluate the impact of SARSA on cooperation rates by analyzing variations in rewards and the distribution of cooperators and defectors within the network.


title: Quantum correlation of Hawking radiations for mass-superposed BTZ black holes

abstract: Recent studies using the Unruh-DeWitt detector model have revealed the quantum signatures of black hole mass superposition. In this paper, we use the equal-time density-density correlation function to reinvestigate the mass superposition of BTZ black holes. Interestingly, the quantum signatures of BTZ black hole mass superposition can be revealed by the equal-time density-density correlation peaks. Additionally, different mass superpositions for the same mass ratio can be distinguished, a phenomenon not previously documented. Specifically, the correlation function method can pinpoint the location where Hawking radiations are generated, even for mass-superposed BTZ black holes. Our findings indicate that this location is approximately at two and a half times the radius of the horizon, where the correlation function reaches its maximum.This supports the concept of a quantum atmosphere as the origin locus of Hawking radiation,even in quantum-superposed spacetimes.


title: Dual-Space Knowledge Distillation for Large Language Models

abstract: Knowledge distillation (KD) is known as a promising solution to compress large language models (LLMs) via transferring their knowledge to smaller models. During this process, white-box KD methods usually minimize the distance between the output distributions of the two models so that more knowledge can be transferred. However, in the current white-box KD framework, the output distributions are from the respective output spaces of the two models, using their own prediction heads. We argue that the space discrepancy will lead to low similarity between the teacher model and the student model on both representation and distribution levels. Furthermore, this discrepancy also hinders the KD process between models with different vocabularies, which is common for current LLMs. To address these issues, we propose a dual-space knowledge distillation (DSKD) framework that unifies the output spaces of the two models for KD. On the basis of DSKD, we further develop a cross-model attention mechanism, which can automatically align the representations of the two models with different vocabularies. Thus, our framework is not only compatible with various distance functions for KD (e.g., KL divergence) like the current framework, but also supports KD between any two LLMs regardless of their vocabularies. Experiments on task-agnostic instruction-following benchmarks show that DSKD significantly outperforms the current white-box KD framework with various distance functions, and also surpasses existing KD methods for LLMs with different vocabularies.


title: Speaker-Independent Acoustic-to-Articulatory Inversion through Multi-Channel Attention Discriminator

abstract: We present a novel speaker-independent acoustic-to-articulatory inversion (AAI) model, overcoming the limitations observed in conventional AAI models that rely on acoustic features derived from restricted datasets. To address these challenges, we leverage representations from a pre-trained self-supervised learning (SSL) model to more effectively estimate the global, local, and kinematic pattern information in Electromagnetic Articulography (EMA) signals during the AAI process. We train our model using an adversarial approach and introduce an attention-based Multi-duration phoneme discriminator (MDPD) designed to fully capture the intricate relationship among multi-channel articulatory signals. Our method achieves a Pearson correlation coefficient of 0.847, marking state-of-the-art performance in speaker-independent AAI models. The implementation details and code can be found online.


title: Essential connectivity and spectral radius of graphs

abstract: A graph is trivial if it contains one vertex and no edges. The essential connectivity $\kappa^{\prime}$ of $G$ is defined to be the minimum number of vertices of $G$ whose removal produces a disconnected graph with at least two non-trivial components. Let $\mathcal{A}_n^{\kappa',\delta}$ be the set of graphs of order $n$ with minimum degree $\delta$ and essential connectivity $\kappa'$. In this paper, we determine the graphs attaining the maximum spectral radii among all graphs in $\mathcal{A}_n^{\kappa',\delta}$ and characterize the corresponding extremal graphs. In addition, we also determine the digraphs which achieve the maximum spectral radii among all strongly connected digraphs with given essential connectivity and give the exact values of the spectral radii of these digraphs.


title: Spinor-Helicity Varieties

abstract: The spinor-helicity formalism in particle physics gives rise to natural subvarieties in the product of two Grassmannians. These include two-step flag varieties for subspaces of complementary dimension. Taking Hadamard products leads to Mandelstam varieties. We study these varieties through the lens of combinatorics and commutative algebra, and we explore their tropicalization, positive geometry, and scattering correspondence.


title: The California Legacy Survey V. Chromospheric Activity Cycles in Main Sequence Stars

abstract: We present optical spectroscopy of 710 solar neighborhood stars collected over twenty years to catalog chromospheric activity and search for stellar activity cycles. The California Legacy Survey stars are amenable to exoplanet detection using precise radial velocities, and we present their Ca II H and K time series as a proxy for stellar and chromospheric activity. Using the HIRES spectrometer at Keck Observatory, we measured stellar flux in the cores of the Ca II H and K lines to determine S-values on the Mt. Wilson scale and the log(R'HK) metric, which is comparable across a wide range of spectral types. From the 710 stars, with 52,372 observations, 285 stars are sufficiently sampled to search for stellar activity cycles with periods of 2-25 years, and 138 stars show stellar cycles of varying length and amplitude. S-values can be used to mitigate stellar activity in the detection and characterization of exoplanets. We use them to probe stellar dynamos and to place the Sun's magnetic activity into context among solar neighborhood stars. Using precise stellar parameters and time-averaged activity measurements, we find tightly constrained cycle periods as a function of stellar temperature between log(R'HK) of -4.7 and -4.9, a range of activity in which nearly every star has a periodic cycle. These observations present the largest sample of spectroscopically determined stellar activity cycles to date.


title: Task Adaptation in Industrial Human-Robot Interaction: Leveraging Riemannian Motion Policies

abstract: In real-world industrial environments, modern robots often rely on human operators for crucial decision-making and mission synthesis from individual tasks. Effective and safe collaboration between humans and robots requires systems that can adjust their motion based on human intentions, enabling dynamic task planning and adaptation. Addressing the needs of industrial applications, we propose a motion control framework that (i) removes the need for manual control of the robot's movement; (ii) facilitates the formulation and combination of complex tasks; and (iii) allows the seamless integration of human intent recognition and robot motion planning. For this purpose, we leverage a modular and purely reactive approach for task parametrization and motion generation, embodied by Riemannian Motion Policies. The effectiveness of our method is demonstrated, evaluated, and compared to \remove{state-of-the-art approaches}\add{a representative state-of-the-art approach} in experimental scenarios inspired by realistic industrial Human-Robot Interaction settings.


title: Joint Admission Control and Resource Allocation of Virtual Network Embedding via Hierarchical Deep Reinforcement Learning

abstract: As an essential resource management problem in network virtualization, virtual network embedding (VNE) aims to allocate the finite resources of physical network to sequentially arriving virtual network requests (VNRs) with different resource demands. Since this is an NP-hard combinatorial optimization problem, many efforts have been made to provide viable solutions. However, most existing approaches have either ignored the admission control of VNRs, which has a potential impact on long-term performances, or not fully exploited the temporal and topological features of the physical network and VNRs. In this paper, we propose a deep Hierarchical Reinforcement Learning approach to learn a joint Admission Control and Resource Allocation policy for VNE, named HRL-ACRA. Specifically, the whole VNE process is decomposed into an upper-level policy for deciding whether to admit the arriving VNR or not and a lower-level policy for allocating resources of the physical network to meet the requirement of VNR through the HRL approach. Considering the proximal policy optimization as the basic training algorithm, we also adopt the average reward method to address the infinite horizon problem of the upper-level agent and design a customized multi-objective intrinsic reward to alleviate the sparse reward issue of the lower-level agent. Moreover, we develop a deep feature-aware graph neural network to capture the features of VNR and physical network and exploit a sequence-to-sequence model to generate embedding actions iteratively. Finally, extensive experiments are conducted in various settings, and show that HRL-ACRA outperforms state-of-the-art baselines in terms of both the acceptance ratio and long-term average revenue. Our code is available at \url{https://github.com/GeminiLight/hrl-acra}.


title: A Thorough Performance Benchmarking on Lightweight Embedding-based Recommender Systems

abstract: Since the creation of the Web, recommender systems (RSs) have been an indispensable mechanism in information filtering. State-of-the-art RSs primarily depend on categorical features, which ecoded by embedding vectors, resulting in excessively large embedding tables. To prevent over-parameterized embedding tables from harming scalability, both academia and industry have seen increasing efforts in compressing RS embeddings. However, despite the prosperity of lightweight embedding-based RSs (LERSs), a wide diversity is seen in evaluation protocols, resulting in obstacles when relating LERS performance to real-world usability. Moreover, despite the common goal of lightweight embeddings, LERSs are evaluated with a single choice between the two main recommendation tasks -- collaborative filtering and content-based recommendation. This lack of discussions on cross-task transferability hinders the development of unified, more scalable solutions. Motivated by these issues, this study investigates various LERSs' performance, efficiency, and cross-task transferability via a thorough benchmarking process. Additionally, we propose an efficient embedding compression method using magnitude pruning, which is an easy-to-deploy yet highly competitive baseline that outperforms various complex LERSs. Our study reveals the distinct performance of LERSs across the two tasks, shedding light on their effectiveness and generalizability. To support edge-based recommendations, we tested all LERSs on a Raspberry Pi 4, where the efficiency bottleneck is exposed. Finally, we conclude this paper with critical summaries of LERS performance, model selection suggestions, and underexplored challenges around LERSs for future research. To encourage future research, we publish source codes and artifacts at \href{this link}{https://github.com/chenxing1999/recsys-benchmark}.


title: Three-Dimensional Spin TFTs from Gauging Line Defects

abstract: From the input of an oriented three-dimensional TFT with framed line defects and a commutative $\Delta$-separable Frobenius algebra $A$ in the ribbon category of these line defects, we construct a three-dimensional spin TFT. The framed line defects of the spin TFT are labelled by certain equivariant modules over $A$, and the spin structure may or may not extend to a given line defect. Physically the spin TFT can be interpreted as the result of gauging a one-form symmetry in the original oriented TFT. This spin TFT extends earlier constructions in Blanchet-Masbaum (1996) and Blanchet (2005) [arXiv:math/0303240], and it reproduces the classification of abelian spin Chern-Simons theories in Belov-Moore (2005) [arXiv:hep-th/0505235].


title: Robust Pareto Design of GaN HEMTs for Millimeter-Wave Applications

abstract: This paper introduces a robust Pareto design approach for selecting Gallium Nitride (GaN) High Electron Mobility Transistors (HEMTs), particularly for power amplifier (PA) and low-noise amplifier (LNA) designs in 5G applications. We consider five key design variables and two settings (PAs and LNAs) where we have multiple objectives. We assess designs based on three critical objectives, evaluating each by its worst-case performance across a range of Gate-Source Voltages ($V_{\text{GS}}$). We conduct simulations across a range of $V_{\text{GS}}$ values to ensure a thorough and robust analysis. For PAs, the optimization goals are to maximize the worst-case modulated average output power ($P_{\text{out,avg}}$) and power-added efficiency ($PAE_{\text{avg}}$) while minimizing the worst-case average junction temperature ($T_{\text{j,avg}}$) under a modulated 64-QAM signal stimulus. In contrast, for LNAs, the focus is on maximizing the worst-case maximum oscillation frequency ($f_{\text{max}}$) and Gain, and minimizing the worst-case minimum noise figure ($NF_{\text{min}}$). We utilize a derivative-free optimization method to effectively identify robust Pareto optimal device designs. This approach enhances our comprehension of the trade-off space, facilitating more informed decision-making. Furthermore, this method is general across different applications. Although it does not guarantee a globally optimal design, we demonstrate its effectiveness in GaN device sizing. The primary advantage of this method is that it enables the attainment of near-optimal or even optimal designs with just a fraction of the simulations required for an exhaustive full-grid search.


title: Robustly Optimized Deep Feature Decoupling Network for Fatty Liver Diseases Detection

abstract: Current medical image classification efforts mainly aim for higher average performance, often neglecting the balance between different classes. This can lead to significant differences in recognition accuracy between classes and obvious recognition weaknesses. Without the support of massive data, deep learning faces challenges in fine-grained classification of fatty liver. In this paper, we propose an innovative deep learning framework that combines feature decoupling and adaptive adversarial training. Firstly, we employ two iteratively compressed decouplers to supervised decouple common features and specific features related to fatty liver in abdominal ultrasound images. Subsequently, the decoupled features are concatenated with the original image after transforming the color space and are fed into the classifier. During adversarial training, we adaptively adjust the perturbation and balance the adversarial strength by the accuracy of each class. The model will eliminate recognition weaknesses by correctly classifying adversarial samples, thus improving recognition robustness. Finally, the accuracy of our method improved by 4.16%, achieving 82.95%. As demonstrated by extensive experiments, our method is a generalized learning framework that can be directly used to eliminate the recognition weaknesses of any classifier while improving its average performance. Code is available at https://github.com/HP-ML/MICCAI2024.


title: Optimizing Configuration Selection in Reconfigurable-Antenna MIMO Systems: Physics-Inspired Heuristic Solvers

abstract: Reconfigurable antenna multiple-input multiple-output (MIMO) is a foundational technology for the continuing evolution of cellular systems, including upcoming 6G communication systems. In this paper, we address the problem of flexible/reconfigurable antenna configuration selection for point-to-point MIMO antenna systems by using physics-inspired heuristics. Firstly, we optimize the antenna configuration to maximize the signal-to-noise ratio (SNR) at the receiver by leveraging two basic heuristic solvers, i.e., coherent Ising machines (CIMs), that mimic quantum mechanical dynamics, and quantum annealing (QA), where a real-world QA architecture is considered (D-Wave). A mathematical framework that converts the configuration selection problem into CIM- and QA- compatible unconstrained quadratic formulations is investigated. Numerical and experimental results show that the proposed designs outperform classical counterparts and achieve near-optimal performance (similar to exhaustive search with exponential complexity) while ensuring polynomial complexity. Moreover, we study the optimal antenna configuration that maximizes the end-to-end Shannon capacity. A simulated annealing (SA) heuristic which achieves near-optimal performance through appropriate parameterization is adopted. A modified version of the basic SA that exploits parallel tempering to avoid local maxima is also studied, which provides additional performance gains. Extended numerical studies show that the SA solutions outperform conventional heuristics (which are also developed for comparison purposes), while the employment of the SNR-based solutions is highly sub-optimal.


title: Two Dynamically Discovered Compact Object Candidate Binary Systems from LAMOST Low-resolution Survey

abstract: We report two binary systems, LAMOST J035540+381550 (hereafter J035540) and LAMOST J035916+400732 (hereafter J035916), identified through the Large Sky Area Multi-Object Fiber Spectroscopic Telescope (LAMOST) low-resolution survey (LRS). Each of these two systems contains an M-type star orbiting with a invisible compact object candidate. Follow-up spectroscopic observations of Palomar 200-inch telescope (P200) enhance radial velocity measurements. We use radial velocities from LAMOST and P200, as well as light curves from Zwicky Transient Facility (ZTF) to constrain orbital parameters. The masses of the visible M-type stars are estimated by fitting the MIST isochrones and SEDs. The mass functions for the unseen companions are: $0.22\pm 0.01 M_{\odot}$ for J035540 and $0.16\pm 0.01 M_{\odot}$ for J035916. With the orbital and stellar parameters derived above and assuming the orbital inclination is 90 degree (edge-on), we find that the minimum masses of the invisible companions exceeds that of the visible stars. The single-lined feature and the dynamical evidence suggest the presence of compact objects. J035540's ZTF light curve, modeled with PHOEBE, yields a compact object mass of $0.70^{+0.12}_{-0.05} M_{\odot}$. For J035916, ellipsoidal modulation analysis constrains the light curve amplitude, yielding a compact object mass range of $0.57-0.90 M_{\odot}$. The mass estimates indicate that both are likely white dwarfs. These findings underscore the efficiency of optical time-domain surveys and dynamical methods in identifying faint, massive white dwarfs, along with other compact objects in binaries.


title: Generative Modelling of Structurally Constrained Graphs

abstract: Graph diffusion models have emerged as state-of-the-art techniques in graph generation, yet integrating domain knowledge into these models remains challenging. Domain knowledge is particularly important in real-world scenarios, where invalid generated graphs hinder deployment in practical applications. Unconstrained and conditioned graph generative models fail to guarantee such domain-specific structural properties. We present ConStruct, a novel framework that allows for hard-constraining graph diffusion models to incorporate specific properties, such as planarity or acyclicity. Our approach ensures that the sampled graphs remain within the domain of graphs that verify the specified property throughout the entire trajectory in both the forward and reverse processes. This is achieved by introducing a specific edge-absorbing noise model and a new projector operator. ConStruct demonstrates versatility across several structural and edge-deletion invariant constraints and achieves state-of-the-art performance for both synthetic benchmarks and attributed real-world datasets. For example, by leveraging planarity in digital pathology graph datasets, the proposed method outperforms existing baselines and enhances generated data validity by up to 71.1 percentage points.


title: Masked Generative Extractor for Synergistic Representation and 3D Generation of Point Clouds

abstract: In the field of 2D image generation modeling and representation learning, Masked Generative Encoder (MAGE) has demonstrated the synergistic potential between generative modeling and representation learning. Inspired by this, we propose Point-MAGE to extend this concept to point cloud data. Specifically, this framework first utilizes a Vector Quantized Variational Autoencoder (VQVAE) to reconstruct a neural field representation of 3D shapes, thereby learning discrete semantic features of point patches. Subsequently, by combining the masking model with variable masking ratios, we achieve synchronous training for both generation and representation learning. Furthermore, our framework seamlessly integrates with existing point cloud self-supervised learning (SSL) models, thereby enhancing their performance. We extensively evaluate the representation learning and generation capabilities of Point-MAGE. In shape classification tasks, Point-MAGE achieved an accuracy of 94.2% on the ModelNet40 dataset and 92.9% (+1.3%) on the ScanObjectNN dataset. Additionally, it achieved new state-of-the-art performance in few-shot learning and part segmentation tasks. Experimental results also confirmed that Point-MAGE can generate detailed and high-quality 3D shapes in both unconditional and conditional settings.


title: Q-DiT: Accurate Post-Training Quantization for Diffusion Transformers

abstract: Recent advancements in diffusion models, particularly the trend of architectural transformation from UNet-based Diffusion to Diffusion Transformer (DiT), have significantly improved the quality and scalability of image synthesis. Despite the incredible generative quality, the large computational requirements of these large-scale models significantly hinder the deployments in real-world scenarios. Post-training Quantization (PTQ) offers a promising solution by compressing model sizes and speeding up inference for the pretrained models while eliminating model retraining. However, we have observed the existing PTQ frameworks exclusively designed for both ViT and conventional Diffusion models fall into biased quantization and result in remarkable performance degradation. In this paper, we find that the DiTs typically exhibit considerable variance in terms of both weight and activation, which easily runs out of the limited numerical representations. To address this issue, we devise Q-DiT, which seamlessly integrates three techniques: fine-grained quantization to manage substantial variance across input channels of weights and activations, an automatic search strategy to optimize the quantization granularity and mitigate redundancies, and dynamic activation quantization to capture the activation changes across timesteps. Extensive experiments on the ImageNet dataset demonstrate the effectiveness of the proposed Q-DiT. Specifically, when quantizing DiT-XL/2 to W8A8 on ImageNet 256x256, Q-DiT achieves a remarkable reduction in FID by 1.26 compared to the baseline. Under a W4A8 setting, it maintains high fidelity in image generation, showcasing only a marginal increase in FID and setting a new benchmark for efficient, high-quality quantization in diffusion transformers. Code is available at \href{https://github.com/Juanerx/Q-DiT}{https://github.com/Juanerx/Q-DiT}.


title: Recurrence and transience for non-Archimedean and directed graphs

abstract: We introduce the notion of recurrence and transience for graphs over non-Archimedean ordered field. To do so we relate these graphs to random walks of directed graphs over the reals. In particular, we give a characterization of the real directed graphs which can arise is such a way. As a main result, we give characterization for recurrence and transience in terms of a quantity related to the capacity.

categories: math.CO math-ph math.AP math.MP math.PR math.SP


title: NerfBaselines: Consistent and Reproducible Evaluation of Novel View Synthesis Methods

abstract: Novel view synthesis is an important problem with many applications, including AR/VR, gaming, and simulations for robotics. With the recent rapid development of Neural Radiance Fields (NeRFs) and 3D Gaussian Splatting (3DGS) methods, it is becoming difficult to keep track of the current state of the art (SoTA) due to methods using different evaluation protocols, codebases being difficult to install and use, and methods not generalizing well to novel 3D scenes. Our experiments support this claim by showing that tiny differences in evaluation protocols of various methods can lead to inconsistent reported metrics. To address these issues, we propose a framework called NerfBaselines, which simplifies the installation of various methods, provides consistent benchmarking tools, and ensures reproducibility. We validate our implementation experimentally by reproducing numbers reported in the original papers. To further improve the accessibility, we release a web platform where commonly used methods are compared on standard benchmarks. Web: https://jkulhanek.com/nerfbaselines


title: Stacked Confusion Reject Plots (SCORE)

abstract: Machine learning is more and more applied in critical application areas like health and driver assistance. To minimize the risk of wrong decisions, in such applications it is necessary to consider the certainty of a classification to reject uncertain samples. An established tool for this are reject curves that visualize the trade-off between the number of rejected samples and classification performance metrics. We argue that common reject curves are too abstract and hard to interpret by non-experts. We propose Stacked Confusion Reject Plots (SCORE) that offer a more intuitive understanding of the used data and the classifier's behavior. We present example plots on artificial Gaussian data to document the different options of SCORE and provide the code as a Python package.


title: Hubble Space Telescope proper motions of Large Magellanic Cloud star clusters -- I. Catalogues and results for NGC 1850

abstract: We present proper motion (PM) measurements for a sample of 23 massive star clusters within the Large Magellanic Cloud using multi-epoch data from the Hubble Space Telescope (HST). We combined archival data from the ACS/WFC and WFC3/UVIS instruments with observations from a dedicated HST programme, resulting in time baselines between 4.7 and 18.2 yr available for PM determinations. For bright well-measured stars, we achieved nominal PM precisions of 55 $\mu$as/yr down to 11 $\mu$as/yr . To demonstrate the potential and limitations of our PM data set, we analysed the cluster NGC 1850 and showcase a selection of different science applications. The precision of the PM measurements allows us to disentangle the kinematics of the various stellar populations that are present in the HST field. The cluster has a centre-of-mass motion that is different from the surrounding old field stars and also differs from the mean motion of a close-by group of very young stars. We determined the velocity dispersion of field stars to be 0.128 +/- 0.003 mas/yr (corresponding to 30.3 +/- 0.7 km/s). The velocity dispersion of the cluster inferred from the PM data set most probably overestimates the true value, suggesting that the precision of the measurements at this stage is not sufficient for a reliable analysis of the internal kinematics of extra-galactic star clusters. Finally, we exploit the PM-cleaned catalogue of likely cluster members to determine any radial segregation between fast and slowly-rotating stars, finding that the former are more centrally concentrated. With this paper, we also release the astro-photometric catalogues for each cluster.


title: Exact controllability to eigensolutions of the heat equation via bilinear controls on two-dimensional domains

abstract: The exact controllability of heat type equations in the presence of bilinear controls have been successfully studied in the recent works [1,3,14] motivated by the numerous application to engineering, neurobiology, chemistry, and life science. Nevertheless, the result has been only achieved for one-dimensional domains due to limit of the existing techniques. In this work, we develop a new strategy to ensure the so-called exact controllability to the eigensolutions of heat-type equations via bilinear control on the two-dimensional domains. The result is implied by the null-controllability of a suitable linearized equation, and the main novelty of the work is the strategy of its proof. First, the null-controllability in a finite dimensional subspace has to be ensured via the solvability of a suitable moment problem. Explicit bounds on the control cost w.r.t. to the dimension of the controlled space are also required. Second, the controllability can be extended to the whole Hilbert space, thanks to the Lebeau-Robbiano-Miller method, when the control cost does not growth too fast w.r.t to the dimension of the finite dimensional subspace. We firstly develop our techniques in the general case when suitable hypotheses on the problem are verified. Afterwards, we apply our procedure to the bilinear heat equation on rectangular domains, and we ensure its exact controllability to the eigensolutions. Finally, we study the controllability issue on the square and we use perturbation theory techniques to deal with the presence of multiple eigenvalues for the spectrum of the Dirichlet Laplacian.


title: Semantic Deep Hiding for Robust Unlearnable Examples

abstract: Ensuring data privacy and protection has become paramount in the era of deep learning. Unlearnable examples are proposed to mislead the deep learning models and prevent data from unauthorized exploration by adding small perturbations to data. However, such perturbations (e.g., noise, texture, color change) predominantly impact low-level features, making them vulnerable to common countermeasures. In contrast, semantic images with intricate shapes have a wealth of high-level features, making them more resilient to countermeasures and potential for producing robust unlearnable examples. In this paper, we propose a Deep Hiding (DH) scheme that adaptively hides semantic images enriched with high-level features. We employ an Invertible Neural Network (INN) to invisibly integrate predefined images, inherently hiding them with deceptive perturbations. To enhance data unlearnability, we introduce a Latent Feature Concentration module, designed to work with the INN, regularizing the intra-class variance of these perturbations. To further boost the robustness of unlearnable examples, we design a Semantic Images Generation module that produces hidden semantic images. By utilizing similar semantic information, this module generates similar semantic images for samples within the same classes, thereby enlarging the inter-class distance and narrowing the intra-class distance. Extensive experiments on CIFAR-10, CIFAR-100, and an ImageNet subset, against 18 countermeasures, reveal that our proposed method exhibits outstanding robustness for unlearnable examples, demonstrating its efficacy in preventing unauthorized data exploitation.


title: Attainability and criticality for multipolar Rellich inequality

abstract: In this paper we obtain optimal multipolar Rellich inequality for biharmonic Schrodinger operator with positive multi-singular potentials. Moreover, we prove the attainability of the best constant and the criticality of the biharmonic Schrodinger operator.


title: Cavity Modified Oscillating Bound States with a $\Lambda$-type giant emitter in a linear waveguide

abstract: We study a system composed by a three-level giant atom (3GA), a waveguide initially in the vacuum state, and a single-mode cavity. The 3GA-cavity system is in a strong-coupling regime, and the distance between the coupling points is comparable to the coherent length of a spontaneously emitted photon. The dynamics of the 3GA and its radiative field in the waveguide for long time are analyzed. Besides the steady value, we also found an oscillatory character of the excited state population, a signature of oscillating bound states which is generated by the superposition of two bound states in the continuum. The radiative field propagates in the cavity-like geometry formed by the coupling points. When one bound state is emergent, a sine-like interference pattern is visible for the emitted field intensity in spacetime. An oscillatory character in time and a beat in space for the emitted field intensity are observed when two bound states are emergent in a subspace. The wavelengths and the periods are controlled by the number of the photons in the cavity.


title: Development of a digital tool for monitoring the behaviour of pre-weaned calves using accelerometer neck-collars

abstract: Automatic monitoring of calf behaviour is a promising way of assessing animal welfare from their first week on farms. This study aims to (i) develop machine learning models from accelerometer data to classify the main behaviours of pre-weaned calves and (ii) set up a digital tool for monitoring the behaviour of pre-weaned calves from the models' prediction. Thirty pre-weaned calves were equipped with a 3-D accelerometer attached to a neck-collar for two months and filmed simultaneously. The behaviours were annotated, resulting in 27.4 hours of observation aligned with the accelerometer data. The time-series were then split into 3 seconds windows. Two machine learning models were tuned using data from 80% of the calves: (i) a Random Forest model to classify between active and inactive behaviours using a set of 11 hand-craft features [model 1] and (ii) a RidgeClassifierCV model to classify between lying, running, drinking milk and other behaviours using ROCKET features [model 2]. The performance of the models was tested using data from the remaining 20% of the calves. Model 1 achieved a balanced accuracy of 0.92. Model 2 achieved a balanced accuracy of 0.84. Behavioural metrics such as daily activity ratio and episodes of running, lying, drinking milk, and other behaviours expressed over time were deduced from the predictions. All the development was finally embedded into a Python dashboard so that the individual calf metrics could be displayed directly from the raw accelerometer files.


title: Error estimation and step size control with minimal subsystem interfaces

abstract: We review error estimation methods for co-simulation, in particular methods that are applicable when the subsystems provide minimal interfaces. By this, we mean that subsystems do not support rollback of time steps, do not output derivatives, and do not provide any other information about their internals other than the output variables that are required for coupling with other subsystems. Such "black-box" subsystems are quite common in industrial applications, and the ability to couple them and run large-system simulations is one of the major attractions of the co-simulation paradigm. We also describe how the resulting error indicators may be used to automatically control macro time step sizes in order to strike a good balance between simulation speed and accuracy. The various elements of the step size control algorithm are presented in pseudocode so that readers may implement them and test them in their own applications. We provide practicable advice on how to use error indicators to judge the quality of a co-simulation, how to avoid common pitfalls, and how to configure the step size control algorithm.


title: On the correlation between Architectural Smells and Static Analysis Warnings

abstract: Background. Software quality assurance is essential during software development and maintenance. Static Analysis Tools (SAT) are widely used for assessing code quality. Architectural smells are becoming more daunting to address and evaluate among quality issues. Objective. We aim to understand the relationships between static analysis warnings (SAW) and architectural smells (AS) to guide developers/maintainers in focusing their efforts on SAWs more prone to co-occurring with AS. Method. We performed an empirical study on 103 Java projects totaling 72 million LOC belonging to projects from a vast set of domains, and 785 SAW detected by four SAT, Checkstyle, Findbugs, PMD, SonarQube, and 4 architectural smells detected by ARCAN tool. We analyzed how SAWs influence AS presence. Finally, we proposed an AS remediation effort prioritization based on SAW severity and SAW proneness to specific ASs. Results. Our study reveals a moderate correlation between SAWs and ASs. Different combinations of SATs and SAWs significantly affect AS occurrence, with certain SAWs more likely to co-occur with specific ASs. Conversely, 33.79% of SAWs act as "healthy carriers", not associated with any ASs. Conclusion. Practitioners can ignore about a third of SAWs and focus on those most likely to be associated with ASs. Prioritizing AS remediation based on SAW severity or SAW proneness to specific ASs results in effective rankings like those based on AS severity.


title: Local-global principle for over semiglobal fields

abstract: We compare different local-global principles for torsors under a reductive group G defined over a semiglobal field F. In particular if the F-group G s a retract rational F-variety, we prove that the local global principle holds for the completions with respect to divisorial valuations of F.


title: The equations of extended magnetohydrodynamics

abstract: Extended magnetohydrodynamics (XMHD) is a fluid plasma model generalizing ideal MHD by taking into account the impact of Hall drift effects and the influence of electron inertial effects. XMHD has a Hamiltonian structure which has received over the past ten years a great deal of attention among physicists, and which is embodied by a non canonical Poisson algebra on an infinite-dimensional phase space. XMHD can alternatively be formulated as a nonlinear evolution equation. Our aim here is to investigate the corresponding Cauchy problem. We consider both incompressible and compressible versions of XMHD with, in the latter case, some additional bulk (fluid) viscosity. In this context, we show that XMHD can be recast as a well-posed symmetric hyperbolic-parabolic system implying pseudo-differential operators of order zero acting as coefficients and source terms. Along these lines, we can solve locally in time the associated initial value problems, with moreover a minimal Sobolev regularity. We also explain the emergence and propagation of inertial waves.


title: Search for the process $\mathbf{\it e^+e^-\to\eta^{\prime}\gamma}$ in the energy range $\mathbf{\it \sqrt{s}}$ = 1.075 -- 2 GeV

abstract: The results of the search for the $e^+e^-\to\eta^{\prime}\gamma$ process in the center-of-mass energy range from 1.075 to 2 GeV are presented. We analyze data with an integral luminosity of 746 pb$^{-1}$ accumulated with the SND detector at the $e^+e^-$ collider VEPP-2000 in 2010--2024. The $\eta^{\prime}\to\eta\pi^0\pi^0$ decay is used in the analysis, with the subsequent $\eta$ and $\pi^0$ decays into $\gamma\gamma$. Upper limits not exceeding 13 pb have been set on the $e^+e^-\to\eta^{\prime}\gamma$ cross section at the 90\% confidence level.


title: Uniform stability of the damped wave equation with a confining potential in the Euclidean space

abstract: We investigate trend to equilibrium for the damped wave equation with a confining potential in the Euclidean space. We provide with necessary and sufficient geometric conditions for the energy to decay exponentially uniformly. The proofs rely on tools from semiclassical analysis together with the construction of quasimodes of the damped wave operator. In addition to the Geometric Control Condition, which is familiar in the context of compact Riemannian manifolds, our work involves a new geometric condition due to the presence of turning points in the underlying classical dynamics which rules the propagation of waves in the high-energy asymptotics.


title: Classification of 3-Node Restricted Excitatory-Inhibitory Networks

abstract: We classify connected 3-node restricted excitatory-inhibitory networks, extending our previous paper (`Classification of 2-node Excitatory-Inhibitory Networks', Mathematical Biosciences 373 (2024) 109205). We assume that there are two node-types and two arrow-types, excitatory and inhibitory; all excitatory arrows are identical and all inhibitory arrows are identical; and excitatory (resp. inhibitory) nodes can only output excitatory (resp. inhibitory) arrows. The classification is performed under the following two network perspectives: ODE-equivalence and minimality; and valence less or equal to 2. The results of this and the previous work constitute a first step towards analysing dynamics and bifurcations of excitatory-inhibitory networks and have potential applications to biological network models.


title: Non-Orthogonal Reduction for Rendering Fluorescent Materials in Non-Spectral Engines

abstract: We propose a method to accurately handle fluorescence in a non-spectral (\eg, tristimulus) rendering engine, showcasing color-shifting and increased luminance effects. Core to our method is a principled reduction technique that encodes the re-radiation into a low-dimensional matrix working in the space of the renderer's Color Matching Functions (CMFs). Our process is independent of a specific CMF set and allows for the addition of a non-visible ultraviolet band during light transport. Our representation visually matches full spectral light transport for measured fluorescent materials even for challenging illuminants.


title: Tree-based variational inference for Poisson log-normal models

abstract: When studying ecosystems, hierarchical trees are often used to organize entities based on proximity criteria, such as the taxonomy in microbiology, social classes in geography, or product types in retail businesses, offering valuable insights into entity relationships. Despite their significance, current count-data models do not leverage this structured information. In particular, the widely used Poisson log-normal (PLN) model, known for its ability to model interactions between entities from count data, lacks the possibility to incorporate such hierarchical tree structures, limiting its applicability in domains characterized by such complexities. To address this matter, we introduce the PLN-Tree model as an extension of the PLN model, specifically designed for modeling hierarchical count data. By integrating structured variational inference techniques, we propose an adapted training procedure and establish identifiability results, enhancisng both theoretical foundations and practical interpretability. Additionally, we extend our framework to classification tasks as a preprocessing pipeline, showcasing its versatility. Experimental evaluations on synthetic datasets as well as real-world microbiome data demonstrate the superior performance of the PLN-Tree model in capturing hierarchical dependencies and providing valuable insights into complex data structures, showing the practical interest of knowledge graphs like the taxonomy in ecosystems modeling.


title: Charged Wormhole Solutions in 4D Einstein-Gauss-Bonnet Gravity

abstract: In the present work, we construct models of static wormholes within the framework of 4-dimensional Einstein-Gauss-Bonnet (4D EGB) gravity an (an)isotropic energy momentum tensor (EMT) and a Maxwell field as supporting matters for the wormhole geometry assuming a constant redshift function. We obtain exact spherically symmetric wormhole solutions in 4D EGB gravity for an isotropic and anisotropic matter sources under the effect of electric charge. The solutions are more generalized in the sense of incorporating the charge contributions. Furthermore, we examine the null, weak and strong energy conditions at the wormhole throat of radius $r=r_{0}$. We demonstrate that at the wormhole throat, the classical energy conditions are violated by arbitrary small amount. Additionally, we analyze the wormhole geometry incorporating semiclassical corrections through embedding diagrams. We discover that the wormhole solutions are in equilibrium as the anisotropic and hydrostatic forces cancel each other.


title: Leveraging Synthetic Audio Data for End-to-End Low-Resource Speech Translation

abstract: This paper describes our system submission to the International Conference on Spoken Language Translation (IWSLT 2024) for Irish-to-English speech translation. We built end-to-end systems based on Whisper, and employed a number of data augmentation techniques, such as speech back-translation and noise augmentation. We investigate the effect of using synthetic audio data and discuss several methods for enriching signal diversity.


title: Annealing-based approach to solving partial differential equations

abstract: Solving partial differential equations using an annealing-based approach is based on solving generalized eigenvalue problems. When a partial differential equation is discretized, it leads to a system of linear equations (SLE). Solving an SLE can be expressed as a general eigenvalue problem, which can be converted into an optimization problem with the objective function being a generalized Rayleigh quotient. The proposed algorithm allows the computation of eigenvectors at arbitrary precision without increasing the number of variables using an Ising machine. Simple examples solved using this method and theoretical analysis provide a guideline for appropriate parameter settings.

categories: math.NA cond-mat.dis-nn cond-mat.stat-mech cs.NA quant-ph


title: An expression for Riemann Siegel function

abstract: There are many analytic functions $U(t)$ satisfying $Z(t)=2\Re\bigl\{ e^{i\vartheta(t)}U(t)\bigr\}$. Here, we consider an entire function $\mathop{\mathcal L}(s)$ such that $U(t)=\mathop{\mathcal L}(\frac12+it)$ is one of the simplest among them. We obtain an expression for the Riemann-Siegel function $Z(t)$ in terms of the zeros of $\mathop{\mathcal L}(s)$. Implicitly, the function $\mathop{\mathcal L}(s)$ is considered by Riemann in his paper on Number Theory. Riemann spoke of having used an expression for $\Xi(t)$ in his demonstration that most of the non-trivial zeros of the zeta function lie on the critical line. Therefore, any expression deserves a study.


title: Optical and X-ray Photo-emission Spectroscopies of Core/Shell Colloidal CdSe/CdS Quantum Dots: Modeling and Experimental Determination of Band Alignment

abstract: Optical properties of multilayer semi-conductor nano-emitters are crucially dependent on the relative energy levelsof their different components. For core/shell quantum dots, the relative energy difference between conduction bandedge of core and shell materials induces, depending on its value, either a confinement of the electron within the coreor a delocalization of its wave function within the whole quantum dot. This results in drastic consequences on theenergy and the oscillator strength of the fundamental transition. Surprisingly, the literature currently lacks a definitivevalue for the energy difference between CdSe and CdS conduction band edges as most of the experimental studiesprovide values corresponding to specific geometries of quantum dots. Here, we develop a full theoretical modelexpressing energy levels considering core/shell interface pressure, ligands and enabling the accurate prediction ofthe bandgap value with the nanocrystal size. It allows to reliably determine the energy difference between theconduction band edge of CdSe and CdS materials, known as the conduction band offset, in such a way that this valuecan later be used to model quantum dots of any geometry. This value is determined using our model and two differentexperimental methods: optical spectroscopy and X-ray photoemission (XPS) experiments.


title: Chemical Evolution of Complex Organic Molecules in Turbulent Protoplanetary Disks: Effect of stochastic UV irradiation

abstract: We investigate the chemical evolution of complex organic molecules (COMs) in turbulent disks using gas-ice chemical reaction network simulations. We trace trajectories of dust particles considering advection, turbulent diffusion, gas drag, and vertical settling, for 10$^6$ yrs in a protoplanetary disk. Then, we solve a gas-ice chemical reaction network along the trajectories and obtain the temporal evolution of molecular abundances. We find that the COM abundances in particles can differ by more than two orders of magnitude even when the UV fluence (i.e., the time integral of UV flux) received by the particles are similar, suggesting that not only the UV fluence but also the time variation of the UV flux does matter for the evolution of COMs in disks. The impact of UV fluence on molecular abundances differs between oxygen-bearing and nitrogen-bearing COMs. While higher UV fluence results in oxygen being locked into CO$_2$, leading to reduced abundances of oxygen-bearing COMs such as CH$_3$OCH$_3$, mild UV exposure can promote their formation by supplying the precursor radicals. On the other hand, nitrogen is not locked up into specific molecules, allowing the formation of nitrogen-bearing COMs, particularly CH$_3$NH$_2$, even for the particle that receives the higher UV fluence. We also find that the final COM abundances are mostly determined by the inherited abundances from the protostellar core when the UV fluence received by dust particles is less than a critical value, while they are set by both the inherited abundances and the chemistry inside the disk at higher UV fluence.


title: On the total Italian domination number in digraphs

abstract: Consider a finite simple digraph $D$ with vertex set $V(D)$. An Italian dominating function (IDF) on $D$ is a function $f:V(D)\rightarrow\{0,1,2\}$ satisfying every vertex $u$ with $f(u)=0$ has an in-neighbor $v$ with $f(v)=2$ or two in-neighbors $w$ and $z$ with $f(w)=f(z)=1$. A total Italian dominating function (TIDF) on $D$ is an IDF $f$ such that the subdigraph $D[\{ u\, |\, f(u)\ge 1\}]$ contains no isolated vertices. The weight $\omega(f)$ of a TIDF $f$ on $D$ is $\sum_{u\in V(D)}f(u)$. The total Italian domination number of $D$ is $\gamma_{tI}(D)=\min\{ \omega(f)\, |\, \mbox{$f$ is a TIDF on $D$}\}$. In this paper, we present bounds on $\gamma_{tI}(D)$, and investigate the relationship between several different domination parameters. In particular, we give the total Italian domination number of the Cartesian products $P_2\Box P_n$ and $P_3\Box P_n$, where $P_n$ represents a dipath with $n$ vertices.


title: Charge transfer in T/H heterostructures of transition metal dichalcogenides

abstract: The $\sqrt{13}\times\sqrt{13}$ charge density wave state of the T polytype of MX$_2$ (M=Nb,Ta, X=S, Se) is known to host a half-filled flat band, which electronic correlations drive into a Mott insulating state. When T polytypes are coupled to strongly metallic H polytypes, such as in T/H bilayer heterostructures or the bulk 4H$_b$ polytype, charge transfer can destabilize the Mott state, but quantifying its magnitude has been a source of controversy. In this work, we perform a systematic ab-initio study of charge transfer for all experimentally relevant T/H bilayers and bulk 4H$_b$ structures. In all cases we find charge transfer from T to H layers which depends strongly on the interlayer distance but weakly on the Hubbard interaction. Additionally, Se compounds display smaller charge transfer than S compounds, and 4H$_b$ bulk polytypes display more charge transfer than isolated bilayers. We rationalize these findings in terms of band structure properties, and argue they might explain differences between compounds observed experimentally. Our work reveals the tendency to Mott insulation and the origin of superconductivity may vary significantly across the family of T/H heterostructures.


title: An ultrasensitive device with embedded phononic crystals for the detection and localisation of nonlinear guided waves

abstract: In this work, a novel approach for the detection and localisation of nonlinear guided waves often associated with the presence of damage in structural components is proposed. The method is active and consists of a piezoelectric transducer bonded to the inspected structure exciting a narrow frequency band wave packet and sensors placed at the proposed ultrasonic devices with embedded phononic crystals. Unit cells of phononic crystals are optimized to open a band gap at the excitation frequency so that the excited waves are attenuated, while the sensitivity detection of higher harmonics is increased. The proposed approach is tested numerically and validated experimentally by considering various manufacturing methods, materials, and unit cell geometries. A parametric study of the angle of attachment of the ultrasonic devices with the embedded phononic crystals to the inspected structure is performed. Band gaps and filtering capabilities of several prototypes are tested. Numerical simulations of guided wave propagation that include the effect of delamination clapping proved that the proposed designs are sensitive enough to detect higher harmonics by simple signal thresholding. The most promising prototype is tested experimentally showing its capability of detection and localisation of a simulated damage.


title: The generalized Tur'{a}n number of long cycles in graphs and bipartite graphs

abstract: Given a graph $T$ and a family of graphs $\mathcal{F}$, the maximum number of copies of $T$ in an $\mathcal{F}$-free graph on $n$ vertices is called the generalized Tur\'{a}n number, denoted by $ex(n, T , \mathcal{F})$. When $T= K_2$, it reduces to the classical Tur\'{a}n number $ex(n, \mathcal{F})$. Let $ex_{bip}(b,n, T , \mathcal{F})$ be the maximum number of copies of $T$ in an $\mathcal{F}$-free bipartite graph with two parts of sizes $b$ and $n$, respectively. Let $P_k$ be the path on $k$ vertices, $\mathcal{C}_{\ge k}$ be the family of all cycles with length at least $k$ and $M_k$ be a matching with $k$ edges. In this article, we determine $ex_{bip}(b,n, K_{s,t}, \mathcal{C}_{\ge 2n-2k})$ exactly in a connected bipartite graph $G$ with minimum degree $\delta(G) \geq r\ge 1$, for $b\ge n\ge 2k+2r$ and $k\in \mathbb{Z}$, which generalizes a theorem of Moon and Moser, a theorem of Jackson and gives an affirmative evidence supporting a conjecture of Adamus and Adamus. As corollaries of our main result, we determine $ex_{bip}(b,n, K_{s,t}, P_{2n-2k})$ and $ex_{bip}(b,n, K_{s,t}, M_{n-k})$ exactly in a connected bipartite graph $G$ with minimum degree $\delta(G) \geq r\ge 1$, which generalizes a theorem of Wang. Moreover, we determine $ex(n, K_{s,t}, \mathcal{C}_{\ge k})$ and $ex(n, K_{s,t}, P_{k})$ respectively in a connected graph $G$ with minimum degree $\delta(G) \geq r\ge 1$, which generalizes a theorem of Lu, Yuan and Zhang.


title: Non-commutative error correcting codes and proper subgroup testing

abstract: Property testing has been a major area of research in computer science in the last three decades. By property testing we refer to an ensemble of problems, results and algorithms which enable to deduce global information about some data by only reading small random parts of it. In recent years, this theory found its way into group theory, mainly via group stability. In this paper, we study the following problem: Devise a randomized algorithm that given a subgroup $H$ of $G$, decides whether $H$ is the whole group or a proper subgroup, by checking whether a single (random) element of $G$ is in $H$. The search for such an algorithm boils down to the following purely group theoretic problem: For $G$ of rank $k$, find a small as possible test subset $A\subseteq G$ such that for every proper subgroup $H$, $|H\cap A|\leq (1-\delta)|A|$ for some absolute constant $\delta>0$, which we call the detection probability of $A$. It turns out that the search for sets $A$ of size linear in $k$ and constant detection probability is a non-commutative analogue of the classical search for families of good error correcting codes. This paper is devoted to proving that such test subsets exist, which implies good universal error correcting codes exist -- providing a far reaching generalization of the classical result of Shannon. In addition, we study this problem in certain subclasses of groups -- such as abelian, nilpotent, and finite solvable groups -- providing different constructions of test subsets for these subclasses with various qualities. Finally, this generalized theory of non-commutative error correcting codes suggests a plethora of interesting problems and research directions.


title: Covering $B_X$ by finitely many convex sets

abstract: Given a finite covering by closed convex sets of $B_X$, the unit ball of an infinite-dimensional Banach space, we investigate whether there is a set of the covering that contains balls of radius close to $1$ and (a) arbitrarily high finite dimension or (b) infinite dimension. In case (a) the answer is affirmative, but for the case (b) we just get radius close to $1/2$ and finite codimension under much more restrictive hypotheses.


title: Generalizability of experimental studies

abstract: Experimental studies are a cornerstone of machine learning (ML) research. A common, but often implicit, assumption is that the results of a study will generalize beyond the study itself, e.g. to new data. That is, there is a high probability that repeating the study under different conditions will yield similar results. Despite the importance of the concept, the problem of measuring generalizability remains open. This is probably due to the lack of a mathematical formalization of experimental studies. In this paper, we propose such a formalization and develop a quantifiable notion of generalizability. This notion allows to explore the generalizability of existing studies and to estimate the number of experiments needed to achieve the generalizability of new studies. To demonstrate its usefulness, we apply it to two recently published benchmarks to discern generalizable and non-generalizable results. We also publish a Python module that allows our analysis to be repeated for other experimental studies.


title: An Empirical Study on the Characteristics of Bias upon Context Length Variation for Bangla

abstract: Pretrained language models inherently exhibit various social biases, prompting a crucial examination of their social impact across various linguistic contexts due to their widespread usage. Previous studies have provided numerous methods for intrinsic bias measurements, predominantly focused on high-resource languages. In this work, we aim to extend these investigations to Bangla, a low-resource language. Specifically, in this study, we (1) create a dataset for intrinsic gender bias measurement in Bangla, (2) discuss necessary adaptations to apply existing bias measurement methods for Bangla, and (3) examine the impact of context length variation on bias measurement, a factor that has been overlooked in previous studies. Through our experiments, we demonstrate a clear dependency of bias metrics on context length, highlighting the need for nuanced considerations in Bangla bias analysis. We consider our work as a stepping stone for bias measurement in the Bangla Language and make all of our resources publicly available to support future research.


title: Temporal-Channel Modeling in Multi-head Self-Attention for Synthetic Speech Detection

abstract: Recent synthetic speech detectors leveraging the Transformer model have superior performance compared to the convolutional neural network counterparts. This improvement could be due to the powerful modeling ability of the multi-head self-attention (MHSA) in the Transformer model, which learns the temporal relationship of each input token. However, artifacts of synthetic speech can be located in specific regions of both frequency channels and temporal segments, while MHSA neglects this temporal-channel dependency of the input sequence. In this work, we proposed a Temporal-Channel Modeling (TCM) module to enhance MHSA's capability for capturing temporal-channel dependencies. Experimental results on the ASVspoof 2021 show that with only 0.03M additional parameters, the TCM module can outperform the state-of-the-art system by 9.25% in EER. Further ablation study reveals that utilizing both temporal and channel information yields the most improvement for detecting synthetic speech.


title: A Three-Pronged Approach to Cross-Lingual Adaptation with Multilingual LLMs

abstract: Low-resource languages, by its very definition, tend to be under represented in the pre-training corpora of Large Language Models. In this work, we investigate three low-resource cross-lingual approaches that enable an LLM adapt to tasks in previously unseen languages. Llama-2 is an LLM where Indic languages, among many other language families, contribute to less than $0.005\%$ of the total $2$ trillion token pre-training corpora. In this work, we experiment with the English-dominated Llama-2 for cross-lingual transfer to three Indic languages, Bengali, Hindi, and Tamil as target languages. We study three approaches for cross-lingual transfer, under ICL and fine-tuning. One, we find that adding additional supervisory signals via a dominant language in the LLM, leads to improvements, both under in-context learning and fine-tuning. Two, adapting the target languages to word reordering may be beneficial under ICL, but its impact diminishes with fine tuning. Finally, continued pre-training in one low-resource language can improve model performance for other related low-resource languages.


title: A Text is Worth Several Tokens: Text Embedding from LLMs Secretly Aligns Well with The Key Tokens

abstract: Text embeddings from large language models (LLMs) have achieved excellent results in tasks such as information retrieval, semantic textual similarity, etc. In this work, we show an interesting finding: when feeding a text into the embedding LLMs, the obtained text embedding will be able to be aligned with the key tokens in the input text. We first fully analyze this phenomenon on eight embedding LLMs and show that this phenomenon is universal and is not affected by model architecture, training strategy, and embedding method. With a deeper analysis, we then find that the main change in embedding space between the embedding LLMs and their original generative LLMs is in the first principal component. By adjusting the first principal component, we can align text embedding with the key tokens. Finally, we give several examples to demonstrate the vast application potential of this finding: (1) we propose a simple and practical sparse retrieval method based on the aligned tokens, which can achieve 80\% of the dense retrieval effect of the same model while reducing the computation significantly; (2) we show that our findings provide a fresh perspective to help understand fuzzy concepts (e.g., semantic relatedness vs. semantic similarity) and emerging technologies (e.g., instruction-following embedding) in this field.


title: Constructing Behavior Trees from Temporal Plans for Robotic Applications

abstract: Executing temporal plans in the real and open world requires adapting to uncertainty both in the environment and in the plan actions. A plan executor must therefore be flexible to dispatch actions based on the actual execution conditions. In general, this involves considering both event and time-based constraints between the actions in the plan. A simple temporal network (STN) is a convenient framework for specifying the constraints between actions in the plan. Likewise, a behavior tree (BT) is a convenient framework for controlling the execution flow of the actions in the plan. The principle contributions of this paper are i) an algorithm for transforming a plan into an STN, and ii) an algorithm for transforming an STN into a BT. When combined, these algorithms define a systematic approach for executing total-order (time-triggered) plans in robots operating in the real world. Our approach is based on creating a graph describing a deordered (state-triggered) plan and then creating a BT representing a partial-order (determined at runtime) plan. This approach ensures the correct execution of plans, including those with required concurrency. We demonstrate the validity of our approach within the PlanSys2 framework on real robots.