title: WeShap: Weak Supervision Source Evaluation with Shapley Values

abstract: Efficient data annotation stands as a significant bottleneck in training contemporary machine learning models. The Programmatic Weak Supervision (PWS) pipeline presents a solution by utilizing multiple weak supervision sources to automatically label data, thereby expediting the annotation process. Given the varied contributions of these weak supervision sources to the accuracy of PWS, it is imperative to employ a robust and efficient metric for their evaluation. This is crucial not only for understanding the behavior and performance of the PWS pipeline but also for facilitating corrective measures. In our study, we introduce WeShap values as an evaluation metric, which quantifies the average contribution of weak supervision sources within a proxy PWS pipeline, leveraging the theoretical underpinnings of Shapley values. We demonstrate efficient computation of WeShap values using dynamic programming, achieving quadratic computational complexity relative to the number of weak supervision sources. Our experiments demonstrate the versatility of WeShap values across various applications, including the identification of beneficial or detrimental labeling functions, refinement of the PWS pipeline, and rectification of mislabeled data. Furthermore, WeShap values aid in comprehending the behavior of the PWS pipeline and scrutinizing specific instances of mislabeled data. Although initially derived from a specific proxy PWS pipeline, we empirically demonstrate the generalizability of WeShap values to other PWS pipeline configurations. Our findings indicate a noteworthy average improvement of 4.8 points in downstream model accuracy through the revision of the PWS pipeline compared to previous state-of-the-art methods, underscoring the efficacy of WeShap values in enhancing data quality for training machine learning models.


title: Data Shapley in One Training Run

abstract: Generative artificial intelligence (AI) systems are trained on large data corpora to generate new pieces of text, images, videos, and other media. There is growing concern that such systems may infringe on the copyright interests of training data contributors. To address the copyright challenges of generative AI, we propose a framework that compensates copyright owners proportionally to their contributions to the creation of AI-generated content. The metric for contributions is quantitatively determined by leveraging the probabilistic nature of modern generative AI models and using techniques from cooperative game theory in economics. This framework enables a platform where AI developers benefit from access to high-quality training data, thus improving model performance. Meanwhile, copyright owners receive fair compensation, driving the continued provision of relevant data for generative model training. Experiments demonstrate that our framework successfully identifies the most relevant data sources used in artwork generation, ensuring a fair and interpretable distribution of revenues among copyright owners.


title: Connecting the Dots: Evaluating Abstract Reasoning Capabilities of LLMs Using the New York Times Connections Word Game

abstract: The New York Times Connections game has emerged as a popular and challenging pursuit for word puzzle enthusiasts. We collect 200 Connections games to evaluate the performance of state-of-the-art large language models (LLMs) against expert and novice human players. Our results show that even the best-performing LLM, GPT-4o, which has otherwise shown impressive reasoning abilities on a wide variety of benchmarks, can only fully solve 8% of the games. Compared to GPT-4o, novice and expert players perform better, with expert human players significantly outperforming GPT-4o. To deepen our understanding we create a taxonomy of the knowledge types required to successfully categorize words in the Connections game, revealing that LLMs struggle with associative, encyclopedic, and linguistic knowledge. Our findings establish the New York Times Connections game as a challenging benchmark for evaluating abstract reasoning capabilities in humans and AI systems.


title: Quasinormal modes in semi-open systems

abstract: Astrophysical black holes are open systems which, when perturbed, radiate quasi-normal modes (QNMs) to infinity. By contrast, laboratory analogues are necessarily finite-sized, presenting a potential obstacle to exciting QNMs in the lab. In this study, we investigate how the QNM spectrum of a toy-model black hole is modified when the system is enclosed by a partially reflecting wall. Counter to expectation, we demonstrate that QNMs not only persist in finite-sized systems, but the number of accessible modes increases. Furthermore, we show that QNMs in this set-up can be easily excited by incoherent background noise. Our findings align with studies exploring the spectral stability of black holes, such as those examining small modifications of the surrounding gravitational field. Importantly, our work paves the way for exploring spectral stability in laboratory systems, enabling experimental investigation of black hole features in closed systems.


title: Latent Communication in Artificial Neural Networks

abstract: As NNs permeate various scientific and industrial domains, understanding the universality and reusability of their representations becomes crucial. At their core, these networks create intermediate neural representations, indicated as latent spaces, of the input data and subsequently leverage them to perform specific downstream tasks. This dissertation focuses on the universality and reusability of neural representations. Do the latent representations crafted by a NN remain exclusive to a particular trained instance, or can they generalize across models, adapting to factors such as randomness during training, model architecture, or even data domain? This adaptive quality introduces the notion of Latent Communication -- a phenomenon that describes when representations can be unified or reused across neural spaces. A salient observation from our research is the emergence of similarities in latent representations, even when these originate from distinct or seemingly unrelated NNs. By exploiting a partial correspondence between the two data distributions that establishes a semantic link, we found that these representations can either be projected into a universal representation, coined as Relative Representation, or be directly translated from one space to another. Latent Communication allows for a bridge between independently trained NN, irrespective of their training regimen, architecture, or the data modality they were trained on -- as long as the data semantic content stays the same (e.g., images and their captions). This holds true for both generation, classification and retrieval downstream tasks; in supervised, weakly supervised, and unsupervised settings; and spans various data modalities including images, text, audio, and graphs -- showcasing the universality of the Latent Communication phenomenon. [...]


title: Imprints of PeV cosmic-ray sources on the diffuse gamma-ray emission

abstract: We present our new model for the description of the very high energy Galactic gamma-ray emission based on a discrete injection of cosmic rays by individual sources. We investigate the morphology of the very high energy gamma-ray sky, the detectability of cosmic-ray sources and the clumpiness of the diffuse gamma-ray flux, assuming two different scenarios for cosmic-ray propagation. Namely, a standard isotropic and homogeneous diffusion process and an isotropic and inhomogeneous diffusion process. We notably formulate a possible explanation to the small number of hadronic PeVatrons recently detected by LHAASO. In the case of the inhomogeneous diffusion process, we constrain the number of hadronic PeVatrons to be small. Finally, we give an argument that may explain the discrepancy between the interstellar gas density distribution and the very high energy diffuse gamma-ray flux.


title: Optimized Speculative Sampling for GPU Hardware Accelerators

abstract: In this work, we optimize speculative sampling for parallel hardware accelerators to improve sampling speed. We notice that substantial portions of the intermediate matrices necessary for speculative sampling can be computed concurrently. This allows us to distribute the workload across multiple GPU threads, enabling simultaneous operations on matrix segments within thread blocks. Additionally, we use fast on-chip memory to store intermediate results, thereby minimizing the frequency of slow read and write operations across different types of memory. This results in profiling time improvements ranging from 6% to 13% relative to the baseline implementation, without compromising accuracy. To further accelerate speculative sampling, probability distributions parameterized by softmax are approximated by sigmoid. This approximation approach results in significantly greater relative improvements in profiling time, ranging from 37% to 94%, with a slight decline in accuracy. We conduct extensive experiments on both automatic speech recognition and summarization tasks to validate the effectiveness of our optimization methods.


title: Exact solution of the nonlinear boson diffusion equation for gluon scattering

abstract: An exact analytical solution of the nonlinear boson diffusion equation (NBDE) is presented. It accounts for the time evolution towards the Bose-Einstein equilibrium distribution through inelastic and elastic collisions in case of constant transport coefficients. As a currently interesting application, gluon scattering in relativistic heavy-ion collisions is investigated. An estimate of time-dependent gluon-condensate formation in overoccupied systems through number-conserving elastic scatterings in Pb-Pb collisions at relativistic energies is given.


title: Implementing dynamic high-performance computing supported workflows on Scanning Transmission Electron Microscope

abstract: Scanning Transmission Electron Microscopy (STEM) coupled with Electron Energy Loss Spectroscopy (EELS) presents a powerful platform for detailed material characterization via rich imaging and spectroscopic data. Modern electron microscopes can access multiple length scales and sampling rates far beyond human perception and reaction time. Recent advancements in machine learning (ML) offer a promising avenue to enhance these capabilities by integrating ML algorithms into the STEM-EELS framework, fostering an environment of active learning. This work enables the seamless integration of STEM with High-Performance Computing (HPC) systems. We present several implemented workflows that exemplify this integration. These workflows include sophisticated techniques such as object finding and Deep Kernel Learning (DKL). Through these developments, we demonstrate how the fusion of STEM-EELS with ML and HPC enhances the efficiency and scope of material characterization for 70% STEM available globally. The codes are available at GitHub link.


title: Self-supervised Pretraining and Finetuning for Monocular Depth and Visual Odometry

abstract: For the task of simultaneous monocular depth and visual odometry estimation, we propose learning self-supervised transformer-based models in two steps. Our first step consists in a generic pretraining to learn 3D geometry, using cross-view completion objective (CroCo), followed by self-supervised finetuning on non-annotated videos. We show that our self-supervised models can reach state-of-the-art performance 'without bells and whistles' using standard components such as visual transformers, dense prediction transformers and adapters. We demonstrate the effectiveness of our proposed method by running evaluations on six benchmark datasets, both static and dynamic, indoor and outdoor, with synthetic and real images. For all datasets, our method outperforms state-of-the-art methods, in particular for depth prediction task.


title: RUPBench: Benchmarking Reasoning Under Perturbations for Robustness Evaluation in Large Language Models

abstract: With the increasing use of large language models (LLMs), ensuring reliable performance in diverse, real-world environments is essential. Despite their remarkable achievements, LLMs often struggle with adversarial inputs, significantly impacting their effectiveness in practical applications. To systematically understand the robustness of LLMs, we present RUPBench, a comprehensive benchmark designed to evaluate LLM robustness across diverse reasoning tasks. Our benchmark incorporates 15 reasoning datasets, categorized into commonsense, arithmetic, logical, and knowledge-intensive reasoning, and introduces nine types of textual perturbations at lexical, syntactic, and semantic levels. By examining the performance of state-of-the-art LLMs such as GPT-4o, Llama3, Phi-3, and Gemma on both original and perturbed datasets, we provide a detailed analysis of their robustness and error patterns. Our findings highlight that larger models tend to exhibit greater robustness to perturbations. Additionally, common error types are identified through manual inspection, revealing specific challenges faced by LLMs in different reasoning contexts. This work provides insights into areas where LLMs need further improvement to handle diverse and noisy inputs effectively.


title: $\alpha$-SSC: Uncertainty-Aware Camera-based 3D Semantic Scene Completion

abstract: In the realm of autonomous vehicle (AV) perception, comprehending 3D scenes is paramount for tasks such as planning and mapping. Semantic scene completion (SSC) aims to infer scene geometry and semantics from limited observations. While camera-based SSC has gained popularity due to affordability and rich visual cues, existing methods often neglect the inherent uncertainty in models. To address this, we propose an uncertainty-aware camera-based 3D semantic scene completion method ($\alpha$-SSC). Our approach includes an uncertainty propagation framework from depth models (Depth-UP) to enhance geometry completion (up to 11.58% improvement) and semantic segmentation (up to 14.61% improvement). Additionally, we propose a hierarchical conformal prediction (HCP) method to quantify SSC uncertainty, effectively addressing high-level class imbalance in SSC datasets. On the geometry level, we present a novel KL divergence-based score function that significantly improves the occupied recall of safety-critical classes (45% improvement) with minimal performance overhead (3.4% reduction). For uncertainty quantification, we demonstrate the ability to achieve smaller prediction set sizes while maintaining a defined coverage guarantee. Compared with baselines, it achieves up to 85% reduction in set sizes. Our contributions collectively signify significant advancements in SSC accuracy and robustness, marking a noteworthy step forward in autonomous perception systems.


title: Outlier Reduction with Gated Attention for Improved Post-training Quantization in Large Sequence-to-sequence Speech Foundation Models

abstract: This paper explores the improvement of post-training quantization (PTQ) after knowledge distillation in the Whisper speech foundation model family. We address the challenge of outliers in weights and activation tensors, known to impede quantization quality in transformer-based language and vision models. Extending this observation to Whisper, we demonstrate that these outliers are also present when transformer-based models are trained to perform automatic speech recognition, necessitating mitigation strategies for PTQ. We show that outliers can be reduced by a recently proposed gating mechanism in the attention blocks of the student model, enabling effective 8-bit quantization, and lower word error rates compared to student models without the gating mechanism in place.


title: Physics-Informed Deep Learning and Partial Transfer Learning for Bearing Fault Diagnosis in the Presence of Highly Missing Data

abstract: One of the most significant obstacles in bearing fault diagnosis is a lack of labeled data for various fault types. Also, sensor-acquired data frequently lack labels and have a large amount of missing data. This paper tackles these issues by presenting the PTPAI method, which uses a physics-informed deep learning-based technique to generate synthetic labeled data. Labeled synthetic data makes up the source domain, whereas unlabeled data with missing data is present in the target domain. Consequently, imbalanced class problems and partial-set fault diagnosis hurdles emerge. To address these challenges, the RF-Mixup approach is used to handle imbalanced classes. As domain adaptation strategies, the MK-MMSD and CDAN are employed to mitigate the disparity in distribution between synthetic and actual data. Furthermore, the partial-set challenge is tackled by applying weighting methods at the class and instance levels. Experimental outcomes on the CWRU and JNU datasets indicate that the proposed approach effectively addresses these problems.


title: Endogenous Attention and the Spread of False News

abstract: We study the impact of endogenous attention in a dynamic model of social media sharing. Each period, a distinct user randomly draws a story from the pool of stories on the platform and decides whether or not to share it. Users want to share stories that are true and interesting, but differentiating true stories from false ones requires attention. Before deciding whether to share a story, users choose their level of attention based on how interesting the story is and the platform's current proportions of true and false stories. We characterize the limit behavior of the share of true stories using stochastic approximation techniques. For some parameter specifications, the system has a unique limit. For others, the limit is random -- starting from the same initial conditions, the platform may end up with very different proportions of true and false stories and different user sharing behavior. We present various comparative statics for the limit. Endogenous attention leads to a counterbalancing force to changes in the credibility of false stories but can intensify the effects of changes in false stories' production rate.


title: Large Language Models for Dysfluency Detection in Stuttered Speech

abstract: Accurately detecting dysfluencies in spoken language can help to improve the performance of automatic speech and language processing components and support the development of more inclusive speech and language technologies. Inspired by the recent trend towards the deployment of large language models (LLMs) as universal learners and processors of non-lexical inputs, such as audio and video, we approach the task of multi-label dysfluency detection as a language modeling problem. We present hypotheses candidates generated with an automatic speech recognition system and acoustic representations extracted from an audio encoder model to an LLM, and finetune the system to predict dysfluency labels on three datasets containing English and German stuttered speech. The experimental results show that our system effectively combines acoustic and lexical information and achieves competitive results on the multi-label stuttering detection task.


title: Boosting Medical Image Classification with Segmentation Foundation Model

abstract: The Segment Anything Model (SAM) exhibits impressive capabilities in zero-shot segmentation for natural images. Recently, SAM has gained a great deal of attention for its applications in medical image segmentation. However, to our best knowledge, no studies have shown how to harness the power of SAM for medical image classification. To fill this gap and make SAM a true ``foundation model'' for medical image analysis, it is highly desirable to customize SAM specifically for medical image classification. In this paper, we introduce SAMAug-C, an innovative augmentation method based on SAM for augmenting classification datasets by generating variants of the original images. The augmented datasets can be used to train a deep learning classification model, thereby boosting the classification performance. Furthermore, we propose a novel framework that simultaneously processes raw and SAMAug-C augmented image input, capitalizing on the complementary information that is offered by both. Experiments on three public datasets validate the effectiveness of our new approach.


title: Weather conditions at Timau National Observatory from ERA5

abstract: A new observatory site should be investigated for its local climate conditions to see its potential and limitations. In this respect, we examine several meteorological parameters at the site of Timau National Observatory, Indonesia using the ERA5 dataset from 2002 to 2021. Based on this dataset, we conclude that the surface temperature at Timau is around 18.9 C with a relatively small temperature variation (1.5 C) over the day. This temperature stability is expected to give advantages to the observatory. In terms of humidity and water vapour, Timau is poor for infrared observations as the median precipitable water vapour exceeds 18 mm, even during the dry season. However, near-infrared observations are feasible. Even though our cloud cover analysis confirms the span of the observing season in the region, we find a significant discrepancy between the clear sky fraction derived from the ERA5 dataset and the one estimated using satellite imagery. Aside from the indicated bias, our results provide insights and directions for the operation and future development of the observatory.


abstract: Text classification, an integral task in natural language processing, involves the automatic categorization of text into predefined classes. Creating supervised labeled datasets for low-resource languages poses a considerable challenge. Unlocking the language potential of low-resource languages requires robust datasets with supervised labels. However, such datasets are scarce, and the label space is often limited. In our pursuit to address this gap, we aim to optimize existing labels/datasets in different languages. This research proposes a novel perspective on Universal Cross-Lingual Text Classification, leveraging a unified model across languages. Our approach involves blending supervised data from different languages during training to create a universal model. The supervised data for a target classification task might come from different languages covering different labels. The primary goal is to enhance label and language coverage, aiming for a label set that represents a union of labels from various languages. We propose the usage of a strong multilingual SBERT as our base model, making our novel training strategy feasible. This strategy contributes to the adaptability and effectiveness of the model in cross-lingual language transfer scenarios, where it can categorize text in languages not encountered during training. Thus, the paper delves into the intricacies of cross-lingual text classification, with a particular focus on its application for low-resource languages, exploring methodologies and implications for the development of a robust and adaptable universal cross-lingual model.


title: Curating Stopwords in Marathi: A TF-IDF Approach for Improved Text Analysis and Information Retrieval

abstract: Stopwords are commonly used words in a language that are often considered to be of little value in determining the meaning or significance of a document. These words occur frequently in most texts and don't provide much useful information for tasks like sentiment analysis and text classification. English, which is a high-resource language, takes advantage of the availability of stopwords, whereas low-resource Indian languages like Marathi are very limited, standardized, and can be used in available packages, but the number of available words in those packages is low. Our work targets the curation of stopwords in the Marathi language using the MahaCorpus, with 24.8 million sentences. We make use of the TF-IDF approach coupled with human evaluation to curate a strong stopword list of 400 words. We apply the stop word removal to the text classification task and show its efficacy. The work also presents a simple recipe for stopword curation in a low-resource language. The stopwords are integrated into the mahaNLP library and publicly available on https://github.com/l3cube-pune/MarathiNLP .


title: FoodieQA: A Multimodal Dataset for Fine-Grained Understanding of Chinese Food Culture

abstract: Food is a rich and varied dimension of cultural heritage, crucial to both individuals and social groups. To bridge the gap in the literature on the often-overlooked regional diversity in this domain, we introduce FoodieQA, a manually curated, fine-grained image-text dataset capturing the intricate features of food cultures across various regions in China. We evaluate vision-language Models (VLMs) and large language models (LLMs) on newly collected, unseen food images and corresponding questions. FoodieQA comprises three multiple-choice question-answering tasks where models need to answer questions based on multiple images, a single image, and text-only descriptions, respectively. While LLMs excel at text-based question answering, surpassing human accuracy, the open-sourced VLMs still fall short by 41\% on multi-image and 21\% on single-image VQA tasks, although closed-weights models perform closer to human levels (within 10\%). Our findings highlight that understanding food and its cultural implications remains a challenging and under-explored direction.


title: Entanglement in $(1+1)$-dimensional Free Scalar Field Theory: Tiptoeing between Continuum and Discrete

abstract: We review some classic works on ground state entanglement entropy in $(1+1)$-dimensional free scalar field theory. We point out identifications between the methods for the calculation of entanglement entropy and we show how the formalism developed for the discretized theory can be utilized in order to obtain results in the continuous theory. We specify the entanglement spectrum and we calculate the entanglement entropy for the theory defined on an interval of finite length $L$. Finally, we derive the modular Hamiltonian directly, without using the modular flow, via the continuous limit of the expressions obtained in the discretized theory. In a specific coordinate system, the modular Hamiltonian assumes the form of a free field Hamiltonian on the Rindler wedge.


title: $a$-potent Schwarz matrices and Bessel-like Jacobi polynomials

abstract: We consider the problem of the reconstruction of a Schwarz matrix from exactly one given eigenvalue. This inverse eigenvalue problem leads to the Jacobi orthogonal polynomials~$\{P_k^{(-n,n)}\}_{k=0}^{n-1}$ that can be treated as a discrete finite analogue of Bessel polynomials.


title: HAIChart: Human and AI Paired Visualization System

abstract: The growing importance of data visualization in business intelligence and data science emphasizes the need for tools that can efficiently generate meaningful visualizations from large datasets. Existing tools fall into two main categories: human-powered tools (e.g., Tableau and PowerBI), which require intensive expert involvement, and AI-powered automated tools (e.g., Draco and Table2Charts), which often fall short of guessing specific user needs. In this paper, we aim to achieve the best of both worlds. Our key idea is to initially auto-generate a set of high-quality visualizations to minimize manual effort, then refine this process iteratively with user feedback to more closely align with their needs. To this end, we present HAIChart, a reinforcement learning-based framework designed to iteratively recommend good visualizations for a given dataset by incorporating user feedback. Specifically, we propose a Monte Carlo Graph Search-based visualization generation algorithm paired with a composite reward function to efficiently explore the visualization space and automatically generate good visualizations. We devise a visualization hints mechanism to actively incorporate user feedback, thus progressively refining the visualization generation module. We further prove that the top-k visualization hints selection problem is NP-hard and design an efficient algorithm. We conduct both quantitative evaluations and user studies, showing that HAIChart significantly outperforms state-of-the-art human-powered tools (21% better at Recall and 1.8 times faster) and AI-powered automatic tools (25.1% and 14.9% better in terms of Hit@3 and R10@30, respectively).


title: Tightness for the Cover Time of Wired Planar Domains

abstract: We consider a continuous time simple random walk on a subset of the square lattice with wired boundary conditions: the walk transitions at unit edge rate on the graph obtained from the lattice closure of the subset by contracting the boundary into one vertex. We study the cover time of such walk, namely the time it takes for the walk to visit all vertices in the graph. Taking a sequence of subsets obtained as scaled lattice versions of a nice planar domain, we show that the square root of the cover time normalized by the size of the subset, is tight around $\frac{1}{\sqrt{\pi}} \log N - \frac{1}{4 \sqrt{\pi}} \log \log N$, where $N$ is the scale parameter. This proves an analog, for the wired case, of a conjecture by Bramson and Zeitouni from 2009. The proof is based on comparison with the extremal landscape of the discrete Gaussian free field.


title: Scaling Synthetic Logical Reasoning Datasets with Context-Sensitive Declarative Grammars

abstract: Logical reasoning remains a challenge for natural language processing, but it can be improved by training language models to mimic theorem provers on procedurally generated problems. Previous work used domain-specific proof generation algorithms, which biases reasoning toward specific proof traces and limits auditability and extensibility. We present a simpler and more general declarative framework with flexible context-sensitive rules binding multiple languages (specifically, simplified English and the TPTP theorem-proving language). We construct first-order logic problems by selecting up to 32 premises and one hypothesis. We demonstrate that using semantic constraints during generation and careful English verbalization of predicates enhances logical reasoning without hurting natural English tasks. We use relatively small DeBERTa-v3 models to achieve state-of-the-art accuracy on the FOLIO human-authored logic dataset, surpassing GPT-4 in accuracy with or without an external solver by 12%.


title: garak: A Framework for Security Probing Large Language Models

abstract: As Large Language Models (LLMs) are deployed and integrated into thousands of applications, the need for scalable evaluation of how models respond to adversarial attacks grows rapidly. However, LLM security is a moving target: models produce unpredictable output, are constantly updated, and the potential adversary is highly diverse: anyone with access to the internet and a decent command of natural language. Further, what constitutes a security weak in one context may not be an issue in a different context; one-fits-all guardrails remain theoretical. In this paper, we argue that it is time to rethink what constitutes ``LLM security'', and pursue a holistic approach to LLM security evaluation, where exploration and discovery of issues are central. To this end, this paper introduces garak (Generative AI Red-teaming and Assessment Kit), a framework which can be used to discover and identify vulnerabilities in a target LLM or dialog system. garak probes an LLM in a structured fashion to discover potential vulnerabilities. The outputs of the framework describe a target model's weaknesses, contribute to an informed discussion of what composes vulnerabilities in unique contexts, and can inform alignment and policy discussions for LLM deployment.


abstract: Speech tokenization is the task of representing speech signals as a sequence of discrete units. Such representations can be later used for various downstream tasks including automatic speech recognition, text-to-speech, etc. More relevant to this study, such representation serves as the basis of Speech Language Models. In this work, we tackle the task of speech tokenization under the noisy setup and present NAST: Noise Aware Speech Tokenization for Speech Language Models. NAST is composed of three main components: (i) a predictor; (ii) a residual encoder; and (iii) a decoder. We evaluate the efficiency of NAST considering several spoken language modeling tasks and show that NAST is superior to the evaluated baselines across all setups. Lastly, we analyze NAST and show its disentanglement properties and robustness to signal variations in the form of noise, reverberation, pitch-shift, and time-stretch. Code and pre-trained models are available at https://github.com/ShovalMessica/NAST.


title: Physical-Layer Security for 6G: Safe Jamming against Malicious Sensing

abstract: The integration of sensing, communications, array signal processing, etc. into 6G mobile networks has ushered in an era of heightened situational awareness. However, this progress brings forth significant concerns regarding privacy and security, particularly due to the proliferation of devices equipped with radar-like sensing capability, including malicious ones. In response, this paper proposes a novel actor-critic (AC) method-based frequency selection scheme for noise jamming, in order to effectively counter malicious multifunction frequency agility sensing. In the meanwhile, to mitigate potential interference (caused by sidelobes of the jamming beam) with uplink transmissions conducted by legitimate but non-cooperative users, a robust action correction mechanism, which is capable of learning and predicting the spectrum utilization state, is proposed to find feasible but near-optimal frequency configuration for jamming. Numerical results demonstrate that benefiting from the robust action correction mechanism, the proposed AC-based safe jamming can not only make the malicious sensing device continuously get stuck in the searching mode but also guarantee minimal disruption to the legitimate non-cooperative users.


title: Dynamic Normativity: Necessary and Sufficient Conditions for Value Alignment

abstract: The critical inquiry pervading the realm of Philosophy, and perhaps extending its influence across all Humanities disciplines, revolves around the intricacies of morality and normativity. Surprisingly, in recent years, this thematic thread has woven its way into an unexpected domain, one not conventionally associated with pondering "what ought to be": the field of artificial intelligence (AI) research. Central to morality and AI, we find "alignment", a problem related to the challenges of expressing human goals and values in a manner that artificial systems can follow without leading to unwanted adversarial effects. More explicitly and with our current paradigm of AI development in mind, we can think of alignment as teaching human values to non-anthropomorphic entities trained through opaque, gradient-based learning techniques. This work addresses alignment as a technical-philosophical problem that requires solid philosophical foundations and practical implementations that bring normative theory to AI system development. To accomplish this, we propose two sets of necessary and sufficient conditions that, we argue, should be considered in any alignment process. While necessary conditions serve as metaphysical and metaethical roots that pertain to the permissibility of alignment, sufficient conditions establish a blueprint for aligning AI systems under a learning-based paradigm. After laying such foundations, we present implementations of this approach by using state-of-the-art techniques and methods for aligning general-purpose language systems. We call this framework Dynamic Normativity. Its central thesis is that any alignment process under a learning paradigm that cannot fulfill its necessary and sufficient conditions will fail in producing aligned systems.


title: Decays $Z\to e_ae_b$ in a 3-3-1 model with neutral leptons

abstract: We investigate the 3-3-1 model with neutral leptons (called the 331$NL$ for short) and by that, we will point out that this model can simultaneously explain the lepton flavor violating (LFV) decays of the $Z$ boson $Z \to e_a e_b$, Standard model-like Higgs boson decay $h\to e_be_a$, and the charged leptons $e_b\to e_a \gamma$ consistent with the recent experimental data. In addition, the numerical results show strict relations among these decay rates of $Z$ and $h$ which are predicted by this model. As a result, the decay channels can be determined theoretically if one of them is detected by experiments.


title: Nested finite element approximation of parabolic SPDEs with Whittle-Mat\'ern noise

abstract: We propose a new type of fully discrete finite element approximation of a class of semilinear stochastic parabolic equations with additive noise. Our discretization differs from the ones typically considered, in that we employ a nested finite element approximation of the noise. This is well suited for dealing with covariance operators defined in terms of (negative powers of) elliptic operators, like that of Whittle-Mat\'ern random fields. We derive strong and pathwise convergence rates for our proposed discretization, and our results are supported by numerical experiments.


title: Thermal and non-thermal DM production in non-Standard Cosmologies: a mini review

abstract: We provide a short review of some aspects of Dark Matter production in non Standard Cosmology. Considering the simplest Higgs portal model as definite particle physics setup, we consider the impact on the parameter space corresponding to the correct relic density, and the complementary experimental constraints, of the presence, during thermal production, of an exotic component dominating the energy density of the Universe. In the second part of the work we will focus on the case that such exotic component satisfies the equation of state of matter and it can produce DM non-thermally.


title: Statistical Considerations for Evaluating Treatment Effect under Various Non-proportional Hazard Scenarios

abstract: We conducted a systematic comparison of statistical methods used for the analysis of time-to-event outcomes under various proportional and nonproportional hazard (NPH) scenarios. Our study used data from recently published oncology trials to compare the Log-rank test, still by far the most widely used option, against some available alternatives, including the MaxCombo test, the Restricted Mean Survival Time Difference (dRMST) test, the Generalized Gamma Model (GGM) and the Generalized F Model (GFM). Power, type I error rate, and time-dependent bias with respect to the RMST difference, survival probability difference, and median survival time were used to evaluate and compare the performance of these methods. In addition to the real data, we simulated three hypothetical scenarios with crossing hazards chosen so that the early and late effects 'cancel out' and used them to evaluate the ability of the aforementioned methods to detect time-specific and overall treatment effects. We implemented novel metrics for assessing the time-dependent bias in treatment effect estimates to provide a more comprehensive evaluation in NPH scenarios. Recommendations under each NPH scenario are provided by examining the type I error rate, power, and time-dependent bias associated with each statistical approach.


title: Evaluating the Performance of Large Language Models via Debates

abstract: Large Language Models (LLMs) are rapidly evolving and impacting various fields, necessitating the development of effective methods to evaluate and compare their performance. Most current approaches for performance evaluation are either based on fixed, domain-specific questions that lack the flexibility required in many real-world applications where tasks are not always from a single domain, or rely on human input, making them unscalable. We propose an automated benchmarking framework based on debates between LLMs, judged by another LLM. This method assesses not only domain knowledge, but also skills such as problem definition and inconsistency recognition. We evaluate the performance of various state-of-the-art LLMs using the debate framework and achieve rankings that align closely with popular rankings based on human input, eliminating the need for costly human crowdsourcing.


title: Kolmogorov Arnold Informed neural network: A physics-informed deep learning framework for solving PDEs based on Kolmogorov Arnold Networks

abstract: AI for partial differential equations (PDEs) has garnered significant attention, particularly with the emergence of Physics-informed neural networks (PINNs). The recent advent of Kolmogorov-Arnold Network (KAN) indicates that there is potential to revisit and enhance the previously MLP-based PINNs. Compared to MLPs, KANs offer interpretability and require fewer parameters. PDEs can be described in various forms, such as strong form, energy form, and inverse form. While mathematically equivalent, these forms are not computationally equivalent, making the exploration of different PDE formulations significant in computational physics. Thus, we propose different PDE forms based on KAN instead of MLP, termed Kolmogorov-Arnold-Informed Neural Network (KINN). We systematically compare MLP and KAN in various numerical examples of PDEs, including multi-scale, singularity, stress concentration, nonlinear hyperelasticity, heterogeneous, and complex geometry problems. Our results demonstrate that KINN significantly outperforms MLP in terms of accuracy and convergence speed for numerous PDEs in computational solid mechanics, except for the complex geometry problem. This highlights KINN's potential for more efficient and accurate PDE solutions in AI for PDEs.


title: Impact of the Availability of ChatGPT on Software Development: A Synthetic Difference in Differences Estimation using GitHub Data

abstract: Advancements in Artificial Intelligence, particularly with ChatGPT, have significantly impacted software development. Utilizing novel data from GitHub Innovation Graph, we hypothesize that ChatGPT enhances software production efficiency. Utilizing natural experiments where some governments banned ChatGPT, we employ Difference-in-Differences (DID), Synthetic Control (SC), and Synthetic Difference-in-Differences (SDID) methods to estimate its effects. Our findings indicate a significant positive impact on the number of git pushes, repositories, and unique developers per 100,000 people, particularly for high-level, general purpose, and shell scripting languages. These results suggest that AI tools like ChatGPT can substantially boost developer productivity, though further analysis is needed to address potential downsides such as low quality code and privacy concerns.


title: Enhancing Supermarket Robot Interaction: A Multi-Level LLM Conversational Interface for Handling Diverse Customer Intents

abstract: This paper presents the design and evaluation of a novel multi-level LLM interface for supermarket robots to assist customers. The proposed interface allows customers to convey their needs through both generic and specific queries. While state-of-the-art systems like OpenAI's GPTs are highly adaptable and easy to build and deploy, they still face challenges such as increased response times and limitations in strategic control of the underlying model for tailored use-case and cost optimization. Driven by the goal of developing faster and more efficient conversational agents, this paper advocates for using multiple smaller, specialized LLMs fine-tuned to handle different user queries based on their specificity and user intent. We compare this approach to a specialized GPT model powered by GPT-4 Turbo, using the Artificial Social Agent Questionnaire (ASAQ) and qualitative participant feedback in a counterbalanced within-subjects experiment. Our findings show that our multi-LLM chatbot architecture outperformed the benchmarked GPT model across all 13 measured criteria, with statistically significant improvements in four key areas: performance, user satisfaction, user-agent partnership, and self-image enhancement. The paper also presents a method for supermarket robot navigation by mapping the final chatbot response to correct shelf numbers, enabling the robot to sequentially navigate towards the respective products, after which lower-level robot perception, control, and planning can be used for automated object retrieval. We hope this work encourages more efforts into using multiple, specialized smaller models instead of relying on a single powerful, but more expensive and slower model.


title: Leveraging Foundation Models for Multi-modal Federated Learning with Incomplete Modality

abstract: Federated learning (FL) has obtained tremendous progress in providing collaborative training solutions for distributed data silos with privacy guarantees. However, few existing works explore a more realistic scenario where the clients hold multiple data modalities. In this paper, we aim to solve a novel challenge in multi-modal federated learning (MFL) -- modality missing -- the clients may lose part of the modalities in their local data sets. To tackle the problems, we propose a novel multi-modal federated learning method, Federated Multi-modal contrastiVe training with Pre-trained completion (FedMVP), which integrates the large-scale pre-trained models to enhance the federated training. In the proposed FedMVP framework, each client deploys a large-scale pre-trained model with frozen parameters for modality completion and representation knowledge transfer, enabling efficient and robust local training. On the server side, we utilize generated data to uniformly measure the representation similarity among the uploaded client models and construct a graph perspective to aggregate them according to their importance in the system. We demonstrate that the model achieves superior performance over two real-world image-text classification datasets and is robust to the performance degradation caused by missing modality.


title: Reconsidering Sentence-Level Sign Language Translation

abstract: Historically, sign language machine translation has been posed as a sentence-level task: datasets consisting of continuous narratives are chopped up and presented to the model as isolated clips. In this work, we explore the limitations of this task framing. First, we survey a number of linguistic phenomena in sign languages that depend on discourse-level context. Then as a case study, we perform the first human baseline for sign language translation that actually substitutes a human into the machine learning task framing, rather than provide the human with the entire document as context. This human baseline -- for ASL to English translation on the How2Sign dataset -- shows that for 33% of sentences in our sample, our fluent Deaf signer annotators were only able to understand key parts of the clip in light of additional discourse-level context. These results underscore the importance of understanding and sanity checking examples when adapting machine learning to new domains.


title: A Peek into Token Bias: Large Language Models Are Not Yet Genuine Reasoners

abstract: This study introduces a hypothesis-testing framework to assess whether large language models (LLMs) possess genuine reasoning abilities or primarily depend on token bias. We go beyond evaluating LLMs on accuracy; rather, we aim to investigate their token bias in solving logical reasoning tasks. Specifically, we develop carefully controlled synthetic datasets, featuring conjunction fallacy and syllogistic problems. Our framework outlines a list of hypotheses where token biases are readily identifiable, with all null hypotheses assuming genuine reasoning capabilities of LLMs. The findings in this study suggest, with statistical guarantee, that most LLMs still struggle with logical reasoning. While they may perform well on classic problems, their success largely depends on recognizing superficial patterns with strong token bias, thereby raising concerns about their actual reasoning and generalization abilities.


title: Asymptotically Optimal Threshold Bias for the $(a : b)$ Maker-Breaker Minimum Degree, Connectivity and Hamiltonicity Games

abstract: We study the $(a:b)$ Maker-Breaker subgraph game played on the edges of the complete graph $K_n$ on $n$ vertices, $n,a,b \in \mathbb{N}$ where the goal of Maker is to build a copy of a specific fixed subgraph $H$. In our work this is a spanning graph with minimum degree $k=k(n)$, a connected spanning subgraph or a Hamiltonian subgraph. In the $(a:b)$ game in each round Maker chooses $a$ unclaimed edges of $K_n$ and Breaker chooses $b$ unclaimed edges. Maker wins, if he succeeds to build a copy of the subgraph under consideration, otherwise Breaker wins. For the $k$-minimum-degree, we present a winning strategy for Maker leading to a bound that generalizes a bound of Gebauer and Szab{\'o} for the $(1:b)$ case. Moreover, we give an explicit strategy for Breaker for $b >(1+o(1)) \frac{an}{a+\ln(n)}$ in case of $a=o\left(\sqrt{\frac{n}{\ln(n)}}\right)$ and $k=o(\ln(n))$. Note that this bound is the same as the Maker bound presented by Hefetz et al. (2012) for the $(a:b)$ connectivity game, which implies that the asymptotic optimal bias for this game is $\frac{an}{a+\ln(n)}$. This resolves the open problem stated by these authors. We also study the $(a:b)$ Hamiltonicity game in which Maker's goal is to create a Hamiltonian subgraph. For the $(1:b)$ variant Krivelevich proved that $\left(1+o(1) \right)\frac{n}{\ln n}$ is the exact threshold bias. Controlling Breaker's vertex degree in the $(a:b)$ Maker-Breaker minimum degree game enables us to the asymptotic optimal generalized threshold bias for the $(a:b)$-game, both for $a=o\left(\sqrt{\frac{n}{\ln n}} \right)$ and $a=\Omega\left(\sqrt{\frac{n}{\ln n}} \right)$.


title: Pure C*-algebras

abstract: We show that every C*-algebra that is (m,n)-pure in the sense of Winter is already pure, that is, its Cuntz semigroup is almost unperforated and almost divisible. More generally, we show that even weaker comparison and divisibility properties automatically lead to pureness. As an application to the non-simple Toms-Winter conjecture, we show that every C*-algebra with the Global Glimm Property and finite nuclear dimension is pure.


title: Magnetospheric origin of a fast radio burst constrained using scintillation

abstract: Fast radio bursts (FRBs) are micro-to-millisecond duration radio transients that originate mostly from extragalactic distances. The emission mechanism responsible for these high luminosity, short duration transients remains debated. The models are broadly grouped into two classes: physical processes that occur within close proximity to a central engine; and central engines that release energy which moves to large radial distances and subsequently interacts with surrounding media producing radio waves. The expected emission region sizes are notably different between these two types of models. FRB emission size constraints can therefore be used to distinguish between these competing models and inform on the physics responsible. Here we present the measurement of two mutually coherent scintillation scales in the frequency spectrum of FRB 20221022A: one originating from a scattering screen located within the Milky Way, and the second originating from a scattering screen located within its host galaxy or local environment. We use the scattering media as an astrophysical lens to constrain the size of the lateral emission region, $R_{\star\mathrm{obs}} \lesssim 3\times10^{4}$ km. We find that this is inconsistent with the expected emission sizes for the large radial distance models, and is more naturally explained with an emission process that operates within or just beyond the magnetosphere of a central compact object. Recently, FRB 20221022A was found to exhibit an S-shaped polarisation angle swing, supporting a magnetospheric emission process. The scintillation results presented in this work independently support this conclusion, while highlighting scintillation as a useful tool in our understanding of FRB emission physics and progenitors.


title: Advancing Solar Flare Prediction using Deep Learning with Active Region Patches

abstract: In this paper, we introduce a novel methodology for leveraging shape-based characteristics of magnetograms of active region (AR) patches and provide a novel capability for predicting solar flares covering the entirety of the solar disk (AR patches spanning from -90$^{\circ}$ to +90$^{\circ}$ of solar longitude). We create three deep learning models: (i) ResNet34, (ii) MobileNet, and (iii) MobileViT to predict $\geq$M-class flares and assess the efficacy of these models across various ranges of solar longitude. Given the inherent imbalance in our data, we employ augmentation techniques alongside undersampling during the model training phase, while maintaining imbalanced partitions in the testing data for realistic evaluation. We use a composite skill score (CSS) as our evaluation metric, computed as the geometric mean of the True Skill Score (TSS) and the Heidke Skill Score (HSS) to rank and compare models. The primary contributions of this work are as follows: (i) We introduce a novel capability in solar flare prediction that allows predicting flares for each ARs throughout the solar disk and evaluate and compare the performance, (ii) Our candidate model (MobileNet) achieves a CSS=0.51 (TSS=0.60 and HSS=0.44), CSS=0.51 (TSS=0.59 and HSS=0.44), and CSS=0.48 (TSS=0.56 and HSS=0.40) for AR patches within $\pm$30$^{\circ}$, $\pm$60$^{\circ}$, $\pm$90$^{\circ}$ of solar longitude respectively. Additionally, we demonstrate the ability to issue flare forecasts for ARs in near-limb regions (regions between $\pm$60$^{\circ}$ to $\pm$90 $^{\circ}$) with a CSS=0.39 (TSS=0.48 and HSS=0.32), expanding the scope of AR-based models for solar flare prediction. This advancement opens new avenues for more reliable prediction of solar flares, thereby contributing to improved forecasting capabilities.


title: Ultrabroadband, ultranarrowband and ultrapassband composite polarisation half-wave plates, ultrabroadband composite polarisation pi-rotators and on the quantum-classical analogy

abstract: Composite pulses, which produce ultrabroadband, ultranarrowband and ultrapassband $x$-, $y$-) rotations by $\theta = \pi$ on the Bloch-Poincar\'e sphere, are presented. The first class plays a role for design of achromatic polarisation retarders, when the second class corresponds to chromatic polarisation filters. The third class is an assortment of the above two classes. Besides, composite pulses, which produce ultrabroadband $z$-) rotations by $\zeta = \pi$ on the same sphere, are presented. These phasal pulses coincide with achromatic polarisation $\pi$ rotators. On the quantum-classical analogy, we obtain ultrarobust, ultrasensitive and ultrasquare quantum control of a $X$ gate and ultrarobust quantum control of a $Z$ gate.


title: Reachability Analysis for Linear Systems with Uncertain Parameters using Polynomial Zonotopes

abstract: In real world applications, uncertain parameters are the rule rather than the exception. We present a reachability algorithm for linear systems with uncertain parameters and inputs using set propagation of polynomial zonotopes. In contrast to previous methods, our approach is able to tightly capture the non-convexity of the reachable set. Building up on our main result, we show how our reachability algorithm can be extended to handle linear time-varying systems as well as linear systems with time-varying parameters. Moreover, our approach opens up new possibilities for reachability analysis of linear time-invariant systems, nonlinear systems, and hybrid systems. We compare our approach to other state of the art methods, with superior tightness on two benchmarks including a 9-dimensional vehicle platooning system. Moreover, as part of the journal extension, we investigate through a polynomial zonotope with special structure named multi-affine zonotopes and its optimization problem. We provide the corresponding optimization algorithm and experiment over the examples obatined from two benchmark systems, showing the efficiency and scalability comparing to the state of the art method for handling such type of set representation.


title: Design of Interacting Particle Systems for Fast and Efficient Reinforcement Learning

abstract: This paper is concerned with the design of algorithms based on systems of interacting particles to represent, approximate, and learn the optimal control law for reinforcement learning (RL). The primary contribution of the present paper is to show that convergence rates can be accelerated dramatically through careful design of interactions between particles. Theory focuses on the linear quadratic stochastic optimal control problem for which a complete and novel theory is presented. Apart from the new algorithm, sample complexity bounds are obtained, and it is shown that the mean square error scales as $1/N$ where $N$ is the number of particles. The theoretical results and algorithms are illustrated with numerical experiments and comparisons with other recent approaches, where the faster convergence of the proposed algorithm is numerically demonstrated.


abstract: We study Hopf Galois extensions of Hopf algebroids as a generalization of the theory for Hopf algebras. More precisely, we introduce (skew-)regular comodules and generalize the structure theorem for relative Hopf modules. Also, we show that if $N\subseteq P$ is a left $\mathcal{L}$-Galois extension and $\Gamma$ is a 2-cocycle of $\mathcal{L}$, then for the twisted comodule algebra ${}_{\Gamma}P$, $N\subseteq{}_{\Gamma}P$ is a left Hopf Galois extension of the twisted Hopf algebroid $\mathcal{L}^{\Gamma}$. We study twisted Drinfeld doubles of Hopf algebroids as examples for the Drinfeld twist theory. Finally, we introduce cleft extension and $\sigma$-twisted crossed products of Hopf algebroids. Moreover, we show the equivalence of cleft extensions, $\sigma$-twisted crossed products, and Hopf Galois extensions with normal basis properties, which generalize the theory of cleft extensions of Hopf algebras.


title: Isospin QCD as a laboratory for dense QCD

abstract: QCD with the isospin chemical potential, $\mu_I$, is a useful laboratory to delineate the microphysics in dense QCD. To study the quark-hadron-continuity we use a quark-meson model that interpolates hadronic and quark matter physics at microscopic level. The equation of state is dominated by mesons at low density but taken over by quarks at high density. We extend our previous studies with two-flavors to the three-flavors case to study the impact of the strangeness which may be brought by kaons $(K_+, K_0) = (u\bar{s}, s\bar{d})$ and the U$_A$(1) anomaly. In the normal phase the excitation energies of kaons are reduced by $\mu_I$ in the same way as hyperons in nuclear matter at finite baryon chemical potential. Once pions condense, kaon excitation energies increases as $\mu_I$ does. Moreover, strange quarks become more massive through the U$_A$(1) coupling to the condensed pions. Hence at zero and low temperature the strange hadrons and quarks are highly suppressed. The previous findings in two-flavor models, sound speed peak, negative trace anomaly, gaps insensitve to $\mu_I$, persist in our three-flavor model and remain consistent with the lattice results to $\mu_I \sim 1$ GeV. We discuss the non-perturbative power corrections and quark saturation effects as important ingredients to understand the crossover equations of state measured on the lattice.


title: Asteroseismology of the fast-rotating high-amplitude $\delta$ Scuti star V2367 Cygni

abstract: We present the comprehensive analysis of the high-amplitude $\delta$ Sct star V2367 Cygni. Firstly, we perform the frequency analysis for the whole available set of the {\it Kepler} and {\it TESS} photometry. Most of the frequency peaks are harmonics or combinations of the three known independent frequencies with the highest amplitudes, i.e., $\nu_1=5.66106$\,d$^{-1}$, $\nu_2=7.14898$\,d$^{-1}$ and $\nu_3=7.77557$\,d$^{-1}$. The total number of independent frequencies is 26 and 25 from the {\it Kepler} and {\it TESS} light curve, respectively. Then, using the $UBVRI$ time-series photometry, we unambiguously identify the dominant frequency $\nu_1$ as the radial mode, whereas in the case of frequencies $\nu_2$ and $\nu_3$ the most probable mode degrees are $\ell=0$ or $\ell=2$. However, only the frequency $\nu_2$ can be associated with a radial mode, and only if higher order effects of rotation are taken into account. Including the rotational mode coupling, we constructed complex seismic models of V2367\,Cyg, which fit $\nu_1$ and $\nu_2$ as radial modes, and reproduce the amplitude of bolometric flux variations (the parameter $f$) for the dominant mode. The empirical values of $f$ are derived from the $UBVRI$ amplitudes and phases. We rely on the Bayesian analysis based on Monte Carlo simulations to derive constraints on evolutionary stage, mass, rotation, overshooting from the convective core and efficiency of convective transport in the envelope. Our seismic analysis clearly indicates that V2367\,Cyg is in a post-MS phase of evolution. This is the first extensive seismic modelling that takes into account the effect of rotational coupling between pulsation modes.


title: Generalization and Knowledge Transfer in Abstract Visual Reasoning Models

abstract: We study generalization and knowledge reuse capabilities of deep neural networks in the domain of abstract visual reasoning (AVR), employing Raven's Progressive Matrices (RPMs), a recognized benchmark task for assessing AVR abilities. Two knowledge transfer scenarios referring to the I-RAVEN dataset are investigated. Firstly, inspired by generalization assessment capabilities of the PGM dataset and popularity of I-RAVEN, we introduce Attributeless-I-RAVEN, a benchmark with four generalization regimes that allow to test generalization of abstract rules applied to held-out attributes. Secondly, we construct I-RAVEN-Mesh, a dataset that enriches RPMs with a novel component structure comprising line-based patterns, facilitating assessment of progressive knowledge acquisition in transfer learning setting. The developed benchmarks reveal shortcomings of the contemporary deep learning models, which we partly address with Pathways of Normalized Group Convolution (PoNG) model, a novel neural architecture for solving AVR tasks. PoNG excels in both presented challenges, as well as the standard I-RAVEN and PGM setups.


title: To Ban or Not to Ban: Uses and Gratifications of Mobile Phones among Township High School Learners

abstract: The proliferation of mobile phone usage among learners from diverse socio-economic backgrounds has prompted school authorities to contemplate banning these devices within educational institutions. This research seeks to explore the motivations and usage patterns of high school learners in response to the proposed ban. Employing a mixed-methods approach, we conducted surveys and interviews with 262 students from three township schools in the Western Cape province of South Africa. Grounded in the Uses and Gratification Theory (UGT), our study examined four key categories: reasons for mobile phone use, usage patterns, purchasing influences, and behavioral factors. Our findings reveal a predominant opposition among students to the ban, despite a significant number opting to leave their phones at home due to concerns about theft and robbery in their neighborhoods. Financial constraints, specifically the inability to afford data bundles and airtime, also contribute to this behavior. Notably, 40% of the participants reported using their phones for more than five hours daily, a duration classified as overuse in existing literature. The primary motivations for mobile phone use among these learners include socializing, internet browsing for non-educational purposes, and using the device for entertainment and recreation. This study highlights critical insights into the nuanced relationship between high school learners and mobile phone usage, offering valuable perspectives for policymakers and educators considering the implications of a mobile phone ban in schools.


title: FastPoseCNN: Real-Time Monocular Category-Level Pose and Size Estimation Framework

abstract: The primary focus of this paper is the development of a framework for pose and size estimation of unseen objects given a single RGB image - all in real-time. In 2019, the first category-level pose and size estimation framework was proposed alongside two novel datasets called CAMERA and REAL. However, current methodologies are restricted from practical use because of its long inference time (2-4 fps). Their approach's inference had significant delays because they used the computationally expensive MaskedRCNN framework and Umeyama algorithm. To optimize our method and yield real-time results, our framework uses the efficient ResNet-FPN framework alongside decoupling the translation, rotation, and size regression problem by using distinct decoders. Moreover, our methodology performs pose and size estimation in a global context - i.e., estimating the involved parameters of all captured objects in the image all at once. We perform extensive testing to fully compare the performance in terms of precision and speed to demonstrate the capability of our method.


title: Continual Test-time Adaptation for End-to-end Speech Recognition on Noisy Speech

abstract: Deep learning-based end-to-end automatic speech recognition (ASR) has made significant strides but still struggles with performance on out-of-domain (OOD) samples due to domain shifts in real-world scenarios. Test-Time Adaptation (TTA) methods address this issue by adapting models using test samples at inference time. However, current ASR TTA methods have largely focused on non-continual TTA, which limits cross-sample knowledge learning compared to continual TTA. In this work, we propose a Fast-slow TTA framework for ASR, which leverages the advantage of continual and non-continual TTA. Within this framework, we introduce Dynamic SUTA (DSUTA), an entropy-minimization-based continual TTA method for ASR. To enhance DSUTA's robustness on time-varying data, we propose a dynamic reset strategy that automatically detects domain shifts and resets the model, making it more effective at handling multi-domain data. Our method demonstrates superior performance on various noisy ASR datasets, outperforming both non-continual and continual TTA baselines while maintaining robustness to domain changes without requiring domain boundary information.


title: Can LLMs Understand the Implication of Emphasized Sentences in Dialogue?

abstract: Emphasis is a crucial component in human communication, which indicates the speaker's intention and implication beyond pure text in dialogue. While Large Language Models (LLMs) have revolutionized natural language processing, their ability to understand emphasis in dialogue remains unclear. This paper introduces Emphasized-Talk, a benchmark with emphasis-annotated dialogue samples capturing the implications of emphasis. We evaluate various LLMs, both open-source and commercial, to measure their performance in understanding emphasis. Additionally, we propose an automatic evaluation pipeline using GPT-4, which achieves a high correlation with human rating. Our findings reveal that although commercial LLMs generally perform better, there is still significant room for improvement in comprehending emphasized sentences.


title: Parameter Blending for Multi-Camera Harmonization for Automotive Surround View Systems

abstract: In a surround view system, the image color and tone captured by multiple cameras can be different due to cameras applying auto white balance (AWB), global tone mapping (GTM) individually for each camera. The color and brightness along stitched seam location may look discontinuous among multiple cameras which impacts overall stitched image visual quality. To improve the color transition between adjacent cameras in stitching algorithm, we propose harmonization algorithm which applies before stitching to adjust multiple cameras' color and tone so that stitched image has smoother color and tone transition between adjacent cameras. Our proposed harmonization algorithm consists of AWB harmonization and GTM harmonization leveraging Image Signal Processor (ISP)'s AWB and GTM metadata statistics. Experiment result shows that our proposed algorithm outperforms global color transfer method in both visual quality and computational cost.


title: GRAPH -- An readout ASIC for large MCP based detectors

abstract: We present a programmable 16 channel, mixed signal, low power readout ASIC, having the project historically named Gigasample Recorder of Analog waveforms from a PHotodetector (GRAPH). It is designed to read large aperture single photon imaging detectors using micro channel plates for charge multiplication, and measuring the detector's response on crossed strips anodes to extrapolate the incoming photon position. Each channel consists of a fast, low power and low noise charge sensitive amplifier, which provides a myriad of coarse and fine programmable options for gain and shaping settings. Further, the amplified signal is recorded using, to our knowledge novel, the Hybrid Universal sampLing Architecture (HULA), a mixed signal double buffer memory, that enables concurrent waveform recording, and selected event digitized data extraction. The sampling frequency is freely adjustable between few~kHz up to 125~MHz, while the chip's internal digital memory holds a history 2048 samples for each channel, with a digital headroom of 12 bits. An optimized region of interest sample-read algorithm allows to extract the information just around the event pulse peak, while selecting the next event, thus substantially reducing the operational dead time. The chip is designed in 130~$n$m TSMC CMOS technology, and its power consumption is around 47~$m$W per channel.


title: A Unified View of Abstract Visual Reasoning Problems

abstract: The field of Abstract Visual Reasoning (AVR) encompasses a wide range of problems, many of which are inspired by human IQ tests. The variety of AVR tasks has resulted in state-of-the-art AVR methods being task-specific approaches. Furthermore, contemporary methods consider each AVR problem instance not as a whole, but in the form of a set of individual panels with particular locations and roles (context vs. answer panels) pre-assigned according to the task-specific arrangements. While these highly specialized approaches have recently led to significant progress in solving particular AVR tasks, considering each task in isolation hinders the development of universal learning systems in this domain. In this paper, we introduce a unified view of AVR tasks, where each problem instance is rendered as a single image, with no a priori assumptions about the number of panels, their location, or role. The main advantage of the proposed unified view is the ability to develop universal learning models applicable to various AVR tasks. What is more, the proposed approach inherently facilitates transfer learning in the AVR domain, as various types of problems share a common representation. The experiments conducted on four AVR datasets with Raven's Progressive Matrices and Visual Analogy Problems, and one real-world visual analogy dataset show that the proposed unified representation of AVR tasks poses a challenge to state-of-the-art Deep Learning (DL) AVR models and, more broadly, contemporary DL image recognition methods. In order to address this challenge, we introduce the Unified Model for Abstract Visual Reasoning (UMAVR) capable of dealing with various types of AVR problems in a unified manner. UMAVR outperforms existing AVR methods in selected single-task learning experiments, and demonstrates effective knowledge reuse in transfer learning and curriculum learning setups.


title: WildVision: Evaluating Vision-Language Models in the Wild with Human Preferences

abstract: Recent breakthroughs in vision-language models (VLMs) emphasize the necessity of benchmarking human preferences in real-world multimodal interactions. To address this gap, we launched WildVision-Arena (WV-Arena), an online platform that collects human preferences to evaluate VLMs. We curated WV-Bench by selecting 500 high-quality samples from 8,000 user submissions in WV-Arena. WV-Bench uses GPT-4 as the judge to compare each VLM with Claude-3-Sonnet, achieving a Spearman correlation of 0.94 with the WV-Arena Elo. This significantly outperforms other benchmarks like MMVet, MMMU, and MMStar. Our comprehensive analysis of 20K real-world interactions reveals important insights into the failure cases of top-performing VLMs. For example, we find that although GPT-4V surpasses many other models like Reka-Flash, Opus, and Yi-VL-Plus in simple visual recognition and reasoning tasks, it still faces challenges with subtle contextual cues, spatial reasoning, visual imagination, and expert domain knowledge. Additionally, current VLMs exhibit issues with hallucinations and safety when intentionally provoked. We are releasing our chat and feedback data to further advance research in the field of VLMs.


title: Fine-grained Classes and How to Find Them

abstract: In many practical applications, coarse-grained labels are readily available compared to fine-grained labels that reflect subtle differences between classes. However, existing methods cannot leverage coarse labels to infer fine-grained labels in an unsupervised manner. To bridge this gap, we propose FALCON, a method that discovers fine-grained classes from coarsely labeled data without any supervision at the fine-grained level. FALCON simultaneously infers unknown fine-grained classes and underlying relationships between coarse and fine-grained classes. Moreover, FALCON is a modular method that can effectively learn from multiple datasets labeled with different strategies. We evaluate FALCON on eight image classification tasks and a single-cell classification task. FALCON outperforms baselines by a large margin, achieving 22% improvement over the best baseline on the tieredImageNet dataset with over 600 fine-grained classes.


title: Color-switching in an optical parametric oscillator using a phase-conjugate mirror

abstract: We construct a phase-conjugate resonator which passively produces stable pulses that alternate between the probe and the conjugate colors. The requisite phase-conjugate mirror inside the resonator is constructed using non-degenerate four-wave mixing (4WM) in rubidium vapor. The glancing-angle phase-conjugate mirror is a 100\% output coupler, and therefore this resonator is unusual in that no light circulates the cavity more than once. Without the gain of the phase-conjugate mirror, the cavity boundary conditions, and thus resonant modes, are not defined and therefore can be tuned by the pump. The output of the optical parametric oscillator that is formed above threshold can passively mode-lock. The phase-conjugate mirror removes thermal or acoustic instabilities that are on a MHz or slower timescale. This work provides a new method for stable pulsing using phase-conjugate optics, and suggests a platform for producing mode-locked pulses with squeezed light, as the 4WM process has already demonstrated quantum correlations.


title: Topological phases of commensurate or incommensurate non-Hermitian Su-Schrieffer-Heeger lattices

abstract: We theoretically investigate topological features of a one-dimensional Su-Schrieffer-Heeger lattice with modulating non-Hermitian on-site potentials containing four sublattices per unit cell. The lattice can be either commensurate or incommensurate. In the former case, the entire lattice can be mapped by supercells completely. While in the latter case, there are two extra lattice points, thereby making the last cell incomplete. We find that an anti-PT transition occurs at exceptional points of edge states at certain parameters, which does not coincide with the conventional topological phase transition characterized by the Berry phase, provided the imaginary on-site potential is large enough. Interestingly, when the potential exceeds a critical value, edge states appear even in the regime with a trivial Berry phase. To characterize these novel edge states we present topological invariants associated with the system's parity. Finally, we analyze the dynamics for initial states with different spatial distributions, which exhibit distinct dynamics for the commensurate and incommensurate cases, depending on the imaginary part of edge state energy.


title: Exploring the Limitations of Detecting Machine-Generated Text

abstract: Recent improvements in the quality of the generations by large language models have spurred research into identifying machine-generated text. Systems proposed for the task often achieve high performance. However, humans and machines can produce text in different styles and in different domains, and it remains unclear whether machine generated-text detection models favour particular styles or domains. In this paper, we critically examine the classification performance for detecting machine-generated text by evaluating on texts with varying writing styles. We find that classifiers are highly sensitive to stylistic changes and differences in text complexity, and in some cases degrade entirely to random classifiers. We further find that detection systems are particularly susceptible to misclassify easy-to-read texts while they have high performance for complex texts.


title: Cusps of caustics by reflection in ellipses

abstract: This paper is concerned with the billiard version of Jacobi's last geometric statement and its generalizations. Given a non-focal point $O$ inside an elliptic billiard table, one considers the family of rays emanating from $O$ and the caustic $\Gamma_n$ of the reflected family after $n$ reflections off the ellipse, for each positive integer $n$. It is known that $\Gamma_n$ has at least four cusps and it has been conjectured that it has exactly four (ordinary) cusps. The present paper presents a proof of this conjecture in the special case when the ellipse is a circle. In the case of an arbitrary ellipse, we give an explicit description of the location of four of the cusps of $\Gamma_n$, though we do not prove that these are the only cusps.


title: Perturbation-Resilient Trades for Dynamic Service Balancing

abstract: A combinatorial trade is a pair of sets of blocks of elements that can be exchanged while preserving relevant subset intersection constraints. The class of balanced and swap-robust minimal trades was proposed in [1] for exchanging blocks of data chunks stored on distributed storage systems in an access- and load-balanced manner. More precisely, data chunks in the trades of interest are labeled by popularity ranks and the blocks are required to have both balanced overall popularity and stability properties with respect to swaps in chunk popularities. The original construction of such trades relied on computer search and paired balanced sets obtained through iterative combining of smaller sets that have provable stability guarantees. To reduce the substantial gap between the results of prior approaches and the known theoretical lower bound, we present new analytical upper and lower bounds on the minimal disbalance of blocks introduced by limited-magnitude popularity ranking swaps. Our constructive and near-optimal approach relies on pairs of graphs whose vertices are two balanced sets with edges/arcs that capture the balance and potential balance changes induced by limited-magnitude popularity swaps. In particular, we show that if we start with carefully selected balanced trades and limit the magnitude of rank swaps to one, the new upper and lower bound on the maximum block disbalance caused by a swap only differ by a factor of $1.07$. We also extend these results for larger popularity swap magnitudes.


title: Bundles of metric structures as left ultrafunctors

abstract: We pursue the study of Ultracategories initiated by Makkai and more recently Lurie by looking at properties of Ultracategories of complete metric structures, i.e. coming from continuous model theory, instead of ultracategories of models of first order theories. Our main result is that for any continuous theory $\mathbb{T}$, there is an equivalence between the category of left ultrafunctors from a compact Hausdorff space $X$ to the category of $\mathbb{T}$-models and a notion of bundle of $\mathbb{T}$-models over $X$. The notion of bundle of $\mathbb{T}$-models is new but recovers many classical notions like Bundle of Banach spaces, or (semi)-continuous field of $\mathrm{C}^*$-algebras or Hilbert spaces.


title: Learning Relighting and Intrinsic Decomposition in Neural Radiance Fields

abstract: The task of extracting intrinsic components, such as reflectance and shading, from neural radiance fields is of growing interest. However, current methods largely focus on synthetic scenes and isolated objects, overlooking the complexities of real scenes with backgrounds. To address this gap, our research introduces a method that combines relighting with intrinsic decomposition. By leveraging light variations in scenes to generate pseudo labels, our method provides guidance for intrinsic decomposition without requiring ground truth data. Our method, grounded in physical constraints, ensures robustness across diverse scene types and reduces the reliance on pre-trained models or hand-crafted priors. We validate our method on both synthetic and real-world datasets, achieving convincing results. Furthermore, the applicability of our method to image editing tasks demonstrates promising outcomes.


title: 2d QCD and Integrability, Part II: Generalized QCD

abstract: We extend our study of integrable structures in large $N_c$ QCD$_2$ to a broad class of theories called the generalized QCD, which are given by the Lagrangian $\mathcal{L}\propto {\rm tr}\,B\wedge F- {\rm tr}\,V(B)$ coupled to quarks in the fundamental representation. We recast the Bethe-Salpeter equation for the meson spectrum into a TQ-Baxter equation and determine a transfer matrix in a closed form for any given polynomial $V(B)$. Using this reformulation, we derive the asymptotic expansion of energy levels and wavefunctions. Examining the analytic structure of the spectrum as a function of the coefficients of $V(B)$, we determine the region of couplings where the theory admits a positive and discrete spectrum of mesons. Furthermore, we uncover a multi-sheeted structure with infinitely many multi-critical points, where several mesons become simultaneously massless. Lastly, we illustrate that this structure persists in the large-representation limit of the generalized QCD with the SU(2) gauge group.


title: GANmut: Generating and Modifying Facial Expressions

abstract: In the realm of emotion synthesis, the ability to create authentic and nuanced facial expressions continues to gain importance. The GANmut study discusses a recently introduced advanced GAN framework that, instead of relying on predefined labels, learns a dynamic and interpretable emotion space. This methodology maps each discrete emotion as vectors starting from a neutral state, their magnitude reflecting the emotion's intensity. The current project aims to extend the study of this framework by benchmarking across various datasets, image resolutions, and facial detection methodologies. This will involve conducting a series of experiments using two emotional datasets: Aff-Wild2 and AffNet. Aff-Wild2 contains videos captured in uncontrolled environments, which include diverse camera angles, head positions, and lighting conditions, providing a real-world challenge. AffNet offers images with labelled emotions, improving the diversity of emotional expressions available for training. The first two experiments will focus on training GANmut using the Aff-Wild2 dataset, processed with either RetinaFace or MTCNN, both of which are high-performance deep learning face detectors. This setup will help determine how well GANmut can learn to synthesise emotions under challenging conditions and assess the comparative effectiveness of these face detection technologies. The subsequent two experiments will merge the Aff-Wild2 and AffNet datasets, combining the real world variability of Aff-Wild2 with the diverse emotional labels of AffNet. The same face detectors, RetinaFace and MTCNN, will be employed to evaluate whether the enhanced diversity of the combined datasets improves GANmut's performance and to compare the impact of each face detection method in this hybrid setup.


title: Electron-electron interactions in partially mixed helical states

abstract: We theoretically study the effect of electron-electron interactions in one-dimensional partially mixed helical states. These helical states can be realized at the edges of two-dimensional topological insulators with partially broken time-reversal symmetry, resulting in helical gapped states. Using the bosonization method and renormalization group analysis, we identify weak gap, crossover, and strong gap regimes in the phase diagram. We find that strong electron-electron interaction mixes the helicity of the states, leading to the relevant strong gap regime. We investigate the charge and spin density wave correlation functions in different relevancy regimes of the gap mediated by interactions, where in the case of strong repulsive interaction, the spin density wave dominates the charge density wave. Additionally, employing the Memory function technique, we calculate the effect of mixed helicity on the charge transport in a sufficiently long edge. We find a non-uniform temperature dependence for the charge conductivity in both the strong and weak gap regimes with distinct features.


title: A Bayesian dynamic stopping method for evoked response brain-computer interfacing

abstract: As brain-computer interfacing (BCI) systems transition from assistive technology to more diverse applications, their speed, reliability, and user experience become increasingly important. Dynamic stopping methods enhance BCI system speed by deciding at any moment whether to output a result or wait for more information. Such approach leverages trial variance, allowing good trials to be detected earlier, thereby speeding up the process without significantly compromising accuracy. Existing dynamic stopping algorithms typically optimize measures such as symbols per minute (SPM) and information transfer rate (ITR). However, these metrics may not accurately reflect system performance for specific applications or user types. Moreover, many methods depend on arbitrary thresholds or parameters that require extensive training data. We propose a model-based approach that takes advantage of the analytical knowledge that we have about the underlying classification model. By using a risk minimisation approach, our model allows precise control over the types of errors and the balance between precision and speed. This adaptability makes it ideal for customizing BCI systems to meet the diverse needs of various applications. We validate our proposed method on a publicly available dataset, comparing it with established static and dynamic stopping methods. Our results demonstrate that our approach offers a broad range of accuracy-speed trade-offs and achieves higher precision than baseline stopping methods.


title: Simultaneously Transmitting and Reflecting Surfaces for Ubiquitous Next Generation Multiple Access in 6G and Beyond

abstract: The ultimate goal of next generation multiple access (NGMA) is to support massive terminals and facilitate multiple functionalities over the limited radio resources of wireless networks in the most efficient manner possible. However, the random and uncontrollable wireless radio environment is a major obstacle to realizing this NGMA vision. Given the prominent feature of achieving 360{\deg} smart radio environment, simultaneously transmitting and reflecting surfaces (STARS) are emerging as one key enabling technology among the family of reconfigurable intelligent surfaces for NGMA. This paper provides a comprehensive overview of the recent research progress of STARS, focusing on fundamentals, performance analysis, and full-space beamforming design, as well as promising employments of STARS in NGMA. In particular, we first introduce the basics of STARS by elaborating on the foundational principles and operating protocols as well as discussing different STARS categories and prototypes. Moreover, we systematically survey the existing performance analysis and beamforming design for STARS-aided wireless communications in terms of diverse objectives and different mathematical approaches. Given the superiority of STARS, we further discuss advanced STARS applications as well as the attractive interplay between STARS and other emerging techniques to motivate future works for realizing efficient NGMA.


title: Fixed-node errors in real space quantum Monte Carlo at high densities: closed-shell atomic correlation energies

abstract: We consider non-relativistic electron correlation energies of heavy noble gas atoms including the superheavy element Og. The corresponding data enables us to quantify fixed-node errors in real space quantum Monte Carlo methods as a function of the atomic number $Z$. We confirm that single-reference trial function nodes lead to an overall trend of mild decrease in recovered correlation energy with the increasing $Z$. This agrees with our previous study that has shown increasing fixed-node biases with the increasing electron density. We also estimate the value of the linear term in the asymptotic expansion of the atomic correlation energy.


title: K-stability of Z-stable C*-algebras

abstract: We provide a shorter new proof of the fact that Z-stable C*-algebras are K1-surjective using the R{\o}rdam-Winter picture of the Jiang-Su algebra Z. Consequently, we recapture the K-stability of Z-stable C*-algebras.


title: Multiple Sources are Better Than One: Incorporating External Knowledge in Low-Resource Glossing

abstract: In this paper, we address the data scarcity problem in automatic data-driven glossing for low-resource languages by coordinating multiple sources of linguistic expertise. We supplement models with translations at both the token and sentence level as well as leverage the extensive linguistic capability of modern LLMs. Our enhancements lead to an average absolute improvement of 5%-points in word-level accuracy over the previous state of the art on a typologically diverse dataset spanning six low-resource languages. The improvements are particularly noticeable for the lowest-resourced language Gitksan, where we achieve a 10%-point improvement. Furthermore, in a simulated ultra-low resource setting for the same six languages, training on fewer than 100 glossed sentences, we establish an average 10%-point improvement in word-level accuracy over the previous state-of-the-art system.


title: A Bayesian Drift-Diffusion Model of Schachter-Singer's Two Factor Theory of Emotion

abstract: Bayesian inference has been used in the past to model visual perception (Kersten, Mamassian, & Yuille, 2004), accounting for the Helmholtz principle of perception as "unconscious inference" that is constrained by bottom-up sensory evidence (likelihood) while subject to top-down expectation, priming, or other contextual influences (prior bias); here "unconsciousness" merely relates to the "directness" of perception in the sense of Gibson. Here, we adopt the same Bayesian framework to model emotion process in accordance with Schachter-Singer's Two-Factor theory, which argues that emotion is the outcome of cognitive labeling or attribution of a diffuse pattern of autonomic arousal (Schachter & Singer, 1962). In analogous to visual perception, we conceptualize the emotion process as an instance of Bayesian inference, combining the contextual information with a person's physiological arousal patterns. Drift-diffusion models were constructed to simulate emotional processes, where the decision boundaries correspond to the emotional state experienced by the participants, and boundary-crossing constitutes "labeling" in Schachter-Singer's sense. Our model is tested against experimental data from the Schachter & Singer's study (1962) and the Ross et al. study (1969). Two model scenarios are investigated, in which arousal pattern as one factor is pitted against contextual interaction with an confederate (in Schachter-Singer case) or explicitly instructed mis-attribution (in Ross et al. case) as another factor, mapping onto the Bayesian prior (initial position of the drift) and the likelihood function (evidence accumulation or drift rate). We find that the first scenario (arousal as the prior and context as the likelihood) has a better fit with Schachter & Singer (1962) whereas the second scenario (context as the prior and arousal as the likelihood) has a better fit with Ross et al. (1969).


title: MemDPT: Differential Privacy for Memory Efficient Language Models

abstract: Large language models have consistently demonstrated remarkable performance across a wide spectrum of applications. Nonetheless, the deployment of these models can inadvertently expose user privacy to potential risks. The substantial memory demands of these models during training represent a significant resource consumption challenge. The sheer size of these models imposes a considerable burden on memory resources, which is a matter of significant concern in practice. In this paper, we present an innovative training framework MemDPT that not only reduces the memory cost of large language models but also places a strong emphasis on safeguarding user data privacy. MemDPT provides edge network and reverse network designs to accommodate various differential privacy memory-efficient fine-tuning schemes. Our approach not only achieves $2 \sim 3 \times$ memory optimization but also provides robust privacy protection, ensuring that user data remains secure and confidential. Extensive experiments have demonstrated that MemDPT can effectively provide differential privacy efficient fine-tuning across various task scenarios.


title: Lifetime of Infrared Quantum Information in Qubits

abstract: Clarifying the principles leading to complete decoherence is essential for understanding information loss in black hole formation. We employ strictly perturbative quantum master equations to compute the long-term decoherence rate in infrared-divergent qubit dynamics. In moderately sub-Ohmic dissipation, we find that this rate exceeds the Hubble's constant, meaning that infrared particles do not completely destroy quantum information at the universe's current age. Deep sub-Ohmic dissipation leads to infrared-divergent recovery of quantum coherence.


title: Exponential localization of 2d Magnetic Schr\"odinger eigenfunctions via Brownian flux

abstract: We study solutions of $\tfrac12 (-i\nabla - A(x))^2f=\lambda f$ on domains $\Omega\subset \mathbb{R}^2$ with Dirichlet boundary conditions and prove exponential decay estimates in terms of an Agmon type distance to a classically allowed region. This metric depends only on the eigenvalue and associated magnetic field. In fact the main quantity in the weight for this distance function can be interpreted as an `average magnetic flux' of the magnetic field along all domains whose boundary is the closed curved formed by joing the `minimal path' to another random path. Our estimates are based on an analysis of the associated heat kernel using the Feynman-Kac-It\'o formula.


title: Extensions of finitely generated Veech groups

abstract: Given a closed surface $S$ with finitely generated Veech group $G$ and its $\pi_1(S)$-extension $\Gamma$, there exists a hyperbolic space $\hat{E}$ on which $\Gamma$ acts isometrically and cocompactly. The space $\hat{E}$ is obtained by collapsing some regions of the surface bundle over the convex hull of the limit set of $G$. Using the nice action of $\Gamma$ on the hyperbolic space $\hat{E}$, it is shown that $\Gamma$ is hierarchically hyperbolic. These are generalizations of results from Dowdall-Durham-Leininger-Sisto, which assume in addition that $G$ is a lattice. Because finitely generated Veech groups are among the most basic examples of subgroups of mapping class groups which are expected to qualify as geometrically finite, this result is evidence for the development of a broader theory of geometric finiteness.


title: Proton Decay and Gauge Coupling Unification in an Extended SU(5) GUT with 45-Dimensional Higgs

abstract: We present a comprehensive study of an extended SU(5) grand unified theory (GUT) that incorporates a 45-dimensional Higgs representation to address the shortcomings of the minimal SU(5) GUT, such as the inability to generate realistic fermion mass hierarchies and insufficient proton stability. By considering a hierarchical mass spectrum for the scalar components of the 45-Higgs, we demonstrate that successful gauge coupling unification (GCU) can be achieved. The color octet scalar, color triplet scalar, and color anti-triplet scalar play crucial roles in realizing GCU when their masses are significantly lighter than other components of the 45-Higgs. We focuses on the proton decay channels mediated by the exchange of the color anti-triplet scalar. Assuming that the 45-Higgs couples to all three generations of fermions, we determine the 45-Higgs Yukawa couplings with which the observed fermion mass matrices at low energies are realized. We calculate proton decay rates using the Yukawa couplings obtained from renormalization group evolutions and matching conditions at the GUT scale, thereby exploring the dependence of proton decay rates on model parameters. We find that the $p \to \nu \pi$ mode imposes the most stringent constraint on the mass of the color anti-triplet scalar $M_{S_1}$. We also study the correlations between the lower bounds on $M_{S_1}$ derived from different proton decay modes.