title: Elucidating nanostructural organisation and photonic properties of butterfly wing scales using hyperspectral microscopy

abstract: Biophotonic nanostructures in butterfly wing scales remain fascinating examples of biological functional materials, with intriguing open questions in regards to formation and evolutionary function. One particularly interesting butterfly species, Erora opisena (Lycaenidae: Theclinae), develops wing scales that contain three-dimensional photonic crystals that closely resemble a single gyroid geometry. Unlike most other gyroid forming butterflies, E. opisena develops discrete gyroid crystallites with a pronounced size gradient hinting at a developmental sequence frozen in time. Here, we use a hyperspectral (wavelength-resolved) microscopy technique to investigate the ultrastructural organisation of these gyroid crystallites in dry, adult wing scales. We show that reflectance corresponds to crystallite size, where larger crystallites reflect green wavelengths more intensely; this relationship could be used to infer size from the optical signal. We further successfully resolve the red-shifted reflectance signal from wing scales immersed in refractive index oils with varying refractive index, including values similar to water or cytosol. Such photonic crystals with lower refractive index contrast may be similar to the hypothesized nanostructural forms in the developing butterfly scales. The ability to resolve these fainter signals hints at the potential of this facile light microscopy method for in vivo analysis of nanostructure formation in developing butterflies.


title: A Qualitative Analysis Framework for mHealth Privacy Practices

abstract: Mobile Health (mHealth) applications have become a crucial part of health monitoring and management. However, the proliferation of these applications has also raised concerns over the privacy and security of Personally Identifiable Information and Protected Health Information. Addressing these concerns, this paper introduces a novel framework for the qualitative evaluation of privacy practices in mHealth apps, particularly focusing on the handling and transmission of sensitive user data. Our investigation encompasses an analysis of 152 leading mHealth apps on the Android platform, leveraging the proposed framework to provide a multifaceted view of their data processing activities. Despite stringent regulations like the General Data Protection Regulation in the European Union and the Health Insurance Portability and Accountability Act in the United States, our findings indicate persistent issues with negligence and misuse of sensitive user information. We uncover significant instances of health information leakage to third-party trackers and a widespread neglect of privacy-by-design and transparency principles. Our research underscores the critical need for stricter enforcement of data protection laws and sets a foundation for future efforts aimed at enhancing user privacy within the mHealth ecosystem.


title: Inference for the stochastic FitzHugh-Nagumo model from real action potential data via approximate Bayesian computation

abstract: The stochastic FitzHugh-Nagumo (FHN) model considered here is a two-dimensional nonlinear stochastic differential equation with additive degenerate noise, whose first component, the only one observed, describes the membrane voltage evolution of a single neuron. Due to its low dimensionality, its analytical and numerical tractability, and its neuronal interpretation, it has been used as a case study to test the performance of different statistical methods in estimating the underlying model parameters. Existing methods, however, often require complete observations, non-degeneracy of the noise or a complex architecture (e.g., to estimate the transition density of the process, "recovering" the unobserved second component), and they may not (satisfactorily) estimate all model parameters simultaneously. Moreover, these studies lack real data applications for the stochastic FHN model. Here, we tackle all challenges (non-globally Lipschitz drift, non-explicit solution, lack of available transition density, degeneracy of the noise, and partial observations) via an intuitive and easy-to-implement sequential Monte Carlo approximate Bayesian computation algorithm. The proposed method relies on a recent computationally efficient and structure-preserving numerical splitting scheme for synthetic data generation, and on summary statistics exploiting the structural properties of the process. We succeed in estimating all model parameters from simulated data and, more remarkably, real action potential data of rats. The presented novel real-data fit may broaden the scope and credibility of this classic and widely used neuronal model.


title: Symmetries of linear and nonlinear partial differential equations

abstract: We consider higher symmetries and operator symmetries of linear partial differential equations. The higher symmetries form a Lie algebra, and operator ones form an associative algebra. The relationship between these symmetries is established. We show that symmetries of linear equations sometimes generate symmetries of nonlinear ones. New symmetries of two-dimensional stationary equations of gas dynamics are found.


title: Recent Trends in Personalized Dialogue Generation: A Review of Datasets, Methodologies, and Evaluations

abstract: Enhancing user engagement through personalization in conversational agents has gained significance, especially with the advent of large language models that generate fluent responses. Personalized dialogue generation, however, is multifaceted and varies in its definition -- ranging from instilling a persona in the agent to capturing users' explicit and implicit cues. This paper seeks to systemically survey the recent landscape of personalized dialogue generation, including the datasets employed, methodologies developed, and evaluation metrics applied. Covering 22 datasets, we highlight benchmark datasets and newer ones enriched with additional features. We further analyze 17 seminal works from top conferences between 2021-2023 and identify five distinct types of problems. We also shed light on recent progress by LLMs in personalized dialogue generation. Our evaluation section offers a comprehensive summary of assessment facets and metrics utilized in these works. In conclusion, we discuss prevailing challenges and envision prospect directions for future research in personalized dialogue generation.


title: Massive Black Hole Seeds

abstract: The pathway(s) to seeding the massive black holes (MBHs) that exist at the heart of galaxies in the present and distant Universe remains an unsolved problem. Here we categorise, describe and quantitatively discuss the formation pathways of both $\textit{light}$ and $\textit{heavy}$ seeds. We emphasise that the most recent computational models suggest that rather than a bimodal-like mass spectrum between $\textit{light}$ and $\textit{heavy}$ seeds with $\textit{light}$ at one end and $\textit{heavy}$ at the other that instead a continuum exists. $\textit{Light}$ seeds being more ubiquitous and the heavier seeds becoming less and less abundant due the rarer environmental conditions required for their formation. We therefore examine the different mechanisms that give rise to different seed mass spectrums. We show how and why the mechanisms that produce the $\textit{heaviest}$ seeds are also among the rarest events in the Universe and are hence extremely unlikely to be the seeds for the vast majority of the MBH population. We quantify, within the limits of the current large uncertainties in the seeding processes, the expected number densities of the seed mass spectrum. We argue that $\textit{light}$ seeds must be at least $10^{3}$ to $10^{5}$ times more numerous than $\textit{heavy}$ seeds to explain the MBH population as a whole. Based on our current understanding of the seed population this makes $\textit{heavy}$ seeds ($\rm{M_{seed}} > 10^3$ M$_{\odot}$) a significantly more likely pathway given that $\textit{heavy}$ seeds have an abundance pattern than is close to and likely in excess of $10^{-4}$ compared to $\textit{light}$ seeds. Finally, we examine the current state-of-the-art in numerical calculations and recent observations and plot a path forward for near-future advances in both domains.


title: Yuan 2.0-M32: Mixture of Experts with Attention Router

abstract: Yuan 2.0-M32, with a similar base architecture as Yuan-2.0 2B, uses a mixture-of-experts architecture with 32 experts of which 2 experts are active. A new router network, Attention Router, is proposed and adopted for a more efficient selection of experts, which improves the accuracy compared to the model with classical router network. Yuan 2.0-M32 is trained with 2000B tokens from scratch, and the training computation consumption is only 9.25% of a dense model at the same parameter scale. Yuan 2.0-M32 demonstrates competitive capability on coding, math, and various domains of expertise, with only 3.7B active parameters of 40B in total, and 7.4 GFlops forward computation per token, both of which are only 1/19 of Llama3-70B. Yuan 2.0-M32 surpass Llama3-70B on MATH and ARC-Challenge benchmark, with accuracy of 55.89 and 95.8 respectively. The models and source codes of Yuan 2.0-M32 are released at Github1.


title: Aligning to Thousands of Preferences via System Message Generalization

abstract: Although humans inherently have diverse values, current large language model (LLM) alignment methods often assume that aligning LLMs with the general public's preferences is optimal. A major challenge in adopting a more individualized approach to LLM alignment is its lack of scalability, as it involves repeatedly acquiring preference data and training new reward models and LLMs for each individual's preferences. To address these challenges, we propose a new paradigm where users specify what they value most within the system message, steering the LLM's generation behavior to better align with the user's intentions. However, a naive application of such an approach is non-trivial since LLMs are typically trained on a uniform system message (e.g., "You are a helpful assistant") which limits their ability to generalize to diverse, unseen system messages. To improve this generalization, we create the Multifaceted Collection, a preference dataset with 192k combinations of values beyond generic helpfulness and harmlessness, spanning 65k user instructions. Using this dataset, we train a 7B LLM called Janus and test it on 921 prompts from 5 benchmarks (AlpacaEval 2.0, FLASK, Koala, MT-Bench, and Self-Instruct) by adding various unseen system messages that reflect user preferences. Janus achieves tie+win rate of 75.2%, 72.4%, and 66.4% against Mistral 7B Instruct v0.2, GPT-3.5 Turbo, and GPT-4, respectively. Unexpectedly, on three benchmarks focused on response helpfulness (AlpacaEval 2.0, MT-Bench, Arena Hard Auto v0.1), Janus also outperforms LLaMA 3 8B Instruct by a +4.0%, +0.1%, +3.0% margin, underscoring that training with a vast array of system messages could also enhance alignment to the general public's preference as well. Our code, dataset, benchmark, and models are available at https://github.com/kaistAI/Janus.


title: FASTopic: A Fast, Adaptive, Stable, and Transferable Topic Modeling Paradigm

abstract: Topic models have been evolving rapidly over the years, from conventional to recent neural models. However, existing topic models generally struggle with either effectiveness, efficiency, or stability, highly impeding their practical applications. In this paper, we propose FASTopic, a fast, adaptive, stable, and transferable topic model. FASTopic follows a new paradigm: Dual Semantic-relation Reconstruction (DSR). Instead of previous conventional, neural VAE-based or clustering-based methods, DSR discovers latent topics by reconstruction through modeling the semantic relations among document, topic, and word embeddings. This brings about a neat and efficient topic modeling framework. We further propose a novel Embedding Transport Plan (ETP) method. Rather than early straightforward approaches, ETP explicitly regularizes the semantic relations as optimal transport plans. This addresses the relation bias issue and thus leads to effective topic modeling. Extensive experiments on benchmark datasets demonstrate that our FASTopic shows superior effectiveness, efficiency, adaptivity, stability, and transferability, compared to state-of-the-art baselines across various scenarios. Our code is available at https://github.com/bobxwu/FASTopic .


title: Performance of Slotted ALOHA in User-Centric Cell-Free Massive MIMO

abstract: To efficiently utilize the scarce wireless resource, the random access scheme has been attaining renewed interest primarily in supporting the sporadic traffic of a large number of devices encountered in the Internet of Things (IoT). In this paper we investigate the performance of slotted ALOHA -- a simple and practical random access scheme -- in connection with the grant-free random access protocol applied for user-centric cell-free massive MIMO. More specifically, we provide the expression of the sum-throughput under the assumptions of the capture capability owned by the centralized detector in the uplink. Further, a comparative study of user-centric cell-free massive MIMO with other types of networks is provided, which allows us to identify its potential and possible limitation. Our numerical simulations show that the user-centric cell-free massive MIMO has a good trade-off between performance and fronthaul load, especially at low activation probability regime.


title: Peering into the Mind of Language Models: An Approach for Attribution in Contextual Question Answering

abstract: With the enhancement in the field of generative artificial intelligence (AI), contextual question answering has become extremely relevant. Attributing model generations to the input source document is essential to ensure trustworthiness and reliability. We observe that when large language models (LLMs) are used for contextual question answering, the output answer often consists of text copied verbatim from the input prompt which is linked together with "glue text" generated by the LLM. Motivated by this, we propose that LLMs have an inherent awareness from where the text was copied, likely captured in the hidden states of the LLM. We introduce a novel method for attribution in contextual question answering, leveraging the hidden state representations of LLMs. Our approach bypasses the need for extensive model retraining and retrieval model overhead, offering granular attributions and preserving the quality of generated answers. Our experimental results demonstrate that our method performs on par or better than GPT-4 at identifying verbatim copied segments in LLM generations and in attributing these segments to their source. Importantly, our method shows robust performance across various LLM architectures, highlighting its broad applicability. Additionally, we present Verifiability-granular, an attribution dataset which has token level annotations for LLM generations in the contextual question answering setup.


title: Explicit formulae for the mean value of products of values of Dirichlet $L$-functions at positive integers

abstract: Let $m\ge 1$ be a rational integer. We give an explicit formula for the mean value $$\frac{2}{\phi(f)}\sum_{\chi (-1)=(-1)^m}\vert L(m,\chi )\vert^2,$$ where $\chi$ ranges over the $\phi (f)/2$ Dirichlet characters modulo $f>2$ with the same parity as $m$. We then adapt our proof to obtain explicit means values for products of the form $L(m_1,\chi_1)\cdots L(m_{n-1},\chi_{n-1})\overline{L(m_n,\chi_1\cdots\chi_{n-1})}$.


title: Homomorphisms between the semirings of Boolean functions on 1-dimensional tropical fans

abstract: In a previous work, we stated the conjecture that any semiring homomorphism between the Boolean function semirings on 1-dimensional tropical fans has the property called geometric. In this paper, we show that the conjecture is true. As an application, we establish a way to find all the morphisms between given 1-dimensional tropical fans.


title: Reinforced Model Predictive Control via Trust-Region Quasi-Newton Policy Optimization

abstract: Model predictive control can optimally deal with nonlinear systems under consideration of constraints. The control performance depends on the model accuracy and the prediction horizon. Recent advances propose to use reinforcement learning applied to a parameterized model predictive controller to recover the optimal control performance even if an imperfect model or short prediction horizons are used. However, common reinforcement learning algorithms rely on first order updates, which only have a linear convergence rate and hence need an excessive amount of dynamic data. Higher order updates are typically intractable if the policy is approximated with neural networks due to the large number of parameters. In this work, we use a parameterized model predictive controller as policy, and leverage the small amount of necessary parameters to propose a trust-region constrained Quasi-Newton training algorithm for policy optimization with a superlinear convergence rate. We show that the required second order derivative information can be calculated by the solution of a linear system of equations. A simulation study illustrates that the proposed training algorithm outperforms other algorithms in terms of data efficiency and accuracy.


title: Cross-Context Backdoor Attacks against Graph Prompt Learning

abstract: Graph Prompt Learning (GPL) bridges significant disparities between pretraining and downstream applications to alleviate the knowledge transfer bottleneck in real-world graph learning. While GPL offers superior effectiveness in graph knowledge transfer and computational efficiency, the security risks posed by backdoor poisoning effects embedded in pretrained models remain largely unexplored. Our study provides a comprehensive analysis of GPL's vulnerability to backdoor attacks. We introduce \textit{CrossBA}, the first cross-context backdoor attack against GPL, which manipulates only the pretraining phase without requiring knowledge of downstream applications. Our investigation reveals both theoretically and empirically that tuning trigger graphs, combined with prompt transformations, can seamlessly transfer the backdoor threat from pretrained encoders to downstream applications. Through extensive experiments involving 3 representative GPL methods across 5 distinct cross-context scenarios and 5 benchmark datasets of node and graph classification tasks, we demonstrate that \textit{CrossBA} consistently achieves high attack success rates while preserving the functionality of downstream applications over clean input. We also explore potential countermeasures against \textit{CrossBA} and conclude that current defenses are insufficient to mitigate \textit{CrossBA}. Our study highlights the persistent backdoor threats to GPL systems, raising trustworthiness concerns in the practices of GPL techniques.


title: Diagnostics of magnetohydrodynamic modes in the ISM through synchrotron polarization statistics

abstract: One of the biggest challenges in understanding Magnetohydrodynamic (MHD) turbulence is identifying the plasma mode components from observational data. Previous studies on synchrotron polarization from the interstellar medium (ISM) suggest that the dominant MHD modes can be identified via statistics of Stokes parameters, which would be crucial for studying various ISM processes such as the scattering and acceleration of cosmic rays, star formation, dynamo. In this paper, we present a numerical study of the Synchrotron Polarization Analysis (SPA) method through systematic investigation of the statistical properties of the Stokes parameters. We derive the theoretical basis for our method from the fundamental statistics of MHD turbulence, recognizing that the projection of the MHD modes allows us to identify the modes dominating the energy fraction from synchrotron observations. Based on the discovery, we revise the SPA method using synthetic synchrotron polarization observations obtained from 3D ideal MHD simulations with a wide range of plasma parameters and driving mechanisms, and present a modified recipe for mode identification. We propose a classification criterion based on a new SPA+ fitting procedure, which allows us to distinguish between Alfv\'en mode and compressible/slow mode dominated turbulence. We further propose a new method to identify fast modes by analyzing the asymmetry of the SPA+ signature and establish a new asymmetry parameter to detect the presence of fast mode turbulence. Additionally, we confirm through numerical tests that the identification of the compressible and fast modes is not affected by Faraday rotation in both the emitting plasma and the foreground.


title: Representing the dissipation of infinite-dimensional linear port-Hamiltonian systems

abstract: It is well known that linear and non-linear dissipative port-Hamiltonian systems in finite dimensions admit an energy balance, relating the energy increase in the system with the supplied energy and the dissipated energy. The integrand in the dissipation term is then a function of the state variable. In this note, we answer the question of when this is possible for linear port-Hamiltonian systems in infinite dimensions.


title: BlueSWAT: A Lightweight State-Aware Security Framework for Bluetooth Low Energy

abstract: Bluetooth Low Energy (BLE) is a short-range wireless communication technology for resource-constrained IoT devices. Unfortunately, BLE is vulnerable to session-based attacks, where previous packets construct exploitable conditions for subsequent packets to compromise connections. Defending against session-based attacks is challenging because each step in the attack sequence is legitimate when inspected individually. In this paper, we present BlueSWAT, a lightweight state-aware security framework for protecting BLE devices. To perform inspection on the session level rather than individual packets, BlueSWAT leverages a finite state machine (FSM) to monitor sequential actions of connections at runtime. Patterns of session-based attacks are modeled as malicious transition paths in the FSM. To overcome the heterogeneous IoT environment, we develop a lightweight eBPF framework to facilitate universal patch distribution across different BLE architectures and stacks, without requiring device reboot. We implement BlueSWAT on 5 real-world devices with different chips and stacks to demonstrate its cross-device adaptability. On our dataset with 101 real-world BLE vulnerabilities, BlueSWAT can mitigate 76.1% of session-based attacks, outperforming other defense frameworks. In our end-to-end application evaluation, BlueSWAT patches introduce an average of 0.073% memory overhead and negligible latency.


title: Multi spacecraft study with the Icarus model: Modelling the propagation of CMEs to Mercury and Earth

abstract: Coronal Mass Ejections (CMEs) are the main drivers of the disturbances in interplanetary space. Understanding the CME interior magnetic structure is crucial for advancing space weather studies. Assessing the capabilities of a numerical heliospheric model is crucial, as understanding the nature and extent of its limitations can be used for improving the model and the space weather predictions based on it. The present paper aims to test the capabilities of the recently developed heliospheric model Icarus and the linear force-free spheromak model that has been implemented in it. To validate the Icarus space weather modeling tool, two CME events were selected that were observed by two spacecraft located near Mercury and Earth, respectively. This enables testing the heliospheric model computed with Icarus at two distant locations. The source regions for the CMEs were identified, and the CME parameters were determined and later optimized. Different adaptive mesh refinement levels were applied in the simulations to assess its performance by comparing the simulation results to in-situ measurements. The first CME event erupted on SOL2013-07-09T15:24. The modeled time series were in good agreement with the observations both at MESSENGER and ACE. The second CME event started on SOL2014-02-16T10:24 and was more complicated, as three CME interactions occurred in this event. It was impossible to recover the observed profiles without modeling the other two CMEs that were observed, one before the main CME and one afterward. For both CME studies, AMR level 3 was sufficient to reconstruct small-scale features near Mercury, while at Earth, AMR level 4 was necessary due to the radially stretched grid that was used.


title: Extraction of Physical Properties of Interstellar Medium from the Observed Line Profiles

abstract: Since molecules are ubiquitous in space, the study of the 'Molecular Universe' could unfold the mystery of the existing Interstellar medium. Star formation is linked to the chemical evolution processes. Thus, an analysis of the formation of stars coupled with the chemical evolution would give a clear insight into the entire process. For example, various evolutionary stages of star formation could be probed by observing various molecules. Chemical diagnostics of these regions could be used to extract the physical properties (e.g., density, temperature, ionization degree, etc.) of these regions. Radiative transfer calculations are worthwhile in estimating physical parameters of the region where molecules are detected. However, the radiative transfer calculations are limited due to insufficient molecular data, such as spectroscopic information or collisional excitation probabilities of many interstellar species. Complex organic molecules are detected in various environments ranging from the cold gas in prestellar cores to the warm gas on solar system scales close to individual protostars. A comparative study of the relative abundances of molecules could provide insights into the beginning of chemical complexity and the link to our solar system. In my thesis, I would mainly investigate the physical properties and kinematics of different star-forming regions using radiative transfer modeling. The observed spatial differentiation between various key molecules is used to explain their physical structure or evolution and various microphysical effects. In addition, some key molecules are used to study the various evolutionary phases. This simulated data is useful for interpreting the observed data of different telescopes like IRAM 30m, GBT, ALMA, Herschel, SOFIA, etc.


title: Bistatic Sensing at THz Frequencies via a Two-Stage Ultra-Wideband MIMO-OFDM System

abstract: Only the chairs can edit The availability of abundant bandwidth at terahertz (THz) frequencies holds promise for significantly enhancing the sensing performance of integrated sensing and communication (ISAC) systems in the next-generation wireless systems, enabling high accuracy and resolution for precise target localization. In orthogonal frequency-division multiplexing (OFDM) systems, wide bandwidth can be achieved by increasing the subcarrier spacing rather than the number of subcarriers, thereby keeping the complexity of the sensing system low. However, this approach may lead to an ambiguity problem in target range estimation. To address this issue, this work proposes a two-stage maximum likelihood method for estimating target position in an ultra-wideband bistatic multiple-antenna OFDM-based ISAC system operating at THz frequencies. Numerical results show that the proposed estimation approach effectively resolves the ambiguity problem while achieving high resolution and accuracy target position estimation at a very low signal-to-noise ratio regime.


title: VeLoRA: Memory Efficient Training using Rank-1 Sub-Token Projections

abstract: Large language models (LLMs) have recently emerged as powerful tools for tackling many language-processing tasks. Despite their success, training and fine-tuning these models is still far too computationally and memory intensive. In this paper, we identify and characterise the important components needed for effective model convergence using gradient descent. In doing so we find that the intermediate activations used to implement backpropagation can be excessively compressed without incurring any degradation in performance. This result leads us to a cheap and memory-efficient algorithm for both fine-tuning and pre-training LLMs. The proposed algorithm simply divides the tokens up into smaller sub-tokens before projecting them onto a fixed 1-dimensional subspace during the forward pass. These features are then coarsely reconstructed during the backward pass to implement the update rules. We confirm the effectiveness of our algorithm as being complimentary to many state-of-the-art PEFT methods on the VTAB-1k fine-tuning benchmark. Furthermore, we outperform QLoRA for fine-tuning LLaMA and show competitive performance against other memory-efficient pre-training methods on the large-scale C4 dataset.


title: fMRI predictors based on language models of increasing complexity recover brain left lateralization

abstract: Over the past decade, studies of naturalistic language processing where participants are scanned while listening to continuous text have flourished. Using word embeddings at first, then large language models, researchers have created encoding models to analyze the brain signals. Presenting these models with the same text as the participants allows to identify brain areas where there is a significant correlation between the functional magnetic resonance imaging (fMRI) time series and the ones predicted by the models' artificial neurons. One intriguing finding from these studies is that they have revealed highly symmetric bilateral activation patterns, somewhat at odds with the well-known left lateralization of language processing. Here, we report analyses of an fMRI dataset where we manipulate the complexity of large language models, testing 28 pretrained models from 8 different families, ranging from 124M to 14.2B parameters. First, we observe that the performance of models in predicting brain responses follows a scaling law, where the fit with brain activity increases linearly with the logarithm of the number of parameters of the model (and its performance on natural language processing tasks). Second, we show that a left-right asymmetry gradually appears as model size increases, and that the difference in left-right brain correlations also follows a scaling law. Whereas the smallest models show no asymmetry, larger models fit better and better left hemispheric activations than right hemispheric ones. This finding reconciles computational analyses of brain activity using large language models with the classic observation from aphasic patients showing left hemisphere dominance for language.


title: Influence of mid-infrared Galactic bubble on surroundings: A case study on IRAS 16489-4431

abstract: We studied the influence of a massive star on a mid-infrared bubble and its surrounding gas in the IRAS\,16489-4431 star-forming region using multi-wavelength data. The {\it Spitzer} mid-infrared band images revealed the shocked nature of the bubble. Analyses showed that the bubble is developed by a massive star owing to its strong radiation pressure. Evidence of collected material along the edge of the bubble was noted by the cold gas tracer line observed using Atacama Millimeter/submillimeter Array (ALMA). The presence of dense dust cores with bi-polar outflows and young stellar objects toward the collected material is suggestive of active star formation possibly influenced by the expansion of the radiation driven bubble.


title: Emergent Oscillating bound states in a semi-infinite linear waveguide with a point-like $\Lambda$-type quantum emitter driven by a classical field

abstract: An oscillating bound state is a phenomenon where excitations mediated by the continuum modes oscillate persistently. Although it is generated by the superposition of two bound states in the continuum (BICs), such phenomenon is said to be unique to giant atoms. We present the phenomenon of an oscillating bound state with an alternative waveguide QED system, which is a one-dimensional semi-infinite waveguide coupled to a \textit{point-like} quantum emitter. This \textit{point-like} quantum emitter is $\Lambda$-type quantum system with one transition driven by a classical field.


title: DMT-JEPA: Discriminative Masked Targets for Joint-Embedding Predictive Architecture

abstract: The joint-embedding predictive architecture (JEPA) recently has shown impressive results in extracting visual representations from unlabeled imagery under a masking strategy. However, we reveal its disadvantages, notably its insufficient understanding of local semantics. This deficiency originates from masked modeling in the embedding space, resulting in a reduction of discriminative power and can even lead to the neglect of critical local semantics. To bridge this gap, we introduce DMT-JEPA, a novel masked modeling objective rooted in JEPA, specifically designed to generate discriminative latent targets from neighboring information. Our key idea is simple: we consider a set of semantically similar neighboring patches as a target of a masked patch. To be specific, the proposed DMT-JEPA (a) computes feature similarities between each masked patch and its corresponding neighboring patches to select patches having semantically meaningful relations, and (b) employs lightweight cross-attention heads to aggregate features of neighboring patches as the masked targets. Consequently, DMT-JEPA demonstrates strong discriminative power, offering benefits across a diverse spectrum of downstream tasks. Through extensive experiments, we demonstrate our effectiveness across various visual benchmarks, including ImageNet-1K image classification, ADE20K semantic segmentation, and COCO object detection tasks. Code is available at: \url{https://github.com/DMTJEPA/DMTJEPA}.


title: Free scalar field theory on a Sobolev space over a bounded interval

abstract: This paper discusses several functional analytic issues relevant for field theories in the context of the Hamiltonian formulation for a free, massless, scalar field defined on a closed interval of the real line. The fields that we use belong to a Sobolev space with a scalar product. As we show this choice is useful because it leads to an explicit representation of the points in the fibers of the phase space (the cotangent bundle of the configuration space). The dynamical role of the boundary of the spatial manifold where the fields are defined is analyzed.


title: Local boundedness of cone multipliers

abstract: We show that the cone multiplier satisfies local $L^p$-$L^q$ bounds only in the trivial range $1\leq q\leq 2\leq p\leq\infty$. To do so, we suitably adapt to this setting the proof of Fefferman for the ball multiplier. As a consequence we answer negatively a question by B\'ekoll\'e and Bonami (Colloq. Math. 68, 1995, 81-100), regarding the continuity from $L^p\to L^q$ of the Cauchy-Szeg\"o projections associated with a class of bounded symmetric domains in $\mathbb{C}^n$ with rank $r\geq2$.


title: Source Echo Chamber: Exploring the Escalation of Source Bias in User, Data, and Recommender System Feedback Loop

abstract: Recently, researchers have uncovered that neural retrieval models prefer AI-generated content (AIGC), called source bias. Compared to active search behavior, recommendation represents another important means of information acquisition, where users are more prone to source bias. Furthermore, delving into the recommendation scenario, as AIGC becomes integrated within the feedback loop involving users, data, and the recommender system, it progressively contaminates the candidate items, the user interaction history, and ultimately, the data used to train the recommendation models. How and to what extent the source bias affects the neural recommendation models within feedback loop remains unknown. In this study, we extend the investigation of source bias into the realm of recommender systems, specifically examining its impact across different phases of the feedback loop. We conceptualize the progression of AIGC integration into the recommendation content ecosystem in three distinct phases-HGC dominate, HGC-AIGC coexist, and AIGC dominance-each representing past, present, and future states, respectively. Through extensive experiments across three datasets from diverse domains, we demonstrate the prevalence of source bias and reveal a potential digital echo chamber with source bias amplification throughout the feedback loop. This trend risks creating a recommender ecosystem with limited information source, such as AIGC, being disproportionately recommended. To counteract this bias and prevent its escalation in the feedback loop, we introduce a black-box debiasing method that maintains model impartiality towards both HGC and AIGC. Our experimental results validate the effectiveness of the proposed debiasing method, confirming its potential to disrupt the feedback loop.


title: Understanding stellar populations in thin & thick discs of edge-on galaxies with MUSE -- I. The case of the reignited S0 galaxy ESO 544-27

abstract: Edge-on galaxies act as the best laboratories to understand the origin of thin and thick discs in galaxies. Measurement of spatially resolved stellar population properties in such galaxies, particularly age, metallicity and [$\alpha$/Fe], are crucial to understanding the formation and evolution of disc galaxies. Such measurements are made possible from stellar population model fits to deep integral field spectroscopic (IFU) observations of resolved galaxies. We utilise archival MUSE IFU observations of the edge-on galaxy ESO 544-27 to uncover the formation history of its thin and thick discs through its stellar populations. We find the thin disc of the galaxy is dominated by an old ($>9$ Gyr) low [$\alpha$/Fe] metal-rich stellar population. Its outer thick disc is dominated by an old ($>9$ Gyr) high [$\alpha$/Fe] metal-rich component that should have formed with higher star-formation efficiency than the Milky Way thick disc. We thus find [$\alpha$/Fe] dichotomy in ESO 544-27 with its thin and thick discs dominated by low and high [$\alpha$/Fe] stellar populations respectively. However, we also find a metal-rich younger ($<2$ Gyr old) stellar population in ESO 544-27. The galaxy was nearly quenched until its star-formation was reignited recently first in the outer and inner thick disc ($\sim$1 Gyr ago) and then in the thin disc ($\sim$600 Myr ago). We thus find that both the low [$\alpha$/Fe] thin and high [$\alpha$/Fe] thick discs of ESO 544-27 are inhabited primarily by similarly old metal-rich stellar populations, a contrast to that of other galaxies with known thin and thick disc stellar population properties.


title: A Passive and Asynchronous Wake-up Receiver for Acoustic Underwater Communication

abstract: Establishing reliable data exchange in an underwater domain using energy and power-efficient communication methods is crucial and challenging. Radio frequencies are absorbed by the salty and mineral-rich water and optical signals are obstructed and scattered after short distances. In contrast, acoustic communication benefits from low absorption and enables communication over long distances. Underwater communication must match low power and energy requirements as underwater sensor systems must have a long battery lifetime and need to work reliably due to their deployment and maintenance cost. For long-term deployments, the sensors' overall power consumption is determined by the power consumption during idle state. It can be reduced by integrating asynchronous always-on wake-up circuits with nano-watt power consumption. However, this approach does reduce but not eliminate idle power consumption, leaving a margin for improvement. This paper presents a passive and asynchronous wake-up receiver for acoustic underwater communication enabling zero-power always-on listening. Zero-power listening is achieved by combining energy and information transmission using a low-power wake-up receiver that extracts energy out of the acoustic signal and eliminates radio frontend idle consumption. In-field evaluations demonstrate that the wake-up circuit requires only 63 uW to detect and compare an 8-bit UUID at a data rate of 200 bps up to a distance of 5 m and that the needed energy can directly be extracted from the acoustic signal.


title: Network-Aware Reliability Modeling and Optimization for Microservice Placement

abstract: Optimizing microservice placement to enhance the reliability of services is crucial for improving the service level of microservice architecture-based mobile networks and Internet of Things (IoT) networks. Despite extensive research on service reliability, the impact of network load and routing on service reliability remains understudied, leading to suboptimal models and unsatisfactory performance. To address this issue, we propose a novel network-aware service reliability model that effectively captures the correlation between network state changes and reliability. Based on this model, we formulate the microservice placement problem as an integer nonlinear programming problem, aiming to maximize service reliability. Subsequently, a service reliability-aware placement (SRP) algorithm is proposed to solve the problem efficiently. To reduce bandwidth consumption, we further discuss the microservice placement problem with the shared backup path mechanism and propose a placement algorithm based on the SRP algorithm using shared path reliability calculation, known as the SRP-S algorithm. Extensive simulations demonstrate that the SRP algorithm reduces service failures by up to 29% compared to the benchmark algorithms. By introducing the shared backup path mechanism, the SRP-S algorithm reduces bandwidth consumption by up to 62% compared to the SRP algorithm with the fully protected path mechanism. It also reduces service failures by up to 21% compared to the SRP algorithm with the shared backup mechanism.


title: Generic decompositions of Deligne--Lusztig representations

abstract: Let $G_0$ be a reductive group over $\mathbb{F}_p$ with simply connected derived subgroup, (geometrically) connected center and Coxeter number $h+1$. We extend Jantzen's generic decomposition pattern from $(2h-1)$-generic to $h$-generic Deligne--Lusztig representations, which is optimal. We also prove several results on the ``obvious'' Jordan--H\"older factors of general Deligne--Lusztig representations. As an application we improve the weight elimination result of arXiv:1610.04819 [math.NT]


title: MAVIN: Multi-Action Video Generation with Diffusion Models via Transition Video Infilling

abstract: Diffusion-based video generation has achieved significant progress, yet generating multiple actions that occur sequentially remains a formidable task. Directly generating a video with sequential actions can be extremely challenging due to the scarcity of fine-grained action annotations and the difficulty in establishing temporal semantic correspondences and maintaining long-term consistency. To tackle this, we propose an intuitive and straightforward solution: splicing multiple single-action video segments sequentially. The core challenge lies in generating smooth and natural transitions between these segments given the inherent complexity and variability of action transitions. We introduce MAVIN (Multi-Action Video INfilling model), designed to generate transition videos that seamlessly connect two given videos, forming a cohesive integrated sequence. MAVIN incorporates several innovative techniques to address challenges in the transition video infilling task. Firstly, a consecutive noising strategy coupled with variable-length sampling is employed to handle large infilling gaps and varied generation lengths. Secondly, boundary frame guidance (BFG) is proposed to address the lack of semantic guidance during transition generation. Lastly, a Gaussian filter mixer (GFM) dynamically manages noise initialization during inference, mitigating train-test discrepancy while preserving generation flexibility. Additionally, we introduce a new metric, CLIP-RS (CLIP Relative Smoothness), to evaluate temporal coherence and smoothness, complementing traditional quality-based metrics. Experimental results on horse and tiger scenarios demonstrate MAVIN's superior performance in generating smooth and coherent video transitions compared to existing methods.


title: SkinCAP: A Multi-modal Dermatology Dataset Annotated with Rich Medical Captions

abstract: With the widespread application of artificial intelligence (AI), particularly deep learning (DL) and vision-based large language models (VLLMs), in skin disease diagnosis, the need for interpretability becomes crucial. However, existing dermatology datasets are limited in their inclusion of concept-level meta-labels, and none offer rich medical descriptions in natural language. This deficiency impedes the advancement of LLM-based methods in dermatological diagnosis. To address this gap and provide a meticulously annotated dermatology dataset with comprehensive natural language descriptions, we introduce SkinCAP: a multi-modal dermatology dataset annotated with rich medical captions. SkinCAP comprises 4,000 images sourced from the Fitzpatrick 17k skin disease dataset and the Diverse Dermatology Images dataset, annotated by board-certified dermatologists to provide extensive medical descriptions and captions. Notably, SkinCAP represents the world's first such dataset and is publicly available at https://huggingface.co/datasets/joshuachou/SkinCAP.


title: Persistence Diagram Estimation : Beyond Plug-in Approaches

abstract: Persistent homology is a tool from Topological Data Analysis (TDA) used to summarize the topology underlying data. It can be conveniently represented through persistence diagrams. Observing a noisy signal, common strategies to infer its persistence diagram involve plug-in estimators, and convergence properties are then derived from sup-norm stability. This dependence on the sup-norm convergence of the preliminary estimator is restrictive, as it essentially imposes to consider regular classes of signals. Departing from these approaches, we design an estimator based on image persistence. In the context of the Gaussian white noise model, and for large classes of piecewise-H\"older signals, we prove that the proposed estimator is consistent and achieves minimax rates. Notably, these rates coincide with the well known minimax rates for H\"older continuous signals.


title: Mathematical models of the Arabidopsis circadian oscillator

abstract: We review the construction and evolution of mathematical models of the Arabidopsis circadian clock, structuring the discussion into two distinct historical phases of modeling strategies: extension and reduction. The extension phase explores the bottom-up assembly of regulatory networks introducing as many components and interactions as possible in order to capture the oscillatory nature of the clock. The reduction phase deals with functional decomposition, distilling complex models to their essential dynamical repertoire. Current challenges in this field, including the integration of spatial considerations and environmental influences like light and temperature, are also discussed. The review emphasizes the ongoing need for models that balance molecular detail with practical simplicity.


title: Quantum circuits for block encoding of structured matrices in ocean acoustics

abstract: Block encoding is a data input model commonly used in a quantum computer. It is a technique that embeds a matrix $A$ satisfying $\left\|A\right\| \leq 1$ into a larger unitary matrix $U_{A}$. We consider special structured matrices arising from generalized eigenvalue equations in ocean acoustics. We develop their block encoding scheme and further improve it which results lower subnormalisations. And we discuss how to construct quantum circuits of block encoding for the structured matrices. Two numerical examples are used to illustrate the feasibility of our block encoding schemes. The corresponding codes of the quantum circuits in \verb|MATLAB| are also presented.


title: Potential to Identify the Neutrino Mass Ordering with Reactor Antineutrinos in JUNO

abstract: The Jiangmen Underground Neutrino Observatory (JUNO) is a multi-purpose neutrino experiment under construction in South of China. This paper presents an updated estimate of JUNO's sensitivity to the neutrino mass ordering using the reactor antineutrinos emitted from eight nuclear reactor cores in the Taishan and Yangjiang nuclear power plants. This measurement is planned by studying the fine interference pattern caused by quasi-vacuum oscillations in the oscillated antineutrino spectrum at a baseline of 52.5~km and is completely independent of the CP violating phase and the neutrino mixing angle $\theta_{23}$. The sensitivity is obtained through a joint analysis of JUNO and TAO detectors utilizing the best available knowledge to date about the location and overburden of the JUNO experimental site, the local and global nuclear reactors, the JUNO and TAO detectors responses, the expected event rates and spectra of signal and backgrounds, and the systematic uncertainties of the analysis inputs. It is found that a 3$\sigma$ median sensitivity to reject the wrong mass ordering hypothesis can be reached with an exposure of about 6.5 years $\times$ 26.6~GW thermal power.


title: Exploring Context Window of Large Language Models via Decomposed Positional Vectors

abstract: Transformer-based large language models (LLMs) typically have a limited context window, resulting in significant performance degradation when processing text beyond the length of the context window. Extensive studies have been proposed to extend the context window and achieve length extrapolation of LLMs, but there is still a lack of in-depth interpretation of these approaches. In this study, we explore the positional information within and beyond the context window for deciphering the underlying mechanism of LLMs. By using a mean-based decomposition method, we disentangle positional vectors from hidden states of LLMs and analyze their formation and effect on attention. Furthermore, when texts exceed the context window, we analyze the change of positional vectors in two settings, i.e., direct extrapolation and context window extension. Based on our findings, we design two training-free context window extension methods, positional vector replacement and attention window extension. Experimental results show that our methods can effectively extend the context window length.


title: Regular Flips in mptopcom

abstract: A triangulation of a point configuration is regular if it can be given by a height function, that is every point gets lifted to a certain height and projecting the lower convex hull gives the triangulation. Checking regularity of a triangulation usually is done by solving a linear program. However when checking many flip-connected triangulations for regularity, one can instead ask which flips preserve regularity. When traversing the flip graph for enumerating all regular triangulations, this allows for vast reduction of the linear programs needing to be solved. At the same time the remaining linear programs will be much smaller.


title: Rethinking Recommender Systems: Cluster-based Algorithm Selection

abstract: Cluster-based algorithm selection deals with selecting recommendation algorithms on clusters of users to obtain performance gains. No studies have been attempted for many combinations of clustering approaches and recommendation algorithms. We want to show that clustering users prior to algorithm selection increases the performance of recommendation algorithms. Our study covers eight datasets, four clustering approaches, and eight recommendation algorithms. We select the best performing recommendation algorithm for each cluster. Our work shows that cluster-based algorithm selection is an effective technique for optimizing recommendation algorithm performance. For five out of eight datasets, we report an increase in nDCG@10 between 19.28% (0.032) and 360.38% (0.191) compared to algorithm selection without prior clustering.


title: Flow-Assisted Motion Learning Network for Weakly-Supervised Group Activity Recognition

abstract: Weakly-Supervised Group Activity Recognition (WSGAR) aims to understand the activity performed together by a group of individuals with the video-level label and without actor-level labels. We propose Flow-Assisted Motion Learning Network (Flaming-Net) for WSGAR, which consists of the motion-aware actor encoder to extract actor features and the two-pathways relation module to infer the interaction among actors and their activity. Flaming-Net leverages an additional optical flow modality in the training stage to enhance its motion awareness when finding locally active actors. The first pathway of the relation module, the actor-centric path, initially captures the temporal dynamics of individual actors and then constructs inter-actor relationships. In parallel, the group-centric path starts by building spatial connections between actors within the same timeframe and then captures simultaneous spatio-temporal dynamics among them. We demonstrate that Flaming-Net achieves new state-of-the-art WSGAR results on two benchmarks, including a 2.8%p higher MPCA score on the NBA dataset. Importantly, we use the optical flow modality only for training and not for inference.


title: On analytic characterization of convex sets in $\mathbb{R}^m$ (a survey)

abstract: In the first part of this note, we review results concerning analytic characterization of convexity for planar sets. The second part is devoted to results valid for arbitrary $m \ge 2$.


title: Coupled Mamba: Enhanced Multi-modal Fusion with Coupled State Space Model

abstract: The essence of multi-modal fusion lies in exploiting the complementary information inherent in diverse modalities. However, prevalent fusion methods rely on traditional neural architectures and are inadequately equipped to capture the dynamics of interactions across modalities, particularly in presence of complex intra- and inter-modality correlations. Recent advancements in State Space Models (SSMs), notably exemplified by the Mamba model, have emerged as promising contenders. Particularly, its state evolving process implies stronger modality fusion paradigm, making multi-modal fusion on SSMs an appealing direction. However, fusing multiple modalities is challenging for SSMs due to its hardware-aware parallelism designs. To this end, this paper proposes the Coupled SSM model, for coupling state chains of multiple modalities while maintaining independence of intra-modality state processes. Specifically, in our coupled scheme, we devise an inter-modal hidden states transition scheme, in which the current state is dependent on the states of its own chain and that of the neighbouring chains at the previous time-step. To fully comply with the hardware-aware parallelism, we devise an expedite coupled state transition scheme and derive its corresponding global convolution kernel for parallelism. Extensive experiments on CMU-MOSEI, CH-SIMS, CH-SIMSV2 through multi-domain input verify the effectiveness of our model compared to current state-of-the-art methods, improved F1-Score by 0.4\%, 0.9\%, and 2.3\% on the three datasets respectively, 49\% faster inference and 83.7\% GPU memory save. The results demonstrate that Coupled Mamba model is capable of enhanced multi-modal fusion.


title: MultiADE: A Multi-domain Benchmark for Adverse Drug Event Extraction

abstract: Objective. Active adverse event surveillance monitors Adverse Drug Events (ADE) from different data sources, such as electronic health records, medical literature, social media and search engine logs. Over years, many datasets are created, and shared tasks are organised to facilitate active adverse event surveillance. However, most-if not all-datasets or shared tasks focus on extracting ADEs from a particular type of text. Domain generalisation-the ability of a machine learning model to perform well on new, unseen domains (text types)-is under-explored. Given the rapid advancements in natural language processing, one unanswered question is how far we are from having a single ADE extraction model that are effective on various types of text, such as scientific literature and social media posts}. Methods. We contribute to answering this question by building a multi-domain benchmark for adverse drug event extraction, which we named MultiADE. The new benchmark comprises several existing datasets sampled from different text types and our newly created dataset-CADECv2, which is an extension of CADEC (Karimi, et al., 2015), covering online posts regarding more diverse drugs than CADEC. Our new dataset is carefully annotated by human annotators following detailed annotation guidelines. Conclusion. Our benchmark results show that the generalisation of the trained models is far from perfect, making it infeasible to be deployed to process different types of text. In addition, although intermediate transfer learning is a promising approach to utilising existing resources, further investigation is needed on methods of domain adaptation, particularly cost-effective methods to select useful training instances.


title: On Creativity and Open-Endedness

abstract: Artificial Life (ALife) as an interdisciplinary field draws inspiration and influence from a variety of perspectives. Scientific progress crucially depends, then, on concerted efforts to invite cross-disciplinary dialogue. The goal of this paper is to revitalize discussions of potential connections between the fields of Computational Creativity (CC) and ALife, focusing specifically on the concept of Open-Endedness (OE); the primary goal of CC is to endow artificial systems with creativity, and ALife has dedicated much research effort into studying and synthesizing OE and artificial innovation. However, despite the close proximity of these concepts, their use so far remains confined to their respective communities, and their relationship is largely unclear. We provide historical context for research in both domains, and review the limited work connecting research on creativity and OE explicitly. We then highlight specific questions to be considered, with the eventual goals of (i) decreasing conceptual ambiguity by highlighting similarities and differences between the concepts of OE and creativity, (ii) identifying synergy effects of a research agenda that encompasses both concepts, and (iii) establishing a dialogue between ALife and CC research.


title: Threshold Effects on the Massless Neutrino in the Canonical Seesaw Mechanism

abstract: In this work, we revisit the one-loop renormalization group equations (RGEs) among non-degenerate seesaw scales, i.e., threshold effects in the canonical seesaw mechanism, which have been obtained for more than two decades. We find some contributions from the Weinberg operator to its Wilson coefficient, the neutrino Yukawa coupling matrix, and the Higgs quartic coupling absent in the previous calculations. Based on the updated one-loop RGEs, we derive the RGE of the effective neutrino mass matrix's determinant without any approximation. Then, for the first time, we provide a strict proof that the one-loop RG running effects among non-degenerate seesaw scales can not generate a non-zero mass for the initial massless neutrino in the minimal type-I seesaw mechanism or in the canonical one with a rank-degenerate neutrino Yukawa coupling matrix. One has to include two- or higher-loop corrections to achieve a non-zero mass for the massless neutrino.


title: A Calibration Tool for Refractive Underwater Vision

abstract: Many underwater robotic applications relying on vision sensors require proper camera calibration, i.e. knowing the incoming light ray for each pixel in the image. While for the ideal pinhole camera model all viewing rays intersect in a single 3D point, underwater cameras suffer from - possibly multiple - refractions of light rays at the interfaces of water, glass and air. These changes of direction depend on the position and orientation of the camera inside the water-proof housing, as well as on the shape and properties of the optical window, the port, itself. In recent years explicit models for underwater vision behind common ports such as flat or dome port have been proposed, but the underwater community is still lacking a calibration tool which can determine port parameters through refractive calibration. With this work we provide the first open source implementation of an underwater refractive camera calibration toolbox. It allows end-to-end calibration of underwater vision systems, including camera, stereo and housing calibration for systems with dome or flat ports. The implementation is verified using rendered datasets and real-world experiments.


title: Mutual Information Analysis of Neuromorphic Coding for Distributed Wireless Spiking Neural Networks

abstract: Wireless Spiking neural networks (WSNNs) allow energy-efficient device-to-device (D2D) or vehicle-to-everything (V2X) communications, especially while considering edge intelligence and learning for beyond 5G and 6G systems. Recent research work has revealed that distributed wireless SNNs (DWSNNs) show good performance in terms of inference accuracy and low energy consumption of edge devices, under the constraints of limited bandwidth and spike loss probability. In this work, we focus on neuromorphic, AI-native transmission techniques for DWSNNs, quantitatively evaluating the features of different coding algorithms that can be viewed as impulse radio modulations. Specifically, the main contribution of this work is the evaluation of information-theoretic measures that may help in quantifying performance trade-offs among existing neuromorphic coding techniques.


title: The association between environmental variables and short-term mortality: evidence from Europe

abstract: Using fine-grained, publicly available data, this paper studies the association between environmental factors, i.e., variables capturing weather and air pollution characteristics, and weekly mortality rates in small geographical regions in Europe. Hereto, we develop a mortality modelling framework where a baseline captures a region-specific, seasonal historical trend observed within the weekly mortality rates. Using a machine learning algorithm, we then explain deviations from this baseline using anomalies and extreme indices constructed from the environmental data. We illustrate our proposed modelling framework through a case study on more than 550 NUTS 3 regions (Nomenclature of Territorial Units for Statistics, level 3) located in 20 different European countries. Through interpretation tools, we unravel insights into which environmental features are most important when estimating excess or deficit mortality with respect to the baseline and explore how these features interact. Moreover, we investigate harvesting effects of the environmental features through our constructed weekly mortality modelling framework. Our findings show that temperature-related features exert the most significant influence in explaining deviations in mortality from the baseline. Furthermore, we find that environmental features prove particularly beneficial in southern regions for explaining elevated levels of mortality over short time periods.


title: MULi-Ev: Maintaining Unperturbed LiDAR-Event Calibration

abstract: Despite the increasing interest in enhancing perception systems for autonomous vehicles, the online calibration between event cameras and LiDAR - two sensors pivotal in capturing comprehensive environmental information - remains unexplored. We introduce MULi-Ev, the first online, deep learning-based framework tailored for the extrinsic calibration of event cameras with LiDAR. This advancement is instrumental for the seamless integration of LiDAR and event cameras, enabling dynamic, real-time calibration adjustments that are essential for maintaining optimal sensor alignment amidst varying operational conditions. Rigorously evaluated against the real-world scenarios presented in the DSEC dataset, MULi-Ev not only achieves substantial improvements in calibration accuracy but also sets a new standard for integrating LiDAR with event cameras in mobile platforms. Our findings reveal the potential of MULi-Ev to bolster the safety, reliability, and overall performance of event-based perception systems in autonomous driving, marking a significant step forward in their real-world deployment and effectiveness.


title: Syzygies of algebraic varieties through symmetric products of algebraic curves

abstract: This is a survey paper on recent work on syzygies of algebraic varieties. We discuss the gonality conjecture on weight-one syzygies of algebraic curves, syzygies of secant varieties of algebraic curves, syzygies of tangent developable surfaces and Green's conjecture on syzygies of canonical curves, and asymptotic syzygies of algebraic varieties. All results considered in this paper were proven using the geometry of symmetric products of algebraic curves.


title: Generator polynomials of cyclic expurgated or extended Goppa codes

abstract: Classical Goppa codes are a well-known class of codes with applications in code-based cryptography, which are a special case of alternant codes. Many papers are devoted to the search for Goppa codes with a cyclic extension or with a cyclic parity-check subcode. Let $\Bbb F_q$ be a finite field with $q=2^l$ elements, where $l$ is a positive integer. In this paper, we determine all the generator polynomials of cyclic expurgated or extended Goppa codes under some prescribed permutations induced by the projective general linear automorphism $A \in PGL_2(\Bbb F_q)$. Moreover, we provide some examples to support our findings.


title: Emergent inhomogeneity and non-locality in a graphene field-effect transistor on a near-parallel moire superlattice of transition metal dichalcogenides

abstract: At near-parallel orientation, twisted bilayer of transition metal dichalcogenides exhibit inter-layer charge transfer-driven out-of-plane ferroelectricity that may lead to unique electronic device architectures. Here we report detailed electrical transport in a dual-gated graphene field-effect transistor placed on 3R stacked twisted bilayer of WSe2 at a twist angle of 2.1 degree. We observe hysteretic transfer characteristics and an emergent charge inhomogeneity with multiple local Dirac points as the electric displacement field (D) is increased. Concomitantly, we also observe a strong non-local voltage signal at D = 0 V/nm that decreases rapidly with increasing D. A linear scaling of the non-local signal with longitudinal resistance suggests edge mode transport, which we attribute to the breaking of valley symmetry of the graphene channel due to the spatially fluctuating electric field from the moire domains of the underlying twisted WSe2. A quantitative analysis connecting the non-locality and channel inhomogeneity suggests emergence of finite-size domains in the graphene channel that modulate the charge and the valley currents simultaneously. This work underlines efficient control and impact of interfacial ferroelectricity that can trigger a new genre of devices for twistronic applications.


title: Unveiling the Power of Diffusion Features For Personalized Segmentation and Retrieval

abstract: Personalized retrieval and segmentation aim to locate specific instances within a dataset based on an input image and a short description of the reference instance. While supervised methods are effective, they require extensive labeled data for training. Recently, self-supervised foundation models have been introduced to these tasks showing comparable results to supervised methods. However, a significant flaw in these models is evident: they struggle to locate a desired instance when other instances within the same class are presented. In this paper, we explore text-to-image diffusion models for these tasks. Specifically, we propose a novel approach called PDM for Personalized Features Diffusion Matching, that leverages intermediate features of pre-trained text-to-image models for personalization tasks without any additional training. PDM demonstrates superior performance on popular retrieval and segmentation benchmarks, outperforming even supervised methods. We also highlight notable shortcomings in current instance and segmentation datasets and propose new benchmarks for these tasks.


title: SP-STM study of the multi-Q phases in GdRu2Si2

abstract: The two stable surfaces of GdRu2Si2 are studied using spin-polarized scanning tunneling microscopy (SP-STM). Depending on the applied magnetic field different magnetic phases have been found and the presented measurements are in agreement with the respective previously proposed multi-Q spin textures. In particular the multi-Q nature of the zero magnetic field state, for which previous experiments could not rule out the coexistence of single-Q states, can be confirmed by our spin-resolved measurements on the Si-terminated surface. The surfaces of GdRu2Si2 exhibit strong magnetism-induced modulations of the spin-averaged density of states. We find that while the magnetic contribution to the tunnel signal can be clearly identified for the Si-terminated surface this proves to be much more difficult for the Gd-terminated surface. However, the magnetic field dependent spatial modulations on the Gd-terminated surface demonstrate that additional magnetic phase transitions occur for the surface layer compared to those identified for bulk GdRu2Si2 and possible spin textures are presented.


title: TimeChara: Evaluating Point-in-Time Character Hallucination of Role-Playing Large Language Models

abstract: While Large Language Models (LLMs) can serve as agents to simulate human behaviors (i.e., role-playing agents), we emphasize the importance of point-in-time role-playing. This situates characters at specific moments in the narrative progression for three main reasons: (i) enhancing users' narrative immersion, (ii) avoiding spoilers, and (iii) fostering engagement in fandom role-playing. To accurately represent characters at specific time points, agents must avoid character hallucination, where they display knowledge that contradicts their characters' identities and historical timelines. We introduce TimeChara, a new benchmark designed to evaluate point-in-time character hallucination in role-playing LLMs. Comprising 10,895 instances generated through an automated pipeline, this benchmark reveals significant hallucination issues in current state-of-the-art LLMs (e.g., GPT-4o). To counter this challenge, we propose Narrative-Experts, a method that decomposes the reasoning steps and utilizes narrative experts to reduce point-in-time character hallucinations effectively. Still, our findings with TimeChara highlight the ongoing challenges of point-in-time character hallucination, calling for further study.


title: Edinburgh Clinical NLP at MEDIQA-CORR 2024: Guiding Large Language Models with Hints

abstract: The MEDIQA-CORR 2024 shared task aims to assess the ability of Large Language Models (LLMs) to identify and correct medical errors in clinical notes. In this study, we evaluate the capability of general LLMs, specifically GPT-3.5 and GPT-4, to identify and correct medical errors with multiple prompting strategies. Recognising the limitation of LLMs in generating accurate corrections only via prompting strategies, we propose incorporating error-span predictions from a smaller, fine-tuned model in two ways: 1) by presenting it as a hint in the prompt and 2) by framing it as multiple-choice questions from which the LLM can choose the best correction. We found that our proposed prompting strategies significantly improve the LLM's ability to generate corrections. Our best-performing solution with 8-shot + CoT + hints ranked sixth in the shared task leaderboard. Additionally, our comprehensive analyses show the impact of the location of the error sentence, the prompted role, and the position of the multiple-choice option on the accuracy of the LLM. This prompts further questions about the readiness of LLM to be implemented in real-world clinical settings.


title: Are Image Distributions Indistinguishable to Humans Indistinguishable to Classifiers?

abstract: The ultimate goal of generative models is to characterize the data distribution perfectly. For image generation, common metrics of visual quality (e.g., FID), and the truthlikeness of generated images to the human eyes seem to suggest that we are close to achieving it. However, through distribution classification tasks, we find that, in the eyes of classifiers parameterized by neural networks, the strongest diffusion models are still far from this goal. Specifically, classifiers consistently and effortlessly distinguish between real and generated images in various settings. Further, we observe an intriguing discrepancy: classifiers can identify differences between diffusion models with similar performance (e.g., U-ViT-H vs. DiT-XL), but struggle to differentiate between the smallest and largest models in the same family (e.g., EDM2-XS vs. EDM2-XXL), whereas humans exhibit the opposite tendency. As an explanation, our comprehensive empirical study suggests that, unlike humans, classifiers tend to classify images through edge and high-frequency components. We believe that our methodology can serve as a probe to understand how generative models work and inspire further thought on how existing models can be improved and how the abuse of such models can be prevented.


title: Modeling and Controlling Many-Core HPC Processors: an Alternative to PID and Moving Average Algorithms

abstract: The race towards performance increase and computing power has led to chips with heterogeneous and complex designs, integrating an ever-growing number of cores on the same monolithic chip or chiplet silicon die. Higher integration density, compounded with the slowdown of technology-driven power reduction, implies that power and thermal management become increasingly relevant. Unfortunately, existing research lacks a detailed analysis and modeling of thermal, power, and electrical coupling effects and how they have to be jointly considered to perform dynamic control of complex and heterogeneous Multi-Processor System on Chips (MPSoCs). To close the gap, in this work, we first provide a detailed thermal and power model targeting a modern High Performance Computing (HPC) MPSoC. We consider real-world coupling effects such as actuators' non-idealities and the exponential relation between the dissipated power, the temperature state, and the voltage level in a single processing element. We analyze how these factors affect the control algorithm behavior and the type of challenges that they pose. Based on the analysis, we propose a thermal capping strategy inspired by Fuzzy control theory to replace the state-of-the-art PID controller, as well as a root-finding iterative method to optimally choose the shared voltage value among cores grouped in the same voltage domain. We evaluate the proposed controller with model-in-the-loop and hardware-in-the-loop co-simulations. We show an improvement over state-of-the-art methods of up to 5x the maximum exceeded temperature while providing an average of 3.56% faster application execution runtime across all the evaluation scenarios.


title: Lower Bounds and Optimal Algorithms for Non-Smooth Convex Decentralized Optimization over Time-Varying Networks

abstract: We consider the task of minimizing the sum of convex functions stored in a decentralized manner across the nodes of a communication network. This problem is relatively well-studied in the scenario when the objective functions are smooth, or the links of the network are fixed in time, or both. In particular, lower bounds on the number of decentralized communications and (sub)gradient computations required to solve the problem have been established, along with matching optimal algorithms. However, the remaining and most challenging setting of non-smooth decentralized optimization over time-varying networks is largely underexplored, as neither lower bounds nor optimal algorithms are known in the literature. We resolve this fundamental gap with the following contributions: (i) we establish the first lower bounds on the communication and subgradient computation complexities of solving non-smooth convex decentralized optimization problems over time-varying networks; (ii) we develop the first optimal algorithm that matches these lower bounds and offers substantially improved theoretical performance compared to the existing state of the art.


title: Automatic Abelian Complexities of Parikh-Collinear Fixed Points

abstract: Parikh-collinear morphisms have the property that all the Parikh vectors of the images of letters are collinear, i.e., the associated adjacency matrix has rank 1. In the conference DLT-WORDS 2023 we showed that fixed points of Parikh-collinear morphisms are automatic. We also showed that the abelian complexity function of a binary fixed point of such a morphism is automatic under some assumptions. In this note, we fully generalize the latter result. Namely, we show that the abelian complexity function of a fixed point of an arbitrary, possibly erasing, Parikh-collinear morphism is automatic. Furthermore, a deterministic finite automaton with output generating this abelian complexity function is provided by an effective procedure. To that end, we discuss the constant of recognizability of a morphism and the related cutting set.


title: RT-GS2: Real-Time Generalizable Semantic Segmentation for 3D Gaussian Representations of Radiance Fields

abstract: Gaussian Splatting has revolutionized the world of novel view synthesis by achieving high rendering performance in real-time. Recently, studies have focused on enriching these 3D representations with semantic information for downstream tasks. In this paper, we introduce RT-GS2, the first generalizable semantic segmentation method employing Gaussian Splatting. While existing Gaussian Splatting-based approaches rely on scene-specific training, RT-GS2 demonstrates the ability to generalize to unseen scenes. Our method adopts a new approach by first extracting view-independent 3D Gaussian features in a self-supervised manner, followed by a novel View-Dependent / View-Independent (VDVI) feature fusion to enhance semantic consistency over different views. Extensive experimentation on three different datasets showcases RT-GS2's superiority over the state-of-the-art methods in semantic segmentation quality, exemplified by a 8.01% increase in mIoU on the Replica dataset. Moreover, our method achieves real-time performance of 27.03 FPS, marking an astonishing 901 times speedup compared to existing approaches. This work represents a significant advancement in the field by introducing, to the best of our knowledge, the first real-time generalizable semantic segmentation method for 3D Gaussian representations of radiance fields.


title: Convergence rates of particle approximation of forward-backward splitting algorithm for granular medium equations

abstract: We study the spatially homogeneous granular medium equation \[\partial_t\mu=\rm{div}(\mu\nabla V)+\rm{div}(\mu(\nabla W \ast \mu))+\Delta\mu\,,\] within a large and natural class of the confinement potentials $V$ and interaction potentials $W$. The considered problem do not need to assume that $\nabla V$ or $\nabla W$ are globally Lipschitz. With the aim of providing particle approximation of solutions, we design efficient forward-backward splitting algorithms. Sharp convergence rates in terms of the Wasserstein distance are provided.


title: Instruction Tuning with Retrieval-based Examples Ranking for Aspect-based Sentiment Analysis

abstract: Aspect-based sentiment analysis (ABSA) identifies sentiment information related to specific aspects and provides deeper market insights to businesses and organizations. With the emergence of large language models (LMs), recent studies have proposed using fixed examples for instruction tuning to reformulate ABSA as a generation task. However, the performance is sensitive to the selection of in-context examples; several retrieval methods are based on surface similarity and are independent of the LM generative objective. This study proposes an instruction learning method with retrieval-based example ranking for ABSA tasks. For each target sample, an LM was applied as a scorer to estimate the likelihood of the output given the input and a candidate example as the prompt, and training examples were labeled as positive or negative by ranking the scores. An alternating training schema is proposed to train both the retriever and LM. Instructional prompts can be constructed using high-quality examples. The LM is used for both scoring and inference, improving the generation efficiency without incurring additional computational costs or training difficulties. Extensive experiments on three ABSA subtasks verified the effectiveness of the proposed method, demonstrating its superiority over various strong baseline models. Code and data are released at https://github.com/zgMin/IT-RER-ABSA.


title: ForecastGrapher: Redefining Multivariate Time Series Forecasting with Graph Neural Networks

abstract: The challenge of effectively learning inter-series correlations for multivariate time series forecasting remains a substantial and unresolved problem. Traditional deep learning models, which are largely dependent on the Transformer paradigm for modeling long sequences, often fail to integrate information from multiple time series into a coherent and universally applicable model. To bridge this gap, our paper presents ForecastGrapher, a framework reconceptualizes multivariate time series forecasting as a node regression task, providing a unique avenue for capturing the intricate temporal dynamics and inter-series correlations. Our approach is underpinned by three pivotal steps: firstly, generating custom node embeddings to reflect the temporal variations within each series; secondly, constructing an adaptive adjacency matrix to encode the inter-series correlations; and thirdly, augmenting the GNNs' expressive power by diversifying the node feature distribution. To enhance this expressive power, we introduce the Group Feature Convolution GNN (GFC-GNN). This model employs a learnable scaler to segment node features into multiple groups and applies one-dimensional convolutions with different kernel lengths to each group prior to the aggregation phase. Consequently, the GFC-GNN method enriches the diversity of node feature distribution in a fully end-to-end fashion. Through extensive experiments and ablation studies, we show that ForecastGrapher surpasses strong baselines and leading published techniques in the domain of multivariate time series forecasting.


title: One-dimensional half-harmonic maps into the circle and their degree

abstract: Given a half-harmonic map $u\in \dot H^{\frac{1}{2},2}(\mathbb{R},\mathbb{S}^1)$ minimizing the fractional Dirichlet energy under Dirichlet boundary conditions in $\mathbb{R}\setminus I$, we show the existence of a second half-harmonic map, minimizing the Dirichlet energy in a different homotopy class. This is a first step towards addressing a problem raised by Brezis and is based on the study of the degree of fractional Sobolev maps and a sharp estimate \`a la Brezis-Coron. We give examples showing that it is in general not possible to minimize in every homotopy class and show a contrast with the 2-dimensional case.


title: Modular functors from non-semisimple 3d TFTs

abstract: Given a not necessarily semisimple modular tensor category C, we use the corresponding 3d TFT defined in [arXiv:1912.02063] to explicitly describe a modular functor as a symmetric monoidal 2-functor from a 2-category of oriented bordisms to a 2-category of finite linear categories. This recovers a result by Lyubashenko [arXiv:hep-th/9405168] obtained via generators and relations. Pulling back the modular functor for C to a 2-category of bordisms with orientation reversing involution cancels the gluing anomaly, and further pulling back to the original bordism category along a doubling functor leads to the modular functor for the Drinfeld centre Z(C).


title: Large Language Model-Driven Curriculum Design for Mobile Networks

abstract: This study introduces an innovative framework that employs large language models (LLMs) to automate the design and generation of curricula for reinforcement learning (RL). As mobile networks evolve towards the 6G era, managing their increasing complexity and dynamic nature poses significant challenges. Conventional RL approaches often suffer from slow convergence and poor generalization due to conflicting objectives and the large state and action spaces associated with mobile networks. To address these shortcomings, we introduce curriculum learning, a method that systematically exposes the RL agent to progressively challenging tasks, improving convergence and generalization. However, curriculum design typically requires extensive domain knowledge and manual human effort. Our framework mitigates this by utilizing the generative capabilities of LLMs to automate the curriculum design process, significantly reducing human effort while improving the RL agent's convergence and performance. We deploy our approach within a simulated mobile network environment and demonstrate improved RL convergence rates, generalization to unseen scenarios, and overall performance enhancements. As a case study, we consider autonomous coordination and user association in mobile networks. Our obtained results highlight the potential of combining LLM-based curriculum generation with RL for managing next-generation wireless networks, marking a significant step towards fully autonomous network operations.


title: Fast-FedUL: A Training-Free Federated Unlearning with Provable Skew Resilience

abstract: Federated learning (FL) has recently emerged as a compelling machine learning paradigm, prioritizing the protection of privacy for training data. The increasing demand to address issues such as ``the right to be forgotten'' and combat data poisoning attacks highlights the importance of techniques, known as \textit{unlearning}, which facilitate the removal of specific training data from trained FL models. Despite numerous unlearning methods proposed for centralized learning, they often prove inapplicable to FL due to fundamental differences in the operation of the two learning paradigms. Consequently, unlearning in FL remains in its early stages, presenting several challenges. Many existing unlearning solutions in FL require a costly retraining process, which can be burdensome for clients. Moreover, these methods are primarily validated through experiments, lacking theoretical assurances. In this study, we introduce Fast-FedUL, a tailored unlearning method for FL, which eliminates the need for retraining entirely. Through meticulous analysis of the target client's influence on the global model in each round, we develop an algorithm to systematically remove the impact of the target client from the trained model. In addition to presenting empirical findings, we offer a theoretical analysis delineating the upper bound of our unlearned model and the exact retrained model (the one obtained through retraining using untargeted clients). Experimental results with backdoor attack scenarios indicate that Fast-FedUL effectively removes almost all traces of the target client, while retaining the knowledge of untargeted clients (obtaining a high accuracy of up to 98\% on the main task). Significantly, Fast-FedUL attains the lowest time complexity, providing a speed that is 1000 times faster than retraining. Our source code is publicly available at \url{https://github.com/thanhtrunghuynh93/fastFedUL}.


title: Defining ideals of Cohen-Macaulay fiber cones

abstract: Let $A$ be a commutative Noetherian local ring with maximal ideal $\mathfrak{m}$, and let $I$ be an ideal. The fiber cone is then an image of the polynomial ring over the residue field $A/\mathfrak{m}$. The kernel of this map is called the defining ideal, and it is natural to ask how to compute it. In this paper, we provide a construction for the defining ideals of Cohen-Macaulay fiber cones.


title: Visualizing the loss landscape of Self-supervised Vision Transformer

abstract: The Masked autoencoder (MAE) has drawn attention as a representative self-supervised approach for masked image modeling with vision transformers. However, even though MAE shows better generalization capability than fully supervised training from scratch, the reason why has not been explored. In another line of work, the Reconstruction Consistent Masked Auto Encoder (RC-MAE), has been proposed which adopts a self-distillation scheme in the form of an exponential moving average (EMA) teacher into MAE, and it has been shown that the EMA-teacher performs a conditional gradient correction during optimization. To further investigate the reason for better generalization of the self-supervised ViT when trained by MAE (MAE-ViT) and the effect of the gradient correction of RC-MAE from the perspective of optimization, we visualize the loss landscapes of the self-supervised vision transformer by both MAE and RC-MAE and compare them with the supervised ViT (Sup-ViT). Unlike previous loss landscape visualizations of neural networks based on classification task loss, we visualize the loss landscape of ViT by computing pre-training task loss. Through the lens of loss landscapes, we find two interesting observations: (1) MAE-ViT has a smoother and wider overall loss curvature than Sup-ViT. (2) The EMA-teacher allows MAE to widen the region of convexity in both pretraining and linear probing, leading to quicker convergence. To the best of our knowledge, this work is the first to investigate the self-supervised ViT through the lens of the loss landscape.


title: Improving mid-infrared thermal background subtraction with Principal Component Analysis

abstract: Ground-based large-aperture telescopes, interferometers, and future Extremely Large Telescopes equipped with adaptive-optics systems provide angular resolution and high-contrast performance that are superior to space-based telescopes at thermal-infrared wavelengths. Their sensitivity, however, is critically limited by the high thermal background inherent to ground-based observations in this wavelength regime. We aim to improve the subtraction quality of the thermal-infrared background from ground-based observations, using Principal Component Analysis (PCA). We use data obtained with the Nulling-Optimized Mid-Infrared Camera on the Large Binocular Telescope Interferometer as a proxy for general high-sensitivity, AO-assisted ground-based data. We apply both a classical background subtraction -- using the mean of dedicated background observations -- and a new background subtraction based on a PCA of the background observations. We compare the performances of these two methods in both high-contrast imaging and aperture photometry. Compared to the classical background subtraction approach, PCA background subtraction delivers up to two times better contrasts down to the diffraction limit of the LBT's primary aperture (i.e., 350 mas in N band), that is, in the case of high-contrast imaging. Improvement factor between two and three are obtained over the mean background retrieval within the diffraction limit in the case of aperture photometry. PCA background subtraction significantly improves the sensitivity of ground-based thermal-infrared imaging observations. When applied to LBTI's nulling interferometry data, we expect the method to improve the sensitivity by a similar factor 2-3. This study paves the way to maximising the potential of future infrared ground-based instruments and facilities, such as the future 30m-class telescopes.


title: Cognitive Insights and Stable Coalition Matching for Fostering Multi-Agent Cooperation

abstract: Cognitive abilities, such as Theory of Mind (ToM), play a vital role in facilitating cooperation in human social interactions. However, our study reveals that agents with higher ToM abilities may not necessarily exhibit better cooperative behavior compared to those with lower ToM abilities. To address this challenge, we propose a novel matching coalition mechanism that leverages the strengths of agents with different ToM levels by explicitly considering belief alignment and specialized abilities when forming coalitions. Our proposed matching algorithm seeks to find stable coalitions that maximize the potential for cooperative behavior and ensure long-term viability. By incorporating cognitive insights into the design of multi-agent systems, our work demonstrates the potential of leveraging ToM to create more sophisticated and human-like coordination strategies that foster cooperation and improve overall system performance.


title: Bridging Mini-Batch and Asymptotic Analysis in Contrastive Learning: From InfoNCE to Kernel-Based Losses

abstract: What do different contrastive learning (CL) losses actually optimize for? Although multiple CL methods have demonstrated remarkable representation learning capabilities, the differences in their inner workings remain largely opaque. In this work, we analyse several CL families and prove that, under certain conditions, they admit the same minimisers when optimizing either their batch-level objectives or their expectations asymptotically. In both cases, an intimate connection with the hyperspherical energy minimisation (HEM) problem resurfaces. Drawing inspiration from this, we introduce a novel CL objective, coined Decoupled Hyperspherical Energy Loss (DHEL). DHEL simplifies the problem by decoupling the target hyperspherical energy from the alignment of positive examples while preserving the same theoretical guarantees. Going one step further, we show the same results hold for another relevant CL family, namely kernel contrastive learning (KCL), with the additional advantage of the expected loss being independent of batch size, thus identifying the minimisers in the non-asymptotic regime. Empirical results demonstrate improved downstream performance and robustness across combinations of different batch sizes and hyperparameters and reduced dimensionality collapse, on several computer vision datasets.


title: Exchange Splitting Mechanism of Negative Magnetoresistance in Layered Antiferromagnetic Semimetals

abstract: Layered topologically non-trivial and trivial semimetals with AFM-type ordering of magnetic sublattice are known to exhibit a negative magnetoresistance that is well correlated with AFM magnetization changes in a magnetic field. This effect is reported in several experimental studies with EuFe$_2$As$_2$, EuSn$_2$As$_2$, EuSn$_2$P$_2$, etc., where the resistance decreases quadratically with field by about $\delta\rho/\rho \sim 4-6\%$ up to the spin-polarization field. Despite the fact that this effect is well documented experimentally, its theoretical explanation is missing up to date. In this paper we propose a novel theoretical mechanism describing the observed magnetoresistance that does not imply either topological origin of the materials, surface roughness, their potential defect structure, or electron-magnon scattering. We believe, the proposed intrinsic mechanism of magnetoresistance is applicable to a wide class of the layered AFM- ordered semimetals. The theoretically calculated magnetoresistance is qualitatively consistent with experimental data for crystals of various composition.


title: 2BP: 2-Stage Backpropagation

abstract: As Deep Neural Networks (DNNs) grow in size and complexity, they often exceed the memory capacity of a single accelerator, necessitating the sharding of model parameters across multiple accelerators. Pipeline parallelism is a commonly used sharding strategy for training large DNNs. However, current implementations of pipeline parallelism are being unintentionally bottlenecked by the automatic differentiation tools provided by ML frameworks. This paper introduces 2-stage backpropagation (2BP). By splitting the backward propagation step into two separate stages, we can reduce idle compute time. We tested 2BP on various model architectures and pipelining schedules, achieving increases in throughput in all cases. Using 2BP, we were able to achieve a 1.70x increase in throughput compared to traditional methods when training a LLaMa-like transformer with 7 billion parameters across 4 GPUs.


title: Expectation in Stochastic Window Mean-Payoff Games

abstract: Stochastic two-player games model systems with an environment that is both adversarial and stochastic. In this paper, we study the expected value of the window mean-payoff measure in stochastic games. The window mean-payoff measure strengthens the classical mean-payoff measure by measuring the mean-payoff over a window of bounded length that slides along an infinite path. Two variants have been considered: in one variant, the maximum window length is fixed and given, while in the other, it is not fixed but is required to be bounded. For both variants, we show that the decision problem to check if the expected value is at least a given threshold is in NP $\cap$ coNP. The result follows from guessing the expected values of the vertices, partitioning them into so-called value classes, and proving that a short certificate for the expected values exists. Finally, we also show that the memory required by the players to play optimally is no more than that in non-stochastic two-player games with the corresponding window objectives.