title: A New Insight into Electron Acceleration Properties from Theoretical Modeling of Double-Peaked Radio Light Curves in Core-Collapse Supernovae

abstract: It is recognized that some core-collapse supernovae (SNe) show a double-peaked radio light curve within a few years since the explosion. A shell of circumstellar medium (CSM) detached from the SN progenitor has been considered to play a viable role in characterizing such a re-brightening of radio emission. Here, we propose another mechanism that can give rise to the double-peaked radio light curve in core-collapse SNe. The key ingredient in the present work is to expand the model for the evolution of the synchrotron spectral energy distribution (SED) to a generic form, including fast and slow cooling regimes, as guided by the widely-accepted modeling scheme of gamma-ray burst afterglows. We show that even without introducing an additional CSM shell, the radio light curve would show a double-peaked morphology when the system becomes optically thin to synchrotron self-absorption at the observational frequency during the fast cooling regime. We can observe this double-peaked feature if the transition from fast cooling to slow cooling regime occurs during the typical observational timescale of SNe. This situation is realized when the minimum Lorentz factor of injected electrons is initially large enough for the non-thermal electrons' SED to be discrete from the thermal distribution. We propose SN 2007bg as a special case of double-peaked radio SNe that can be possibly explained by the presented scenario. Our model can serve as a potential diagnostic for electron acceleration properties in SNe.


title: Breast MRI radiomics and machine learning radiomics-based predictions of response to neoadjuvant chemotherapy -- how are they affected by variations in tumour delineation?

abstract: Manual delineation of volumes of interest (VOIs) by experts is considered the gold-standard method in radiomics analysis. However, it suffers from inter- and intra-operator variability. A quantitative assessment of the impact of variations in these delineations on the performance of the radiomics predictors is required to develop robust radiomics based prediction models. In this study, we developed radiomics models for the prediction of pathological complete response to neoadjuvant chemotherapy in patients with two different breast cancer subtypes based on contrast-enhanced magnetic resonance imaging acquired prior to treatment (baseline MRI scans). Different mathematical operations such as erosion, smoothing, dilation, randomization, and ellipse fitting were applied to the original VOIs delineated by experts to simulate variations of segmentation masks. The effects of such VOI modifications on various steps of the radiomics workflow, including feature extraction, feature selection, and prediction performance, were evaluated. Using manual tumor VOIs and radiomics features extracted from baseline MRI scans, an AUC of up to 0.96 and 0.89 was achieved for human epidermal growth receptor 2 positive and triple-negative breast cancer, respectively. For smoothing and erosion, VOIs yielded the highest number of robust features and the best prediction performance, while ellipse fitting and dilation lead to the lowest robustness and prediction performance for both breast cancer subtypes. At most 28% of the selected features were similar to manual VOIs when different VOI delineation data were used. Differences in VOI delineation affects different steps of radiomics analysis, and their quantification is therefore important for development of standardized radiomics research.


title: Physics-inspired Neural Networks for Parameter Learning of Adaptive Cruise Control Systems

abstract: This paper proposes and develops a physics-inspired neural network (PiNN) for learning the parameters of commercially implemented adaptive cruise control (ACC) systems in automotive industry. To emulate the core functionality of stock ACC systems, which have proprietary control logic and undisclosed parameters, the constant time-headway policy (CTHP) is adopted. Leveraging the multi-layer artificial neural networks as universal approximators, the developed PiNN serves as a surrogate model for the longitudinal dynamics of ACC-engaged vehicles, efficiently learning the unknown parameters of the CTHP. The PiNNs allow the integration of physical laws directly into the learning process. The ability of the PiNN to infer the unknown ACC parameters is meticulously assessed using both synthetic and high-fidelity empirical data of space-gap and relative velocity involving ACC-engaged vehicles in platoon formation. The results have demonstrated the superior predictive ability of the proposed PiNN in learning the unknown design parameters of stock ACC systems from different car manufacturers. The set of ACC model parameters obtained from the PiNN revealed that the stock ACC systems of the considered vehicles in three experimental campaigns are neither $\mathcal{L}_2$ nor $\mathcal{L}_\infty$ string stable.


title: NADiffuSE: Noise-aware Diffusion-based Model for Speech Enhancement

abstract: The goal of speech enhancement (SE) is to eliminate the background interference from the noisy speech signal. Generative models such as diffusion models (DM) have been applied to the task of SE because of better generalization in unseen noisy scenes. Technical routes for the DM-based SE methods can be summarized into three types: task-adapted diffusion process formulation, generator-plus-conditioner (GPC) structures and the multi-stage frameworks. We focus on the first two approaches, which are constructed under the GPC architecture and use the task-adapted diffusion process to better deal with the real noise. However, the performance of these SE models is limited by the following issues: (a) Non-Gaussian noise estimation in the task-adapted diffusion process. (b) Conditional domain bias caused by the weak conditioner design in the GPC structure. (c) Large amount of residual noise caused by unreasonable interpolation operations during inference. To solve the above problems, we propose a noise-aware diffusion-based SE model (NADiffuSE) to boost the SE performance, where the noise representation is extracted from the noisy speech signal and introduced as a global conditional information for estimating the non-Gaussian components. Furthermore, the anchor-based inference algorithm is employed to achieve a compromise between the speech distortion and noise residual. In order to mitigate the performance degradation caused by the conditional domain bias in the GPC framework, we investigate three model variants, all of which can be viewed as multi-stage SE based on the preprocessing networks for Mel spectrograms. Experimental results show that NADiffuSE outperforms other DM-based SE models under the GPC infrastructure. Audio samples are available at: https://square-of-w.github.io/NADiffuSE-demo/.


title: Implicit regularization of deep residual networks towards neural ODEs

abstract: Residual neural networks are state-of-the-art deep learning models. Their continuous-depth analog, neural ordinary differential equations (ODEs), are also widely used. Despite their success, the link between the discrete and continuous models still lacks a solid mathematical foundation. In this article, we take a step in this direction by establishing an implicit regularization of deep residual networks towards neural ODEs, for nonlinear networks trained with gradient flow. We prove that if the network is initialized as a discretization of a neural ODE, then such a discretization holds throughout training. Our results are valid for a finite training time, and also as the training time tends to infinity provided that the network satisfies a Polyak-Lojasiewicz condition. Importantly, this condition holds for a family of residual networks where the residuals are two-layer perceptrons with an overparameterization in width that is only linear, and implies the convergence of gradient flow to a global minimum. Numerical experiments illustrate our results.


title: Immersive Technologies in Virtual Companions: A Systematic Literature Review

abstract: The emergence of virtual companions is transforming the evolution of intelligent systems that effortlessly cater to the unique requirements of users. These advanced systems not only take into account the user present capabilities, preferences, and needs but also possess the capability to adapt dynamically to changes in the environment, as well as fluctuations in the users emotional state or behavior. A virtual companion is an intelligent software or application that offers support, assistance, and companionship across various aspects of users lives. Various enabling technologies are involved in building virtual companion, among these, Augmented Reality (AR), and Virtual Reality (VR) are emerging as transformative tools. While their potential for use in virtual companions or digital assistants is promising, their applications in these domains remain relatively unexplored. To address this gap, a systematic review was conducted to investigate the applications of VR, AR, and MR immersive technologies in the development of virtual companions. A comprehensive search across PubMed, Scopus, and Google Scholar yielded 28 relevant articles out of a pool of 644. The review revealed that immersive technologies, particularly VR and AR, play a significant role in creating digital assistants, offering a wide range of applications that brings various facilities in the individuals life in areas such as addressing social isolation, enhancing cognitive abilities and dementia care, facilitating education, and more. Additionally, AR and MR hold potential for enhancing Quality of life (QoL) within the context of virtual companion technology. The findings of this review provide a valuable foundation for further research in this evolving field.


title: Resolving the $R_{\rm pA}$ and $v_2$ puzzle of $D^0$ mesons in $p-$Pb collisions

abstract: It has been difficult to reconcile the experimental data on the $D^0$ meson nuclear modification factor and elliptic flow in $p-$Pb collisions at LHC energies. Here we study these observables with the string melting version of a multi-phase transport model, which has been improved with the implementation of the Cronin effect (or transverse momentum broadening) and independent fragmentation for charm quarks. Using a strong Cronin effect allows us to provide the first simultaneous description of the $D^0$ meson $R_{\rm pA}$ and $v_2$ data at $p_{\rm T} \leq$ 8 GeV$/c$. The model also provides a reasonable description of the $D^0$ meson $p_{\rm T}$ spectra and the low-$p_{\rm T}$ (below $\sim$ 2 GeV$/c$) charged hadron spectra in $p+p$ and $p-$Pb collisions as well as $R_{\rm pA}$ and $v_2$ in $p-$Pb collisions. We find that both parton scatterings and the Cronin effect are important for the $D^0$ meson $R_{\rm pA}$, while parton scatterings are mostly responsible for the $D^0$ meson $v_2$. Our results indicate that it is crucial to include the Cronin effect for the simultaneous description of the $D^0$ meson $R_{\rm pA}$ and $v_2$. Since the Cronin effect is expected to grow with the system size, this work implies that the Cronin effect could also be important for heavy hadrons in large systems.


title: Unifying positioning corrections and random number generations in silicon micro-strip trackers

abstract: The optimizations of the track fittings require complex simulations of silicon strip detectors to be compliant with the fundamental properties of the hit heteroscedasticity. Many different generations of random numbers must be available with distributions as similar as possible to the test-beam data. A fast way to solve this problem is an extension of an algorithm of frequent use for the center of gravity positioning corrections. Such extension gives a single method to generate the required types of random numbers. Actually, the starting algorithm is a random number generator, useful in a reverse mode: from non uniform sets of data to uniform ones. The inversion of this operation produces random numbers of given distributions. Many methods have been developed to generate random numbers, but none of those methods is directly connected with this positioning corrections. Hence, the adaptation of the correction algorithm to operate in both mode is illustrated. A sample distribution is generated and its consistency is verified with the Kolmogorov-Smirnov test. As final step, the elimination of the noise is explored, in fact, simulations require noiseless distributions to be modified by given noise models.


title: Quantum Tapsilou -- a quantum game inspired from the traditional Greek coin tossing game tapsilou

abstract: This paper introduces a new quantum game called Quantum Tapsilou that is inspired by the classical traditional Greek coin tossing game tapsilou. The new quantum game, despite its increased complexity and scope, retains the most important characteristic of the traditional game. In the classical game, both players have $\frac { 1 } { 4 }$ probability to win. The quantum version retains this characteristic feature, that is both players have the same probability to win, only now this probability varies considerably and depends on previous moves and choices. The two most important novelties of Quantum Tapsilou can be attributed to its implementation of entanglement via the use of rotation gates instead of Hadamard gates, which generates Bell-like states with unequal probability amplitudes, and the integral use of groups. In Quantum Tapsilou both players agree on a specific cyclic rotation group of order $n$, for some sufficiently large $n$. The game is based on the chosen group, in the sense that both players will draw their moves from its elements. More specifically, both players will pick rotations from this group to realize their actions using the corresponding $R_{ y }$ rotation gates. In the Quantum Tapsilou game, it is equally probable for both players to win. This fact is in accordance with a previous result in the literature showing that quantum games where both players choose their actions from the same group, exhibit perfect symmetry by providing each player with the possibility to pick the move that counteracts the other player's action.


title: Sharp sub-Gaussian upper bounds for subsolutions of Trudinger's equation on Riemannian manifolds

abstract: We consider on Riemannian manifolds the nonlinear evolution equation \begin{equation*} \partial _{t}u=\Delta _{p}(u^{1/(p-1)}), \end{equation*}% where $p>1$. This equation is also known as a doubly non-linear parabolic equation or Trudinger's equation. We prove that weak subsolutions of this equation have a sub-Gaussian upper bound and prove that this upper bound is sharp for a specific class of manifolds including $\mathbb{R}^{n}$.


title: Siren's Song in the AI Ocean: A Survey on Hallucination in Large Language Models

abstract: While large language models (LLMs) have demonstrated remarkable capabilities across a range of downstream tasks, a significant concern revolves around their propensity to exhibit hallucinations: LLMs occasionally generate content that diverges from the user input, contradicts previously generated context, or misaligns with established world knowledge. This phenomenon poses a substantial challenge to the reliability of LLMs in real-world scenarios. In this paper, we survey recent efforts on the detection, explanation, and mitigation of hallucination, with an emphasis on the unique challenges posed by LLMs. We present taxonomies of the LLM hallucination phenomena and evaluation benchmarks, analyze existing approaches aiming at mitigating LLM hallucination, and discuss potential directions for future research.


title: On the numerical approximation of the distance to singularity for matrix-valued functions

abstract: Given a matrix-valued function $\mathcal{F}(\lambda)=\sum_{i=1}^d f_i(\lambda) A_i$, with complex matrices $A_i$ and $f_i(\lambda)$ entire functions for $i=1,\ldots,d$, we discuss a method for the numerical approximation of the distance to singularity of $\mathcal{F}(\lambda)$. The closest singular matrix-valued function $\widetilde{\mathcal{F}}(\lambda)$ with respect to the Frobenius norm is approximated using an iterative method. The property of singularity on the matrix-valued function is translated into a numerical constraint for a suitable minimization problem. Unlike the case of matrix polynomials, in the general setting of matrix-valued functions the main issue is that the function $\det ( \widetilde{\mathcal{F}}(\lambda) )$ may have an infinite number of roots. An important feature of the numerical method consists in the possibility of addressing different structures, such as sparsity patterns induced by the matrix coefficients, in which case the search of the closest singular function is restricted to the class of functions preserving the structure of the matrices.


title: $\mathbb{H}^{2|2}$-model and Vertex-Reinforced Jump Process on Regular Trees: Infinite-Order Transition and an Intermediate Phase

abstract: We explore the supercritical phase of the vertex-reinforced jump process (VRJP) and the $\mathbb{H}^{2|2}$-model on rooted regular trees. The VRJP is a random walk, which is more likely to jump to vertices on which it has previously spent a lot of time. The $\mathbb{H}^{2|2}$-model is a supersymmetric lattice spin model, originally introduced as a toy model for the Anderson transition. On infinite rooted regular trees, the VRJP undergoes a recurrence/transience transition controlled by an inverse temperature parameter $\beta > 0$. Approaching the critical point from the transient regime, $\beta \searrow \beta_{\mathrm{c}}$, we show that the expected total time spent at the starting vertex diverges as $\sim \exp(c/\sqrt{\beta - \beta_{\mathrm{c}}})$. Moreover, on large finite trees we show that the VRJP exhibits an additional intermediate regime for parameter values $\beta_{\mathrm{c}} < \beta < \beta_{\mathrm{c}}^{\mathrm{erg}}$. In this regime, despite being transient in infinite volume, the VRJP on finite trees spends an unusually long time at the starting vertex with high probability. We provide analogous results for correlation functions of the $\mathbb{H}^{2|2}$-model. Our proofs rely on the application of branching random walk methods to a horospherical marginal of the $\mathbb{H}^{2|2}$-model.

categories: math.PR cond-mat.stat-mech math-ph math.MP


title: A remark on taut foliations and Floer homology

abstract: It is well-known that the reduced Floer homology of a rational homology sphere admitting a taut foliation does not vanish. We strengthen this by showing that (when thought of as an $\mathbb{F}[U]$-module) it also admits a direct $\mathbb{F}$-summand. Hence, one could potentially detect counterexamples to the foliation part of the $L$-space conjecture via purely Floer theoretic computations.


title: Tensor products of topological abelian groups and Pontryagin duality

abstract: Let $G$ be the group of all $\ZZ$-valued homomorphisms of the Baer-Specker group $\ZZ^\NN$. The group $G$ is algebraically isomorphic to $\ZZ^{(\NN)}$, the infinite direct sum of the group of integers, and equipped with the topology of pointwise convergence on $\ZZ^\NN$, becomes a non reflexive prodiscrete group. It was an open question to find its dual group $\hat{G}$. Here, we answer this question by proving that $\hat{G}$ is topologically isomorphic to $\ZZ^\NN\otimes_\mathcal{Q}\TT$, the (locally quasi-convex) tensor product of $\ZZ^\NN$ and $\TT$. Furthermore, we investigate the reflexivity properties of the groups of $C_p(X,\ZZ)$, the group of all $\ZZ$-valued continuous functions on $X$ equipped with the pointwise convergence topology, and $A_p(X)$, the free abelian group on a $0$-dimensional space $X$ equipped with the topology $t_p(C(X,\ZZ))$ of pointwise convergence topology on $C(X,\ZZ)$. In particular, we prove that $\hat{A_p(X)}\simeq C_p(X,\ZZ)\otimes_\mathcal{Q}\TT$ and we establish the existence of $0$-dimensional spaces $X$ such that $C_p(X,\ZZ)$ is Pontryagin reflexive.


title: Quasi-static Soft Fixture Analysis of Rigid and Deformable Objects

abstract: We present a sampling-based approach to reasoning about the caging-based manipulation of rigid and a simplified class of deformable 3D objects subject to energy constraints. Towards this end, we propose the notion of soft fixtures extending earlier work on energy-bounded caging to include a broader set of energy function constraints and settings, such as gravitational and elastic potential energy of 3D deformable objects. Previous methods focused on establishing provably correct algorithms to compute lower bounds or analytically exact estimates of escape energy for a very restricted class of known objects with low-dimensional C-spaces, such as planar polygons. We instead propose a practical sampling-based approach that is applicable in higher-dimensional C-spaces but only produces a sequence of upper-bound estimates that, however, appear to converge rapidly to actual escape energy. We present 8 simulation experiments demonstrating the applicability of our approach to various complex quasi-static manipulation scenarios. Quantitative results indicate the effectiveness of our approach in providing upper-bound estimates for escape energy in quasi-static manipulation scenarios. Two real-world experiments also show that the computed normalized escape energy estimates appear to correlate strongly with the probability of escape of an object under randomized pose perturbation.


title: Stabilization of parareal algorithms for long time computation of a class of highly oscillatory Hamiltonian flows using data

abstract: Applying parallel-in-time algorithms to multiscale Hamiltonian systems to obtain stable long time simulations is very challenging. In this paper, we present novel data-driven methods aimed at improving the standard parareal algorithm developed by Lion, Maday, and Turinici in 2001, for multiscale Hamiltonian systems. The first method involves constructing a correction operator to improve a given inaccurate coarse solver through solving a Procrustes problem using data collected online along parareal trajectories. The second method involves constructing an efficient, high-fidelity solver by a neural network trained with offline generated data. For the second method, we address the issues of effective data generation and proper loss function design based on the Hamiltonian function. We show proof-of-concept by applying the proposed methods to a Fermi-Pasta-Ulum (FPU) problem. The numerical results demonstrate that the Procrustes parareal method is able to produce solutions that are more stable in energy compared to the standard parareal. The neural network solver can achieve comparable or better runtime performance compared to numerical solvers of similar accuracy. When combined with the standard parareal algorithm, the improved neural network solutions are slightly more stable in energy than the improved numerical coarse solutions.


title: Saturn: An Optimized Data System for Large Model Deep Learning Workloads

abstract: Large language models such as GPT-3 & ChatGPT have transformed deep learning (DL), powering applications that have captured the public's imagination. These models are rapidly being adopted across domains for analytics on various modalities, often by finetuning pre-trained base models. Such models need multiple GPUs due to both their size and computational load, driving the development of a bevy of "model parallelism" techniques & tools. Navigating such parallelism choices, however, is a new burden for end users of DL such as data scientists, domain scientists, etc. who may lack the necessary systems knowhow. The need for model selection, which leads to many models to train due to hyper-parameter tuning or layer-wise finetuning, compounds the situation with two more burdens: resource apportioning and scheduling. In this work, we tackle these three burdens for DL users in a unified manner by formalizing them as a joint problem that we call SPASE: Select a Parallelism, Allocate resources, and SchedulE. We propose a new information system architecture to tackle the SPASE problem holistically, representing a key step toward enabling wider adoption of large DL models. We devise an extensible template for existing parallelism schemes and combine it with an automated empirical profiler for runtime estimation. We then formulate SPASE as an MILP. We find that direct use of an MILP-solver is significantly more effective than several baseline heuristics. We optimize the system runtime further with an introspective scheduling approach. We implement all these techniques into a new data system we call Saturn. Experiments with benchmark DL workloads show that Saturn achieves 39-49% lower model selection runtimes than typical current DL practice.


title: The Born Oscillator

abstract: The paper studies the properties of an oscillator whose Hamiltonian is $[(1+q^2)(1+p^2)]^{1/2}-1$. It can be deduced from the nonlinear theory of electrodynamics originally proposed by Max Born in 1934. The quantization of such oscillator represents a possible regularization of the Barry and Keating's Hamiltonian, which has been proposed in the framework of the theory of non-trivial zeros of the Riemann's $\zeta$ function.


title: An infinite family of hyperovals of $Q^+(5,q)$, $q$ even

abstract: We construct an infinite family of hyperovals on the Klein quadric $Q^+(5,q)$, $q$ even. The construction makes use of ovoids of the symplectic generalized quadrangle $W(q)$ that is associated with an elliptic quadric which arises as solid intersection with $Q^+(5,q)$. We also solve the isomorphism problem: we determine necessary and sufficient conditions for two hyperovals arising from the construction to be isomorphic.


title: Inverse modeling of time-delayed interactions via the dynamic-entropy formalism

abstract: Even though instantaneous interactions are unphysical, a large variety of maximum-entropy statistical-inference methods match the model inferred and the empirically measured equal-time correlation functions. While this constraint holds when the interaction timescale is much faster than that of the interacting units, as, e.g., in starling flocks (where birds see each other via the electromagnetic field), it fails in a number of counter examples, as, e.g., leukocyte coordination (where signalling proteins diffuse among two cells). Here, by relying upon the Akaike Information Criterion, we relax this assumption and develop a dynamical maximum-entropy framework, which copes with delay in signalling. Our method correctly infers the strength of couplings and fields, but also the time required by the couplings to propagate among the units. We demonstrate the validity of our approach providing excellent results on synthetic datasets generated by the Heisemberg-Kuramoto and Vicsek models. As a proof of concept, we also apply the method to experiments on dendritic migration to prove that matching equal-time correlations results in a significant information loss.


title: lfads-torch: A modular and extensible implementation of latent factor analysis via dynamical systems

abstract: Latent factor analysis via dynamical systems (LFADS) is an RNN-based variational sequential autoencoder that achieves state-of-the-art performance in denoising high-dimensional neural activity for downstream applications in science and engineering. Recently introduced variants and extensions continue to demonstrate the applicability of the architecture to a wide variety of problems in neuroscience. Since the development of the original implementation of LFADS, new technologies have emerged that use dynamic computation graphs, minimize boilerplate code, compose model configuration files, and simplify large-scale training. Building on these modern Python libraries, we introduce lfads-torch -- a new open-source implementation of LFADS that unifies existing variants and is designed to be easier to understand, configure, and extend. Documentation, source code, and issue tracking are available at https://github.com/arsedler9/lfads-torch .


title: Two Games on Arithmetic Functions: SALIQUANT and NONTOTIENT

abstract: We investigate the Sprague-Grundy sequences for two normal-play impartial games based on arithmetic functions, first described by Iannucci and Larsson in \cite{sum}. In each game, the set of positions is N (natural numbers). In saliquant, the options are to subtract a non-divisor. Here we obtain several nice number theoretic lemmas, a fundamental theorem, and two conjectures about the eventual density of Sprague-Grundy values. In nontotient, the only option is to subtract the number of relatively prime residues. Here are able to calculate certain Sprague-Grundy values, and start to understand an appropriate class function.


title: Chirped Pulse Control of Raman Coherence in Atoms and Molecules

abstract: A novel chirped pulse control scheme is presented based on Coherent Anti-Stokes Raman Spectroscopy (C-CARS) aiming at maximizing the vibrational coherence in atoms and molecules. The scheme utilizes chirping of the three incoming pulses, the pump, the Stokes and the probe, in the four-wave mixing process of C-CARS to fulfill the adiabatic passage conditions. The derivation of the scheme is based on simplifying the four-level system into a 'super-effective' two level system via rotating wave approximation and adiabatic elimination of the excited state manifold. The robustness, spectral selectivity and adiabatic nature of C-CARS method may prove useful for sensing, imaging, and detection. It is demonstrated that the selectivity in excitation of vibrational degrees of freedom can be controlled by carefully choosing the spectral chirp rate of the pulses. The C-CARS control scheme is applied to a surrogate methanol molecule to generate an optimal anti-Stokes signal backscattered from a cloud of molecules a kilometer away. The theory is based on the solution of the coupled Maxwell-Liouville von Neumann equations and focuses on the quantum effects induced in the target molecules by the control pulse trains. The propagation effects of pulses through the medium are evaluated and the buildup of the molecular-specific anti-Stokes signal is demonstrated numerically. A deep learning technique, using Convolutional Neural Networks (CNN), is implemented to characterize the control pulses and evaluate time-dependent phase characteristics from them. The effects of decoherence induced by spontaneous decay and collisional dephasing are also examined. Additionally, we present the technique of Fractional Stimulated Raman Adiabatic Passage (F-STIRAP) and demonstrate that it can be utilized for remote detection in a multi-level system by creation of a maximally coherent superposition state.


title: An FLRW accelerating universe model in Weyl type $f(Q)$ gravity and Observational Constraints

abstract: We propose to develop a cosmological model of the universe based on Weyl type $ f(Q) $ gravity which shows the transition from decelerating in the past to acceleration at present by considering a particular functional form of $ f(Q) $ gravity as $ f(Q) = ({H_0}^2) (\alpha_1 + \alpha_2 \hskip0.05in log ({H_0^{-2}} Q)) $. We have solved Weyl type $ f(Q) $ gravity field equations numerically and have obtained numerical solutions to the Hubble and deceleration parameters, distance modulus, and apparent magnitudes of stellar objects like SNIa Supernovae. We have also obtained numerical solutions for the Weyl vector $ w $, non-metricity scalar $ Q $, and the Lagrangian multiplier $ \lambda $ appearing in the action of $ f(Q) $ gravity. We have compared our theoretical solutions with the error bar plots of the Observed Hubble data set of $ 77 $ points, $ 580 $ distance modulus SNIa data set, and $ 1048 $ supernova Pantheon data sets of apparent magnitudes. It is found that our results fit well with the observed data set points. \bf{The model envisages a unique feature that although the universe is filled with perfect fluid as dust whose pressure is zero, still the weyl vector dominance f(Q) creates acceleration in it. }


title: On the estimation of fuzzy poverty indices

abstract: We review the fuzzy approach to poverty measurement by comparing poverty indices using different membership functions proposed in the literature. We put our main focus on the issue of estimation of the mean squared errors of these fuzzy methods showing which indices can be more accurately estimated using sample data. By means of simulations, we also investigate the role of parameters of the membership function when it comes to estimating mean squared errors via a robustness analysis.


title: Generalizability and Application of the Skin Reflectance Estimate Based on Dichromatic Separation (SREDS)

abstract: Face recognition (FR) systems have become widely used and readily available in recent history. However, differential performance between certain demographics has been identified within popular FR models. Skin tone differences between demographics can be one of the factors contributing to the differential performance observed in face recognition models. Skin tone metrics provide an alternative to self-reported race labels when such labels are lacking or completely not available e.g. large-scale face recognition datasets. In this work, we provide a further analysis of the generalizability of the Skin Reflectance Estimate based on Dichromatic Separation (SREDS) against other skin tone metrics and provide a use case for substituting race labels for SREDS scores in a privacy-preserving learning solution. Our findings suggest that SREDS consistently creates a skin tone metric with lower variability within each subject and SREDS values can be utilized as an alternative to the self-reported race labels at minimal drop in performance. Finally, we provide a publicly available and open-source implementation of SREDS to help the research community. Available at https://github.com/JosephDrahos/SREDS


title: BodySLAM++: Fast and Tightly-Coupled Visual-Inertial Camera and Human Motion Tracking

abstract: Robust, fast, and accurate human state - 6D pose and posture - estimation remains a challenging problem. For real-world applications, the ability to estimate the human state in real-time is highly desirable. In this paper, we present BodySLAM++, a fast, efficient, and accurate human and camera state estimation framework relying on visual-inertial data. BodySLAM++ extends an existing visual-inertial state estimation framework, OKVIS2, to solve the dual task of estimating camera and human states simultaneously. Our system improves the accuracy of both human and camera state estimation with respect to baseline methods by 26% and 12%, respectively, and achieves real-time performance at 15+ frames per second on an Intel i7-model CPU. Experiments were conducted on a custom dataset containing both ground truth human and camera poses collected with an indoor motion tracking system.


title: The Information Geometry of UMAP

abstract: Although UMAP was derived from Category Theory observations, its underlying mechanisms may be clarified using Information Geometry.


title: Performance-Sensitive Potential Functions for Efficient Flow of Connected and Automated Vehicles

abstract: Connected and automated vehicles (CAVs) provide the most intriguing opportunity for enabling users to monitor transportation network conditions and make better decisions for improving safety and transportation efficiency. In this paper, we address the problem of effectively coordinating CAVs on lane-based roadways. Our approach utilizes potential functions to generate repulsive forces between CAVs that ensure collision avoidance. However, such potential functions can lead to unrealistic acceleration profiles and large inter-vehicle distances. The primary contribution of this work is the introduction of performance-sensitive potential functions to address these challenges. In our approach, the parameters of a potential function are determined through an optimization problem aiming to reduce both acceleration and inter-vehicle distances. To circumvent the computational implications due to the complexity of the resulting optimization problem that prevents the derivation of a real-time solution, we train a neural network model to learn the mapping of initial conditions to optimal parameters derived offline. Then, we prove sufficient criteria for the sampled-data model to ensure that the neural network output does not activate any of the state and safety constraints. Finally, we provide simulation results to demonstrate the effectiveness of the proposed approach.


title: Primordial black holes in non-canonical scalar field inflation driven by quartic potential in the presence of bump

abstract: Here, generation of Primordial Black Holes (PBHs) from quartic potential in the presence of a tiny bump in non-canonical inflationary model has been inquired. It is demonstrated that, a viable inflationary era can be driven through the quartic potential in non-canonical framework with a power-law Lagrangian density. Furthermore, setting a suitable function of inflaton field as a correction term (like a bump) to the quartic potential, causes the inflaton to slow down for a while. In such a short time span, the amplitude of the scalar perturbations power spectrum on small scales grows up sufficiently versus CMB scales. In addition to the bump feature, the enhancing effect of the $\alpha$ parameter of the Lagrangian on the amplitude of the scalar power spectrum has been shown. Fine tuning of three parameter Cases of the model results in generating of three Cases of PBHs. In addition, we investigate the secondary Gravitational Waves (GWs) produced during generation of PBHs and show that their contemporary density parameter spectra $(\Omega_{\rm GW_0})$ can be tracked down by GWs detectors.


title: Decentralized shape formation and force-based interactive formation control in robot swarms

abstract: Swarm robotic systems utilize collective behaviour to achieve goals that might be too complex for a lone entity, but become attainable with localized communication and collective decision making. In this paper, a behaviour-based distributed approach to shape formation is proposed. Flocking into strategic formations is observed in migratory birds and fish to avoid predators and also for energy conservation. The formation is maintained throughout long periods without collapsing and is advantageous for communicating within the flock. Similar behaviour can be deployed in multi-agent systems to enhance coordination within the swarm. Existing methods for formation control are either dependent on the size and geometry of the formation or rely on maintaining the formation with a single reference in the swarm (the leader). These methods are not resilient to failure and involve a high degree of deformation upon obstacle encounter before the shape is recovered again. To improve the performance, artificial force-based interaction amongst the entities of the swarm to maintain shape integrity while encountering obstacles is elucidated.


title: On a finite state representation of $GL(n,\mathbb{Z})$

abstract: It is examined finite state automorphisms of regular rooted trees constructed to represent groups $GL(n,\mathbb{Z})$. The number of states of automorphisms that correspond to elementary matrices is computed. Using the representation of $GL(2,\mathbb{Z})$ over an alphabet of size $4$ a finite state representation of the free group of rank $2$ over binary alphabet is constructed.


title: On input-to-state stability verification of identified models obtained by Koopman operator

abstract: This paper proposes a class of basis functions for realizing the input-to-state stability verification of identified models obtained from the true system (assumed to be input-to-state stable) using the Koopman operator. The formulated input-to-state stability conditions are in the form of linear matrix inequalities. We also present extensions to relax the imposed restrictions on the basis functions. A numerical example is provided to demonstrate the efficacy of the proposed results.


title: The Normal Distributions Indistinguishability Spectrum and its Application to Privacy-Preserving Machine Learning

abstract: Differential Privacy (DP) (and its variants) is the most common method for machine learning (ML) on privacy-sensitive data. In big data analytics, one often uses randomized sketching/aggregation algorithms to make processing high-dimensional data tractable. Intuitively, such ML algorithms should provide some inherent privacy, yet most existing DP mechanisms do not leverage or under-utilize this inherent randomness, resulting in potentially redundant noising. The motivating question of our work is: (How) can we improve the utility of DP mechanisms for randomized ML queries, by leveraging the randomness of the query itself? Towards a (positive) answer, our key contribution is (proving) what we call the NDIS theorem, a theoretical result with several practical implications. In a nutshell, NDIS is a closed-form analytic computation for the (varepsilon,delta)-indistinguishability-spectrum (IS) of two arbitrary normal distributions N1 and N2, i.e., the optimal delta (for any given varepsilon) such that N1 and N2 are (varepsilon,delta)-close according to the DP distance. The importance of the NDIS theorem lies in that (1) it yields efficient estimators for IS, and (2) it allows us to analyze DP-mechanism with normally-distributed outputs, as well as more general mechanisms by leveraging their behavior on large inputs. We apply the NDIS theorem to derive DP mechanisms for queries with normally-distributed outputs--i.e., Gaussian Random Projections (RP)--and for more general queries--i.e., Ordinary Least Squares (OLS). Compared to existing techniques, our new DP mechanisms achieve superior privacy/utility trade-offs by leveraging the randomness of the underlying algorithms. We then apply the NDIS theorem to a data-driven DP notion--in particular relative DP introduced by Lu et al. [S&P 2024]. Our method identifies the range of (varepsilon,delta) for which no additional noising is needed.


title: On the Convergence of L-shaped Algorithms for Two-Stage Stochastic Programming

abstract: In this paper, we design, analyze, and implement a variant of the two-loop L-shaped algorithms for solving two-stage stochastic programming problems that arise from important application areas including revenue management and power systems. We consider the setting in which it is intractable to compute exact objective function and (sub)gradient information, and instead, only estimates of objective function and (sub)gradient values are available. Under common assumptions including fixed recourse and bounded (sub)gradients, the algorithm generates a sequence of iterates that converge to a neighborhood of optimality, where the radius of the convergence neighborhood depends on the level of the inexactness of objective function estimates. The number of outer and inner iterations needed to find an approximate optimal iterate is provided. Finally, we show a sample complexity result for the algorithm with a Polyak-type step-size policy that can be extended to analyze other situations. We also present a numerical study that verifies our theoretical results and demonstrates the superior empirical performance of our proposed algorithms over classic solvers.


title: Representations Matter: Embedding Modes of Large Language Models using Dynamic Mode Decomposition

abstract: Existing large language models (LLMs) are known for generating "hallucinated" content, namely a fabricated text of plausibly looking, yet unfounded, facts. To identify when these hallucination scenarios occur, we examine the properties of the generated text in the embedding space. Specifically, we draw inspiration from the dynamic mode decomposition (DMD) tool in analyzing the pattern evolution of text embeddings across sentences. We empirically demonstrate how the spectrum of sentence embeddings over paragraphs is constantly low-rank for the generated text, unlike that of the ground-truth text. Importantly, we find that evaluation cases having LLM hallucinations correspond to ground-truth embedding patterns with a higher number of modes being poorly approximated by the few modes associated with LLM embedding patterns. In analogy to near-field electromagnetic evanescent waves, the embedding DMD eigenmodes of the generated text with hallucinations vanishes quickly across sentences as opposed to those of the ground-truth text. This suggests that the hallucinations result from both the generation techniques and the underlying representation.


title: Towards Generic Image Manipulation Detection with Weakly-Supervised Self-Consistency Learning

abstract: As advanced image manipulation techniques emerge, detecting the manipulation becomes increasingly important. Despite the success of recent learning-based approaches for image manipulation detection, they typically require expensive pixel-level annotations to train, while exhibiting degraded performance when testing on images that are differently manipulated compared with training images. To address these limitations, we propose weakly-supervised image manipulation detection, such that only binary image-level labels (authentic or tampered with) are required for training purpose. Such a weakly-supervised setting can leverage more training images and has the potential to adapt quickly to new manipulation techniques. To improve the generalization ability, we propose weakly-supervised self-consistency learning (WSCL) to leverage the weakly annotated images. Specifically, two consistency properties are learned: multi-source consistency (MSC) and inter-patch consistency (IPC). MSC exploits different content-agnostic information and enables cross-source learning via an online pseudo label generation and refinement process. IPC performs global pair-wise patch-patch relationship reasoning to discover a complete region of manipulation. Extensive experiments validate that our WSCL, even though is weakly supervised, exhibits competitive performance compared with fully-supervised counterpart under both in-distribution and out-of-distribution evaluations, as well as reasonable manipulation localization ability.


title: Evaluation of forecasts by a global data-driven weather model with and without probabilistic post-processing at Norwegian stations

abstract: During the last two years, tremendous progress in global data-driven weather models trained on numerical weather prediction (NWP) re-analysis data has been made. The most recent models trained on the ERA5 at 0.25{\deg} resolution demonstrate forecast quality on par with ECMWF's high-resolution model with respect to a wide selection of verification metrics. In this study, one of these models, the Pangu-Weather, is compared to several NWP models with and without probabilistic post-processing for 2-meter temperature and 10-meter wind speed forecasting at 183 Norwegian SYNOP stations up to +60 hours ahead. The NWP models included are the ECMWF HRES, ECMWF ENS and the Harmonie-AROME ensemble model MEPS with 2.5 km spatial resolution. Results show that the performances of the global models are on the same level with Pangu-Weather being slightly better than the ECMWF models for temperature and slightly worse for wind speed. The MEPS model clearly provided the best forecasts for both parameters. The post-processing improved the forecast quality considerably for all models, but to a larger extent for the coarse-resolution global models due to stronger systematic deficiencies in these. Apart from this, the main characteristics in the scores were more or less the same with and without post-processing. Our results thus confirm the conclusions from other studies that global data-driven models are promising for operational weather forecasting.


title: Modified Step Size for Enhanced Stochastic Gradient Descent: Convergence and Experiments

abstract: This paper introduces a novel approach to enhance the performance of the stochastic gradient descent (SGD) algorithm by incorporating a modified decay step size based on $\frac{1}{\sqrt{t}}$. The proposed step size integrates a logarithmic term, leading to the selection of smaller values in the final iterations. Our analysis establishes a convergence rate of $O(\frac{\ln T}{\sqrt{T}})$ for smooth non-convex functions without the Polyak-{\L}ojasiewicz condition. To evaluate the effectiveness of our approach, we conducted numerical experiments on image classification tasks using the FashionMNIST, and CIFAR10 datasets, and the results demonstrate significant improvements in accuracy, with enhancements of $0.5\%$ and $1.4\%$ observed, respectively, compared to the traditional $\frac{1}{\sqrt{t}}$ step size. The source code can be found at \\\url{https://github.com/Shamaeem/LNSQRTStepSize}.


title: Large AI Model Empowered Multimodal Semantic Communications

abstract: Multimodal signals, including text, audio, image and video, can be integrated into Semantic Communication (SC) for providing an immersive experience with low latency and high quality at the semantic level. However, the multimodal SC has several challenges, including data heterogeneity, semantic ambiguity, and signal fading. Recent advancements in large AI models, particularly in Multimodal Language Model (MLM) and Large Language Model (LLM), offer potential solutions for these issues. To this end, we propose a Large AI Model-based Multimodal SC (LAM-MSC) framework, in which we first present the MLM-based Multimodal Alignment (MMA) that utilizes the MLM to enable the transformation between multimodal and unimodal data while preserving semantic consistency. Then, a personalized LLM-based Knowledge Base (LKB) is proposed, which allows users to perform personalized semantic extraction or recovery through the LLM. This effectively addresses the semantic ambiguity. Finally, we apply the Conditional Generative adversarial networks-based channel Estimation (CGE) to obtain Channel State Information (CSI). This approach effectively mitigates the impact of fading channels in SC. Finally, we conduct simulations that demonstrate the superior performance of the LAM-MSC framework.


title: Longest Common Substring and Longest Palindromic Substring in $\tilde{\mathcal{O}}(\sqrt{n})$ Time

abstract: The Longest Common Substring (LCS) and Longest Palindromic Substring (LPS) are classical problems in computer science, representing fundamental challenges in string processing. Both problems can be solved in linear time using a classical model of computation, by means of very similar algorithms, both relying on the use of suffix trees. Very recently, two sublinear algorithms for LCS and LPS in the quantum query model have been presented by Le Gall and Seddighin~\cite{GallS23}, requiring $\tilde{\mathcal{O}}(n^{5/6})$ and $\tilde{\mathcal{O}}(\sqrt{n})$ queries, respectively. However, while the query model is fascinating from a theoretical standpoint, its practical applicability becomes limited when it comes to crafting algorithms meant for actual execution on real hardware. In this paper we present, for the first time, a $\tilde{\mathcal{O}}(\sqrt{n})$ quantum algorithm for both LCS and LPS working in the circuit model of computation. Our solutions are simpler than previous ones and can be easily translated into quantum procedures. We also present actual implementations of the two algorithms as quantum circuits working in $\mathcal{O}(\sqrt{n}\log^5(n))$ and $\mathcal{O}(\sqrt{n}\log^4(n))$ time, respectively.


title: Reflection of Stochastic Evolution Equations in Infinite Dimensional Domains

abstract: In this paper, we establish the existence and the uniqueness of solutions of stochastic evolution equations (SEEs) with reflection in an infinite dimensional ball. Our framework is sufficiently general to include e.g. the stochastic Navier-Stokes equations.


title: S2RF: Semantically Stylized Radiance Fields

abstract: We present our method for transferring style from any arbitrary image(s) to object(s) within a 3D scene. Our primary objective is to offer more control in 3D scene stylization, facilitating the creation of customizable and stylized scene images from arbitrary viewpoints. To achieve this, we propose a novel approach that incorporates nearest neighborhood-based loss, allowing for flexible 3D scene reconstruction while effectively capturing intricate style details and ensuring multi-view consistency.


title: Lattice homology and Seiberg-Witten-Floer spectra

abstract: Using lattice homology, we give an explicit combinatorial description of the Seiberg-Witten-Floer spectrum $\mathit{SWF}(Y)$ for $Y$ an almost-rational plumbed homology sphere. This class of manifolds includes all Seifert fibered rational homology spheres with base orbifold $S^2$. Using our computations, we provide a calculation of Manolescu's $\kappa$-invariant for certain connected sums of these spaces.


title: A Bootstrap Hypothesis Test for High-Dimensional Mean Vectors

abstract: This paper is concerned with testing global null hypotheses about population mean vectors of high-dimensional data. Current tests require either strong mixing (independence) conditions on the individual components of the high-dimensional data or high-order moment conditions. In this paper, we propose a novel class of bootstrap hypothesis tests based on $\ell_p$-statistics with $p \in [1, \infty]$ which requires neither of these assumptions. We study asymptotic size, unbiasedness, consistency, and Bahadur slope of these tests. Capitalizing on these theoretical insights, we develop a modified bootstrap test with improved power properties and a self-normalized bootstrap test for elliptically distributed data. We then propose two novel bias correction procedures to improve the accuracy of the bootstrap test in finite samples, which leverage measure concentration and hypercontractivity properties of $\ell_p$-norms in high dimensions. Numerical experiments support our theoretical results in finite samples.


title: On the structure of the Schur complement matrix for the Stokes equation

abstract: In this paper, we investigate the structure of the Schur complement matrix for the fully-staggered finite-difference discretization of the stationary Stokes equation. Specifically, we demonstrate that the structure of the Schur complement matrix depends qualitatively on a particular characteristic, namely the number of non-unit eigenvalues, and the two limiting cases are of special interest.


title: BDC-Adapter: Brownian Distance Covariance for Better Vision-Language Reasoning

abstract: Large-scale pre-trained Vision-Language Models (VLMs), such as CLIP and ALIGN, have introduced a new paradigm for learning transferable visual representations. Recently, there has been a surge of interest among researchers in developing lightweight fine-tuning techniques to adapt these models to downstream visual tasks. We recognize that current state-of-the-art fine-tuning methods, such as Tip-Adapter, simply consider the covariance between the query image feature and features of support few-shot training samples, which only captures linear relations and potentially instigates a deceptive perception of independence. To address this issue, in this work, we innovatively introduce Brownian Distance Covariance (BDC) to the field of vision-language reasoning. The BDC metric can model all possible relations, providing a robust metric for measuring feature dependence. Based on this, we present a novel method called BDC-Adapter, which integrates BDC prototype similarity reasoning and multi-modal reasoning network prediction to perform classification tasks. Our extensive experimental results show that the proposed BDC-Adapter can freely handle non-linear relations and fully characterize independence, outperforming the current state-of-the-art methods by large margins.


title: A dynamic state-based model of crowds

abstract: We consider the problem of categorizing and describing the dynamic properties and behaviours of crowds over time. Previous work has tended to focus on a relatively static "typology"-based approach, which does not account for the fact that crowds can change, often quite rapidly. Moreover, the labels attached to crowd behaviours are often subjective and/or value-laden. Here, we present an alternative approach, loosely based on the statechart formalism from computer science. This uses relatively "agnostic" labels, which means that we do not prescribe the behaviour of an individual, but provide a context within which an individual might behave. This naturally describes the time-series evolution of a crowd as "threads" of states, and allows for the dynamic handling of an arbitrary number of "sub-crowds".


title: Efficient Classical Shadow Tomography through Many-body Localization Dynamics

abstract: Classical shadow tomography serves as a potent tool for extracting numerous properties from quantum many-body systems with minimal measurements. Nevertheless, prevailing methods yielding optimal performance for few-body operators necessitate the application of random two-qubit gates, a task that can prove challenging on specific quantum simulators such as ultracold atomic gases. In this work, we introduce an alternative approach founded on the dynamics of many-body localization, a phenomenon extensively demonstrated in optical lattices. Through an exploration of the shadow norm -- both analytically, employing a phenomenological model, and numerically, utilizing the TEBD algorithm -- we demonstrate that our scheme achieves remarkable efficiency comparable to shallow circuits or measurement-induced criticality. This efficiency provides an exponential advantage over the Pauli measurement protocol for few-body measurements. Our findings are corroborated through direct numerical simulations encompassing the entire sampling and reconstruction processes. Consequently, our results present a compelling methodology for analyzing the output states of quantum simulators.

categories: quant-ph cond-mat.dis-nn cond-mat.quant-gas cond-mat.stat-mech


title: The science of ultra-high energy cosmic rays after more than 15 years of operation of the Pierre Auger Observatory

abstract: Ultra-high energy cosmic rays (UHECRs) have been studied with the data of the Pierre Auger Observatory for more than fifteen years. An essential feature of the Observatory is its hybrid design: UHECRs are detected through the observation of the associated extensive air showers (EASs) with different and complementary techniques. The analyses of the multi-detector data have enabled high-statistics and high-precision studies of the UHECR energy spectrum, mass composition and distribution of arrival directions. The resulting science of UHECRs is summarized in this contribution. While no discrete source of UHECRs has been identified so far, the extragalactic origin of the particles has been recently confirmed from the arrival directions above 8~EeV, and the ring is closing around nearby astrophysical sites at higher energies. Also, the established upper limits on fluxes of UHE neutrinos and photons have implications on multi-messenger studies and beyond-the-Standard-Model (BSM) physics.


title: Completions of triangulated categories

abstract: These notes for a master class at Aarhus University (March 22--24, 2023) provide an introduction to the theory of completion for triangulated categories.


title: Worst-Case Input Generation for Concurrent Programs under Non-Monotone Resource Metrics

abstract: Worst-case input generation aims to automatically generate inputs that exhibit the worst-case performance of programs. It has several applications, and can, for example, detect vulnerabilities to denial-of-service attacks. However, it is non-trivial to generate worst-case inputs for concurrent programs, particularly for resources like memory where the peak cost depends on how processes are scheduled. This article presents the first sound worst-case input generation algorithm for concurrent programs under non-monotone resource metrics like memory. The key insight is to leverage resource-annotated session types and symbolic execution. Session types describe communication protocols on channels in process calculi. Equipped with resource annotations, resource-annotated session types not only encode cost bounds but also indicate how many resources can be reused and transferred between processes. This information is critical for identifying a worst-case execution path during symbolic execution. The algorithm is sound: if it returns any input, it is guaranteed to be a valid worst-case input. The algorithm is also relatively complete: as long as resource-annotated session types are sufficiently expressive and the background theory for SMT solving is decidable, a worst-case input is guaranteed to be returned. A simple case study of a web server's memory usage demonstrates the utility of the worst-case input generation algorithm.


title: Multimodal Contrastive Learning with Hard Negative Sampling for Human Activity Recognition

abstract: Human Activity Recognition (HAR) systems have been extensively studied by the vision and ubiquitous computing communities due to their practical applications in daily life, such as smart homes, surveillance, and health monitoring. Typically, this process is supervised in nature and the development of such systems requires access to large quantities of annotated data. However, the higher costs and challenges associated with obtaining good quality annotations have rendered the application of self-supervised methods an attractive option and contrastive learning comprises one such method. However, a major component of successful contrastive learning is the selection of good positive and negative samples. Although positive samples are directly obtainable, sampling good negative samples remain a challenge. As human activities can be recorded by several modalities like camera and IMU sensors, we propose a hard negative sampling method for multimodal HAR with a hard negative sampling loss for skeleton and IMU data pairs. We exploit hard negatives that have different labels from the anchor but are projected nearby in the latent space using an adjustable concentration parameter. Through extensive experiments on two benchmark datasets: UTD-MHAD and MMAct, we demonstrate the robustness of our approach forlearning strong feature representation for HAR tasks, and on the limited data setting. We further show that our model outperforms all other state-of-the-art methods for UTD-MHAD dataset, and self-supervised methods for MMAct: Cross session, even when uni-modal data are used during downstream activity recognition.


title: $P$-log-Sobolev inequalities on $\mathbb{N}$

abstract: We answer an open problem posed by Mossel--Oleszkiewicz--Sen regarding relations between $p$-log-Sobolev inequalities for $p\in(0,1]$. We show that for any interval $I\subset(0,1]$, there exist $q,p\in I$, $q<p$, and a measure $\mu$ for which the $q$-log-Sobolev inequality holds, while the $p$-log-Sobolev inequality is violated. As a tool we develop certain necessary and closely related sufficient conditions characterizing those inequalities in the case of birth-death processes on $\mathbb{N}$.


title: Upward and Orthogonal Planarity are W[1]-hard Parameterized by Treewidth

abstract: Upward planarity testing and Rectilinear planarity testing are central problems in graph drawing. It is known that they are both NP-complete, but XP when parameterized by treewidth. In this paper we show that these two problems are W[1]-hard parameterized by treewidth, which answers open problems posed in two earlier papers. The key step in our proof is an analysis of the All-or-Nothing Flow problem, a generalization of which was used as an intermediate step in the NP-completeness proof for both planarity testing problems. We prove that the flow problem is W[1]-hard parameterized by treewidth on planar graphs, and that the existing chain of reductions to the planarity testing problems can be adapted without blowing up the treewidth. Our reductions also show that the known $n^{O(tw)}$-time algorithms cannot be improved to run in time $n^{o(tw)}$ unless ETH fails.


title: SOAR: Scene-debiasing Open-set Action Recognition

abstract: Deep learning models have a risk of utilizing spurious clues to make predictions, such as recognizing actions based on the background scene. This issue can severely degrade the open-set action recognition performance when the testing samples have different scene distributions from the training samples. To mitigate this problem, we propose a novel method, called Scene-debiasing Open-set Action Recognition (SOAR), which features an adversarial scene reconstruction module and an adaptive adversarial scene classification module. The former prevents the decoder from reconstructing the video background given video features, and thus helps reduce the background information in feature learning. The latter aims to confuse scene type classification given video features, with a specific emphasis on the action foreground, and helps to learn scene-invariant information. In addition, we design an experiment to quantify the scene bias. The results indicate that the current open-set action recognizers are biased toward the scene, and our proposed SOAR method better mitigates such bias. Furthermore, our extensive experiments demonstrate that our method outperforms state-of-the-art methods, and the ablation studies confirm the effectiveness of our proposed modules.


title: Calder\'on-Zygmund theory with noncommuting kernels via $H_1^c$

abstract: We study an alternative definition of the $H_1$-space associated to a semicommutative von Neumann algebra $L_\infty(\mathbb{R}) \overline{\otimes} \mathcal{M}$, first studied by Mei. We identify a "new" description for atoms in $H_1$. We then explain how they can be used to study $H_1^c$-$L_1$ endpoint estimates for Calder\'on-Zygmund operators with noncommuting kernels.


title: Deception Game: Closing the Safety-Learning Loop in Interactive Robot Autonomy

abstract: An outstanding challenge for the widespread deployment of robotic systems like autonomous vehicles is ensuring safe interaction with humans without sacrificing performance. Existing safety methods often neglect the robot's ability to learn and adapt at runtime, leading to overly conservative behavior. This paper proposes a new closed-loop paradigm for synthesizing safe control policies that explicitly account for the robot's evolving uncertainty and its ability to quickly respond to future scenarios as they arise, by jointly considering the physical dynamics and the robot's learning algorithm. We leverage adversarial reinforcement learning for tractable safety analysis under high-dimensional learning dynamics and demonstrate our framework's ability to work with both Bayesian belief propagation and implicit learning through large pre-trained neural trajectory predictors.


title: Timescale of Stellar Feedback-Driven Turbulence in the ISM: A Deep Dive into UGC 4305

abstract: Understanding the interplay of stellar feedback and turbulence in the interstellar medium (ISM) is essential to modeling the evolution of galaxies. To determine the timescales over which stellar feedback drives turbulence in the ISM, we performed a spatially resolved, multi-wavelength study of the nearby star-forming dwarf galaxy UGC 4305 (aka Holmberg II). As indicators of turbulence on local scales (400 pc), we utilized ionized gas velocity dispersion derived from IFU H$\alpha$ observations and atomic gas velocity dispersion and energy surface densities derived from HI synthesis observations with the Very Large Array. These indicators of turbulence were tested against star formation histories over the past 560 Myr derived from Color-Magnitude Diagrams (CMD) using Spearman's rank correlation coefficient. The strongest correlation identified at the 400 pc scale is between measures of HI turbulence and star formation 70-140 Myr ago. We repeated our analysis of UGC 4305's current turbulence and past star formation activity on multiple physical scales ($\sim$560, and 800 pc) to determine if there are indications of changes in the correlation timescale with changes to the physical scale. No notable correlations were found at larger physical scales emphasizing the importance of analyzing star formation driven turbulence as a local phenomenon.


title: Outlining the design space of eXplainable swarm (xSwarm): experts perspective

abstract: In swarm robotics, agents interact through local roles to solve complex tasks beyond an individual's ability. Even though swarms are capable of carrying out some operations without the need for human intervention, many safety-critical applications still call for human operators to control and monitor the swarm. There are novel challenges to effective Human-Swarm Interaction (HSI) that are only beginning to be addressed. Explainability is one factor that can facilitate effective and trustworthy HSI and improve the overall performance of Human-Swarm team. Explainability was studied across various Human-AI domains, such as Human-Robot Interaction and Human-Centered ML. However, it is still ambiguous whether explanations studied in Human-AI literature would be beneficial in Human-Swarm research and development. Furthermore, the literature lacks foundational research on the prerequisites for explainability requirements in swarm robotics, i.e., what kind of questions an explainable swarm is expected to answer, and what types of explanations a swarm is expected to generate. By surveying 26 swarm experts, we seek to answer these questions and identify challenges experts faced to generate explanations in Human-Swarm environments. Our work contributes insights into defining a new area of research of eXplainable Swarm (xSwarm) which looks at how explainability can be implemented and developed in swarm systems. This paper opens the discussion on xSwarm and paves the way for more research in the field.


title: COMEDIAN: Self-Supervised Learning and Knowledge Distillation for Action Spotting using Transformers

abstract: We present COMEDIAN, a novel pipeline to initialize spatiotemporal transformers for action spotting, which involves self-supervised learning and knowledge distillation. Action spotting is a timestamp-level temporal action detection task. Our pipeline consists of three steps, with two initialization stages. First, we perform self-supervised initialization of a spatial transformer using short videos as input. Additionally, we initialize a temporal transformer that enhances the spatial transformer's outputs with global context through knowledge distillation from a pre-computed feature bank aligned with each short video segment. In the final step, we fine-tune the transformers to the action spotting task. The experiments, conducted on the SoccerNet-v2 dataset, demonstrate state-of-the-art performance and validate the effectiveness of COMEDIAN's pretraining paradigm. Our results highlight several advantages of our pretraining pipeline, including improved performance and faster convergence compared to non-pretrained models.


title: Bayesian inference of composition-dependent phase diagrams

abstract: Phase diagrams serve as a highly informative tool for materials design, encapsulating information about the phases that a material can manifest under specific conditions. In this work, we develop a method in which Bayesian inference is employed to combine thermodynamic data from molecular dynamics (MD), melting point simulations, and phonon calculations, process these data, and yield a temperature-concentration phase diagram. The employed Bayesian framework yields us not only the free energies of different phases as functions of temperature and concentration but also the uncertainties of these free energies originating from statistical errors inherent to finite-length MD trajectories. Furthermore, it extrapolates the results of the finite-atom calculations to the infinite-atom limit and facilitates the choice of temperature, chemical potentials, and the number of atoms conducting the next simulation with which will be the most efficient in reducing the uncertainty of the phase diagram. The developed algorithm was successfully tested on two binary systems, Ge-Si and K-Na, in the full range of concentrations and temperatures.


title: Electromagnetic Waves Generated by Null Cosmic Strings Passing Pulsars

abstract: Null cosmic strings disturb electromagnetic (EM) fields of charged sources and sources with magnetic moments. As has been recently shown by the authors, these perturbations result in a self-force acting on the sources and create EM waves outgoing from the sources. We develop an analytic approximation for asymptotic of the EM waves at the future null infinity and calculate radiation fluxes for sources of the both types. For magnetic-dipole-like sources the radiation flux depends on orientation of the magnetic moment with respect to the string. Estimates show that the peak power of the radiation can be quite large for null strings moving near pulsars and considerably large in case of magnetars. The string generated variations of the luminosities of the stars can be used as a potential experimental signature of null cosmic strings.


title: WindMill: A Parameterized and Pluggable CGRA Implemented by DIAG Design Flow

abstract: With the cross-fertilization of applications and the ever-increasing scale of models, the efficiency and productivity of hardware computing architectures have become inadequate. This inadequacy further exacerbates issues in design flexibility, design complexity, development cycle, and development costs (4-d problems) in divergent scenarios. To address these challenges, this paper proposed a flexible design flow called DIAG based on plugin techniques. The proposed flow guides hardware development through four layers: definition(D), implementation(I), application(A), and generation(G). Furthermore, a versatile CGRA generator called WindMill is implemented, allowing for agile generation of customized hardware accelerators based on specific application demands. Applications and algorithm tasks from three aspects is experimented. In the case of reinforcement learning algorithm, a significant performance improvement of $2.3\times$ compared to GPU is achieved.


title: Diffusion Models with Deterministic Normalizing Flow Priors

abstract: For faster sampling and higher sample quality, we propose DiNof ($\textbf{Di}$ffusion with $\textbf{No}$rmalizing $\textbf{f}$low priors), a technique that makes use of normalizing flows and diffusion models. We use normalizing flows to parameterize the noisy data at any arbitrary step of the diffusion process and utilize it as the prior in the reverse diffusion process. More specifically, the forward noising process turns a data distribution into partially noisy data, which are subsequently transformed into a Gaussian distribution by a nonlinear process. The backward denoising procedure begins with a prior created by sampling from the Gaussian distribution and applying the invertible normalizing flow transformations deterministically. To generate the data distribution, the prior then undergoes the remaining diffusion stochastic denoising procedure. Through the reduction of the number of total diffusion steps, we are able to speed up both the forward and backward processes. More importantly, we improve the expressive power of diffusion models by employing both deterministic and stochastic mappings. Experiments on standard image generation datasets demonstrate the advantage of the proposed method over existing approaches. On the unconditional CIFAR10 dataset, for example, we achieve an FID of 2.01 and an Inception score of 9.96. Our method also demonstrates competitive performance on CelebA-HQ-256 dataset as it obtains an FID score of 7.11. Code is available at https://github.com/MohsenZand/DiNof.


title: A Comparative Evaluation of FedAvg and Per-FedAvg Algorithms for Dirichlet Distributed Heterogeneous Data

abstract: In this paper, we investigate Federated Learning (FL), a paradigm of machine learning that allows for decentralized model training on devices without sharing raw data, there by preserving data privacy. In particular, we compare two strategies within this paradigm: Federated Averaging (FedAvg) and Personalized Federated Averaging (Per-FedAvg), focusing on their performance with Non-Identically and Independently Distributed (Non-IID) data. Our analysis shows that the level of data heterogeneity, modeled using a Dirichlet distribution, significantly affects the performance of both strategies, with Per-FedAvg showing superior robustness in conditions of high heterogeneity. Our results provide insights into the development of more effective and efficient machine learning strategies in a decentralized setting.


title: Verifying the Unknown: Correct-by-Design Control Synthesis for Networks of Stochastic Uncertain Systems

abstract: In this paper, we present an approach for designing correct-by-design controllers for cyber-physical systems composed of multiple dynamically interconnected uncertain systems. We consider networked discrete-time uncertain nonlinear systems with additive stochastic noise and model parametric uncertainty. Such settings arise when multiple systems interact in an uncertain environment and only observational data is available. We address two limitations of existing approaches for formal synthesis of controllers for networks of uncertain systems satisfying complex temporal specifications. Firstly, whilst existing approaches rely on the stochasticity to be Gaussian, the heterogeneous nature of composed systems typically yields a more complex stochastic behavior. Secondly, exact models of the systems involved are generally not available or difficult to acquire. To address these challenges, we show how abstraction-based control synthesis for uncertain systems based on sub-probability couplings can be extended to networked systems. We design controllers based on parameter uncertainty sets identified from observational data and approximate possibly arbitrary noise distributions using Gaussian mixture models whilst quantifying the incurred stochastic coupling. Finally, we demonstrate the effectiveness of our approach on a nonlinear package delivery case study with a complex specification, and a platoon of cars.


title: Star formation efficiency across large-scale galactic environments

abstract: Environmental effects on the evolution of galaxies have been one of the leading questions in galaxy studies for decades. In this work, we investigate the relationship between the star formation activity of galaxies and their environmental matter density using the cosmological hydrodynamic simulation Simba. The star formation activity indicators we explore include the star formation efficiency (SFE), specific star formation rate (sSFR) and molecular hydrogen mass fraction ($f^*_{H_2}$) and the environment is considered as the large-scale environmental matter density, calculated based on the stellar mass of nearby galaxies on a 1 Mpc/h grid using the cloud in cell (CIC) method. Our sample includes galaxies with $9<\log(M_*/M_{\odot})$ at $0<z<4$, divided into three mass bins to disentangle the effects of mass and environment on the galactic star formation activity. For low- to intermediate-mass galaxies at low-redshifts ($z<1.5$), we find that the star formation efficiency of those in high-density regions are $\sim 0.3$ dex lower than those in low-density regions. However, there is no significant environmental dependence of the star formation efficiency for massive galaxies over all our redshift range, and low- to intermediate-mass galaxies at high redshifts ($z > 1.5$). We present a scaling relation for the depletion time of molecular hydrogen (${t_{depl}}=1/SFE$) as a function of galaxy parameters including environmental density. Our findings provide a framework for quantifying the environmental effects on the star formation activities of galaxies as a function of stellar mass and redshift. The most significant environmental dependence is seen at later cosmic times ($z<1.5$) and towards lower stellar masses ($9<\log(M_*/M_{\odot})<10$). Future large galaxy surveys can use this framework to look for the environmental dependence of the star formation activity and examine our predictions.


title: Under-frequency Load Shedding for Power Reserve Management in Islanded Microgrids

abstract: This paper introduces under-frequency load shedding (UFLS) schemes specially designed to fulfill the power reserve requirements in islanded microgrids (MGs), where only one grid-forming resource is available for frequency regulation. When the power consumption of the MG exceeds a pre-defined threshold, the MG frequency will be lowered to various setpoints, thereby triggering UFLS for different levels of load reduction. Three types of controllable devices are considered for executing UFLS: sectionalizers, smart meters, and controllable appliances. To avoid unnecessary UFLS activation, various time delay settings are analyzed, allowing short-lived power spikes caused by events like motor startups or cold-load pickups to be disregarded. We tested the proposed UFLS schemes on a modified IEEE 123-bus system on the OPAL-RT eMEGASIM platform. Simulation results verify the efficacy of the proposed approaches in restoring power reserves, maintaining phase power balance, and effectively handling short-lived power fluctuations. Furthermore, in comparison to sectionalizer-based UFLS, using smart meters or controllable loads for UFLS allows for a more accurate per-phase load shedding in a progressive manner. As a result, it leads to better balanced three-phase voltage and serves more loads.


title: FOR-instance: a UAV laser scanning benchmark dataset for semantic and instance segmentation of individual trees

abstract: The FOR-instance dataset (available at https://doi.org/10.5281/zenodo.8287792) addresses the challenge of accurate individual tree segmentation from laser scanning data, crucial for understanding forest ecosystems and sustainable management. Despite the growing need for detailed tree data, automating segmentation and tracking scientific progress remains difficult. Existing methodologies often overfit small datasets and lack comparability, limiting their applicability. Amid the progress triggered by the emergence of deep learning methodologies, standardized benchmarking assumes paramount importance in these research domains. This data paper introduces a benchmarking dataset for dense airborne laser scanning data, aimed at advancing instance and semantic segmentation techniques and promoting progress in 3D forest scene segmentation. The FOR-instance dataset comprises five curated and ML-ready UAV-based laser scanning data collections from diverse global locations, representing various forest types. The laser scanning data were manually annotated into individual trees (instances) and different semantic classes (e.g. stem, woody branches, live branches, terrain, low vegetation). The dataset is divided into development and test subsets, enabling method advancement and evaluation, with specific guidelines for utilization. It supports instance and semantic segmentation, offering adaptability to deep learning frameworks and diverse segmentation strategies, while the inclusion of diameter at breast height data expands its utility to the measurement of a classic tree variable. In conclusion, the FOR-instance dataset contributes to filling a gap in the 3D forest research, enhancing the development and benchmarking of segmentation algorithms for dense airborne laser scanning data.


title: KMT-2021-BLG-1547Lb: Giant microlensing planet detected through a signal deformed by source binarity

abstract: We investigate the previous microlensing data collected by the KMTNet survey in search of anomalous events for which no precise interpretations of the anomalies have been suggested. From this investigation, we find that the anomaly in the lensing light curve of the event KMT-2021-BLG-1547 is approximately described by a binary-lens (2L1S) model with a lens possessing a giant planet, but the model leaves unexplained residuals. We investigate the origin of the residuals by testing more sophisticated models that include either an extra lens component (3L1S model) or an extra source star (2L2S model) to the 2L1S configuration of the lens system. From these analyses, we find that the residuals from the 2L1S model originate from the existence of a faint companion to the source. The 2L2S solution substantially reduces the residuals and improves the model fit by $\Delta\chi^2=67.1$ with respect to the 2L1S solution. The 3L1S solution also improves the fit, but its fit is worse than that of the 2L2S solution by $\Delta\chi^2=24.7$. According to the 2L2S solution, the lens of the event is a planetary system with planet and host masses $(M_{\rm p}/M_{\rm J}, M_{\rm h}/M_\odot)=\left( 1.47^{+0.64}_{-0.77}, 0.72^{+0.32}_{-0.38}\right)$ lying at a distance $\D_{\rm L} =5.07^{+0.98}_{-1.50}$~kpc, and the source is a binary composed of a subgiant primary of a late G or an early K spectral type and a main-sequence companion of a K spectral type. The event demonstrates the need of sophisticated modeling for unexplained anomalies for the construction of a complete microlensing planet sample.


title: Game Theory in Distributed Systems Security: Foundations, Challenges, and Future Directions

abstract: Many of our critical infrastructure systems and personal computing systems have a distributed computing systems structure. The incentives to attack them have been growing rapidly as has their attack surface due to increasing levels of connectedness. Therefore, we feel it is time to bring in rigorous reasoning to secure such systems. The distributed system security and the game theory technical communities can come together to effectively address this challenge. In this article, we lay out the foundations from each that we can build upon to achieve our goals. Next, we describe a set of research challenges for the community, organized into three categories -- analytical, systems, and integration challenges, each with "short term" time horizon (2-3 years) and "long term" (5-10 years) items. This article was conceived of through a community discussion at the 2022 NSF SaTC PI meeting.


title: Generalization of the Thistlethwaite--Tsvietkova Method

abstract: In work by Thistlethwaite and Tsvietkova, an alternative method for solving for the hyperbolic structure of the complement of a link in the 3-sphere is developed. We generalize this method to other classes of links, in particular links in the thickened torus and fully augmented links.


title: Square packings and rectifiable doubling measures

abstract: We prove that for all integers $2\leq m\leq d-1$, there exists doubling measures on $\mathbb{R}^d$ with full support that are $m$-rectifiable and purely $(m-1)$-unrectifiable in the sense of Federer (i.e. without assuming $\mu\ll\mathcal{H}^m$). The corresponding result for 1-rectifiable measures is originally due to Garnett, Killip, and Schul (2010). Our construction of higher-dimensional Lipschitz images is informed by a simple observation about square packing in the plane: $N$ axis-parallel squares of side length $s$ pack inside of a square of side length $\lceil N^{1/2}\rceil s$. The approach is robust and when combined with standard metric geometry techniques allows for constructions in complete Ahlfors regular metric spaces. One consequence of the main theorem is that for each $m\in\{2,3,4\}$ and $s<m$, there exist doubling measures $\mu$ on the Heisenberg group $\mathbb{H}^1$ and Lipschitz maps $f:E\subset\mathbb{R}^m\rightarrow\mathbb{H}^1$ such that $\mu\ll\mathcal{H}^{s-\epsilon}$ for all $\epsilon>0$, $f(E)$ has Hausdorff dimension $s$, and $\mu(f(E))>0$. This is striking, because $\mathcal{H}^m(f(E))=0$ for every Lipschitz map $f:E\subset\mathbb{R}^m\rightarrow\mathbb{H}^1$ by a theorem of Ambrosio and Kirchheim (2000). Another application of the square packing construction is that every compact metric space $\mathbb{X}$ of Assouad dimension strictly less than $m$ is a Lipschitz image of a compact set $E\subset[0,1]^m$. Of independent interest, we record the existence of doubling measures on complete Ahlfors regular metric spaces with prescribed lower and upper Hausdorff and packing dimensions.


title: Flexible involutive meadows

abstract: We investigate a notion of inverse for neutrices inspired by Van den Berg and Koudjeti's decomposition of a neutrix as the product of a real number and an idempotent neutrix. We end up with an algebraic structure that can be characterized axiomatically and generalizes involutive meadows. The latter are algebraic structures where the inverse for multiplication is a total operation. As it turns out, the structures satisfying the axioms of flexible involutive meadows are of interest beyond nonstandard analysis.


title: The role of pressure-induced stacking faults on the magnetic properties of gadolinium

abstract: Experimental data show that under pressure, Gd goes through a series of structural transitions hcp to Sm-type (close-packed rhombohedral) to dhcp that is accompanied by a gradual decrease of the Curie temperature and magnetization till the collapse of a finite magnetization close to the dhcp structure. We explore theoretically the pressure-induced changes of the magnetic properties, by describing these structural transitions as the formation of fcc stackings faults. Using this approach, we are able to describe correctly the variation of the Curie temperature with pressure, in contrast to a static structural model using the hcp structure.


title: MAP: Domain Generalization via Meta-Learning on Anatomy-Consistent Pseudo-Modalities

abstract: Deep models suffer from limited generalization capability to unseen domains, which has severely hindered their clinical applicability. Specifically for the retinal vessel segmentation task, although the model is supposed to learn the anatomy of the target, it can be distracted by confounding factors like intensity and contrast. We propose Meta learning on Anatomy-consistent Pseudo-modalities (MAP), a method that improves model generalizability by learning structural features. We first leverage a feature extraction network to generate three distinct pseudo-modalities that share the vessel structure of the original image. Next, we use the episodic learning paradigm by selecting one of the pseudo-modalities as the meta-train dataset, and perform meta-testing on a continuous augmented image space generated through Dirichlet mixup of the remaining pseudo-modalities. Further, we introduce two loss functions that facilitate the model's focus on shape information by clustering the latent vectors obtained from images featuring identical vasculature. We evaluate our model on seven public datasets of various retinal imaging modalities and we conclude that MAP has substantially better generalizability. Our code is publically available at https://github.com/DeweiHu/MAP.


title: Integral expressions for derivations of multiarrangements

abstract: The construction of an explicit basis for a free multiarrangement is not easy in general. Inspired by the integral expressions for quasi-invariants of quantum Calogero-Moser systems, we present integral expressions for specific bases of certain multiarrangements. Our construction covers the cases of three lines in dimension $2$ (previously examined by Wakamiko) and free multiarrangements associated with complex reflection groups (Hoge, Mano, R\"ohrle, Stump). Furthermore, we propose a conjectural basis for the module of logarithmic vector fields of the extended Catalan arrangement of type $B_2$.


title: How Crowd Worker Factors Influence Subjective Annotations: A Study of Tagging Misogynistic Hate Speech in Tweets

abstract: Crowdsourced annotation is vital to both collecting labelled data to train and test automated content moderation systems and to support human-in-the-loop review of system decisions. However, annotation tasks such as judging hate speech are subjective and thus highly sensitive to biases stemming from annotator beliefs, characteristics and demographics. We conduct two crowdsourcing studies on Mechanical Turk to examine annotator bias in labelling sexist and misogynistic hate speech. Results from 109 annotators show that annotator political inclination, moral integrity, personality traits, and sexist attitudes significantly impact annotation accuracy and the tendency to tag content as hate speech. In addition, semi-structured interviews with nine crowd workers provide further insights regarding the influence of subjectivity on annotations. In exploring how workers interpret a task - shaped by complex negotiations between platform structures, task instructions, subjective motivations, and external contextual factors - we see annotations not only impacted by worker factors but also simultaneously shaped by the structures under which they labour.


title: Federated Orthogonal Training: Mitigating Global Catastrophic Forgetting in Continual Federated Learning

abstract: Federated Learning (FL) has gained significant attraction due to its ability to enable privacy-preserving training over decentralized data. Current literature in FL mostly focuses on single-task learning. However, over time, new tasks may appear in the clients and the global model should learn these tasks without forgetting previous tasks. This real-world scenario is known as Continual Federated Learning (CFL). The main challenge of CFL is Global Catastrophic Forgetting, which corresponds to the fact that when the global model is trained on new tasks, its performance on old tasks decreases. There have been a few recent works on CFL to propose methods that aim to address the global catastrophic forgetting problem. However, these works either have unrealistic assumptions on the availability of past data samples or violate the privacy principles of FL. We propose a novel method, Federated Orthogonal Training (FOT), to overcome these drawbacks and address the global catastrophic forgetting in CFL. Our algorithm extracts the global input subspace of each layer for old tasks and modifies the aggregated updates of new tasks such that they are orthogonal to the global principal subspace of old tasks for each layer. This decreases the interference between tasks, which is the main cause for forgetting. We empirically show that FOT outperforms state-of-the-art continual learning methods in the CFL setting, achieving an average accuracy gain of up to 15% with 27% lower forgetting while only incurring a minimal computation and communication cost.


title: Lattice Point Variance in Thin Elliptic Annuli over $\mathbb{F}_q [T]$

abstract: For fixed coprime polynomials $U,V \in \mathbb{F}_q [T]$ with degrees of different parities, and a general polynomial $A \in \mathbb{F}_q [T]$, define the arithmetic function $S_{U,V} (A)$ to be the number of representations of $A$ of the form $UE^2 + VF^2$ with $E,F \in \mathbb{F}_q [T]$. We study the mean and variance of $S_{U,V}$ over short intervals in $\mathbb{F}_q [T]$, and this can be interpreted as the function field analogue of the mean and variance of lattice points in thin elliptic annuli, where the scaling factor of the ellipses is rational. Our main result is an asymptotic formula for the variance even when the length of the interval remains constant relative to the absolute value of the centre of the interval. In terms of lattice points, this means we obtain the variance in the so-called ``local'' or ``microscopic'' regime, where the area of the annulus remains constant relative to the inner radius. We also obtain asymptotic or exact formulas for almost all other lengths of the interval, and we see some interesting behaviour at the boundary between short and long intervals. Our approach is that of additive characters and Hankel matrices that we employed for the divisor function and a restricted sum-of-squares function in previous work, and we develop further results on Hankel matrices in this paper.


title: Generative Social Choice

abstract: Traditionally, social choice theory has only been applicable to choices among a few predetermined alternatives but not to more complex decisions such as collectively selecting a textual statement. We introduce generative social choice, a framework that combines the mathematical rigor of social choice theory with the capability of large language models to generate text and extrapolate preferences. This framework divides the design of AI-augmented democratic processes into two components: first, proving that the process satisfies rigorous representation guarantees when given access to oracle queries; second, empirically validating that these queries can be approximately implemented using a large language model. We apply this framework to the problem of generating a slate of statements that is representative of opinions expressed as free-form text; specifically, we develop a democratic process with representation guarantees and use this process to represent the opinions of participants in a survey about chatbot personalization. We find that 93 out of 100 participants feel "mostly" or "perfectly" represented by the slate of five statements we extracted.