title: The Hamilton-Jacobi-Bellman Equation in Economic Dynamics with a Non-Smooth Fiscal Policy

abstract: We consider a class of economic growth models that includes the classical Ramsey--Cass--Koopmans capital accumulation model and verify that, under several assumptions, the value function of the model is the unique viscosity solution to the Hamilton--Jacobi--Bellman equation. Moreover, we discuss a solution method for these models using differential inclusion, where the subdifferential of the value function plays an important role. Next, we present an assumption under which the value function is a classical solution to the Hamilton--Jacobi--Bellman equation, and show that many economic models satisfy this assumption. In particular, our result still holds in an economic growth model in which the government takes a non-smooth Keynesian policy rule.


title: Gaussian Approximation and Multiplier Bootstrap for Polyak-Ruppert Averaged Linear Stochastic Approximation with Applications to TD Learning

abstract: In this paper, we obtain the Berry-Esseen bound for multivariate normal approximation for the Polyak-Ruppert averaged iterates of the linear stochastic approximation (LSA) algorithm with decreasing step size. Our findings reveal that the fastest rate of normal approximation is achieved when setting the most aggressive step size $\alpha_{k} \asymp k^{-1/2}$. Moreover, we prove the non-asymptotic validity of the confidence intervals for parameter estimation with LSA based on multiplier bootstrap. This procedure updates the LSA estimate together with a set of randomly perturbed LSA estimates upon the arrival of subsequent observations. We illustrate our findings in the setting of temporal difference learning with linear function approximation.

categories: stat.ML cs.LG math.OC math.PR math.ST stat.TH


title: Diffusion4D: Fast Spatial-temporal Consistent 4D Generation via Video Diffusion Models

abstract: The availability of large-scale multimodal datasets and advancements in diffusion models have significantly accelerated progress in 4D content generation. Most prior approaches rely on multiple image or video diffusion models, utilizing score distillation sampling for optimization or generating pseudo novel views for direct supervision. However, these methods are hindered by slow optimization speeds and multi-view inconsistency issues. Spatial and temporal consistency in 4D geometry has been extensively explored respectively in 3D-aware diffusion models and traditional monocular video diffusion models. Building on this foundation, we propose a strategy to migrate the temporal consistency in video diffusion models to the spatial-temporal consistency required for 4D generation. Specifically, we present a novel framework, \textbf{Diffusion4D}, for efficient and scalable 4D content generation. Leveraging a meticulously curated dynamic 3D dataset, we develop a 4D-aware video diffusion model capable of synthesizing orbital views of dynamic 3D assets. To control the dynamic strength of these assets, we introduce a 3D-to-4D motion magnitude metric as guidance. Additionally, we propose a novel motion magnitude reconstruction loss and 3D-aware classifier-free guidance to refine the learning and generation of motion dynamics. After obtaining orbital views of the 4D asset, we perform explicit 4D construction with Gaussian splatting in a coarse-to-fine manner. The synthesized multi-view consistent 4D image set enables us to swiftly generate high-fidelity and diverse 4D assets within just several minutes. Extensive experiments demonstrate that our method surpasses prior state-of-the-art techniques in terms of generation efficiency and 4D geometry consistency across various prompt modalities.


title: A Provably Effective Method for Pruning Experts in Fine-tuned Sparse Mixture-of-Experts

abstract: The sparsely gated mixture of experts (MoE) architecture sends different inputs to different subnetworks, i.e., experts, through trainable routers. MoE reduces the training computation significantly for large models, but its deployment can be still memory or computation expensive for some downstream tasks. Model pruning is a popular approach to reduce inference computation, but its application in MoE architecture is largely unexplored. To the best of our knowledge, this paper provides the first provably efficient technique for pruning experts in finetuned MoE models. We theoretically prove that prioritizing the pruning of the experts with a smaller change of the routers l2 norm from the pretrained model guarantees the preservation of test accuracy, while significantly reducing the model size and the computational requirements. Although our theoretical analysis is centered on binary classification tasks on simplified MoE architecture, our expert pruning method is verified on large vision MoE models such as VMoE and E3MoE finetuned on benchmark datasets such as CIFAR10, CIFAR100, and ImageNet.


title: Sharp extension inequalities on finite fields

abstract: Sharp restriction theory and the finite field extension problem have both received a great deal of attention in the last two decades, but so far they have not intersected. In this paper, we initiate the study of sharp restriction theory on finite fields. We prove that constant functions maximize the Fourier extension inequality from the parabola $\mathbb{P}^1\subset \mathbb{F}^{2\ast}_q$ and the paraboloid $\mathbb{P}^2\subset \mathbb{F}_q^{3\ast}$ at the euclidean Stein-Tomas endpoint; here, $\mathbb{F}_q^{d\ast}$ denotes the (dual) $d$-dimensional vector space over the finite field $\mathbb F_q$ with $q=p^n$ elements, where $p$ is a prime number greater than $3$ or $2$, respectively. We fully characterize the maximizers for the $L^2\to L^4$ extension inequality from $\mathbb{P}^2$ whenever $q\equiv 1(\text{mod}\, 4)$. Our methods lead to analogous results on the hyperbolic paraboloid, whose corresponding euclidean problem remains open. We further establish that constants maximize the $L^2\to L^4$ extension inequality from the cone $\Gamma^3:=\{(\boldsymbol{\xi},\tau, \sigma)\in \mathbb{F}^{4\ast}_q: \tau\sigma=\boldsymbol{\xi}^2\}\setminus \{{\bf 0}\}$ whenever $q\equiv 3(\text{mod}\, 4)$. By contrast, we prove that constant functions fail to be critical points for the corresponding inequality on $\Gamma^3\cup \{{\bf 0}\}$ over $\mathbb{F}_p^4$. While some inspiration is drawn from the euclidean setting, entirely new phenomena emerge which are related to the underlying arithmetic and discrete structures.


title: Canonical singularities on moduli spaces of rational curves via the circle method

abstract: By developing a suitable version of the circle method, we show that the space of degree $e$ rational curves on a smooth hypersurface of degree $d$ has only canonical singularities provided its dimension is sufficiently large with respect to $e$ and $d$.


title: Deep Koopman Learning using the Noisy Data

abstract: This paper proposes a data-driven framework to learn a finite-dimensional approximation of a Koopman operator for approximating the state evolution of a dynamical system under noisy observations. To this end, our proposed solution has two main advantages. First, the proposed method only requires the measurement noise to be bounded. Second, the proposed method modifies the existing deep Koopman operator formulations by characterizing the effect of the measurement noise on the Koopman operator learning and then mitigating it by updating the tunable parameter of the observable functions of the Koopman operator, making it easy to implement. The performance of the proposed method is demonstrated on several standard benchmarks. We further compare the presented method with similar methods proposed in the latest literature on Koopman learning.


title: Bounding Dark Energy from the SPARC rotation curves: Data driven probe for galaxy virialization

abstract: Dark Energy (DE) acts as a repulsive force that opposes gravitational attraction. Assuming galaxies maintain a steady state over extended periods, the estimated upper bound on DE studies its resistance to the attractive gravitational force from dark matter. Using the SPARC dataset, we fit the Navarro-Frenk-White (NFW) and Hernquist models to identify the most suitable galaxies for these models. Introducing the presence of DE in these galaxies helps establish the upper limit on its repulsive force. This upper bound on DE sits around $\rho_{\left(<\Lambda\right)} \sim 10^{-25}$~kg/m$^3$, only two orders of magnitude higher than the one measured by Planck. We discuss the conditions for detecting DE in different systems and show the consistency of the upper bound from galaxies to other systems. The upper bound is of the same order of magnitude as $\rho_{200} = 200 \rho_c$ for both dark matter profiles. We also address the implications for future measurements on that upper bound and the condition for detecting the impact of $\Lambda$ on galactic scales.

categories: astro-ph.CO astro-ph.GA gr-qc hep-ph hep-th


title: Variational Quantum Framework for Partial Differential Equation Constrained Optimization

abstract: We present a novel variational quantum framework for linear partial differential equation (PDE) constrained optimization problems. Such problems arise in many scientific and engineering domains. For instance, in aerodynamics, the PDE constraints are the conservation laws such as momentum, mass and energy balance, the design variables are vehicle shape parameters and material properties, and the objective could be to minimize the effect of transient heat loads on the vehicle or to maximize the lift-to-drag ratio. The proposed framework utilizes the variational quantum linear system (VQLS) algorithm and a black box optimizer as its two main building blocks. VQLS is used to solve the linear system, arising from the discretization of the PDE constraints for given design parameters, and evaluate the design cost/objective function. The black box optimizer is used to select next set of parameter values based on this evaluated cost, leading to nested bi-level optimization structure within a hybrid classical-quantum setting. We present detailed computational error and complexity analysis to highlight the potential advantages of our proposed framework over classical techniques. We implement our framework using the PennyLane library, apply it to a heat transfer optimization problem, and present simulation results using Bayesian optimization as the black box optimizer.


title: A two-speed actuator for robotics with fast seamless gear shifting

abstract: This paper present a novel dual-speed actuator adapted to robotics. In many applications, robots have to bear large loads while moving slowly and also have to move quickly through the air with almost no load. This lead to conflicting requirements for their actuators. Multiple gear ratios address this issue by allowing an effective use of power over a wide range of torque-speed load conditions. Furthermore, very different gear ratios also lead to drastic changes of the intrinsic impedance, enabling a non-back-drivable mode for stiff position control and a back-drivable mode for force control. The proposed actuator consists of two electric motors coupled to a differential; one has a large gear ratio while the other is almost direct-drive and equipped with a brake. During the high-force mode the brake is locked, only one motor is used, and the actuator behaves like a regular highly-geared servo-motor. During the high-speed mode the brake is open, both motor are used at the same time, and the actuator behaves like a direct drive motor. A dynamic model is developed and novel controllers are proposed for synergic use of both motors. The redundancy of motors is exploited for maintaining full control of the output during mode transitions, allowing for fast and seamless switching even when interacting with unknown environments. Results are demonstrated with a proof-of-concept linear actuator.


title: Generalized Ramsey numbers via conflict-free hypergraph matchings

abstract: Given graphs $G, H$ and an integer $q \ge 2$, the generalized Ramsey number, denoted $r(G,H,q)$, is the minimum number of colours needed to edge-colour $G$ such that every copy of $H$ receives at least $q$ colours. In this paper, we prove that for a fixed integer $k \ge 3$, we have $r(K_n,C_k,3) = n/(k-2)+o(n)$. This generalises work of Joos and Muybayi, who proved $r(K_n,C_4,3) = n/2+o(n)$. We also provide an upper bound on $r(K_{n,n}, C_k, 3)$, which generalises a result of Joos and Mubayi that $r(K_{n,n},C_4,3) = 2n/3+o(n)$. Both of our results are in fact specific cases of more general theorems concerning families of cycles.


title: Ethics Pathways: A Design Activity for Reflecting on Ethics Engagement in HCI Research

abstract: This paper introduces Ethics Pathways, a design activity aimed at understanding HCI and design researchers' ethics engagements and flows during their research process. Despite a strong ethical commitment in these fields, challenges persist in grasping the complexity of researchers' engagement with ethics -- practices conducted to operationalize ethics -- in situated institutional contexts. Ethics Pathways, developed through six playtesting sessions, offers a design approach to understanding the complexities of researchers' past ethics engagements in their work. This activity involves four main tasks: recalling ethical incidents; describing stakeholders involved in the situation; recounting their actions or speculative alternatives; and reflection and emotion walk-through. The paper reflects on the role of design decisions and facilitation strategies in achieving these goals. The design activity contributes to the discourse on ethical HCI research by conceptualizing ethics engagement as a part of ongoing research processing, highlighting connections between individual affective experiences, social interactions across power differences, and institutional goals.


title: Predicting Likely-Vulnerable Code Changes: Machine Learning-based Vulnerability Protections for Android Open Source Project

abstract: This paper presents a framework that selectively triggers security reviews for incoming source code changes. Functioning as a review bot within a code review service, the framework can automatically request additional security reviews at pre-submit time before the code changes are submitted to a source code repository. Because performing such secure code reviews add cost, the framework employs a classifier trained to identify code changes with a high likelihood of vulnerabilities. The online classifier leverages various types of input features to analyze the review patterns, track the software engineering process, and mine specific text patterns within given code changes. The classifier and its features are meticulously chosen and optimized using data from the submitted code changes and reported vulnerabilities in Android Open Source Project (AOSP). The evaluation results demonstrate that our Vulnerability Prevention (VP) framework identifies approximately 80% of the vulnerability-inducing code changes in the dataset with a precision ratio of around 98% and a false positive rate of around 1.7%. We discuss the implications of deploying the VP framework in multi-project settings and future directions for Android security research. This paper explores and validates our approach to code change-granularity vulnerability prediction, offering a preventive technique for software security by preemptively detecting vulnerable code changes before submission.


title: "I Searched for a Religious Song in Amharic and Got Sexual Content Instead": Investigating Online Harm in Low-Resourced Languages on YouTube

abstract: Online social media platforms such as YouTube have a wide, global reach. However, little is known about the experience of low-resourced language speakers on such platforms; especially in how they experience and navigate harmful content. To better understand this, we (1) conducted semi-structured interviews (n=15) and (2) analyzed search results (n=9313), recommendations (n=3336), channels (n=120) and comments (n=406) of policy-violating sexual content on YouTube focusing on the Amharic language. Our findings reveal that -- although Amharic-speaking YouTube users find the platform crucial for several aspects of their lives -- participants reported unplanned exposure to policy-violating sexual content when searching for benign, popular queries. Furthermore, malicious content creators seem to exploit under-performing language technologies and content moderation to further target vulnerable groups of speakers, including migrant domestic workers, diaspora, and local Ethiopians. Overall, our study sheds light on how failures in low-resourced language technology may lead to exposure to harmful content and suggests implications for stakeholders in minimizing harm. Content Warning: This paper includes discussions of NSFW topics and harmful content (hate, abuse, sexual harassment, self-harm, misinformation). The authors do not support the creation or distribution of harmful content.


title: ELG Spectroscopic Systematics Analysis of the DESI Data Release 1

abstract: Dark Energy Spectroscopic Instrument (DESI) uses more than 2.4 million Emission Line Galaxies (ELGs) for 3D large-scale structure (LSS) analyses in its Data Release 1 (DR1). Such large statistics enable thorough research on systematic uncertainties. In this study, we focus on spectroscopic systematics of ELGs. The redshift success rate ($f_{\rm goodz}$) is the relative fraction of secure redshifts among all measurements. It depends on observing conditions, thus introduces non-cosmological variations to the LSS. We, therefore, develop the redshift failure weight ($w_{\rm zfail}$) and a per-fibre correction ($\eta_{\rm zfail}$) to mitigate these dependences. They have minor influences on the galaxy clustering. For ELGs with a secure redshift, there are two subtypes of systematics: 1) catastrophics (large) that only occur in a few samples; 2) redshift uncertainty (small) that exists for all samples. The catastrophics represent 0.26\% of the total DR1 ELGs, composed of the confusion between O\,\textsc{ii} and sky residuals, double objects, total catastrophics and others. We simulate the realistic 0.26\% catastrophics of DR1 ELGs, the hypothetical 1\% catastrophics, and the truncation of the contaminated $1.31<z<1.33$ in the \textsc{AbacusSummit} ELG mocks. Their $P_\ell$ show non-negligible bias from the uncontaminated mocks. But their influences on the redshift space distortions (RSD) parameters are smaller than $0.2\sigma$. The redshift uncertainty of \Yone ELGs is 8.5 km/s with a Lorentzian profile. The code for implementing the catastrophics and redshift uncertainty on mocks can be found in https://github.com/Jiaxi-Yu/modelling_spectro_sys.


title: Acceleration of Grokking in Learning Arithmetic Operations via Kolmogorov-Arnold Representation

abstract: We propose novel methodologies aimed at accelerating the grokking phenomenon, which refers to the rapid increment of test accuracy after a long period of overfitting as reported in~\cite{power2022grokking}. Focusing on the grokking phenomenon that arises in learning arithmetic binary operations via the transformer model, we begin with a discussion on data augmentation in the case of commutative binary operations. To further accelerate, we elucidate arithmetic operations through the lens of the Kolmogorov-Arnold (KA) representation theorem, revealing its correspondence to the transformer architecture: embedding, decoder block, and classifier. Observing the shared structure between KA representations associated with binary operations, we suggest various transfer learning mechanisms that expedite grokking. This interpretation is substantiated through a series of rigorous experiments. In addition, our approach is successful in learning two nonstandard arithmetic tasks: composition of operations and a system of equations. Furthermore, we reveal that the model is capable of learning arithmetic operations using a limited number of tokens under embedding transfer, which is supported by a set of experiments as well.


title: RAPF: Efficient path planning for lunar microrovers

abstract: Efficient path planning is key for safe autonomous navigation over complex and unknown terrains. Lunar Zebro (LZ), a project of the Delft University of Technology, aims to deploy a compact rover, no larger than an A4 sheet of paper and weighing not more than 3 kilograms. In this work, we introduce a Robust Artificial Potential Field (RAPF) algorithm, a new path-planning algorithm for reliable local navigation solution for lunar microrovers. RAPF leverages and improves state of the art Artificial Potential Field (APF)-based methods by incorporating the position of the robot in the generation of bacteria points and considering local minima as regions to avoid. We perform both simulations and on field experiments to validate the performance of RAPF, which outperforms state-of-the-art APF-based algorithms by over 15% in reachability within a similar or shorter planning time. The improvements resulted in a 200% higher success rate and 50% lower computing time compared to the conventional APF algorithm. Near-optimal paths are computed in real-time with limited available processing power. The bacterial approach of the RAPF algorithm proves faster to execute and smaller to store than path planning algorithms used in existing planetary rovers, showcasing its potential for reliable lunar exploration with computationally constrained and energy constrained robotic systems.


title: A proof that HT is more likely to outnumber HH than vice versa in a sequence of n coin flips

abstract: Consider the following probability puzzle: A fair coin is flipped n times. For each HT in the resulting sequence, Bob gets a point, and for each HH Alice gets a point. Who is more likely to win? We provide a proof that Bob wins more often for every n>=3. As a byproduct, we derive the asymptotic form of the difference in win probabilities, and obtain an efficient algorithms for their calculation.


title: RLSF: Reinforcement Learning via Symbolic Feedback

abstract: In recent years, large language models (LLMs) have had a dramatic impact on various sub-fields of AI, most notably on natural language understanding tasks. However, there is widespread agreement that the logical reasoning capabilities of contemporary LLMs are, at best, fragmentary (i.e., may work well on some problem instances but fail dramatically on others). While traditional LLM fine-tuning approaches (e.g., those that use human feedback) do address this problem to some degree, they suffer from many issues, including unsound black-box reward models, difficulties in collecting preference data, and sparse scalar reward values. To address these challenges, we propose a new training/fine-tuning paradigm we refer to as Reinforcement Learning via Symbolic Feedback (RLSF), which is aimed at enhancing the reasoning capabilities of LLMs. In the RLSF setting, the LLM that is being trained/fine-tuned is considered as the RL agent, while the environment is allowed access to reasoning or domain knowledge tools (e.g., solvers, algebra systems). Crucially, in RLSF, these reasoning tools can provide feedback to the LLMs via poly-sized certificates (e.g., proofs), that characterize errors in the LLM-generated object with respect to some correctness specification. The ability of RLSF-based training/fine-tuning to leverage certificate-generating symbolic tools enables sound fine-grained (token-level) reward signals to LLMs, and thus addresses the limitations of traditional reward models mentioned above. Via extensive evaluations, we show that our RLSF-based fine-tuning of LLMs outperforms traditional approaches on two different applications, namely, program synthesis from natural language pseudo-code to programming language (C++) and solving the Game of 24.


title: Conjunctive categorial grammars and Lambek grammars with additives

abstract: A new family of categorial grammars is proposed, defined by enriching basic categorial grammars with a conjunction operation. It is proved that the formalism obtained in this way has the same expressive power as conjunctive grammars, that is, context-free grammars enhanced with conjunction. It is also shown that categorial grammars with conjunction can be naturally embedded into the Lambek calculus with conjunction and disjunction operations. This further implies that a certain NP-complete set can be defined in the Lambek calculus with conjunction. We also show how to handle some subtle issues connected with the empty string. Finally, we prove that a language generated by a conjunctive grammar can be described by a Lambek grammar with disjunction (but without conjunction).


title: Private Edge Density Estimation for Random Graphs: Optimal, Efficient and Robust

abstract: We give the first polynomial-time, differentially node-private, and robust algorithm for estimating the edge density of Erd\H{o}s-R\'enyi random graphs and their generalization, inhomogeneous random graphs. We further prove information-theoretical lower bounds, showing that the error rate of our algorithm is optimal up to logarithmic factors. Previous algorithms incur either exponential running time or suboptimal error rates. Two key ingredients of our algorithm are (1) a new sum-of-squares algorithm for robust edge density estimation, and (2) the reduction from privacy to robustness based on sum-of-squares exponential mechanisms due to Hopkins et al. (STOC 2023).


title: Deep learning improved autofocus for motion artifact reduction and its application in quantitative susceptibility mapping

abstract: Purpose: To develop a pipeline for motion artifact correction in mGRE and quantitative susceptibility mapping (QSM). Methods: Deep learning is integrated with autofocus to improve motion artifact suppression, which is applied QSM of patients with Parkinson's disease (PD). The estimation of affine motion parameters in the autofocus method depends on signal-to-noise ratio and lacks accuracy when data sampling occurs outside the k-space center. A deep learning strategy is employed to remove the residual motion artifacts in autofocus. Results: Results obtained in simulated brain data (n =15) with reference truth show that the proposed autofocus deep learning method significantly improves the image quality of mGRE and QSM (p = 0.001 for SSIM, p < 0.0001 for PSNR and RMSE). Results from 10 PD patients with real motion artifacts in QSM have also been corrected using the proposed method and sent to an experienced radiologist for image quality evaluation, and the average image quality score has increased (p=0.0039). Conclusions: The proposed method enables substantial suppression of motion artifacts in mGRE and QSM.


title: Characters and Sylow $3$-subgroup commutators

abstract: We characterize when a finite group G possesses a Sylow 3-subgroup P with abelianization of order 9 in terms of the number of height zero characters lying in the principal 3-block of G, settling a conjecture put forward by Navarro, Sambale, and Tiep in 2018. Along the way, we show that a recent result by Laradji on the number of character of height zero in a block that lie above a given character of some normal subgroup holds, without any hypothesis on the group for blocks of maximal defect.


title: Comments on Friedman's Method for Class Distribution Estimation

abstract: The purpose of class distribution estimation (also known as quantification) is to determine the values of the prior class probabilities in a test dataset without class label observations. A variety of methods to achieve this have been proposed in the literature, most of them based on the assumption that the distributions of the training and test data are related through prior probability shift (also known as label shift). Among these methods, Friedman's method has recently been found to perform relatively well both for binary and multi-class quantification. We discuss the properties of Friedman's method and another approach mentioned by Friedman (called DeBias method in the literature) in the context of a general framework for designing linear equation systems for class distribution estimation.


title: Quantitative linear nondegeneracy of approximate solutions to strongly competitive Gross-Pitaevskii systems in general domains in $N\geq 1$ dimensions

abstract: We consider strongly coupled competitive elliptic systems of Gross-Pitaevskii type that arise in the study of two-component Bose-Einstein condensates, in general smooth bounded domains of $\mathbb{R}^N$, $N\geq 1$. As the coupling parameter tends to infinity, solutions that remain uniformly bounded are known to converge to a segregated limiting profile, with the difference of its components satisfying a limit scalar PDE. Under natural non-degeneracy assumptions on a solution of the limit problem, we show that the linearization of the Gross-Pitaevskii system around a 'sufficiently good' approximate solution does not have a kernel and obtain an estimate for its inverse with respect to carefully chosen weighted norms. Our motivation is the study of the persistence of solutions of the limit scalar problem for large values of the coupling parameter which is known only in two dimensions or if the domain has radial symmetry.


title: Provably Efficient Off-Policy Adversarial Imitation Learning with Convergence Guarantees

abstract: Adversarial Imitation Learning (AIL) faces challenges with sample inefficiency because of its reliance on sufficient on-policy data to evaluate the performance of the current policy during reward function updates. In this work, we study the convergence properties and sample complexity of off-policy AIL algorithms. We show that, even in the absence of importance sampling correction, reusing samples generated by the $o(\sqrt{K})$ most recent policies, where $K$ is the number of iterations of policy updates and reward updates, does not undermine the convergence guarantees of this class of algorithms. Furthermore, our results indicate that the distribution shift error induced by off-policy updates is dominated by the benefits of having more data available. This result provides theoretical support for the sample efficiency of off-policy AIL algorithms. To the best of our knowledge, this is the first work that provides theoretical guarantees for off-policy AIL algorithms.


title: Low-resourced Languages and Online Knowledge Repositories: A Need-Finding Study

abstract: Online Knowledge Repositories (OKRs) like Wikipedia offer communities a way to share and preserve information about themselves and their ways of living. However, for communities with low-resourced languages -- including most African communities -- the quality and volume of content available are often inadequate. One reason for this lack of adequate content could be that many OKRs embody Western ways of knowledge preservation and sharing, requiring many low-resourced language communities to adapt to new interactions. To understand the challenges faced by low-resourced language contributors on the popular OKR Wikipedia, we conducted (1) a thematic analysis of Wikipedia forum discussions and (2) a contextual inquiry study with 14 novice contributors. We focused on three Ethiopian languages: Afan Oromo, Amharic, and Tigrinya. Our analysis revealed several recurring themes; for example, contributors struggle to find resources to corroborate their articles in low-resourced languages, and language technology support, like translation systems and spellcheck, result in several errors that waste contributors' time. We hope our study will support designers in making online knowledge repositories accessible to low-resourced language speakers.


title: On the regularity of axially-symmetric solutions to the incompressible Navier-Stokes equations in a cylinder

abstract: We consider the axisymmetric Navier-Stokes equations in a finite cylinder $\Omega\subset\mathbb{R}^3$. We assume that $v_r$, $v_\varphi$, $\omega_\varphi$ vanish on the lateral boundary $\partial \Omega$ of the cylinder, and that $v_z$, $\omega_\varphi$, $\partial_z v_\varphi$ vanish on the top and bottom parts of the boundary $\partial \Omega$, where we used standard cylindrical coordinates, and we denoted by $\omega =\mathrm{curl}\, v$ the vorticity field. We use estimates and $H^3$ Sobolev estimate on the modified stream function to derive three order-reduction estimates. These enable one to reduce the order of the nonlinear estimates of the equations, and help observe that the solutions to the equations is ``almost regular''. We use the order-reduction estimates to show that the solution to the equations remains regular as long as, for any $p\in (6,\infty)$, $\| v_\varphi \|_{L^\infty_t L^p_x}/\| v_\varphi \|_{L^\infty_t L^\infty_x}$ remains bounded below by a positive number.


title: Mixture of Experts Using Tensor Products

abstract: In multi-task learning, the conventional approach involves training a model on multiple tasks simultaneously. However, the training signals from different tasks can interfere with one another, potentially leading to \textit{negative transfer}. To mitigate this, we investigate if modular language models can facilitate positive transfer and systematic generalization. Specifically, we propose a novel modular language model (\texttt{TensorPoly}), that balances parameter efficiency with nuanced routing methods. For \textit{modules}, we reparameterize Low-Rank Adaptation (\texttt{LoRA}) by employing an entangled tensor through the use of tensor product operations and name the resulting approach \texttt{TLoRA}. For \textit{routing function}, we tailor two innovative routing functions according to the granularity: \texttt{TensorPoly-I} which directs to each rank within the entangled tensor while \texttt{TensorPoly-II} offers a finer-grained routing approach targeting each order of the entangled tensor. The experimental results from the multi-task T0-benchmark demonstrate that: 1) all modular LMs surpass the corresponding dense approaches, highlighting the potential of modular language models to mitigate negative inference in multi-task learning and deliver superior outcomes. 2) \texttt{TensorPoly-I} achieves higher parameter efficiency in adaptation and outperforms other modular LMs, which shows the potential of our approach in multi-task transfer learning.


title: Transfer Learning Under High-Dimensional Graph Convolutional Regression Model for Node Classification

abstract: Node classification is a fundamental task, but obtaining node classification labels can be challenging and expensive in many real-world scenarios. Transfer learning has emerged as a promising solution to address this challenge by leveraging knowledge from source domains to enhance learning in a target domain. Existing transfer learning methods for node classification primarily focus on integrating Graph Convolutional Networks (GCNs) with various transfer learning techniques. While these approaches have shown promising results, they often suffer from a lack of theoretical guarantees, restrictive conditions, and high sensitivity to hyperparameter choices. To overcome these limitations, we propose a Graph Convolutional Multinomial Logistic Regression (GCR) model and a transfer learning method based on the GCR model, called Trans-GCR. We provide theoretical guarantees of the estimate obtained under GCR model in high-dimensional settings. Moreover, Trans-GCR demonstrates superior empirical performance, has a low computational cost, and requires fewer hyperparameters than existing methods.


title: Black holes in the expanding Universe

abstract: If the Universe is closed, there must exist a constant and positive energy density of vacuum (cosmological constant). By analyzing the McVittie metric, we show that in the expanding Universe: the Hubble parameters at the event horizons of all centrally symmetric black holes are equal and related to the cosmological constant, black holes do not grow with the expansion of the Universe, and different regions of the Universe expand at different rates (Hubble tension).


title: Limits of Deep Learning: Sequence Modeling through the Lens of Complexity Theory

abstract: Deep learning models have achieved significant success across various applications but continue to struggle with tasks requiring complex reasoning over sequences, such as function composition and compositional tasks. Despite advancements, models like Structured State Space Models (SSMs) and Transformers underperform in deep compositionality tasks due to inherent architectural and training limitations. Maintaining accuracy over multiple reasoning steps remains a primary challenge, as current models often rely on shortcuts rather than genuine multi-step reasoning, leading to performance degradation as task complexity increases. Existing research highlights these shortcomings but lacks comprehensive theoretical and empirical analysis for SSMs. Our contributions address this gap by providing a theoretical framework based on complexity theory to explain SSMs' limitations. Moreover, we present extensive empirical evidence demonstrating how these limitations impair function composition and algorithmic task performance. Our experiments reveal significant performance drops as task complexity increases, even with Chain-of-Thought (CoT) prompting. Models frequently resort to shortcuts, leading to errors in multi-step reasoning. This underscores the need for innovative solutions beyond current deep learning paradigms to achieve reliable multi-step reasoning and compositional task-solving in practical applications.


title: Using Jupyter Notebooks to foster computational skills and professional practice in an introductory physics lab course

abstract: In this paper, we detail the integration of Python data analysis into a first-year physics laboratory course, a task accomplished without significant alterations to the existing course structure. We introduced tailored laboratory computational learning goals and designed activities to address them. We emphasise the development and application of Jupyter Notebooks, tailored with exercises and physics application examples, to facilitate students' mastery of data analysis programming within the laboratory setting. These Notebooks serve as a crucial tool in guiding students through the core principles of data handling and analysis in Python, while working on simple experimental tasks. The results of the evaluation of this intervention offer insights into the advantages and challenges associated with early integration of computational skills in laboratory courses, providing valuable information for educators in the field of physics education. This study demonstrates a practical and effective way of embedding computational skills into the physics curriculum, and contributes to the ongoing efforts of the physics education research community.


title: iDIGIT4L. Nuevos ecosistemas de digitalizaci\'on y aprendizaje hombre-m\'aquina para sistemas de fabricaci\'on industrial heredados

abstract: The digitization of the productive ecosystem related to human-machine interaction has become a priority for small and medium-sized enterprises. Particularly to face the challenges of Industry 4.0 and advanced digital skills in the workplace. From the research point of view, digitization opens a global scenario for the generation of opportunities for learning in existing manufacturing systems. Mainly, traditional environments must deal with competitive pressures to incorporate new technologies and adapt the skills of workers. In this paper is presented the iDIGIT4L project, which was envisaged to research and develop a digitization ecosystem where people and systems interact in order to transform industrial processes in an intelligent and predictive way. The project contributes with a three-tier human-machine learning methodology that provides augmented and bi-directional interaction in a traditional manufacturing scenario. It is based on the implementation of a non-intrusively integrated digital twin, characterizing an old industrial milling machine for learning through knowledge models supported by the experience of skilled workers. As a result, it has been possible to simultaneously update the functionalities of the industrial system and the digital skills of the workers, becoming an integral part of the digital twin.


title: Crossmodal ASR Error Correction with Discrete Speech Units

abstract: ASR remains unsatisfactory in scenarios where the speaking style diverges from that used to train ASR systems, resulting in erroneous transcripts. To address this, ASR Error Correction (AEC), a post-ASR processing approach, is required. In this work, we tackle an understudied issue: the Low-Resource Out-of-Domain (LROOD) problem, by investigating crossmodal AEC on very limited downstream data with 1-best hypothesis transcription. We explore pre-training and fine-tuning strategies and uncover an ASR domain discrepancy phenomenon, shedding light on appropriate training schemes for LROOD data. Moreover, we propose the incorporation of discrete speech units to align with and enhance the word embeddings for improving AEC quality. Results from multiple corpora and several evaluation metrics demonstrate the feasibility and efficacy of our proposed AEC approach on LROOD data, as well as its generalizability and superiority on large-scale data. Finally, a study on speech emotion recognition confirms that our model produces ASR error-robust transcripts suitable for downstream applications.


title: On wreath product occurring as subgroup of automata group

abstract: A finitely generated group is said to be an automata group if it admits a faithful self-similar finite-state representation on some regular $m$-tree. We prove that if $G$ is a subgroup of an automata group, then for each finitely generated abelian group $A$, the wreath product $A \wr G$ is a subgroup of an automata group. We obtain, for example, that $C_2 \wr (C_{2} \wr \mathbb{Z})$, $\mathbb{Z} \wr (C_2 \wr \mathbb{Z})$, $C_2 \wr (\mathbb{Z} \wr \mathbb{Z})$, and $\mathbb{Z} \wr (\mathbb{Z} \wr \mathbb{Z})$ are subgroups of automata groups. In the particular case $\mathbb{Z} \wr (\mathbb{Z} \wr \mathbb{Z})$, we prove that it is a subgroup of a two-letters automata group; this solves Problem 15.19 - (b) of the Kourovka Notebook proposed by A. M. Brunner and S. Sidki in 2000 [8, 17].


title: Aggregation-Diffusion Equations for Collective Behaviour in the Sciences

abstract: This is a survey article based on the content of the plenary lecture given by Jos\'e A. Carrillo at the ICIAM23 conference in Tokyo. It is devoted to produce a snapshot of the state of the art in the analysis, numerical analysis, simulation, and applications of the vast area of aggregation-diffusion equations. We also discuss the implications in mathematical biology explaining cell sorting in tissue growth as an example of this modelling framework. This modelling strategy is quite successful in other timely applications such as global optimisation, parameter estimation and machine learning.


title: Six-Degree-of-Freedom Aircraft Landing Trajectory Planning with Runway Alignment

abstract: This paper presents a numerical optimization algorithm for generating approach and landing trajectories for a six-degree-of-freedom (6-DoF) aircraft. We improve on the existing research on aircraft landing trajectory generation by formulating the trajectory optimization problem with additional real-world operational constraints, including 6-DoF aircraft dynamics, runway alignment, constant wind field, and obstacle avoidance, to obtain a continuous-time nonconvex optimal control problem. Particularly, the runway alignment constraint enforces the trajectory of the aircraft to be aligned with the runway only during the final approach phase. This is a novel feature that is essential for preventing an approach that is either too steep or too shallow. The proposed method models the runway alignment constraint through a multi-phase trajectory planning scheme, imposing alignment conditions exclusively during the final approach phase. We compare this formulation with the existing state-triggered constraint formulation for runway alignment. To solve the formulated problem, we design a novel sequential convex programming algorithm called xPTR that extends the penalized trust-region (PTR) algorithm by incorporating an extrapolation step to expedite convergence. We validate the proposed method through extensive numerical simulations, including a Monte Carlo study, to evaluate the robustness of the algorithm to varying initial conditions.


title: Triple Preference Optimization: Achieving Better Alignment with Less Data in a Single Step Optimization

abstract: Large Language Models (LLMs) perform well across diverse tasks, but aligning them with human demonstrations is challenging. Recently, Reinforcement Learning (RL)-free methods like Direct Preference Optimization (DPO) have emerged, offering improved stability and scalability while retaining competitive performance relative to RL-based methods. However, while RL-free methods deliver satisfactory performance, they require significant data to develop a robust Supervised Fine-Tuned (SFT) model and an additional step to fine-tune this model on a preference dataset, which constrains their utility and scalability. In this paper, we introduce Triple Preference Optimization (TPO), a new preference learning method designed to align an LLM with three preferences without requiring a separate SFT step and using considerably less data. Through a combination of practical experiments and theoretical analysis, we show the efficacy of TPO as a single-step alignment strategy. Specifically, we fine-tuned the Phi-2 (2.7B) and Mistral (7B) models using TPO directly on the UltraFeedback dataset, achieving superior results compared to models aligned through other methods such as SFT, DPO, KTO, IPO, CPO, and ORPO. Moreover, the performance of TPO without the SFT component led to notable improvements in the MT-Bench score, with increases of +1.27 and +0.63 over SFT and DPO, respectively. Additionally, TPO showed higher average accuracy, surpassing DPO and SFT by 4.2% and 4.97% on the Open LLM Leaderboard benchmarks. Our code is publicly available at https://github.com/sahsaeedi/triple-preference-optimization .


title: A Systematic Review of Federated Generative Models

abstract: Federated Learning (FL) has emerged as a solution for distributed systems that allow clients to train models on their data and only share models instead of local data. Generative Models are designed to learn the distribution of a dataset and generate new data samples that are similar to the original data. Many prior works have tried proposing Federated Generative Models. Using Federated Learning and Generative Models together can be susceptible to attacks, and designing the optimal architecture remains challenging. This survey covers the growing interest in the intersection of FL and Generative Models by comprehensively reviewing research conducted from 2019 to 2024. We systematically compare nearly 100 papers, focusing on their FL and Generative Model methods and privacy considerations. To make this field more accessible to newcomers, we highlight the state-of-the-art advancements and identify unresolved challenges, offering insights for future research in this evolving field.


title: Toward Digitalization: A Secure Approach to Find a Missing Person Using Facial Recognition Technology

abstract: Facial Recognition is a technique, based on machine learning technology that can recognize a human being analyzing his facial profile, and is applied in solving various types of realworld problems nowadays. In this paper, a common real-world problem, finding a missing person has been solved in a secure and effective way with the help of facial recognition technology. Although there exist a few works on solving the problem, the proposed work is unique with respect to its security, design, and feasibility. Impeding intruders in participating in the processes and giving importance to both finders and family members of a missing person are two of the major features of this work. The proofs of the works of our system in finding a missing person have been described in the result section of the paper. The advantages that our system provides over the other existing systems can be realized from the comparisons, described in the result summary section of the paper. The work is capable of providing a worthy solution to find a missing person on the digital platform.


title: gzip Predicts Data-dependent Scaling Laws

abstract: Past work has established scaling laws that predict the performance of a neural language model (LM) as a function of its parameter count and the number of tokens it's trained on, enabling optimal allocation of a fixed compute budget. Are these scaling laws agnostic to training data as some prior work suggests? We generate training datasets of varying complexities by modulating the syntactic properties of a PCFG, finding that 1) scaling laws are sensitive to differences in data complexity and that 2) gzip, a compression algorithm, is an effective predictor of how data complexity impacts scaling properties. We propose a new data-dependent scaling law for LM's that accounts for the training data's gzip-compressibility; its compute-optimal frontier increases in dataset size preference (over parameter count preference) as training data becomes harder to compress.


title: EdgeSphere: A Three-Tier Architecture for Cognitive Edge Computing

abstract: Computing at the edge is increasingly important as Internet of Things (IoT) devices at the edge generate massive amounts of data and pose challenges in transporting all that data to the Cloud where they can be analyzed. On the other hand, harnessing the edge data is essential for offering cognitive applications, if the challenges, such as device capabilities, connectivity, and heterogeneity can be overcome. This paper proposes a novel three-tier architecture, called EdgeSphere, which harnesses resources of the edge devices, to analyze the data in situ at the edge. In contrast to the state-of-the-art cloud and mobile applications, EdgeSphere applications span across cloud, edge gateways, and edge devices. At its core, EdgeSphere builds on Apache Mesos to optimize resources usage and scheduling. EdgeSphere has been applied to practical scenarios and this paper describes the engineering challenges faced as well as innovative solutions.


title: Electron-only reconnection and ion heating in 3D3V hybrid-Vlasov plasma turbulence

abstract: We perform 3D3V hybrid-Vlasov (fully kinetic ions and fluid electrons) simulations of sub-ion-scale plasma turbulence with quasi-isotropic, compressible injection close to the ion scales to investigate electron-only reconnection and its effect on ion heating. Retaining electron inertia in the generalized Ohm s law provides the mechanism for collisionless magnetic reconnection. Spectral analysis reveals a shift from kinetic Alfv\'{e}n waves (KAW) to inertial kinetic Alfv\'{e}n (IKAW) and inertial whistler waves (IWW) near electron scales. To distinguish the roles of the inertial scale and the gyroradius (d_{\rm{i}} and \rho_{\rm{i}}), three values of ion beta (\beta_{\rm{i}} = 0.25, 1, 4) are studied. Ion-electron decoupling increases with \beta_{\rm{i}}, as ions become less mobile when the injection scale is closer to \rho_{\rm{i}} than to d_{\rm{i}}, highlighting the role of \rho_{\rm{i}} in achieving an electron magnetohydrodynamic (EMHD) regime at sub-ion scales. The EMHD regime promotes electron-only reconnection in turbulence with small-scale injection at \beta_{\rm{i}} \gtrsim 1. Despite this EMHD-favoured dynamics, we still observe significant ion heating also at large \beta_{\rm{i}}, namely Q_{\rm{i}}/\epsilon \approx 69, 91, and 96 at \beta_{\rm{i}} = 0.25, 1, and 4, respectively. Moreover, while ion heating is significantly anisotropic at \beta_{\rm{i}} \leq 1 (namely, T_{\rm i,\perp} > T_{\rm i,\parallel}), it becomes only marginally anisotropic at \beta_{\rm{i}} > 1 (i.e., T_{\rm i,\perp} \gtrsim T_{\rm i,\parallel}). Our results highlight that ion turbulent heating in collisionless plasmas is sensitive to the separation between injection scales \lambda_{\text{inj}} and the ion gyroradius \rho_{\rm{i}}, as well as to \beta_{\rm{i}} and finite-k_{\parallel} effects, requiring an extended investigation of these parameters for accurate modelling.


title: Reconstructing the Charlie Parker Omnibook using an audio-to-score automatic transcription pipeline

abstract: The Charlie Parker Omnibook is a cornerstone of jazz music education, described by pianist Ethan Iverson as "the most important jazz education text ever published". In this work we propose a new transcription pipeline and explore the extent to which state of the art music technology is able to reconstruct these scores directly from the audio without human intervention. Our pipeline includes: a newly trained source separation model for saxophone, a new MIDI transcription model for solo saxophone and an adaptation of an existing MIDI-to-score method for monophonic instruments. To assess this pipeline we also provide an enhanced dataset of Charlie Parker transcriptions as score-audio pairs with accurate MIDI alignments and downbeat annotations. This represents a challenging new benchmark for automatic audio-to-score transcription that we hope will advance research into areas beyond transcribing audio-to-MIDI alone. Together, these form another step towards producing scores that musicians can use directly, without the need for onerous corrections or revisions. To facilitate future research, all model checkpoints and data are made available to download along with code for the transcription pipeline. Improvements in our modular pipeline could one day make the automatic transcription of complex jazz solos a routine possibility, thereby enriching the resources available for music education and preservation.


title: DeTEcT: Dynamic and Probabilistic Parameters Extension

abstract: This paper presents a theoretical extension of the DeTEcT framework proposed by Sadykhov et al., DeTEcT, where a formal analysis framework was introduced for modelling wealth distribution in token economies. DeTEcT is a framework for analysing economic activity, simulating macroeconomic scenarios, and algorithmically setting policies in token economies. This paper proposes four ways of parametrizing the framework, where dynamic vs static parametrization is considered along with the probabilistic vs non-probabilistic. Using these parametrization techniques, we demonstrate that by adding restrictions to the framework it is possible to derive the existing wealth distribution models from DeTEcT. In addition to exploring parametrization techniques, this paper studies how money supply in DeTEcT framework can be transformed to become dynamic, and how this change will affect the dynamics of wealth distribution. The motivation for studying dynamic money supply is that it enables DeTEcT to be applied to modelling token economies without maximum supply (i.e., Ethereum), and it adds constraints to the framework in the form of symmetries.


title: A note on the area of event horizon of Kleinian black hole

abstract: We point out that the area of event horizon of Kleinian black hole is infinite due to the fact that its event horizon is not a sphere but a hyperboloid. Therefore, the usual interpretations of Schwarzschild black hole might not be applicable to the Kleinian black hole.


title: On the Performance of Continuous Aperture Array (CAPA)-Based Wireless Communications

abstract: The performance of continuous aperture array (CAPA)-based wireless communications is analyzed in an uplink scenario. An analytical framework is proposed to characterize uplink CAPA-based transmission using electromagnetic field theories. On this basis, new expressions are derived for the channel capacity in a single-user scenario and the sum-rate capacity in a multiuser scenario, along with the capacity-achieving decoding schemes. These findings are proved to differ greatly from those established for conventional spatially discrete (SPD) arrays. Numerical results are provided to demonstrate that CAPA offers significant capacity gains compared to the SPD array.


title: Stabilizers of consistent walks

abstract: A walk of length $n$ in a graph is consistent if there exists an automorphism of the graph that maps the initial $n-1$ vertices to the final $n-1$ vertices of the walk. In this paper we find some sufficient conditions for a consistent walk in an arc-transitive graph to have a trivial pointwise stabilizer. We show that in that case, the size of the smallest generating set of the group is bounded by the valence of the graph.


title: Planning Robot Placement for Object Grasping

abstract: When performing manipulation-based activities such as picking objects, a mobile robot needs to position its base at a location that supports successful execution. To address this problem, prominent approaches typically rely on costly grasp planners to provide grasp poses for a target object, which are then are then analysed to identify the best robot placements for achieving each grasp pose. In this paper, we propose instead to first find robot placements that would not result in collision with the environment and from where picking up the object is feasible, then evaluate them to find the best placement candidate. Our approach takes into account the robot's reachability, as well as RGB-D images and occupancy grid maps of the environment for identifying suitable robot poses. The proposed algorithm is embedded in a service robotic workflow, in which a person points to select the target object for grasping. We evaluate our approach with a series of grasping experiments, against an existing baseline implementation that sends the robot to a fixed navigation goal. The experimental results show how the approach allows the robot to grasp the target object from locations that are very challenging to the baseline implementation.


title: Detection of decision-making manipulation in the pairwise comparisons method

abstract: Most decision-making models, including the pairwise comparison method, assume the decision-makers honesty. However, it is easy to imagine a situation where a decision-maker tries to manipulate the ranking results. This paper presents three simple manipulation methods in the pairwise comparison method. We then try to detect these methods using appropriately constructed neural networks. Experimental results accompany the proposed solutions on the generated data, showing a considerable manipulation detection level.


title: Aperture Selection for CAP Arrays (CAPAs)

abstract: The concept of aperture selection is proposed for continuous aperture array (CAPA)-based communications. The achieved performance is analyzed in an uplink scenario by considering both line-of-sight (LoS) and non-line-of-sight (NLoS) scenarios. In the LoS scenario, the optimal selection strategy is demonstrated to follow the nearest neighbor criterion, and the resulting signal-to-noise ratio (SNR) is analyzed. In the NLoS scenario, the achieved outage probability along with the diversity order is revealed. Numerical results are provided to demonstrate that aperture selection effectively maintains satisfactory performance by leveraging selection diversity while simultaneously reducing the implementation complexity of CAPAs.


title: Oscillations in neuronal activity: a neuron-centered spatiotemporal model of the Unfolded Protein Response in prion diseases

abstract: Many neurodegenerative diseases (NDs) are characterized by the slow spatial spread of toxic protein species in the brain. The toxic proteins can induce neuronal stress, triggering the Unfolded Protein Response (UPR), which slows or stops protein translation and can indirectly reduce the toxic load. However, the UPR may also trigger processes leading to apoptotic cell death and the UPR is implicated in the progression of several NDs. In this paper, we develop a novel mathematical model to describe the spatiotemporal dynamics of the UPR mechanism for prion diseases. Our model is centered around a single neuron, with representative proteins P (healthy) and S (toxic) interacting with heterodimer dynamics (S interacts with P to form two S's). The model takes the form of a coupled system of nonlinear reaction-diffusion equations with a delayed, nonlinear flux for P (delay from the UPR). Through the delay, we find parameter regimes that exhibit oscillations in the P- and S-protein levels. We find that oscillations are more pronounced when the S-clearance rate and S-diffusivity are small in comparison to the P-clearance rate and P-diffusivity, respectively. The oscillations become more pronounced as delays in initiating the UPR increase. We also consider quasi-realistic clinical parameters to understand how possible drug therapies can alter the course of a prion disease. We find that decreasing the production of P, decreasing the recruitment rate, increasing the diffusivity of S, increasing the UPR S-threshold, and increasing the S clearance rate appear to be the most powerful modifications to reduce the mean UPR intensity and potentially moderate the disease progression.


title: How many samples are needed to train a deep neural network?

abstract: Neural networks have become standard tools in many areas, yet many important statistical questions remain open. This paper studies the question of how much data are needed to train a ReLU feed-forward neural network. Our theoretical and empirical results suggest that the generalization error of ReLU feed-forward neural networks scales at the rate $1/\sqrt{n}$ in the sample size $n$ rather than the usual "parametric rate" $1/n$. Thus, broadly speaking, our results underpin the common belief that neural networks need "many" training samples.


title: CNN Autoencoder Resizer: A Power-Efficient LoS/NLoS Detector in MIMO-enabled UAV Networks

abstract: Optimizing the design, performance, and resource efficiency of wireless networks (WNs) necessitates the ability to discern Line of Sight (LoS) and Non-Line of Sight (NLoS) scenarios across diverse applications and environments. Unmanned Aerial Vehicles (UAVs) exhibit significant potential in this regard due to their rapid mobility, aerial capabilities, and payload characteristics. Particularly, UAVs can serve as vital non-terrestrial base stations (NTBS) in the event of terrestrial base station (TBS) failures or downtime. In this paper, we propose CNN autoencoder resizer (CAR) as a framework that improves the accuracy of LoS/NLoS detection without demanding extra power consumption. Our proposed method increases the mean accuracy of detecting LoS/NLoS signals from 66% to 86%, while maintaining consistent power consumption levels. In addition, the resolution provided by CAR shows that it can be employed as a preprocessing tool in other methods to enhance the quality of signals.


title: The Phase Space Distance Between Collider Events

abstract: How can one fully harness the power of physics encoded in relativistic $N$-body phase space? Topologically, phase space is isomorphic to the product space of a simplex and a hypersphere and can be equipped with explicit coordinates and a Riemannian metric. This natural structure that scaffolds the space on which all collider physics events live opens up new directions for machine learning applications and implementation. Here we present a detailed construction of the phase space manifold and its differential line element, identifying particle ordering prescriptions that ensure that the metric satisfies necessary properties. We apply the phase space metric to several binary classification tasks, including discrimination of high-multiplicity resonance decays or boosted hadronic decays of electroweak bosons from QCD processes, and demonstrate powerful performance on simulated data. Our work demonstrates the many benefits of promoting phase space from merely a background on which calculations take place to being geometrically entwined with a theory's dynamics.


title: Odd viscous flow past a sphere at low but nonzero Reynolds numbers

abstract: Measuring lift force on symmetrically shaped obstacles immersed in laminar flow is the quintessential way of signalling odd viscosity. For flow past cylinders, such a lift force does not arise when incompressibility and no-slip boundary conditions hold, whereas for spheres, a lift force was found in Stokes flow, applying to cases where the Reynolds number is negligible and convection can be ignored. When considering the role of convection at low but nonzero Reynolds numbers, two arising hurdles are the Whitehead paradox and the breaking of axial symmetry, which are overcome by asymptotic matching and the Lorentz reciprocal theorem respectively. We also consider the case where axial symmetry is retained because the translation of the sphere is aligned with the anisotropy vector of odd viscosity. We find that while lift vanishes, the interplay between odd viscosity and convection gives rise to a stream-induced non-vanishing torque.


title: Implicit Multimodal Alignment: On the Generalization of Frozen LLMs to Multimodal Inputs

abstract: Large Language Models (LLMs) have demonstrated impressive performance on multimodal tasks, without any multimodal finetuning. They are the building block for Large Multimodal Models, yet, we still lack a proper understanding of their success. In this work, we expose frozen LLMs to image, video, audio and text inputs and analyse their internal representation aiming to understand their generalization beyond textual inputs. Findings. Perceptual tokens (1) are easily distinguishable from textual ones inside LLMs, with significantly different representations, and complete translation to textual tokens does not exist. Yet, (2) both perceptual and textual tokens activate similar LLM weights. Despite being different, (3) perceptual and textual tokens are implicitly aligned inside LLMs, we call this the implicit multimodal alignment (IMA), and argue that this is linked to architectural design, helping LLMs to generalize. This provide more evidence to believe that the generalization of LLMs to multimodal inputs is mainly due to their architecture. Implications. (1) We find a positive correlation between the implicit alignment score and the task performance, suggesting that this could act as a proxy metric for model evaluation and selection. (2) A negative correlation exists regarding hallucinations, revealing that this problem is mainly due to misalignment between the internal perceptual and textual representations. (3) Perceptual tokens change slightly throughout the model, thus, we propose different approaches to skip computations (e.g. in FFN layers), and significantly reduce the inference cost. (4) Due to the slowly changing embeddings across layers, and the high overlap between textual and multimodal activated weights, we compress LLMs by keeping only 1 subnetwork that works well across a wide range of multimodal tasks. Paper code: https://github.com/mshukor/ima-lmms.


title: Detail-Enhanced Intra- and Inter-modal Interaction for Audio-Visual Emotion Recognition

abstract: Capturing complex temporal relationships between video and audio modalities is vital for Audio-Visual Emotion Recognition (AVER). However, existing methods lack attention to local details, such as facial state changes between video frames, which can reduce the discriminability of features and thus lower recognition accuracy. In this paper, we propose a Detail-Enhanced Intra- and Inter-modal Interaction network(DE-III) for AVER, incorporating several novel aspects. We introduce optical flow information to enrich video representations with texture details that better capture facial state changes. A fusion module integrates the optical flow estimation with the corresponding video frames to enhance the representation of facial texture variations. We also design attentive intra- and inter-modal feature enhancement modules to further improve the richness and discriminability of video and audio representations. A detailed quantitative evaluation shows that our proposed model outperforms all existing methods on three benchmark datasets for both concrete and continuous emotion recognition. To encourage further research and ensure replicability, we will release our full code upon acceptance.


title: Accurate and Nuanced Open-QA Evaluation Through Textual Entailment

abstract: Open-domain question answering (Open-QA) is a common task for evaluating large language models (LLMs). However, current Open-QA evaluations are criticized for the ambiguity in questions and the lack of semantic understanding in evaluators. Complex evaluators, powered by foundation models or LLMs and pertaining to semantic equivalence, still deviate from human judgments by a large margin. We propose to study the entailment relations of answers to identify more informative and more general system answers, offering a much closer evaluation to human judgment on both NaturalQuestions and TriviaQA while being learning-free. The entailment-based evaluation we propose allows the assignment of bonus or partial marks by quantifying the inference gap between answers, enabling a nuanced ranking of answer correctness that has higher AUC than current methods.


title: The three-point Gaudin model and branched coverings of the Riemann sphere

abstract: We study the three-point quantum $\mathfrak{sl_2}$-Gaudin model. In this case the compactification of the parameter space is $\overline{M_{0,4}(\mathbb{C})}$, which is the Riemann sphere. We analyze sphere coverings by the joint spectrum of the Gaudin Hamiltonians treating them as algebraic curves. We write equations of these curves as determinants of tridiagonal matrices and deduce some consequences regarding the geometric structure of the Gaudin coverings.


title: Non-Normal Magidor-Radin Types of Forcings

abstract: We develop the non-normal variations of two classical Prikry-type forcings; namely, Magidor and Radin forcings. We generalize the fact that the non-normal Prikry forcing is a projection of the extender-based to a coordinate of the extender to our forcing and the Radin/Magidor-Radin-extender-based forcing from \cite{CarmiMagidorRadin,CarmiRadin}. Then, we show that both the non-normal variation of Magidor and Radin forcings can add a Cohen generic function to every limit point of cofinality $\omega$ of the generic club. Second, we show that this phenomenon is limited to the cases where the forcings are not designed to change the cofinality of a measurable $\kappa$ to $\omega_1$. Specifically, in the above-mentioned circumstances these forcings do not project onto any $\kappa$-distributive forcing. We use that to conclude that the extender-based Radin/Magidor-Radin forcing does not add fresh subsets to $\kappa$ as well. In the second part of the paper we focus on the natural non-normal variation of Gitik's forcing from \cite[\S3]{GitikNonStationary}. Our main result shows that this poset can be employed to change the cofinality of a measurable cardinal $\kappa$ to $\omega_1$ while introducing a Cohen subset of $\kappa$.


title: On the Phragm\'{e}n-Lindel\"{o}f and the superposition principles for the $p$-Laplacian

abstract: We study sub and supersolutions for the $p$-Laplace type elliptic equation of the form $$-\Delta_p u-V|u|^{p-2}u=0\quad\text{in $\Omega$},$$ where $\Omega$ is a radially symmetric domain in ${\mathbb{R}}^N$ and $V(x)\ge 0$ is a continuous potential such that the solutions of the equation satisfy the comparison principle on bounded subdomains of $\Omega$. In this work we establish a superposition principle and then use it to develop a version of a Phragm\'{e}n-Lindel\"{o}f comparison principle in the case $p\ge 2$. Moreover, by applying this principle to the case of Hardy-type potentials we recover and improve a number of known lower and upper estimates for sub and supersolutions.


title: Gravitational higher-form symmetries and the origin of hidden symmetries in Kaluza-Klein compactifications

abstract: We show that, in presence of isometries and non-trivial topology, the Einstein--Hilbert action is invariant under certain transformations of the metric which are not diffeomorphisms. These transformations are similar to the higher-form symmetries of field theories with $p$-form fields. In the context of toroidal Kaluza--Klein compactifications, we show that these symmetries give rise to some of the ``hidden symmetries'' (dualities) of the dimensionally-reduced theories.


title: Visualizing the Shadows: Unveiling Data Poisoning Behaviors in Federated Learning

abstract: This demo paper examines the susceptibility of Federated Learning (FL) systems to targeted data poisoning attacks, presenting a novel system for visualizing and mitigating such threats. We simulate targeted data poisoning attacks via label flipping and analyze the impact on model performance, employing a five-component system that includes Simulation and Data Generation, Data Collection and Upload, User-friendly Interface, Analysis and Insight, and Advisory System. Observations from three demo modules: label manipulation, attack timing, and malicious attack availability, and two analysis components: utility and analytical behavior of local model updates highlight the risks to system integrity and offer insight into the resilience of FL systems. The demo is available at https://github.com/CathyXueqingZhang/DataPoisoningVis.


title: Higher-Order Mathematical Operational Semantics

abstract: Compositionality proofs in higher-order languages are notoriously involved, and general semantic frameworks guaranteeing compositionality are hard to come by. In particular, Turi and Plotkin's bialgebraic abstract GSOS framework, which provides off-the-shelf compositionality results for first-order languages, so far does not apply to higher-order languages. In the present work, we develop a theory of abstract GSOS specifications for higher-order languages, in effect transferring the core principles of Turi and Plotkin's framework to a higher-order setting. In our theory, the operational semantics of higher-order languages is represented by certain dinatural transformations that we term \emph{(pointed) higher-order GSOS laws}. We give a general compositionality result that applies to all systems specified in this way and discuss how compositionality of combinatory logics and the $\lambda$-calculus w.r.t.\ a strong variant of Abramsky's applicative bisimilarity are obtained as instances.


title: Spin-orbit coupling controlled two-dimensional magnetism in chromium trihalides

abstract: CrX$_3$ (X = Cl, Br, I) have the same crystal structure and Hamiltonian but different ligand spin-orbit coupling (SOC) constant $\lambda_X$, providing excellent material platform exploring for exotic two-dimensional (2D) spin orders. Their microscopic mechanism underlying 2D spin physics and Hamiltonian remain unestablished, along with experimental corroboration of Kitaev exchange interaction, central to realizing topological quantum spin liquids. We report Kitaev interaction signature in magnetic anisotropy measured by ferromagnetic resonance (FMR) spectroscopy. We present measured values of Heisenberg J, Kitaev K, and off-diagonal symmetric $\Gamma$ exchange interactions in CrX$_3$ determined using FMR and exact diagonalization. K and $\Gamma$ exhibit dominant quadratic dependencies on $\lambda_X$, indicating its central role in 2D magnetism. Our study provides foundation for exploring exotic 2D magnetic topologies by tuning intrinsic material parameters such as SOC.


title: REX: Designing User-centered Repair and Explanations to Address Robot Failures

abstract: Robots in real-world environments continuously engage with multiple users and encounter changes that lead to unexpected conflicts in fulfilling user requests. Recent technical advancements (e.g., large-language models (LLMs), program synthesis) offer various methods for automatically generating repair plans that address such conflicts. In this work, we understand how automated repair and explanations can be designed to improve user experience with robot failures through two user studies. In our first, online study ($n=162$), users expressed increased trust, satisfaction, and utility with the robot performing automated repair and explanations. However, we also identified risk factors -- safety, privacy, and complexity -- that require adaptive repair strategies. The second, in-person study ($n=24$) elucidated distinct repair and explanation strategies depending on the level of risk severity and type. Using a design-based approach, we explore automated repair with explanations as a solution for robots to handle conflicts and failures, complemented by adaptive strategies for risk factors. Finally, we discuss the implications of incorporating such strategies into robot designs to achieve seamless operation among changing user needs and environments.


title: The AI-DEC: A Card-based Design Method for User-centered AI Explanations

abstract: Increasing evidence suggests that many deployed AI systems do not sufficiently support end-user interaction and information needs. Engaging end-users in the design of these systems can reveal user needs and expectations, yet effective ways of engaging end-users in the AI explanation design remain under-explored. To address this gap, we developed a design method, called AI-DEC, that defines four dimensions of AI explanations that are critical for the integration of AI systems -- communication content, modality, frequency, and direction -- and offers design examples for end-users to design AI explanations that meet their needs. We evaluated this method through co-design sessions with workers in healthcare, finance, and management industries who regularly use AI systems in their daily work. Findings indicate that the AI-DEC effectively supported workers in designing explanations that accommodated diverse levels of performance and autonomy needs, which varied depending on the AI system's workplace role and worker values. We discuss the implications of using the AI-DEC for the user-centered design of AI explanations in real-world systems.


title: Zamba: A Compact 7B SSM Hybrid Model

abstract: In this technical report, we present Zamba, a novel 7B SSM-transformer hybrid model which achieves competitive performance against leading open-weight models at a comparable scale. Zamba is trained on 1T tokens from openly available datasets and is the best non-transformer model at this scale. Zamba pioneers a unique architecture combining a Mamba backbone with a single shared attention module, thus obtaining the benefits of attention at minimal parameter cost. Due to its architecture, Zamba is significantly faster at inference than comparable transformer models and requires substantially less memory for generation of long sequences. Zamba is pretrained in two phases: the first phase is based on existing web datasets, while the second one consists of annealing the model over high-quality instruct and synthetic datasets, and is characterized by a rapid learning rate decay. We open-source the weights and all checkpoints for Zamba, through both phase 1 and annealing phases.


title: Finding Maximum Common Contractions Between Phylogenetic Networks

abstract: In this paper, we lay the groundwork on the comparison of phylogenetic networks based on edge contractions and expansions as edit operations, as originally proposed by Robinson and Foulds to compare trees. We prove that these operations connect the space of all phylogenetic networks on the same set of leaves, even if we forbid contractions that create cycles. This allows to define an operational distance on this space, as the minimum number of contractions and expansions required to transform one network into another. We highlight the difference between this distance and the computation of the maximum common contraction between two networks. Given its ability to outline a common structure between them, which can provide valuable biological insights, we study the algorithmic aspects of the latter. We first prove that computing a maximum common contraction between two networks is NP-hard, even when the maximum degree, the size of the common contraction, or the number of leaves is bounded. We also provide lower bounds to the problem based on the Exponential-Time Hypothesis. Nonetheless, we do provide a polynomial-time algorithm for weakly-galled networks, a generalization of galled trees.


title: Crafting Interpretable Embeddings by Asking LLMs Questions

abstract: Large language models (LLMs) have rapidly improved text embeddings for a growing array of natural-language processing tasks. However, their opaqueness and proliferation into scientific domains such as neuroscience have created a growing need for interpretability. Here, we ask whether we can obtain interpretable embeddings through LLM prompting. We introduce question-answering embeddings (QA-Emb), embeddings where each feature represents an answer to a yes/no question asked to an LLM. Training QA-Emb reduces to selecting a set of underlying questions rather than learning model weights. We use QA-Emb to flexibly generate interpretable models for predicting fMRI voxel responses to language stimuli. QA-Emb significantly outperforms an established interpretable baseline, and does so while requiring very few questions. This paves the way towards building flexible feature spaces that can concretize and evaluate our understanding of semantic brain representations. We additionally find that QA-Emb can be effectively approximated with an efficient model, and we explore broader applications in simple NLP tasks.


title: Coil Reweighting to Suppress Motion Artifacts in Real-Time Exercise Cine Imaging

abstract: Background: Accelerated real-time cine (RT-Cine) imaging enables cardiac function assessment without the need for breath-holding. However, when performed during in-magnet exercise, RT-Cine images may exhibit significant motion artifacts. Methods: By projecting the time-averaged images to the subspace spanned by the coil sensitivity maps, we propose a coil reweighting (CR) method to automatically suppress a subset of receive coils that introduces a high level of artifacts in the reconstructed image. RT-Cine data collected at rest and during exercise from ten healthy volunteers and six patients were utilized to assess the performance of the proposed method. One short-axis and one two-chamber RT-Cine series reconstructed with and without CR from each subject were visually scored by two cardiologists in terms of the level of artifacts on a scale of 1 (worst) to 5 (best). Results: For healthy volunteers, applying CR to RT-Cine images collected at rest did not significantly change the image quality score (p=1). In contrast, for RT-Cine images collected during exercise, CR significantly improved the score from 3.9 to 4.68 (p<0.001). Similarly, in patients, CR did not significantly change the score for images collected at rest (p=0.031) but markedly improved the score from 3.15 to 4.42 (p<0.001) for images taken during exercise. Despite lower image quality scores in the patient cohort compared to healthy subjects, likely due to larger body habitus and the difficulty of limiting body motion during exercise, CR effectively suppressed motion artifacts, with all image series from the patient cohort receiving a score of four or higher. Conclusion: Using data from healthy subjects and patients, we demonstrate that the motion artifacts in the reconstructed RT-Cine images can be effectively suppressed significantly with the proposed CR method.


title: Adaptive Incentive Design with Learning Agents

abstract: How can the system operator learn an incentive mechanism that achieves social optimality based on limited information about the agents' behavior, who are dynamically updating their strategies? To answer this question, we propose an \emph{adaptive} incentive mechanism. This mechanism updates the incentives of agents based on the feedback of each agent's externality, evaluated as the difference between the player's marginal cost and society's marginal cost at each time step. The proposed mechanism updates the incentives on a slower timescale compared to the agents' learning dynamics, resulting in a two-timescale coupled dynamical system. Notably, this mechanism is agnostic to the specific learning dynamics used by agents to update their strategies. We show that any fixed point of this adaptive incentive mechanism corresponds to the optimal incentive mechanism, ensuring that the Nash equilibrium coincides with the socially optimal strategy. Additionally, we provide sufficient conditions that guarantee the convergence of the adaptive incentive mechanism to a fixed point. Our results apply to both atomic and non-atomic games. To demonstrate the effectiveness of our proposed mechanism, we verify the convergence conditions in two practically relevant games: atomic networked quadratic aggregative games and non-atomic network routing games.


title: Accurate and Fast Estimation of the Continuum Limit in Path Integral Simulations of Quantum Oscillators and Crystals

abstract: Convergence of path integral simulations requires a substantial number of beads when quantum effects are significant. Traditional Trotter scaling approaches estimate the continuum limit through extrapolation, however they are restricted to the asymptotic behavior near this limit. We introduce an efficient extrapolation approach for thermodynamic properties of quantum oscillators and crystals from primitive path integral simulations. The method utilizes a fitting function inspired by the analytic solution of the harmonic oscillator (HO), or the Einstein crystal for solids. The formulation is for first derivative properties, such as energy and pressure; however, extension to second derivative properties, such as elastic constants, is straightforward. We apply the method to a one-dimensional HO and anharmonic oscillator (AO), as well as a three-dimensional Lennard-Jones crystal. Configurations are sampled using path integral molecular dynamics simulations in the canonical ensemble, at a low temperature of $T=0.1$ (simulation units). Compared to Trotter extrapolation approaches, the new method demonstrates substantial accuracy in estimating the continuum limit, using only a few simulations of relatively smaller system sizes. This capability significantly reduces computational cost, providing a powerful tool to facilitate computations for more complex and challenging systems, such as molecules and real crystals.


title: Amortized Active Causal Induction with Deep Reinforcement Learning

abstract: We present Causal Amortized Active Structure Learning (CAASL), an active intervention design policy that can select interventions that are adaptive, real-time and that does not require access to the likelihood. This policy, an amortized network based on the transformer, is trained with reinforcement learning on a simulator of the design environment, and a reward function that measures how close the true causal graph is to a causal graph posterior inferred from the gathered data. On synthetic data and a single-cell gene expression simulator, we demonstrate empirically that the data acquired through our policy results in a better estimate of the underlying causal graph than alternative strategies. Our design policy successfully achieves amortized intervention design on the distribution of the training environment while also generalizing well to distribution shifts in test-time design environments. Further, our policy also demonstrates excellent zero-shot generalization to design environments with dimensionality higher than that during training, and to intervention types that it has not been trained on.


title: Alistair: Efficient On-device Budgeting for Differentially-Private Ad-Measurement Systems

abstract: With the impending removal of third-party cookies from major browsers and the introduction of new privacy-preserving advertising APIs, the research community has a timely opportunity to assist industry in qualitatively improving the Web's privacy. This paper discusses our efforts, within a W3C community group, to enhance existing privacy-preserving advertising measurement APIs. We analyze designs from Google, Apple, Meta and Mozilla, and augment them with a more rigorous and efficient differential privacy (DP) budgeting component. Our approach, called Alistair, enforces well-defined DP guarantees and enables advertisers to conduct more private measurement queries accurately. By framing the privacy guarantee in terms of an individual form of DP, we can make DP budgeting more efficient than in current systems that use a traditional DP definition. We incorporate Alistair into Chrome and evaluate it on microbenchmarks and advertising datasets. Across all workloads, Alistair significantly outperforms baselines in enabling more advertising measurements under comparable DP protection.


title: Large Scale Knowledge Washing

abstract: Large language models show impressive abilities in memorizing world knowledge, which leads to concerns regarding memorization of private information, toxic or sensitive knowledge, and copyrighted content. We introduce the problem of Large Scale Knowledge Washing, focusing on unlearning an extensive amount of factual knowledge. Previous unlearning methods usually define the reverse loss and update the model via backpropagation, which may affect the model's fluency and reasoning ability or even destroy the model due to extensive training with the reverse loss. Existing works introduce additional data from downstream tasks to prevent the model from losing capabilities, which requires downstream task awareness. Controlling the tradeoff of unlearning and maintaining existing capabilities is also challenging. To this end, we propose LAW (Large Scale Washing) to update the MLP layers in decoder-only large language models to perform knowledge washing, as inspired by model editing methods and based on the hypothesis that knowledge and reasoning are disentanglable. We derive a new objective with the knowledge to be unlearned to update the weights of certain MLP layers. Experimental results demonstrate the effectiveness of LAW in forgetting target knowledge while maintaining reasoning ability. The code will be open-sourced at https://github.com/wangyu-ustc/LargeScaleWashing.


title: A parabolic PDE-based approach to Borell--Brascamp--Lieb inequality

abstract: In this paper, we provide a new PDE proof for the celebrated Borell--Brascamp--Lieb inequality. Our approach reveals a deep connection between the Borell--Brascamp--Lieb inequality and properties of diffusion equations of porous medium type pertaining to the large time asymptotics and preservation of a generalized concavity of the solutions. We also recover the equality condition in the special case of the Pr\'ekopa--Leindler inequality by further exploiting known properties of the heat equation including the eventual log-concavity and backward uniqueness of solutions.


title: Observation of in-plane anomalous Hall effect associated with orbital magnetization

abstract: For over a century, the Hall effect, a transverse effect under out-of-plane magnetic field or magnetization, has been a cornerstone for magnetotransport studies and applications. Modern theoretical formulation based on the Berry curvature has revealed the potential that even in-plane magnetic field can induce anomalous Hall effect, but its experimental demonstration has remained difficult due to its potentially small magnitude and strict symmetry requirements. Here we report observation of the in-plane anomalous Hall effect by measuring low-carrier density films of magnetic Weyl semimetal EuCd$_2$Sb$_2$. Anomalous Hall resistance exhibits distinct three-fold rotational symmetry for changes in the in-plane field component, and this can be understood in terms of out-of-plane Weyl points splitting or orbital magnetization induced by in-plane field, as also confirmed by model calculation. Our findings demonstrate the importance of in-plane field to control the Hall effect, accelerating materials development and further exploration of various in-plane field induced phenomena.


title: On some values which do not belong to the image of Ramanujan's tau-function

abstract: Lehmer conjectured that Ramanujan's tau function never vanishes. As a variation of this conjecture, it is proved that \begin{equation*} \tau(n)\neq \pm \ell, \pm 2\ell, \pm 2\ell^2, \end{equation*} where $\ell<100$ is an odd prime, by Balakrishnan, Ono, Craig, Tsai and many people. We have proved that \begin{equation*} \tau(n)\neq \pm \ell, \pm 2\ell, \pm 4\ell, \pm 8\ell \end{equation*} for any $n\geq 1$ except 14 cases, where $\ell<1000$ is an odd prime.


title: Real-time detection and control of correlated charge tunneling in a quantum dot

abstract: The tunneling of interacting charges in nanostructures is a random and noisy process, which gives rise to a variety of intriguing physical phenomena, including Coulomb blockade, the Kondo effect, and Fermi-edge singularities. Such correlation effects are visible in low-frequency measurements of the electric current or the shot noise, however, they are also expected to leave clear fingerprints in the tunneling times of individual charges. Here, we experimentally demonstrate the real-time detection and control of correlated charge tunneling in a dynamically driven quantum dot. To this end, we measure the joint distribution of waiting times between tunneling charges, and we show that subsequent waiting times are strongly correlated due to the Coulomb interactions between the tunneling charges and the external periodic drive. Our measurements are in excellent agreement with a theoretical model that allows us to develop a detailed understanding of the correlated tunneling events. We also demonstrate that the degree of correlations can be controlled by the external drive. Our experiment paves the way for systematic real-time investigations of correlated electron transport in low-dimensional nanostructures with potential applications in metrology and sensing.


title: Discovery and follow-up of a quasiperiodically nulling and sub-pulse drifting pulsar with the Murchison Widefield Array

abstract: The phenomenon of pulsar nulling, where pulsars temporarily and stochastically cease their radio emission, is thought to be indicative of a `dying' pulsar, where radio emission ceases entirely. Here we report the discovery of a long-period pulsar, PSR J0452-3418, from the ongoing Southern-sky MWA Rapid Two-meter (SMART) pulsar survey. The pulsar has a rotation period of ${\sim}$1.67\,s and a dispersion measure of 19.8\,\dmu, and it exhibits both quasi-periodic nulling and sub-pulse drifting. Periodic nulling is uncommon, only reported in $<1$\% of the pulsar population, with even a smaller fraction showing periodic nulling and sub-pulse drifting. We describe the discovery and follow-up of the pulsar, including a positional determination using high-resolution imaging with the upgraded Giant Metrewave Radio Telescope (uGMRT), initial timing analysis using the combination of MWA and uGMRT data, and detailed characterisation of the nulling and drifting properties in the MWA's frequency band (140-170\,MHz). Our analysis suggests a nulling fraction of 34$\pm6$\% and a nulling periodicity of 42$^{+1.5}_{-1.3}$ pulses. We measure the phase ($P_2$) and time modulation ($P_3$) caused by the sub-pulse drifting, with an average $P_2$ of 7.1$^{+26.3}_{-3.1}$ degrees and a $P_3$ of 4.8$^{+1.5}_{-0.9}$ pulses. We compare and contrast the observed properties with those of other pulsars that exhibit sub-pulse drifting and quasi-periodic nulling phenomena, and find that the majority of these objects tend to be in the `death valley' in the period-period derivative ($P$-$\dot{P}$) diagram. We also discuss some broader implications for pulsar emission physics and the detectability of similar objects using next-generation pulsar surveys.


title: Exploring Edge Probability Graph Models Beyond Edge Independency: Concepts, Analyses, and Algorithms

abstract: Desirable random graph models (RGMs) should (i) be tractable so that we can compute and control graph statistics, and (ii) generate realistic structures such as high clustering (i.e., high subgraph densities). A popular category of RGMs (e.g., Erdos-Renyi and stochastic Kronecker) outputs edge probabilities, and we need to realize (i.e., sample from) the edge probabilities to generate graphs. Typically, each edge (in)existence is assumed to be determined independently. However, with edge independency, RGMs theoretically cannot produce high subgraph densities unless they "replicate" input graphs. In this work, we explore realization beyond edge independence that can produce more realistic structures while ensuring high tractability. Specifically, we propose edge-dependent realization schemes called binding and derive closed-form tractability results on subgraph (e.g., triangle) densities in graphs generated with binding. We propose algorithms for graph generation with binding and parameter fitting of binding. We empirically validate that binding exhibits high tractability and generates realistic graphs with high clustering, significantly improving upon existing RGMs assuming edge independency.


title: Disentangling and Integrating Relational and Sensory Information in Transformer Architectures

abstract: The Transformer architecture processes sequences by implementing a form of neural message-passing that consists of iterative information retrieval (attention), followed by local processing (position-wise MLP). Two types of information are essential under this general computational paradigm: "sensory" information about individual objects, and "relational" information describing the relationships between objects. Standard attention naturally encodes the former, but does not explicitly encode the latter. In this paper, we present an extension of Transformers where multi-head attention is augmented with two distinct types of attention heads, each routing information of a different type. The first type is the standard attention mechanism of Transformers, which captures object-level features, while the second type is a novel attention mechanism we propose to explicitly capture relational information. The two types of attention heads each possess different inductive biases, giving the resulting architecture greater efficiency and versatility. The promise of this approach is demonstrated empirically across a range of tasks.