title: Mixing is easy: New insights for cosmochemical evolution from pre-stellar core collapse

abstract: Signposts of early planet formation are ubiquitous in substructured young discs. Dense, hot and high-pressure regions formed during gravitational collapse process, integral to star formation, facilitate dynamical mixing of dust within the protostellar disc. This provides an incentive to constrain the role of gas-dust interaction and resolve zones of dust concentration during star-disc formation. We explore if thermal and dynamical conditions developed during disc formation can generate gas flows that efficiently mix and transport well-coupled gas and dust components. We simulated the collapse of dusty molecular cloud cores with the hydrodynamics code PLUTO augmented with radiation transport and self-gravity. We used a 2D axisymmetric geometry and follow the azimuthal component of velocity. Dust was treated as Lagrangian particles that are subject to drag from the gas, whose motion is computed on a Eulerian grid. We considered 1, 10 and 100 micron-sized neutral spherical dust. Importantly, the equation of state accurately includes molecular hydrogen dissociation. We focus on molecular cloud core masses of 1 and 3 Msun and explore effects of initial rotation rates and cloud core sizes. Our study underlines mechanisms for early transport of dust from inner hot disc regions via the occurrence of meridional flows and outflow. The vortical flow fosters dynamical mixing and retention of dust while thermal pressure driven outflow replenishes dust in the outer disc. Young dynamical precursors to planet-forming discs exhibit regions with complex hydrodynamical gas features and high-temperature structures. These can play a crucial role in concentrating dust for subsequent growth into protoplanets. Dust transport, especially, from sub-au scales surrounding the protostar to outer relatively cooler parts, offers an efficient pathway for thermal reprocessing during pre-stellar core collapse. [Abridged]


title: On the dynamical evolution of the asteroid belt in a massive star-neutron star binary

abstract: Some fast radio bursts (FRBs) exhibit repetitive behaviors and their origins remain enigmatic. It has been argued that repeating FRBs could be produced by the interaction between a neutron star and an asteroid belt. Here we consider the systems in which an asteroid belt dwells around a massive star, while a neutron star, as a companion of the massive star, interacts with the belt through gravitational force. Various orbital configurations are assumed for the system. Direct N-body simulations are performed to investigate the dynamical evolution of the asteroids belt. It is found that a larger orbital eccentricity of the neutron star will destroy the belt more quickly, with a large number of asteroids being scattered out of the system. A non-zero mutual inclination angle suppresses the ejection rate of asteroids, but it also leads to a reduction in the collision rate of asteroids with the neutron star since many asteroids are essentially scattered into the 3D space. Among the various configurations, a clear periodicity is observed in the collision events for the case with an orbital eccentricity of 0.7 and mutual inclination of $0^{\circ}$. It is found that such a periodicity can be sustained for at least 8 neutron star orbital periods, supporting this mechanism as a possible explanation for periodically repeating FRBs. Our studies also suggest that the active stage of these kinds of FRB sources should be limited, since the asteroid belt would finally be destroyed by the neutron star after multiple passages.


title: FedCCL: Federated Dual-Clustered Feature Contrast Under Domain Heterogeneity

abstract: Federated learning (FL) facilitates a privacy-preserving neural network training paradigm through collaboration between edge clients and a central server. One significant challenge is that the distributed data is not independently and identically distributed (non-IID), typically including both intra-domain and inter-domain heterogeneity. However, recent research is limited to simply using averaged signals as a form of regularization and only focusing on one aspect of these non-IID challenges. Given these limitations, this paper clarifies these two non-IID challenges and attempts to introduce cluster representation to address them from both local and global perspectives. Specifically, we propose a dual-clustered feature contrast-based FL framework with dual focuses. First, we employ clustering on the local representations of each client, aiming to capture intra-class information based on these local clusters at a high level of granularity. Then, we facilitate cross-client knowledge sharing by pulling the local representation closer to clusters shared by clients with similar semantics while pushing them away from clusters with dissimilar semantics. Second, since the sizes of local clusters belonging to the same class may differ for each client, we further utilize clustering on the global side and conduct averaging to create a consistent global signal for guiding each local training in a contrastive manner. Experimental results on multiple datasets demonstrate that our proposal achieves comparable or superior performance gain under intra-domain and inter-domain heterogeneity.


title: JaFIn: Japanese Financial Instruction Dataset

abstract: We construct an instruction dataset for the large language model (LLM) in the Japanese finance domain. Domain adaptation of language models, including LLMs, is receiving more attention as language models become more popular. This study demonstrates the effectiveness of domain adaptation through instruction tuning. To achieve this, we propose an instruction tuning data in Japanese called JaFIn, the Japanese Financial Instruction Dataset. JaFIn is manually constructed based on multiple data sources, including Japanese government websites, which provide extensive financial knowledge. We then utilize JaFIn to apply instruction tuning for several LLMs, demonstrating that our models specialized in finance have better domain adaptability than the original models. The financial-specialized LLMs created were evaluated using a quantitative Japanese financial benchmark and qualitative response comparisons, showing improved performance over the originals.


title: Formal integration of complete Rota-Baxter Lie algebras

abstract: In this paper, first we revisit the formal integration of Lie algebras, which give rise to braces in some special cases. Then we establish the formal integration theory for complete Rota-Baxter Lie algebras, that is, we show that there is a Rota-Baxter group with the underlying group structure given by the Baker-Campbell-Hausdorff formula, associated to any complete Rota-Baxter Lie algebra.


title: Quantized polarization in a generalized Rice-Mele model at arbitrary filling

abstract: We discuss the charge polarization in a generalized Rice-Mele model at arbitrary particle filling per site as a model of charge ordered systems in one dimension. The model possesses neither the conventional bond-centered inversion symmetry nor the one site translation symmetry alone, but has combinations of these symmetries. We show that the charge polarization in the ground state is quantized by the combined symmetry and is characterized solely by the filling. Especially, the polarization can be $1/2$ (mod 1) in the zero filling limit. Under the open boundary condition, there exist excess charges accumulated near edges of the system irrespective of existence or absence of edge modes. Correspondingly, we decompose the polarization into a bulk contribution and an edge contribution, and numerically demonstrate that the polarization is dominated by the former (latter) when the energy gap is large (small). We also discuss a simple generalization of our model and examine absence/existence of a gapless edge mode protected by the inversion symmetry by introducing intra unit cell and inter unit cell contributions of the charge polarization.


title: Task-Driven Exploration: Decoupling and Inter-Task Feedback for Joint Moment Retrieval and Highlight Detection

abstract: Video moment retrieval and highlight detection are two highly valuable tasks in video understanding, but until recently they have been jointly studied. Although existing studies have made impressive advancement recently, they predominantly follow the data-driven bottom-up paradigm. Such paradigm overlooks task-specific and inter-task effects, resulting in poor model performance. In this paper, we propose a novel task-driven top-down framework TaskWeave for joint moment retrieval and highlight detection. The framework introduces a task-decoupled unit to capture task-specific and common representations. To investigate the interplay between the two tasks, we propose an inter-task feedback mechanism, which transforms the results of one task as guiding masks to assist the other task. Different from existing methods, we present a task-dependent joint loss function to optimize the model. Comprehensive experiments and in-depth ablation studies on QVHighlights, TVSum, and Charades-STA datasets corroborate the effectiveness and flexibility of the proposed framework. Codes are available at https://github.com/EdenGabriel/TaskWeave.


title: A Reinforcement Learning Based Backfilling Strategy for HPC Batch Jobs

abstract: High Performance Computing (HPC) systems are used across a wide range of disciplines for both large and complex computations. HPC systems often receive many thousands of computational tasks at a time, colloquially referred to as jobs. These jobs must then be scheduled as optimally as possible so they can be completed within a reasonable timeframe. HPC scheduling systems often employ a technique called backfilling, wherein low-priority jobs are scheduled earlier to use the available resources that are waiting for the pending high-priority jobs. To make it work, backfilling largely relies on job runtime to calculate the start time of the ready-to-schedule jobs and avoid delaying them. It is a common belief that better estimations of job runtime will lead to better backfilling and more effective scheduling. However, our experiments show a different conclusion: there is a missing trade-off between prediction accuracy and backfilling opportunities. To learn how to achieve the best trade-off, we believe reinforcement learning (RL) can be effectively leveraged. Reinforcement Learning relies on an agent which makes decisions from observing the environment, and gains rewards or punishments based on the quality of its decision-making. Based on this idea, we designed RLBackfilling, a reinforcement learning-based backfilling algorithm. We show how RLBackfilling can learn effective backfilling strategies via trial-and-error on existing job traces. Our evaluation results show up to 59% better scheduling performance (based on average bounded job slowdown) compared to EASY backfilling using user-provided job runtime and 30% better performance compared with EASY using the ideal predicted job runtime (the actual job runtime).


title: Make Split, not Hijack: Preventing Feature-Space Hijacking Attacks in Split Learning

abstract: The popularity of Machine Learning (ML) makes the privacy of sensitive data more imperative than ever. Collaborative learning techniques like Split Learning (SL) aim to protect client data while enhancing ML processes. Though promising, SL has been proved to be vulnerable to a plethora of attacks, thus raising concerns about its effectiveness on data privacy. In this work, we introduce a hybrid approach combining SL and Function Secret Sharing (FSS) to ensure client data privacy. The client adds a random mask to the activation map before sending it to the servers. The servers cannot access the original function but instead work with shares generated using FSS. Consequently, during both forward and backward propagation, the servers cannot reconstruct the client's raw data from the activation map. Furthermore, through visual invertibility, we demonstrate that the server is incapable of reconstructing the raw image data from the activation map when using FSS. It enhances privacy by reducing privacy leakage compared to other SL-based approaches where the server can access client input information. Our approach also ensures security against feature space hijacking attack, protecting sensitive information from potential manipulation. Our protocols yield promising results, reducing communication overhead by over 2x and training time by over 7x compared to the same model with FSS, without any SL. Also, we show that our approach achieves >96% accuracy and remains equivalent to the plaintext models.


title: Multivariate confluent Vandermonde with G-Arnoldi and applications

abstract: In the least-squares fitting framework, the Vandermonde with Arnoldi (V+A) method presented in [Brubeck, Nakatsukasa, and Trefethen, SIAM Review, 63 (2021), pp. 405-415] is an effective approach to compute a polynomial that approximates an underlying univariate function f. Extensions of V+A include its multivariate version and the univariate confluent V+A; the latter enables us to use the information of the derivative of f in obtaining the approximation polynomial. In this paper, we shall extend V+A further to the multivariate confluent V+A. Besides the technical generalization of the univariate confluent V+A, we also introduce a general and application-dependent G-orthogonalization in the Arnoldi process. We shall demonstrate with several applications that, by specifying an application-related G-inner product, the desired approximate multivariate polynomial as well as its certain partial derivatives can be computed accurately from a well-conditioned least-squares problem whose coefficient matrix is orthonormal. The desired multivariate polynomial is represented in a discrete G-orthogonal polynomials basis which admits an explicit recurrence, and therefore, facilitates evaluating function values and certain partial derivatives at new nodes efficiently. We demonstrate its flexibility by applying it to solve the multivariate Hermite least-squares problem and PDEs with various boundary conditions in irregular domains.


title: Tangram: High-resolution Video Analytics on Serverless Platform with SLO-aware Batching

abstract: Cloud-edge collaborative computing paradigm is a promising solution to high-resolution video analytics systems. The key lies in reducing redundant data and managing fluctuating inference workloads effectively. Previous work has focused on extracting regions of interest (RoIs) from videos and transmitting them to the cloud for processing. However, a naive Infrastructure as a Service (IaaS) resource configuration falls short in handling highly fluctuating workloads, leading to violations of Service Level Objectives (SLOs) and inefficient resource utilization. Besides, these methods neglect the potential benefits of RoIs batching to leverage parallel processing. In this work, we introduce Tangram, an efficient serverless cloud-edge video analytics system fully optimized for both communication and computation. Tangram adaptively aligns the RoIs into patches and transmits them to the scheduler in the cloud. The system employs a unique ``stitching'' method to batch the patches with various sizes from the edge cameras. Additionally, we develop an online SLO-aware batching algorithm that judiciously determines the optimal invoking time of the serverless function. Experiments on our prototype reveal that Tangram can reduce bandwidth consumption and computation cost up to 74.30\% and 66.35\%, respectively, while maintaining SLO violations within 5\% and the accuracy loss negligible.


title: Combinatorial upper bounds for the smallest eigenvalue of a graph

abstract: Let $G$ be a graph, and let $\lambda(G)$ denote the smallest eigenvalue of $G$. First, we provide an upper bound for $\lambda(G)$ based on induced bipartite subgraphs of $G$. Consequently, we extract two other upper bounds, one relying on the average degrees of induced bipartite subgraphs and a more explicit one in terms of the chromatic number and the independence number of $G$. In particular, motivated by our bounds, we introduce two graph invariants that are of interest on their own. Finally, special attention goes to the investigation of the sharpness of our bounds in various classes of graphs as well as the comparison with an existing well-known upper bound.


title: PANet: A Physics-guided Parametric Augmentation Net for Image Dehazing by Hazing

abstract: Image dehazing faces challenges when dealing with hazy images in real-world scenarios. A huge domain gap between synthetic and real-world haze images degrades dehazing performance in practical settings. However, collecting real-world image datasets for training dehazing models is challenging since both hazy and clean pairs must be captured under the same conditions. In this paper, we propose a Physics-guided Parametric Augmentation Network (PANet) that generates photo-realistic hazy and clean training pairs to effectively enhance real-world dehazing performance. PANet comprises a Haze-to-Parameter Mapper (HPM) to project hazy images into a parameter space and a Parameter-to-Haze Mapper (PHM) to map the resampled haze parameters back to hazy images. In the parameter space, we can pixel-wisely resample individual haze parameter maps to generate diverse hazy images with physically-explainable haze conditions unseen in the training set. Our experimental results demonstrate that PANet can augment diverse realistic hazy images to enrich existing hazy image benchmarks so as to effectively boost the performances of state-of-the-art image dehazing models.


title: The Next Generation of MeV Energy X-ray Sources for use in the Inspection of Additively Manufactured Parts for Industry

abstract: For the first time, we demonstrate the application of an inverse Compton scattering X-ray Source, driven by a laser-plasma accelerator, to image an additively manufactured component. X-rays with a mean energy of 380 keV were produced and used to image an additively manufactured part made of an Inconel (Nickel 718) alloy. Because inverse Compton scattering driven by laser-plasma acceleration produces high-energy X-rays while maintaining a focal spot size on the order of a micron, the source can provide several benefits over conventional X-ray production methods, particularly when imaging superalloy parts, with the potential to revolutionise what can be inspected.


title: VRS-NeRF: Visual Relocalization with Sparse Neural Radiance Field

abstract: Visual relocalization is a key technique to autonomous driving, robotics, and virtual/augmented reality. After decades of explorations, absolute pose regression (APR), scene coordinate regression (SCR), and hierarchical methods (HMs) have become the most popular frameworks. However, in spite of high efficiency, APRs and SCRs have limited accuracy especially in large-scale outdoor scenes; HMs are accurate but need to store a large number of 2D descriptors for matching, resulting in poor efficiency. In this paper, we propose an efficient and accurate framework, called VRS-NeRF, for visual relocalization with sparse neural radiance field. Precisely, we introduce an explicit geometric map (EGM) for 3D map representation and an implicit learning map (ILM) for sparse patches rendering. In this localization process, EGP provides priors of spare 2D points and ILM utilizes these sparse points to render patches with sparse NeRFs for matching. This allows us to discard a large number of 2D descriptors so as to reduce the map size. Moreover, rendering patches only for useful points rather than all pixels in the whole image reduces the rendering time significantly. This framework inherits the accuracy of HMs and discards their low efficiency. Experiments on 7Scenes, CambridgeLandmarks, and Aachen datasets show that our method gives much better accuracy than APRs and SCRs, and close performance to HMs but is much more efficient.


title: Nontrivial solutions to the relative overdetermined torsion problem in a cylinder

abstract: Given a bounded regular domain $\omega \subset \mathbb{R}^{N-1}$ and the half-cylinder $\Sigma = \omega \times (0,+\infty)$, we consider the relative overdetermined torsion problem in $\Sigma$, i.e. \[\left\{ \begin{array}{ll} \Delta {u}+1=0 &\mbox{in $\Omega$},\newline \partial_\eta u = 0 &\mbox{on $\widetilde \Gamma_\Omega$},\newline u=0 &\mbox{on $\Gamma_\Omega$},\newline \partial_{\nu}u =c &\mbox{on $\Gamma_\Omega$}. \end{array} \right. \] where $\Omega \subset \Sigma$, $\Gamma_\Omega = \partial \Omega \cap \Sigma$, $\widetilde \Gamma_\Omega = \partial \Omega \setminus \Gamma_\Omega$, $\nu$ is the outer unit normal vector on $\Gamma_\Omega$ and $\eta$ is the outer unit normal vector on $\widetilde \Gamma_\Omega$. We build nontrivial solutions to this problem in domains $\Omega$ that are the hypograph of certain nonconstant functions $v : \overline{\omega} \to (0, + \infty)$. Such solutions can be reflected with respect to $\omega$, giving nontrivial solutions to the relative overdetermined torsion problem in a cylinder. The proof uses a local bifurcation argument which, quite remarkably, works for any generic base $\omega$.


title: STAR-FDTD : Space-time modulated acousto-optic guidestar in disordered media

abstract: We developed a 2D Finite-Difference Time-Domain (FDTD) method for modeling a space-time modulated guidestar targeting wavefront shaping applications in disordered media. Space-time modulation in general (a particular example being the acousto-optic effect) is used here as a guidestar for the transverse confinement of light around the tagged region surrounded by disorder. Together with the guidestar, the iterative optical phase conjugation (IOPC) method is used to overcome the diffusion of light due to multiple scattering. A phase sensitive lock-in detection technique is utilized to estimate the steady-state amplitude and phase of the modulated wavefronts emerging from the guidestar region continuously operating in the Raman-Nath regime. As the IOPC scheme naturally converges to the maximally transmitting eigenchannel profile, one could use the position of the guidestar within the disorder to channelize the maximal transmission through the tagged region. The associated code developed in MATLAB is provided as an open source (MIT license) package. The code package is referred by the acronym STAR-FDTD where STAR stands for Space-Time modulated Acousto-optic guidestaR.


title: Analysis of the CERN-NA63 radiation reaction data set, assuming the Rindler bath is composed of microscopic black holes

abstract: In this manuscript we examine the Unruh-thermalized CERN-NA63 radiation reaction data set from the point of view of a diphoton Rindler bath. Under the assumption that these Hawking-Unruh diphoton pairs are microscopic trans-Planckian black holes, we find the resultant heat capacity describes the measured energy spectrum and is thus a dual description of the data set. Then, employing an n-dimensional Stefan-Boltzmann analysis, we find the power radiated by a black hole in the standard 3+1 spacetime dimensions in complete agreement with the data. Finally, we utilize this power spectrum to directly measure Newtons constant of gravitation.


title: TrafficVLM: A Controllable Visual Language Model for Traffic Video Captioning

abstract: Traffic video description and analysis have received much attention recently due to the growing demand for efficient and reliable urban surveillance systems. Most existing methods only focus on locating traffic event segments, which severely lack descriptive details related to the behaviour and context of all the subjects of interest in the events. In this paper, we present TrafficVLM, a novel multi-modal dense video captioning model for vehicle ego camera view. TrafficVLM models traffic video events at different levels of analysis, both spatially and temporally, and generates long fine-grained descriptions for the vehicle and pedestrian at different phases of the event. We also propose a conditional component for TrafficVLM to control the generation outputs and a multi-task fine-tuning paradigm to enhance TrafficVLM's learning capability. Experiments show that TrafficVLM performs well on both vehicle and overhead camera views. Our solution achieved outstanding results in Track 2 of the AI City Challenge 2024, ranking us third in the challenge standings. Our code is publicly available at https://github.com/quangminhdinh/TrafficVLM.


title: Algorithm xxx: Faster Randomized SVD with Dynamic Shifts

abstract: Aiming to provide a faster and convenient truncated SVD algorithm for large sparse matrices from real applications (i.e. for computing a few of largest singular values and the corresponding singular vectors), a dynamically shifted power iteration technique is applied to improve the accuracy of the randomized SVD method. This results in a dynamic shifts based randomized SVD (dashSVD) algorithm, which also collaborates with the skills for handling sparse matrices. An accuracy-control mechanism is included in the dashSVD algorithm to approximately monitor the per vector error bound of computed singular vectors with negligible overhead. Experiments on real-world data validate that the dashSVD algorithm largely improves the accuracy of randomized SVD algorithm or attains same accuracy with fewer passes over the matrix, and provides an efficient accuracy-control mechanism to the randomized SVD computation, while demonstrating the advantages on runtime and parallel efficiency. A bound of the approximation error of the randomized SVD with the shifted power iteration is also proved.


title: SyntStereo2Real: Edge-Aware GAN for Remote Sensing Image-to-Image Translation while Maintaining Stereo Constraint

abstract: In the field of remote sensing, the scarcity of stereo-matched and particularly lack of accurate ground truth data often hinders the training of deep neural networks. The use of synthetically generated images as an alternative, alleviates this problem but suffers from the problem of domain generalization. Unifying the capabilities of image-to-image translation and stereo-matching presents an effective solution to address the issue of domain generalization. Current methods involve combining two networks, an unpaired image-to-image translation network and a stereo-matching network, while jointly optimizing them. We propose an edge-aware GAN-based network that effectively tackles both tasks simultaneously. We obtain edge maps of input images from the Sobel operator and use it as an additional input to the encoder in the generator to enforce geometric consistency during translation. We additionally include a warping loss calculated from the translated images to maintain the stereo consistency. We demonstrate that our model produces qualitatively and quantitatively superior results than existing models, and its applicability extends to diverse domains, including autonomous driving.


title: Upper Bound of Barrow Entropy Index from Black Hole Fragmentation

abstract: Both classical and quantum arguments suggest that if Barrow entropy is correct, its index $\delta$ must be energy dependent, which would affect the very early universe. Based on thermodynamic stability that sufficiently large black holes should not fragment, we argue that Barrow entropy correction must be small except possibly at the Planckian regime. Furthermore, the fact that a solar mass black hole does not fragment implies an upper bound $\delta \lesssim O(10^{-3})$, which surprisingly lies in the same range as the bound obtained from some cosmological considerations assuming fixed $\delta$. This indicates that allowing $\delta$ to run does not raise its allowed value. We briefly comment on the case of Kaniadakis entropy.


title: Optimal Control of a Markovian Qubit with Unitary Control

abstract: We study a single Markovian qubit governed by a Lindblad master equation and subject to fast unitary control. Using reduced control systems and optimal control theory we determine (i) controls for cooling and heating such systems in a time-optimal way as well as (ii) the set of stabilizable states in the Bloch ball. No restrictions on the Lindblad equation are assumed, and several known results, for instance for the Bloch equations, are recovered. Furthermore we introduce integral systems, for which the solutions take a particularly nice form. These integral systems include all systems with real Lindblad terms as well as all coolable systems. The method allows for intuitive visualizations and is mostly analytical, making use of only basic numerical methods.


title: Improved Optimization for the Neural-network Quantum States and Tests on the Chromium Dimer

abstract: The advent of Neural-network Quantum States (NQS) has significantly advanced wave function ansatz research, sparking a resurgence in orbital space variational Monte Carlo (VMC) exploration. This work introduces three algorithmic enhancements to reduce computational demands of VMC optimization using NQS: an adaptive learning rate algorithm, constrained optimization, and block optimization. We evaluate the refined algorithm on complex multireference bond stretches of $\rm H_2O$ and $\rm N_2$ within the cc-pVDZ basis set and calculate the ground-state energy of the strongly correlated chromium dimer ($\rm Cr_2$) in the Ahlrichs SV basis set. Our results achieve superior accuracy compared to coupled cluster theory at a relatively modest CPU cost. This work demonstrates how to enhance optimization efficiency and robustness using these strategies, opening a new path to optimize large-scale Restricted Boltzmann Machine (RBM)-based NQS more effectively and marking a substantial advancement in NQS's practical quantum chemistry applications.


title: Applying an electrostatic cross-correlation to the CFTR-ATP interaction

abstract: The cystic fibrosis transmembrane conductance regulator (CFTR) is an important membrane protein in vertebrates. The function of CFTR is to transport chloride ions across the cell membrane, which is known to require adenosine triphosphate (ATP). Whereas most conventional wisdom suggests that ATP interacts with CFTR purely through random collisions via diffusion, we investigate electrostatic interactions between CFTR and ATP at the mesoscale (10s of Angstroms). We use molecular dynamics to simulate CFTR-ATP interactions in cases where CFTR is bound/unbound from ATP, and we demonstrate an electrostatic potential gradient towards CFTR when ATP is unbound. We additionally compute electrostatic interactions between ATP and the solvent and membrane, which are simulated explicitly.


title: A Model Predictive Control Scheme for Flight Scheduling and Energy Management of Electric Aviation Networks

abstract: This paper presents a Model Predictive Control (MPC) scheme for flight scheduling and energy management of electric aviation networks, where electric aircraft transport passengers between electrified airports equipped with sustainable energy sources and battery storage, with the goal of minimizing grid dependency. Specifically, we first model the aircraft flight and charge scheduling problem jointly with the airport energy management problem, explicitly accounting for local weather forecasts. Second, we frame the minimum-grid-energy operational problem as a mixed-integer linear program and solve it in a receding horizon fashion, where the route assignment and charging decisions of each aircraft can be dynamically reassigned to mitigate disruptions. We showcase the proposed MPC scheme on real-world data taken from conventional flights and weather conditions in the Dutch Leeward Antilles. Our results show that MPC can effectively guarantee operation of the network by efficiently re-assigning flights and rescheduling aircraft charging, whilst maximizing the efficiency of the on-site energy systems.


title: Pairs of knot invariants

abstract: Let $\alpha$ be a map from the set of all knot types ${\mathcal K}$ to a set $X$. Let $\beta$ be a map from ${\mathcal K}$ to a set $Y$. We define the relation between $\alpha$ and $\beta$ to be the image of a map $(\alpha,\beta)$ from ${\mathcal K}$ to $X\times Y$ sending an element $K$ of ${\mathcal K}$ to $(\alpha(K),\beta(K))$. We determine the relations between $\alpha$ and $\beta$ for certain $\alpha$ and $\beta$ such as crossing number, unknotting number, bridge number, braid index, genus and canonical genus.


title: Deriving a GENERIC system from a Hamiltonian system

abstract: We reconsider the fundamental problem of coarse-graining infinite-dimensional Hamiltonian dynamics to obtain a macroscopic system which includes dissipative mechanisms. In particular, we study the thermodynamical implications concerning Hamiltonians, energy, and entropy and the induced geometric structures such as Poisson and Onsager brackets (symplectic and dissipative brackets). We start from a general finite-dimensional Hamiltonian system that is coupled linearly to an infinite-dimensional heat bath with linear dynamics. The latter is assumed to admit a compression to a finite-dimensional dissipative semigroup (i.e., the heat bath is a dilation of the semigroup) describing the dissipative evolution of new macroscopic variables. Already in the finite-energy case (zero-temperature heat bath) we obtain the so-called GENERIC structure (General Equations for Non-Equilibrium Reversible Irreversibe Coupling), with conserved energy, nondecreasing entropy, a new Poisson structure, and an Onsager operator describing the dissipation. However, their origin is not obvious at this stage. After extending the system in a natural way to the case of positive temperature, giving a heat bath with infinite energy, the compression property leads to an exact multivariate Ornstein-Uhlenbeck process that drives the rest of the system. Thus, we are able to identify a conserved energy, an entropy, and an Onsager operator (involving the Green-Kubo formalism) which indeed provide a GENERIC structure for the macroscopic system.


title: Egret: Reinforcement Mechanism for Sequential Computation Offloading in Edge Computing

abstract: As an emerging computing paradigm, edge computing offers computing resources closer to the data sources, helping to improve the service quality of many real-time applications. A crucial problem is designing a rational pricing mechanism to maximize the revenue of the edge computing service provider (ECSP). However, prior works have considerable limitations: clients are static and are required to disclose their preferences, which is impractical in reality. However, previous works assume user privacy information to be known or consider the number of users in edge scenarios to be static. To address this issue, we propose a novel sequential computation offloading mechanism, where the ECSP posts prices of computing resources with different configurations to clients in turn. Clients independently choose which computing resources to purchase and how to offload based on their prices. Then Egret, a deep reinforcement learning-based approach that achieves maximum revenue, is proposed. Egret determines the optimal price and visiting orders online without considering clients' preferences. Experimental results show that the revenue of ECSP in Egret is only 1.29\% lower than Oracle and 23.43\% better than the state-of-the-art when the client arrives dynamically.


title: Artificial Intelligence enhanced Security Problems in Real-Time Scenario using Blowfish Algorithm

abstract: In a nutshell, "the cloud" refers to a collection of interconnected computing resources made possible by an extensive, real-time communication network like the internet. Because of its potential to reduce processing costs, the emerging paradigm of cloud computing has recently attracted a large number of academics. The exponential expansion of cloud computing has made the rapid expansion of cloud services very remarkable. Ensuring the security of personal information in today's interconnected world is no easy task. These days, security is really crucial. Models of security that are relevant to cloud computing include confidentiality, authenticity, accessibility, data integrity, and recovery. Using the Hybrid Encryption this study, we cover all the security issues and leaks in cloud infrastructure.


title: On the Condensation and fluctuations in reversible coagulation-fragmentation models

abstract: We study the condensation phenomenon for the invariant measures of the mean-field model of reversible coagulation-fragmentation processes conditioned to a supercritical density of particles. It is shown that when the parameters of the associated balance equation satisfy a subexponential tail condition, there is one single giant particle that corresponds to the missing mass in the macroscopic limit. We also show that in this case, the rest of the particles are asymptotically \emph{i.i.d.} according to the normalized equilibrium state of the limit hydrodynamic differential equation. Conditions for the normal fluctuations and the $\alpha$-stable fluctuations around the condensed mass are given. We obtain the large deviation principle for the empirical measure of the masses of the particles at equilibrium as well.


title: New Class of Ciphers Using Hardware Entropy Source

abstract: We present a novel, computationally simple method of hiding any message in the stream of random bits by using a secret key. The method is called Bury Among Random Numbers (BARN). A stream of random bits is produced by extracting the entropy of a physical process in a hardware-based true random number generator (TRNG). The process of placing bits of a message into the stream of random bits is governed by the number of random bits skipped between subsequent insertions. The set of numbers that correspond to the steps of BARN is derived from a random number also provided by TRNG. Hence BARN cipher does not depend on any arithmetic function. We propose an effective method of computing random keys from a given number of random bits. We estimate the number of permutations that need to be tested during a brute-force attack on the new cipher for various key lengths. Some practical applications for the new class of symmetrical ciphers are discussed.


title: Hitting time of connectedness in the random hypercube process

abstract: We present a short and self-contained proof of a classical result due to Bollob\'as (1990): in the random hypercube process, with high probability the hitting time of connectedness equals the hitting time of having minimum degree at least one.


title: RoofDiffusion: Constructing Roofs from Severely Corrupted Point Data via Diffusion

abstract: Accurate completion and denoising of roof height maps are crucial to reconstructing high-quality 3D buildings. Repairing sparse points can enhance low-cost sensor use and reduce UAV flight overlap. RoofDiffusion is a new end-to-end self-supervised diffusion technique for robustly completing, in particular difficult, roof height maps. RoofDiffusion leverages widely-available curated footprints and can so handle up to 99\% point sparsity and 80\% roof area occlusion (regional incompleteness). A variant, No-FP RoofDiffusion, simultaneously predicts building footprints and heights. Both quantitatively outperform state-of-the-art unguided depth completion and representative inpainting methods for Digital Elevation Models (DEM), on both a roof-specific benchmark and the BuildingNet dataset. Qualitative assessments show the effectiveness of RoofDiffusion for datasets with real-world scans including AHN3, Dales3D, and USGS 3DEP LiDAR. Tested with the leading City3D algorithm, preprocessing height maps with RoofDiffusion noticeably improves 3D building reconstruction. RoofDiffusion is complemented by a new dataset of 13k complex roof geometries, focusing on long-tail issues in remote sensing; a novel simulation of tree occlusion; and a wide variety of large-area roof cut-outs for data augmentation and benchmarking.


title: Green and Kubo forge the arrow of time

abstract: Transport theory describes the response of a macroscopic current to a thermodynamic force, thus producing entropy and apparently violating time-reversal symmetry. In this note I report a pedagogical derivation of the Green-Kubo formula for transport coefficients that highlights the intrinsically dynamical nature of this formula and showcases the relation between the apparent breach of time-reversal symmetry and the non-commutativity of the low-frequency / low-wavevector limits of the conserved-density susceptibilities, from which the formula can be established.


title: Bridging Data Islands: Geographic Heterogeneity-Aware Federated Learning for Collaborative Remote Sensing Semantic Segmentation

abstract: Remote sensing semantic segmentation (RSS) is an essential task in Earth Observation missions. Due to data privacy concerns, high-quality remote sensing images with annotations cannot be well shared among institutions, making it difficult to fully utilize RSS data to train a generalized model. Federated Learning (FL), a privacy-preserving collaborative learning technology, is a potential solution. However, the current research on how to effectively apply FL in RSS is still scarce and requires further investigation. Remote sensing images in various institutions often exhibit strong geographical heterogeneity. More specifically, it is reflected in terms of class-distribution heterogeneity and object-appearance heterogeneity. Unfortunately, most existing FL studies show inadequate focus on geographical heterogeneity, thus leading to performance degradation in the global model. Considering the aforementioned issues, we propose a novel Geographic Heterogeneity-Aware Federated Learning (GeoFed) framework to address privacy-preserving RSS. Through Global Feature Extension and Tail Regeneration modules, class-distribution heterogeneity is alleviated. Additionally, we design an Essential Feature Mining strategy to alleviate object-appearance heterogeneity by constructing essential features. Extensive experiments on three datasets (i.e., FBP, CASID, Inria) show that our GeoFed consistently outperforms the current state-of-the-art methods. The code will be available publicly.


title: A Novel State Space Model with Local Enhancement and State Sharing for Image Fusion

abstract: In image fusion tasks, images from different sources possess distinct characteristics. This has driven the development of numerous methods to explore better ways of fusing them while preserving their respective characteristics. Mamba, as a state space model, has emerged in the field of natural language processing. Recently, many studies have attempted to extend Mamba to vision tasks. However, due to the nature of images different from casual language sequences, the limited state capacity of Mamba weakens its ability to model image information. Additionally, the sequence modeling ability of Mamba is only capable of spatial information and cannot effectively capture the rich spectral information in images. Motivated by these challenges, we customize and improve the vision Mamba network designed for the image fusion task. Specifically, we propose the local-enhanced vision Mamba block, dubbed as LEVM. The LEVM block can improve local information perception of the network and simultaneously learn local and global spatial information. Furthermore, we propose the state sharing technique to enhance spatial details and integrate spatial and spectral information. Finally, the overall network is a multi-scale structure based on vision Mamba, called LE-Mamba. Extensive experiments show the proposed methods achieve state-of-the-art results on multispectral pansharpening and multispectral and hyperspectral image fusion datasets, and demonstrate the effectiveness of the proposed approach. Code will be made available.


title: Miscibility of Binary Bose-Einstein Condensates with $p$-wave Interaction

abstract: We investigate the ground-state phase diagram of a binary mixture of Bose-Einstein condensates (BECs) with competing interspecies $s$- and $p$-wave interactions. Exploiting a pseudopotential model for the $l=1$ partial wave, we derive an extended Gross-Pitaevskii (GP) equation for the BEC mixture that incorporates both $s$- and $p$-wave interactions. Based on it, we study the miscible-immiscible transition of a binary BEC mixture in the presence of interspecies $p$-wave interaction, by combining numerical solution of the GP equation and Gaussian variational analysis. Our study uncovers a dual effect -- either enhance or reduce miscibility -- of positive interspecies $p$-wave interaction, which can be precisely controlled by adjusting relevant experimental parameters. By complete characterizing the miscibility phase diagram, we establish a promising avenue towards experimental control of the miscibility of binary BEC mixtures via high partial-wave interactions.


title: Estimates for trilinear and quadrilinear character sums

abstract: We obtain new bounds on some trilinear and quadrilinear character sums, which are non-trivial starting from very short ranges of the variables. An application to an apparently new problem on oscillations of characters on differences between Farey fractions is given. Other applications include a modular analogue of a multiplicative hybrid problem of Iwaniec and S\'ark\"ozy (1987) and the solvability of some prime type equations with constraints.


title: Cross-Data Knowledge Graph Construction for LLM-enabled Educational Question-Answering System: A~Case~Study~at~HCMUT

abstract: In today's rapidly evolving landscape of Artificial Intelligence, large language models (LLMs) have emerged as a vibrant research topic. LLMs find applications in various fields and contribute significantly. Despite their powerful language capabilities, similar to pre-trained language models (PLMs), LLMs still face challenges in remembering events, incorporating new information, and addressing domain-specific issues or hallucinations. To overcome these limitations, researchers have proposed Retrieval-Augmented Generation (RAG) techniques, some others have proposed the integration of LLMs with Knowledge Graphs (KGs) to provide factual context, thereby improving performance and delivering more accurate feedback to user queries. Education plays a crucial role in human development and progress. With the technology transformation, traditional education is being replaced by digital or blended education. Therefore, educational data in the digital environment is increasing day by day. Data in higher education institutions are diverse, comprising various sources such as unstructured/structured text, relational databases, web/app-based API access, etc. Constructing a Knowledge Graph from these cross-data sources is not a simple task. This article proposes a method for automatically constructing a Knowledge Graph from multiple data sources and discusses some initial applications (experimental trials) of KG in conjunction with LLMs for question-answering tasks.


title: Belief Bias Identification

abstract: This paper proposes a unified theoretical model to identify and test a comprehensive set of probabilistic updating biases within a single framework. The model achieves separate identification by focusing on the updating of belief distributions, rather than classic point-belief measurements. Testing the model in a laboratory experiment reveals significant heterogeneity at the individual level: All tested biases are present, and each participant exhibits at least one identifiable bias. Notably, motivated-belief biases (optimism and pessimism) and sequence-related biases (gambler's fallacy and hot hand fallacy) are identified as key drivers of biased inference. Moreover, at the population level, base rate neglect emerges as a persistent influence. This study contributes to the belief-updating literature by providing a methodological toolkit for researchers examining links between different conflicting biases, or exploring connections between updating biases and other behavioural phenomena.


title: Large Segmentation Design of Robust Photonic Quantum Gates

abstract: We analyze the fidelity and power loss of photonic quantum gates, implemented by a segmentation of coupled optical waveguides, as functions of the number of segments. We show that designs with a large number of segments mitigate effectively the systematic errors for a wide range of error correlation strength and variance. We quantify the design roughness effect on the power loss and analyze the performance of various methods for smoothing the configuration of the waveguides. We observe an asymptotic scaling behaviour of the gate fidelity and power loss with the number of segments.


title: Reap the Wild Wind: Detecting Media Storms in Large-Scale News Corpora

abstract: Media Storms, dramatic outbursts of attention to a story, are central components of media dynamics and the attention landscape. Despite their significance, there has been little systematic and empirical research on this concept due to issues of measurement and operationalization. We introduce an iterative human-in-the-loop method to identify media storms in a large-scale corpus of news articles. The text is first transformed into signals of dispersion based on several textual characteristics. In each iteration, we apply unsupervised anomaly detection to these signals; each anomaly is then validated by an expert to confirm the presence of a storm, and those results are then used to tune the anomaly detection in the next iteration. We demonstrate the applicability of this method in two scenarios: first, supplementing an initial list of media storms within a specific time frame; and second, detecting media storms in new time periods. We make available a media storm dataset compiled using both scenarios. Both the method and dataset offer the basis for comprehensive empirical research into the concept of media storms, including characterizing them and predicting their outbursts and durations, in mainstream media or social media platforms.


title: Analysis of a finite element DtN method for scattering resonances of sound hard obstacles

abstract: Scattering resonances have important applications in many areas of science and engineering. They are the replacement of discrete spectral data for problems on non-compact domains. In this paper, we consider the computation of scattering resonances defined on the exterior to a compact sound hard obstacle. The resonances are the eigenvalues of a holomorphic Fredholm operator function. We truncate the unbounded domain and impose the Dirichlet-to-Neumann (DtN) mapping. The problem is then discretized using the linear Lagrange element. Convergence of the resonances is proved using the abstract approximation theory for holomorphic Fredholm operator functions. The discretization leads to nonlinear algebraic eigenvalue problems, which are solved by the recently developed parallel spectral indicator methods. Numerical examples are presented for validation.


title: A Simple Strategy for Body Estimation from Partial-View Images

abstract: Virtual try-on and product personalization have become increasingly important in modern online shopping, highlighting the need for accurate body measurement estimation. Although previous research has advanced in estimating 3D body shapes from RGB images, the task is inherently ambiguous as the observed scale of human subjects in the images depends on two unknown factors: capture distance and body dimensions. This ambiguity is particularly pronounced in partial-view scenarios. To address this challenge, we propose a modular and simple height normalization solution. This solution relocates the subject skeleton to the desired position, thereby normalizing the scale and disentangling the relationship between the two variables. Our experimental results demonstrate that integrating this technique into state-of-the-art human mesh reconstruction models significantly enhances partial body measurement estimation. Additionally, we illustrate the applicability of this approach to multi-view settings, showcasing its versatility.


title: High Significant Fault Detection in Azure Core Workload Insights

abstract: Azure Core workload insights have time-series data with different metric units. Faults or Anomalies are observed in these time-series data owing to faults observed with respect to metric name, resources region, dimensions, and its dimension value associated with the data. For Azure Core, an important task is to highlight faults or anomalies to the user on a dashboard that they can perceive easily. The number of anomalies reported should be highly significant and in a limited number, e.g., 5-20 anomalies reported per hour. The reported anomalies will have significant user perception and high reconstruction error in any time-series forecasting model. Hence, our task is to automatically identify 'high significant anomalies' and their associated information for user perception.


title: Sinestesia as a model for HCI: a Systematic Review

abstract: Synesthesia, conceived as a neuropsychological condition, may prove valuable in studying the interaction between humans and machines by analyzing the co-occurrence of sensory or cognitive responses triggered by a stimulus. In our approach, synesthesia is elevated beyond a mere perceptual-cognitive anomaly, offering insights into the reciprocal interaction between humans and the digital system, steering novel experimental design and enriching results interpretations.This review broadens the traditional scope, conventionally rooted in neuroscience and psychology, by considering how computer science can approach this condition. The interdisciplinary examination revolves around two primary viewpoints: one associating this condition with specific cognitive, perceptual, and behavioral anomalies, and the other acknowledging it as a prevalent human experience. Synesthesia, in this review, emerges as a significant model for Human Computer Interaction (HCI). The exploration of this specific condition aims to decipher how atypical pathways of perception and cognition can be encoded, empowering machines to actively engage in processing information from both the body and the environment. The authors attempt to amalgamate findings and insights from various disciplines, fostering collaboration between computer science, neuroscience, psychology, and philosophy.The overarching objective is to construct a comprehensive framework that elucidates how synesthesia and anomalies in information processing can be harnessed within HCI, with a particular emphasis on contributing to digital technologies for medical research and enhancing patients care and comfort. In this sense, the review endeavors also to fill the gap between theoretical understanding and practical application.


title: Monte Carlo Search Algorithms Discovering Monte Carlo Tree Search Exploration Terms

abstract: Monte Carlo Tree Search and Monte Carlo Search have good results for many combinatorial problems. In this paper we propose to use Monte Carlo Search to design mathematical expressions that are used as exploration terms for Monte Carlo Tree Search algorithms. The optimized Monte Carlo Tree Search algorithms are PUCT and SHUSS. We automatically design the PUCT and the SHUSS root exploration terms. For small search budgets of 32 evaluations the discovered root exploration terms make both algorithms competitive with usual PUCT.


title: OWLOOP: Interfaces for Mapping OWL Axioms into OOP Hierarchies

abstract: The paper tackles the issue of mapping logic axioms formalised in the Ontology Web Language (OWL) within the Object-Oriented Programming (OOP) paradigm. The issues of mapping OWL axioms hierarchies and OOP objects hierarchies are due to OWL-based reasoning algorithms, which might change an OWL hierarchy at runtime; instead, OOP hierarchies are usually defined as static structures. Although programming paradigms based on reflection allow changing the OOP hierarchies at runtime and mapping OWL axioms dynamically, there are no currently available mechanisms that do not limit the reasoning algorithms. Thus, the factory-based paradigm is typically used since it decouples the OWL and OOP hierarchies. However, the factory inhibits OOP polymorphism and introduces a paradigm shift with respect to widely accepted OOP paradigms. We present the OWLOOP API, which exploits the factory to not limit reasoning algorithms, and it provides novel OOP interfaces concerning the axioms in an ontology. OWLOOP is designed to limit the paradigm shift required for using ontologies while improving, through OOP-like polymorphism, the modularity of software architectures that exploit logic reasoning. The paper details our OWL to OOP mapping mechanism, and it shows the benefits and limitations of OWLOOP through examples concerning a robot in a smart environment.


title: Minimax Optimal rates of convergence in the shuffled regression, unlinked regression, and deconvolution under vanishing noise

abstract: Shuffled regression and unlinked regression represent intriguing challenges that have garnered considerable attention in many fields, including but not limited to ecological regression, multi-target tracking problems, image denoising, etc. However, a notable gap exists in the existing literature, particularly in vanishing noise, i.e., how the rate of estimation of the underlying signal scales with the error variance. This paper aims to bridge this gap by delving into the monotone function estimation problem under vanishing noise variance, i.e., we allow the error variance to go to $0$ as the number of observations increases. Our investigation reveals that, asymptotically, the shuffled regression problem exhibits a comparatively simpler nature than the unlinked regression; if the error variance is smaller than a threshold, then the minimax risk of the shuffled regression is smaller than that of the unlinked regression. On the other hand, the minimax estimation error is of the same order in the two problems if the noise level is larger than that threshold. Our analysis is quite general in that we do not assume any smoothness of the underlying monotone link function. Because these problems are related to deconvolution, we also provide bounds for deconvolution in a similar context. Through this exploration, we contribute to understanding the intricate relationships between these statistical problems and shed light on their behaviors when subjected to the nuanced constraint of vanishing noise.


title: Cost-effective company response policy for product co-creation in company-sponsored online community

abstract: Product co-creation based on company-sponsored online community has come to be a paradigm of developing new products collaboratively with customers. In such a product co-creation campaign, the sponsoring company needs to interact intensively with active community members about the design scheme of the product. We call the collection of the rates of the company's response to active community members at all time in the co-creation campaign as a company response policy (CRP). This paper addresses the problem of finding a cost-effective CRP (the CRP problem). First, we introduce a novel community state evolutionary model and, thereby, establish an optimal control model for the CRP problem (the CRP model). Second, based on the optimality system for the CRP model, we present an iterative algorithm for solving the CRP model (the CRP algorithm). Thirdly, through extensive numerical experiments, we conclude that the CRP algorithm converges and the resulting CRP exhibits excellent cost benefit. Consequently, we recommend the resulting CRP to companies that embrace product co-creation. Next, we discuss how to implement the resulting CRP. Finally, we investigate the effect of some factors on the cost benefit of the resulting CRP. To our knowledge, this work is the first attempt to study value co-creation through optimal control theoretic approach.


title: In My Perspective, In My Hands: Accurate Egocentric 2D Hand Pose and Action Recognition

abstract: Action recognition is essential for egocentric video understanding, allowing automatic and continuous monitoring of Activities of Daily Living (ADLs) without user effort. Existing literature focuses on 3D hand pose input, which requires computationally intensive depth estimation networks or wearing an uncomfortable depth sensor. In contrast, there has been insufficient research in understanding 2D hand pose for egocentric action recognition, despite the availability of user-friendly smart glasses in the market capable of capturing a single RGB image. Our study aims to fill this research gap by exploring the field of 2D hand pose estimation for egocentric action recognition, making two contributions. Firstly, we introduce two novel approaches for 2D hand pose estimation, namely EffHandNet for single-hand estimation and EffHandEgoNet, tailored for an egocentric perspective, capturing interactions between hands and objects. Both methods outperform state-of-the-art models on H2O and FPHA public benchmarks. Secondly, we present a robust action recognition architecture from 2D hand and object poses. This method incorporates EffHandEgoNet, and a transformer-based action recognition method. Evaluated on H2O and FPHA datasets, our architecture has a faster inference time and achieves an accuracy of 91.32% and 94.43%, respectively, surpassing state of the art, including 3D-based methods. Our work demonstrates that using 2D skeletal data is a robust approach for egocentric action understanding. Extensive evaluation and ablation studies show the impact of the hand pose estimation approach, and how each input affects the overall performance.


title: Julia as a universal platform for statistical software development

abstract: Like Python and Java, which are integrated into Stata, Julia is a free programming language that runs on all major operating systems. The julia package links Stata to Julia as well. Users can transfer data between Stata and Julia at high speed, issue Julia commands from Stata to analyze and plot, and pass results back to Stata. Julia's econometric software ecosystem is not as mature as Stata's or R's, or even Python's. But Julia is an excellent environment for developing high-performance numerical applications, which can then be called from many platforms. The boottest program for wild bootstrap-based inference (Roodman et al. 2019) can call a Julia back end for a 33-50% speed-up, even as the R package fwildclusterboot (Fischer and Roodman 2021) uses the same back end for inference after instrumental variables estimation. reghdfejl mimics reghdfe (Correia 2016) in fitting linear models with high-dimensional fixed effects but calls an independently developed Julia package for tenfold acceleration on hard problems. reghdfejl also supports nonlinear models--preliminarily, as the Julia package for that purpose matures.


title: pp-waves in conformal Killing gravity

abstract: Recently Harada has proposed a gravitational theory which is of third order in the derivatives of the metric tensor. This has attracted some attention particularly as it predicts a late-time transition from cosmological decelaration to accelerated expansion without assuming the presence of dark energy or a non-zero cosmological constant. This theory has been dubbed conformal Killing gravity by Mantica & Molinari. The most general exact solutions of the Harada field equations are known for a number of important physical situations: homogeneous and isotropic cosmological models, static spherically symmetric vacuum and electrovac spacetimes. These are analogues of the well-known FRWL, Schwarzschild and Reissner-Nordstr\"om metrics of General Relativity(GR). In this study the pp-waves in Harada's theory are studied and the most general exact solution is obtained together with its specialisation for plane waves. The generalisation from GR to Harada's theory turns out to be straightforward and the solutions only involve an extra non-propagating term. The solutions have Petrov type N (or 0) and the Ricci tensor is either zero or the Segr\'e type is [(211)] with zero eigenvalue. For any metric in conformal Killing gravity it is shown that more than one possible matter source can generate the solution. If the metric admits one or more Killing vectors, the ambiguity in the possible matter sources increases.


title: A nodal based high order nonlinear stabilization for finite element approximation of Magnetohydrodynamics

abstract: We present a novel high-order nodal artificial viscosity approach designed for solving Magnetohydrodynamics (MHD) equations. Unlike conventional methods, our approach eliminates the need for ad hoc parameters. The viscosity is mesh-dependent, yet explicit definition of the mesh size is unnecessary. Our method employs a multimesh strategy: the viscosity coefficient is constructed from a linear polynomial space constructed on the fine mesh, corresponding to the nodal values of the finite element approximation space. The residual of MHD is utilized to introduce high-order viscosity in a localized fashion near shocks and discontinuities. This approach is designed to precisely capture and resolve shocks. Then, high-order Runge-Kutta methods are employed to discretize the temporal domain. Through a comprehensive set of challenging test problems, we validate the robustness and high-order accuracy of our proposed approach for solving MHD equations.


title: Exclusive-or encoded algebraic structure for efficient quantum dynamics

abstract: We propose a formalism that captures the algebraic structure of many-body two-level quantum systems, and directly motivates an efficient numerical method. This formalism is based on the binary representation of the enumeration-indices of the elements of the corresponding Lie algebra. The action of arbitrarily large elements of that algebra reduces to a few bit-wise exclusive-or operations. This formalism naturally produces sparse representations of many-body density operators, the size of which we control through a dynamic truncation method. We demonstrate how this formalism applies to real-time evolution, dissipative Lindblad action, imaginary-time evolution, and projective measurement processes. We find that this approach to calculating quantum dynamics scales close to linearly with the number of non-zero components in the density operator. We refer to this exclusive-or represented quantum algebra as ORQA. As a proof of concept, we provide a numerical demonstration of this formalism by simulating quantum annealing processes for the maximum independent set problem for up to 22 two-level systems.


title: Text-to-Song: Towards Controllable Music Generation Incorporating Vocals and Accompaniment

abstract: A song is a combination of singing voice and accompaniment. However, existing works focus on singing voice synthesis and music generation independently. Little attention was paid to explore song synthesis. In this work, we propose a novel task called text-to-song synthesis which incorporating both vocals and accompaniments generation. We develop Melodist, a two-stage text-to-song method that consists of singing voice synthesis (SVS) and vocal-to-accompaniment (V2A) synthesis. Melodist leverages tri-tower contrastive pretraining to learn more effective text representation for controllable V2A synthesis. A Chinese song dataset mined from a music website is built up to alleviate data scarcity for our research. The evaluation results on our dataset demonstrate that Melodist can synthesize songs with comparable quality and style consistency. Audio samples can be found in https://text2songMelodist.github.io/Sample/.


title: Modular data of non-semisimple modular categories

abstract: We investigate non-semisimple modular categories with an eye towards a structure theory, low-rank classification, and applications to low dimensional topology and topological physics. We aim to extend the well-understood theory of semisimple modular categories to the non-semisimple case by using representations of factorizable ribbon Hopf algebras as a case study. We focus on the Cohen-Westreich modular data, which is obtained from the Lyubashenko-Majid modular representation restricted to the Higman ideal of a factorizable ribbon Hopf algebra. The Cohen-Westreich $S$-matrix diagonalizes the mixed fusion rules and reduces to the usual $S$-matrix for semisimple modular categories. The paper includes detailed studies on small quantum groups $U_qsl(2)$ and the Drinfeld doubles of Nichols Hopf algebras, especially the $\mathrm{SL}(2, \mathbb{Z})$-representation on their centers, Cohen-Westreich modular data, and the congruence kernel theorem's validity.


title: Binary bi-braces and applications to cryptography

abstract: In a XOR-based alternating block cipher the plaintext is masked by a sequence of layers each performing distinct actions: a highly nonlinear permutation, a linear transformation, and the bitwise key addition. When assessing resistance against classical differential attacks (where differences are computed with respect to XOR), the cryptanalysts must only take into account differential probabilities introduced by the nonlinear layer, this being the only one whose differential transitions are not deterministic. The temptation of computing differentials with respect to another difference operation runs into the difficulty of understanding how differentials propagate through the XOR-affine levels of the cipher. In this paper we introduce a special family of braces that enable the derivation of a set of differences whose interaction with every layer of an XOR-based alternating block cipher can be understood. We show that such braces can be described also in terms of alternating binary algebras of nilpotency class two. Additionally, we present a method to compute the automorphism group of these structures through an equivalence between bilinear maps. By doing so, we characterise the XOR-linear permutations for which the differential transitions with respect to the new difference are deterministic, facilitating an alternative differential attack.


title: Numerical Discretization Methods for the Extended Linear Quadratic Control Problem

abstract: In this study, we introduce numerical methods for discretizing continuous-time linear-quadratic optimal control problems (LQ-OCPs). The discretization of continuous-time LQ-OCPs is formulated into differential equation systems, and we can obtain the discrete equivalent by solving these systems. We present the ordinary differential equation (ODE), matrix exponential, and a novel step-doubling method for the discretization of LQ-OCPs. Utilizing Euler-Maruyama discretization with a fine step, we reformulate the costs of continuous-time stochastic LQ-OCPs into a quadratic form, and show that the stochastic cost follows the $\chi^2$ distribution. In the numerical experiment, we test and compare the proposed numerical methods. The results ensure that the discrete-time LQ-OCP derived using the proposed numerical methods is equivalent to the original problem.


title: Characterizing Soft-Error Resiliency in Arm's Ethos-U55 Embedded Machine Learning Accelerator

abstract: As Neural Processing Units (NPU) or accelerators are increasingly deployed in a variety of applications including safety critical applications such as autonomous vehicle, and medical imaging, it is critical to understand the fault-tolerance nature of the NPUs. We present a reliability study of Arm's Ethos-U55, an important industrial-scale NPU being utilised in embedded and IoT applications. We perform large scale RTL-level fault injections to characterize Ethos-U55 against the Automotive Safety Integrity Level D (ASIL-D) resiliency standard commonly used for safety-critical applications such as autonomous vehicles. We show that, under soft errors, all four configurations of the NPU fall short of the required level of resiliency for a variety of neural networks running on the NPU. We show that it is possible to meet the ASIL-D level resiliency without resorting to conventional strategies like Dual Core Lock Step (DCLS) that has an area overhead of 100%. We achieve so through selective protection, where hardware structures are selectively protected (e.g., duplicated, hardened) based on their sensitivity to soft errors and their silicon areas. To identify the optimal configuration that minimizes the area overhead while meeting the ASIL-D standard, the main challenge is the large search space associated with the time-consuming RTL simulation. To address this challenge, we present a statistical analysis tool that is validated against Arm silicon and that allows us to quickly navigate hundreds of billions of fault sites without exhaustive RTL fault injections. We show that by carefully duplicating a small fraction of the functional blocks and hardening the Flops in other blocks meets the ASIL-D safety standard while introducing an area overhead of only 38%.


title: Unraveling stochastic fundamental diagrams considering empirical knowledge: modeling, limitation and further discussion

abstract: Traffic flow modeling relies heavily on fundamental diagrams. However, deterministic fundamental diagrams, such as single or multi-regime models, cannot capture the uncertainty pattern that underlies traffic flow. To address this limitation, a sparse non-parametric regression model is proposed in this paper to formulate the stochastic fundamental diagram. Unlike parametric stochastic fundamental diagram models, a non-parametric model is insensitive to parameters, flexible, and applicable. The computation complexity and the huge memory required for training in the Gaussian process regression have been reduced by introducing the sparse Gaussian process regression. The paper also discusses how empirical knowledge influences the modeling process. The paper analyzes the influence of modeling empirical knowledge in the prior of the stochastic fundamental diagram model and whether empirical knowledge can improve the robustness and accuracy of the proposed model. By introducing several well-known single-regime fundamental diagram models as the prior and testing the model's robustness and accuracy with different sampling methods given real-world data, the authors find that empirical knowledge can only benefit the model under small inducing samples given a relatively clean and large dataset. A pure data-driven approach is sufficient to estimate and describe the pattern of the density-speed relationship.


title: Impact of curved elements for flows over orography with a Discontinuous Galerkin scheme

abstract: We present a quantitative assessment of the impact of high-order mappings on the simulation of flows over complex orography. Curved boundaries were not used in earlier numerical methods, whereas they are employed nowadays to an increasing extent in combination with high-order methods, such as the Finite Element Method (FEM) and the Spectral Element Method (SEM). We consider here a specific Discontinuous Galerkin (DG) method implemented in the framework of the deal.II library, which natively supports high-order mappings. A number of numerical experiments based on classical benchmarks over idealized orographic profiles demonstrate the positive impact of curved boundaries on the accuracy of the results. These findings are also supported by results of the application of this approach to non-smooth and realistic orographic profiles.


title: MPC Based Linear Equivalence with Control Barrier Functions for VTOL-UAVs

abstract: In this work, we propose a cascaded scheme of linear Model prediction Control (MPC) based on Control Barrier Functions (CBF) with Dynamic Feedback Linearization (DFL) for Vertical Take-off and Landing (VTOL) Unmanned Aerial Vehicles (UAVs). CBF is a tool that allows enforcement of forward invariance of a set using Lyapunov-like functions to ensure safety. The First control synthesis that employed CBF was based on Quadratic Program (QP) that modifies the existing controller to satisfy the safety requirements. However, the CBF-QP-based controllers leading to longer detours and undesirable transient performance. Recent contributions utilize the framework of MPC benefiting from the prediction capabilities and constraints imposed on the state and control inputs. Due to the intrinsic nonlinearities of the dynamics of robotics systems, all the existing MPC-CBF solutions rely on nonlinear MPC formulations or operate on less accurate linear models. In contrast, our novel solution unlocks the benefits of linear MPC-CBF while considering the full underactuated dynamics without any linear approximations. The cascaded scheme converts the problem of safe VTOL-UAV navigation to a Quadratic Constraint Quadratic Programming (QCQP) problem solved efficiently by off-the-shelf solvers. The closed-loop stability and recursive feasibility is proved along with numerical simulations showing the effective and robust solutions. Keywords: Unmanned Aerial Vehicles, Vertical Take-off and Landing, Model Predictive Control, MPC, Nonlinearity, Dynamic Feedback Linearization, Optimal Control.


title: Clarification of the transverse orbital angular momentum of spatiotemporal optical vortices

abstract: Advances in the generation and the application of spatiotemporal optical vortices (STOV) are proceeding fast, but fundamental aspects of their nature remain obscure. Phys. Rev. A 107, L031501 (2023) (PRA) and Prog. Electromagn. Res. 177, 95 (2023) (PIER) provide contradictory results on the transverse orbital angular momentum (OAM) carried by STOVs. We show that the results by Porras in PIER and by Bliokh in PRA refer to different STOVs and are all correct. In PIER, STOVs are elliptical at given cross section and time, or in space-time, but not in three-dimensional space. In PRA, STOVs are elliptical in space but not in space-time. This is evidenced from two dual, equivalent theories on the transverse OAM where a wave packet is seen in space-time evolving with propagation distance or in space evolving in time, that accounts for all values of the total, intrinsic and extrinsic OAM in PIERS and PRA. However, the intrinsic OAM with respect to the photon wave function center in PRA is not generally conserved, which advocates for the energy center in PIER as the STOV center. We argue that STOVs are generated in experiments to purportedly have elliptical symmetry in space-time. The values provided in PIER should then be taken as the reference for elliptical STOVs, and the theory therein to evaluate the transverse OAM of other wave packets. Hancock et al. in Phys. Rev. Lett. 127, 193901 (2021) and Phys. Rev. X. 14, 011031 (2024) erroneously attribute the transverse OAM of elliptical STOVs in space to the elliptical STOVs in space-time they consider theoretically and can generate in their experiments.


title: The intelligent prediction and assessment of financial information risk in the cloud computing model

abstract: Cloud computing (cloud computing) is a kind of distributed computing, referring to the network "cloud" will be a huge data calculation and processing program into countless small programs, and then, through the system composed of multiple servers to process and analyze these small programs to get the results and return to the user. This report explores the intersection of cloud computing and financial information processing, identifying risks and challenges faced by financial institutions in adopting cloud technology. It discusses the need for intelligent solutions to enhance data processing efficiency and accuracy while addressing security and privacy concerns. Drawing on regulatory frameworks, the report proposes policy recommendations to mitigate concentration risks associated with cloud computing in the financial industry. By combining intelligent forecasting and evaluation technologies with cloud computing models, the study aims to provide effective solutions for financial data processing and management, facilitating the industry's transition towards digital transformation.


title: Incremental data compression for PDE-constrained optimization with a data assimilation application

abstract: This paper proposes and analyzes an inexact gradient method based on incremental proper orthogonal decomposition (iPOD) to address the data storage difficulty in time-dependent PDE-constrained optimization, particularly for a data assimilation problem as a detailed demonstration for the key ideas. The proposed method is proved robust by rigorous analysis. We first derive a sharp data compression error estimate of the iPOD with the help of Hilbert-Schmidt operators. Then we demonstrate a numerical PDE analysis to show how to properly choose Hilbert space for the iPOD data compression so that the gradient error is under control. We further prove that for a convex problem with appropriately bounded gradient error, the inexact gradient method achieves the accuracy level of the optimal solution while not hurting the convergence rate compared with the usual gradient method. Finally, numerical experiments are provided to verify the theoretical results and validate the proposed method.


abstract: We investigate multi-agent imitation learning (IL) within the framework of mean field games (MFGs), considering the presence of time-varying correlated signals. Existing MFG IL algorithms assume demonstrations are sampled from Mean Field Nash Equilibria (MFNE), limiting their adaptability to real-world scenarios. For example, in the traffic network equilibrium influenced by public routing recommendations, recommendations introduce time-varying correlated signals into the game, not captured by MFNE and other existing correlated equilibrium concepts. To address this gap, we propose Adaptive Mean Field Correlated Equilibrium (AMFCE), a general equilibrium incorporating time-varying correlated signals. We establish the existence of AMFCE under mild conditions and prove that MFNE is a subclass of AMFCE. We further propose Correlated Mean Field Imitation Learning (CMFIL), a novel IL framework designed to recover the AMFCE, accompanied by a theoretical guarantee on the quality of the recovered policy. Experimental results, including a real-world traffic flow prediction problem, demonstrate the superiority of CMFIL over state-of-the-art IL baselines, highlighting the potential of CMFIL in understanding large population behavior under correlated signals.


title: Exceptionally High Two-Photon Absorption in Diazaacene-Bithiophene Derivatives: A Combined Experimental and Theoretical Approach

abstract: This study delves into the enhancement of two-photon absorption (2PA) properties in diazaacene-bithiophene derivatives through a synergistic approach combining theoretical analysis and experimental validation. By investigating the structural modifications and their impact on 2PA cross sections, we identify key factors that significantly influence the 2PA efficiency. For all molecular systems studied, our state-of-the-art quantum chemical calculations show a very high involvement of the first excited singlet state (S1) in the 2PA processes into higher excited states, even if this state itself has only a small 2PA cross section for symmetry reasons. Consequently, both the oscillator strength of S1 and the transition dipole moments between S1 and other excited states are of importance, underscoring the role of electronic polarizability in facilitating effective two-photon interactions. The investigated compounds exhibit large 2PA cross sections over a wide near-infrared spectral range reaching giant values of 42000 GM. The introduction of diazine and diazaacene moieties into bithiophene derivatives not only induces charge transfer but also opens up pathways for the creation of materials with tailored nonlinear optical responses, suggesting potential applications in nonlinear optics.


title: Weight Copy and Low-Rank Adaptation for Few-Shot Distillation of Vision Transformers

abstract: Few-shot knowledge distillation recently emerged as a viable approach to harness the knowledge of large-scale pre-trained models, using limited data and computational resources. In this paper, we propose a novel few-shot feature distillation approach for vision transformers. Our approach is based on two key steps. Leveraging the fact that vision transformers have a consistent depth-wise structure, we first copy the weights from intermittent layers of existing pre-trained vision transformers (teachers) into shallower architectures (students), where the intermittence factor controls the complexity of the student transformer with respect to its teacher. Next, we employ an enhanced version of Low-Rank Adaptation (LoRA) to distill knowledge into the student in a few-shot scenario, aiming to recover the information processing carried out by the skipped teacher layers. We present comprehensive experiments with supervised and self-supervised transformers as teachers, on five data sets from various domains, including natural, medical and satellite images. The empirical results confirm the superiority of our approach over competitive baselines. Moreover, the ablation results demonstrate the usefulness of each component of the proposed pipeline.


title: Measurement-Induced Heating of Trapped Ions

abstract: We experimentally study the heating of trapped atomic ions during measurement of their internal qubit states. During measurement, ions are projected into one of two basis states and discriminated by their state-dependent fluorescence. We observe that ions in the fluorescing state rapidly scatter photons and heat at a rate of $\dot{\bar{n}}\sim 2\times 10^4$ quanta/s, which is $\sim 30$ times faster than the anomalous ion heating rate. We introduce a quantum trajectory-based framework that accurately reproduces the experimental results and provides a unified description of ion heating for both continuous and discrete sources.


title: Existence and regularity results for space-time fractional integro-differential equation of Kirchhoff type with memory

abstract: This paper analyses a Kirchhoff type quasilinear space-time fractional integro-differential equation with memory $(\mathcal{K}^{s}_{\alpha})$. Various a priori bounds are derived in different norms on the solution of the considered equation. Utilizing these a priori bounds, existence and uniqueness of the weak solution to the proposed model are proved. Furthermore, regularity results on the solution of $(\mathcal{K}^{s}_{\alpha})$ are established. The contribution made in this work provides a framework for further investigation of such types of partial integro-differential equation $(\mathcal{K}^{s}_{\alpha})$.


title: Large Language Models are as persuasive as humans, but how? About the cognitive effort and moral-emotional language of LLM arguments

abstract: Large Language Models (LLMs) are already as persuasive as humans. However, we know very little about how they do it. This paper investigates the persuasion strategies of LLMs, comparing them with human-generated arguments. Using a dataset of 1,251 participants in an experiment, we analyze the persuasion strategies of LLM-generated and human-generated arguments using measures of cognitive effort (lexical and grammatical complexity) and moral-emotional language (sentiment and moral analysis). The study reveals that LLMs produce arguments that require higher cognitive effort, exhibiting more complex grammatical and lexical structures than human counterparts. Additionally, LLMs demonstrate a significant propensity to engage more deeply with moral language, utilizing both positive and negative moral foundations more frequently than humans. In contrast with previous research, no significant difference was found in the emotional content produced by LLMs and humans. These findings contribute to the discourse on AI and persuasion, highlighting the dual potential of LLMs to both enhance and undermine informational integrity through communication strategies for digital persuasion.


title: A universal strategy for decoupling stiffness and extensibility of polymer networks

abstract: Since the invention of polymer networks in the 19th century (e.g., crosslinked natural rubber by Goodyear), it has been a dogma that stiffer networks are less stretchable, a trade-off inherent to the molecular nature of polymer network strands. Here, we report a universal strategy for decoupling the stiffness and extensibility of single-network elastomers. Instead of using linear polymers as network strands, we use foldable bottlebrush polymers, which feature a collapsed backbone grafted with many linear side chains. Upon elongation, the collapsed backbone unfolds to release stored length, enabling remarkable extensibility. By contrast, the network elastic modulus is inversely proportional to the network strand mass and is determined by the side chains. We validate this concept by creating a series of unentangled single-network elastomers with nearly constant Young's modulus (30 kPa) while increasing tensile breaking strain by 40-fold, from 20% to 800%. We show that this strategy applies to networks of different polymer species and topologies. Our discovery opens an avenue for developing polymer networks with extraordinary mechanical properties.


title: SNN4Agents: A Framework for Developing Energy-Efficient Embodied Spiking Neural Networks for Autonomous Agents

abstract: Recent trends have shown that autonomous agents, such as Autonomous Ground Vehicles (AGVs), Unmanned Aerial Vehicles (UAVs), and mobile robots, effectively improve human productivity in solving diverse tasks. However, since these agents are typically powered by portable batteries, they require extremely low power/energy consumption to operate in a long lifespan. To solve this challenge, neuromorphic computing has emerged as a promising solution, where bio-inspired Spiking Neural Networks (SNNs) use spikes from event-based cameras or data conversion pre-processing to perform sparse computations efficiently. However, the studies of SNN deployments for autonomous agents are still at an early stage. Hence, the optimization stages for enabling efficient embodied SNN deployments for autonomous agents have not been defined systematically. Toward this, we propose a novel framework called SNN4Agents that consists of a set of optimization techniques for designing energy-efficient embodied SNNs targeting autonomous agent applications. Our SNN4Agents employs weight quantization, timestep reduction, and attention window reduction to jointly improve the energy efficiency, reduce the memory footprint, optimize the processing latency, while maintaining high accuracy. In the evaluation, we investigate use cases of event-based car recognition, and explore the trade-offs among accuracy, latency, memory, and energy consumption. The experimental results show that our proposed framework can maintain high accuracy (i.e., 84.12% accuracy) with 68.75% memory saving, 3.58x speed-up, and 4.03x energy efficiency improvement as compared to the state-of-the-art work for NCARS dataset. In this manner, our SNN4Agents framework paves the way toward enabling energy-efficient embodied SNN deployments for autonomous agents.


title: A generalized Liouville equation and magnetic stability

abstract: This work considers two related families of nonlinear and nonlocal problems in the plane $\R^2$. The first main result derives the general integrable solution to a generalized Liouville equation using the Wronskian of two coprime complex polynomials. The second main result concerns an application to a generalized Ladyzhenskaya--Gagliardo--Nirenberg interpolation inequality, with a single real parameter $\beta$ interpreted as the strength of a magnetic self-interaction. The optimal constant of the inequality and the corresponding minimizers of the quotient are studied and it is proved that for $\beta \ge 2$, for which the constant equals $2\pi\beta$, such minimizers only exist at quantized $\beta \in 2\N$ corresponding to nonlinear generalizations of Landau levels with densities solving the generalized Liouville equation. This latter problem originates from the study of self-dual vortex solitons in the abelian Chern--Simons--Higgs theory and from the average-field-Pauli effective theory of anyons, i.e.\ quantum particles with statistics intermediate to bosons and fermions. An immediate application is given to Keller--Lieb--Thirring stability bounds for a gas of such anyons which self-interact magnetically (vector nonlocal repulsion) as well as electrostatically (scalar local/point attraction), thus generalizing the stability theory of the 2D cubic nonlinear Schr\"odinger equation.


title: Small deviation for the mutual intersection local time of Brownian motions

abstract: In this note, we establish the bounds \[ c\varepsilon^{\frac23}\le P\bigg\{\int_0^1\!\!\int_0^1\delta_0(B_s-\tilde{B}_r)dsdr\le \varepsilon \bigg\} \le C \varepsilon^{\frac23},\] for the mutual intersection local time of two independent 1-dimensional Brownian motions $B$ and $\tilde B$.


title: Human Vs. Machines: Who Wins In Semiconductor Market Forecasting?

abstract: "If you ask ten experts, you will get ten different opinions." This common proverb illustrates the common association of expert forecasts with personal bias and lack of consistency. On the other hand, digitization promises consistency and explainability through data-driven forecasts employing machine learning (ML) and statistical models. In the following, we compare such forecasts to expert forecasts from the World Semiconductor Trade Statistics (WSTS), a leading semiconductor market data provider.


title: Asymptotics of Bergman polynomials for domains with reflection-invariant corners

abstract: We study the asymptotic behavior of the Bergman orthogonal polynomials $(p_n)_{n=0}^{\infty}$ for a class of bounded simply connected domains $D$. The class is defined by the requirement that conformal maps $\varphi$ of $D$ onto the unit disk extend analytically across the boundary $L$ of $D$, and that $\varphi'$ has a finite number of zeros $z_1,\ldots, z_q$ on $L$. The boundary $L$ is then piecewise analytic with corners at the zeros of $\varphi'$. A result of Stylianopoulos implies that a Carleman-type strong asymptotic formula for $p_n$ holds on the exterior domain $\mathbb{C}\setminus\overline{D}$. We prove that the same formula remains valid across $L\setminus\{z_1,\ldots,z_q\}$ and on a maximal open subset of $D$. As a consequence, the only boundary points that attract zeros of $p_n$ are the corners. This is in stark contrast to the case when $\varphi$ fails to admit an analytic extension past $L$, since when this happens the zero counting measure of $p_n$ is known to approach the equilibrium measure for $L$ along suitable subsequences.


title: Self-Selected Attention Span for Accelerating Large Language Model Inference

abstract: Large language models (LLMs) can solve challenging tasks. However, their inference computation on modern GPUs is highly inefficient due to the increasing number of tokens they must attend to as they generate new ones. To address this inefficiency, we capitalize on LLMs' problem-solving capabilities to optimize their own inference-time efficiency. We demonstrate with two specific tasks: (a) evaluating complex arithmetic expressions and (b) summarizing news articles. For both tasks, we create custom datasets to fine-tune an LLM. The goal of fine-tuning is twofold: first, to make the LLM learn to solve the evaluation or summarization task, and second, to train it to identify the minimal attention spans required for each step of the task. As a result, the fine-tuned model is able to convert these self-identified minimal attention spans into sparse attention masks on-the-fly during inference. We develop a custom CUDA kernel to take advantage of the reduced context to attend to. We demonstrate that using this custom CUDA kernel improves the throughput of LLM inference by 28%. Our work presents an end-to-end demonstration showing that training LLMs to self-select their attention spans speeds up autoregressive inference in solving real-world tasks.


title: Every subcubic graph is packing $(1,1,2,2,3)$-colorable

abstract: For a sequence $S=(s_1, \ldots, s_k)$ of non-decreasing integers, a packing $S$-coloring of a graph $G$ is a partition of its vertex set $V(G)$ into $V_1, \ldots, V_k$ such that for every pair of distinct vertices $u,v \in V_i$, where $1 \le i \le k$, the distance between $u$ and $v$ is at least $s_i+1$. The packing chromatic number, $\chi_p(G)$, of a graph $G$ is the smallest integer $k$ such that $G$ has a packing $(1,2, \ldots, k)$-coloring. Gastineau and Togni asked an open question ``Is it true that the $1$-subdivision ($D(G)$) of any subcubic graph $G$ has packing chromatic number at most $5$?'' and later Bre\v{s}ar, Klav\v{z}ar, Rall, and Wash conjectured that it is true. In this paper, we prove that every subcubic graph has a packing $(1,1,2,2,3)$-coloring and it is sharp due to the existence of subcubic graphs that are not packing $(1,1,2,2)$-colorable. As a corollary of our result, $\chi_p(D(G)) \le 6$ for every subcubic graph $G$, improving a previous bound ($8$) due to Balogh, Kostochka, and Liu in 2019, and we are now just one step away from fully solving the conjecture.


title: Entropy Guided Extrapolative Decoding to Improve Factuality in Large Language Models

abstract: Large language models (LLMs) exhibit impressive natural language capabilities but suffer from hallucination -- generating content ungrounded in the realities of training data. Recent work has focused on decoding techniques to improve factuality during inference by leveraging LLMs' hierarchical representation of factual knowledge, manipulating the predicted distributions at inference time. Current state-of-the-art approaches refine decoding by contrasting early-exit distributions from a lower layer with the final layer to exploit information related to factuality within the model forward procedure. However, such methods often assume the final layer is the most reliable and the lower layer selection process depends on it. In this work, we first propose extrapolation of critical token probabilities beyond the last layer for more accurate contrasting. We additionally employ layer-wise entropy-guided lower layer selection, decoupling the selection process from the final layer. Experiments demonstrate strong performance - surpassing state-of-the-art on multiple different datasets by large margins. Analyses show different kinds of prompts respond to different selection strategies.