title: Quantum gravity inspired nonlocal quantum dynamics preserving the classical limit

abstract: Several approaches to quantum gravity lead to nonlocal modifications of fields' dynamics. This, in turn, can give rise to nonlocal modifications of quantum mechanics at non-relativistic energies. Here, we analyze the nonlocal Schr\"{o}dinger evolution of a quantum harmonic oscillator in one such scenario, where the problem can be addressed without the use of perturbation theory. We demonstrate that although deviations from standard quantum predictions occur at low occupation numbers, where they could potentially be detected or constrained by high-precision experiments, the classical limits of quantum probability densities and free energy remain unaffected up to energies comparable with the nonlocality scale. These results provide an example of nonlocal quantum dynamics compatible with classical predictions, suggesting massive quantum objects as a promising avenue for testing some phenomenological aspects of quantum gravity.


title: On Energy of Graphs with Self-Loops

abstract: Let G be a simple graph on n vertices with vertex set V(G). The energy of G, denoted by, $\mathcal{E}(G)$ is the sum of all absolute values of the eigenvalues of the adjacency matrix $A(G)$. It is the first eigenvalue-based topological molecular index and is related to the molecular orbital energy levels of ${\pi}$-electrons in conjugated hydrocarbons. Recently, the concept of energy of a graph is extended to a self-loop graph. Let $S$ be a subset of $V(G)$. The graph $G_S$ is obtained from the graph $G$ by attaching a self-loop at each of the vertices of $G$ which are in the set $S$. The energy of the self-loop graph $G_S$, denoted by $\mathcal{E}(G_S)$, is the sum of all absolute eigenvalues of the matrix $A(G_S)$. Two non-isomorphic self-loop graphs are equienergetic if their energies are equal. Akbari et al. (2023)conjectured that there exist a subset $S$ of $V(G)$ such that $\mathcal(G_S) > \mathcal{E}(G)$. In this paper, we confirm this conjecture. Also, we construct pairs of equienergetic self-loop graphs of order 24n for all n \ge 1.


title: UAV-assisted C-RAN for On-demand Cellular Coverage: Opportunities and Challenges

abstract: The deployment of beyond fifth-generation (5G) infrastructure over disaster-affected regions, temporary hotspot situations (e.g., massive gatherings, etc.), complex terrains (e.g., sea, hills, marshes, etc.) poses numerous challenges for cellular service providers. Recently, unmanned aerial vehicles (UAVs) have emerged as potential candidates to overcome the aforementioned technical issues based on their multi-role capabilities to serve as aerial base stations, mobile relays, and flying wireless access points. As such, the UAVs can act as portable platforms that can be deployed immediately on demand without requiring massive ground infrastructure to support wireless services. This article introduces the integration of UAVs to cloud radio access networks (C-RAN) for beyond 5G applications. The article mainly focuses on the underlying opportunities and challenges to realize the UAV-assisted C-RAN (UC-RAN) architecture in view of three generic application scenarios, i.e., disaster management, hotspots, and complex terrains. A preliminary performance analysis via simulation is further provided for the proposed UC-RAN under hotspot application scenario based on the relevant metrics.


title: SEP: Self-Enhanced Prompt Tuning for Visual-Language Model

abstract: Prompt tuning based on Context Optimization (CoOp) effectively adapts visual-language models (VLMs) to downstream tasks by inferring additional learnable prompt tokens. However, these tokens are less discriminative as they are independent of the pre-trained tokens and fail to capture input-specific knowledge, such as class-aware textual or instance-aware visual knowledge. Leveraging the discriminative and generalization capabilities inherent in pre-trained tokens, we introduce a novel approach named Self-Enhanced Prompt Tuning (SEP). The core principle of SEP involves adapting the learnable prompt tokens at each encoder layer from the corresponding self-pretrained tokens, thereby explicitly incorporating discriminative prior knowledge to enhance both textual-level and visual-level embeddings. Furthermore, SEP's self-enhanced tokens not only boost discrimination but also mitigate domain shifts in unseen domains, enhancing generalization. In practice, SEP selects several representative tokens from all pre-trained tokens for each input data at every layer of the text/visual encoders. Subsequently, a Token Fusion Module (TFM) is introduced to generate a self-enhanced token by merging these representative tokens with the learnable tokens using a cross-attention mechanism. This self-enhanced token is then concatenated with all pre-trained tokens, serving as input for subsequent encoder layers to produce the relevant embeddings. Comprehensive evaluations across various benchmarks and tasks confirm SEP's efficacy in prompt tuning. Code: \href{Code}{https://github.com/htyao89/SEP}.


title: CowScreeningDB: A public benchmark dataset for lameness detection in dairy cows

abstract: Lameness is one of the costliest pathological problems affecting dairy animals. It is usually assessed by trained veterinary clinicians who observe features such as gait symmetry or gait parameters as step counts in real-time. With the development of artificial intelligence, various modular systems have been proposed to minimize subjectivity in lameness assessment. However, the major limitation in their development is the unavailability of a public dataset which is currently either commercial or privately held. To tackle this limitation, we have introduced CowScreeningDB which was created using sensory data. This dataset was sourced from 43 cows at a dairy located in Gran Canaria, Spain. It consists of a multi-sensor dataset built on data collected using an Apple Watch 6 during the normal daily routine of a dairy cow. Thanks to the collection environment, sampling technique, information regarding the sensors, the applications used for data conversion and storage make the dataset a transparent one. This transparency of data can thus be used for further development of techniques for lameness detection for dairy cows which can be objectively compared. Aside from the public sharing of the dataset, we have also shared a machine-learning technique which classifies the caws in healthy and lame by using the raw sensory data. Hence validating the major objective which is to establish the relationship between sensor data and lameness.


title: Thinking Forward: Memory-Efficient Federated Finetuning of Language Models

abstract: Finetuning large language models (LLMs) in federated learning (FL) settings has become important as it allows resource-constrained devices to finetune a model using private data. However, finetuning LLMs using backpropagation requires excessive memory (especially from intermediate activations) for resource-constrained devices. While Forward-mode Auto-Differentiation (AD) can reduce memory footprint from activations, we observe that directly applying it to LLM finetuning results in slow convergence and poor accuracy. This work introduces Spry, an FL algorithm that splits trainable weights of an LLM among participating clients, such that each client computes gradients using Forward-mode AD that are closer estimates of the true gradients. Spry achieves a low memory footprint, high accuracy, and fast convergence. We theoretically show that the global gradients in Spry are unbiased estimates of true global gradients for homogeneous data distributions across clients, while heterogeneity increases bias of the estimates. We also derive Spry's convergence rate, showing that the gradients decrease inversely proportional to the number of FL rounds, indicating the convergence up to the limits of heterogeneity. Empirically, Spry reduces the memory footprint during training by 1.4-7.1$\times$ in contrast to backpropagation, while reaching comparable accuracy, across a wide range of language tasks, models, and FL settings. Spry reduces the convergence time by 1.2-20.3$\times$ and achieves 5.2-13.5\% higher accuracy against state-of-the-art zero-order methods. When finetuning Llama2-7B with LoRA, compared to the peak memory usage of 33.9GB of backpropagation, Spry only consumes 6.2GB of peak memory. For OPT13B, the reduction is from 76.5GB to 10.8GB. Spry makes feasible previously impossible FL deployments on commodity mobile and edge devices. Source code is available at https://github.com/Astuary/Spry.


title: Stability and Performance Analysis of Model Predictive Control of Uncertain Linear Systems

abstract: Model mismatch often poses challenges in model-based controller design. This paper investigates model predictive control (MPC) of uncertain linear systems with input constraints, focusing on stability and closed-loop infinite-horizon performance. The uncertainty arises from a parametric mismatch between the true and the estimated system under the matrix Frobenius norm. We examine a simple MPC controller that exclusively uses the estimated system model and establishes sufficient conditions under which the MPC controller can stabilize the true system. Moreover, we derive a theoretical performance bound based on relaxed dynamic programming, elucidating the impact of prediction horizon and modeling errors on the suboptimality gap between the MPC controller and the Oracle infinite-horizon optimal controller with knowledge of the true system. Simulations of a numerical example validate the theoretical results. Our theoretical analysis offers guidelines for obtaining the desired modeling accuracy and choosing a proper prediction horizon to develop certainty-equivalent MPC controllers for uncertain linear systems.


title: Massive MIMO-ISAC System With 1-Bit ADCs/DACs

abstract: This paper investigates a hardware-efficient massive multiple-input multiple-output integrated sensing and communication (MIMO-ISAC) system with 1-bit analog-to-digital converters (ADCs)/digital-to-analog converters (DACs). The proposed system, referred to as 1BitISAC, employs 1-bit DACs at the ISAC transmitter and 1-bit ADCs at the sensing receiver, achieving significant reductions in power consumption and hardware costs. For such kind of systems, two 1BitISAC joint transceiver designs, i.e., i) quality of service constrained 1BitISAC design and ii) quality of detection constrained design, are considered and the corresponding problems are formulated. In order to address these problems, we thoroughly analyze the radar detection performance after 1-bit ADCs quantization and the communication bit error rate. This analysis yields new design insights and leads to unique radar and communication metrics, which enables us to simplify the original problems and employ majorization-minimization and integer linear programming methods to solve the problems. Numerical results are provided to validate the performance analysis of the proposed 1BitISAC and to compare with other ISAC configurations. The superiority of the proposed 1BitISAC system in terms of balancing ISAC performance and energy efficiency is also demonstrated.


title: Slow linear shear flow past discrete particles adhered to a plane wall

abstract: Linear shear flow bounded by a plane wall is an idealization that occurs in microfluidic devices and many other applications. Perfect plane approximation neglects surface irregularities and discrete particles adsorbed at the surface. Here we study the disturbance to the linear shear flow due to the particle(s) rigidly attached to the surface. We first revisit the exact solution of O'Neill for a spherical particle in contact with an infinite plane boundary. While the original paper contains multiple typos and provides very few details of the derivation, we present detailed solution accompanied by an alternative and simpler derivation of the viscous force and the torque exerted on the particle. We further study the universal far-field behavior of the flow due to an arbitrary particle adhered to the surface, and demonstrate that it is controlled by the stress moment of magnitude depending on particle's volume and shape. Using the revised O'Neill solution, we compute the stress moment for a spherical particle. Using the far-field asymptotic form of the flow we estimate the net flow due to uniform and sparse layer of discrete adsorbates by superposition and demonstrate that it does not decay away from the plane.


title: ZTF J185259.31+124955.2: A new evolved disc-eclipsing binary system

abstract: Discs in long-period eclipsing binary systems are rare and can lead to extraordinary eclipsing events. ZTF J185259.31+124955.2 was identified as a candidate disc-eclipsing system through a continuing search programme of ZTF variables with a near-IR excess in the WISE data. Examination of the combined ZTF and ATLAS photometry shows seven eclipses since 2017 with depths of 0\fm34 in all bands on a period of $289.57\pm0.09$\,d. The eclipse width is $\sim 40$\,d but this and the profile evolve over time. Comparison with library spectra shows that the spectral energy distribution from the available photometry is consistent with an early K-type giant, and fitting black-body profiles suggests $T_{eff} \sim 4000$\,K for the stellar component, with a cool component having $T_{eff} < 500$\,K. The reddening and distance, and hence the luminosity place the star within the giant branch. The most likely scenario is that the system is in a state of rapid evolution following Case B/C mass transfer into an extended disc around an unseen companion.


title: Certifiably Robust RAG against Retrieval Corruption

abstract: Retrieval-augmented generation (RAG) has been shown vulnerable to retrieval corruption attacks: an attacker can inject malicious passages into retrieval results to induce inaccurate responses. In this paper, we propose RobustRAG as the first defense framework against retrieval corruption attacks. The key insight of RobustRAG is an isolate-then-aggregate strategy: we get LLM responses from each passage in isolation and then securely aggregate these isolated responses. To instantiate RobustRAG, we design keyword-based and decoding-based algorithms for securely aggregating unstructured text responses. Notably, RobustRAG can achieve certifiable robustness: we can formally prove and certify that, for certain queries, RobustRAG can always return accurate responses, even when the attacker has full knowledge of our defense and can arbitrarily inject a small number of malicious passages. We evaluate RobustRAG on open-domain QA and long-form text generation datasets and demonstrate its effectiveness and generalizability across various tasks and datasets.


title: Learning from Linear Algebra: A Graph Neural Network Approach to Preconditioner Design for Conjugate Gradient Solvers

abstract: Large linear systems are ubiquitous in modern computational science. The main recipe for solving them is iterative solvers with well-designed preconditioners. Deep learning models may be used to precondition residuals during iteration of such linear solvers as the conjugate gradient (CG) method. Neural network models require an enormous number of parameters to approximate well in this setup. Another approach is to take advantage of small graph neural networks (GNNs) to construct preconditioners of the predefined sparsity pattern. In our work, we recall well-established preconditioners from linear algebra and use them as a starting point for training the GNN. Numerical experiments demonstrate that our approach outperforms both classical methods and neural network-based preconditioning. We also provide a heuristic justification for the loss function used and validate our approach on complex datasets.


title: EGUP corrected thermodynamics of RN-AdS black hole with quintessence matter

abstract: Reissner-Nordstrom anti de Sitter (RN-AdS) black hole, characterized by electric charge and negative cosmological constant,exhibits a rich thermodynamics structure. In this paper, we consider the influence of quintessence, a hypothetical dark energy component with negative pressure. we have computed the extended generalized uncertainty principle (EGUP) corrections to the thermodynamics of RN-AdS black hole, including Hawking temperature, heat capacity, entropy function and pressure. Furthermore, as a special case of EGUP, we have computed and compared the result obtained from the generalized uncertainty principle (GUP) with those from the extended uncertainty principle (EUP). This work contributes to the understanding of the interplay between fundamental physics and the macroscopic properties of black holes, offering a novel perspective on the thermodynamics of RN-AdS black holes in the context of quintessence and quantum gravity corrections. More importantly, we found that, unlike in the case of the Reissner-Nordstrom (RN) black hole, the qualitative behavior for the RN-AdS black hole with quintessence remain largely unchanged, except for minor differences, at the equation of state parameters w=-1/3 and w=-2/3. In addition , unlike RN black holes, the phase transition point of RN-AdS black holes also disappears. Thus, small mass black holes can also exist stably, solving the black hole information paradox of RN-AdS space-time.


title: Non-diffusive neural network method for hyperbolic conservation laws

abstract: In this paper we develop a non-diffusive neural network (NDNN) algorithm for accurately solving weak solutions to hyperbolic conservation laws. The principle is to construct these weak solutions by computing smooth local solutions in subdomains bounded by discontinuity lines (DLs), the latter defined from the Rankine-Hugoniot jump conditions. The proposed approach allows to efficiently consider an arbitrary number of entropic shock waves, shock wave generation, as well as wave interactions. Some numerical experiments are presented to illustrate the strengths and properties of the algorithms.


title: Super-diffusive transport in two-dimensional Fermionic wires

abstract: We consider a two-dimensional model of a Fermionic wire in contact with reservoirs along its two opposite edges. With the reservoirs biased around a Fermi level, $E$, we study the scaling of the conductance of the wire with its length, $L$ as the width of the wire $W\rightarrow\infty$. The wire is disordered along the direction of the transport so the conductance is expected to exponentially decay with the length of the wire. However, we show that our model shows a super-diffusive scaling ($1/L^{1/2}$) of the conductance within $|E|<E_c$. This behavior is attributed to the presence of eigenstates of diverging localization length as $W\rightarrow\infty$. At $|E|=E_c$, the conductance behavior is sensitive to the disorder and scales sub-diffusively as $1/L^{3/2}$, and $1/L^{5/2}$ for zero and nonzero expectation value of the disorder. Furthermore, at this Fermi level and at certain points in the parameter space of the wire, the behavior of the conductance is also sensitive to the sign of the expectation value of the disorder. At these points we find $1/L^{7/4}$ for zero expectation value of the disorder and $1/L$, $1/L^{3}$ for different signs of the expectation value of the disorder.

categories: cond-mat.mes-hall cond-mat.dis-nn cond-mat.stat-mech quant-ph


title: When Generative AI Meets Workplace Learning: Creating A Realistic & Motivating Learning Experience With A Generative PCA

abstract: Workplace learning is used to train employees systematically, e.g., via e-learning or in 1:1 training. However, this is often deemed ineffective and costly. Whereas pure e-learning lacks the possibility of conversational exercise and personal contact, 1:1 training with human instructors involves a high level of personnel and organizational costs. Hence, pedagogical conversational agents (PCAs), based on generative AI, seem to compensate for the disadvantages of both forms. Following Action Design Research, this paper describes an organizational communication training with a Generative PCA (GenPCA). The evaluation shows promising results: the agent was perceived positively among employees and contributed to an improvement in self-determined learning. However, the integration of such agent comes not without limitations. We conclude with suggestions concerning the didactical methods, which are supported by a GenPCA, and possible improvements of such an agent for workplace learning.


title: Transformer-XL for Long Sequence Tasks in Robotic Learning from Demonstration

abstract: This paper presents an innovative application of Transformer-XL for long sequence tasks in robotic learning from demonstrations (LfD). The proposed framework effectively integrates multi-modal sensor inputs, including RGB-D images, LiDAR, and tactile sensors, to construct a comprehensive feature vector. By leveraging the advanced capabilities of Transformer-XL, particularly its attention mechanism and position encoding, our approach can handle the inherent complexities and long-term dependencies of multi-modal sensory data. The results of an extensive empirical evaluation demonstrate significant improvements in task success rates, accuracy, and computational efficiency compared to conventional methods such as Long Short-Term Memory (LSTM) networks and Convolutional Neural Networks (CNNs). The findings indicate that the Transformer-XL-based framework not only enhances the robot's perception and decision-making abilities but also provides a robust foundation for future advancements in robotic learning from demonstrations.


title: Heterogeneous virus classification using a functional deep learning model based on transmission electron microscopy images (Preprint)

abstract: Viruses are submicroscopic agents that can infect all kinds of lifeforms and use their hosts' living cells to replicate themselves. Despite having some of the simplest genetic structures among all living beings, viruses are highly adaptable, resilient, and given the right conditions, are capable of causing unforeseen complications in their hosts' bodies. Due to their multiple transmission pathways, high contagion rate, and lethality, viruses are the biggest biological threat faced by animal and plant species. It is often challenging to promptly detect the presence of a virus in a possible host's body and accurately determine its type using manual examination techniques; however, it can be done using computer-based automatic diagnosis methods. Most notably, the analysis of Transmission Electron Microscopy (TEM) images has been proven to be quite successful in instant virus identification. Using TEM images collected from a recently published dataset, this article proposes a deep learning-based classification model to identify the type of virus within those images correctly. The methodology of this study includes two coherent image processing techniques to reduce the noise present in the raw microscopy images. Experimental results show that it can differentiate among the 14 types of viruses present in the dataset with a maximum of 97.44% classification accuracy and F1-score, which asserts the effectiveness and reliability of the proposed method. Implementing this scheme will impart a fast and dependable way of virus identification subsidiary to the thorough diagnostic procedures.


title: Rethinking Independent Cross-Entropy Loss For Graph-Structured Data

abstract: Graph neural networks (GNNs) have exhibited prominent performance in learning graph-structured data. Considering node classification task, based on the i.i.d assumption among node labels, the traditional supervised learning simply sums up cross-entropy losses of the independent training nodes and applies the average loss to optimize GNNs' weights. But different from other data formats, the nodes are naturally connected. It is found that the independent distribution modeling of node labels restricts GNNs' capability to generalize over the entire graph and defend adversarial attacks. In this work, we propose a new framework, termed joint-cluster supervised learning, to model the joint distribution of each node with its corresponding cluster. We learn the joint distribution of node and cluster labels conditioned on their representations, and train GNNs with the obtained joint loss. In this way, the data-label reference signals extracted from the local cluster explicitly strengthen the discrimination ability on the target node. The extensive experiments demonstrate that our joint-cluster supervised learning can effectively bolster GNNs' node classification accuracy. Furthermore, being benefited from the reference signals which may be free from spiteful interference, our learning paradigm significantly protects the node classification from being affected by the adversarial attack.


title: Error Crafting in Probabilistic Quantum Gate Synthesis

abstract: At the early stage of fault-tolerant quantum computing, it is envisioned that the gate synthesis of a general unitary gate into universal gate sets yields error whose magnitude is comparable with the noise inherent in the gates themselves. While it is known that the use of probabilistic synthesis already suppresses such coherent errors quadratically, there is no clear understanding on its remnant error, which hinders us from designing a holistic error countermeasure that is effectively combined with error suppression and mitigation. In this work, we propose that, by exploiting the fact that synthesis error can be characterized completely and efficiently, we can craft the remnant error of probabilistic synthesis such that the error profile satisfies desirable properties. We prove for the case of single-qubit unitary synthesis that, there is a guaranteed way to perform probabilistic synthesis such that we can craft the remnant error to be described by Pauli and depolarizing errors, while the conventional twirling cannot be applied in principle. Furthermore, we show a numerical evidence for the synthesis of Pauli rotations based on Clifford+T formalism that, we can craft the remnant error so that it can be eliminated up to {\it cubic} order by combining logical measurement and feedback operations. As a result, Pauli rotation gates can be implemented with T counts of $\log_2(1/\varepsilon)$ on average up to accuracy of $\varepsilon=10^{-9}$, which can be applied to early fault-tolerant quantum computation beyond classical tractability. Our work opens a novel avenue in quantum circuit design and architecture that orchestrates error countermeasures.


title: Exploring galactic properties with machine learning Predicting star formation, stellar mass, and metallicity from photometric data

abstract: Aims. We explore machine learning techniques to forecast star formation rate, stellar mass, and metallicity across galaxies with redshifts ranging from 0.01 to 0.3. Methods. Leveraging CatBoost and deep learning architectures, we utilize multiband optical and infrared photometric data from SDSS and AllWISE, trained on the SDSS MPA-JHU DR8 catalogue. Results. Our study demonstrates the potential of machine learning in accurately predicting galaxy properties solely from photometric data. We achieve minimised root mean square errors, specifically employing the CatBoost model. For star formation rate prediction, we attain a value of RMSESFR = 0.336 dex, while for stellar mass prediction, the error is reduced to RMSESM = 0.206 dex. Additionally, our model yields a metallicity prediction of RMSEmetallicity = 0.097 dex. Conclusions. These findings underscore the significance of automated methodologies in efficiently estimating critical galaxy properties, amid the exponential growth of multi-wavelength astronomy data. Future research may focus on refining machine learning models and expanding datasets for even more accurate predictions.


title: PyCellMech: A shape-based feature extraction pipeline for use in medical and biological studies

abstract: Summary: Medical researchers obtain knowledge about the prevention and treatment of disability and disease using physical measurements and image data. To assist in this endeavor, feature extraction packages are available that are designed to collect data from the image structure. In this study, we aim to augment current works by adding to the current mix of shape-based features. The significance of shape-based features has been explored extensively in research for several decades, but there is no single package available in which all shape-related features can be extracted easily by the researcher. PyCellMech has been crafted to address this gap. The PyCellMech package extracts three classes of shape features, which are classified as one-dimensional, geometric, and polygonal. Future iterations will be expanded to include other feature classes, such as scale-space. Availability and implementation: PyCellMech is freely available at https://github.com/icm-dac/pycellmech.


title: OMNI-EPIC: Open-endedness via Models of human Notions of Interestingness with Environments Programmed in Code

abstract: Open-ended and AI-generating algorithms aim to continuously generate and solve increasingly complex tasks indefinitely, offering a promising path toward more general intelligence. To accomplish this grand vision, learning must occur within a vast array of potential tasks. Existing approaches to automatically generating environments are constrained within manually predefined, often narrow distributions of environment, limiting their ability to create any learning environment. To address this limitation, we introduce a novel framework, OMNI-EPIC, that augments previous work in Open-endedness via Models of human Notions of Interestingness (OMNI) with Environments Programmed in Code (EPIC). OMNI-EPIC leverages foundation models to autonomously generate code specifying the next learnable (i.e., not too easy or difficult for the agent's current skill set) and interesting (e.g., worthwhile and novel) tasks. OMNI-EPIC generates both environments (e.g., an obstacle course) and reward functions (e.g., progress through the obstacle course quickly without touching red objects), enabling it, in principle, to create any simulatable learning task. We showcase the explosive creativity of OMNI-EPIC, which continuously innovates to suggest new, interesting learning challenges. We also highlight how OMNI-EPIC can adapt to reinforcement learning agents' learning progress, generating tasks that are of suitable difficulty. Overall, OMNI-EPIC can endlessly create learnable and interesting environments, further propelling the development of self-improving AI systems and AI-Generating Algorithms. Project website with videos: https://dub.sh/omniepic


title: Randomized heuristic repair for large-scale multidimensional knapsack problem

abstract: The multidimensional knapsack problem (MKP) is an NP-hard combinatorial optimization problem whose solution is determining a subset of maximum total profit items that do not violate capacity constraints. Due to its hardness, large-scale MKP instances are usually a target for metaheuristics, a context in which effective feasibility maintenance strategies are crucial. In 1998, Chu and Beasley proposed an effective heuristic repair that is still relevant for recent metaheuristics. However, due to its deterministic nature, the diversity of solutions such heuristic provides is insufficient for long runs. As a result, the search for new solutions ceases after a while. This paper proposes an efficiency-based randomization strategy for the heuristic repair that increases the variability of the repaired solutions without deteriorating quality and improves the overall results.


title: Multi-Gigabit Interactive Extended Reality over Millimeter-Wave: An End-to-End System Approach

abstract: Achieving high-quality wireless interactive Extended Reality (XR) will require multi-gigabit throughput at extremely low latency. The Millimeter-Wave (mmWave) frequency bands, between 24 and 300GHz, can achieve such extreme performance. However, maintaining a consistently high Quality of Experience with highly mobile users is challenging, as mmWave communications are inherently directional. In this work, we present and evaluate an end-to-end approach to such a mmWave-based mobile XR system. We perform a highly realistic simulation of the system, incorporating accurate XR data traffic, detailed mmWave propagation models and actual user motion. We evaluate the impact of the beamforming strategy and frequency on the overall performance. In addition, we provide the first system-level evaluation of the CoVRage algorithm, a proactive and spatially aware user-side beamforming approach designed specifically for highly mobile XR environments.


title: RCInvestigator: Towards Better Investigation of Anomaly Root Causes in Cloud Computing Systems

abstract: Finding the root causes of anomalies in cloud computing systems quickly is crucial to ensure availability and efficiency since accurate root causes can guide engineers to take appropriate actions to address the anomalies and maintain customer satisfaction. However, it is difficult to investigate and identify the root causes based on large-scale and high-dimension monitoring data collected from complex cloud computing environments. Due to the inherently dynamic characteristics of cloud computing systems, the existing approaches in practice largely rely on manual analyses for flexibility and reliability, but massive unpredictable factors and high data complexity make the process time-consuming. Despite recent advances in automated detection and investigation approaches, the speed and quality of root cause analyses remain limited by the lack of expert involvement in these approaches. The limitations found in the current solutions motivate us to propose a visual analytics approach that facilitates the interactive investigation of the anomaly root causes in cloud computing systems. We identified three challenges, namely, a) modeling databases for the root cause investigation, b) inferring root causes from large-scale time series, and c) building comprehensible investigation results. In collaboration with domain experts, we addressed these challenges with RCInvestigator, a novel visual analytics system that establishes a tight collaboration between human and machine and assists experts in investigating the root causes of cloud computing system anomalies. We evaluated the effectiveness of RCInvestigator through two use cases based on real-world data and received positive feedback from experts.


title: Toward a generalization of Lehmer's problem to adelic curves

abstract: In this short note, we investigate the generalization of Lehmer's problem to finitely generated fields over $\mathbb{Q}$.


title: Uniform $\mathcal{H}$-matrix Compression with Applications to Boundary Integral Equations

abstract: Boundary integral equation formulations of elliptic partial differential equations lead to dense system matrices when discretized, yet they are data-sparse. Using the $\mathcal{H}$-matrix format, this sparsity is exploited to achieve $\mathcal{O}(N\log N)$ complexity for storage and multiplication by a vector. This is achieved purely algebraically, based on low-rank approximations of subblocks, and hence the format is also applicable to a wider range of problems. The $\mathcal{H}^2$-matrix format improves the complexity to $\mathcal{O}(N)$ by introducing a recursive structure onto subblocks on multiple levels. However, in practice this comes with a large proportionality constant, making the $\mathcal{H}^2$-matrix format advantageous mostly for large problems. In this paper we investigate the usefulness of a matrix format that lies in between these two: Uniform $\mathcal{H}$-matrices. An algebraic compression algorithm is introduced to transform a regular $\mathcal{H}$-matrix into a uniform $\mathcal{H}$-matrix, which maintains the asymptotic complexity.


title: Meteor: Mamba-based Traversal of Rationale for Large Language and Vision Models

abstract: The rapid development of large language and vision models (LLVMs) has been driven by advances in visual instruction tuning. Recently, open-source LLVMs have curated high-quality visual instruction tuning datasets and utilized additional vision encoders or multiple computer vision models in order to narrow the performance gap with powerful closed-source LLVMs. These advancements are attributed to multifaceted information required for diverse capabilities, including fundamental image understanding, real-world knowledge about common-sense and non-object concepts (e.g., charts, diagrams, symbols, signs, and math problems), and step-by-step procedures for solving complex questions. Drawing from the multifaceted information, we present a new efficient LLVM, Mamba-based traversal of rationales (Meteor), which leverages multifaceted rationale to enhance understanding and answering capabilities. To embed lengthy rationales containing abundant information, we employ the Mamba architecture, capable of processing sequential data with linear time complexity. We introduce a new concept of traversal of rationale that facilitates efficient embedding of rationale. Subsequently, the backbone multimodal language model (MLM) is trained to generate answers with the aid of rationale. Through these steps, Meteor achieves significant improvements in vision language performances across multiple evaluation benchmarks requiring diverse capabilities, without scaling up the model size or employing additional vision encoders and computer vision models.


title: Manifold Solutions to Navier-Stokes Equations

abstract: We have developed dynamic manifold solutions for the Navier-Stokes equations using an extension of differential geometry called the calculus for moving surfaces. Specifically, we have shown that the geometric solutions to the Navier-Stokes equations can take the form of fluctuating spheres, constant mean curvature surfaces, generic wave equations for compressible systems, and arbitrarily curved shapes for incompressible systems in various scenarios. These solutions apply to predominantly incompressible and compressible systems for the equations in any dimension, while the remaining cases are yet to be solved. We have demonstrated that for incompressible Navier-Stokes equations, geometric solutions are always bound by the curvature tensor of the closed smooth manifold for every smooth velocity field. As a result, solutions always converge for systems with constant volumes.


title: Online Changepoint Detection via Dynamic Mode Decomposition

abstract: Detecting changes in data streams is a vital task in many applications. There is increasing interest in changepoint detection in the online setting, to enable real-time monitoring and support prompt responses and informed decision-making. Many approaches assume stationary sequences before encountering an abrupt change in the mean or variance. Notably less attention has focused on the challenging case where the monitored sequences exhibit trend, periodicity and seasonality. Dynamic mode decomposition is a data-driven dimensionality reduction technique that extracts the essential components of a dynamical system. We propose a changepoint detection method that leverages this technique to sequentially model the dynamics of a moving window of data and produce a low-rank reconstruction. A change is identified when there is a significant difference between this reconstruction and the observed data, and we provide theoretical justification for this approach. Extensive simulations demonstrate that our approach has superior detection performance compared to other methods for detecting small changes in mean, variance, periodicity, and second-order structure, among others, in data that exhibits seasonality. Results on real-world datasets also show excellent performance compared to contemporary approaches.


title: Closed mean curvature flows with asymptotically conical singularities

abstract: In this paper, we prove that for any asymptotically conical self-shrinker, there exists an embedded closed hypersurface such that the mean curvature flow starting from it develops a singularity modeled on the given shrinker. The main technique is the Wa\.zewski box argument, used by Stolarski in the proof of the corresponding theorem in the Ricci flow case. As a corollary, our construction, combined with the works of Angenent-Ilmanen-Vel\'azquez and Chodosh-Daniels-Holgate-Schulze, implies the existence of fattening level set flows starting from smooth embedded closed hypersurfaces. This addresses a question posed by Evans-Spruck and De Giorgi.


title: Distributed Locking as a Data Type

abstract: Mixed-consistency programming models assist programmers in designing applications that provide high availability while still ensuring application-specific safety invariants. However, existing models often make specific system assumptions, such as building on a particular database system or having baked-in coordination strategies. This makes it difficult to apply these strategies in diverse settings, ranging from client/server to ad-hoc peer-to-peer networks. This work proposes a new strategy for building programmable coordination mechanisms based on the algebraic replicated data types (ARDTs) approach. ARDTs allow for simple and composable implementations of various protocols, while making minimal assumptions about the network environment. As a case study, two different locking protocols are presented, both implemented as ARDTs. In addition, we elaborate on our ongoing efforts to integrate the approach into the LoRe mixed-consistency programming language.


title: Generating density nowcasts for U.S. GDP growth with deep learning: Bayes by Backprop and Monte Carlo dropout

abstract: Recent results in the literature indicate that artificial neural networks (ANNs) can outperform the dynamic factor model (DFM) in terms of the accuracy of GDP nowcasts. Compared to the DFM, the performance advantage of these highly flexible, nonlinear estimators is particularly evident in periods of recessions and structural breaks. From the perspective of policy-makers, however, nowcasts are the most useful when they are conveyed with uncertainty attached to them. While the DFM and other classical time series approaches analytically derive the predictive (conditional) distribution for GDP growth, ANNs can only produce point nowcasts based on their default training procedure (backpropagation). To fill this gap, first in the literature, we adapt two different deep learning algorithms that enable ANNs to generate density nowcasts for U.S. GDP growth: Bayes by Backprop and Monte Carlo dropout. The accuracy of point nowcasts, defined as the mean of the empirical predictive distribution, is evaluated relative to a naive constant growth model for GDP and a benchmark DFM specification. Using a 1D CNN as the underlying ANN architecture, both algorithms outperform those benchmarks during the evaluation period (2012:Q1 -- 2022:Q4). Furthermore, both algorithms are able to dynamically adjust the location (mean), scale (variance), and shape (skew) of the empirical predictive distribution. The results indicate that both Bayes by Backprop and Monte Carlo dropout can effectively augment the scope and functionality of ANNs, rendering them a fully compatible and competitive alternative for classical time series approaches.


title: Open-Vocabulary SAM3D: Understand Any 3D Scene

abstract: Open-vocabulary 3D scene understanding presents a significant challenge in the field. Recent advancements have sought to transfer knowledge embedded in vision language models from the 2D domain to 3D domain. However, these approaches often require learning prior knowledge from specific 3D scene datasets, which limits their applicability in open-world scenarios. The Segment Anything Model (SAM) has demonstrated remarkable zero-shot segmentation capabilities, prompting us to investigate its potential for comprehending 3D scenes without the need for training. In this paper, we introduce OV-SAM3D, a universal framework for open-vocabulary 3D scene understanding. This framework is designed to perform understanding tasks for any 3D scene without requiring prior knowledge of the scene. Specifically, our method is composed of two key sub-modules: First, we initiate the process by generating superpoints as the initial 3D prompts and refine these prompts using segment masks derived from SAM. Moreover, we then integrate a specially designed overlapping score table with open tags from the Recognize Anything Model (RAM) to produce final 3D instances with open-world label. Empirical evaluations conducted on the ScanNet200 and nuScenes datasets demonstrate that our approach surpasses existing open-vocabulary methods in unknown open-world environments.


title: Nonlinear studies of modifications to general relativity: Comparing different approaches

abstract: Studying the dynamical, nonlinear regime of modified theories of gravity remains a theoretical challenge that limits our ability to test general relativity. Here we consider two generally applicable, but approximate methods for treating modifications to full general relativity that have been used to study binary black hole mergers and other phenomena in this regime, and compare solutions obtained by them to those from solving the full equations of motion. The first method evolves corrections to general relativity order by order in a perturbative expansion, while the second method introduces extra dynamical fields in such a way that strong hyperbolicity is recovered. We use shift-symmetric Einstein-scalar-Gauss-Bonnet gravity as a benchmark theory to illustrate the differences between these methods for several spacetimes of physical interest. We study the formation of scalar hair about initially non-spinning black holes, the collision of black holes with scalar charge, and the inspiral and merger of binary black holes. By directly comparing predictions, we assess the extent to which those from the approximate treatments can be meaningfully confronted with gravitational wave observations. We find that the order-by-order approach cannot faithfully track the solutions when the corrections to general relativity are non-negligible. The second approach, however, can provide consistent solutions, provided the ad-hoc timescale over which the dynamical fields are driven to their target values is made short compared to the physical timescales.


title: The ABCDEFGJK of maximally strongly coupled $\mathcal{N}=2$ SCFTs

abstract: We classify all possible charge lattices and 1-form symmetry groups for $\mathcal{N}=2$ SCFTs with characteristic dimension $\varkappa \neq \{1,2\}$. For rank-$r$ SCFTs that are not stacks of lower rank theories the order of the 1-form symmetry group can be 1,2,3,4 and $r+1$. As an application of the classification we show that $\mathcal{N}=2$ $S$-folds and Minahan-Nemeschansky SCFTs have trivial 1-form symmetry. We find two sporadic lattices compatible with the Coulomb branch geometries $\mathbb{C}^5/G_{33}$ and $\mathbb{C}^6/G_{34}$ that are not realized by any known SCFT. The former, if realized, would have a $\mathbb{Z}_2$ 1-form symmetry and a non-invertible topological defect.


title: Transfer Learning with Informative Priors: Simple Baselines Better than Previously Reported

abstract: We pursue transfer learning to improve classifier accuracy on a target task with few labeled examples available for training. Recent work suggests that using a source task to learn a prior distribution over neural net weights, not just an initialization, can boost target task performance. In this study, we carefully compare transfer learning with and without source task informed priors across 5 datasets. We find that standard transfer learning informed by an initialization only performs far better than reported in previous comparisons. The relative gains of methods using informative priors over standard transfer learning vary in magnitude across datasets. For the scenario of 5-300 examples per class, we find negative or negligible gains on 2 datasets, modest gains (between 1.5-3 points of accuracy) on 2 other datasets, and substantial gains (>8 points) on one dataset. Among methods using informative priors, we find that an isotropic covariance appears competitive with learned low-rank covariance matrix while being substantially simpler to understand and tune. Further analysis suggests that the mechanistic justification for informed priors -- hypothesized improved alignment between train and test loss landscapes -- is not consistently supported due to high variability in empirical landscapes. We release code to allow independent reproduction of all experiments.


title: Unveiling the True Nature of Plasma Dynamics from the Reference Frame of a Super-penumbral Fibril

abstract: The magnetic geometry of the solar atmosphere, combined with projection effects, makes it difficult to accurately map the propagation of ubiquitous waves in fibrillar structures. These waves are of interest due to their ability to carry energy into the chromosphere and deposit it through damping and dissipation mechanisms. To this end, the Interferometric Bidimensional Spectrometer (IBIS) at the Dunn Solar Telescope was employed to capture high resolution H$\alpha$ spectral scans of a sunspot, with the transverse oscillations of a prominent super-penumbral fibril examined in depth. The oscillations are re-projected from the helioprojective-cartesian frame to a new frame of reference oriented along the average fibril axis through non-linear force-free field extrapolations. The fibril was found to be carrying an elliptically polarised, propagating kink oscillation with a period of $430$ s and a phase velocity of $69\pm4$ km s$^{-1}$. The oscillation is damped as it propagates away from the sunspot with a damping length of approximately $9.2$ Mm, resulting in the energy flux decreasing at a rate on the order of $460$ W m$^{-2}$/Mm. The H$\alpha$ line width is examined and found to increase with distance from the sunspot; a potential sign of a temperature increase. Different linear and non-linear mechanisms are investigated for the damping of the wave energy flux, but a first-order approximation of their combined effects is insufficient to recreate the observed damping length by a factor of at least $3$. It is anticipated that the re-projection methodology demonstrated in this study will aid with future studies of transverse waves within fibrillar structures.


title: Synergizing In-context Learning with Hints for End-to-end Task-oriented Dialog Systems

abstract: Large language models (LLM) based end-to-end task-oriented dialog (TOD) systems built using few-shot (in-context) learning perform better than supervised models only when the train data is limited. This is due to the inherent ability of LLMs to learn any task with just a few demonstrations. As the number of train dialogs increases, supervised SoTA models surpass in-context learning LLMs as they learn to better align with the style of the system responses in the training data, which LLMs struggle to mimic. In response, we propose SyncTOD, which synergizes LLMs with useful hints about the task for improved alignment. At a high level, SyncTOD trains auxiliary models to provide these hints and select exemplars for the in-context prompts. With ChatGPT, SyncTOD achieves superior performance compared to LLM-based baselines and SoTA models in low-data settings, while retaining competitive performance in full-data settings


title: DAGER: Exact Gradient Inversion for Large Language Models

abstract: Federated learning works by aggregating locally computed gradients from multiple clients, thus enabling collaborative training without sharing private client data. However, prior work has shown that the data can actually be recovered by the server using so-called gradient inversion attacks. While these attacks perform well when applied on images, they are limited in the text domain and only permit approximate reconstruction of small batches and short input sequences. In this work, we propose DAGER, the first algorithm to recover whole batches of input text exactly. DAGER leverages the low-rank structure of self-attention layer gradients and the discrete nature of token embeddings to efficiently check if a given token sequence is part of the client data. We use this check to exactly recover full batches in the honest-but-curious setting without any prior on the data for both encoder- and decoder-based architectures using exhaustive heuristic search and a greedy approach, respectively. We provide an efficient GPU implementation of DAGER and show experimentally that it recovers full batches of size up to 128 on large language models (LLMs), beating prior attacks in speed (20x at same batch size), scalability (10x larger batches), and reconstruction quality (ROUGE-1/2 > 0.99).


title: Composed Image Retrieval for Remote Sensing

abstract: This work introduces composed image retrieval to remote sensing. It allows to query a large image archive by image examples alternated by a textual description, enriching the descriptive power over unimodal queries, either visual or textual. Various attributes can be modified by the textual part, such as shape, color, or context. A novel method fusing image-to-image and text-to-image similarity is introduced. We demonstrate that a vision-language model possesses sufficient descriptive power and no further learning step or training data are necessary. We present a new evaluation benchmark focused on color, context, density, existence, quantity, and shape modifications. Our work not only sets the state-of-the-art for this task, but also serves as a foundational step in addressing a gap in the field of remote sensing image retrieval. Code at: https://github.com/billpsomas/rscir


title: Modified 3D Massive Abelian 2-From Theory with a Single Pseudo-Scalar Field: BRST Approach

abstract: We obtain the off-shell nilpotent Becchi-Rouet-Stora-Tyutin (BRST) and anti-BRST symmetry transformations (corresponding to the infinitesimal classical gauge symmetry transformations) for the St${\ddot u}$ckelberg-modified massive three $(2 + 1)$-dimensional (3D) Abelian 2-form gauge theory with a single pseudo-scalar field. The latter field (having the negative kinetic term and a well-defined mass) has already been shown (i) to exist in the modified version of the standard 3D St${\ddot u}$ckelberg formalism (on solid mathematical grounds), (ii) to be a possible candidate for dark matter, and (iii) to correspond to the ``phantom" field of some of the cosmological models of the Universe. A couple of highlights of our present endeavor are (i) the observation that, even though the pseudo-scalar field does not transform under the gauge and (anti-)BRST symmetry transformations, it appears in the first-class constraints which annihilate the physical states at the quantum level, and (ii) the Noether conserved (anti-)BRST charges are found to be non-nilpotent. In our present investigation, we derive (i) the coupled (but equivalent) BRST and anti-BRST invariant Lagrangian densities, (ii) the conserved and off-shell nilpotent versions of the (anti-)BRST charges and the conserved ghost charge, (iii) the (anti-)BRST invariant Curci-Ferrari (CF) type restrictions, and (iv) the standard BRST algebra amongst the conserved and nilpotent (anti-)BRST and conserved ghost charges of our theory.


title: Efficient Adversarial Training in LLMs with Continuous Attacks

abstract: Large language models (LLMs) are vulnerable to adversarial attacks that can bypass their safety guardrails. In many domains, adversarial training has proven to be one of the most promising methods to reliably improve robustness against such attacks. Yet, in the context of LLMs, current methods for adversarial training are hindered by the high computational costs required to perform discrete adversarial attacks at each training iteration. We address this problem by instead calculating adversarial attacks in the continuous embedding space of the LLM, which is orders of magnitudes more efficient. We propose a fast adversarial training algorithm (C-AdvUL) composed of two losses: the first makes the model robust on continuous embedding attacks computed on an adversarial behaviour dataset; the second ensures the usefulness of the final model by fine-tuning on utility data. Moreover, we introduce C-AdvIPO, an adversarial variant of IPO that does not require utility data for adversarially robust alignment. Our empirical evaluation on four models from different families (Gemma, Phi3, Mistral, Zephyr) and at different scales (2B, 3.8B, 7B) shows that both algorithms substantially enhance LLM robustness against discrete attacks (GCG, AutoDAN, PAIR), while maintaining utility. Our results demonstrate that robustness to continuous perturbations can extrapolate to discrete threat models. Thereby, we present a path toward scalable adversarial training algorithms for robustly aligning LLMs.


title: Profiling checkpointing schedules in adjoint ST-AD

abstract: Checkpointing is a cornerstone of data-flow reversal in adjoint algorithmic differentiation. Checkpointing is a storage/recomputation trade-off that can be applied at different levels, one of which being the call tree. We are looking for good placements of checkpoints onto the call tree of a given application, to reduce run time and memory footprint of its adjoint. There is no known optimal solution to this problem other than a combinatorial search on all placements. We propose a heuristics based on run-time profiling of the adjoint code. We describe implementation of this profiling tool in an existing source-transformation AD tool. We demonstrate the interest of this approach on test cases taken from the MITgcm ocean and atmospheric global circulation model. We discuss the limitations of our approach and propose directions to lift them.


title: Constraints for electron-capture decays mimicking production of axion-like particles in nuclei

abstract: We give for the first time, theoretical estimates of ground-state-to-ground-state (GS-to-GS) electron-capture (EC) branch decay rates of $^{44}$Ti, $^{57}$Co, and $^{139}$Ce. The nuclear-structure calculations have been done exploiting the nuclear shell model (NSM) with well-established Hamiltonians and an advanced theory of $\beta$ decay. In the absence of experimental measurements of these GS-to-GS branches, these estimates are of utmost importance for terrestrial searches of axion-like particles (ALPs). Predictions are made for EC-decay rates of 2$^{nd}$-forbidden unique (FU) and 2$^{nd}$-forbidden non-unique (FNU) EC transitions that can potentially mimic nuclear axion production in experiments designed to detect ALPs in nuclear environments.


title: Density Sensitive Bifiltered Dowker Complexes via Total Weight

abstract: In this paper, we introduce a density-sensitive bifiltration on Dowker complexes. Previously, Dowker complexes were studied to address directional or bivariate data whereas density-sensitive bifiltrations on \v{C}ech and Vietoris--Rips complexes were suggested to make them more robust. We combine these two lines of research, noting that the superlevels of the total weight function of a Dowker complex can be identified as an instance of Sheehy's multicover filtration. An application of the multicover nerve theorem then provides a form of Dowker duality that is compatible with this filtration. As a consequence, we find that the subdivision intrinsic \v{C}ech complex admits a smaller model. Moreover, regarding the total weight function as a counting measure, we generalize it to arbitrary measures and prove a density-sensitive stability theorem for the case of probability measures. Additionally, we provide an algorithm to calculate the appearances of simplices in our bifiltration and present computational examples.


title: MicroAdam: Accurate Adaptive Optimization with Low Space Overhead and Provable Convergence

abstract: We propose a new variant of the Adam optimizer [Kingma and Ba, 2014] called MICROADAM that specifically minimizes memory overheads, while maintaining theoretical convergence guarantees. We achieve this by compressing the gradient information before it is fed into the optimizer state, thereby reducing its memory footprint significantly. We control the resulting compression error via a novel instance of the classical error feedback mechanism from distributed optimization [Seide et al., 2014, Alistarh et al., 2018, Karimireddy et al., 2019] in which the error correction information is itself compressed to allow for practical memory gains. We prove that the resulting approach maintains theoretical convergence guarantees competitive to those of AMSGrad, while providing good practical performance. Specifically, we show that MICROADAM can be implemented efficiently on GPUs: on both million-scale (BERT) and billion-scale (LLaMA) models, MicroAdam provides practical convergence competitive to that of the uncompressed Adam baseline, with lower memory usage and similar running time. Our code is available at https://github.com/IST-DASLab/MicroAdam.


title: Eikonal amplitudes on the celestial sphere

abstract: Celestial scattering amplitudes for massless particles are Mellin transforms of momentum-space scattering amplitudes with respect to the energies of the external particles, and behave as conformal correlators on the celestial sphere. However, there are few explicit cases of well-defined celestial amplitudes, particularly for gravitational theories: the mixing between low- and high-energy scales induced by the Mellin transform generically yields divergent integrals. In this paper, we argue that the most natural object to consider is the gravitational amplitude dressed by an oscillating phase arising from semi-classical effects known as eikonal exponentiation. This leads to gravitational celestial amplitudes which are analytic, apart from a set of poles at integer negative conformal dimensions, whose degree and residues we characterize. We also study the large conformal dimension limits, and provide an asymptotic series representation for these celestial eikonal amplitudes. Our investigation covers two different frameworks, related by eikonal exponentiation: $2\to2$ scattering of scalars in flat spacetime and $1\to1$ scattering of a probe scalar particle in a curved, stationary spacetime. These provide data which any putative celestial dual for Minkowski, shockwave or black hole spacetimes must reproduce. We also derive dispersion and monodromy relations for these celestial amplitudes and discuss Carrollian eikonal-probe amplitudes in curved spacetimes.


title: Fast adiabatic preparation of multi-squeezed states by jumping along the path

abstract: Multi-squeezed states, also known as generalized squeezed states, are valuable quantum non-Gaussian resources, because they can feature non-classical properties such as large phase-space Wigner negativities. In this work, we introduce a novel shortcuts to adiabaticity (STA) method for the fast preparation of multi-squeezed states. In contrast to previous STA methods, which rely on the use of counterdiabatic control to suppress unwanted non-adiabatic effects, our method simplifies the process and accelerates state preparation by selecting an appropriate sampling along a quantum evolution path. We demonstrate the high-fidelity and fast preparation of multi-squeezed states, as well as hybrid entangled states between a bosonic mode and a qubit.


title: Multimodal Object Detection via Probabilistic a priori Information Integration

abstract: Multimodal object detection has shown promise in remote sensing. However, multimodal data frequently encounter the problem of low-quality, wherein the modalities lack strict cell-to-cell alignment, leading to mismatch between different modalities. In this paper, we investigate multimodal object detection where only one modality contains the target object and the others provide crucial contextual information. We propose to resolve the alignment problem by converting the contextual binary information into probability maps. We then propose an early fusion architecture that we validate with extensive experiments on the DOTA dataset.


title: One-level densities in families of Gr\"ossencharakters associated to CM elliptic curves

abstract: We study the low-lying zeros of a family of $L$-functions attached to the CM elliptic curves $E_d \;:\; y^2 = x^3 - dx$, for each odd and square-free integer $d$. Writing the $L$-function of $E_d$ as $L(s-\frac12, \xi_d)$ for the appropriate Gr\"ossencharakter $\xi_d$ of conductor $\mathfrak{f}_d$, the family $\mathcal F_d$ is defined as the family of $L$-functions attached to the Gr\"ossencharakters $\xi_{d,k}$, where for each integer $k \geq 1$, $\xi_{d, k}$ denotes the primitive character inducing $\xi_d^k$. We observe that the average root number over the family $\mathcal F_d$ is $\frac14$, which makes the symmetry type of the family (unitary, symplectic or orthogonal) somehow mysterious, as none of the symmetry types would lead to this average value. By computing the one-level density, we find that $\mathcal F_d$ breaks down into two natural subfamilies, namely a symplectic family ($L(s, \xi_{d,k})$ for $k$ even) and an orthogonal family ($L(s, \xi_{d,k})$ for $k$ odd). For $k$ odd, $\mathcal F_d$ is in fact a subfamily of the automorphic forms of fixed level $4 N (\mathfrak{f}_d )$, and even weight $k+1$, and this larger family also has orthogonal symmetry. The main term of the one-level density gives the symmetry and we also compute explicit lower order terms for each case.


title: MCDFN: Supply Chain Demand Forecasting via an Explainable Multi-Channel Data Fusion Network Model

abstract: Accurate demand forecasting is crucial for optimizing supply chain management. Traditional methods often fail to capture complex patterns from seasonal variability and special events. Despite advancements in deep learning, interpretable forecasting models remain a challenge. To address this, we introduce the Multi-Channel Data Fusion Network (MCDFN), a hybrid architecture that integrates Convolutional Neural Networks (CNN), Long Short-Term Memory networks (LSTM), and Gated Recurrent Units (GRU) to enhance predictive performance by extracting spatial and temporal features from time series data. Our rigorous benchmarking demonstrates that MCDFN outperforms seven other deep-learning models, achieving superior metrics: MSE (23.5738%), RMSE (4.8553%), MAE (3.9991%), and MAPE (20.1575%). Additionally, MCDFN's predictions were statistically indistinguishable from actual values, confirmed by a paired t-test with a 5% p-value and a 10-fold cross-validated statistical paired t-test. We apply explainable AI techniques like ShapTime and Permutation Feature Importance to enhance interpretability. This research advances demand forecasting methodologies and offers practical guidelines for integrating MCDFN into supply chain systems, highlighting future research directions for scalability and user-friendly deployment.


title: On the Computational Landscape of Replicable Learning

abstract: We study computational aspects of algorithmic replicability, a notion of stability introduced by Impagliazzo, Lei, Pitassi, and Sorrell [2022]. Motivated by a recent line of work that established strong statistical connections between replicability and other notions of learnability such as online learning, private learning, and SQ learning, we aim to understand better the computational connections between replicability and these learning paradigms. Our first result shows that there is a concept class that is efficiently replicably PAC learnable, but, under standard cryptographic assumptions, no efficient online learner exists for this class. Subsequently, we design an efficient replicable learner for PAC learning parities when the marginal distribution is far from uniform, making progress on a question posed by Impagliazzo et al. [2022]. To obtain this result, we design a replicable lifting framework inspired by Blanc, Lange, Malik, and Tan [2023] that transforms in a black-box manner efficient replicable PAC learners under the uniform marginal distribution over the Boolean hypercube to replicable PAC learners under any marginal distribution, with sample and time complexity that depends on a certain measure of the complexity of the distribution. Finally, we show that any pure DP learner can be transformed to a replicable one in time polynomial in the accuracy, confidence parameters and exponential in the representation dimension of the underlying hypothesis class.


title: Transfer Learning for Spatial Autoregressive Models

abstract: The spatial autoregressive (SAR) model has been widely applied in various empirical economic studies to characterize the spatial dependence among subjects. However, the precision of estimating the SAR model diminishes when the sample size of the target data is limited. In this paper, we propose a new transfer learning framework for the SAR model to borrow the information from similar source data to improve both estimation and prediction. When the informative source data sets are known, we introduce a two-stage algorithm, including a transferring stage and a debiasing stage, to estimate the unknown parameters and also establish the theoretical convergence rates for the resulting estimators. If we do not know which sources to transfer, a transferable source detection algorithm is proposed to detect informative sources data based on spatial residual bootstrap to retain the necessary spatial dependence. Its detection consistency is also derived. Simulation studies demonstrate that using informative source data, our transfer learning algorithm significantly enhances the performance of the classical two-stage least squares estimator. In the empirical application, we apply our method to the election prediction in swing states in the 2020 U.S. presidential election, utilizing polling data from the 2016 U.S. presidential election along with other demographic and geographical data. The empirical results show that our method outperforms traditional estimation methods.


title: High-resolution spectroscopy of neutron-rich Br isotopes and signatures for a prolate-to-oblate shape transition at N=56

abstract: The first systematic experimental study of the neutron-rich Br isotopes with two complementary state-of-the-art techniques is presented. These isotopes have been populated in the fission process at two different facilities, GANIL and ILL. New spectroscopic information has been obtained for odd-even $^{87-93}$Br isotopes and the experimental results have been compared with state-of-the-art Large-Scale Shell-Model and DNO Shell-Model calculations. As a result of such theoretical approaches, a transition from prolate ($^{87,89}$Br) to oblate ($^{91,93}$Br) shapes is obtained from the subtle balance between proton and neutron quadrupole deformations, as a clear signature of pseudo-SU3 quadrupole regime.


title: Far-from-equilibrium travelling pulses in sloped semi-arid environments driven by autotoxicity effects

abstract: In this work, an extension of the 1D Klausmeier model that accounts for the toxicity compounds is considered and the occurrence of travelling stripes is investigated. Numerical simulations are firstly conducted to capture the qualitative behaviours of the pulse-type solutions and, then, geometric singular perturbation theory is used to prove the existence of such travelling pulses by constructing the corresponding homoclinic orbits in the associated 4-dimensional system. A scaling analysis on the investigated model is performed to identify the asymptotic scaling regime in which travelling pulses can be constructed. Biological observations are extracted from the analytical results and the role of autotoxicity in travelling patterns is emphasized. Finally, the analytically constructed solutions are compared with the numerical ones, leading to a good agreement that confirms the validity of the conducted analysis. Numerical investigations are also carried out in order to gain additional information on vegetation dynamics.


title: Kronecker-Factored Approximate Curvature for Physics-Informed Neural Networks

abstract: Physics-informed neural networks (PINNs) are infamous for being hard to train. Recently, second-order methods based on natural gradient and Gauss-Newton methods have shown promising performance, improving the accuracy achieved by first-order methods by several orders of magnitude. While promising, the proposed methods only scale to networks with a few thousand parameters due to the high computational cost to evaluate, store, and invert the curvature matrix. We propose Kronecker-factored approximate curvature (KFAC) for PINN losses that greatly reduces the computational cost and allows scaling to much larger networks. Our approach goes beyond the established KFAC for traditional deep learning problems as it captures contributions from a PDE's differential operator that are crucial for optimization. To establish KFAC for such losses, we use Taylor-mode automatic differentiation to describe the differential operator's computation graph as a forward network with shared weights. This allows us to apply KFAC thanks to a recently-developed general formulation for networks with weight sharing. Empirically, we find that our KFAC-based optimizers are competitive with expensive second-order methods on small problems, scale more favorably to higher-dimensional neural networks and PDEs, and consistently outperform first-order methods and LBFGS.


title: Text Generation: A Systematic Literature Review of Tasks, Evaluation, and Challenges

abstract: Text generation has become more accessible than ever, and the increasing interest in these systems, especially those using large language models, has spurred an increasing number of related publications. We provide a systematic literature review comprising 244 selected papers between 2017 and 2024. This review categorizes works in text generation into five main tasks: open-ended text generation, summarization, translation, paraphrasing, and question answering. For each task, we review their relevant characteristics, sub-tasks, and specific challenges (e.g., missing datasets for multi-document summarization, coherence in story generation, and complex reasoning for question answering). Additionally, we assess current approaches for evaluating text generation systems and ascertain problems with current metrics. Our investigation shows nine prominent challenges common to all tasks and sub-tasks in recent text generation publications: bias, reasoning, hallucinations, misuse, privacy, interpretability, transparency, datasets, and computing. We provide a detailed analysis of these challenges, their potential solutions, and which gaps still require further engagement from the community. This systematic literature review targets two main audiences: early career researchers in natural language processing looking for an overview of the field and promising research directions, as well as experienced researchers seeking a detailed view of tasks, evaluation methodologies, open challenges, and recent mitigation strategies.


title: Fast-PGM: Fast Probabilistic Graphical Model Learning and Inference

abstract: Probabilistic graphical models (PGMs) serve as a powerful framework for modeling complex systems with uncertainty and extracting valuable insights from data. However, users face challenges when applying PGMs to their problems in terms of efficiency and usability. This paper presents Fast-PGM, an efficient and open-source library for PGM learning and inference. Fast-PGM supports comprehensive tasks on PGMs, including structure and parameter learning, as well as exact and approximate inference, and enhances efficiency of the tasks through computational and memory optimizations and parallelization techniques. Concurrently, Fast-PGM furnishes developers with flexible building blocks, furnishes learners with detailed documentation, and affords non-experts user-friendly interfaces, thereby ameliorating the usability of PGMs to users across a spectrum of expertise levels. The source code of Fast-PGM is available at https://github.com/jjiantong/FastPGM.


title: Chiral-Gain Photonics

abstract: Here, we present an exploratory study of the potential applications of electrically biased materials that possess a nonreciprocal and non-Hermitian electromagnetic response analogous to the electronic response of field-effect transistors. The most distinctive feature of such materials is their chiral-gain, meaning that their response can be active or dissipative depending on the handedness of the wave polarization. Here, we show how the chiral-gain can be harnessed to develop novel electromagnetic devices with unique properties such as chiral lasers, polarization-dependent mirrors, and coherent-perfect-absorber lasers. Furthermore, it is demonstrated that materials with chiral-gain can bypass a reciprocity constraint that typically limits the external coupling strength, thus facilitating the excitation of cavities with extremely large quality factors.


title: Channel Estimation and Reconstruction in Fluid Antenna System: Oversampling is Essential

abstract: Fluid antenna system (FAS) has recently surfaced as a promising technology for the upcoming sixth generation (6G) wireless networks. Unlike traditional antenna system (TAS) with fixed antenna location, FAS introduces a flexible component where the radiating element can switch its position within a predefined space. This capability allows FAS to achieve additional diversity and multiplexing gains. Nevertheless, to fully reap the benefits of FAS, obtaining channel state information (CSI) over the predefined space is crucial. In this paper, we explore the interaction between a transmitter equipped with a traditional antenna and a receiver with a fluid antenna over an electromagnetic-compliant channel model. We address the challenges of channel estimation and reconstruction using Nyquist sampling and maximum likelihood estimation (MLE) methods. Our analysis reveals a fundamental tradeoff between the accuracy of the reconstructed channel and the number of estimated channels, indicating that half-wavelength sampling is insufficient for perfect reconstruction and that oversampling is essential to enhance accuracy. Despite its advantages, oversampling can introduce practical challenges. Consequently, we propose a suboptimal sampling distance that facilitates efficient channel reconstruction. In addition, we employ the MLE method to bound the channel estimation error by $\epsilon$, with a specific confidence interval (CI). Our findings enable us to determine the minimum number of estimated channels and the total number of pilot symbols required for efficient channel reconstruction in a given space. Lastly, we investigate the rate performance of FAS and TAS and demonstrate that FAS with imperfect CSI can outperform TAS with perfect CSI.


title: Design and fabrication of autonomous electronic lablets for chemical control

abstract: Lablets are autonomous microscopic particles with programmable CMOS electronics that canvcontrol electrokinetic phenomena and electrochemical reactions in solution via actuator and sensor microelectrodes. The lablets are designed to be rechargeable using an integrated supercapacitor, and to allow docking to one another or to a smart surface for interchange of energy, electronic information and chemicals. In this paper, we describe the design and fabrication of singulated lablets (CMOS2) at the scale of 100 by 200 {\mu}m, with the supercap adjacent to the functional lablet and occupying half the space. In other works, we have characterized the supercap and described the electronic design and proven functionality using arrays of these lablets. Here we present fabrication details for integrating functional coatings and the supercap and demonstrate electronic functionality of the lablets following singulation.


title: A way around the exponential scaling in optimal quantum control

abstract: We show that combining ideas from the fields of quantum invariants and of optimal control can be used to design quantum control of quantum systems without explicit reference to quantum states. The scaling in numerical effort of the resultant approach is given by commutation relations of system operators, and it can be polynomial in the number of subsystems despite the general quantum mechanical exponential scaling of the Hilbert space. As explicit applications, we discuss state preparation and quantum simulation with Hamiltonians including three-body and many-body interactions with spin chains of up to 50 constituents, and the perspective of use for topologically protected quantum information processing.


title: Increasing Efficiency and Result Reliability of Continuous Benchmarking for FaaS Applications

abstract: In a continuous deployment setting, Function-as-a-Service (FaaS) applications frequently receive updated releases, each of which can cause a performance regression. While continuous benchmarking, i.e., comparing benchmark results of the updated and the previous version, can detect such regressions, performance variability of FaaS platforms necessitates thousands of function calls, thus, making continuous benchmarking time-intensive and expensive. In this paper, we propose DuetFaaS, an approach which adapts duet benchmarking to FaaS applications. With DuetFaaS, we deploy two versions of FaaS function in a single cloud function instance and execute them in parallel to reduce the impact of platform variability. We evaluate our approach against state-of-the-art approaches, running on AWS Lambda. Overall, DuetFaaS requires fewer invocations to accurately detect performance regressions than other state-of-the-art approaches. In 99.65% of evaluated cases, our approach provides smaller confidence interval sizes than the comparing approaches, and can reduce the size by up to 98.23%.


title: Planet-driven spirals in protoplanetary discs: limitations of the semi-analytical theory for observations

abstract: Detecting protoplanets during their formation stage is an important but elusive goal of modern astronomy. Kinematic detections via the spiral wakes in the gaseous disc are a promising avenue to achieve this goal. We aim to test the applicability to observations in the low and intermediate planet mass regimes of a commonly used semi-analytical model for planet induced spiral waves. In contrast with previous works which proposed to use the semi-analytical model to interpret observations, in this study we analyse for the first time both the structure of the velocity and density perturbations. We run a set of FARGO3D hydrodynamic simulations and compare them with the output of the semi-analytic model in the code wakeflow, which is obtained by solving Burgers' equation using the simulations as an initial condition. We find that the velocity field derived from the analytic theory is discontinuous at the interface between the linear and nonlinear regions. After 0.2 r$_p$ from the planet, the behaviour of the velocity field closely follows that of the density perturbations. In the low mass limit, the analytical model is in qualitative agreement with the simulations, although it underestimates the azimuthal width and the amplitude of the perturbations, predicting a stronger decay but a slower azimuthal advance of the shock fronts. In the intermediate regime, the discrepancy increases, resulting in a different pitch angle between the spirals of the simulations and the analytic model. The implementation of a fitting procedure based on the minimisation of intensity residuals is bound to fail due to the deviation in pitch angle between the analytic model and the simulations. In order to apply this model to observations, it needs to be revisited accounting also for higher planet masses.


title: Dual opposing quadrature-PT symmetry

abstract: Our recent research on type-I quadrature parity-time (PT) symmetry, utilizing an open twin-beam system, not only enables observing genuine quantum photonic PT symmetry amid phase-sensitive amplification (PSA) and loss in the presence of Langevin noise but also reveals additional classical-to-quantum (C2Q) transitions in quadrature and relative-intensity noise fluctuations. In contrast to the previous setup, our exploration of an alternative system assuming no loss involves a type-II PSA-only scheme. This scheme facilitates dual opposing quadrature PT symmetry, offering a comprehensive and complementary comprehension of C2Q transitions and anti-Hermiticity-enhanced quantum sensing. Furthermore, our investigation into the correlation with the Einstein-Podolsky-Rosen criteria uncovers previously unexplored connections between PT symmetry and nonclassicality, as well as quantum entanglement within the continuous-variable framework.


title: Automatic Data Curation for Self-Supervised Learning: A Clustering-Based Approach

abstract: Self-supervised features are the cornerstone of modern machine learning systems. They are typically pre-trained on data collections whose construction and curation typically require extensive human effort. This manual process has some limitations similar to those encountered in supervised learning, e.g., the crowd-sourced selection of data is costly and time-consuming, preventing scaling the dataset size. In this work, we consider the problem of automatic curation of high-quality datasets for self-supervised pre-training. We posit that such datasets should be large, diverse and balanced, and propose a clustering-based approach for building ones satisfying all these criteria. Our method involves successive and hierarchical applications of $k$-means on a large and diverse data repository to obtain clusters that distribute uniformly among data concepts, followed by a hierarchical, balanced sampling step from these clusters. Extensive experiments on three different data domains including web-based images, satellite images and text show that features trained on our automatically curated datasets outperform those trained on uncurated data while being on par or better than ones trained on manually curated data.


title: Harnessing Large Language Models for Software Vulnerability Detection: A Comprehensive Benchmarking Study

abstract: Despite various approaches being employed to detect vulnerabilities, the number of reported vulnerabilities shows an upward trend over the years. This suggests the problems are not caught before the code is released, which could be caused by many factors, like lack of awareness, limited efficacy of the existing vulnerability detection tools or the tools not being user-friendly. To help combat some issues with traditional vulnerability detection tools, we propose using large language models (LLMs) to assist in finding vulnerabilities in source code. LLMs have shown a remarkable ability to understand and generate code, underlining their potential in code-related tasks. The aim is to test multiple state-of-the-art LLMs and identify the best prompting strategies, allowing extraction of the best value from the LLMs. We provide an overview of the strengths and weaknesses of the LLM-based approach and compare the results to those of traditional static analysis tools. We find that LLMs can pinpoint many more issues than traditional static analysis tools, outperforming traditional tools in terms of recall and F1 scores. The results should benefit software developers and security analysts responsible for ensuring that the code is free of vulnerabilities.


title: Sensitivity of K$\beta$ mainline X-ray emission to structural dynamics in iron photosensitizer

abstract: Photochemistry and photophysics processes involve structures far from equilibrium. In these reactions, there is often strong coupling between nuclear and electronic degrees of freedom. For first-row transition metals, K$\beta$ X-ray emission spectroscopy (XES) is a sensitive probe of electronic structure due to the direct overlap between the valence orbitals and the 3p hole in the final state. Here the sensitivity of K$\beta$ mainline (K$\beta$1,3) XES to structural dynamics is analyzed by simulating spectral changes along the excited state dynamics of an iron photosensitizer [FeII(bmip)2]2+ [bmip = 2,6-bis(3-methyl-imidazole-1-ylidine)-pyridine], using both restricted active space (RAS) multiconfigurational wavefunction theory and a one-electron orbital-energy approach in density-functional theory (1-DFT). Both methods predict a spectral blue-shift with increasing metal-ligand distance, which changes the emission intensity for any given detection energy. These results support the suggestion that the [FeII(bmip)2]2+ femtosecond K$\beta$ XES signal shows oscillations due to coherent wavepacket dynamics. Based on the RAS results, the sensitivity to structural dynamics is twice as high for K$\beta$ compared to K$\alpha$, with the drawback of a lower signal-to-noise ratio. K$\beta$ sensitivity is favored by a larger spectral blue-shift with increasing metal-ligand distance and larger changes in spectral shape. Comparing the two simulations methods, 1-DFT predicts smaller energy shifts and lower sensitivity, likely due to missing final-state effects. The simulations can be used to design and interpret XES probes of non-equilibrium structures to gain mechanistic insights in photocatalysis.


title: Neuromorphic dreaming: A pathway to efficient learning in artificial agents

abstract: Achieving energy efficiency in learning is a key challenge for artificial intelligence (AI) computing platforms. Biological systems demonstrate remarkable abilities to learn complex skills quickly and efficiently. Inspired by this, we present a hardware implementation of model-based reinforcement learning (MBRL) using spiking neural networks (SNNs) on mixed-signal analog/digital neuromorphic hardware. This approach leverages the energy efficiency of mixed-signal neuromorphic chips while achieving high sample efficiency through an alternation of online learning, referred to as the "awake" phase, and offline learning, known as the "dreaming" phase. The model proposed includes two symbiotic networks: an agent network that learns by combining real and simulated experiences, and a learned world model network that generates the simulated experiences. We validate the model by training the hardware implementation to play the Atari game Pong. We start from a baseline consisting of an agent network learning without a world model and dreaming, which successfully learns to play the game. By incorporating dreaming, the number of required real game experiences are reduced significantly compared to the baseline. The networks are implemented using a mixed-signal neuromorphic processor, with the readout layers trained using a computer in-the-loop, while the other layers remain fixed. These results pave the way toward energy-efficient neuromorphic learning systems capable of rapid learning in real world applications and use-cases.


title: Inductive detection of inverse spin-orbit torques in magnetic heterostructures

abstract: The manipulation of magnetization via Magnetic torques is one of the most important phenomena in spintronics. In thin films, conventionally, a charge current flowing in a heavy metal is used to generate transverse spin currents and to exert torques on the magnetization of an adjacent ferromagnetic thin film layer. Here, in contrast to the typically employed heavy metals, we study spin-to-charge conversion in ferromagnetic heterostructures with large spin-orbit interaction that function as the torque-generating layers. In particular, we chose perpendicular magnetic anisotropy (PMA) multilayers [Co/Ni] and [Co/Pt] as the torque-generating layers and drive magnetization dynamics in metallic ferromagnetic thin film $\mathrm{Co_{20}Fe_{60}B_{20}}$ (CoFeB) layers with in-plane magnetic anisotropy (IMA). We investigate the spin dynamics driven by spin-orbit torque (SOT) and the concomitant charge current generation by the inverse SOT process using an inductive technique based on a vector network analyzer. In our experimental findings, we find that the SOTs generated by our multilayers are of a magnitude comparable to those produced by Pt, consistent with first-principles calculations. Furthermore, we noted a significant correlation between the SOT and the thickness of the CoFeB layer.


title: MLPs Learn In-Context

abstract: In-context learning (ICL), the remarkable ability to solve a task from only input exemplars, has commonly been assumed to be a unique hallmark of Transformer models. In this study, we demonstrate that multi-layer perceptrons (MLPs) can also learn in-context. Moreover, we find that MLPs, and the closely related MLP-Mixer models, learn in-context competitively with Transformers given the same compute budget. We further show that MLPs outperform Transformers on a subset of ICL tasks designed to test relational reasoning. These results suggest that in-context learning is not exclusive to Transformers and highlight the potential of exploring this phenomenon beyond attention-based architectures. In addition, MLPs' surprising success on relational tasks challenges prior assumptions about simple connectionist models. Altogether, our results endorse the broad trend that ``less inductive bias is better" and contribute to the growing interest in all-MLP alternatives to task-specific architectures.


title: DiffCalib: Reformulating Monocular Camera Calibration as Diffusion-Based Dense Incident Map Generation

abstract: Monocular camera calibration is a key precondition for numerous 3D vision applications. Despite considerable advancements, existing methods often hinge on specific assumptions and struggle to generalize across varied real-world scenarios, and the performance is limited by insufficient training data. Recently, diffusion models trained on expansive datasets have been confirmed to maintain the capability to generate diverse, high-quality images. This success suggests a strong potential of the models to effectively understand varied visual information. In this work, we leverage the comprehensive visual knowledge embedded in pre-trained diffusion models to enable more robust and accurate monocular camera intrinsic estimation. Specifically, we reformulate the problem of estimating the four degrees of freedom (4-DoF) of camera intrinsic parameters as a dense incident map generation task. The map details the angle of incidence for each pixel in the RGB image, and its format aligns well with the paradigm of diffusion models. The camera intrinsic then can be derived from the incident map with a simple non-learning RANSAC algorithm during inference. Moreover, to further enhance the performance, we jointly estimate a depth map to provide extra geometric information for the incident map estimation. Extensive experiments on multiple testing datasets demonstrate that our model achieves state-of-the-art performance, gaining up to a 40% reduction in prediction errors. Besides, the experiments also show that the precise camera intrinsic and depth maps estimated by our pipeline can greatly benefit practical applications such as 3D reconstruction from a single in-the-wild image.


title: Measures, modular forms, and summation formulas of Poisson type

abstract: In this article, we show that Fourier eigenmeasures supported on spheres with radii given by a locally finite sequence, which we call $k$-spherical measures, correspond to Fourier series exhibiting a modular-type transformation behaviour with respect to the metaplectic group. A familiar subset of such Fourier series comprises holomorphic modular forms. This allows us to construct $k$-spherical eigenmeasures and derive Poisson-type summation formulas, thereby recovering formulas of a similar nature established by Cohn-Gon\c{c}alves, Lev-Reti, and Meyer, among others. Additionally, we extend our results to higher dimensions, where Hilbert modular forms yield higher-dimensional $k$-spherical measures.


title: On the Existence of Generalized Breathers and Transition Fronts in Time-Periodic Nonlinear Lattices

abstract: We prove the existence of a class of time-localized and space-periodic breathers (called q-gap breathers) in nonlinear lattices with time-periodic coefficients. These q-gap breathers are the counterparts to the classical space-localized and time-periodic breathers found in space-periodic systems. Using normal form transformations, we establish rigorously the existence of such solutions with oscillating tails (in the time domain) that can be made arbitrarily small, but finite. Due to the presence of the oscillating tails, these solutions are coined generalized q-gap breathers. Using a multiple-scale analysis, we also derive a tractable amplitude equation that describes the dynamics of breathers in the limit of small amplitude. In the presence of damping, we demonstrate the existence of transition fronts that connect the trivial state to the time-periodic ones. The analytical results are corroborated by systematic numerical simulations.


title: LAM3D: Large Image-Point-Cloud Alignment Model for 3D Reconstruction from Single Image

abstract: Large Reconstruction Models have made significant strides in the realm of automated 3D content generation from single or multiple input images. Despite their success, these models often produce 3D meshes with geometric inaccuracies, stemming from the inherent challenges of deducing 3D shapes solely from image data. In this work, we introduce a novel framework, the Large Image and Point Cloud Alignment Model (LAM3D), which utilizes 3D point cloud data to enhance the fidelity of generated 3D meshes. Our methodology begins with the development of a point-cloud-based network that effectively generates precise and meaningful latent tri-planes, laying the groundwork for accurate 3D mesh reconstruction. Building upon this, our Image-Point-Cloud Feature Alignment technique processes a single input image, aligning to the latent tri-planes to imbue image features with robust 3D information. This process not only enriches the image features but also facilitates the production of high-fidelity 3D meshes without the need for multi-view input, significantly reducing geometric distortions. Our approach achieves state-of-the-art high-fidelity 3D mesh reconstruction from a single image in just 6 seconds, and experiments on various datasets demonstrate its effectiveness.