title: FLAME Diffuser: Grounded Wildfire Image Synthesis using Mask Guided Diffusion

abstract: The rise of machine learning in recent years has brought benefits to various research fields such as wide fire detection. Nevertheless, small object detection and rare object detection remain a challenge. To address this problem, we present a dataset automata that can generate ground truth paired datasets using diffusion models. Specifically, we introduce a mask-guided diffusion framework that can fusion the wildfire into the existing images while the flame position and size can be precisely controlled. In advance, to fill the gap that the dataset of wildfire images in specific scenarios is missing, we vary the background of synthesized images by controlling both the text prompt and input image. Furthermore, to solve the color tint problem or the well-known domain shift issue, we apply the CLIP model to filter the generated massive dataset to preserve quality. Thus, our proposed framework can generate a massive dataset of that images are high-quality and ground truth-paired, which well addresses the needs of the annotated datasets in specific tasks.


title: q-Identities for parafermion theories

abstract: In this paper we will prove a series of $q$-identities suggested by the realisation of certain conformal field theories by so-called `coupled free fermions'. We will consider $q$-series arising from coupled free fermions constructed by the parafermion coset construction as well as from scaled root lattices, and some interesting relations between the two.


title: Self-Attention Empowered Graph Convolutional Network for Structure Learning and Node Embedding

abstract: In representation learning on graph-structured data, many popular graph neural networks (GNNs) fail to capture long-range dependencies, leading to performance degradation. Furthermore, this weakness is magnified when the concerned graph is characterized by heterophily (low homophily). To solve this issue, this paper proposes a novel graph learning framework called the graph convolutional network with self-attention (GCN-SA). The proposed scheme exhibits an exceptional generalization capability in node-level representation learning. The proposed GCN-SA contains two enhancements corresponding to edges and node features. For edges, we utilize a self-attention mechanism to design a stable and effective graph-structure-learning module that can capture the internal correlation between any pair of nodes. This graph-structure-learning module can identify reliable neighbors for each node from the entire graph. Regarding the node features, we modify the transformer block to make it more applicable to enable GCN to fuse valuable information from the entire graph. These two enhancements work in distinct ways to help our GCN-SA capture long-range dependencies, enabling it to perform representation learning on graphs with varying levels of homophily. The experimental results on benchmark datasets demonstrate the effectiveness of the proposed GCN-SA. Compared to other outstanding GNN counterparts, the proposed GCN-SA is competitive.


title: Systematic Improvement of Quantum Monte Carlo Calculations in Transition Metal Oxides: sCI-Driven Wavefunction Optimization for Reliable Band Gap prediction

abstract: Accurate determination of electronic properties of correlated oxides remains a significant challenge for computational theory. Traditional Hubbard-corrected density functional theory (DFT+U) frequently encounters limitations in precisely capturing electron correlation, particularly when predicting band gaps. We introduce a systematic methodology to enhance the accuracy of diffusion Monte Carlo (DMC) simulations for both ground and excited states, focusing on LiCoO$_2$ as a case study. By employing a selected CI (sCI) approach, we demonstrate the capability to optimize wavefunctions beyond the constraints of single-reference DFT+U trial wavefunctions. We show that the sCI framework enables accurate prediction of band gaps in LiCoO$_2$, closely aligning with experimental values and substantially improving upon traditional computational methods. The study uncovers a nuanced mixed state of $t_{2g}$ a $e_g$ orbitals at the band edges that is not captured by conventional single-reference methods, further elucidating the limitations of PBE+U in describing $d$-$d$ excitations. Our findings advocate for the adoption of beyond-DFT methodologies, such as sCI, to capture the essential physics of excited state wavefunctions in strongly correlated materials. The improved accuracy in band gap predictions and the ability to generate more reliable trial wavefunctions for DMC calculations underscore the potential of this approach for broader applications in the study of correlated oxides. This work not only provides a pathway for more accurate simulations of electronic structures in complex materials but also suggests a framework for future investigations into the excited states of other challenging systems.


title: Multimode Quantum Correlations in Supercontinuum Pulses

abstract: Suprecontinuum (SC) light contains complex spectral noise structure and its accurate characterization is important for fundamental understanding of its physics as well as for its applications. Several experimental and theoretical noise characterizations have been performed so far. However, none of them takes into account the quantum mechanical properties. Here, we demonstrate experimental characterisation of quantum noise and its spectral correlations formed in the SC light generated from a photonic crystal fiber. Moreover, by applying an appropriate basis transformation to these correlations, we demonstrate that the SC noise amplitude can be squeezed below the shot-noise limit in some bases, even in the presence of excessively large nonlinearities.


title: Multi-task Learning for Real-time Autonomous Driving Leveraging Task-adaptive Attention Generator

abstract: Real-time processing is crucial in autonomous driving systems due to the imperative of instantaneous decision-making and rapid response. In real-world scenarios, autonomous vehicles are continuously tasked with interpreting their surroundings, analyzing intricate sensor data, and making decisions within split seconds to ensure safety through numerous computer vision tasks. In this paper, we present a new real-time multi-task network adept at three vital autonomous driving tasks: monocular 3D object detection, semantic segmentation, and dense depth estimation. To counter the challenge of negative transfer, which is the prevalent issue in multi-task learning, we introduce a task-adaptive attention generator. This generator is designed to automatically discern interrelations across the three tasks and arrange the task-sharing pattern, all while leveraging the efficiency of the hard-parameter sharing approach. To the best of our knowledge, the proposed model is pioneering in its capability to concurrently handle multiple tasks, notably 3D object detection, while maintaining real-time processing speeds. Our rigorously optimized network, when tested on the Cityscapes-3D datasets, consistently outperforms various baseline models. Moreover, an in-depth ablation study substantiates the efficacy of the methodologies integrated into our framework.


title: Exponential learning advantages with conjugate states and minimal quantum memory

abstract: The ability of quantum computers to directly manipulate and analyze quantum states stored in quantum memory allows them to learn about aspects of our physical world that would otherwise be invisible given a modest number of measurements. Here we investigate a new learning resource which could be available to quantum computers in the future -- measurements on the unknown state accompanied by its complex conjugate $\rho \otimes \rho^\ast$. For a certain shadow tomography task, we surprisingly find that measurements on only copies of $\rho \otimes \rho^\ast$ can be exponentially more powerful than measurements on $\rho^{\otimes K}$, even for large $K$. This expands the class of provable exponential advantages using only a constant overhead quantum memory, or minimal quantum memory, and we provide a number of examples where the state $\rho^\ast$ is naturally available in both computational and physical applications. In addition, we precisely quantify the power of classical shadows on single copies under a generalized Clifford ensemble and give a class of quantities that can be efficiently learned. The learning task we study in both the single copy and quantum memory settings is physically natural and corresponds to real-space observables with a limit of bosonic modes, where it achieves an exponential improvement in detecting certain signals under a noisy background. We quantify a new and powerful resource in quantum learning, and we believe the advantage may find applications in improving quantum simulation, learning from quantum sensors, and uncovering new physical phenomena.


title: Burnett's conjecture in generalized wave coordinates

abstract: We prove Burnett's conjecture in general relativity when the metrics satisfy a generalized wave coordinate condition, i.e., suppose $\{g_n\}_{n=1}^\infty$ is a sequence of Lorentzian metrics (in arbitrary dimensions $d \geq 3$) satisfying a generalized wave coordinate condition and such that $g_n\to g$ in a suitably weak and "high-frequency" manner, then the limit metric $g$ satisfies the Einstein--massless Vlasov system. Moreover, we show that the Vlasov field for the limiting metric can be taken to be a suitable microlocal defect measure corresponding to the convergence. The proof uses a compensation phenomenon based on the linear and nonlinear structure of the Einstein equations.


title: Coupled free fermion conformal field theories

abstract: We study a specific class of CFTs that involve coupled free fermions, arising from parafermion CFTs and lattice constructions. We analyse their representation spaces and the underlying exclusion statistics of coupled free fermions using specific bases. In one particular case, we reveal an unexpected connection between the coset construction of parafermions, the lattice construction, and and orbifold thereof. This connection is supported by proving a range of character identities within the context of coupled free fermions. Simultaneously, we obtain explicit expressions of certain string functions in terms of Dedekind eta functions.


title: Boosting Meta-Training with Base Class Information for Few-Shot Learning

abstract: Few-shot learning, a challenging task in machine learning, aims to learn a classifier adaptable to recognize new, unseen classes with limited labeled examples. Meta-learning has emerged as a prominent framework for few-shot learning. Its training framework is originally a task-level learning method, such as Model-Agnostic Meta-Learning (MAML) and Prototypical Networks. And a recently proposed training paradigm called Meta-Baseline, which consists of sequential pre-training and meta-training stages, gains state-of-the-art performance. However, as a non-end-to-end training method, indicating the meta-training stage can only begin after the completion of pre-training, Meta-Baseline suffers from higher training cost and suboptimal performance due to the inherent conflicts of the two training stages. To address these limitations, we propose an end-to-end training paradigm consisting of two alternative loops. In the outer loop, we calculate cross entropy loss on the entire training set while updating only the final linear layer. In the inner loop, we employ the original meta-learning training mode to calculate the loss and incorporate gradients from the outer loss to guide the parameter updates. This training paradigm not only converges quickly but also outperforms existing baselines, indicating that information from the overall training set and the meta-learning training paradigm could mutually reinforce one another. Moreover, being model-agnostic, our framework achieves significant performance gains, surpassing the baseline systems by approximate 1%.


title: Inverse-Free Fast Natural Gradient Descent Method for Deep Learning

abstract: Second-order optimization techniques have the potential to achieve faster convergence rates compared to first-order methods through the incorporation of second-order derivatives or statistics. However, their utilization in deep learning is limited due to their computational inefficiency. Various approaches have been proposed to address this issue, primarily centered on minimizing the size of the matrix to be inverted. Nevertheless, the necessity of performing the inverse operation iteratively persists. In this work, we present a fast natural gradient descent (FNGD) method that only requires inversion during the first epoch. Specifically, it is revealed that natural gradient descent (NGD) is essentially a weighted sum of per-sample gradients. Our novel approach further proposes to share these weighted coefficients across epochs without affecting empirical performance. Consequently, FNGD exhibits similarities to the average sum in first-order methods, leading to the computational complexity of FNGD being comparable to that of first-order methods. Extensive experiments on image classification and machine translation tasks demonstrate the efficiency of the proposed FNGD. For training ResNet-18 on CIFAR-100, FNGD can achieve a speedup of 2.07$\times$ compared with KFAC. For training Transformer on Multi30K, FNGD outperforms AdamW by 24 BLEU score while requiring almost the same training time.


title: Symmetric Perfect $2$-colorings on $J(10,3)$

abstract: We study perfect $2$-coloring of the Johnson graphs $J(n,3)$ associated with the third largest eigenvalue and symmetric quotient matrix, which exists only when $n \in \{6, 10\}$. We survey the known constructions in the case $n=6$, give a new construction for the two known perfect $2$-colorings in the case $n=10$, and prove that these are the only possible ones.


title: Non-homogeneous anisotropic bulk viscosity for acoustic wave attenuation in weakly compressible methods

abstract: A major limitation of the weakly compressible approaches to simulate incompressible flows is the appearance of artificial acoustic waves that introduce a large mass conservation error and lead to spurious oscillations in the force coefficients. In this work, we propose a non-homogeneous anisotropic bulk viscosity term to effectively damp the acoustic waves. By implementing this term in a computational framework based on the recently proposed general pressure equation, we demonstrate that the non-homogeneous and anisotropic nature of the term makes it significantly more effective than the isotropic homogeneous version widely used in the literature. Moreover, it is computationally more efficient than the pressure (or mass) diffusion term, which is an alternative mechanism used to suppress acoustic waves. We simulate a range of benchmark problems to comprehensively investigate the performance of the bulk viscosity on the effective suppression of acoustic waves, mass conservation error, order of convergence of the solver, and computational efficiency. The proposed form of the bulk viscosity enables fairly accurate modelling of the initial transients of unsteady simulations, which is highly challenging for weakly compressible approaches, and to the best of our knowledge, existing approaches can't provide an accurate prediction of such transients.


title: Korovkin-type approximation for non positive operators

abstract: This article investigates the convergence properties of Grunwald-type operators defined using the Lagrange interpolation operator. In $C[0, \pi]$, we establish sufficient conditions under which alternate grid point selection yields a convergence result. Employing a quantitative approach grounded in the modulus of continuity, we derive a theorem that provides insightful estimates for the convergence of Grunwald operator, accompanied by illustrative numerical examples. Addressing challenges related to continuity, we extend the operator to $L^1(\mathbb{R})$ and prove similar convergence results. Notably, the new operator demonstrates a uniform order of convergence on a dense subspace of $L^1(\mathbb{R})$. Moreover, it has a better convergence rate than Grunwald operator. We establish the non positivity of the Lagrange interpolation operator and, consequently, the constructed operators. Significant emphasis is placed on D.E. Wulbert theorem ($1968$), which is a Korovkin-type theorem that can be applied to non-positive operators. We extend this theorem to a broader class of operators, enabling its effective application to the constructed operators. This article, overall, highlights the broad applicability of Lagrange interpolation across diverse disciplines.


title: Continual Segmentation with Disentangled Objectness Learning and Class Recognition

abstract: Most continual segmentation methods tackle the problem as a per-pixel classification task. However, such a paradigm is very challenging, and we find query-based segmenters with built-in objectness have inherent advantages compared with per-pixel ones, as objectness has strong transfer ability and forgetting resistance. Based on these findings, we propose CoMasTRe by disentangling continual segmentation into two stages: forgetting-resistant continual objectness learning and well-researched continual classification. CoMasTRe uses a two-stage segmenter learning class-agnostic mask proposals at the first stage and leaving recognition to the second stage. During continual learning, a simple but effective distillation is adopted to strengthen objectness. To further mitigate the forgetting of old classes, we design a multi-label class distillation strategy suited for segmentation. We assess the effectiveness of CoMasTRe on PASCAL VOC and ADE20K. Extensive experiments show that our method outperforms per-pixel and query-based methods on both datasets. Code will be available at https://github.com/jordangong/CoMasTRe.


title: Hermitian-preserving ansatz and variational open quantum eigensolver

abstract: We propose a new variational quantum algorithm named Variational Open Quantum Eigensolver (VOQE) for solving steady states of open quantum systems described by either Lindblad master equations or non-Hermitian Hamiltonians. In VOQE, density matrices of mixed states are represented by pure states in doubled Hilbert space. We give a framework for building circuit ansatz which we call the Hermitian-preserving ansatz (HPA) to restrict the searching space. We also give a method to efficiently measure the operators' expectation values by post-selection measurements. We show the workflow of VOQE on solving steady states of the LMEs of the driven XXZ model and implement VOQE to solve the spectrum of the non-Hermitian Hamiltonians of the Ising spin chain in an imaginary field.


title: Observation of counterflow superfluidity in a two-component Mott insulator

abstract: The counterflow superfluidity (CSF) was predicted two decades ago. Counterintuitively, while both components in the CSF have fluidity, their correlated counterflow currents cancel out leading the overall system to an incompressible Mott insulator. However, realizing and identifying the CSF remain challenging due to the request on extreme experimental capabilities in a single setup. Here, we observe the CSF in a binary Bose mixture in optical lattices. We prepare a low-entropy spin-Mott state by conveying and merging two spin-1/2 bosonic atoms at every site and drive it adiabatically to the CSF at $\sim$ 1 nK. Antipair correlations of the CSF are probed though a site- and spin-resolved quantum gas microscope in both real and momentum spaces. These techniques and observations provide accessibility to the symmetry-protected topological quantum matters.


title: Impurities, or dopants, that is the question

abstract: The numerous stories around LK-99 as a possible room-temperature superconductor over the summer of 2023 epitomise that materials are more than a bulk crystallographic structure or an expected composition. Like all materials, those at the core of technologies for the energy generation transition, including batteries, catalysts or quantum materials draw their properties from a hierarchy of microstructural features where impurities can dramatically influence the outcomes. As we move towards a circular economy, the recycling of materials will inevitably create fluxes of increasingly impure materials, generating new challenges for fabricating materials with controlled properties. Here, we provide our perspective on how high-end microscopy and microanalysis have helped us to understand relationships between synthesis, processing and microstructure, avoiding imprecise or even erroneous interpretations on the origins of the properties from a range of materials. We highlight examples of how unexpected impurities and their spatial distribution on the nanoscale can be turned into an advantage to define pathways for synthesis of materials with new and novel sets of physical properties.


title: Magic Markup: Maintaining Document-External Markup with an LLM

abstract: Text documents, including programs, typically have human-readable semantic structure. Historically, programmatic access to these semantics has required explicit in-document tagging. Especially in systems where the text has an execution semantics, this means it is an opt-in feature that is hard to support properly. Today, language models offer a new method: metadata can be bound to entities in changing text using a model's human-like understanding of semantics, with no requirements on the document structure. This method expands the applications of document annotation, a fundamental operation in program writing, debugging, maintenance, and presentation. We contribute a system that employs an intelligent agent to re-tag modified programs, enabling rich annotations to automatically follow code as it evolves. We also contribute a formal problem definition, an empirical synthetic benchmark suite, and our benchmark generator. Our system achieves an accuracy of 90% on our benchmarks and can replace a document's tags in parallel at a rate of 5 seconds per tag. While there remains significant room for improvement, we find performance reliable enough to justify further exploration of applications.


title: Chemically Tailored Growth of 2D Semiconductors via Hybrid Metal-Organic Chemical Vapor Deposition

abstract: Two-dimensional (2D) semiconducting transition-metal dichalcogenides (TMDCs) are an exciting platform for new excitonic physics and next-generation electronics, creating a strong demand to understand their growth, doping, and heterostructures. Despite significant progress in solid-source (SS-) and metal-organic chemical vapor deposition (MOCVD), further optimization is necessary to grow highly crystalline 2D TMDCs with controlled doping. Here, we report a hybrid MOCVD growth method that combines liquid-phase metal precursor deposition and vapor-phase organo-chalcogen delivery to leverage the advantages of both MOCVD and SS-CVD. Using our hybrid approach, we demonstrate WS$_2$ growth with tunable morphologies - from separated single-crystal domains to continuous monolayer films - on a variety of substrates, including sapphire, SiO$_2$, and Au. These WS$_2$ films exhibit narrow neutral exciton photoluminescence linewidths down to 33 meV and room-temperature mobility up to 34 - 36 cm$^2$V$^-$$^1$s$^-$$^1$). Through simple modifications to the liquid precursor composition, we demonstrate the growth of V-doped WS$_2$, MoxW$_1$$_-$$_x$S$_2$ alloys, and in-plane WS$_2$-MoS$_2$ heterostructures. This work presents an efficient approach for addressing a variety of TMDC synthesis needs on a laboratory scale.


title: A Teacher-Free Graph Knowledge Distillation Framework with Dual Self-Distillation

abstract: Recent years have witnessed great success in handling graph-related tasks with Graph Neural Networks (GNNs). Despite their great academic success, Multi-Layer Perceptrons (MLPs) remain the primary workhorse for practical industrial applications. One reason for such an academic-industry gap is the neighborhood-fetching latency incurred by data dependency in GNNs. To reduce their gaps, Graph Knowledge Distillation (GKD) is proposed, usually based on a standard teacher-student architecture, to distill knowledge from a large teacher GNN into a lightweight student GNN or MLP. However, we found in this paper that neither teachers nor GNNs are necessary for graph knowledge distillation. We propose a Teacher-Free Graph Self-Distillation (TGS) framework that does not require any teacher model or GNNs during both training and inference. More importantly, the proposed TGS framework is purely based on MLPs, where structural information is only implicitly used to guide dual knowledge self-distillation between the target node and its neighborhood. As a result, TGS enjoys the benefits of graph topology awareness in training but is free from data dependency in inference. Extensive experiments have shown that the performance of vanilla MLPs can be greatly improved with dual self-distillation, e.g., TGS improves over vanilla MLPs by 15.54% on average and outperforms state-of-the-art GKD algorithms on six real-world datasets. In terms of inference speed, TGS infers 75X-89X faster than existing GNNs and 16X-25X faster than classical inference acceleration methods.


title: Hubble tension may indicate time-dependent dark matter comoving energy density

abstract: The values of Hubble constant H0 by direct measurements with standard distance ladder are typically larger than those obtained from the observation of cosmic microwave background and the galaxy survey with inverse distance ladder. On the other hand, although the errors are still large, various determinations of the value of matter density parameter Omega_m are consistent with each other. Therefore, it is possible that the difference in Hubble constant is translated to the difference of physical matter energy density omega_m = Omega_m h^2, where h = H0 / (100 Km/s/Mpc). In this article it is examined the possibility of an increase of the physical dark matter energy density (comoving energy density without the effect of expansion of the universe) by a fast transition at a certain value of redshift as a possible resolution of the Hubble tension. A phenomenological fluid model of the dark sector, which is the modification of a so-called unified dark matter model, is introduced to concretely realize such a fast transition in the physical dark matter energy density.


title: NoiseCollage: A Layout-Aware Text-to-Image Diffusion Model Based on Noise Cropping and Merging

abstract: Layout-aware text-to-image generation is a task to generate multi-object images that reflect layout conditions in addition to text conditions. The current layout-aware text-to-image diffusion models still have several issues, including mismatches between the text and layout conditions and quality degradation of generated images. This paper proposes a novel layout-aware text-to-image diffusion model called NoiseCollage to tackle these issues. During the denoising process, NoiseCollage independently estimates noises for individual objects and then crops and merges them into a single noise. This operation helps avoid condition mismatches; in other words, it can put the right objects in the right places. Qualitative and quantitative evaluations show that NoiseCollage outperforms several state-of-the-art models. These successful results indicate that the crop-and-merge operation of noises is a reasonable strategy to control image generation. We also show that NoiseCollage can be integrated with ControlNet to use edges, sketches, and pose skeletons as additional conditions. Experimental results show that this integration boosts the layout accuracy of ControlNet. The code is available at https://github.com/univ-esuty/noisecollage.


title: PhenoAuth: A Novel PUF-Phenotype-based Authentication Protocol for IoT Devices

abstract: Physical Unclonable Functions (PUFs) have been shown to be a highly promising solution for enabling high security systems tailored for low-power devices. Commonly, PUFs are utilised to generate cryptographic keys on-the-fly, replacing the need to store keys in vulnerable, non-volatile memories. Due to the physical nature of PUFs, environmental variations cause noise, manifesting themselves as errors which are apparent in the initial PUF measurements. This necessitates expensive active error correction techniques which can run counter to the goal of lightweight security. ML-based techniques for authenticating noisy PUF measurements were explored as an alternative to error correction techniques, bringing about the concept of a PUF Phenotype, where PUF identity is considered as a structure agnostic representation of the PUF, with relevant noise encoding. This work proposes a full noise-tolerant authentication protocol based on the PUF Phenotype concept and methodology for an Internet-of-Things (IoT) network, demonstrating mutual authentication and forward secrecy in a setting suitable for device-to-device communication. Upon conducting security and performance analyses, it is evident that our proposed scheme demonstrates resilience against various attacks compared to the currently existing PUF protocols.


title: Study of eccentric binary black hole mergers using numerical relativity and an inspiral-merger-ringdown model

abstract: We study the phenomenology of non-spinning eccentric binary black hole (BBH) mergers using numerical relativity (NR) waveforms and \texttt{EccentricIMR} waveform model, as presented in Ref. \cite{Hinder:2017sxy} (Hinder, Kidder, and Pfeiffer, arXiv:1709.02007). This model is formulated by combining an eccentric inspiral, derived from a post-Newtonian (PN) approximation including 3PN conservative and 2PN reactive contributions to the BBH dynamics, with a circular merger model. A distinctive feature of \texttt{EccentricIMR} is its two-parameter treatment, utilizing eccentricity and mean anomaly, to characterize eccentric waveforms. We implement the \texttt{EccentricIMR} model in \texttt{Python} to facilitate routine use. We then validate the model against 35 eccentric NR waveforms obtained from both the SXS and RIT NR catalogs. We find that \texttt{EccentricIMR} model reasonably match NR data for eccentricities up to $0.16$, specified at a dimensionless reference frequency of $x=0.07$, and mass ratios up to $q=4$. Additionally, we use this model as a tool for cross-comparing eccentric NR data obtained from the SXS and RIT catalogs. Furthermore, we explore the validity of a circular merger model often used in eccentric BBH merger modelling using both the NR data and \texttt{EccentricIMR} model. Finally, we use this model to explore the effect of mean anomaly in eccentric BBH mergers.


title: Fast, nonlocal and neural: a lightweight high quality solution to image denoising

abstract: With the widespread application of convolutional neural networks (CNNs), the traditional model based denoising algorithms are now outperformed. However, CNNs face two problems. First, they are computationally demanding, which makes their deployment especially difficult for mobile terminals. Second, experimental evidence shows that CNNs often over-smooth regular textures present in images, in contrast to traditional non-local models. In this letter, we propose a solution to both issues by combining a nonlocal algorithm with a lightweight residual CNN. This solution gives full latitude to the advantages of both models. We apply this framework to two GPU implementations of classic nonlocal algorithms (NLM and BM3D) and observe a substantial gain in both cases, performing better than the state-of-the-art with low computational requirements. Our solution is between 10 and 20 times faster than CNNs with equivalent performance and attains higher PSNR. In addition the final method shows a notable gain on images containing complex textures like the ones of the MIT Moire dataset.


title: Global Geolocated Realtime Data of Interfleet Urban Transit Bus Idling

abstract: Urban transit bus idling is a contributor to ecological stress, economic inefficiency, and medically hazardous health outcomes due to emissions. The global accumulation of this frequent pattern of undesirable driving behavior is enormous. In order to measure its scale, we propose GRD-TRT- BUF-4I (Ground Truth Buffer for Idling) an extensible, realtime detection system that records the geolocation and idling duration of urban transit bus fleets internationally. Using live vehicle locations from General Transit Feed Specification (GTFS) Realtime, the system detects approximately 200,000 idling events per day from over 50 cities across North America, Europe, Oceania, and Asia. This realtime data was created to dynamically serve operational decision-making and fleet management to reduce the frequency and duration of idling events as they occur, as well as to capture its accumulative effects. Civil and Transportation Engineers, Urban Planners, Epidemiologists, Policymakers, and other stakeholders might find this useful for emissions modeling, traffic management, route planning, and other urban sustainability efforts at a variety of geographic and temporal scales.


title: A comparative study of cosmological constraints from weak lensing using Convolutional Neural Networks

abstract: Weak Lensing (WL) surveys are reaching unprecedented depths, enabling the investigation of very small angular scales. At these scales, nonlinear gravitational effects lead to higher-order correlations making the matter distribution highly non-Gaussian. Extracting this information using traditional statistics has proven difficult, and Machine Learning based summary statistics have emerged as a powerful alternative. We explore the capabilities of a discriminative, Convolutional Neural Networks (CNN) based approach, focusing on parameter constraints in the ($\Omega_m$, $\sigma_8$) cosmological parameter space. Leveraging novel training loss functions and network representations on WL mock datasets without baryons, we show that our models achieve $\sim 5$ times stronger constraints than the power spectrum, $\sim 3$ stronger constraints than peak counts, and $\sim 2$ stronger constraints than previous CNN-learned summary statistics and scattering transforms, for noise levels relevant to Rubin or Euclid. For WL convergence maps with baryonic physics, our models achieve $\sim 2.3$ times stronger constraining power than the power spectrum at these noise levels, also outperforming previous summary statistics. To further explore the possibilities of CNNs for this task, we also discuss transfer learning where we adapt pre-trained models, trained on different tasks or datasets, for cosmological inference, finding that these do not improve the performance.


title: Practical Approach to Extending Baselines of Telescopes using Continuous-Variable Quantum Information

abstract: Interferometric telescopes are instrumental for the imaging of distant astronomical bodies, but optical loss heavily restricts how far telescopes in an array can be placed from one another, leading to a bottleneck in the resolution that can be achieved. An entanglement-assisted approach to this problem has been proposed by Gottesman, Jennewein, and Croke (GJC12) [Physical Review Letters, 109(7):070503, July 2011], as a possible solution to the issue of optical loss if the entangled state can be distributed across long distances by employing a quantum repeater network. In this paper, we propose an alternative entanglement-assisted scheme that interferes a two-mode squeezed vacuum state with the astronomical state and then measures the resulting state by means of homodyne detection. We use a continuous-variable approach and compute the Fisher information with respect to the mutual coherence of the astronomical source. We show that when the Fisher information is observed cumulatively at the rate at which successful measurements can be performed, our proposed scheme does not outperforms the traditional direct detection approach or the entanglement-assisted approach of GJC12.


title: Joint User Association and Resource Allocation for Tailored QoS Provisioning in 6G HetNets

abstract: The proliferation of wireless-enabled applications with divergent quality of service (QoS) requirements necessitates tailored QoS provisioning. With the growing complexity of wireless infrastructures, application-specific QoS perceived by a user equipment (UE) is jointly determined by its association with the supporting base station in heterogeneous networks (HetNets) and the amount of resource allocated to it. However, conventional application-agnostic objective-based user association and resource allocation often ignore the differences among applications' specific requirements for resources, inevitably preventing tailored QoS provisioning. Hence, in this paper, the problem of joint user association and resource allocation with application-specific objectives is investigated for achieving tailored QoS provisioning in 6G HetNets. This problem is intrinsically difficult to solve directly due to the extremely large solution space and the combination of discrete and continuous variables. Therefore, we decompose the original problem into two subproblems, i.e. user association and resource allocation, and propose an interactive optimization algorithm (IOA) to solve them iteratively in an interactive way until convergence is achieved. Specifically, matching theory is utilized to solve resource allocation and user association is solved heuristically. Extensive experimental results confirm that IOA algorithm outperforms several baseline algorithms in terms of both average utility and UE satisfaction ratio.


title: VastTrack: Vast Category Visual Object Tracking

abstract: In this paper, we introduce a novel benchmark, dubbed VastTrack, towards facilitating the development of more general visual tracking via encompassing abundant classes and videos. VastTrack possesses several attractive properties: (1) Vast Object Category. In particular, it covers target objects from 2,115 classes, largely surpassing object categories of existing popular benchmarks (e.g., GOT-10k with 563 classes and LaSOT with 70 categories). With such vast object classes, we expect to learn more general object tracking. (2) Larger scale. Compared with current benchmarks, VastTrack offers 50,610 sequences with 4.2 million frames, which makes it to date the largest benchmark regarding the number of videos, and thus could benefit training even more powerful visual trackers in the deep learning era. (3) Rich Annotation. Besides conventional bounding box annotations, VastTrack also provides linguistic descriptions for the videos. The rich annotations of VastTrack enables development of both the vision-only and the vision-language tracking. To ensure precise annotation, all videos are manually labeled with multiple rounds of careful inspection and refinement. To understand performance of existing trackers and to provide baselines for future comparison, we extensively assess 25 representative trackers. The results, not surprisingly, show significant drops compared to those on current datasets due to lack of abundant categories and videos from diverse scenarios for training, and more efforts are required to improve general tracking. Our VastTrack and all the evaluation results will be made publicly available https://github.com/HengLan/VastTrack.


title: Scalable ATLAS pMSSM computational workflows using containerised REANA reusable analysis platform

abstract: In this paper we describe the development of a streamlined framework for large-scale ATLAS pMSSM reinterpretations of LHC Run-2 analyses using containerised computational workflows. The project is looking to assess the global coverage of BSM physics and requires running O(5k) computational workflows representing pMSSM model points. Following ATLAS Analysis Preservation policies, many analyses have been preserved as containerised Yadage workflows, and after validation were added to a curated selection for the pMSSM study. To run the workflows at scale, we utilised the REANA reusable analysis platform. We describe how the REANA platform was enhanced to ensure the best concurrent throughput by internal service scheduling changes. We discuss the scalability of the approach on Kubernetes clusters from 500 to 5000 cores. Finally, we demonstrate a possibility of using additional ad-hoc public cloud infrastructure resources by running the same workflows on the Google Cloud Platform.


title: Aharonov-Bohm effect mediated by massive photons

abstract: Virtual photons play an essential role in the locally realistic description of the Aharonov-Bohm interference. We show that the effect of virtual photons in the interferometer is manifested by a change in their spectrum. In particular, when a vacuum is confined between two ideal conducting plates, the photons obey the two-dimensional Proca equation, the wave equation with finite effective mass. This results in a short-range interaction between a test charge and a magnetic flux, and hence the Aharonov-Bohm effect is reduced exponentially at a large distance between the two bodies. On the other hand, a semiclassical description is also possible, and this raises the interesting question of how to prove the physical reality of virtual photons.


title: A Knowledge Plug-and-Play Test Bed for Open-domain Dialogue Generation

abstract: Knowledge-based, open-domain dialogue generation aims to build chit-chat systems that talk to humans using mined support knowledge. Many types and sources of knowledge have previously been shown to be useful as support knowledge. Even in the era of large language models, response generation grounded in knowledge retrieved from additional up-to-date sources remains a practically important approach. While prior work using single-source knowledge has shown a clear positive correlation between the performances of knowledge selection and response generation, there are no existing multi-source datasets for evaluating support knowledge retrieval. Further, prior work has assumed that the knowledge sources available at test time are the same as during training. This unrealistic assumption unnecessarily handicaps models, as new knowledge sources can become available after a model is trained. In this paper, we present a high-quality benchmark named multi-source Wizard of Wikipedia (Ms.WoW) for evaluating multi-source dialogue knowledge selection and response generation. Unlike existing datasets, it contains clean support knowledge, grounded at the utterance level and partitioned into multiple knowledge sources. We further propose a new challenge, dialogue knowledge plug-and-play, which aims to test an already trained dialogue model on using new support knowledge from previously unseen sources in a zero-shot fashion.


title: Adaptive coordination promotes collective cooperation in repeated social dilemmas

abstract: Direct reciprocity based on the repeated prisoner's dilemma has been intensively studied. Most theoretical investigations have concentrated on memory-$1$ strategies, a class of elementary strategies just reacting to the previous-round outcomes. Though the properties of "All-or-None" strategies ($AoN_K$) have been discovered, simulations just confirmed the good performance of $AoN_K$ of very short memory lengths. It remains unclear how $AoN_K$ strategies would fare when players have access to longer rounds of history information. We construct a theoretical model to investigate the performance of the class of $AoN_K$ strategies of varying memory length $K$. We rigorously derive the payoffs and show that $AoN_K$ strategies of intermediate memory length $K$ are most prevalent, while strategies of larger memory lengths are less competent. Larger memory lengths make it hard for $AoN_K$ strategies to coordinate, and thus inhibiting their mutual reciprocity. We then propose the adaptive coordination strategy combining tolerance and $AoN_K$' coordination rule. This strategy behaves like $AoN_K$ strategy when coordination is not sufficient, and tolerates opponents' occasional deviations by still cooperating when coordination is sufficient. We found that the adaptive coordination strategy wins over other classic memory-$1$ strategies in various typical competition environments, and stabilizes the population at high levels of cooperation, suggesting the effectiveness of high level adaptability in resolving social dilemmas. Our work may offer a theoretical framework for exploring complex strategies using history information, which are different from traditional memory-$n$ strategies.


title: Some Remarks on Maesaka-Seki-Watanabe's Formula for the Multiple Harmonic Sums

abstract: Recently, Maesaka, Seki and Watanabe discovered a surprising equality between multiple harmonic sums and certain Riemann sums which approximate the iterated integral expression of the multiple zeta values. In this paper, we describe the formula corresponding to the multiple zeta-star values and, more generally, to the Schur multiple zeta values of diagonally constant indices. We also discuss the relationship of these formulas with Hoffman's duality identity and an identity due to Kawashima.


title: CNN-based End-to-End Adaptive Controller with Stability Guarantees

abstract: This letter proposes a convolutional neural network (CNN)-based adaptive controller wtih three notable features: 1) it determines control input directly from historical sensor data (in an end-to-end process); 2) it learns the desired control policy during real-time implementation without using a pretrained network (in an online adaptive manner); and 3) the asymptotic tracking error convergence is proven during the learning process (to deliver a stability guarantee). An adaptive law for learning the desired control policy is derived using the gradient descent optimization method, and its stability is analyzed based on the Lyapunov approach. A simulation study using a control-affine nonlinear system demonstrated that the proposed controller exhibits these features, and its performance can be tuned by manipulating the design parameters. In addition, it is shown that the proposed controller has a superior tracking performance to that of a deep neural network (DNN)-based adaptive controller.


title: Observation of the decay $h_{c}\to3(\pi^{+}\pi^{-})\pi^{0}$

abstract: Based on $(2712.4\pm14.1)\times10^{6}$ $\psi(3686)$ events collected with the BESIII detector, we study the decays $h_{c}\to3(\pi^{+}\pi^{-})\pi^{0}$, $h_{c}\to2(\pi^{+}\pi^{-})\omega$, $h_{c}\to2(\pi^{+}\pi^{-})\pi^{0}\eta$, $h_{c}\to2(\pi^{+}\pi^{-})\eta$, and $h_{c}\to p\bar{p}$ via $\psi(3686)\to\pi^{0}h_{c}$. The decay channel $h_{c}\to3(\pi^{+}\pi^{-})\pi^{0}$ is observed for the first time, and its branching fraction is determined to be $\left( {9.28\pm 1.14 \pm 0.77} \right) \times {10^{ - 3}}$, where the first uncertainty is statistical and the second is systematic. In addition, first evidence is found for the modes $h_{c} \to 2(\pi^{+}\pi^{-})\pi^{0}\eta$ and $h_{c}\to2(\pi^{+}\pi^{-})\omega$ with significances of 4.8$\sigma$ and 4.7$\sigma$, and their branching fractions are determined to be $(7.55\pm1.51\pm0.77)\times10^{-3}$ and $\left( {4.00 \pm 0.86 \pm 0.35}\right) \times {10^{ - 3}}$, respectively. No significant signals of $h_c\to 2(\pi^+\pi^-)\eta$ and $h_{c}\to p\bar{p}$ are observed, and the upper limits of the branching fractions of these decays are determined to be $<6.19\times10^{-4}$ and $<4.40\times10^{-5}$ at the 90% confidence level, respectively.


title: Double Exponential Lower Bound for Telephone Broadcast

abstract: Consider the Telephone Broadcast problem in which an input is a connected graph $G$ on $n$ vertices, a source vertex $s \in V(G)$, and a positive integer $t$. The objective is to decide whether there is a broadcast protocol from $s$ that ensures that all the vertices of $G$ get the message in at most $t$ rounds. We consider the broadcast protocol where, in a round, any node aware of the message can forward it to at most one of its neighbors. As the number of nodes aware of the message can at most double at each round, for a non-trivial instance we have $n \le 2^t$. Hence, the brute force algorithm that checks all the permutations of the vertices runs in time $2^{2^{\calO(t)}} \cdot n^{\calO(1)}$. As our first result, we prove this simple algorithm is the best possible in the following sense. Telephone Broadcast does not admit an algorithm running in time $2^{2^{o(t)}} \cdot n^{\calO(1)}$, unless the \ETH\ fails. To the best of our knowledge, this is only the fourth example of \NP-Complete problem that admits a double exponential lower bound when parameterized by the solution size. It also resolves the question by Fomin, Fraigniaud, and Golovach [WG 2023]. In the same article, the authors asked whether the problem is \FPT\ when parameterized by the feedback vertex set number of the graph. We answer this question in the negative. Telephone Broadcast, when restricted to graphs of the feedback vertex number one, and hence treewidth of two, is \NP-\complete. We find this a relatively rare example of problems that admit a polynomial-time algorithm on trees but is \NP-\complete\ on graphs of treewidth two.


title: Reducing the runtime of fault-tolerant quantum simulations in chemistry through symmetry-compressed double factorization

abstract: Quantum phase estimation based on qubitization is the state-of-the-art fault-tolerant quantum algorithm for computing ground-state energies in chemical applications. In this context, the 1-norm of the Hamiltonian plays a fundamental role in determining the total number of required iterations and also the overall computational cost. In this work, we introduce the symmetry-compressed double factorization (SCDF) approach, which combines a compressed double factorization of the Hamiltonian with the symmetry shift technique, significantly reducing the 1-norm value. The effectiveness of this approach is demonstrated numerically by considering various benchmark systems, including the FeMoco molecule, cytochrome P450, and hydrogen chains of different sizes. To compare the efficiency of SCDF to other methods in absolute terms, we estimate Toffoli gate requirements, which dominate the execution time on fault-tolerant quantum computers. For the systems considered here, SCDF leads to a sizeable reduction of the Toffoli gate count in comparison to other variants of double factorization or even tensor hypercontraction, which is usually regarded as the most efficient approach for qubitization.


title: Universality of pseudo-Goldstone damping near critical points

abstract: Recently, in studies of holographic models and hydrodynamics with spontaneous breaking of approximate symmetries, it has been proposed that the damping of pseudo-Goldstone modes at finite temperatures is universally constrained in the way that $\Omega_{\varphi}/m_{\varphi}^2\simeq D_{\varphi}$ in the broken phase, where $\Omega_{\varphi}$ and $m_{\varphi} $ are the relaxation rate at zero wavenumber and the mass of pseudo-Goldstones, $D_{\varphi}$ is the Goldstone diffusivity in the limit of purely spontaneous breaking. In this paper, we investigate the pseudo-Goldstone damping in a purely relaxational O($N$) model by performing the functional renormalization group calculations at the full quantum and stochastic level within the Schwinger-Keldysh formalism. We find that, away from the critical temperature, the proposed relation is always valid. When the temperature is very close to the critical value such that the mass of the Higgs mode is comparable to the mass of the pseudo-Goldstone modes, the pseudo-Goldstone damping displays a novel scaling behavior that follows $\Omega_\varphi/m_\varphi^2\propto m_{\varphi}^{\Delta_\eta}$ with a correction $\Delta_\eta$ controlled by the critical universalities. Moreover, we study how the correction depends on the value of $N$ and show that $\Delta_\eta \rightarrow 0$ when fluctuations are infinitely suppressed in the large $N$ limit. In this case, the proposed relation works even in the critical region. Finally, we match our results to the dissipative sector of the pion dynamics near the chiral phase transition.


title: Graph Visualization for Blockchain Data

abstract: In this report, we introduce a novel approach to visualize extremely large graphs efficiently. Our method combines two force-directed algorithms, Kamada-Kawai and ForceAtlas2, to handle different graph components based on their node count. Additionally, we suggest utilizing the Fast Multipole method to enhance the speed of ForceAtlas2. Although initially designed for analyzing bitcoin transaction graphs, for which we present results here, this algorithm can also be applied to other crypto currency transaction graphs or graphs from diverse domains.


title: Unveiling the Complete Variant of Spherical Robots

abstract: This study presents a systematic enumeration of spherical ($SO(3)$) type parallel robots' variants using an analytical velocity-level approach. These robots are known for their ability to perform arbitrary rotations around a fixed point, making them suitable for numerous applications. Despite their architectural diversity, existing research has predominantly approached them on a case-by-case basis. This approach hinders the exploration of all possible variants, thereby limiting the benefits derived from architectural diversity. By employing a generalized analytical approach through the reciprocal screw method, we systematically explore all the kinematic conditions for limbs yielding $SO(3)$ motion.Consequently, all 73 possible types of non-redundant limbs suitable for generating the target $SO(3)$ motion are identified. The approach involves performing an in-depth algebraic motion-constraint analysis and identifying common characteristics among different variants. This leads us to systematically explore all 73 symmetric and 5256 asymmetric variants, which in turn become a total of 5329, each potentially having different workspace capability, stiffness performance, and dynamics. Hence, having all these variants can facilitate the innovation of novel spherical robots and help us easily find the best and optimal ones for our specific applications.


title: Detecting AI-Generated Sentences in Human-AI Collaborative Hybrid Texts: Challenges, Strategies, and Insights

abstract: This study explores the challenge of sentence-level AI-generated text detection within human-AI collaborative hybrid texts. Existing studies of AI-generated text detection for hybrid texts often rely on synthetic datasets. These typically involve hybrid texts with a limited number of boundaries. We contend that studies of detecting AI-generated content within hybrid texts should cover different types of hybrid texts generated in realistic settings to better inform real-world applications. Therefore, our study utilizes the CoAuthor dataset, which includes diverse, realistic hybrid texts generated through the collaboration between human writers and an intelligent writing system in multi-turn interactions. We adopt a two-step, segmentation-based pipeline: (i) detect segments within a given hybrid text where each segment contains sentences of consistent authorship, and (ii) classify the authorship of each identified segment. Our empirical findings highlight (1) detecting AI-generated sentences in hybrid texts is overall a challenging task because (1.1) human writers' selecting and even editing AI-generated sentences based on personal preferences adds difficulty in identifying the authorship of segments; (1.2) the frequent change of authorship between neighboring sentences within the hybrid text creates difficulties for segment detectors in identifying authorship-consistent segments; (1.3) the short length of text segments within hybrid texts provides limited stylistic cues for reliable authorship determination; (2) before embarking on the detection process, it is beneficial to assess the average length of segments within the hybrid text. This assessment aids in deciding whether (2.1) to employ a text segmentation-based strategy for hybrid texts with longer segments, or (2.2) to adopt a direct sentence-by-sentence classification strategy for those with shorter segments.


title: GaLore: Memory-Efficient LLM Training by Gradient Low-Rank Projection

abstract: Training Large Language Models (LLMs) presents significant memory challenges, predominantly due to the growing size of weights and optimizer states. Common memory-reduction approaches, such as low-rank adaptation (LoRA), add a trainable low-rank matrix to the frozen pre-trained weight in each layer, reducing trainable parameters and optimizer states. However, such approaches typically underperform training with full-rank weights in both pre-training and fine-tuning stages since they limit the parameter search to a low-rank subspace and alter the training dynamics, and further, may require full-rank warm start. In this work, we propose Gradient Low-Rank Projection (GaLore), a training strategy that allows full-parameter learning but is more memory-efficient than common low-rank adaptation methods such as LoRA. Our approach reduces memory usage by up to 65.5% in optimizer states while maintaining both efficiency and performance for pre-training on LLaMA 1B and 7B architectures with C4 dataset with up to 19.7B tokens, and on fine-tuning RoBERTa on GLUE tasks. Our 8-bit GaLore further reduces optimizer memory by up to 82.5% and total training memory by 63.3%, compared to a BF16 baseline. Notably, we demonstrate, for the first time, the feasibility of pre-training a 7B model on consumer GPUs with 24GB memory (e.g., NVIDIA RTX 4090) without model parallel, checkpointing, or offloading strategies.


title: Probing the Robustness of Time-series Forecasting Models with CounterfacTS

abstract: A common issue for machine learning models applied to time-series forecasting is the temporal evolution of the data distributions (i.e., concept drift). Because most of the training data does not reflect such changes, the models present poor performance on the new out-of-distribution scenarios and, therefore, the impact of such events cannot be reliably anticipated ahead of time. We present and publicly release CounterfacTS, a tool to probe the robustness of deep learning models in time-series forecasting tasks via counterfactuals. CounterfacTS has a user-friendly interface that allows the user to visualize, compare and quantify time series data and their forecasts, for a number of datasets and deep learning models. Furthermore, the user can apply various transformations to the time series and explore the resulting changes in the forecasts in an interpretable manner. Through example cases, we illustrate how CounterfacTS can be used to i) identify the main features characterizing and differentiating sets of time series, ii) assess how the model performance depends on these characateristics, and iii) guide transformations of the original time series to create counterfactuals with desired properties for training and increasing the forecasting performance in new regions of the data distribution. We discuss the importance of visualizing and considering the location of the data in a projected feature space to transform time-series and create effective counterfactuals for training the models. Overall, CounterfacTS aids at creating counterfactuals to efficiently explore the impact of hypothetical scenarios not covered by the original data in time-series forecasting tasks.


title: Self-sustained optomechanical state destruction triggered by the Kerr nonlinearity

abstract: Cavity optomechanics implements a unique platform where moving objects can be probed by quantum fields, either laser light or microwave signals. With a pump tone driving at a frequency above the cavity resonance, self-sustained oscillations can be triggered at large injected powers. These limit cycle dynamics are particularly rich, presenting hysteretic behaviours, broad comb signals and especially large motion amplitudes. All of these features can be exploited for both fundamental quantum research and engineering. Here we present low temperature microwave experiments performed on a high-Q cavity resonance capacitively coupled to the flexure of a beam resonator. We study the limit cycle dynamics phase space as a function of pump parameters (detuning, power). Unexpectedly, we find that in a region of this phase space the microwave resonance is irremediably destroyed: only a dramatic power-reset can restore the dynamics to its original state. The phenomenon can be understood as an optical instability linked to the Kerr nonlinearity of the cavity. A theory supporting this claim is presented, reproducing almost quantitatively the measurement. This remarkable feature might be further optimized and represents a new resource for quantum microwave circuits.


title: METAMAT 01: A semi-analytic Solution for Benchmarking Wave Propagation Simulations of homogeneous Absorbers in 1D/3D and 2D

abstract: The development of acoustic simulation workflows in the time-domain description is essential for predicting the sound of aeroacoustic or other transient acoustic effects. A common practice for noise mitigation is using absorbers. The modeling of these acoustic absorbers is typically provided in the frequency domain. Several, methods established bridging this gap, investigating methods to model absorber in the time domain. Therefore, this short article, describes the analytic solution in time-domain for benchmarking absorber simulations with infinite 1D, 2D, and 3D domains. Connected to the analytic solution, a Matlab script is provided to easily obtain the reference solution. The reference codes are provided as benchmark solution in the EAA TCCA Benchmarking database as METAMAT 01.


title: Illuminating the property space in crystal structure prediction using Quality-Diversity algorithms

abstract: The identification of materials with exceptional properties is an essential objective to enable technological progress. We propose the application of \textit{Quality-Diversity} algorithms to the field of crystal structure prediction. The objective of these algorithms is to identify a diverse set of high-performing solutions, which has been successful in a range of fields such as robotics, architecture and aeronautical engineering. As these methods rely on a high number of evaluations, we employ machine-learning surrogate models to compute the interatomic potential and material properties that are used to guide optimisation. Consequently, we also show the value of using neural networks to model crystal properties and enable the identification of novel composition--structure combinations. In this work, we specifically study the application of the MAP-Elites algorithm to predict polymorphs of TiO$_2$. We rediscover the known ground state, in addition to a set of other polymorphs with distinct properties. We validate our method for C, SiO$_2$ and SiC systems, where we show that the algorithm can uncover multiple local minima with distinct electronic and mechanical properties.


title: Dcl-Net: Dual Contrastive Learning Network for Semi-Supervised Multi-Organ Segmentation

abstract: Semi-supervised learning is a sound measure to relieve the strict demand of abundant annotated datasets, especially for challenging multi-organ segmentation . However, most existing SSL methods predict pixels in a single image independently, ignoring the relations among images and categories. In this paper, we propose a two-stage Dual Contrastive Learning Network for semi-supervised MoS, which utilizes global and local contrastive learning to strengthen the relations among images and classes. Concretely, in Stage 1, we develop a similarity-guided global contrastive learning to explore the implicit continuity and similarity among images and learn global context. Then, in Stage 2, we present an organ-aware local contrastive learning to further attract the class representations. To ease the computation burden, we introduce a mask center computation algorithm to compress the category representations for local contrastive learning. Experiments conducted on the public 2017 ACDC dataset and an in-house RC-OARs dataset has demonstrated the superior performance of our method.


title: Spectrum of random centrosymmetric matrices; CLT and Circular law

abstract: We analyze the asymptotic fluctuations of linear eigenvalue statistics of random centrosymmetric matrices with i.i.d. entries. We prove that for a complex analytic test function, the centered and normalized linear eigenvalue statistics of random centrosymmetric matrices converge to a normal distribution. We find the exact expression of the variance of the limiting normal distribution via combinatorial arguments. Moreover, we also argue that the limiting spectral distribution of properly scaled centrosymmetric matrices follows the circular law.


title: CLongEval: A Chinese Benchmark for Evaluating Long-Context Large Language Models

abstract: Developing Large Language Models (LLMs) with robust long-context capabilities has been the recent research focus, resulting in the emergence of long-context LLMs proficient in Chinese. However, the evaluation of these models remains underdeveloped due to a lack of benchmarks. To address this gap, we present CLongEval, a comprehensive Chinese benchmark for evaluating long-context LLMs. CLongEval is characterized by three key features: (1) Sufficient data volume, comprising 7 distinct tasks and 7,267 examples; (2) Broad applicability, accommodating to models with context windows size from 1K to 100K; (3) High quality, with over 2,000 manually annotated question-answer pairs in addition to the automatically constructed labels. With CLongEval, we undertake a comprehensive assessment of 6 open-source long-context LLMs and 2 leading commercial counterparts that feature both long-context abilities and proficiency in Chinese. We also provide in-depth analysis based on the empirical results, trying to shed light on the critical capabilities that present challenges in long-context settings. The dataset, evaluation scripts, and model outputs will be released.


title: Lattice thermal conductivity and mechanical properties of the single-layer penta-NiN2 explored by a deep-learning interatomic potential

abstract: Penta-NiN2, a novel pentagonal 2D sheet with potential nanoelectronic applications, is investigated in terms of its lattice thermal conductivity, stability, and mechanical behavior. A deep learning interatomic potential (DLP) is firstly generated from ab-initio molecular dynamics (AIMD) data and then utilized for classical molecular dynamics simulations. The DLP's accuracy is verified, showing strong agreement with AIMD results. The dependence of thermal conductivity on size, temperature, and tensile strain, reveals important insights into the material's thermal properties. Additionally, the mechanical response of penta-NiN2 under uniaxial loading is examined, yielding a Young's modulus of approximately 368 GPa. The influence of vacancy defects on mechanical properties is analyzed, demonstrating significant reduction in modulus, fracture stress, and ultimate strength. This study also investigates the influence of strain on phonon dispersion relations and phonon group velocity in penta-NiN2, shedding light on how alterations in the atomic lattice affect the phonon dynamics and, consequently, impact the thermal conductivity. This investigation showcases the ability of deep learning based interatomic potentials in studying the properties of 2D Penta-NiN2.


title: Unsupervised Multilingual Dense Retrieval via Generative Pseudo Labeling

abstract: Dense retrieval methods have demonstrated promising performance in multilingual information retrieval, where queries and documents can be in different languages. However, dense retrievers typically require a substantial amount of paired data, which poses even greater challenges in multilingual scenarios. This paper introduces UMR, an Unsupervised Multilingual dense Retriever trained without any paired data. Our approach leverages the sequence likelihood estimation capabilities of multilingual language models to acquire pseudo labels for training dense retrievers. We propose a two-stage framework which iteratively improves the performance of multilingual dense retrievers. Experimental results on two benchmark datasets show that UMR outperforms supervised baselines, showcasing the potential of training multilingual retrievers without paired data, thereby enhancing their practicality. Our source code, data, and models are publicly available at https://github.com/MiuLab/UMR


title: IB-Net: Initial Branch Network for Variable Decision in Boolean Satisfiability

abstract: Boolean Satisfiability problems are vital components in Electronic Design Automation, particularly within the Logic Equivalence Checking process. Currently, SAT solvers are employed for these problems and neural network is tried as assistance to solvers. However, as SAT problems in the LEC context are distinctive due to their predominantly unsatisfiability nature and a substantial proportion of UNSAT-core variables, existing neural network assistance has proven unsuccessful in this specialized domain. To tackle this challenge, we propose IB-Net, an innovative framework utilizing graph neural networks and novel graph encoding techniques to model unsatisfiable problems and interact with state-of-the-art solvers. Extensive evaluations across solvers and datasets demonstrate IB-Net's acceleration, achieving an average runtime speedup of 5.0% on industrial data and 8.3% on SAT competition data empirically. This breakthrough advances efficient solving in LEC workflows.


title: Tracing Dirac points of topological surface states by ferromagnetic resonance

abstract: Ferromagnetic resonance is used to reveal features of the buried electronic band structure at interfaces between ferromagnetic metals and topological insulators. By monitoring the evolution of magnetic damping, the application of this method to a hybrid structure consisting of a ferromagnetic layer and a 3D topological insulator reveals a clear fingerprint of the Dirac point and exhibits additional features of the interfacial band structure not otherwise observable. The underlying spin-pumping mechanism is discussed in the framework of dissipation of angular momentum by topological surface states (TSSs). Tuning of the Fermi level within the TSS was verified both by varying the stoichiometry of the topological insulator layer and by electrostatic backgating and the damping values obtained in both cases show a remarkable agreement. The high energy resolution of this method additionally allows us to resolve the energetic shift of the local Dirac points generated by local variations of the electrostatic potential. Calculations based on the chiral tunneling process naturally occurring in TSS agree well with the experimental results.


title: KIAS Lectures on Symplectic Aspects of Degenerations

abstract: This is a series of three lectures I gave at the Korea Institute of Advanced Study in June 2019 at a workshop about "Algebraic and Symplectic Aspects of Degenerations of Complex Surfaces". I focus on the symplectic aspects, in particular on the case of cyclic quotient surface singularities. These notes have been available on a public Git repository since 2019, and I noticed that people occasionally cited them in the years since. For that reason, I decided to post them on arXiv for a more permanent record; I have made some small corrections and annotations but otherwise they are unchanged. These notes are a purely expository account of stuff I was thinking about 2016-2019, and are largely self-aggrandising.


title: Modelling the inelastic constitutive behaviour of multi-layer spiral strands. Comparison of hysteresis operator approach to multi-scale model

abstract: The simulation of inelastic effects in flexible slender technical devices has become of increasing interest in the past years. Different approaches have been considered depending on the effects relevant for the specific application. Recently, a mixed stress strain driven computational homogenisation has been proposed to model the dissipative nonlinear bending response of spiral strands subjected to axial force. In this study, we propose two different approaches, namely a rheological model and a databased greybox model, to predict the cyclic response of these strands using only their monotonic response. In the first approach, a system of so-called bending springs and sliders is used to model different contributions to the bending stiffness of the strands. The data-based approach makes use of mathematical tools called hysteresis operators. The Prandtl-Ishlinskii operator plays a relevant role in modelling the input-output relation in phenomena showing hysteretic behaviour and can be expressed as a weighted superposition of elementary stop operators. Comparing the two approaches leads to a better understanding and an explicit physical interpretation of the parameters of a specific class of hysteresis operator models.


title: BiVert: Bidirectional Vocabulary Evaluation using Relations for Machine Translation

abstract: Neural machine translation (NMT) has progressed rapidly in the past few years, promising improvements and quality translations for different languages. Evaluation of this task is crucial to determine the quality of the translation. Overall, insufficient emphasis is placed on the actual sense of the translation in traditional methods. We propose a bidirectional semantic-based evaluation method designed to assess the sense distance of the translation from the source text. This approach employs the comprehensive multilingual encyclopedic dictionary BabelNet. Through the calculation of the semantic distance between the source and its back translation of the output, our method introduces a quantifiable approach that empowers sentence comparison on the same linguistic level. Factual analysis shows a strong correlation between the average evaluation scores generated by our method and the human assessments across various machine translation systems for English-German language pair. Finally, our method proposes a new multilingual approach to rank MT systems without the need for parallel corpora.


title: Non-verbal information in spontaneous speech -- towards a new framework of analysis

abstract: Non-verbal signals in speech are encoded by prosody and carry information that ranges from conversation action to attitude and emotion. Despite its importance, the principles that govern prosodic structure are not yet adequately understood. This paper offers an analytical schema and a technological proof-of-concept for the categorization of prosodic signals and their association with meaning. The schema interprets surface-representations of multi-layered prosodic events. As a first step towards implementation, we present a classification process that disentangles prosodic phenomena of three orders. It relies on fine-tuning a pre-trained speech recognition model, enabling the simultaneous multi-class/multi-label detection. It generalizes over a large variety of spontaneous data, performing on a par with, or superior to, human annotation. In addition to a standardized formalization of prosody, disentangling prosodic patterns can direct a theory of communication and speech organization. A welcome by-product is an interpretation of prosody that will enhance speech- and language-related technologies.


title: High-harmonic generation in graphene under the application of a DC electric current: From perturbative to non-perturbative regimes

abstract: We theoretically investigate high-harmonic generation (HHG) in honeycomb-lattice graphene models when subjected to a DC electric field. By integrating the quantum master equation with the Boltzmann equation, we develop a numerical method to compute laser-driven dynamics in many-electron lattice systems under DC electric current. The method enables us to treat both the weak-laser (perturbative) and intense-laser (non-perturbative) regimes in a unified way, accounting for the experimentally inevitable dissipation effects. From it, we obtain the HHG spectra and analyze their dependence on laser frequency, laser intensity, laser-field direction, and DC current strength. We show that the dynamical and static symmetries are partially broken by a DC current or staggered potential term, and such symmetry breakings drastically change the shape of the HHG spectra, especially in terms of the presence or absence of $(2n+1)$-th, $2n$-th, or $3n$-th order harmonics ($n\in \mathbb Z$). The laser intensity, frequency, and polarization are also shown to affect the shape of the HHG spectra. Our findings indicate that HHG spectra in conducting electron systems can be quantitatively or qualitatively controlled by tuning various external parameters, and DC electric current is used as such an efficient parameter.

categories: cond-mat.mes-hall cond-mat.stat-mech cond-mat.str-el physics.optics quant-ph


title: Infinite-horizon Fuk-Nagaev inequalities

abstract: We develop explicit bounds for the tail of the distribution for the all-time supremum of a random walk with negative drift, where the increments have a truncated heavy-tailed distribution. As an application, we consider a ruin problem in the presence of re-insurance.


title: Exploratory Factory Analysis of the Centrality Metrics for Complex Real-World Networks

abstract: Exploratory factor analysis (EFA) is useful to identify the number and mapping of the hidden factors that could dominantly represent the features in the dataset. Principal component analysis (PCA) is the first step as part of the two-step procedure to conduct EFA, with the number of dominant principal components being the number of hidden factors and the entries for the features in the corresponding Eigenvectors serve as the initial values of the factor loadings. In this paper, we conduct EFA on a suite of 80 complex network datasets to identify the number and mapping of the hidden factors (expected to be less than four) that could dominantly represent the values incurred by the vertices with respect to the four major centrality metrics (degree: DEG, eigenvector: EVC, betweenness: BWC and closeness: CLC).


title: FingerNet: EEG Decoding of A Fine Motor Imagery with Finger-tapping Task Based on A Deep Neural Network

abstract: Brain-computer interface (BCI) technology facilitates communication between the human brain and computers, primarily utilizing electroencephalography (EEG) signals to discern human intentions. Although EEG-based BCI systems have been developed for paralysis individuals, ongoing studies explore systems for speech imagery and motor imagery (MI). This study introduces FingerNet, a specialized network for fine MI classification, departing from conventional gross MI studies. The proposed FingerNet could extract spatial and temporal features from EEG signals, improving classification accuracy within the same hand. The experimental results demonstrated that performance showed significantly higher accuracy in classifying five finger-tapping tasks, encompassing thumb, index, middle, ring, and little finger movements. FingerNet demonstrated dominant performance compared to the conventional baseline models, EEGNet and DeepConvNet. The average accuracy for FingerNet was 0.3049, whereas EEGNet and DeepConvNet exhibited lower accuracies of 0.2196 and 0.2533, respectively. Statistical validation also demonstrates the predominance of FingerNet over baseline networks. For biased predictions, particularly for thumb and index classes, we led to the implementation of weighted cross-entropy and also adapted the weighted cross-entropy, a method conventionally employed to mitigate class imbalance. The proposed FingerNet involves optimizing network structure, improving performance, and exploring applications beyond fine MI. Moreover, the weighted Cross Entropy approach employed to address such biased predictions appears to have broader applicability and relevance across various domains involving multi-class classification tasks. We believe that effective execution of motor imagery can be achieved not only for fine MI, but also for local muscle MI


title: LDSF: Lightweight Dual-Stream Framework for SAR Target Recognition by Coupling Local Electromagnetic Scattering Features and Global Visual Features

abstract: Mainstream DNN-based SAR-ATR methods still face issues such as easy overfitting of a few training data, high computational overhead, and poor interpretability of the black-box model. Integrating physical knowledge into DNNs to improve performance and achieve a higher level of physical interpretability becomes the key to solving the above problems. This paper begins by focusing on the electromagnetic (EM) backscattering mechanism. We extract the EM scattering (EMS) information from the complex SAR data and integrate the physical properties of the target into the network through a dual-stream framework to guide the network to learn physically meaningful and discriminative features. Specifically, one stream is the local EMS feature (LEMSF) extraction net. It is a heterogeneous graph neural network (GNN) guided by a multi-level multi-head attention mechanism. LEMSF uses the EMS information to obtain topological structure features and high-level physical semantic features. The other stream is a CNN-based global visual features (GVF) extraction net that captures the visual features of SAR pictures from the image domain. After obtaining the two-stream features, a feature fusion subnetwork is proposed to adaptively learn the fusion strategy. Thus, the two-stream features can maximize the performance. Furthermore, the loss function is designed based on the graph distance measure to promote intra-class aggregation. We discard overly complex design ideas and effectively control the model size while maintaining algorithm performance. Finally, to better validate the performance and generalizability of the algorithms, two more rigorous evaluation protocols, namely once-for-all (OFA) and less-for-more (LFM), are used to verify the superiority of the proposed algorithm on the MSTAR.


title: Improved theoretical prediction of nanoparticle sizes with the resistive-pulse technique

abstract: With the resistive-pulse technique (RPT), nanopores serve as the nanofluidic sensors of various analytes for their many physical and chemical properties. Here, we focus on the size measurement and its theoretical prediction for sub-200 nm nanoparticles with RPT. Through systematical investigation of the current blockade of nanoparticles across cylindrical nanopores with simulations, Maxwell method considering the shape coefficient and access resistances agrees well with simulation results. However, the widely used integration method of the resistance has distinct deviations in various cases. With the introduction of a correction factor \b{eta} to the integration method, our revised equations can provide good predictions for simulation results. \b{eta} shows a strong dependence on the diameter ratio (d over D) of the nanoparticle and nanopore. Following the same strategy, modified equations are provided for the accurate size prediction for nanoparticles across conical nanopores, where the integration method is the default convenient way. The correction factor \b{eta}' relates to \b{eta} in cylindrical nanopores. \b{eta}' exhibits independence on the pore geometry parameters and diameters of nanoparticles, but dependence on the surface charge density of conical nanopores. Our improved equations can provide theoretical predictions for the accurate size detection of 100-200 nm diameter nanoparticles across cylindrical and conical nanopores.


title: Radiation-mediated shocks in GRB prompt emission

abstract: The debate regarding the emission mechanism in gamma-ray bursts has been long-standing. Here, we study the spectral signatures of photospheric emission, accounting for subphotospheric dissipation by a radiation-mediated shock. The shocks are modeled using the Kompaneets RMS approximation (KRA). We find that the resulting observed spectra are soft, broad, and exhibit an additional break at lower energies. When fitting a collection of 150 mock data samples generated by the model, we obtain a distribution of the low-energy index $\alpha$ that is similar to the observed one. These results are promising and show that dissipative photospheric models can account for many of the observed properties of prompt gamma-ray burst emission.


title: Average-case deterministic query complexity of boolean functions with fixed weight

abstract: We explore the $\textit{average-case deterministic query complexity}$ of boolean functions under the $\textit{uniform distribution}$, denoted by $\mathrm{D}_\mathrm{ave}(f)$, the minimum average depth of zero-error decision tree computing a boolean function $f$. This measure found several applications across diverse fields. We study $\mathrm{D}_\mathrm{ave}(f)$ of several common functions, including penalty shoot-out functions, symmetric functions, linear threshold functions and tribes functions. Let $\mathrm{wt}(f)$ denote the number of the inputs on which $f$ outputs $1$. We prove that $\mathrm{D}_\mathrm{ave}(f) \le \log \frac{\mathrm{wt}(f)}{\log n} + O\left(\log \log \frac{\mathrm{wt}(f)}{\log n}\right)$ when $\mathrm{wt}(f) \ge 4 \log n$ (otherwise, $\mathrm{D}_\mathrm{ave}(f) = O(1)$), and that for almost all fixed-weight functions, $\mathrm{D}_\mathrm{ave}(f) \geq \log \frac{\mathrm{wt}(f)}{\log n} - O\left( \log \log \frac{\mathrm{wt}(f)}{\log n}\right)$, which implies the tightness of the upper bound up to an additive logarithmic term. We also study $\mathrm{D}_\mathrm{ave}(f)$ of circuits. Using H\r{a}stad's switching lemma or Rossman's switching lemma [Comput. Complexity Conf. 137, 2019], one can derive upper bounds $\mathrm{D}_\mathrm{ave}(f) \leq n\left(1 - \frac{1}{O(k)}\right)$ for width-$k$ CNFs/DNFs and $\mathrm{D}_\mathrm{ave}(f) \leq n\left(1 - \frac{1}{O(\log s)}\right)$ for size-$s$ CNFs/DNFs, respectively. For any $w \ge 1.1 \log n$, we prove the existence of some width-$w$ size-$(2^w/w)$ DNF formula with $\mathrm{D}_\mathrm{ave} (f) = n \left(1 - \frac{\log n}{\Theta(w)}\right)$, providing evidence on the tightness of the switching lemmas.


title: Data based constitutive modelling of rate independent inelastic effects in composite cables using Preisach hysteresis operators

abstract: This contribution aims at introducing first steps to develop hysteresis operator type inelastic constitutive laws for Cosserat rods for the simulation of cables composed of complex interior components. Motivated by the basic elements of Cosserat rod theory, we develop a specific approach to constitutive modelling adapted for this application. Afterwards, we describe the hysteretical behaviour arising from cyclic bending experiments on cables by means of the Preisach operator. As shown in pure bending experiments, slender structures such as electric cables behave inelastically, and open hysteresis loops arise with noticeable difference between the first load cycle and the following ones. The Preisach operator plays an important role in describing the input-output relation in hysteresis behaviours, and it can be expressed as a superposition of relay operators. Hence, a mathematical formulation of the problem is introduced, and a first attempt is made to determine the hysteresis behaviour that describes the relation between curvature and bending moment. Therefore, a suitable kernel function is identified in a way that its integration over the Preisach plane results in the bending moment of the specimen, and a comparison between different kernel functions is performed.


title: Extend Your Own Correspondences: Unsupervised Distant Point Cloud Registration by Progressive Distance Extension

abstract: Registration of point clouds collected from a pair of distant vehicles provides a comprehensive and accurate 3D view of the driving scenario, which is vital for driving safety related applications, yet existing literature suffers from the expensive pose label acquisition and the deficiency to generalize to new data distributions. In this paper, we propose EYOC, an unsupervised distant point cloud registration method that adapts to new point cloud distributions on the fly, requiring no global pose labels. The core idea of EYOC is to train a feature extractor in a progressive fashion, where in each round, the feature extractor, trained with near point cloud pairs, can label slightly farther point cloud pairs, enabling self-supervision on such far point cloud pairs. This process continues until the derived extractor can be used to register distant point clouds. Particularly, to enable high-fidelity correspondence label generation, we devise an effective spatial filtering scheme to select the most representative correspondences to register a point cloud pair, and then utilize the aligned point clouds to discover more correct correspondences. Experiments show that EYOC can achieve comparable performance with state-of-the-art supervised methods at a lower training cost. Moreover, it outwits supervised methods regarding generalization performance on new data distributions.


title: Quantum machine learning with indefinite causal order

abstract: In a conventional circuit for quantum machine learning, the quantum gates used to encode the input parameters and the variational parameters are constructed with a fixed order. The resulting output function, which can be expressed in the form of a restricted Fourier series, has limited flexibility in the distributions of its Fourier coefficients. This indicates that a fixed order of quantum gates can limit the performance of quantum machine learning. Building on this key insight (also elaborated with examples), we introduce indefinite causal order to quantum machine learning. Because the indefinite causal order of quantum gates allows for the superposition of different orders, the performance of quantum machine learning can be significantly enhanced. Considering that the current accessible quantum platforms only allow to simulate a learning structure with a fixed order of quantum gates, we reform the existing simulation protocol to implement indefinite causal order and further demonstrate the positive impact of indefinite causal order on specific learning tasks. Our results offer useful insights into possible quantum effects in quantum machine learning.


title: Characterization of the low electric field and zero-temperature two-level-system loss in hydrogenated amorphous silicon

abstract: Two-level systems (TLS) are an important, if not dominant, source of loss and noise for superconducting resonators such as those used in kinetic inductance detectors and some quantum information science platforms. They are similarly important for loss in photolithographically fabricated superconducting mm-wave/THz transmission lines. For both lumped-element and transmission-line structures, native amorphous surface oxide films are typically the sites of such TLS in non-microstripline geometries, while loss in the (usually amorphous) dielectric film itself usually dominates in microstriplines. We report here on the demonstration of low TLS loss at GHz frequencies in hydrogenated amorphous silicon (a-Si:H) films deposited by plasma-enhanced chemical vapor deposition in superconducting lumped-element resonators using parallel-plate capacitors (PPCs). The values we obtain from two recipes in different deposition machines, 7$\,\times\,10^{-6}$ and 12$\,\times\,10^{-6}$, improve on the best achieved in the literature by a factor of 2--4 for a-Si:H and are comparable to recent measurements of amorphous germanium. Moreover, we have taken care to extract the true zero-temperature, low-field loss tangent of these films, accounting for temperature and field saturation effects that can yield misleading results. Such robustly fabricated and characterized films render the use of PPCs with deposited amorphous films a viable architecture for superconducting resonators, and they also promise extremely low loss and high quality factor for photolithographically fabricated superconducting mm-wave/THz transmission lines used in planar antennas and resonant filters.


title: Task Attribute Distance for Few-Shot Learning: Theoretical Analysis and Applications

abstract: Few-shot learning (FSL) aims to learn novel tasks with very few labeled samples by leveraging experience from \emph{related} training tasks. In this paper, we try to understand FSL by delving into two key questions: (1) How to quantify the relationship between \emph{training} and \emph{novel} tasks? (2) How does the relationship affect the \emph{adaptation difficulty} on novel tasks for different models? To answer the two questions, we introduce Task Attribute Distance (TAD) built upon attributes as a metric to quantify the task relatedness. Unlike many existing metrics, TAD is model-agnostic, making it applicable to different FSL models. Then, we utilize TAD metric to establish a theoretical connection between task relatedness and task adaptation difficulty. By deriving the generalization error bound on a novel task, we discover how TAD measures the adaptation difficulty on novel tasks for FSL models. To validate our TAD metric and theoretical findings, we conduct experiments on three benchmarks. Our experimental results confirm that TAD metric effectively quantifies the task relatedness and reflects the adaptation difficulty on novel tasks for various FSL methods, even if some of them do not learn attributes explicitly or human-annotated attributes are not available. Finally, we present two applications of the proposed TAD metric: data augmentation and test-time intervention, which further verify its effectiveness and general applicability. The source code is available at https://github.com/hu-my/TaskAttributeDistance.


title: Towards Efficient and Effective Unlearning of Large Language Models for Recommendation

abstract: The significant advancements in large language models (LLMs) give rise to a promising research direction, i.e., leveraging LLMs as recommenders (LLMRec). The efficacy of LLMRec arises from the open-world knowledge and reasoning capabilities inherent in LLMs. LLMRec acquires the recommendation capabilities through instruction tuning based on user interaction data. However, in order to protect user privacy and optimize utility, it is also crucial for LLMRec to intentionally forget specific user data, which is generally referred to as recommendation unlearning. In the era of LLMs, recommendation unlearning poses new challenges for LLMRec in terms of \textit{inefficiency} and \textit{ineffectiveness}. Existing unlearning methods require updating billions of parameters in LLMRec, which is costly and time-consuming. Besides, they always impact the model utility during the unlearning process. To this end, we propose \textbf{E2URec}, the first \underline{E}fficient and \underline{E}ffective \underline{U}nlearning method for LLM\underline{Rec}. Our proposed E2URec enhances the unlearning efficiency by updating only a few additional LoRA parameters, and improves the unlearning effectiveness by employing a teacher-student framework, where we maintain multiple teacher networks to guide the unlearning process. Extensive experiments show that E2URec outperforms state-of-the-art baselines on two real-world datasets. Specifically, E2URec can efficiently forget specific data without affecting recommendation performance. The source code is at \url{https://github.com/justarter/E2URec}.


title: On the Second-Order Asymptotics of the Hoeffding Test and Other Divergence Tests

abstract: Consider a binary statistical hypothesis testing problem, where $n$ independent and identically distributed random variables $Z^n$ are either distributed according to the null hypothesis $P$ or the alternative hypothesis $Q$, and only $P$ is known. A well-known test that is suitable for this case is the so-called Hoeffding test, which accepts $P$ if the Kullback-Leibler (KL) divergence between the empirical distribution of $Z^n$ and $P$ is below some threshold. This work characterizes the first and second-order terms of the type-II error probability for a fixed type-I error probability for the Hoeffding test as well as for divergence tests, where the KL divergence is replaced by a general divergence. It is demonstrated that, irrespective of the divergence, divergence tests achieve the first-order term of the Neyman-Pearson test, which is the optimal test when both $P$ and $Q$ are known. In contrast, the second-order term of divergence tests is strictly worse than that of the Neyman-Pearson test. It is further demonstrated that divergence tests with an invariant divergence achieve the same second-order term as the Hoeffding test, but divergence tests with a non-invariant divergence may outperform the Hoeffding test for some alternative hypotheses $Q$. Potentially, this behavior could be exploited by a composite hypothesis test with partial knowledge of the alternative hypothesis $Q$ by tailoring the divergence of the divergence test to the set of possible alternative hypotheses.


title: RADIA -- Radio Advertisement Detection with Intelligent Analytics

abstract: Radio advertising remains an integral part of modern marketing strategies, with its appeal and potential for targeted reach undeniably effective. However, the dynamic nature of radio airtime and the rising trend of multiple radio spots necessitates an efficient system for monitoring advertisement broadcasts. This study investigates a novel automated radio advertisement detection technique incorporating advanced speech recognition and text classification algorithms. RadIA's approach surpasses traditional methods by eliminating the need for prior knowledge of the broadcast content. This contribution allows for detecting impromptu and newly introduced advertisements, providing a comprehensive solution for advertisement detection in radio broadcasting. Experimental results show that the resulting model, trained on carefully segmented and tagged text data, achieves an F1-macro score of 87.76 against a theoretical maximum of 89.33. This paper provides insights into the choice of hyperparameters and their impact on the model's performance. This study demonstrates its potential to ensure compliance with advertising broadcast contracts and offer competitive surveillance. This groundbreaking research could fundamentally change how radio advertising is monitored and open new doors for marketing optimization.