title: How Universal Polynomial Bases Enhance Spectral Graph Neural Networks: Heterophily, Over-smoothing, and Over-squashing

abstract: Spectral Graph Neural Networks (GNNs), alternatively known as graph filters, have gained increasing prevalence for heterophily graphs. Optimal graph filters rely on Laplacian eigendecomposition for Fourier transform. In an attempt to avert prohibitive computations, numerous polynomial filters have been proposed. However, polynomials in the majority of these filters are predefined and remain fixed across different graphs, failing to accommodate the varying degrees of heterophily. Addressing this gap, we demystify the intrinsic correlation between the spectral property of desired polynomial bases and the heterophily degrees via thorough theoretical analyses. Subsequently, we develop a novel adaptive heterophily basis wherein the basis vectors mutually form angles reflecting the heterophily degree of the graph. We integrate this heterophily basis with the homophily basis to construct a universal polynomial basis UniBasis, which devises a polynomial filter based graph neural network - UniFilter. It optimizes the convolution and propagation in GNN, thus effectively limiting over-smoothing and alleviating over-squashing. Our extensive experiments, conducted on a diverse range of real-world and synthetic datasets with varying degrees of heterophily, support the superiority of UniFilter. These results not only demonstrate the universality of UniBasis but also highlight its proficiency in graph explanation.


title: GASE: Graph Attention Sampling with Edges Fusion for Solving Vehicle Routing Problems

abstract: Learning-based methods have become increasingly popular for solving vehicle routing problems due to their near-optimal performance and fast inference speed. Among them, the combination of deep reinforcement learning and graph representation allows for the abstraction of node topology structures and features in an encoder-decoder style. Such an approach makes it possible to solve routing problems end-to-end without needing complicated heuristic operators designed by domain experts. Existing research studies have been focusing on novel encoding and decoding structures via various neural network models to enhance the node embedding representation. Despite the sophisticated approaches applied, there is a noticeable lack of consideration for the graph-theoretic properties inherent to routing problems. Moreover, the potential ramifications of inter-nodal interactions on the decision-making efficacy of the models have not been adequately explored. To bridge this gap, we propose an adaptive Graph Attention Sampling with the Edges Fusion framework (GASE),where nodes' embedding is determined through attention calculation from certain highly correlated neighbourhoods and edges, utilizing a filtered adjacency matrix. In detail, the selections of particular neighbours and adjacency edges are led by a multi-head attention mechanism, contributing directly to the message passing and node embedding in graph attention sampling networks. Furthermore, we incorporate an adaptive actor-critic algorithm with policy improvements to expedite the training convergence. We then conduct comprehensive experiments against baseline methods on learning-based VRP tasks from different perspectives. Our proposed model outperforms the existing methods by 2.08\%-6.23\% and shows stronger generalization ability, achieving state-of-the-art performance on randomly generated instances and real-world datasets.


title: Benchmarking Fish Dataset and Evaluation Metric in Keypoint Detection -- Towards Precise Fish Morphological Assessment in Aquaculture Breeding

abstract: Accurate phenotypic analysis in aquaculture breeding necessitates the quantification of subtle morphological phenotypes. Existing datasets suffer from limitations such as small scale, limited species coverage, and inadequate annotation of keypoints for measuring refined and complex morphological phenotypes of fish body parts. To address this gap, we introduce FishPhenoKey, a comprehensive dataset comprising 23,331 high-resolution images spanning six fish species. Notably, FishPhenoKey includes 22 phenotype-oriented annotations, enabling the capture of intricate morphological phenotypes. Motivated by the nuanced evaluation of these subtle morphologies, we also propose a new evaluation metric, Percentage of Measured Phenotype (PMP). It is designed to assess the accuracy of individual keypoint positions and is highly sensitive to the phenotypes measured using the corresponding keypoints. To enhance keypoint detection accuracy, we further propose a novel loss, Anatomically-Calibrated Regularization (ACR), that can be integrated into keypoint detection models, leveraging biological insights to refine keypoint localization. Our contributions set a new benchmark in fish phenotype analysis, addressing the challenges of precise morphological quantification and opening new avenues for research in sustainable aquaculture and genetic studies. Our dataset and code are available at https://github.com/WeizhenLiuBioinform/Fish-Phenotype-Detect.


title: Gaussian Control with Hierarchical Semantic Graphs in 3D Human Recovery

abstract: Although 3D Gaussian Splatting (3DGS) has recently made progress in 3D human reconstruction, it primarily relies on 2D pixel-level supervision, overlooking the geometric complexity and topological relationships of different body parts. To address this gap, we introduce the Hierarchical Graph Human Gaussian Control (HUGS) framework for achieving high-fidelity 3D human reconstruction. Our approach involves leveraging explicitly semantic priors of body parts to ensure the consistency of geometric topology, thereby enabling the capture of the complex geometrical and topological associations among body parts. Additionally, we disentangle high-frequency features from global human features to refine surface details in body parts. Extensive experiments demonstrate that our method exhibits superior performance in human body reconstruction, particularly in enhancing surface details and accurately reconstructing body part junctions. Codes are available at https://wanghongsheng01.github.io/HUGS/.


title: Efficient Economic Model Predictive Control of Water Treatment Process with Learning-based Koopman Operator

abstract: Used water treatment plays a pivotal role in advancing environmental sustainability. Economic model predictive control holds the promise of enhancing the overall operational performance of the water treatment facilities. In this study, we propose a data-driven economic predictive control approach within the Koopman modeling framework. First, we propose a deep learning-enabled input-output Koopman modeling approach, which predicts the overall economic operational cost of the wastewater treatment process based on input data and available output measurements that are directly linked to the operational costs. Subsequently, by leveraging this learned input-output Koopman model, a convex economic predictive control scheme is developed. The resulting predictive control problem can be efficiently solved by leveraging quadratic programming solvers, and complex non-convex optimization problems are bypassed. The proposed method is applied to a benchmark wastewater treatment process. The proposed method significantly improves the overall economic operational performance of the water treatment process. Additionally, the computational efficiency of the proposed method is significantly enhanced as compared to benchmark control solutions.


title: Dynamic Asset Pricing in a Unified Bachelier-Black-Scholes-Merton Model

abstract: We present a unified, market-complete model that integrates both the Bachelier and Black-Scholes-Merton frameworks for asset pricing. The model allows for the study, within a unified framework, of asset pricing in a natural world that experiences the possibility of negative security prices or riskless rates. In contrast to classical Black-Scholes-Merton, we show that option pricing in the unified model displays a difference depending on whether the replicating, self-financing portfolio uses riskless bonds or a single riskless bank account. We derive option price formulas and extend our analysis to the term structure of interest rates by deriving the pricing of zero-coupon bonds, forward contracts, and futures contracts. We identify a necessary condition for the unified model to support a perpetual derivative. Discrete binomial pricing under the unified model is also developed. In every scenario analyzed, we show that the unified model simplifies to the standard Black-Scholes-Merton pricing under specific limits and provides pricing in the Bachelier model limit. We note that the Bachelier limit within the unified model allows for positive riskless rates. The unified model prompts us to speculate on the possibility of a mixed multiplicative and additive deflator model for risk-neutral option pricing.


title: Towards Detecting and Mitigating Cognitive Bias in Spoken Conversational Search

abstract: Instruments such as eye-tracking devices have contributed to understanding how users interact with screen-based search engines. However, user-system interactions in audio-only channels -- as is the case for Spoken Conversational Search (SCS) -- are harder to characterize, given the lack of instruments to effectively and precisely capture interactions. Furthermore, in this era of information overload, cognitive bias can significantly impact how we seek and consume information -- especially in the context of controversial topics or multiple viewpoints. This paper draws upon insights from multiple disciplines (including information seeking, psychology, cognitive science, and wearable sensors) to provoke novel conversations in the community. To this end, we discuss future opportunities and propose a framework including multimodal instruments and methods for experimental designs and settings. We demonstrate preliminary results as an example. We also outline the challenges and offer suggestions for adopting this multimodal approach, including ethical considerations, to assist future researchers and practitioners in exploring cognitive biases in SCS.


title: On the role of Loewner entropy in statistical mechanics of 2D Ising system

abstract: The fundamental properties of 2-dimensional (2D) Ising system were formulated using the Loewner theory. We focus on the role of the complexity measure of the 2D geometry, referred to as the Loewner entropy, to derive the statistical-mechanical relations of the 2D Ising system by analyzing the structure of the interface (i.e., the phase separation line). For the mixing property of the discrete Loewner evolution, we assume that the Loewner driving force ${\it\eta_s(n)}$ obtained from the interface has a stationary property, where the autocorrelation function $\langle{\it\eta_s(0)\eta_s(n)}\rangle $ converges in the long-time limit. Using this fact, we reconstruct the continuous Loewner evolution driven by the diffusion process whose increments correspond to the sequence of ${\it\eta_s(n)}$, and the fractal dimension of the generated curve was derived. We show that these formulations lead to a novel expression of the Hamiltonian, grand canonical ensemble of the system, which also are applicable for the non-equilibrium state of the system. In addition, the relations on the central limit theorem (CLT) governing the local fluctuation of the interface, the non-equilibrium free energy, and fluctuation dissipation relation (FDR) were derived using the Loewner theory. The present results suggest a possible form of the complexity-based theory of the 2D statistical mechanical systems that is applicable for the non-equilibrium states.


title: Coherence spectroscopy by the Nth power of the measured signal in an interferometer overcoming the diffraction limit

abstract: Coherence spectroscopy has been intensively studied over the last several decades for various applications in science and engineering. The Rayleigh criterion defines the resolution limit of an interferometer, where many-wave interference beats the resolution limit of a two-slit system. On the other hand, the diffraction angle in a slit is reduced by the Kth power of the measured signal, resulting in the shot-noise limit. Here, the Kth power of the measured signal in an N-slit interferometer is studied for enhanced coherence spectroscopy to overcome the resolution limit of the original system. The Kth power to the individual intensities of the N-slit interferometer is numerically demonstrated for enhanced resolution satisfying the shot-noise limit. As a result, the Kth power of the intensity beats the resolution limit of the N-slit interferometer, in which the out-of-shelf spectrometer or wavelength meter can be a primary beneficiary of this technique. Due to the same resolution of the Heisenberg limit in quantum sensing as in the N-slit interference fringe, the proposed Kth power technique also beats the superresolution in quantum metrology.


title: Molecule-induced surface second-order nonlinearity in an inversion symmetric microcavity

abstract: Inversion symmetry eliminates the second-order nonlinear responses in materials commonly used in silicon photonics with electric-dipole approximation. The lack of effective methods to induce the second-order nonlinearity in silicon photonic materials prevents their applications in second-order nonlinear integrated photonics. Here, we experimentally demonstrate a surface second-order nonlinear optics approach for boosting the second harmonic (SH) generation process in a silica microcavity. By leveraging the molecule-induced surface second-order nonlinearity, a record high SH efficiency of about 6.7% W-1 is achieved in a silica microcavity functionalized with a surface asymmetrically-aligned molecular monolayer, which is enhanced of two to four orders of magnitude compared to that before molecule-functionalization. Furthermore, we derive the equations that govern the surface second-order nonlinear process in inversion symmetric microcavities. Our method not only enables high efficiency second-order nonlinear frequency conversions in silica photonics, but also can apply to other inversion symmetric material platforms for integrated photonics.


title: Meta-Homogenization for Knitwear Simulation

abstract: This paper presents meta-homogenization, a spatially varying homogenization scheme for knitwear simulation. We are motivated by the observation that macro-scale fabric dynamics is strongly correlated with its underlying knitting patterns. Therefore, homogenization towards a single material is less effective when the knitting is complex and non-repetitive. Our method tackles this challenge by homogenizing the yarn-level material locally at volumetric elements. Assigning a virtual volume of a knitting structure enables us to model bending and twisting effects via a simple volume-preserving penalty and thus effectively alleviates the material nonlinearity. We employ an adjoint Gauss-Newton formulation to battle the dimensionality challenge of such per-element material optimization. This intuitive material model makes the forward simulation GPU-friendly. To this end, our pipeline also equips a novel domain-decomposed subspace solver crafted for GPU projective dynamics, which makes our simulator hundreds of times faster than the yarn-level simulator. Experiments validate the capability and effectiveness of meta-homogenization. Our method produces realistic animations of knitwear matching the quality of full-scale yarn-level simulations. It is also orders of magnitude faster than existing homogenization techniques in both the training and simulation stages.


title: Formal languages, spin systems, and quasicrystals

abstract: We present a categorical formalism for context-free languages with morphisms given by correspondences obtained from rational transductions. We show that D0L-systems are a special case of the correspondences that define morphisms in this category. We construct a functorial mapping to aperiodic spin chains. We then generalize this construction to a class of mildly context sensitive grammars, the multiple-context-free grammars (MCFG), with a similar functorial mapping to spin systems in higher dimensions, with Boltzmann weights describing interacting spins on vertices of hypercubes. We show that a particular motivating example for this general construction is provided by the Korepin completely integrable model on the icosahedral quasicrystal, which we construct as the spin system associated to a multiple-context-free grammar describing the geometry of the Ammann planes quasilattice. We review the main properties of this spin system, including solvability, bulk free energy, and criticality, based on results of Baxter and the known relation to the Zamolodchikov tetrahedron equation. We show that the latter has a generalization for the Boltzmannweights on hypercubes of the spin systems associated to more general MCFGs in terms of two dual cubulations of the n-simplex. We formulate analogous questions about bulk free energy and criticality for our construction of spin systems.


title: Time Matters: Enhancing Pre-trained News Recommendation Models with Robust User Dwell Time Injection

abstract: Large Language Models (LLMs) have revolutionized text comprehension, leading to State-of-the-Art (SOTA) news recommendation models that utilize LLMs for in-depth news understanding. Despite this, accurately modeling user preferences remains challenging due to the inherent uncertainty of click behaviors. Techniques like multi-head attention in Transformers seek to alleviate this by capturing interactions among clicks, yet they fall short in integrating explicit feedback signals. User Dwell Time emerges as a powerful indicator, offering the potential to enhance the weak signals emanating from clicks. Nonetheless, its real-world applicability is questionable, especially when dwell time data collection is subject to delays. To bridge this gap, this paper proposes two novel and robust dwell time injection strategies, namely Dwell time Weight (DweW) and Dwell time Aware (DweA). Dwe} concentrates on refining Effective User Clicks through detailed analysis of dwell time, integrating with initial behavioral inputs to construct a more robust user preference. DweA empowers the model with awareness of dwell time information, thereby facilitating autonomous adjustment of attention values in user modeling. This enhancement sharpens the model's ability to accurately identify user preferences. In our experiment using the real-world news dataset from MSN website, we validated that our two strategies significantly improve recommendation performance, favoring high-quality news. Crucially, our approaches exhibit robustness to user dwell time information, maintaining their ability to recommend high-quality content even in extreme cases where dwell time data is entirely missing.


title: 3DSS-Mamba: 3D-Spectral-Spatial Mamba for Hyperspectral Image Classification

abstract: Hyperspectral image (HSI) classification constitutes the fundamental research in remote sensing fields. Convolutional Neural Networks (CNNs) and Transformers have demonstrated impressive capability in capturing spectral-spatial contextual dependencies. However, these architectures suffer from limited receptive fields and quadratic computational complexity, respectively. Fortunately, recent Mamba architectures built upon the State Space Model integrate the advantages of long-range sequence modeling and linear computational efficiency, exhibiting substantial potential in low-dimensional scenarios. Motivated by this, we propose a novel 3D-Spectral-Spatial Mamba (3DSS-Mamba) framework for HSI classification, allowing for global spectral-spatial relationship modeling with greater computational efficiency. Technically, a spectral-spatial token generation (SSTG) module is designed to convert the HSI cube into a set of 3D spectral-spatial tokens. To overcome the limitations of traditional Mamba, which is confined to modeling causal sequences and inadaptable to high-dimensional scenarios, a 3D-Spectral-Spatial Selective Scanning (3DSS) mechanism is introduced, which performs pixel-wise selective scanning on 3D hyperspectral tokens along the spectral and spatial dimensions. Five scanning routes are constructed to investigate the impact of dimension prioritization. The 3DSS scanning mechanism combined with conventional mapping operations forms the 3D-spectral-spatial mamba block (3DMB), enabling the extraction of global spectral-spatial semantic representations. Experimental results and analysis demonstrate that the proposed method outperforms the state-of-the-art methods on HSI classification benchmarks.


title: First joint oscillation analysis of Super-Kamiokande atmospheric and T2K accelerator neutrino data

abstract: The Super-Kamiokande and T2K collaborations present a joint measurement of neutrino oscillation parameters from their atmospheric and beam neutrino data. It uses a common interaction model for events overlapping in neutrino energy and correlated detector systematic uncertainties between the two datasets, which are found to be compatible. Using 3244.4 days of atmospheric data and a beam exposure of $19.7(16.3) \times 10^{20}$ protons on target in (anti)neutrino mode, the analysis finds a 1.9$\sigma$ exclusion of CP-conservation (defined as $J_{CP}=0$) and a preference for the normal mass ordering.


title: Exploring and Exploiting the Asymmetric Valley of Deep Neural Networks

abstract: Exploring the loss landscape offers insights into the inherent principles of deep neural networks (DNNs). Recent work suggests an additional asymmetry of the valley beyond the flat and sharp ones, yet without thoroughly examining its causes or implications. Our study methodically explores the factors affecting the symmetry of DNN valleys, encompassing (1) the dataset, network architecture, initialization, and hyperparameters that influence the convergence point; and (2) the magnitude and direction of the noise for 1D visualization. Our major observation shows that the {\it degree of sign consistency} between the noise and the convergence point is a critical indicator of valley symmetry. Theoretical insights from the aspects of ReLU activation and softmax function could explain the interesting phenomenon. Our discovery propels novel understanding and applications in the scenario of Model Fusion: (1) the efficacy of interpolating separate models significantly correlates with their sign consistency ratio, and (2) imposing sign alignment during federated learning emerges as an innovative approach for model parameter alignment.


title: Customize Your Own Paired Data via Few-shot Way

abstract: Existing solutions to image editing tasks suffer from several issues. Though achieving remarkably satisfying generated results, some supervised methods require huge amounts of paired training data, which greatly limits their usages. The other unsupervised methods take full advantage of large-scale pre-trained priors, thus being strictly restricted to the domains where the priors are trained on and behaving badly in out-of-distribution cases. The task we focus on is how to enable the users to customize their desired effects through only few image pairs. In our proposed framework, a novel few-shot learning mechanism based on the directional transformations among samples is introduced and expands the learnable space exponentially. Adopting a diffusion model pipeline, we redesign the condition calculating modules in our model and apply several technical improvements. Experimental results demonstrate the capabilities of our method in various cases.


title: Bridging the Gap Between Domain-specific Frameworks and Multiple Hardware Devices

abstract: The rapid development of domain-specific frameworks has presented us with a significant challenge: The current approach of implementing solutions on a case-by-case basis incurs a theoretical complexity of O(M*N), thereby increasing the cost of porting applications to different hardware platforms. To address these challenges, we propose a systematic methodology that effectively bridges the gap between domain-specific frameworks and multiple hardware devices, reducing porting complexity to O(M+N). The approach utilizes multi-layer abstractions. Different domain-specific abstractions are employed to represent applications from various domains. These abstractions are then transformed into a unified abstraction, which is subsequently translated into combinations of primitive operators. Finally, these operators are mapped to multiple hardware platforms. The implemented unified framework supports deep learning, classical machine learning, and data analysis across X86, ARM, RISC-V, IoT devices, and GPU. It outperforms existing solutions like scikit-learn, hummingbird, Spark, and pandas, achieving impressive speedups: 1.1x to 3.83x on X86 servers, 1.06x to 4.33x on ARM IoT devices, 1.25x to 3.72x on RISC-V IoT devices, and 1.93x on GPU. The source code is available at https://github.com/BenchCouncil/bridger.git.


title: The influence of the Sun and Moon on the observation of very high energy gamma-ray sources using EAS arrays

abstract: With great advance of ground-based extensive air shower array, such as LHAASO and HAWC, many very high energy (VHE) gamma-ray sources have been discovered and are been monitored regardless of the day and the night. Hence, the Sun and Moon would have some compact on the observation of gamma-ray sources, which have not been taken into account in previous analysis. In this paper, the influence of the Sun and Moon on the observation of very high energy gamma-ray sources when they are near the line of sight of the Sun or Moon is estimated. The tracks of all the known VHE sources are scanned and several VHE sources are found to be very close to the line of sight of the Sun or Moon during some period. The absorption of very high energy gamma-ray by sunlight is estimated with detailed method and some usefully conclusions are achieved. The main influence is the block of the Sun and Moon on gamma-ray and their shadow on the cosmic ray background. The influence is investigated considering the detector angular resolution and some strategy on data analysis are proposed to avoid the underestimation of the gamma-ray emission.


title: Visualizing, Rethinking, and Mining the Loss Landscape of Deep Neural Networks

abstract: The loss landscape of deep neural networks (DNNs) is commonly considered complex and wildly fluctuated. However, an interesting observation is that the loss surfaces plotted along Gaussian noise directions are almost v-basin ones with the perturbed model lying on the basin. This motivates us to rethink whether the 1D or 2D subspace could cover more complex local geometry structures, and how to mine the corresponding perturbation directions. This paper systematically and gradually categorizes the 1D curves from simple to complex, including v-basin, v-side, w-basin, w-peak, and vvv-basin curves. Notably, the latter two types are already hard to obtain via the intuitive construction of specific perturbation directions, and we need to propose proper mining algorithms to plot the corresponding 1D curves. Combining these 1D directions, various types of 2D surfaces are visualized such as the saddle surfaces and the bottom of a bottle of wine that are only shown by demo functions in previous works. Finally, we propose theoretical insights from the lens of the Hessian matrix to explain the observed several interesting phenomena.


title: Phishing Email Detection Using Inputs From Artificial Intelligence

abstract: Enterprise security is increasingly being threatened by social engineering attacks, such as phishing, which deceive employees into giving access to enterprise data. To protect both the users themselves and enterprise data, more and more organizations provide cyber security training that seeks to teach employees/customers to identify and report suspicious content. By its very nature, such training seeks to focus on signals that are likely to persist across a wide range of attacks. Further, it expects the user to apply the learnings from these training on e-mail messages that were not filtered by existing, automatic enterprise security (e.g., spam filters and commercial phishing detection software). However, relying on such training now shifts the detection of phishing from an automatic process to a human driven one which is fallible especially when a user errs due to distraction, forgetfulness, etc. In this work we explore treating this type of detection as a natural language processing task and modifying training pipelines accordingly. We present a dataset with annotated labels where these labels are created from the classes of signals that users are typically asked to identify in such training. We also present baseline classifier models trained on these classes of labels. With a comparative analysis of performance between human annotators and the models on these labels, we provide insights which can contribute to the improvement of the respective curricula for both machine and human training.


title: A stochastic algorithm approach for the elephant random walk with applications

abstract: The randomized play-the-winner rule (RPW) is a response-adaptive design proposed by Wei and Durham (1978) for sequentially randomizing patients to treatments in a two-treatment clinical trial so that more patients are assigned to the better treatment as the clinical trial goes on. The elephant random walk (ERW) proposed by Schutz and Trimper (2004) is a non-Markovian discrete-time random walk on $\mathbb Z$ which has a link to a famous saying that elephants can always remember where they have been. The asymptotic behaviors of RPW rule and ERW have been studied in litterateurs independently, and their asymptotic behaviors are very similar. In this paper, we show that the RPW rule is a biased ERW and link them with the recursive stochastic algorithm. With the help of a recursive stochastic algorithm, we obtain the strong invariance principle of the ERW as well as multi-dimensional varying-memory ERW with random step sizes. By the strong invariance principle, the central limit theorem, precise law of the iterated logarithm and almost sure central limit theorem are obtained for both the multi-dimensional ERW, and the multi-dimensional ERW with random step sizes and their centers of mass. The Chung type law of the iterated logarithm of the multi-dimensional ERW is also obtained.


title: A Survey of Integrating Wireless Technology into Active Noise Control

abstract: Active Noise Control (ANC) is a widely adopted technology for reducing environmental noise across various scenarios. This paper focuses on enhancing noise reduction performance, particularly through the refinement of signal quality fed into ANC systems. We discuss the main wireless technique integrated into the ANC system, equipped with some innovative algorithms, in diverse environments. Instead of using microphone arrays, which increase the computation complexity of the ANC system, to isolate multiple noise sources to improve noise reduction performance, the application of the wireless technique avoids extra computation demand. Wireless transmissions of reference, error, and control signals are also applied to improve the convergence performance of the ANC system. Furthermore, this paper lists some wireless ANC applications, such as earbuds, headphones, windows, and headrests, underscoring their adaptability and efficiency in various settings.


title: RaBitQ: Quantizing High-Dimensional Vectors with a Theoretical Error Bound for Approximate Nearest Neighbor Search

abstract: Searching for approximate nearest neighbors (ANN) in the high-dimensional Euclidean space is a pivotal problem. Recently, with the help of fast SIMD-based implementations, Product Quantization (PQ) and its variants can often efficiently and accurately estimate the distances between the vectors and have achieved great success in the in-memory ANN search. Despite their empirical success, we note that these methods do not have a theoretical error bound and are observed to fail disastrously on some real-world datasets. Motivated by this, we propose a new randomized quantization method named RaBitQ, which quantizes $D$-dimensional vectors into $D$-bit strings. RaBitQ guarantees a sharp theoretical error bound and provides good empirical accuracy at the same time. In addition, we introduce efficient implementations of RaBitQ, supporting to estimate the distances with bitwise operations or SIMD-based operations. Extensive experiments on real-world datasets confirm that (1) our method outperforms PQ and its variants in terms of accuracy-efficiency trade-off by a clear margin and (2) its empirical performance is well-aligned with our theoretical analysis.


title: Model independent calibration for sound horizon combining observations of supernovae and transversal BAO measurements

abstract: The sound horizon is a key theoretical prediction of the cosmological model that depends on the speed of sound and the rate of expansion in the early universe, before matter and radiation decoupled. The standard ruler for low redshift calibration of baryon acoustic oscillations (BAOs) is a direct measurement that would exist even if the standard cosmological model and the standard assumptions of early physics did not. We propose a new model-independent method to calibrate sound horizon $r^h_s$ (relative standard ruler) by using the latest observations of SNe Ia and transversal BAO measurements. The final result reports $r_s^{h}=107.10^{+1.36}_{-1.32}$ $Mpc/h$ in the framework of the Pantheon dataset. This result changes to $r_s^{h}=105.63^{+1.33}_{-1.31}$ $Mpc/h$ when uses Pantheon+ dataset. Note that even without an estimate of dimensionless Hubble constant $h$, the combination of BAO and SNe Ia datasets already constrain the low-redshift standard ruler scale $r_s^{h}$ at the $\sim1.26\%$ level. More importantly, it is interesting to find that most of the $r_s^{h}$ obtained at high redshifts have a larger value (9 out of 15 results are larger than the result obtained by combining all BAOs). This finding may give us a better understanding of the discordance between the data sets or Hubble tension or reveal new physics beyond the standard model.


title: Inversin of double Fourier integral of non-Lebesgue integrable bounded variation functions

abstract: This work proves pointwise convergence of the truncated Fourier double integral of non-Lebesgue integrable bounded variation functions. This leads to the Dirichlet-Jordan theorem proof for non-Lebesgue integrable functions, which has not been sufficiently studied. Note that recent contributions regarding this subject consider Lebesgue integrable functions, [F. Moricz, 2015], [B. Ghodadra-V. Fuulop, 2016].


title: Entropic associative memory for real world images

abstract: The entropic associative memory (EAM) is a computational model of natural memory incorporating some of its putative properties of being associative, distributed, declarative, abstractive and constructive. Previous experiments satisfactorily tested the model on structured, homogeneous and conventional data: images of manuscripts digits and letters, images of clothing, and phone representations. In this work we show that EAM appropriately stores, recognizes and retrieves complex and unconventional images of animals and vehicles. Additionally, the memory system generates meaningful retrieval association chains for such complex images. The retrieved objects can be seen as proper memories, associated recollections or products of imagination.


title: The origin of large emission line widths in massive galaxies at redshifts $z\sim 3-4$

abstract: We present a sample of 22 massive galaxies with stellar masses $>10^{10} M_{\odot}$ at $3<z<4$ with deep H and K-band high resolution spectra (R=3500-3000) from Keck/MOSFIRE and VLT/KMOS near-infrared spectrographs. We find a large fraction have strong [OIII]5007 and H$\beta$ emission lines with large line widths ($\sigma$ 100 -- 450 km/s). We measure the sizes of our galaxies from Hubble Space Telescope images and consider the potential kinematic scaling relations of our sample; and rule out an explanation for these broad lines in terms of galaxy-wide kinematics. Based on consideration of the [OIII]5007 $/$ H$\beta$ flux ratios, their location in the Mass--Excitation diagram, and the derived bolometric luminosities, we conclude that Active Galactic Nuclei (AGN) and their Narrow Line Regions most likely give rise to this emission. At redshifts $3<z<4$, we find significantly high AGN fractions in massive galaxies, ranging from 60--70\% for the mass range $10<\log(M_{\star}/M_{\odot})<11$, with a lower limit 30\% for all galaxies within that redshift range when we apply our most stringent AGN criteria. We also find a considerably lower AGN fraction in massive quiescent galaxies, ranging from 20-30\%. These fractions of AGN point to the period between $3<z<4$ being a time of heightened activity for the development of supermassive black holes in the massive end of the galaxy population and provide evidence for their role in the emergence of the first massive quenched galaxies at this epoch.


title: EntropyStop: Unsupervised Deep Outlier Detection with Loss Entropy

abstract: Unsupervised Outlier Detection (UOD) is an important data mining task. With the advance of deep learning, deep Outlier Detection (OD) has received broad interest. Most deep UOD models are trained exclusively on clean datasets to learn the distribution of the normal data, which requires huge manual efforts to clean the real-world data if possible. Instead of relying on clean datasets, some approaches directly train and detect on unlabeled contaminated datasets, leading to the need for methods that are robust to such conditions. Ensemble methods emerged as a superior solution to enhance model robustness against contaminated training sets. However, the training time is greatly increased by the ensemble. In this study, we investigate the impact of outliers on the training phase, aiming to halt training on unlabeled contaminated datasets before performance degradation. Initially, we noted that blending normal and anomalous data causes AUC fluctuations, a label-dependent measure of detection accuracy. To circumvent the need for labels, we propose a zero-label entropy metric named Loss Entropy for loss distribution, enabling us to infer optimal stopping points for training without labels. Meanwhile, we theoretically demonstrate negative correlation between entropy metric and the label-based AUC. Based on this, we develop an automated early-stopping algorithm, EntropyStop, which halts training when loss entropy suggests the maximum model detection capability. We conduct extensive experiments on ADBench (including 47 real datasets), and the overall results indicate that AutoEncoder (AE) enhanced by our approach not only achieves better performance than ensemble AEs but also requires under 2\% of training time. Lastly, our proposed metric and early-stopping approach are evaluated on other deep OD models, exhibiting their broad potential applicability.


title: CLRKDNet: Speeding up Lane Detection with Knowledge Distillation

abstract: Road lanes are integral components of the visual perception systems in intelligent vehicles, playing a pivotal role in safe navigation. In lane detection tasks, balancing accuracy with real-time performance is essential, yet existing methods often sacrifice one for the other. To address this trade-off, we introduce CLRKDNet, a streamlined model that balances detection accuracy with real-time performance. The state-of-the-art model CLRNet has demonstrated exceptional performance across various datasets, yet its computational overhead is substantial due to its Feature Pyramid Network (FPN) and muti-layer detection head architecture. Our method simplifies both the FPN structure and detection heads, redesigning them to incorporate a novel teacher-student distillation process alongside a newly introduced series of distillation losses. This combination reduces inference time by up to 60% while maintaining detection accuracy comparable to CLRNet. This strategic balance of accuracy and speed makes CLRKDNet a viable solution for real-time lane detection tasks in autonomous driving applications.


title: SN 2019tua : A Type IIb Supernova with Multiple Bumps in the Light Curves

abstract: We present photometric and spectroscopic observations and analysis of the type IIb supernova (SN) SN 2019tua, which exhibits multiple bumps in its declining light curves between 40 and 65 days after discovery. SN 2019tua shows a time to peak of about 25 days similar to other type IIb SNe. Our observations indicate a decrease in its brightness of about 1 magnitude in the 60 days after the peak. At about days 50, and 60, its multiband light curves exhibit bumpy behavior. The complex luminosity evolution of SN 2019tua could not be well modeled with a single currently popular energy source model, e.g., radioactive decay of $^{56}$Ni, magnetar, interaction between the ejecta and a circumstellar shell. Even though the magnetar model has a smaller $\chi^2 / \text{dof}$ value, the complex changes in SN 2019tua's brightness suggest that more than one physical process might be involved. We propose a hybrid CSM interaction plus $^{56}$Ni model to explain the bolometric light curve (LC) of SN 2019tua. The fitting results show that the ejecta mass $M_{\rm ej} \approx 2.4~M_\odot$, the total CSM mass $M_{\rm CSM} \approx 1.0~M_\odot$, and the $^{56}$Ni mass $M_{\rm Ni} \approx 0.4~M_\odot$. The total kinetic energy of the ejecta is $E_k\approx 0.5 \times 10^{51}\rm~erg$. Pre-existing multiple shells suggest that the progenitor of SN 2019tua experienced mass ejections within approximately $\sim6 - 44$ years prior to the explosion.


title: NOVA-3D: Non-overlapped Views for 3D Anime Character Reconstruction

abstract: In the animation industry, 3D modelers typically rely on front and back non-overlapped concept designs to guide the 3D modeling of anime characters. However, there is currently a lack of automated approaches for generating anime characters directly from these 2D designs. In light of this, we explore a novel task of reconstructing anime characters from non-overlapped views. This presents two main challenges: existing multi-view approaches cannot be directly applied due to the absence of overlapping regions, and there is a scarcity of full-body anime character data and standard benchmarks. To bridge the gap, we present Non-Overlapped Views for 3D \textbf{A}nime Character Reconstruction (NOVA-3D), a new framework that implements a method for view-aware feature fusion to learn 3D-consistent features effectively and synthesizes full-body anime characters from non-overlapped front and back views directly. To facilitate this line of research, we collected the NOVA-Human dataset, which comprises multi-view images and accurate camera parameters for 3D anime characters. Extensive experiments demonstrate that the proposed method outperforms baseline approaches, achieving superior reconstruction of anime characters with exceptional detail fidelity. In addition, to further verify the effectiveness of our method, we applied it to the animation head reconstruction task and improved the state-of-the-art baseline to 94.453 in SSIM, 7.726 in LPIPS, and 19.575 in PSNR on average. Codes and datasets are available at https://wanghongsheng01.github.io/NOVA-3D/.


title: Upper bounds for moments of zeta sums

abstract: We establish upper bounds for moments of zeta sums using results on shifted moments of the Riemann zeta function under the Riemann hypothesis.


title: Compiler support for semi-manual AoS-to-SoA conversions with data views

abstract: The C programming language and its cousins such as C++ stipulate the static storage of sets of structured data: Developers have to commit to one, invariant data model -- typically a structure-of-arrays (SoA) or an array-of-structs (AoS) -- unless they manually rearrange, i.e.~convert it throughout the computation. Whether AoS or SoA is favourable depends on the execution context and algorithm step. We propose a language extension based upon C++ attributes through which developers can guide the compiler what memory arrangements are to be used. The compiler can then automatically convert (parts of) the data into the format of choice prior to a calculation and convert results back afterwards. As all conversions are merely annotations, it is straightforward for the developer to experiment with different storage formats and to pick subsets of data that are subject to memory rearrangements. Our work implements the annotations within Clang and demonstrates their potential impact through a smoothed particle hydrodynamics (SPH) code.


title: Upper bounding the quantum space complexity for computing class group and principal ideal problem

abstract: In this paper, we calculate the upper bound on quantum space complexity of the quantum algorithms proposed by Biasse and Song (SODA'16) for solving class group computation and the principal ideal problem using the reductions to $S$-unit group computation. We follow the approach of Barbulescu and Poulalion (AFRICACRYPT'23) and the framework given by de Boer, Ducas, and Fehr (EUROCRYPT'20) and Eisentr\"{a}ger, Hallgren, Kitaev, and Song (STOC'14).


title: Active Object Detection with Knowledge Aggregation and Distillation from Large Models

abstract: Accurately detecting active objects undergoing state changes is essential for comprehending human interactions and facilitating decision-making. The existing methods for active object detection (AOD) primarily rely on visual appearance of the objects within input, such as changes in size, shape and relationship with hands. However, these visual changes can be subtle, posing challenges, particularly in scenarios with multiple distracting no-change instances of the same category. We observe that the state changes are often the result of an interaction being performed upon the object, thus propose to use informed priors about object related plausible interactions (including semantics and visual appearance) to provide more reliable cues for AOD. Specifically, we propose a knowledge aggregation procedure to integrate the aforementioned informed priors into oracle queries within the teacher decoder, offering more object affordance commonsense to locate the active object. To streamline the inference process and reduce extra knowledge inputs, we propose a knowledge distillation approach that encourages the student decoder to mimic the detection capabilities of the teacher decoder using the oracle query by replicating its predictions and attention. Our proposed framework achieves state-of-the-art performance on four datasets, namely Ego4D, Epic-Kitchens, MECCANO, and 100DOH, which demonstrates the effectiveness of our approach in improving AOD.


title: Electric field induction in quark-gluon plasma due to thermoelectric effects

abstract: Relativistic heavy-ion collisions produce quark-gluon plasma (QGP), which is locally thermalized. QGP with higher thermal conductivity advances towards global thermalization. Being made of electrically charged particles (quarks), QGP exhibits interesting thermoelectric phenomena during its evolution, resulting in the induction of an electric field in the medium. For the first time, we estimate the induced electric field in the QGP due to thermoelectric effect. This can be seen even in the QGP produced in the head-on collisions. The Seebeck coefficient is essential in determining the induced field. However, spectator current can produce a magnetic field in peripheral heavy-ion collisions. This breaks the isotropy of the thermoelectric coefficient matrix and introduces magneto-Seebeck and Nernst coefficients that contribute to the induced electric field in peripheral collisions. We have taken care of the temperature evolution of QGP with different hydrodynamic cooling rates to calculate the transport coefficients. The induced electric field is estimated with the cooling rate obtained from Gubser hydrodynamic flow. We estimated the space-time profile of the induced field and found that it is zero at the center and increases as we go away from the center. At the early time of evolution, the electric field can reach a maximum value of $eE \approx 1~m_\pi^2$, and the strength decreases in time. Moreover, we estimated the transport coefficients in the presence of the external time-varying magnetic field. The effect of the intensity and decay parameter of the magnetic field on the induced electric field is also explored.


title: Quantum Computing for Databases: Overview and Challenges

abstract: In the decades, the general field of quantum computing has experienced remarkable progress since its inception. A plethora of researchers not only proposed quantum algorithms showing the power of quantum computing but also constructed the prototype of quantum computers, making it walk into our tangible reality. Those remarkable advancements in quantum computing have opened doors for novel applications, one of which is quantum databases. Researchers are trying to use a paradigm brought by quantum computing to revolutionize various aspects of database management systems. In this paper, we envision the synergy between quantum computing and databases with two perspectives: Quantum computing-enabled technology, and quantum computing-inspired technology. Based on this classification, we present a detailed overview of the research attained in this area, aiming to show the landscape of the field and draw a road map of future directions.


title: Rethink Predicting the Optical Flow with the Kinetics Perspective

abstract: Optical flow estimation is one of the fundamental tasks in low-level computer vision, which describes the pixel-wise displacement and can be used in many other tasks. From the apparent aspect, the optical flow can be viewed as the correlation between the pixels in consecutive frames, so continuously refining the correlation volume can achieve an outstanding performance. However, it will make the method have a catastrophic computational complexity. Not only that, the error caused by the occlusion regions of the successive frames will be amplified through the inaccurate warp operation. These challenges can not be solved only from the apparent view, so this paper rethinks the optical flow estimation from the kinetics viewpoint.We propose a method combining the apparent and kinetics information from this motivation. The proposed method directly predicts the optical flow from the feature extracted from images instead of building the correlation volume, which will improve the efficiency of the whole network. Meanwhile, the proposed method involves a new differentiable warp operation that simultaneously considers the warping and occlusion. Moreover, the proposed method blends the kinetics feature with the apparent feature through the novel self-supervised loss function. Furthermore, comprehensive experiments and ablation studies prove that the proposed novel insight into how to predict the optical flow can achieve the better performance of the state-of-the-art methods, and in some metrics, the proposed method outperforms the correlation-based method, especially in situations containing occlusion and fast moving. The code will be public.


title: Fully Randomized Pointers

abstract: Software security continues to be a critical concern for programs implemented in low-level programming languages such as C and C++. Many defenses have been proposed in the current literature, each with different trade-offs including performance, compatibility, and attack resistance. One general class of defense is pointer randomization or authentication, where invalid object access (e.g., memory errors) is obfuscated or denied. Many defenses rely on the program termination (e.g., crashing) to abort attacks, with the implicit assumption that an adversary cannot "brute force" the defense with multiple attack attempts. However, such assumptions do not always hold, such as hardware speculative execution attacks or network servers configured to restart on error. In such cases, we argue that most existing defenses provide only weak effective security. In this paper, we propose Fully Randomized Pointers (FRP) as a stronger memory error defense that is resistant to even brute force attacks. The key idea is to fully randomize pointer bits -- as much as possible while also preserving binary compatibility -- rendering the relationships between pointers highly unpredictable. Furthermore, the very high degree of randomization renders brute force attacks impractical -- providing strong effective security compared to existing work. We design a new FRP encoding that is: (1) compatible with existing binary code (without recompilation); (2) decoupled from the underlying object layout; and (3) can be efficiently decoded on-the-fly to the underlying memory address. We prototype FRP in the form of a software implementation (BlueFat) to test security and compatibility, and a proof-of-concept hardware implementation (GreenFat) to evaluate performance. We show that FRP is secure, practical, and compatible at the binary level, while a hardware implementation can achieve low performance overheads (<10%).


title: Future You: A Conversation with an AI-Generated Future Self Reduces Anxiety, Negative Emotions, and Increases Future Self-Continuity

abstract: We introduce "Future You," an interactive, brief, single-session, digital chat intervention designed to improve future self-continuity--the degree of connection an individual feels with a temporally distant future self--a characteristic that is positively related to mental health and wellbeing. Our system allows users to chat with a relatable yet AI-powered virtual version of their future selves that is tuned to their future goals and personal qualities. To make the conversation realistic, the system generates a "synthetic memory"--a unique backstory for each user--that creates a throughline between the user's present age (between 18-30) and their life at age 60. The "Future You" character also adopts the persona of an age-progressed image of the user's present self. After a brief interaction with the "Future You" character, users reported decreased anxiety, and increased future self-continuity. This is the first study successfully demonstrating the use of personalized AI-generated characters to improve users' future self-continuity and wellbeing.


title: Generalized Baker's result and stability of functional equations using fixed point results

abstract: Hyre-Ulam stability of functional equation in single variable is studied in non-triangular metric spaces. We derive it as applications of some fixed point results developed on the said structure. A general version of Baker's theorem is also deduced as a consequence.


title: Explosive synchronization in coupled stars

abstract: We study the effect of network topology on the collective dynamics of an oscillator ensemble. Specifically, we explore explosive synchronization in a system of interacting star networks. Explosive synchronization is characterized by an abrupt transition from an incoherent state to a coherent state. In this study, we couple multiple star networks through their hubs and study the emergent dynamics as a function of coupling strength. The dynamics of each node satisfies the equation of a Kuramoto oscillator. We observe that for a small inter-star coupling strength, the hysteresis width between the forward and backward transition point is minimal, which increases with an increase in the inter-star coupling strength. This observation is independent of the size of the network. Further, we find that the backward transition point is independent of the number of stars coupled together and the inter-star coupling strength, which is also verified using the Watanabe and Strogatz (WS) theory.


title: Hybrid dynamics of hyperbolic automorphisms of K3 surfaces

abstract: We study degenerating families of hyperbolic dynamics over complex K3 surfaces by means of the theory of hybrid spaces by Boucksom, Favre, and Jonsson. For an analytic family of hyperbolic automorphisms $\{f_t: X_t\to X_t\}_{t\in\mathbb{D}^*}$ over K3 surfaces $X_t$ that is possibly meromorphically degenerating at the origin, we consider the family of invariant measures $\{\eta_t\}$ on $X_t$ constructed by Cantat. The family $f_t$ induces a hyperbolic automorphism $f_{\mathbb{C}((t))}^{\mathop{\mathrm{an}}}:X_{\mathbb{C}((t))}^{\mathop{\mathrm{an}}}\to X_{\mathbb{C}((t))}^{\mathop{\mathrm{an}}}$ over the induced non-archimedean K3 surface, where we also have a measure $\eta_0$ by Filip. Our main theorem states the weak convergence of $\{\eta_t\}$ to $\eta_0$ as $t\to0$ over the induced so-called hybrid space.


title: WST -- Widefield Spectroscopic Telescope: Motivation, science drivers and top-level requirements for a new dedicated facility

abstract: In this paper, we describe the wide-field spectroscopic survey telescope (WST) project. WST is a 12-metre wide-field spectroscopic survey telescope with simultaneous operation of a large field-of-view (3 sq. degree), high-multiplex (20,000) multi-object spectrograph (MOS), with both a low and high-resolution modes, and a giant 3x3 arcmin2 integral field spectrograph (IFS). In scientific capability, these specifications place WST far ahead of existing and planned facilities. In only 5 years of operation, the MOS would target 250 million galaxies and 25 million stars at low spectral resolution, plus 2 million stars at high resolution. Without need for pre-imaged targets, the IFS would deliver 4 billion spectra offering many serendipitous discoveries. Given the current investment in deep imaging surveys and noting the diagnostic power of spectroscopy, WST will fill a crucial gap in astronomical capability and work in synergy with future ground and space-based facilities. We show how it can address outstanding scientific questions in the areas of cosmology; galaxy assembly, evolution, and enrichment, including our own Milky Way; the origin of stars and planets; and time domain and multi-messenger astrophysics. WST's uniquely rich dataset may yield unforeseen discoveries in many of these areas. The telescope and instruments are designed as an integrated system and will mostly use existing technology, with the aim to minimise the carbon footprint and environmental impact. We will propose WST as the next European Southern Observatory (ESO) project after completion of the 39-metre ELT.

categories: astro-ph.IM astro-ph.CO astro-ph.GA astro-ph.SR


title: MAGE: Model-Level Graph Neural Networks Explanations via Motif-based Graph Generation

abstract: Graph Neural Networks (GNNs) have shown remarkable success in molecular tasks, yet their interpretability remains challenging. Traditional model-level explanation methods like XGNN and GNNInterpreter often fail to identify valid substructures like rings, leading to questionable interpretability. This limitation stems from XGNN's atom-by-atom approach and GNNInterpreter's reliance on average graph embeddings, which overlook the essential structural elements crucial for molecules. To address these gaps, we introduce an innovative \textbf{M}otif-b\textbf{A}sed \textbf{G}NN \textbf{E}xplainer (MAGE) that uses motifs as fundamental units for generating explanations. Our approach begins with extracting potential motifs through a motif decomposition technique. Then, we utilize an attention-based learning method to identify class-specific motifs. Finally, we employ a motif-based graph generator for each class to create molecular graph explanations based on these class-specific motifs. This novel method not only incorporates critical substructures into the explanations but also guarantees their validity, yielding results that are human-understandable. Our proposed method's effectiveness is demonstrated through quantitative and qualitative assessments conducted on six real-world molecular datasets.


title: MOSS: A Large-scale Open Microscopic Traffic Simulation System

abstract: In the research of Intelligent Transportation Systems (ITS), traffic simulation is a key procedure for the evaluation of new methods and optimization of strategies. However, existing traffic simulation systems face two challenges. First, how to balance simulation scale with realism is a dilemma. Second, it is hard to simulate realistic results, which requires realistic travel demand data and simulator. These problems limit computer-aided optimization of traffic management strategies for large-scale road networks and reduce the usability of traffic simulations in areas where real-world travel demand data are lacking. To address these problems, we design and implement MObility Simulation System (MOSS). MOSS adopts GPU acceleration to significantly improve the efficiency and scale of microscopic traffic simulation, which enables realistic and fast simulations for large-scale road networks. It provides realistic travel Origin-Destination (OD) matrices generation through a pre-trained generative neural network model based on publicly available data on a global scale, such as satellite imagery, to help researchers build meaningful travel demand data. It also provides a complete open toolchain to help users with road network construction, demand generation, simulation, and result analysis. The whole toolchain including the simulator can be accessed at https://moss.fiblab.net and the codes are open-source for community collaboration.


title: Unleash Graph Neural Networks from Heavy Tuning

abstract: Graph Neural Networks (GNNs) are deep-learning architectures designed for graph-type data, where understanding relationships among individual observations is crucial. However, achieving promising GNN performance, especially on unseen data, requires comprehensive hyperparameter tuning and meticulous training. Unfortunately, these processes come with high computational costs and significant human effort. Additionally, conventional searching algorithms such as grid search may result in overfitting on validation data, diminishing generalization accuracy. To tackle these challenges, we propose a graph conditional latent diffusion framework (GNN-Diff) to generate high-performing GNNs directly by learning from checkpoints saved during a light-tuning coarse search. Our method: (1) unleashes GNN training from heavy tuning and complex search space design; (2) produces GNN parameters that outperform those obtained through comprehensive grid search; and (3) establishes higher-quality generation for GNNs compared to diffusion frameworks designed for general neural networks.


title: Sparse Autoencoders Enable Scalable and Reliable Circuit Identification in Language Models

abstract: This paper introduces an efficient and robust method for discovering interpretable circuits in large language models using discrete sparse autoencoders. Our approach addresses key limitations of existing techniques, namely computational complexity and sensitivity to hyperparameters. We propose training sparse autoencoders on carefully designed positive and negative examples, where the model can only correctly predict the next token for the positive examples. We hypothesise that learned representations of attention head outputs will signal when a head is engaged in specific computations. By discretising the learned representations into integer codes and measuring the overlap between codes unique to positive examples for each head, we enable direct identification of attention heads involved in circuits without the need for expensive ablations or architectural modifications. On three well-studied tasks - indirect object identification, greater-than comparisons, and docstring completion - the proposed method achieves higher precision and recall in recovering ground-truth circuits compared to state-of-the-art baselines, while reducing runtime from hours to seconds. Notably, we require only 5-10 text examples for each task to learn robust representations. Our findings highlight the promise of discrete sparse autoencoders for scalable and efficient mechanistic interpretability, offering a new direction for analysing the inner workings of large language models.


title: Single Image Unlearning: Efficient Machine Unlearning in Multimodal Large Language Models

abstract: Machine unlearning empowers individuals with the `right to be forgotten' by removing their private or sensitive information encoded in machine learning models. However, it remains uncertain whether MU can be effectively applied to Multimodal Large Language Models (MLLMs), particularly in scenarios of forgetting the leaked visual data of concepts. To overcome the challenge, we propose an efficient method, Single Image Unlearning (SIU), to unlearn the visual recognition of a concept by fine-tuning a single associated image for few steps. SIU consists of two key aspects: (i) Constructing Multifaceted fine-tuning data. We introduce four targets, based on which we construct fine-tuning data for the concepts to be forgotten; (ii) Jointly training loss. To synchronously forget the visual recognition of concepts and preserve the utility of MLLMs, we fine-tune MLLMs through a novel Dual Masked KL-divergence Loss combined with Cross Entropy loss. Alongside our method, we establish MMUBench, a new benchmark for MU in MLLMs and introduce a collection of metrics for its evaluation. Experimental results on MMUBench show that SIU completely surpasses the performance of existing methods. Furthermore, we surprisingly find that SIU can avoid invasive membership inference attacks and jailbreak attacks. To the best of our knowledge, we are the first to explore MU in MLLMs. We will release the code and benchmark in the near future.


title: APTT: An accuracy-preserved tensor-train method for the Boltzmann-BGK equation

abstract: Solving the Boltzmann-BGK equation with traditional numerical methods suffers from high computational and memory costs due to the curse of dimensionality. In this paper, we propose a novel accuracy-preserved tensor-train (APTT) method to efficiently solve the Boltzmann-BGK equation. A second-order finite difference scheme is applied to discretize the Boltzmann-BGK equation, resulting in a tensor algebraic system at each time step. Based on the low-rank TT representation, the tensor algebraic system is then approximated as a TT-based low-rank system, which is efficiently solved using the TT-modified alternating least-squares (TT-MALS) solver. Thanks to the low-rank TT representation, the APTT method can significantly reduce the computational and memory costs compared to traditional numerical methods. Theoretical analysis demonstrates that the APTT method maintains the same convergence rate as that of the finite difference scheme. The convergence rate and efficiency of the APTT method are validated by several benchmark test cases.


title: Cache Blocking of Distributed-Memory Parallel Matrix Power Kernels

abstract: Sparse matrix-vector products (SpMVs) are a bottleneck in many scientific codes. Due to the heavy strain on the main memory interface from loading the sparse matrix and the possibly irregular memory access pattern, SpMV typically exhibits low arithmetic intensity. Repeating these products multiple times with the same matrix is required in many algorithms. This so-called matrix power kernel (MPK) provides an opportunity for data reuse since the same matrix data is loaded from main memory multiple times, an opportunity that has only recently been exploited successfully with the Recursive Algebraic Coloring Engine (RACE). Using RACE, one considers a graph based formulation of the SpMV and employs s level-based implementation of SpMV for reuse of relevant matrix data. However, the underlying data dependencies have restricted the use of this concept to shared memory parallelization and thus to single compute nodes. Enabling cache blocking for distributed-memory parallelization of MPK is challenging due to the need for explicit communication and synchronization of data in neighboring levels. In this work, we propose and implement a flexible method that interleaves the cache-blocking capabilities of RACE with an MPI communication scheme that fulfills all data dependencies among processes. Compared to a "traditional" distributed memory parallel MPK, our new Distributed Level-Blocked MPK yields substantial speed-ups on modern Intel and AMD architectures across a wide range of sparse matrices from various scientific applications. Finally, we address a modern quantum physics problem to demonstrate the applicability of our method, achieving a speed-up of up to 4x on 832 cores of an Intel Sapphire Rapids cluster.


title: Enhanced Terahertz Emission from the Wakefield of CO2 Laser-Created Plasma

abstract: High-field terahertz (THz) pulse generation is investigated through the interaction of an intense single-color CO2 laser pulse with helium (He) gas targets. Employing multi-dimensional Particle-In-Cell (PIC) simulations, this study reveals a substantial enhancement in THz generation efficiency, even with a single-color laser pulse interacting with gas targets in the self-modulated-laser-wakefield (SMLWF) regime. Our study demonstrates that in the presence of photoionization, a synergistic interplay of laser self-modulation, self-focusing, and local pump depletion leads to the generation of robust THz pulses polarized parallel to the laser electric field. The dependence of THz generation efficiency on target density and laser pulse duration has been investigated. Our study identifies a favourable parametric regime for producing THz fields with amplitudes reaching hundreds of GV/m, surpassing those reported in previous studies.


title: Nonlocal free-energy density functional for warm dense matter

abstract: Finite-temperature orbital-free density functional theory (FT-OFDFT) holds significant promise for simulating warm dense matter due to its favorable scaling with both system size and temperature. However, the lack of the numerically accurate and transferable noninteracting free energy functionals results in a limit on the application of FT-OFDFT for warm dense matter simulations. Here, a nonlocal free energy functional, named XWMF, was derived by line integrals for FT-OFDFT simulations. Particularly, a designed integral path, wherein the electronic density varies from uniform to inhomogeneous, was employed to accurately describe deviations in response behavior from the uniform electron gas. The XWMF has been benchmarked by a range of warm dense matter systems including the Si, Al, H, He, and H-He mixture. The simulated results demonstrate that FT-OFDFT within XWMF achieves remarkable performance for accuracy and numerical stability. It is worth noting that XWMF exhibits a low computational cost for large-scale ab~initio simulations, offering exciting opportunities for the realistic simulations of warm dense matter systems covering a broad range of temperatures and pressures.


title: SirLLM: Streaming Infinite Retentive LLM

abstract: As Large Language Models (LLMs) become increasingly prevalent in various domains, their ability to process inputs of any length and maintain a degree of memory becomes essential. However, the one-off input of overly long texts is limited, as studies have shown that when input lengths exceed the LLMs' pre-trained text length, there is a dramatic decline in text generation capabilities. Moreover, simply extending the length of pre-training texts is impractical due to the difficulty in obtaining long text data and the substantial memory consumption costs this would entail for LLMs. Recent efforts have employed streaming inputs to alleviate the pressure of excessively long text inputs, but this approach can significantly impair the model's long-term memory capabilities. Motivated by this challenge, we introduce Streaming Infinite Retentive LLM (SirLLM), which allows LLMs to maintain longer memory during infinite-length dialogues without the need for fine-tuning. SirLLM utilizes the Token Entropy metric and a memory decay mechanism to filter key phrases, endowing LLMs with both long-lasting and flexible memory. We designed three distinct tasks and constructed three datasets to measure the effectiveness of SirLLM from various angles: (1) DailyDialog; (2) Grocery Shopping; (3) Rock-Paper-Scissors. Our experimental results robustly demonstrate that SirLLM can achieve stable and significant improvements across different LLMs and tasks, compellingly proving its effectiveness. When having a coversation, "A sir could forget himself," but SirLLM never does! Our code is publicly available at https://github.com/Zoeyyao27/SirLLM


title: BSN: First Photometric Light Curve Analysis of Two W-type Contact Binary Systems OP Boo and V0511 Cam

abstract: This study presented the first light curve analysis of the OP Boo and V0511 Cam binary stars, which was conducted in the frame of the Binary Systems of South and North (BSN) Project. Photometric ground-based observations were conducted with standard filters at two observatories in the Czech Republic. We computed a new ephemeris for each of the systems using our extracted times of minima, TESS data, and additional literature. Linear fits for O-C diagrams of both systems were considered using the Markov Chain Monte Carlo (MCMC) method. The light curves were analyzed using the Wilson-Devinney (WD) binary code combined with the Monte Carlo (MC) simulation. The light curve solutions of both target systems required a cold starspot. The absolute parameters of the systems were calculated by using a P-M parameter relationship. The positions of the systems were also depicted on the Hertzsprung-Russell (HR), P-L, logMtot-logJ0, and T-M diagrams. The second component in both systems is determined to be a more massive and hotter star. Therefore, it can be concluded that both systems are W-type contact binary systems.


title: Multi-hop Multi-RIS Wireless Communication Systems: Multi-reflection Path Scheduling and Beamforming

abstract: Reconfigurable intelligent surface (RIS) provides a promising way to proactively augment propagation environments for better transmission performance in wireless communications. Existing multi-RIS works mainly focus on link-level optimization with predetermined transmission paths, which cannot be directly extended to system-level management, since they neither consider the interference caused by undesired scattering of RISs, nor the performance balancing between different transmission paths. To address this, we study an innovative multi-hop multi-RIS communication system, where a base station (BS) transmits information to a set of distributed users over multi-RIS configuration space in a multi-hop manner. The signals for each user are subsequently reflected by the selected RISs via multi-reflection line-of-sight (LoS) links. To ensure that all users have fair access to the system to avoid excessive number of RISs serving one user, we aim to find the optimal beam reflecting path for each user, while judiciously determining the path scheduling strategies with the corresponding beamforming design to ensure the fairness. Due to the presence of interference caused by undesired scattering of RISs, it is highly challenging to solve the formulated multi-RIS multi-path beamforming optimization problem. To solve it, we first derive the optimal RISs' phase shifts and the corresponding reflecting path selection for each user based on its practical deployment location. With the optimized multi-reflection paths, we obtain a feasible user grouping pattern for effective interference mitigation by constructing the maximum independent sets (MISs). Finally, we propose a joint heuristic algorithm to iteratively update the beamforming vectors and the group scheduling policies to maximize the minimum equivalent data rate of all users.


title: CustomText: Customized Textual Image Generation using Diffusion Models

abstract: Textual image generation spans diverse fields like advertising, education, product packaging, social media, information visualization, and branding. Despite recent strides in language-guided image synthesis using diffusion models, current models excel in image generation but struggle with accurate text rendering and offer limited control over font attributes. In this paper, we aim to enhance the synthesis of high-quality images with precise text customization, thereby contributing to the advancement of image generation models. We call our proposed method CustomText. Our implementation leverages a pre-trained TextDiffuser model to enable control over font color, background, and types. Additionally, to address the challenge of accurately rendering small-sized fonts, we train the ControlNet model for a consistency decoder, significantly enhancing text-generation performance. We assess the performance of CustomText in comparison to previous methods of textual image generation on the publicly available CTW-1500 dataset and a self-curated dataset for small-text generation, showcasing superior results.


title: PyramidInfer: Pyramid KV Cache Compression for High-throughput LLM Inference

abstract: Large Language Models (LLMs) have shown remarkable comprehension abilities but face challenges in GPU memory usage during inference, hindering their scalability for real-time applications like chatbots. To accelerate inference, we store computed keys and values (KV cache) in the GPU memory. Existing methods study the KV cache compression to reduce memory by pruning the pre-computed KV cache. However, they neglect the inter-layer dependency between layers and huge memory consumption in pre-computation. To explore these deficiencies, we find that the number of crucial keys and values that influence future generations decreases layer by layer and we can extract them by the consistency in attention weights. Based on the findings, we propose PyramidInfer, a method that compresses the KV cache by layer-wise retaining crucial context. PyramidInfer saves significant memory by computing fewer keys and values without sacrificing performance. Experimental results show PyramidInfer improves 2.2x throughput compared to Accelerate with over 54% GPU memory reduction in KV cache.


title: Dataset and Benchmark for Urdu Natural Scenes Text Detection, Recognition and Visual Question Answering

abstract: The development of Urdu scene text detection, recognition, and Visual Question Answering (VQA) technologies is crucial for advancing accessibility, information retrieval, and linguistic diversity in digital content, facilitating better understanding and interaction with Urdu-language visual data. This initiative seeks to bridge the gap between textual and visual comprehension. We propose a new multi-task Urdu scene text dataset comprising over 1000 natural scene images, which can be used for text detection, recognition, and VQA tasks. We provide fine-grained annotations for text instances, addressing the limitations of previous datasets for facing arbitrary-shaped texts. By incorporating additional annotation points, this dataset facilitates the development and assessment of methods that can handle diverse text layouts, intricate shapes, and non-standard orientations commonly encountered in real-world scenarios. Besides, the VQA annotations make it the first benchmark for the Urdu Text VQA method, which can prompt the development of Urdu scene text understanding. The proposed dataset is available at: https://github.com/Hiba-MeiRuan/Urdu-VQA-Dataset-/tree/main


title: Is Planckian discreteness observable in cosmology?

abstract: A Planck scale inflationary era -- in a quantum gravity theory predicting discreteness of quantum geometry at the fundamental scale -- produces the scale invariant spectrum of inhomogeneities with very small tensor-to-scalar ratio of perturbations and a hot big bang leading to a natural dark matter genesis scenario. Here we evoke the possibility that some of the major puzzles in cosmology would have an explanation rooted in quantum gravity.

categories: gr-qc astro-ph.HE hep-ph hep-th quant-ph


title: PhiBE: A PDE-based Bellman Equation for Continuous Time Policy Evaluation

abstract: In this paper, we address the problem of continuous-time reinforcement learning in scenarios where the dynamics follow a stochastic differential equation. When the underlying dynamics remain unknown and we have access only to discrete-time information, how can we effectively conduct policy evaluation? We first highlight that the commonly used Bellman equation (BE) is not always a reliable approximation to the true value function. We then introduce a new bellman equation, PhiBE, which integrates the discrete-time information into a PDE formulation. The new bellman equation offers a more accurate approximation to the true value function, especially in scenarios where the underlying dynamics change slowly. Moreover, we extend PhiBE to higher orders, providing increasingly accurate approximations. We conduct the error analysis for both BE and PhiBE with explicit dependence on the discounted coefficient, the reward and the dynamics. Additionally, we present a model-free algorithm to solve PhiBE when only discrete-time trajectory data is available. Numerical experiments are provided to validate the theoretical guarantees we propose.


title: Method of Kinetic Energy Reconstruction from Time-of-Flight Mass Spectra

abstract: We present a method for the reconstruction of ion kinetic energy distributions from ion time-of-flight mass spectra through ion trajectory simulations. In particular, this method is applicable to complicated spectrometer geometries with largely anisotropic ion collection efficiencies. A calibration procedure using a single ion mass peak allows the accurate determination of parameters related to the spectrometer calibration, experimental alignment and instrument response function, which improves the agreement between simulations and experiment. The calibrated simulation is used to generate a set of basis functions for the time-of-flight spectra, which are then used to transform from time-of-flight to kinetic-energy spectra. We demonstrate this reconstruction method on a recent pump-probe experiment by Asmussen et al. (J. D. Asmussen et al., Phys. Chem. Chem. Phys., 23, 15138, (2021)) on helium nanodroplets and retrieve time-resolved kinetic-energy-release spectra for the ions from ion time-of-flight spectra.


title: Flow of unitary matrices: Real-space winding numbers in one and three dimensions

abstract: The notion of the flow introduced by Kitaev is a manifestly topological formulation of the winding number on a real lattice. First, we show in this paper that the flow is quite useful for practical numerical computations for systems without translational invariance. Second, we extend it to three dimensions. Namely, we derive a formula of the flow on a three-dimensional lattice, which corresponds to the conventional winding number when systems have translational invariance.


title: Bridging the Intent Gap: Knowledge-Enhanced Visual Generation

abstract: For visual content generation, discrepancies between user intentions and the generated content have been a longstanding problem. This discrepancy arises from two main factors. First, user intentions are inherently complex, with subtle details not fully captured by input prompts. The absence of such details makes it challenging for generative models to accurately reflect the intended meaning, leading to a mismatch between the desired and generated output. Second, generative models trained on visual-label pairs lack the comprehensive knowledge to accurately represent all aspects of the input data in their generated outputs. To address these challenges, we propose a knowledge-enhanced iterative refinement framework for visual content generation. We begin by analyzing and identifying the key challenges faced by existing generative models. Then, we introduce various knowledge sources, including human insights, pre-trained models, logic rules, and world knowledge, which can be leveraged to address these challenges. Furthermore, we propose a novel visual generation framework that incorporates a knowledge-based feedback module to iteratively refine the generation process. This module gradually improves the alignment between the generated content and user intentions. We demonstrate the efficacy of the proposed framework through preliminary results, highlighting the potential of knowledge-enhanced generative models for intention-aligned content generation.


title: Capillary condensation between non-parallel walls

abstract: We study the condensation of fluids confined by a pair of non-parallel plates of finite height $H$. We show that such a system experiences two types of condensation, termed single- and double-pinning, which can be characterized by one (single-pinning) or two (double-pinning) edge contact angles describing the shape of menisci pinned at the system edges. For both types of capillary condensation we formulate the Kelvin-like equation and determine the conditions under which the given type of condensation occurs. We construct the global phase diagram revealing a reentrant phenomenon pertinent to the change of the capillary condensation type upon varying the inclination of the walls. Asymptotic properties of the system are discussed and a link with related phase phenomena in different systems is made. Finally, we show that the change from a single- to a double-pinned state is a continuous transition, the character of which depends on the wetting properties of the walls.


title: Context-Enhanced Video Moment Retrieval with Large Language Models

abstract: Current methods for Video Moment Retrieval (VMR) struggle to align complex situations involving specific environmental details, character descriptions, and action narratives. To tackle this issue, we propose a Large Language Model-guided Moment Retrieval (LMR) approach that employs the extensive knowledge of Large Language Models (LLMs) to improve video context representation as well as cross-modal alignment, facilitating accurate localization of target moments. Specifically, LMR introduces a context enhancement technique with LLMs to generate crucial target-related context semantics. These semantics are integrated with visual features for producing discriminative video representations. Finally, a language-conditioned transformer is designed to decode free-form language queries, on the fly, using aligned video representations for moment retrieval. Extensive experiments demonstrate that LMR achieves state-of-the-art results, outperforming the nearest competitor by up to 3.28\% and 4.06\% on the challenging QVHighlights and Charades-STA benchmarks, respectively. More importantly, the performance gains are significantly higher for localization of complex queries.


title: DrHouse: An LLM-empowered Diagnostic Reasoning System through Harnessing Outcomes from Sensor Data and Expert Knowledge

abstract: Large language models (LLMs) have the potential to transform digital healthcare, as evidenced by recent advances in LLM-based virtual doctors. However, current approaches rely on patient's subjective descriptions of symptoms, causing increased misdiagnosis. Recognizing the value of daily data from smart devices, we introduce a novel LLM-based multi-turn consultation virtual doctor system, DrHouse, which incorporates three significant contributions: 1) It utilizes sensor data from smart devices in the diagnosis process, enhancing accuracy and reliability. 2) DrHouse leverages continuously updating medical databases such as Up-to-Date and PubMed to ensure our model remains at diagnostic standard's forefront. 3) DrHouse introduces a novel diagnostic algorithm that concurrently evaluates potential diseases and their likelihood, facilitating more nuanced and informed medical assessments. Through multi-turn interactions, DrHouse determines the next steps, such as accessing daily data from smart devices or requesting in-lab tests, and progressively refines its diagnoses. Evaluations on three public datasets and our self-collected datasets show that DrHouse can achieve up to an 18.8% increase in diagnosis accuracy over the state-of-the-art baselines. The results of a 32-participant user study show that 75% medical experts and 91.7% patients are willing to use DrHouse.


title: Orthogonally Initiated Particle Swarm Optimization with Advanced Mutation for Real-Parameter Optimization

abstract: This article introduces an enhanced particle swarm optimizer (PSO), termed Orthogonal PSO with Mutation (OPSO-m). Initially, it proposes an orthogonal array-based learning approach to cultivate an improved initial swarm for PSO, significantly boosting the adaptability of swarm-based optimization algorithms. The article further presents archive-based self-adaptive learning strategies, dividing the population into regular and elite subgroups. Each subgroup employs distinct learning mechanisms. The regular group utilizes efficient learning schemes derived from three unique archives, which categorize individuals based on their quality levels. Additionally, a mutation strategy is implemented to update the positions of elite individuals. Comparative studies are conducted to assess the effectiveness of these learning strategies in OPSO-m, evaluating its optimization capacity through exploration-exploitation dynamics and population diversity analysis. The proposed OPSO-m model is tested on real-parameter challenges from the CEC 2017 suite in 10, 30, 50, and 100-dimensional search spaces, with its results compared to contemporary state-of-the-art algorithms using a sensitivity metric. OPSO-m exhibits distinguished performance in the precision of solutions, rapidity of convergence, efficiency in search, and robust stability, thus highlighting its superior aptitude for resolving intricate optimization issues.


title: Like Humans to Few-Shot Learning through Knowledge Permeation of Vision and Text

abstract: Few-shot learning aims to generalize the recognizer from seen categories to an entirely novel scenario. With only a few support samples, several advanced methods initially introduce class names as prior knowledge for identifying novel classes. However, obstacles still impede achieving a comprehensive understanding of how to harness the mutual advantages of visual and textual knowledge. In this paper, we propose a coherent Bidirectional Knowledge Permeation strategy called BiKop, which is grounded in a human intuition: A class name description offers a general representation, whereas an image captures the specificity of individuals. BiKop primarily establishes a hierarchical joint general-specific representation through bidirectional knowledge permeation. On the other hand, considering the bias of joint representation towards the base set, we disentangle base-class-relevant semantics during training, thereby alleviating the suppression of potential novel-class-relevant information. Experiments on four challenging benchmarks demonstrate the remarkable superiority of BiKop. Our code will be publicly available.


title: Interatomic Interaction Models for Magnetic Materials: Recent Advances

abstract: Atomistic modeling is a widely employed theoretical method of computational materials science. It has found particular utility in the study of magnetic materials. Initially, magnetic empirical interatomic potentials or spin-polarized density functional theory (DFT) served as the primary models for describing interatomic interactions in atomistic simulations of magnetic systems. Furthermore, in recent years, a new class of interatomic potentials known as magnetic machine-learning interatomic potentials (magnetic MLIPs) has emerged. These MLIPs combine the computational efficiency, in terms of CPU time, of empirical potentials with the accuracy of DFT calculations. In this review, our focus lies on providing a comprehensive summary of the interatomic interaction models developed specifically for investigating magnetic materials. We also delve into the various problem classes to which these models can be applied. Finally, we offer insights into the future prospects of interatomic interaction model development for the exploration of magnetic materials.


title: An explicit log-free zero density estimate for the Riemann zeta-function

abstract: We will provide an explicit log-free zero-density estimate for $\zeta(s)$ of the form $N(\sigma,T)\le AT^{B(1-\sigma)}$. In particular, this estimate becomes the sharpest known explicit zero-density estimate uniformly for $\sigma\in[\alpha_0,1]$, with $0.985\le \alpha_0\le 0.9927$ and $3\cdot 10^{12}<T\le \exp(6.7\cdot 10^{12})$.


title: Data-driven Coordinated AC/DC Control Strategy for Frequency Safety

abstract: With high penetrations of renewable energy and power electronics converters, less predictable operating conditions and strong uncertainties in under-frequency events pose challenges for emergency frequency control (EFC). On the other hand, the fast adjustability of converter-based sources presents opportunities to reduce economic losses from traditional load shedding for EFC. By integrating DC power emergency support, a data-driven coordinated AC/DC control strategy for frequency safety - Coordinated Emergency Frequency Control (CEFC) - has been designed. CEFC coordinates both the initiation and control amount of emergency DC power support (EDCPS) and traditional load shedding. Based on real-time power system response data, CEFC ensures system frequency safety at a minimum control cost under non-envisioned operating conditions and large power deficits. A sufficient condition where data-driven modeling errors do not affect the precision of the control strategy for power system frequency is rigorously provided. Simulation results demonstrate CEFC's adaptability, prediction accuracy, and control effectiveness.


title: Solar wind data analysis aided by synthetic modeling: a better understanding of plasma-frame variations from temporal data

abstract: In-situ measurements of the solar wind, a turbulent and anisotropic plasma flow originating at the Sun, are mostly carried out by single spacecraft, resulting in one-dimensional time series. The conversion of these measurements to the spatial frame of the plasma is a great challenge, but required for direct comparison of the measurements with MHD turbulence theories. Here we present a toolkit, based on the synthetic modeling of solar wind fluctuations as two-dimensional noise maps with adjustable spectral and power anisotropy, that can help with the temporal-spatial conversion of real data. Specifically, by following the spacecraft trajectory through a noise map (relative velocity and angle relative to some mean magnetic field) with properties tuned to mimic those of the solar wind, the likelihood that the temporal data fluctuations represent parallel or perpendicular fluctuations in the plasma frame can be quantified by correlating structure functions of the noise map. Synthetic temporal data can also be generated, which can provide a testing ground for analysis applied to the solar wind data. We demonstrate this tool by investigating Parker Solar Probe's E7 trajectory and data, and showcase several possible ways in which it can be used. We find that whether temporal variations in the spacecraft frame come from parallel or perpendicular variations in the plasma frame strongly depends on the spectral and power anisotropy of the measured wind. Data analysis assisted by such underlying synthetic models as presented here could open up new ways to interpret measurements in the future, specifically in the more reliable determination of plasma frame quantities from temporal measurements.


title: The transition-metal-dichalcogenide family as a superconductor tuned by charge density wave strength

abstract: Metallic transition metal dichalcogenides (TMDs), consisting of H-NbSe$_2$, H-NbS$_2$, H-TaSe$_2$ and H-TaS$_2$, remain superconducting down to a thickness of a single layer. In these materials, thickness affects a variety of properties, including Ising protection, two-band superconductivity, and the critical temperature $T_C$, which decreases for the Nb-based, and increases for the Ta-based materials. This contradicting trend is puzzling, and has precluded the development of a unified theory. We approach the question of thickness-evolution of $T_C$ and the superconducting gap $\Delta$ by measuring high-resolution tunneling spectra in TaS$_2$-based stacked devices. Our measurements allow for simultaneous evaluation of $\Delta$, $T_C$, and the upper critical field $H_{C2}$. The latter, we find, is strongly enhanced towards the single-layer limit, following a $H_{C2} \propto \Delta^2$ proportionality ratio. Our main finding is that the same ratio holds for the entire family of metallic TMDs: TaS$_2$ and NbSe$_2$ of all thicknesses, bulk TaSe$_2$ and bulk NbS$_2$, extending over 4 orders of magnitude in $H_{C2}$ and covering both clean and dirty limits. We propose that this tunability across the TMD family is controlled by the competing charge density wave (CDW) phase. Using Gor'kov's theory, we calculate how a CDW order affects the quasiparticle density of states and the resulting $T_C$ and $H_{C2}$. Our results suggest that CDW is the key determinant factor limiting $T_C$ in the TMD family. They also show that $H_{C2}$ is universally enhanced by a factor of two orders of magnitude above the expected value, an effect that remains an open question.


title: The Schwarzian Approach in Sturm-Liouville Problems

abstract: A novel method for finding the eigenvalues of a Sturm-Liouville problem is developed. Following the minimalist approach the problem is transformed to a single first-order differential equation with appropriate boundary conditions. Although the resulting equation is nonlinear, its form allows to find the general solution by adding a second part to a particular solution. This splitting of the general solution in two parts involves the Schwarzian derivative, hence the name of the approach. The eigenvalues that correspond to acceptable solutions asymptotically can be found by requiring the second part to correct the diverging behavior of the particular solution. The method can be applied to many different areas of physics, such as the Schr\"odinger equation in quantum mechanics and stability problems in fluid dynamics. Examples are presented.