title: 24-hour measurement of squeezed light using automated stable fiber system

abstract: In order to provide a cloud service of optical quantum computing, it is inevitable to stabilize the optical system for many hours. It is advantageous to construct a fiber-based system, which does not require spatial alignment. However, fiber-based systems are instead subject to fiber-specific instabilities. For instance, there are phase drifts due to ambient temperature changes and external disturbances, and polarization fluctuations due to the finite polarization extinction ratio of fiber components. Here, we report the success of measuring squeezed light with a fiber system for 24 hours. To do this, we introduce stabilization mechanics to suppress fluctuations in the fiber system, and integrated controller to automatically align the entire system. The squeezed light at the wavelength of 1545.3 nm is measured every 2 minutes, where automated alignments are inserted every 30 minutes. The squeezing levels with the average of -4.42 dB are recorded with an extremely small standard deviation of 0.08 dB over 24 hours.


title: Charged spherically symmetric black holes in the Lyra geometry and a preliminary investigation on the overcharging process

abstract: This paper aims to investigate charged spherically symmetric static black holes in the Lyra geometry, in which a scale function naturally arises in the metric and affine structure of these type of manifolds. In particular, it is utilized the appropriate generalization of General Relativity, the recently proposed Lyra Scalar-Tensor Theory (LyST). The simplest generalization of Maxwell electrodynamics for Lyra manifolds is considered. It is presented an analytic solution for the line element of a Reissner-Nordstr\"om LyST generalization. It is shown that, due to the natural presence of a scale radius, it is possible to have three different extremal charges for positive or negative charge intervals. As a consequence, in natural units, the equality of the mass and charge defined on Lyra manifolds does not give rise to an extremal black hole, which allows the existence of solutions in which the charge is greater than the mass. An analysis with charged test particles indicates that a finite positive Lyra scale radius possibly allows for a violation of the weak cosmic censorship on Lyra manifolds, it is shown that an extremal black hole can be overcharged to the point that the emergence of a naked singularity becomes possible. The same behavior is observed for negative values of the Lyra radius if its absolute value is greater than four times the black hole mass. Notably, this investigation also shows that an eternal black hole can exist for any charge increase if the Lyra scale radius is sufficiently close to some critical values.


title: Hierarchical phased-array antennas coupled to Al KIDs: a scalable architecture for multi-band mm/submm focal planes

abstract: We present the optical characterization of two-scale hierarchical phased-array antenna kinetic inductance detectors (KIDs) for millimeter/submillimeter wavelengths. Our KIDs have a lumped-element architecture with parallel plate capacitors and aluminum inductors. The incoming light is received with a hierarchical phased array of slot-dipole antennas, split into 4 frequency bands (between 125 GHz and 365 GHz) with on-chip lumped-element band-pass filters, and routed to different KIDs using microstriplines. Individual pixels detect light for the 3 higher frequency bands (190-365 GHz) and the signals from four individual pixels are coherently summed to create a larger pixel detecting light for the lowest-frequency band (125-175 GHz). The spectral response of the band-pass filters was measured using Fourier transform spectroscopy (FTS), the far-field beam pattern of the phased-array antennas was obtained using an infrared source mounted on a 2-axis translating stage, and the optical efficiency of the KIDs was characterized by observing loads at 294 K and 77 K. We report on the results of these three measurements.


title: PipeNet: Question Answering with Semantic Pruning over Knowledge Graphs

abstract: It is well acknowledged that incorporating explicit knowledge graphs (KGs) can benefit question answering. Existing approaches typically follow a grounding-reasoning pipeline in which entity nodes are first grounded for the query (question and candidate answers), and then a reasoning module reasons over the matched multi-hop subgraph for answer prediction. Although the pipeline largely alleviates the issue of extracting essential information from giant KGs, efficiency is still an open challenge when scaling up hops in grounding the subgraphs. In this paper, we target at finding semantically related entity nodes in the subgraph to improve the efficiency of graph reasoning with KG. We propose a grounding-pruning-reasoning pipeline to prune noisy nodes, remarkably reducing the computation cost and memory usage while also obtaining decent subgraph representation. In detail, the pruning module first scores concept nodes based on the dependency distance between matched spans and then prunes the nodes according to score ranks. To facilitate the evaluation of pruned subgraphs, we also propose a graph attention network (GAT) based module to reason with the subgraph data. Experimental results on CommonsenseQA and OpenBookQA demonstrate the effectiveness of our method.


title: Complementary Relationships between Entanglement and Measurement

abstract: Complementary relationships exist regarding interference properties of particles such as pattern visibility, predictability and distinguishability. Additionally, relationships are known between information gain $G$ and measurement disturbance $F$ for entangled spin pairs. The question of whether a similar complementary relationship between entanglement and measurement occurs is examined herein. For qubit systems, both measurement on a single system and measurements on a bipartite system are considered in regards to the entanglement. It is proven that $\overline{E}+D\le 1$ holds where $\overline{E}$ is the average entanglement after a measurement is made and for which $D$ is a measure of the measurement disturbance of a single measurement. For measurements on a bipartite system shared by Alice and Bob ,it is shown that $\overline{E}+G\le 1$ where $G$ is the maximum information gain regarding Alice's result that can be obtained by Bob. These results are generalized for arbitrary initial mixed states and as well to non-Hermitian operators. In the case of maximally entangled initial states, it is found that $D\le E_{L}$ and $G\le E_{L}$ where $E_{L}$ is the entanglement loss due to measurement by Alice. We conclude that the amount of disturbance and information gain that one can gain are strictly limited by entanglement.


title: Post-Quantum Cryptography for Internet of Things: A Survey on Performance and Optimization

abstract: Due to recent development in quantum computing, the invention of a large quantum computer is no longer a distant future. Quantum computing severely threatens modern cryptography, as the hard mathematical problems beneath classic public-key cryptosystems can be solved easily by a sufficiently large quantum computer. As such, researchers have proposed PQC based on problems that even quantum computers cannot efficiently solve. Generally, post-quantum encryption and signatures can be hard to compute. This could potentially be a problem for IoT, which usually consist lightweight devices with limited computational power. In this paper, we survey existing literature on the performance for PQC in resource-constrained devices to understand the severeness of this problem. We also review recent proposals to optimize PQC algorithms for resource-constrained devices. Overall, we find that whilst PQC may be feasible for reasonably lightweight IoT, proposals for their optimization seem to lack standardization. As such, we suggest future research to seek coordination, in order to ensure an efficient and safe migration toward IoT for the post-quantum era.


title: Enhancing Score-Based Sampling Methods with Ensembles

abstract: We introduce ensembles within score-based sampling methods to develop gradient-free approximate sampling techniques that leverage the collective dynamics of particle ensembles to compute approximate reverse diffusion drifts. We introduce the underlying methodology, emphasizing its relationship with generative diffusion models and the previously introduced F\"ollmer sampler. We demonstrate the efficacy of ensemble strategies through various examples, ranging from low- to medium-dimensionality sampling problems, including multi-modal and highly non-Gaussian probability distributions, and provide comparisons to traditional methods like NUTS. Our findings highlight the potential of ensemble strategies for modeling complex probability distributions in situations where gradients are unavailable. Finally, we showcase its application in the context of Bayesian inversion problems within the geophysical sciences.


title: Good and Fast Row-Sparse ah-Symmetric Reflexive Generalized Inverses

abstract: We present several algorithms aimed at constructing sparse and structured sparse (row-sparse) generalized inverses, with application to the efficient computation of least-squares solutions, for inconsistent systems of linear equations, in the setting of multiple right-hand sides and a rank-deficient constraint matrix. Leveraging our earlier formulations to minimize the 1- and 2,1- norms of generalized inverses that satisfy important properties of the Moore-Penrose pseudoinverse, we develop efficient and scalable ADMM algorithms to address these norm-minimization problems and to limit the number of nonzero rows in the solution. We establish a 2,1-norm approximation result for a local-search procedure that was originally designed for 1-norm minimization, and we compare the ADMM algorithms with the local-search procedure and with general-purpose optimization solvers.


title: Towards Understanding Variants of Invariant Risk Minimization through the Lens of Calibration

abstract: Machine learning models traditionally assume that training and test data are independently and identically distributed. However, in real-world applications, the test distribution often differs from training. This problem, known as out-of-distribution (OOD) generalization, challenges conventional models. Invariant Risk Minimization (IRM) emerges as a solution that aims to identify invariant features across different environments to enhance OOD robustness. However, IRM's complexity, particularly its bi-level optimization, has led to the development of various approximate methods. Our study investigates these approximate IRM techniques, using the consistency and variance of calibration across environments as metrics to measure the invariance aimed for by IRM. Calibration, which measures the reliability of model prediction, serves as an indicator of whether models effectively capture environment-invariant features by showing how uniformly over-confident the model remains across varied environments. Through a comparative analysis of datasets with distributional shifts, we observe that Information Bottleneck-based IRM achieves consistent calibration across different environments. This observation suggests that information compression techniques, such as IB, are potentially effective in achieving model invariance. Furthermore, our empirical evidence indicates that models exhibiting consistent calibration across environments are also well-calibrated. This demonstrates that invariance and cross-environment calibration are empirically equivalent. Additionally, we underscore the necessity for a systematic approach to evaluating OOD generalization. This approach should move beyond traditional metrics, such as accuracy and F1 scores, which fail to account for the model's degree of over-confidence, and instead focus on the nuanced interplay between accuracy, calibration, and model invariance.


title: A Medical Data-Effective Learning Benchmark for Highly Efficient Pre-training of Foundation Models

abstract: Foundation models, pre-trained on massive datasets, have achieved unprecedented generalizability. However, is it truly necessary to involve such vast amounts of data in pre-training, consuming extensive computational resources? This paper introduces data-effective learning, aiming to use data in the most impactful way to pre-train foundation models. This involves strategies that focus on data quality rather than quantity, ensuring the data used for training has high informational value. Data-effective learning plays a profound role in accelerating foundation model training, reducing computational costs, and saving data storage, which is very important as the volume of medical data in recent years has grown beyond many people's expectations. However, due to the lack of standards and comprehensive benchmarks, research on medical data-effective learning is poorly studied. To address this gap, our paper introduces a comprehensive benchmark specifically for evaluating data-effective learning in the medical field. This benchmark includes a dataset with millions of data samples from 31 medical centers (DataDEL), a baseline method for comparison (MedDEL), and a new evaluation metric (NormDEL) to objectively measure data-effective learning performance. Our extensive experimental results show the baseline MedDEL can achieve performance comparable to the original large dataset with only 5% of the data. Establishing such an open data-effective learning benchmark is crucial for the medical foundation model research community because it facilitates efficient data use, promotes collaborative breakthroughs, and fosters the development of cost-effective, scalable, and impactful healthcare solutions.


title: Fr\'echet Distance for Offline Evaluation of Information Retrieval Systems with Sparse Labels

abstract: The rapid advancement of natural language processing, information retrieval (IR), computer vision, and other technologies has presented significant challenges in evaluating the performance of these systems. One of the main challenges is the scarcity of human-labeled data, which hinders the fair and accurate assessment of these systems. In this work, we specifically focus on evaluating IR systems with sparse labels, borrowing from recent research on evaluating computer vision tasks. taking inspiration from the success of using Fr\'echet Inception Distance (FID) in assessing text-to-image generation systems. We propose leveraging the Fr\'echet Distance to measure the distance between the distributions of relevant judged items and retrieved results. Our experimental results on MS MARCO V1 dataset and TREC Deep Learning Tracks query sets demonstrate the effectiveness of the Fr\'echet Distance as a metric for evaluating IR systems, particularly in settings where a few labels are available. This approach contributes to the advancement of evaluation methodologies in real-world scenarios such as the assessment of generative IR systems.


title: Trainable Fixed-Point Quantization for Deep Learning Acceleration on FPGAs

abstract: Quantization is a crucial technique for deploying deep learning models on resource-constrained devices, such as embedded FPGAs. Prior efforts mostly focus on quantizing matrix multiplications, leaving other layers like BatchNorm or shortcuts in floating-point form, even though fixed-point arithmetic is more efficient on FPGAs. A common practice is to fine-tune a pre-trained model to fixed-point for FPGA deployment, but potentially degrading accuracy. This work presents QFX, a novel trainable fixed-point quantization approach that automatically learns the binary-point position during model training. Additionally, we introduce a multiplier-free quantization strategy within QFX to minimize DSP usage. QFX is implemented as a PyTorch-based library that efficiently emulates fixed-point arithmetic, supported by FPGA HLS, in a differentiable manner during backpropagation. With minimal effort, models trained with QFX can readily be deployed through HLS, producing the same numerical results as their software counterparts. Our evaluation shows that compared to post-training quantization, QFX can quantize models trained with element-wise layers quantized to fewer bits and achieve higher accuracy on both CIFAR-10 and ImageNet datasets. We further demonstrate the efficacy of multiplier-free quantization using a state-of-the-art binarized neural network accelerator designed for an embedded FPGA (AMD Xilinx Ultra96 v2). We plan to release QFX in open-source format.


title: Three-Stage Adjusted Regression Forecasting (TSARF) for Software Defect Prediction

abstract: Software reliability growth models (SRGM) enable failure data collected during testing. Specifically, nonhomogeneous Poisson process (NHPP) SRGM are the most commonly employed models. While software reliability growth models are important, efficient modeling of complex software systems increases the complexity of models. Increased model complexity presents a challenge in identifying robust and computationally efficient algorithms to identify model parameters and reduces the generalizability of the models. Existing studies on traditional software reliability growth models suggest that NHPP models characterize defect data as a smooth continuous curve and fail to capture changes in the defect discovery process. Therefore, the model fits well under ideal conditions, but it is not adaptable and will only fit appropriately shaped data. Neural networks and other machine learning methods have been applied to greater effect [5], however limited due to lack of large samples of defect data especially at earlier stages of testing.


title: Effective Multi-Stage Training Model For Edge Computing Devices In Intrusion Detection

abstract: Intrusion detection poses a significant challenge within expansive and persistently interconnected environments. As malicious code continues to advance and sophisticated attack methodologies proliferate, various advanced deep learning-based detection approaches have been proposed. Nevertheless, the complexity and accuracy of intrusion detection models still need further enhancement to render them more adaptable to diverse system categories, particularly within resource-constrained devices, such as those embedded in edge computing systems. This research introduces a three-stage training paradigm, augmented by an enhanced pruning methodology and model compression techniques. The objective is to elevate the system's effectiveness, concurrently maintaining a high level of accuracy for intrusion detection. Empirical assessments conducted on the UNSW-NB15 dataset evince that this solution notably reduces the model's dimensions, while upholding accuracy levels equivalent to similar proposals.


title: Task-Oriented Diffusion Model Compression

abstract: As recent advancements in large-scale Text-to-Image (T2I) diffusion models have yielded remarkable high-quality image generation, diverse downstream Image-to-Image (I2I) applications have emerged. Despite the impressive results achieved by these I2I models, their practical utility is hampered by their large model size and the computational burden of the iterative denoising process. In this paper, we explore the compression potential of these I2I models in a task-oriented manner and introduce a novel method for reducing both model size and the number of timesteps. Through extensive experiments, we observe key insights and use our empirical knowledge to develop practical solutions that aim for near-optimal results with minimal exploration costs. We validate the effectiveness of our method by applying it to InstructPix2Pix for image editing and StableSR for image restoration. Our approach achieves satisfactory output quality with 39.2% and 56.4% reduction in model footprint and 81.4% and 68.7% decrease in latency to InstructPix2Pix and StableSR, respectively.


title: Rethinking Channel Dependence for Multivariate Time Series Forecasting: Learning from Leading Indicators

abstract: Recently, channel-independent methods have achieved state-of-the-art performance in multivariate time series (MTS) forecasting. Despite reducing overfitting risks, these methods miss potential opportunities in utilizing channel dependence for accurate predictions. We argue that there exist locally stationary lead-lag relationships between variates, i.e., some lagged variates may follow the leading indicators within a short time period. Exploiting such channel dependence is beneficial since leading indicators offer advance information that can be used to reduce the forecasting difficulty of the lagged variates. In this paper, we propose a new method named LIFT that first efficiently estimates leading indicators and their leading steps at each time step and then judiciously allows the lagged variates to utilize the advance information from leading indicators. LIFT plays as a plugin that can be seamlessly collaborated with arbitrary time series forecasting methods. Extensive experiments on six real-world datasets demonstrate that LIFT improves the state-of-the-art methods by 5.5% in average forecasting performance. Our code is available at https://github.com/SJTU-Quant/LIFT.


title: Precise mass measurement of OGLE-2013-BLG-0132/MOA-2013-BLG-148: a Saturn mass planet orbiting an M-dwarf

abstract: We revisit the planetary microlensing event OGLE-2013-BLG-0132/MOA-2013-BLG-148 using Keck adaptive optics imaging in 2013 with NIRC2 and in 2020, 7.4 years after the event, with OSIRIS. The 2020 observations yield a source and lens separation of $ 56.91 \pm 0.29$ mas, which provides us with a precise measurement of the heliocentric proper motion of the event $\mu_{rel,hel} = 7.695 \pm 0.039$ mas $yr^{-1}$. We measured the magnitude of the lens in K-band as $K_{lens} = 18.69 \pm 0.04 $. Using these constraints, we refit the microlensing light curve and undertake a full reanalysis of the event parameters including the microlensing parallax $\pi_{E}$ and the distance to the source D$_S$. We confirm the results obtained in the initial study by \cite{Mroz_2017} and improve significantly upon the accuracy of the physical parameters. The system is an M dwarf of $0.495 \pm 0.054$ $M_\odot$ orbited by a cold, Saturn-mass planet of $0.26 \pm 0.028$ $M_{Jup}$ at projected separation $r_{\perp}$ = 3.14 $\pm$ 0.28 AU. This work confirms that the planetary system is at a distance of 3.48 $\pm$ 0.36 kpc, which places it in the Galactic disk and not the Galactic bulge.


title: Second-order optimisation strategies for neural network quantum states

abstract: The Variational Monte Carlo method has recently seen important advances through the use of neural network quantum states. While more and more sophisticated ans\"atze have been designed to tackle a wide variety of quantum many-body problems, modest progress has been made on the associated optimisation algorithms. In this work, we revisit the Kronecker Factored Approximate Curvature, an optimiser that has been used extensively in a variety of simulations. We suggest improvements on the scaling and the direction of this optimiser, and find that they substantially increase its performance at a negligible additional cost. We also reformulate the Variational Monte Carlo approach in a game theory framework, to propose a novel optimiser based on decision geometry. We find that, on a practical test case for continuous systems, this new optimiser consistently outperforms any of the KFAC improvements in terms of stability, accuracy and speed of convergence. Beyond Variational Monte Carlo, the versatility of this approach suggests that decision geometry could provide a solid foundation for accelerating a broad class of machine learning algorithms.


title: Polymer Network Diffusion in Charged Gels

abstract: The swelling kinetics of charged polymer gels reflect the complex competition among elastic, mixing, and ionic contributions. Here, we used dynamic light scattering to investigate the collective diffusion coefficient of model gels, whose polymer network structure was controlled so that the three contributions were comparable. We demonstrate that the collective diffusion coefficient stems from the sum of elastic, mixing, and ionic contributions, without evident cross-correlations. The significant ionic contribution conforms to the Donnan equilibrium, which explains equilibrium electrical potential gradients in biological systems.

categories: cond-mat.soft cond-mat.mtrl-sci cond-mat.stat-mech physics.bio-ph physics.chem-ph


title: Impurity effects in one dimensional spin nematic liquid

abstract: We study impurity effects in the spin nematic phase of the $S=1/2$ $J_1$-$J_2$ frustrated spin chain under an external magnetic field by using the infinite density matrix renormalization group and the bosonization. It is found that local magnetization almost saturates around the impurity and the entanglement entropy nearly vanishes at the corresponding bonds, not only when the magnetic interactions near the impurity are weakened but also when they are strengthened compared to those in the bulk. Then, we examine spin correlations and Friedel oscillations induced by the impurity. The bosonization provides a qualitative understanding of the characteristic behaviors of the magnetization. We also discuss impacts of the impurity on experiments by focusing on NMR spectra.


title: Dark matter measurements combining stellar and HI kinematics: 30% $1-\sigma$ outliers with low dark matter content at $5R_\mathrm{e}$

abstract: We construct the Schwarzschild dynamical models for 11 early-type galaxies with the SAURON and Mitchell stellar IFUs out to $2-4 R_\mathrm{e}$, and construct dynamical models with combined stellar and HI kinematics for a subsample of 4 galaxies with HI velocity fields out to $10 R_\mathrm{e}$ obtained from the Westerbork Synthesis Radio Telescope, thus robustly obtaining the dark matter content out to large radii for these galaxies. Adopting a generalised-NFW dark matter profile, we measure an NFW-like density cusp in the dark matter inner slopes for all sample galaxies, with a mean value of $1.00\pm0.04$ (rms scatter $0.15$). The mean dark matter fraction for the sample is $0.2$ within $1 R_\mathrm{e}$, and increases to $0.4$ at $2 R_\mathrm{e}$, and $0.6$ at $5 R_\mathrm{e}$. The dark matter fractions within $1 R_\mathrm{e}$ of these galaxies are systematically lower than the predictions of both the TNG-100 and EAGLE simulations. For the dark matter fractions within $2 R_\mathrm{e}$ and $5 R_\mathrm{e}$, 40% and 70% galaxies are $1-\sigma$ consistent with either the TNG-100 or the EAGLE predictions, while the remaining 60% and 30% galaxies lie below the $1-\sigma$ region. Combined with 36 galaxies with dark matter fractions measured out to $5 R_\mathrm{e}$ in the literature, about 10% of these 47 galaxies lie below the $3-\sigma$ region of the TNG-100 or EAGLE predictions.


title: Ferromagnetic Semiconductors and Spintronic Devices

abstract: Ferromagnetic semiconductors play a crucial role in spintronic devices, enabling effective control of electron spin over charge. This study explores their unique properties, ongoing advancements in spin control, and potential integration into next-generation semiconductor technologies.


title: opML: Optimistic Machine Learning on Blockchain

abstract: The integration of machine learning with blockchain technology has witnessed increasing interest, driven by the vision of decentralized, secure, and transparent AI services. In this context, we introduce opML (Optimistic Machine Learning on chain), an innovative approach that empowers blockchain systems to conduct AI model inference. opML lies a interactive fraud proof protocol, reminiscent of the optimistic rollup systems. This mechanism ensures decentralized and verifiable consensus for ML services, enhancing trust and transparency. Unlike zkML (Zero-Knowledge Machine Learning), opML offers cost-efficient and highly efficient ML services, with minimal participation requirements. Remarkably, opML enables the execution of extensive language models, such as 7B-LLaMA, on standard PCs without GPUs, significantly expanding accessibility. By combining the capabilities of blockchain and AI through opML, we embark on a transformative journey toward accessible, secure, and efficient on-chain machine learning.


title: Model-Theoretic Logic for Mathematical Theory of Semantic Information and Communication

abstract: In this paper, we propose an advancement to Tarskian model-theoretic semantics, leading to a unified quantitative theory of semantic information and communication. We start with description of inductive logic and probabilities, which serve as notable tools in development of the proposed theory. Then, we identify two disparate kinds of uncertainty in semantic communication, that of physical and content, present refined interpretations of semantic information measures, and conclude with proposing a new measure for semantic content-information and entropy. Our proposition standardizes semantic information across different universes and systems, hence bringing measurability and comparability into semantic communication. We then proceed with introducing conditional and mutual semantic cont-information measures and point out to their utility in formulating practical and optimizable lossless and lossy semantic compression objectives. Finally, we experimentally demonstrate the value of our theoretical propositions.


title: A simple method to measure numax for asteroseismology: application to 16,000 oscillating Kepler red giants

abstract: The importance of numax (the frequency of maximum oscillation power) for asteroseismology has been demonstrated widely in the previous decade, especially for red giants. With the large amount of photometric data from CoRoT, Kepler and TESS, several automated algorithms to retrieve numax values have been introduced. Most of these algorithms correct the granulation background in the power spectrum by fitting a model and subtracting it before measuring numax. We have developed a method that does not require fitting to the granulation background. Instead, we simply divide the power spectrum by a function of the form nu^-2, to remove the slope due to granulation background, and then smooth to measure numax. This method is fast, simple and avoids degeneracies associated with fitting. The method is able to measure oscillations in 99.9% of previously-studied Kepler red giants, with a systematic offset of 1.5 % in numax values that that we are able to calibrate. On comparing the seismic radii from this work with Gaia, we see similar trends to those observed in previous studies. Additionally, our values of width of the power envelope can clearly identify the dipole mode suppressed stars as a distinct population, hence as a way to detect them. We also applied our method to stars with low (0.19--18.35 muHz) and found it works well to correctly identify the oscillations.


title: A Channel to Form Fast-spinning Black Hole-Neutron Star Binary Mergers as Multimessenger Sources. II. Accretion-induced Spin-up

abstract: In this work, we investigate an alternative channel for the formation of fast-spinning black hole-neutron star (BHNS) binaries, in which super-Eddington accretion is expected to occur in accreting BHs during the stable mass transfer phase within BH-stripped helium (BH--He-rich) star binary systems. We evolve intensive \texttt{MESA} grids of close-orbit BH--He-rich star systems to systematically explore the projected aligned spins of BHs in BHNS binaries, as well as the impact of different accretion limits on the tidal disruption probability and electromagnetic (EM) signature of BHNS mergers. Most of the BHs in BHNS mergers cannot be effectively spun up through accretion, if the accretion rate is limited to $\lesssim10\,\dot{M}_{\rm Edd}$, where $\dot{M}_{\rm Edd}$ is the standard Eddington accretion limit. In order to reach high spins (e.g., $\chi_{\rm BH} \gtrsim 0.5$), the BHs are required to be born less massive (e.g., $\lesssim3.0\,M_\odot$) in binary systems with initial periods of $\lesssim0.2-0.3\,{\rm days}$ and accrete material at $\sim100\,\dot{M}_{\rm Edd}$. However, even under this high accretion limit, $\gtrsim6\,M_\odot$ BHs are typically challenging to significantly spin up and generate detectable associated EM signals. Our population simulations suggest that different accretion limits have a slight impact on the ratio of tidal disruption events. However, as the accretion limit increases, the EM counterparts from the cosmological BHNS population can become bright overall.


title: Heavy flavor production under a strong magnetic field

abstract: The magnetic field created in high energy nuclear collisions will affect the dynamical processes in the QCD medium, especially the heavy quark production that happens in the initial stage of the collisions. We calculate in a strong magnetic field the heavy quark production cross section for the elementary process gg {\rightarrow} Q{\bar Q} at leading order and the corresponding transverse momentum distribution in nucleus-nucleus collisions. In comparison to the QED process, the heavy quark production is dominated by the unique QCD channel with gluon self-interaction. Due to the dimension reduction of quark phase space in a strong magnetic field, the production is concentrated in a very narrow energy region above the threshold. Since the translation invariance is broken, the production becomes anisotropic in magnetic field.


title: On the existence and uniqueness of unbounded solutions to quadratic BSDEs with monotonic-convex generators

abstract: With the terminal value $\xi^-$ admitting a certain exponential moment and $\xi^+$ admitting every exponential moments or being bounded, we establish several existence and uniqueness results for unbounded solutions of backward stochastic differential equations (BSDEs) whose generator $g$ satisfies a monotonicity condition with general growth in the first unknown variable $y$ and a convexity condition with quadratic growth in the second unknown variable $z$. In particular, the generator $g$ may be not locally-Lipschitz continuous in $y$. This generalizes some results reported in \cite{Delbaen 2011} by relaxing the continuity and growth of $g$ in $y$. We also give an explicit expression of the first process in the unique unbounded solution of a BSDE when the generator $g$ is jointly convex in $(y,z)$ and has a linear growth in $y$ and a quadratic growth in $z$. Finally, we put forward the corresponding comparison theorems for unbounded solutions of the preceding BSDEs. These results are proved by those existing ideas and some innovative ones.


title: Formation Mechanism of Laser-Driven Magnetized "Pillars of Creation"

abstract: Pillars of Creation, one of the most recognized objects in the sky, are believed to be associated with the formation of young stars. However, so far, the formation and maintenance mechanism for the pillars are still not fully understood due to the complexity of the nonlinear radiation magneto-hydrodynamics (RMHD). Here, assuming laboratory laser-driven conditions, we studied the self-consistent dynamics of pillar structures in magnetic fields by means of two-dimensional (2D) and three-dimensional (3D) RMHD simulations, and these results also support our proposed experimental scheme. We find only when the magnetic pressure and ablation pressure are comparable, the magnetic field can significantly alter the plasma hydrodynamics. For medium magnetized cases ($\beta_{initial} \approx 3.5$), {the initial magnetic fields undergo compression and amplification. This amplification results in the magnetic pressure inside the pillar becoming large enough to support the sides of the pillar against radial collapse due to pressure from the surrounding hot plasma. This effect is particularly pronounced for the parallel component ($B_y$), which is consistent with observational results.} In contrast, a strong perpendicular ($B_x, B_z$) magnetic field ($\beta_{initial} < 1$) almost remains its initial distribution and significantly suppresses the expansion of blow-off gas plasma, leading to the inability to form pillar-like structures. The 3D simulations suggest that the bending at the head of `Column \uppercase\expandafter{\romannumeral1}' in pillars of creation may be due to the non-parallel magnetic fields. After similarity scaling transformation, our results can be applied to explain the formation and maintenance mechanism of the pillars, and can also provide useful information for future experimental designs.


title: Phase Transition of single-layer vanadium diselenide on Au(111) with distinguished electronic structures

abstract: Herein, we report the reversible structural transition of single-layer VSe2 grown on Au(111) through alternating thermal annealing and Se replenishment. Using scanning tunneling microscopy (STM) and angle-resolved photoemission spectroscopy (ARPES), we demonstrate the epitaxial growth of high-quality VSe2 on Au(111) with the octahedral (1T) structure and the Se-vacancy-induced transformation of VSe2 from the metallic moir\'e (1T) phase to the semiconducting (2H) phase. With convincing agreement between the experimental results and DFT calculations, the nanostructure near the grain boundary in the defective intermediate phase is confirmed, as well as the reaction pathway with Se gradually depleting at elevated temperatures. Importantly, it is revealed that the density of the linear Se defects plays a crucial role in the formation of the 2H domain phase due to the increment of the in-plane lattice parameter after Se desorption and the better thermal stability of the 2H phase compared to the 1T phase. The proper control of the density of Se atoms in the topmost Se layer of VSe2 could feasibly manipulate the ratio between the 1T phase and the 2H phase in the steak-shaped domain, which is regarded as a good platform for 2D homojunctions in nanoelectronics.


title: Iossif Ostrovskii's work on entire functions

abstract: The theory of entire functions and its applications were at the center of Ostrovskii's research interests throughout his entire career. He made lasting contributions to several aspects of this theory, and many of his works had a significant influence on subsequent research. In this note, we describe some of this work.


title: Biorthogonal topological charge pumping in non-Hermitian systems

abstract: We study charge pumping in generic non-Hermitian settings and show that quantized charge pumping is only guaranteed under a biorthogonal formalism therein, where the charge transport is evaluated using the left and right eigenvectors of the non-Hermitian Hamiltonian. Specifically, for biorthogonal charge pumping in generic one-dimensional non-Hermitian models, we demonstrate how quantized transport is related to the Chern number in the parameter space. When the non-Hermitian model possesses the non-Hermitian skin effect, under which Bloch states in the bulk are deformed and localize toward boundaries, we propose a scenario where the pumped charge is related to the non-Bloch Chern number defined in the parameter space involving the generalized Brillouin zone. We illustrate the validity of our analytic results using concrete examples and, in the context of the biorthogonal charge pumping, discuss in detail a recent experiment where quantized charge pumping was observed in a lossy environment.


title: Dissipative particle dynamics simulation plus slip-springs for entangled polymers with various slip-spring densities

abstract: Slip-spring models are valuable tools for simulating entangled polymers, bridging the gap between bead-spring models with excluded volume and network models with presumed reptation motion. This study focuses on the DPD-SS (Dissipative Particle Dynamics - Slip-Spring) model, which introduces slip-springs into the standard DPD polymer model with soft-core interactions. By systematically adjusting the fugacity of slip-springs, the density of slip-springs within the system is varied. Simulation results demonstrate the compatibility of models with different slip-spring densities in terms of diffusion and linear relaxation modulus when the average number of slip-springs per chain is the same. The conversion between DPD-SS models concerning length and time is achieved through Rouse scaling, which utilizes the average number of DPD beads between consecutive anchoring points of slip-springs. Additionally, the modulus conversion is accomplished through the plateau modulus that takes account of fluctuations around entanglement. Notably, diffusion and relaxation modulus from the DPD-SS model align with those reported for standard Kremer-Grest and DPD models featuring strong repulsive interactions.


title: IQ Skew and Imbalance Estimation for Coherent Point-to-Multi-Point Optical Networks

abstract: Coherent point-to-multi-point (PtMP) optical network based on digital subcarrier multiplexing (DSCM) has been a promising technology for metro and access networks to achieve cost savings, low latency, and high flexibility. In-phase and quadrature (IQ) impairments of the coherent transceiver (e.g. IQ skew and power imbalance) cause severe performance degradation. In the DSCM-based coherent PtMP optical networks, it is hard to realize far-end IQ-impairments estimation for the hub transmitter because the leaf on one subcarrier cannot acquire the signal on the symmetrical subcarrier. In this paper, we propose a far-end IQ-impairments estimation based on the specially designed time-and-frequency interleaving tones (TFITs), which can simultaneously estimate IQ skews and power imbalances of the hub transmitter and leaf receiver at an individual leaf. The feasibility of the TFITs-based IQ-impairments estimation has been experimentally verified by setting up $8$Gbaud/SC $\times$ $4$SCs DSCM-based coherent PtMP optical network. The experimental results depict that the absolute errors in the estimated IQ skew and power imbalance are within $\pm 0.5$ps and $\pm 0.2$dB, respectively. In conclusion, TFITs-based IQ-impairments estimation has great potential for DSCM-based coherent PtMP optical networks.


title: Error analysis of a collocation method on graded meshes for nonlocal diffusion problems with weakly singular kernels

abstract: Can graded meshes yield more accurate numerical solution than uniform meshes? A time-dependent nonlocal diffusion problem with a weakly singular kernel is considered using collocation method. For its steady-state counterpart, under the sufficiently smooth solution, we first clarify that the standard graded meshes are worse than uniform meshes and may even lead to divergence; instead, an optimal convergence rate arises in so-called anomalous graded meshes. Furthermore, under low regularity solutions, it may suffer from a severe order reduction in (Chen, Qi, Shi and Wu, IMA J. Numer. Anal., 41 (2021) 3145--3174). In this case, conversely, a sharp error estimates appears in standard graded meshes, but offering far less than first-order accuracy. For the time-dependent case, however, second-order convergence can be achieved on graded meshes. The related analysis are easily extended for certain multidimensional problems. Numerical results are provided that confirm the sharpness of the error estimates.


title: Nonlinear dispersion relation of dust acoustic waves using the Korteweg-de Vries model

abstract: In this brief communication, we present an exact analytic nonlinear dispersion relation (NLDR) for the dust acoustic waves using the Korteweg-de Vries (KdV) model. The NLDR agrees with the spectrum of spatio-temporal evolution obtained from an exact solution as in Mir~\textit{et al.}~[Phys. Plasmas \textbf{27}, 113701 (2020)]. The NLDR also shows a reasonable match with the experimental data of Thompson~\textit{et al.}~[Phys. Plasmas \textbf{4}, 2331 (1997)] in the long wavelength limit ($k \lambda_D \ll 1$). We suggest that such nonlinear corrections should be incorporated in the dispersion relation along with damping, streaming, and correlation effects in order to provide a more realistic interpretation of experimental data.


title: A high contrast and resolution reconstruction algorithm in quantitative photoacoustic tomography

abstract: A framework for reconstruction of optical diffusion and absorption coefficients in quantitative photoacoustic tomography is presented. This framework is based on a Tikhonov-type functional with a regularization term promoting sparsity of the absorption coefficient and a prior involving a Kubelka-Munk absorption-diffusion relation that allows to obtain superior reconstructions. The reconstruction problem is formulated as the minimization of this functional subject to the differential constraint given by a photon-propagation model. The solution of this problem is obtained by a fast and robust sequential quadratic hamiltonian algorithm based on the Pontryagin maximum principle. Results of several numerical experiments demonstrate that the proposed computational strategy is able to obtain reconstructions of the optical coefficients with high contrast and resolution for a wide variety of objects.


title: Primes in arithmetic progressions and short intervals without $L$-functions

abstract: We develop a sieve that can detect primes in multiplicatively structured sets under certain conditions. We apply it to obtain a new $L$-function free proof of Linnik's problem of bounding the least prime $p$ such that $p\equiv a\pmod q$ (with the bound $p \ll q^{350}$) as well as a new $L$-function free proof that the interval $(x-x^{39/40}, x]$ contains primes for every large $x$. In a future work we will develop the sieve further and provide more applications.


title: Is Registering Raw Tagged-MR Enough for Strain Estimation in the Era of Deep Learning?

abstract: Magnetic Resonance Imaging with tagging (tMRI) has long been utilized for quantifying tissue motion and strain during deformation. However, a phenomenon known as tag fading, a gradual decrease in tag visibility over time, often complicates post-processing. The first contribution of this study is to model tag fading by considering the interplay between $T_1$ relaxation and the repeated application of radio frequency (RF) pulses during serial imaging sequences. This is a factor that has been overlooked in prior research on tMRI post-processing. Further, we have observed an emerging trend of utilizing raw tagged MRI within a deep learning-based (DL) registration framework for motion estimation. In this work, we evaluate and analyze the impact of commonly used image similarity objectives in training DL registrations on raw tMRI. This is then compared with the Harmonic Phase-based approach, a traditional approach which is claimed to be robust to tag fading. Our findings, derived from both simulated images and an actual phantom scan, reveal the limitations of various similarity losses in raw tMRI and emphasize caution in registration tasks where image intensity changes over time.


title: Null geodesic structure for the Barriola-Vilenkin spacetime via $k$-essence

abstract: Based on the work of Chandrasekhar [{\it The Mathematical Theory of Black Holes, Oxford Univ. Press (1992)}], we investigate the null geodesic structure of the emergent Barriola-Vilenkin spacetime in the context of {\bf k-}essence theory. For {\bf k-}essence, the emergent gravity metric is a one-to-one correspondence with the Barriola-Vilenkin (BV) metric connected to the Schwarzschild background, where the global monopole charge is replaced by the dark energy density. This equivalence holds specifically for a certain class of {\bf k-}essence scalar fields that have been constructed by Gangopadhyay and Manna [Euro. Phys. Lett., 100, 49001, (2012)]. We have traced out different trajectories for null geodesic in the presence of dark energy for the {\bf k-}essence emergent Barriola-Vilenkin spacetime. It is demonstrated that the outcomes deviate from the typical Schwarzchild spacetime owing to the fundamental configuration with a constant dark energy density.


title: Tensor-based process control and monitoring for semiconductor manufacturing with unstable disturbances

abstract: With the development and popularity of sensors installed in manufacturing systems, complex data are collected during manufacturing processes, which brings challenges for traditional process control methods. This paper proposes a novel process control and monitoring method for the complex structure of high-dimensional image-based overlay errors (modeled in tensor form), which are collected in semiconductor manufacturing processes. The proposed method aims to reduce overlay errors using limited control recipes. We first build a high-dimensional process model and propose different tensor-on-vector regression algorithms to estimate parameters in the model to alleviate the curse of dimensionality. Then, based on the estimate of tensor parameters, the exponentially weighted moving average (EWMA) controller for tensor data is designed whose stability is theoretically guaranteed. Considering the fact that low-dimensional control recipes cannot compensate for all high-dimensional disturbances on the image, control residuals are monitored to prevent significant drifts of uncontrollable high-dimensional disturbances. Through extensive simulations and real case studies, the performances of parameter estimation algorithms and the EWMA controller in tensor space are evaluated. Compared with existing image-based feedback controllers, the superiority of our method is verified especially when disturbances are not stable.


title: Scavenging Hyena: Distilling Transformers into Long Convolution Models

abstract: The rapid evolution of Large Language Models (LLMs), epitomized by architectures like GPT-4, has reshaped the landscape of natural language processing. This paper introduces a pioneering approach to address the efficiency concerns associated with LLM pre-training, proposing the use of knowledge distillation for cross-architecture transfer. Leveraging insights from the efficient Hyena mechanism, our method replaces attention heads in transformer models by Hyena, offering a cost-effective alternative to traditional pre-training while confronting the challenge of processing long contextual information, inherent in quadratic attention mechanisms. Unlike conventional compression-focused methods, our technique not only enhances inference speed but also surpasses pre-training in terms of both accuracy and efficiency. In the era of evolving LLMs, our work contributes to the pursuit of sustainable AI solutions, striking a balance between computational power and environmental impact.


title: Can We Improve Channel Reciprocity via Loop-back Compensation for RIS-assisted Physical Layer Key Generation

abstract: Reconfigurable intelligent surface (RIS) facilitates the extraction of unpredictable channel features for physical layer key generation (PKG), securing communications among legitimate users with symmetric keys. Previous works have demonstrated that channel reciprocity plays a crucial role in generating symmetric keys in PKG systems, whereas, in reality, reciprocity is greatly affected by hardware interference and RIS-based jamming attacks. This motivates us to propose LoCKey, a novel approach that aims to improve channel reciprocity by mitigating interferences and attacks with a loop-back compensation scheme, thus maximizing the secrecy performance of the PKG system. Specifically, our proposed LoCKey is capable of effectively compensating for the CSI non-reciprocity by the combination of transmit-back signal value and error minimization module. Firstly, we introduce the entire flowchart of our method and provide an in-depth discussion of each step. Following that, we delve into a theoretical analysis of the performance optimizations when our LoCKey is applied for CSI reciprocity enhancement. Finally, we conduct experiments to verify the effectiveness of the proposed LoCKey in improving channel reciprocity under various interferences for RIS-assisted wireless communications. The results demonstrate a significant improvement in both the rate of key generation assisted by the RIS and the consistency of the generated keys, showing great potential for the practical deployment of our LoCKey in future wireless systems.


title: Existence, uniqueness and comparison theorem on unbounded solutions of general time interval BSDEs with sub-quadratic generators

abstract: This paper is devoted to the existence, uniqueness and comparison theorem on unbounded solutions of one-dimensional backward stochastic differential equations (BSDEs) with sub-quadratic generators, where the terminal time is allowed to be finite or infinite. We first establish existence of the unbounded solutions for this kind of BSDEs with generator $g$ satisfying a time-varying one-sided linear growth in the first unknown variable $y$ and a time-varying sub-quadratic growth in the second unknown variable $z$. Then, the uniqueness and comparison theorem of the unbounded solutions for this kind of BSDEs are proved under a time-varying extended convexity assumption. These results generalized those obtained in \cite{12} to the general time interval BSDEs. Finally, several sufficient conditions ensuring that the uniqueness holds are put forward and verified via some innovative ideas, which are explored at the first time even though for the case of finite time interval BSDEs.


title: Robustness in Wireless Distributed Learning: An Information-Theoretic Analysis

abstract: In this paper, we take an information-theoretic approach to understand the robustness in wireless distributed learning. Upon measuring the difference in loss functions, we provide an upper bound of the performance deterioration due to imperfect wireless channels. Moreover, we characterize the transmission rate under task performance guarantees and propose the channel capacity gain resulting from the inherent robustness in wireless distributed learning. An efficient algorithm for approximating the derived upper bound is established for practical use. The effectiveness of our results is illustrated by the numerical simulations.


title: Similarity and Comparison Complexity

abstract: Some choice options are more difficult to compare than others. This paper develops a theory of what makes a comparison complex, and how comparison complexity generates systematic mistakes in choice. In our model, options are easier to compare when they 1) share similar features, holding fixed their value difference, and 2) are closer to dominance. We show how these two postulates yield tractable measures of comparison complexity in the domains of multiattribute, lottery, and intertemporal choice. Using experimental data on binary choices, we demonstrate that our complexity measures predict choice errors, choice inconsistency, and cognitive uncertainty across all three domains. We then show how canonical anomalies in choice and valuation, such as context effects, preference reversals, and apparent probability weighting and present bias in the valuation of risky and intertemporal prospects, can be understood as responses to comparison complexity.


title: On Local Solutions of Second Order Quasi-linear Elliptic Systems with Arbitrary 1-Jet at a Point

abstract: We prove a general result on the existence of local solutions of any second order quasi-linear elliptic system with arbitrary 1-jet at a point.


title: Graph Contrastive Learning with Cohesive Subgraph Awareness

abstract: Graph contrastive learning (GCL) has emerged as a state-of-the-art strategy for learning representations of diverse graphs including social and biomedical networks. GCL widely uses stochastic graph topology augmentation, such as uniform node dropping, to generate augmented graphs. However, such stochastic augmentations may severely damage the intrinsic properties of a graph and deteriorate the following representation learning process. We argue that incorporating an awareness of cohesive subgraphs during the graph augmentation and learning processes has the potential to enhance GCL performance. To this end, we propose a novel unified framework called CTAug, to seamlessly integrate cohesion awareness into various existing GCL mechanisms. In particular, CTAug comprises two specialized modules: topology augmentation enhancement and graph learning enhancement. The former module generates augmented graphs that carefully preserve cohesion properties, while the latter module bolsters the graph encoder's ability to discern subgraph patterns. Theoretical analysis shows that CTAug can strictly improve existing GCL mechanisms. Empirical experiments verify that CTAug can achieve state-of-the-art performance for graph representation learning, especially for graphs with high degrees. The code is available at https://doi.org/10.5281/zenodo.10594093, or https://github.com/wuyucheng2002/CTAug.


title: Bitcoin Inscriptions: Foundations and Beyond

abstract: Bitcoin inscription marks a pivotal moment in blockchain technology. This report presents a primary exploration of Bitcoin inscriptions. We dive into the technological underpinnings and offer a detailed comparative analysis between Bitcoin inscriptions and NFTs on other blockchains. Further, we explore a wide range of use cases and significant opportunities for future innovation, including inscription derivative protocols, Bitcoin Layer2 solutions, and interoperability techniques.


title: STAR: An Efficient Softmax Engine for Attention Model with RRAM Crossbar

abstract: RRAM crossbars have been studied to construct in-memory accelerators for neural network applications due to their in-situ computing capability. However, prior RRAM-based accelerators show efficiency degradation when executing the popular attention models. We observed that the frequent softmax operations arise as the efficiency bottleneck and also are insensitive to computing precision. Thus, we propose STAR, which boosts the computing efficiency with an efficient RRAM-based softmax engine and a fine-grained global pipeline for the attention models. Specifically, STAR exploits the versatility and flexibility of RRAM crossbars to trade off the model accuracy and hardware efficiency. The experimental results evaluated on several datasets show STAR achieves up to 30.63x and 1.31x computing efficiency improvements over the GPU and the state-of-the-art RRAM-based attention accelerators, respectively.


title: Agile But Safe: Learning Collision-Free High-Speed Legged Locomotion

abstract: Legged robots navigating cluttered environments must be jointly agile for efficient task execution and safe to avoid collisions with obstacles or humans. Existing studies either develop conservative controllers (< 1.0 m/s) to ensure safety, or focus on agility without considering potentially fatal collisions. This paper introduces Agile But Safe (ABS), a learning-based control framework that enables agile and collision-free locomotion for quadrupedal robots. ABS involves an agile policy to execute agile motor skills amidst obstacles and a recovery policy to prevent failures, collaboratively achieving high-speed and collision-free navigation. The policy switch in ABS is governed by a learned control-theoretic reach-avoid value network, which also guides the recovery policy as an objective function, thereby safeguarding the robot in a closed loop. The training process involves the learning of the agile policy, the reach-avoid value network, the recovery policy, and an exteroception representation network, all in simulation. These trained modules can be directly deployed in the real world with onboard sensing and computation, leading to high-speed and collision-free navigation in confined indoor and outdoor spaces with both static and dynamic obstacles.


title: Driving factors behind multiple populations

abstract: Star clusters were historically considered simple stellar populations, with all stars sharing the same age and initial chemical composition. However, the presence of chemical anomalies in globular clusters (GCs), called multiple stellar populations (MPs), has challenged star formation theories in dense environments. Literature studies show that mass, metallicity, and age are likely controlling parameters for the manifestation of MPs. Identifying the limit between clusters with/without MPs in physical parameter space is crucial to reveal the driving mechanism behind their presence. In this study, we look for MP signals in Whiting 1, traditionally considered a young GC. Using the Magellan telescope, we obtained low-resolution spectra within $\rm \lambda\lambda = 3850-5500 \r{A}$ for eight giants of Whiting 1. We measured the C and N abundances from the CN and CH spectral indices. C and N abundances have variations comparable with their measurement errors ($\sim0.1$ dex), suggesting that MPs are absent from Whiting 1. Combining these findings with literature studies, we propose a limit in the metallicity vs. cluster compactness index parameter space, which relatively clearly separates star clusters with/without MPs (GCs/open clusters). This limit is physically motivated. On a larger scale, the galactic environment determines cluster compactness and metallicity, leading to metal-rich, diffuse, old clusters formed ex situ. Our proposed limit also impacts our understanding of the formation of the Sagittarius dwarf galaxy: star clusters formed after the first starburst (age$\lesssim 8-10$ Gyr). These clusters are simple stellar populations because the enriched galactic environment is no longer suitable for MP formation.


title: Propagation and Pitfalls: Reasoning-based Assessment of Knowledge Editing through Counterfactual Tasks

abstract: Current approaches of knowledge editing struggle to effectively propagate updates to interconnected facts. In this work, we delve into the barriers that hinder the appropriate propagation of updated knowledge within these models for accurate reasoning. To support our analysis, we introduce a novel reasoning-based benchmark -- ReCoE (Reasoning-based Counterfactual Editing dataset) -- which covers six common reasoning schemes in real world. We conduct a thorough analysis of existing knowledge editing techniques, including input augmentation, finetuning, and locate-and-edit. We found that all model editing methods show notably low performance on this dataset, especially in certain reasoning schemes. Our analysis over the chain-of-thought generation of edited models further uncover key reasons behind the inadequacy of existing knowledge editing methods from a reasoning standpoint, involving aspects on fact-wise editing, fact recall ability, and coherence in generation. We will make our benchmark publicly available.


title: Magnetic Bloch oscillations in a non-Hermitian quantum Ising chain

abstract: We investigate the impacts of an imaginary transverse field on the dynamics of magnetic domain walls in a quantum Ising chain. We show that an imaginary field plays a similar role as a real transverse field in forming a low-lying Wannier-Stark ladder. However, analytical and numerical calculations of the time evolutions in both systems show that the corresponding Bloch oscillations exhibit totally different patterns for the same initial states. These findings reveal the nontrivial effect of non-Hermiticity on quantum spin dynamics.


title: A Hybrid Machine Learning Framework for Predicting Hydrogen Storage Capacities: Unsupervised Feature Learning with Deep Neural Networks

abstract: In this study, we present a sophisticated hybrid machine-learning framework that significantly improves the accuracy of predicting hydrogen storage capacities in metal hydrides. This is a critical challenge due to the scarcity of experimental data and the complexity of high-dimensional feature spaces. Our approach employs the power of unsupervised learning through the use of a state-of-the-art autoencoder. This autoencoder is trained on elemental descriptors obtained from Mendeleev software, enabling the extraction of a meaningful and lower dimensional latent space from the input data. This latent representation serves as the basis for our deep multi-layer perceptron (MLP) model, which consists of five layers and shows good precision in predicting hydrogen storage capacities. Furthermore, our results show very good agreement with the results of density functional theory (DFT). In addition to addressing the limitations caused by limited and unevenly distributed data in the field of hydrogen storage materials, we also focus on discovering new materials that show promising opportunities for hydrogen storage. These materials were identified using both feature-based approaches and predictions generated by a large language model. Finally, our investigation into the effectiveness of transferring weights from the autoencoder to the MLP, in addition to the latent features, suggests that while this strategy slightly improves model performance indicated by a slightly higher R$^2$ value and lower RMSE, it emphasizes the intricate challenge of adapting pre-trained weights for specific supervised tasks.


title: Local and Global Contexts for Conversation

abstract: The context in conversation is the dialog history crucial for multi-turn dialogue. Learning from the relevant contexts in dialog history for grounded conversation is a challenging problem. Local context is the most neighbor and more sensitive to the subsequent response, and global context is relevant to a whole conversation far beyond neighboring utterances. Currently, pretrained transformer models for conversation challenge capturing the correlation and connection between local and global contexts. We introduce a local and global conversation model (LGCM) for general-purpose conversation in open domain. It is a local-global hierarchical transformer model that excels at accurately discerning and assimilating the relevant contexts necessary for generating responses. It employs a local encoder to grasp the local context at the level of individual utterances and a global encoder to understand the broader context at the dialogue level. The seamless fusion of these locally and globally contextualized encodings ensures a comprehensive comprehension of the conversation. Experiments on popular datasets show that LGCM outperforms the existing conversation models on the performance of automatic metrics with significant margins.


title: Critical behavior and Joule-Thomson expansion of charged AdS black holes surrounded by exotic fluid with modified Chaplygin equation of state

abstract: By considering the concept of a unified single fluid model, referred to as the modified Chaplygin gas (MCG), which amalgamates dark energy and dark matter. In this study, we explore the thermodynamic characteristics of charged anti-de Sitter (AdS) black holes existing in an unconventional fluid accompanied by MCG. To accomplish this objective, we derive the equations of state by regarding the charge $Q^{2}$ as a thermodynamic variable. The impact of MCG parameters on the critical thermodynamic quantities ($\psi_{c}$, $T_{c}$, $Q_{c}^{2}$) are examined, followed by a detailed analysis of the $Q^{2}-\psi$ diagram. To provide a clearer explanation of the phase transition, we present an analysis of the Gibbs free energy. It is important to note that if the Hawking temperature exceeds the critical temperature, there is a distinct pattern observed known as swallowtail behavior. This indicates that the system undergoes a first-order phase transition from a smaller black hole to a larger one. The critical exponent of the system is found to be in complete agreement with that of the van der Waals fluid system. Furthermore, we investigate the impact of MCG parameters and black hole charge on the Joule-Thomson (J-T) expansion in the extended phase space. The J-T coefficient is examined to pinpoint the exact region experiencing cooling or heating, the observation reveals that the presence of negative heat capacity results in the occurrence of a cooling process. In addition, it is worth noting that the certain parameters exert a significant influence on the ratio $\frac{T_{min}}{T_{c}}$. The parameters $\gamma$ and $\beta$ have a non-negligible effect on the isenthalpy curve.


title: Spectrally-large scale geometry in cotangent bundles

abstract: In this paper, we prove that the ${\rm Ham}$-orbit space from a fiber of a large family of cotangent bundles, as a metric space with respect to the Floer-theoretic spectral metric, contains a quasi-isometric embedding of an infinite-dimensional normed vector space. The same conclusion holds for the group of compactly supported Hamiltonian diffeomorphisms of some cotangent bundles. To prove this, we generalize a result, relating boundary depth and spectral norm for closed symplectic manifolds in Kislev-Shelukhin's recent work, to Liouville domains. Then we modify Usher's constructions (which were used to obtain Hofer-large scale geometric properties) to achieve our desired conclusions.


title: Multi-Agent Phase-Balancing around Polar Curves with Bounded Trajectories: An Experimental Study using Crazyflies and MoCap System

abstract: In this experimental work, we implement the control design from our earlier work on a swarm of Crazyflie 2.1 quad-copters by deriving the original control in terms of variables that are available to the user in this practical system. A suitable model is developed using the Crazyswarm2 package within ROS2 to facilitate the execution of the control law. We also discuss various components that are part of this experiment and the challenges we encountered during the experimentation. Extensive experimental results, along with the links to the YouTube videos for actual Crazyflie quad-copters, are provided.


title: Local Feature Matching Using Deep Learning: A Survey

abstract: Local feature matching enjoys wide-ranging applications in the realm of computer vision, encompassing domains such as image retrieval, 3D reconstruction, and object recognition. However, challenges persist in improving the accuracy and robustness of matching due to factors like viewpoint and lighting variations. In recent years, the introduction of deep learning models has sparked widespread exploration into local feature matching techniques. The objective of this endeavor is to furnish a comprehensive overview of local feature matching methods. These methods are categorized into two key segments based on the presence of detectors. The Detector-based category encompasses models inclusive of Detect-then-Describe, Joint Detection and Description, Describe-then-Detect, as well as Graph Based techniques. In contrast, the Detector-free category comprises CNN Based, Transformer Based, and Patch Based methods. Our study extends beyond methodological analysis, incorporating evaluations of prevalent datasets and metrics to facilitate a quantitative comparison of state-of-the-art techniques. The paper also explores the practical application of local feature matching in diverse domains such as Structure from Motion, Remote Sensing Image Registration, and Medical Image Registration, underscoring its versatility and significance across various fields. Ultimately, we endeavor to outline the current challenges faced in this domain and furnish future research directions, thereby serving as a reference for researchers involved in local feature matching and its interconnected domains. A comprehensive list of studies in this survey is available at https://github.com/vignywang/Awesome-Local-Feature-Matching .


title: Head and Neck Tumor Segmentation from [18F]F-FDG PET/CT Images Based on 3D Diffusion Model

abstract: Head and neck (H&N) cancers are among the most prevalent types of cancer worldwide, and [18F]F-FDG PET/CT is widely used for H&N cancer management. Recently, the diffusion model has demonstrated remarkable performance in various image-generation tasks. In this work, we proposed a 3D diffusion model to accurately perform H&N tumor segmentation from 3D PET and CT volumes. The 3D diffusion model was developed considering the 3D nature of PET and CT images acquired. During the reverse process, the model utilized a 3D UNet structure and took the concatenation of PET, CT, and Gaussian noise volumes as the network input to generate the tumor mask. Experiments based on the HECKTOR challenge dataset were conducted to evaluate the effectiveness of the proposed diffusion model. Several state-of-the-art techniques based on U-Net and Transformer structures were adopted as the reference methods. Benefits of employing both PET and CT as the network input as well as further extending the diffusion model from 2D to 3D were investigated based on various quantitative metrics and the uncertainty maps generated. Results showed that the proposed 3D diffusion model could generate more accurate segmentation results compared with other methods. Compared to the diffusion model in 2D format, the proposed 3D model yielded superior results. Our experiments also highlighted the advantage of utilizing dual-modality PET and CT data over only single-modality data for H&N tumor segmentation.


title: 5G NR Positioning Enhancements in 3GPP Release-18

abstract: New radio (NR) positioning in the Third Generation Partnership Project (3GPP) Release 18 (Rel-18) enables 5G-advanced networks to achieve ultra-high accuracy positioning without dependence on global navigation satellite systems (GNSS) with key enablers such as the carrier phase positioning technique, standardized for the first time in a cellular communications standard and setting a new baseline for future generations. In addition, Rel-18 NR supports positioning functionalities for reduced capability (RedCap) user equipment and bandwidth aggregation for positioning measurements. Moreover, the low power solutions are designed for low power high accuracy positioning use cases. Lastly, sidelink-based positioning is introduced in Rel-18. This article constitutes a comprehensive treatment of the Rel-18 NR positioning enhancements crucial for the development of next-generation networks.


title: Marginal treatment effects in the absence of instrumental variables

abstract: We propose a method for defining, identifying, and estimating the marginal treatment effect (MTE) without imposing the instrumental variable (IV) assumptions of independence, exclusion, and separability (or monotonicity). Under a new definition of the MTE based on reduced-form treatment error that is statistically independent of the covariates, we find that the relationship between the MTE and standard treatment parameters holds in the absence of IVs. We provide a set of sufficient conditions ensuring the identification of the defined MTE in an environment of essential heterogeneity. The key conditions include a linear restriction on potential outcome regression functions, a nonlinear restriction on the propensity score, and a conditional mean independence restriction that will lead to additive separability. We prove this identification using the notion of semiparametric identification based on functional form. We suggest consistent semiparametric estimation procedures, and provide an empirical application for the Head Start program to illustrate the usefulness of the proposed method in analyzing heterogenous causal effects when IVs are elusive.


title: An Interactive Empirical Approach to the Validation of Software Package Specifications

abstract: The objective of this research is the development of a practical system to manipulate and validate software package specifications. The validation process developed is based on consistency checks. Furthermore, by means of scenarios, the customer will be able to interactively experience the specified system prior to its implementation. Functions, data, and data types constitute the framework of our validation system. The specification of the Graphical Kernel System (GKS) is a typical example of the target software package specifications to be manipulated.


title: SPECTRUM: Speaker-Enhanced Pre-Training for Long Dialogue Summarization

abstract: Multi-turn dialogues are characterized by their extended length and the presence of turn-taking conversations. Traditional language models often overlook the distinct features of these dialogues by treating them as regular text. In this paper, we propose a speaker-enhanced pre-training method for long dialogue summarization, which leverages the inherent structure of multiple-turn dialogues. To support our study, we curate a diverse dataset that includes transcripts from real-world scenarios, movie or TV show transcripts, and dialogues generated by a Large Language Model. We then perform a pre-training, which encompasses the detection of speaker changes, and masked utterance generation. Experimental results of fine-tuned models demonstrate that our model achieves state-of-the-art performance on downstream benchmarks with long context, surpassing baseline models and highlighting the effectiveness of our approach. Our findings highlight the importance of curating pre-training datasets that exhibit diversity and variations in length distribution to ensure effective alignment with downstream datasets.


title: Subsurface Flows Associated with Formation and Flaring Activity of Solar Active Regions

abstract: We investigate the evolution of subsurface flows during the emergence and the active phase of sunspot regions using the time-distance helioseismology analysis of the full-disk Dopplergrams from the Helioseismic and Magnetic Imager (HMI) onboard the Solar Dynamics Observatory (SDO). We present an analysis of emerging active regions of various types, including delta-type active regions and regions with the reverse polarity order (`anti-Hale active regions'). The results reveal strong vortical and shearing flows during the emergence of magnetic flux, as well as the process of formation of large-scale converging flow patterns around developing active regions, predominantly in the top 6 Mm deep layers of the convection zone. Our analysis revealed a significant correlation between the flow divergence and helicity in the active regions with their flaring activity, indicating that measuring characteristics of subsurface flows can contribute to flare forecasting.


title: A Graphics Function Standard Specification Validator

abstract: A validation methodology is proposed and implemented for natural language software specifications of standard graphics functions. Checks are made for consistency, completeness, and lack of ambiguity in data element and function descriptions. Functions and data elements are maintained in a relational database representation. The appropriate checks are performed by sequences of database operations. The relational database manager INGRES was used to support a prototype implementation of the proposed technique. The methodology supports the development of a scenario-based prototype from the information available in the specification. This permits various function sequences to be checked without implementation of the environment specified. The application of a prototype implementation of the proposed methodology to the specification of the Graphics Kernel System (GKS) software package demonstrates the practicability of the method. Several inconsistencies in GKS related to the definition of data elements have been identified.


title: Good at captioning, bad at counting: Benchmarking GPT-4V on Earth observation data

abstract: Large Vision-Language Models (VLMs) have demonstrated impressive performance on complex tasks involving visual input with natural language instructions. However, it remains unclear to what extent capabilities on natural images transfer to Earth observation (EO) data, which are predominantly satellite and aerial images less common in VLM training data. In this work, we propose a comprehensive benchmark to gauge the progress of VLMs toward being useful tools for EO data by assessing their abilities on scene understanding, localization and counting, and change detection tasks. Motivated by real-world applications, our benchmark includes scenarios like urban monitoring, disaster relief, land use, and conservation. We discover that, although state-of-the-art VLMs like GPT-4V possess extensive world knowledge that leads to strong performance on open-ended tasks like location understanding and image captioning, their poor spatial reasoning limits usefulness on object localization and counting tasks. Our benchmark will be made publicly available at https://vleo.danielz.ch/ and on Hugging Face at https://huggingface.co/collections/mit-ei/vleo-benchmark-datasets-65b789b0466555489cce0d70 for easy model evaluation.


title: Electronic conduction and superconducting properties of CoSi$_2$ films on silicon--an unconventional superconductor with technological potential

abstract: We report observations of unusual normal-state electronic conduction properties and superconducting characteristics of high-quality CoSi$_2$/Si films grown on silicon Si(100) and Si(111) substrates. A good understanding of these features shall help to address the underlying physics of the unconventional pairing symmetry recently observed in transparent CoSi$_2$/TiSi$_2$ heterojunctions [S. P. Chiu \textit{et al.}, Sci. Adv. \textbf{7}, eabg6569 (2021); Nanoscale \textbf{15}, 9179 (2023)], where CoSi$_2$/Si is a superconductor with a superconducting transition temperature $T_c \simeq$ (1.1--1.5) K, dependent on its dimensions, and TiSi$_2$ is a normal metal. In CoSi$_2$/Si films, we find a pronounced positive magnetoresistance caused by the weak-antilocalization effect, indicating a strong Rashba spin-orbit coupling (SOC). This SOC generates two-component superconductivity in CoSi$_2$/TiSi$_2$ heterojunctions. The CoSi$_2$/Si films are stable under ambient conditions and have ultralow 1/$f$ noise. Moreover, they can be patterned via the standard lithography techniques, which might be of considerable practical value for future scalable superconducting and quantum device fabrication.


title: Assertion Detection Large Language Model In-context Learning LoRA Fine-tuning

abstract: In this study, we aim to address the task of assertion detection when extracting medical concepts from clinical notes, a key process in clinical natural language processing (NLP). Assertion detection in clinical NLP usually involves identifying assertion types for medical concepts in the clinical text, namely certainty (whether the medical concept is positive, negated, possible, or hypothetical), temporality (whether the medical concept is for present or the past history), and experiencer (whether the medical concept is described for the patient or a family member). These assertion types are essential for healthcare professionals to quickly and clearly understand the context of medical conditions from unstructured clinical texts, directly influencing the quality and outcomes of patient care. Although widely used, traditional methods, particularly rule-based NLP systems and machine learning or deep learning models, demand intensive manual efforts to create patterns and tend to overlook less common assertion types, leading to an incomplete understanding of the context. To address this challenge, our research introduces a novel methodology that utilizes Large Language Models (LLMs) pre-trained on a vast array of medical data for assertion detection. We enhanced the current method with advanced reasoning techniques, including Tree of Thought (ToT), Chain of Thought (CoT), and Self-Consistency (SC), and refine it further with Low-Rank Adaptation (LoRA) fine-tuning. We first evaluated the model on the i2b2 2010 assertion dataset. Our method achieved a micro-averaged F-1 of 0.89, with 0.11 improvements over the previous works. To further assess the generalizability of our approach, we extended our evaluation to a local dataset that focused on sleep concept extraction. Our approach achieved an F-1 of 0.74, which is 0.31 higher than the previous method.


title: Topology-Aware Latent Diffusion for 3D Shape Generation

abstract: We introduce a new generative model that combines latent diffusion with persistent homology to create 3D shapes with high diversity, with a special emphasis on their topological characteristics. Our method involves representing 3D shapes as implicit fields, then employing persistent homology to extract topological features, including Betti numbers and persistence diagrams. The shape generation process consists of two steps. Initially, we employ a transformer-based autoencoding module to embed the implicit representation of each 3D shape into a set of latent vectors. Subsequently, we navigate through the learned latent space via a diffusion model. By strategically incorporating topological features into the diffusion process, our generative module is able to produce a richer variety of 3D shapes with different topological structures. Furthermore, our framework is flexible, supporting generation tasks constrained by a variety of inputs, including sparse and partial point clouds, as well as sketches. By modifying the persistence diagrams, we can alter the topology of the shapes generated from these input modalities.


title: Computation and Parameter Efficient Multi-Modal Fusion Transformer for Cued Speech Recognition

abstract: Cued Speech (CS) is a pure visual coding method used by hearing-impaired people that combines lip reading with several specific hand shapes to make the spoken language visible. Automatic CS recognition (ACSR) seeks to transcribe visual cues of speech into text, which can help hearing-impaired people to communicate effectively. The visual information of CS contains lip reading and hand cueing, thus the fusion of them plays an important role in ACSR. However, most previous fusion methods struggle to capture the global dependency present in long sequence inputs of multi-modal CS data. As a result, these methods generally fail to learn the effective cross-modal relationships that contribute to the fusion. Recently, attention-based transformers have been a prevalent idea for capturing the global dependency over the long sequence in multi-modal fusion, but existing multi-modal fusion transformers suffer from both poor recognition accuracy and inefficient computation for the ACSR task. To address these problems, we develop a novel computation and parameter efficient multi-modal fusion transformer by proposing a novel Token-Importance-Aware Attention mechanism (TIAA), where a token utilization rate (TUR) is formulated to select the important tokens from the multi-modal streams. More precisely, TIAA firstly models the modality-specific fine-grained temporal dependencies over all tokens of each modality, and then learns the efficient cross-modal interaction for the modality-shared coarse-grained temporal dependencies over the important tokens of different modalities. Besides, a light-weight gated hidden projection is designed to control the feature flows of TIAA. The resulting model, named Economical Cued Speech Fusion Transformer (EcoCued), achieves state-of-the-art performance on all existing CS datasets, compared with existing transformer-based fusion methods and ACSR fusion methods.


title: Exploring Uni-manual Around Ear Off-Device Gestures for Earables

abstract: Small form factor limits physical input space in earable (i.e., ear-mounted wearable) devices. Off-device earable inputs in alternate mid-air and on-skin around-ear interaction spaces using uni-manual gestures can address this input space limitation. Segmenting these alternate interaction spaces to create multiple gesture regions for reusing off-device gestures can expand earable input vocabulary by a large margin. Although prior earable interaction research has explored off-device gesture preferences and recognition techniques in such interaction spaces, supporting gesture reuse over multiple gesture regions needs further exploration. We collected and analyzed 7560 uni-manual gesture motion data from 18 participants to explore earable gesture reuse by segmentation of on-skin and mid-air spaces around the ear. Our results show that gesture performance degrades significantly beyond 3 mid-air and 5 on-skin around-ear gesture regions for different uni-manual gesture classes (e.g., swipe, pinch, tap). We also present qualitative findings on most and least preferred regions (and associated boundaries) by end-users for different uni-manual gesture shapes across both interaction spaces for earable devices. Our results complement earlier elicitation studies and interaction technologies for earables to help expand the gestural input vocabulary and potentially drive future commercialization of such devices.


title: Ambush from All Sides: Understanding Security Threats in Open-Source Software CI/CD Pipelines

abstract: The continuous integration and continuous deployment (CI/CD) pipelines are widely adopted on Internet hosting platforms, such as GitHub. With the popularity, the CI/CD pipeline faces various security threats. However, current CI/CD pipelines suffer from malicious code and severe vulnerabilities. Even worse, people have not been fully aware of its attack surfaces and the corresponding impacts. Therefore, in this paper, we conduct a large-scale measurement and a systematic analysis to reveal the attack surfaces of the CI/CD pipeline and quantify their security impacts. Specifically, for the measurement, we collect a data set of 320,000+ CI/CD pipeline-configured GitHub repositories and build an analysis tool to parse the CI/CD pipelines and extract security-critical usages. Besides, current CI/CD ecosystem heavily relies on several core scripts, which may lead to a single point of failure. While the CI/CD pipelines contain sensitive information/operations, making them the attacker's favorite targets. Inspired by the measurement findings, we abstract the threat model and the attack approach toward CI/CD pipelines, followed by a systematic analysis of attack surfaces, attack strategies, and the corresponding impacts. We further launch case studies on five attacks in real-world CI/CD environments to validate the revealed attack surfaces. Finally, we give suggestions on mitigating attacks on CI/CD scripts, including securing CI/CD configurations, securing CI/CD scripts, and improving CI/CD infrastructure.


title: Engineering two-dimensional nodal semimetals in functionalized biphenylene by fluorine adatoms

abstract: We propose a new band engineering scheme on the biphenylene network, a newly synthesized carbon allotrope. First, we investigate the mechanism for the appearance of type II Dirac fermion in a pristine biphenylene network. We show that the essential ingredients are mirror symmetries and the stabilization of the compact localized eigenstates via destructive interference. While the former is used for the band-crossing point along high symmetry lines, the latter makes the obtained Dirac dispersion highly inclined. Then, we demonstrate that many other different kinds of Dirac fermions, such as type-I Dirac, gapped type-II Dirac, and nodal line semimetals, can be developed by fluorinating the biphenylene network periodically in various ways. In this program, the key role of the fluorine atoms is manipulating the condition of the destructive interference and mirror symmetries.


title: Electrical 180o switching of N\'eel vector in spin-splitting antiferromagnet

abstract: Antiferromagnetic spintronics have attracted wide attention due to its great potential in constructing ultra-dense and ultra-fast antiferromagnetic memory that suits modern high-performance information technology. The electrical 180o switching of N\'eel vector is a long-term goal for developing electrical-controllable antiferromagnetic memory with opposite N\'eel vectors as binary "0" and "1". However, the state-of-art antiferromagnetic switching mechanisms have long been limited for 90o or 120o switching of N\'eel vector, which unavoidably require multiple writing channels that contradicts ultra-dense integration. Here, we propose a deterministic switching mechanism based on spin-orbit torque with asymmetric energy barrier, and experimentally achieve electrical 180o switching of spin-splitting antiferromagnet Mn5Si3. Such a 180o switching is read out by the N\'eel vector-induced anomalous Hall effect. Based on our writing and readout methods, we fabricate an antiferromagnet device with electrical-controllable high and low resistance states that accomplishes robust write and read cycles. Besides fundamental advance, our work promotes practical spin-splitting antiferromagnetic devices based on spin-splitting antiferromagnet.


title: LaneGraph2Seq: Lane Topology Extraction with Language Model via Vertex-Edge Encoding and Connectivity Enhancement

abstract: Understanding road structures is crucial for autonomous driving. Intricate road structures are often depicted using lane graphs, which include centerline curves and connections forming a Directed Acyclic Graph (DAG). Accurate extraction of lane graphs relies on precisely estimating vertex and edge information within the DAG. Recent research highlights Transformer-based language models' impressive sequence prediction abilities, making them effective for learning graph representations when graph data are encoded as sequences. However, existing studies focus mainly on modeling vertices explicitly, leaving edge information simply embedded in the network. Consequently, these approaches fall short in the task of lane graph extraction. To address this, we introduce LaneGraph2Seq, a novel approach for lane graph extraction. It leverages a language model with vertex-edge encoding and connectivity enhancement. Our serialization strategy includes a vertex-centric depth-first traversal and a concise edge-based partition sequence. Additionally, we use classifier-free guidance combined with nucleus sampling to improve lane connectivity. We validate our method on prominent datasets, nuScenes and Argoverse 2, showcasing consistent and compelling results. Our LaneGraph2Seq approach demonstrates superior performance compared to state-of-the-art techniques in lane graph extraction.


title: Asymptotic formulas for the logarithm of general L-functions at and near s=1

abstract: We consider a general form of L-function L(s) defined by an Euler product and satisfies several analytic assumptions. We show several asymptotic formulas for L(1) and log L(1). In particular those asymptotic formulas are valid for Dirichlet L-functions attached to almost all Dirichlet characters. Our theorems should be compared with former results due to Elliott, Montgomery and Weinberger, etc.


title: Estimating Diffusion Degree on Graph Streams

abstract: The challenges of graph stream algorithms are twofold. First, each edge needs to be processed only once, and second, it needs to work on highly constrained memory. Diffusion degree is a measure of node centrality that can be calculated (for all nodes) trivially for static graphs using a single Breadth-First Search (BFS). However, keeping track of the Diffusion Degree in a graph stream is nontrivial. The memory requirement for exact calculation is equivalent to keeping the whole graph in memory. The present paper proposes an estimator (or sketch) of diffusion degree for graph streams. We prove the correctness of the proposed sketch and the upper bound of the estimated error. Given $\epsilon, \delta \in (0,1)$, we achieve error below $\epsilon(b_u-a_u)d_u\lambda$ in node $u$ with probability $1-\delta$ by utilizing $O(n\frac1{\epsilon^2}\log{\frac1{\delta}})$ space, where $b_u$ and $a_u$ are the maximum and minimum degrees of neighbors of $u$, $\lambda$ is diffusion probability, and $d_u$ is the degree of node $u$. With the help of this sketch, we propose an algorithm to extract the top-$k$ influencing nodes in the graph stream. Comparative experiments show that the spread of top-$k$ nodes by the proposed graph stream algorithm is equivalent to or better than the spread of top-$k$ nodes extracted by the exact algorithm.


title: IGCN: Integrative Graph Convolutional Networks for Multi-modal Data

abstract: Recent advances in Graph Neural Networks (GNN) have led to a considerable growth in graph data modeling for multi-modal data which contains various types of nodes and edges. Although some integrative prediction solutions have been developed recently for network-structured data, these methods have some restrictions. For a node classification task involving multi-modal data, certain data modalities may perform better when predicting one class, while others might excel in predicting a different class. Thus, to obtain a better learning representation, advanced computational methodologies are required for the integrative analysis of multi-modal data. Moreover, existing integrative tools lack a comprehensive and cohesive understanding of the rationale behind their specific predictions, making them unsuitable for enhancing model interpretability. Addressing these restrictions, we introduce a novel integrative neural network approach for multi-modal data networks, named Integrative Graph Convolutional Networks (IGCN). IGCN learns node embeddings from multiple topologies and fuses the multiple node embeddings into a weighted form by assigning attention coefficients to the node embeddings. Our proposed attention mechanism helps identify which types of data receive more emphasis for each sample to predict a certain class. Therefore, IGCN has the potential to unravel previously unknown characteristics within different node classification tasks. We benchmarked IGCN on several datasets from different domains, including a multi-omics dataset to predict cancer subtypes and a multi-modal clinical dataset to predict the progression of Alzheimer's disease. Experimental results show that IGCN outperforms or is on par with the state-of-the-art and baseline methods.