title: Detecting Racist Text in Bengali: An Ensemble Deep Learning Framework

abstract: Racism is an alarming phenomenon in our country as well as all over the world. Every day we have come across some racist comments in our daily life and virtual life. Though we can eradicate this racism from virtual life (such as Social Media). In this paper, we have tried to detect those racist comments with NLP and deep learning techniques. We have built a novel dataset in the Bengali Language. Further, we annotated the dataset and conducted data label validation. After extensive utilization of deep learning methodologies, we have successfully achieved text detection with an impressive accuracy rate of 87.94\% using the Ensemble approach. We have applied RNN and LSTM models using BERT Embeddings. However, the MCNN-LSTM model performed highest among all those models. Lastly, the Ensemble approach has been followed to combine all the model results to increase overall performance.


title: Bayesian scalar-on-network regression with applications to brain functional connectivity

abstract: This paper presents a Bayesian regression model relating scalar outcomes to brain functional connectivity represented as symmetric positive definite (SPD) matrices. Unlike many proposals that simply vectorize the matrix-valued connectivity predictors thereby ignoring their geometric structure, the method presented here respects the Riemannian geometry of SPD matrices by using a tangent space modeling. Dimension reduction is performed in the tangent space, relating the resulting low-dimensional representations to the responses. The dimension reduction matrix is learned in a supervised manner with a sparsity-inducing prior imposed on a Stiefel manifold to prevent overfitting. Our method yields a parsimonious regression model that allows uncertainty quantification of all model parameters and identification of key brain regions that predict the outcomes. We demonstrate the performance of our approach in simulation settings and through a case study to predict Picture Vocabulary scores using data from the Human Connectome Project.


title: Multi-Objective Aerodynamic Optimization of External Compression Supersonic Intake using Kriging/MOGA

abstract: A formal optimization procedure is reported for an external-compression supersonic intake with the twin objectives of maximizing the total pressure recovery while simultaneously minimizing the intake pressure drag. Prior to that, two key design modifications are introduced to the supersonic intake. First, a small cowl offset distance is applied, deliberately violating the shock-on-lip condition. This ensures an attached external shock at the cowl, which is beneficial, in return for a small, controlled flow spillage. Second, in a novel development, an internal wedge angle is introduced at the cowl lip, which forces the terminal shock to be a strong oblique shock. This also helps anchor the terminal shock at the cowl lip for a range of intake back-pressure values, and reduces the cowl external angle with respect to the free stream. The optimization problem is formulated based on axiomatic design theory with the two design parameters innovatively selected as the Oswatitsch ramp angle triplets and the cowl internal wedge angle, respectively. A multi-objective genetic algorithm (MOGA), assisted by a Kriging meta-model with infilling, is run in tandem with a RANS solver, to iteratively compute the Pareto front. The optimal design yields ramp angles that are somewhat smaller than the theoretical Oswatitsch values, yet returns a total pressure recovery very close to the Oswatitsch optimum while reducing the intake pressure drag significantly.


title: Simultaneous Computation and Communication over MAC

abstract: We study communication over a Gaussian multiple-access channel (MAC) with two types of transmitters: Digital transmitters hold a message from a discrete set that needs to be communicated to the receiver with vanishing error probability. Analog transmitters hold sequences of analog values, and some functions of these distributed values (but not the values themselves) need to be conveyed to the receiver, subject to a fidelity criterion such as mean squared error (MSE) or a certain maximum error with given confidence. For the case in which the computed function for the analog transmitters is a sum of values in [-1,1], we derive inner and outer bounds for the tradeoff of digital and analog rates of communication under peak and average power constraints for digital transmitters and a peak power constraint for analog transmitters. We then extend the achievability result to a class of functions that includes all linear and some non-linear functions. The practicality of our proposed communication scheme is shown in channel simulations that use a version of the scheme based on low density parity check (LDPC) coding and evaluate the system performance for different block lengths and Gaussian as well as non-Gaussian noise distributions.


title: Enhancing Urban Traffic Safety: An Evaluation on Taipei's Neighborhood Traffic Environment Improvement Program

abstract: In densely populated urban areas, where interactions between pedestrians, vehicles, and motorcycles are frequent and complex, traffic safety is a critical concern. This paper evaluates the Neighborhood Traffic Environment Improvement Program in Taipei, which involved painting green pedestrian paths, adjusting no-parking red/yellow lines, and painting speed limit and stop/slow signs on lanes and alleys. Exploiting staggered rollout of policy implementation and administrative traffic accident data, we found that the program reduced daytime traffic accidents by 5 percent and injuries by 8 percent, while having no significant impact on nighttime incidents. The effectiveness of the program during the day is mainly attributed to the painted green sidewalks, with adequate sunlight playing a part in the program's success. Our findings indicate that cost-effective strategies like green pedestrian lanes can be effective in areas with dense populations and high motorcycle traffic, as they improve safety by encouraging pedestrians to use marked areas and deterring vehicles from these zones.


title: MuSc: Zero-Shot Industrial Anomaly Classification and Segmentation with Mutual Scoring of the Unlabeled Images

abstract: This paper studies zero-shot anomaly classification (AC) and segmentation (AS) in industrial vision. We reveal that the abundant normal and abnormal cues implicit in unlabeled test images can be exploited for anomaly determination, which is ignored by prior methods. Our key observation is that for the industrial product images, the normal image patches could find a relatively large number of similar patches in other unlabeled images, while the abnormal ones only have a few similar patches. We leverage such a discriminative characteristic to design a novel zero-shot AC/AS method by Mutual Scoring (MuSc) of the unlabeled images, which does not need any training or prompts. Specifically, we perform Local Neighborhood Aggregation with Multiple Degrees (LNAMD) to obtain the patch features that are capable of representing anomalies in varying sizes. Then we propose the Mutual Scoring Mechanism (MSM) to leverage the unlabeled test images to assign the anomaly score to each other. Furthermore, we present an optimization approach named Re-scoring with Constrained Image-level Neighborhood (RsCIN) for image-level anomaly classification to suppress the false positives caused by noises in normal images. The superior performance on the challenging MVTec AD and VisA datasets demonstrates the effectiveness of our approach. Compared with the state-of-the-art zero-shot approaches, MuSc achieves a $\textbf{21.1%}$ PRO absolute gain (from 72.7% to 93.8%) on MVTec AD, a $\textbf{19.4%}$ pixel-AP gain and a $\textbf{14.7%}$ pixel-AUROC gain on VisA. In addition, our zero-shot approach outperforms most of the few-shot approaches and is comparable to some one-class methods. Code is available at https://github.com/xrli-U/MuSc.


title: AI Oversight and Human Mistakes: Evidence from Centre Court

abstract: Powered by the increasing predictive capabilities of machine learning algorithms, artificial intelligence (AI) systems have begun to be used to overrule human mistakes in many settings. We provide the first field evidence this AI oversight carries psychological costs that can impact human decision-making. We investigate one of the highest visibility settings in which AI oversight has occurred: the Hawk-Eye review of umpires in top tennis tournaments. We find that umpires lowered their overall mistake rate after the introduction of Hawk-Eye review, in line with rational inattention given psychological costs of being overruled by AI. We also find that umpires increased the rate at which they called balls in, which produced a shift from making Type II errors (calling a ball out when in) to Type I errors (calling a ball in when out). We structurally estimate the psychological costs of being overruled by AI using a model of rational inattentive umpires, and our results suggest that because of these costs, umpires cared twice as much about Type II errors under AI oversight.


title: Diffusion model for relational inference

abstract: Dynamical behaviors of complex interacting systems, including brain activities, financial price movements, and physical collective phenomena, are associated with underlying interactions between the system's components. The issue of uncovering interaction relations in such systems using observable dynamics is called relational inference. In this study, we propose a Diffusion model for Relational Inference (DiffRI), inspired by a self-supervised method for probabilistic time series imputation. DiffRI learns to infer the probability of the presence of connections between components through conditional diffusion modeling.


title: Thermodynamic topology of black Holes in f(R) gravity

abstract: In this work, we study the thermodynamic topology of a static, a charged static and a charged, rotating black hole in $f(R)$ gravity. For charged static black holes, we work in two different ensembles: fixed charge$(q)$ ensemble and fixed potential$(\phi)$ ensemble. For charged, rotating black hole, four different types of ensembles are considered: fixed $(q, J)$, fixed $(\phi, J)$, fixed $(q,\Omega)$ and fixed $(\phi,\Omega)$ ensemble, where $J$ and $\Omega$ denotes the angular momentum and the angular frequency respectively. Using the generalized off-shell free energy method, where the black holes are treated as topological defects in their thermodynamic spaces, we investigate the local and global topology of these black holes via the computation of winding numbers at these defects. For static black hole we work in three model. We find that the topological charge for a static black hole is always $-1$ regardless of the values of the thermodynamic parameters and the choice of $f(R)$ model. For a charged static black hole, in the fixed charge ensemble, the topological charge is found to be zero. Contrastingly, in the fixed $\phi$ ensemble, the topological charge is found to be $-1.$ For charged static black holes, in both the ensembles, the topological charge is observed to be independent of the thermodynamic parameters. For charged, rotating black hole, in fixed $(q, J)$ ensemble, the topological charge is found to be $1.$ In $(\phi, J)$ ensemble, we find the topological charge to be $1.$ In case of fixed $(q,\Omega)$ ensemble, the topological charge is $1$ or $0$ depending on the value of the scalar curvature($R$). In fixed $(\Omega,\phi)$ ensemble, the topological charge is $-1,0$ or $1$ depending on the values of $R,\Omega$ and $\phi.$


title: SwapNet: Efficient Swapping for DNN Inference on Edge AI Devices Beyond the Memory Budget

abstract: Executing deep neural networks (DNNs) on edge artificial intelligence (AI) devices enables various autonomous mobile computing applications. However, the memory budget of edge AI devices restricts the number and complexity of DNNs allowed in such applications. Existing solutions, such as model compression or cloud offloading, reduce the memory footprint of DNN inference at the cost of decreased model accuracy or autonomy. To avoid these drawbacks, we divide DNN into blocks and swap them in and out in order, such that large DNNs can execute within a small memory budget. Nevertheless, naive swapping on edge AI devices induces significant delays due to the redundant memory operations in the DNN development ecosystem for edge AI devices. To this end, we develop SwapNet, an efficient DNN block swapping middleware for edge AI devices. We systematically eliminate the unnecessary memory operations during block swapping while retaining compatible with the deep learning frameworks, GPU backends, and hardware architectures of edge AI devices. We further showcase the utility of SwapNet via a multi-DNN scheduling scheme. Evaluations on eleven DNN inference tasks in three applications demonstrate that SwapNet achieves almost the same latency as the case with sufficient memory even when DNNs demand 2.32x to 5.81x memory beyond the available budget. The design of SwapNet also provides novel and feasible insights for deploying large language models (LLMs) on edge AI devices in the future.


title: Similarity to earthquakes again: periodic radio pulses of the magnetar SGR 1935+2154 are accompanied by aftershocks like fast radio bursts

abstract: It was recently discovered that the time correlations of repeating fast radio bursts (FRBs) are similar to earthquake aftershocks. Motivated by the association between FRBs and magnetars, here we report correlation function analyses in the time-energy space for the 563 periodic radio pulses and the 579 X-ray short bursts from the magnetar SGR 1935+2154, which is known to have generated FRBs. Although radio pulses are concentrated near the fixed phase of the rotational cycle, we find that when multiple pulses occur within a single cycle, their correlation properties (aftershock production probability, aftershock rate decaying in power of time, and more) are similar to those of extragalactic FRBs and earthquakes. A possible interpretation is that the radio pulses are produced by rupture of the neutron star crust, and the first pulse within one cycle is triggered by external force periodically exerted on the crust. The periodic external force may be from the interaction of the magnetosphere with material ejected in an outburst. For X-ray bursts, we found no significant correlation signal, though correlation on the same time scale as radio pulses may be hidden due to the long event duration. The aftershock similarity between the periodic radio pulsation and FRBs is surprising, given that the two are energetically very different, and therefore the energy sources would be different. This suggests that the essence of FRB-like phenomena is starquakes, regardless of the energy source, and it is important to search for FRB-like bursts from neutron stars with various properties or environments.


title: Sandi: A System for Accountability and Applications in Direct Communication

abstract: We construct a system, Sandi, to bring trust in online communication through accountability. Sandi is based on a unique "somewhat monotone" accountability score, with strong privacy and security properties. A registered sender can request from Sandi a cryptographic tag encoding its score. The score measures the sender's trustworthiness based on its previous communications. The tag is sent to a receiver with whom the sender wants to initiate a conversation and signals the sender's "endorsement" for the communication channel. Receivers can use the sender's score to decide how to proceed with the sender. If a receiver finds the sender's communication inappropriate, it can use the tag to report the sender to Sandi, thus decreasing the sender's score. Sandi aims to benefit both senders and receivers. Senders benefit, as receivers are more likely to react to communication on an endorsed channel. Receivers benefit, as they can make better choices regarding who they interact with based on indisputable evidence from prior receivers. Receivers do not need registered accounts. Neither senders nor receivers are required to maintain long-term secret keys. Sandi provides a score integrity guarantee for the senders, a full communication privacy guarantee for the senders and receivers, a reporter privacy guarantee to protect reporting receivers, and an unlinkability guarantee to protect senders. The design of Sandi ensures compatibility with any communication system that allows for small binary data transfer. Finally, we provide a game-theoretic analysis for the sender. We prove that Sandi drives rational senders towards a strategy that reduces the amount of inappropriate communication.


title: One-Step Forward and Backtrack: Overcoming Zig-Zagging in Loss-Aware Quantization Training

abstract: Weight quantization is an effective technique to compress deep neural networks for their deployment on edge devices with limited resources. Traditional loss-aware quantization methods commonly use the quantized gradient to replace the full-precision gradient. However, we discover that the gradient error will lead to an unexpected zig-zagging-like issue in the gradient descent learning procedures, where the gradient directions rapidly oscillate or zig-zag, and such issue seriously slows down the model convergence. Accordingly, this paper proposes a one-step forward and backtrack way for loss-aware quantization to get more accurate and stable gradient direction to defy this issue. During the gradient descent learning, a one-step forward search is designed to find the trial gradient of the next-step, which is adopted to adjust the gradient of current step towards the direction of fast convergence. After that, we backtrack the current step to update the full-precision and quantized weights through the current-step gradient and the trial gradient. A series of theoretical analysis and experiments on benchmark deep models have demonstrated the effectiveness and competitiveness of the proposed method, and our method especially outperforms others on the convergence performance.


title: Quantum metaphotonics: recent advances and perspective

abstract: Quantum metaphotonics has emerged as a cutting-edge subfield of meta-optics employing subwavelength resonators and their planar structures such as metasurfaces to generate, manipulate, and detect quantum states of light. It holds a great potential for the miniaturization of current bulky quantum optical elements by developing a design of on-chip quantum systems for various applications of quantum technologies. Over the past few years, this field has witnessed a surge of intriguing theoretical ideas, groundbreaking experiments, and novel application proposals. This perspective paper aims to summarize the most recent advancements and also provide a perspective on the further progress in this rapidly developing field of research.


title: Pick-and-Draw: Training-free Semantic Guidance for Text-to-Image Personalization

abstract: Diffusion-based text-to-image personalization have achieved great success in generating subjects specified by users among various contexts. Even though, existing finetuning-based methods still suffer from model overfitting, which greatly harms the generative diversity, especially when given subject images are few. To this end, we propose Pick-and-Draw, a training-free semantic guidance approach to boost identity consistency and generative diversity for personalization methods. Our approach consists of two components: appearance picking guidance and layout drawing guidance. As for the former, we construct an appearance palette with visual features from the reference image, where we pick local patterns for generating the specified subject with consistent identity. As for layout drawing, we outline the subject's contour by referring to a generative template from the vanilla diffusion model, and inherit the strong image prior to synthesize diverse contexts according to different text conditions. The proposed approach can be applied to any personalized diffusion models and requires as few as a single reference image. Qualitative and quantitative experiments show that Pick-and-Draw consistently improves identity consistency and generative diversity, pushing the trade-off between subject fidelity and image-text fidelity to a new Pareto frontier.


title: What is a limit of structure-preserving numerical methods for compressible flows?

abstract: We present an overview of recent developments on the convergence analysis of numerical methods for inviscid multidimensional compressible flows that preserve underlying physical structures. We introduce the concept of generalized solutions, the so-called dissipative solutions, and explain their relationship to other commonly used solution concepts. In numerical experiments we apply K-convergence of numerical solutions and approximate turbulent solutions together with the Reynolds stress defect and the energy defect.


title: BoostDream: Efficient Refining for High-Quality Text-to-3D Generation from Multi-View Diffusion

abstract: Witnessing the evolution of text-to-image diffusion models, significant strides have been made in text-to-3D generation. Currently, two primary paradigms dominate the field of text-to-3D: the feed-forward generation solutions, capable of swiftly producing 3D assets but often yielding coarse results, and the Score Distillation Sampling (SDS) based solutions, known for generating high-fidelity 3D assets albeit at a slower pace. The synergistic integration of these methods holds substantial promise for advancing 3D generation techniques. In this paper, we present BoostDream, a highly efficient plug-and-play 3D refining method designed to transform coarse 3D assets into high-quality. The BoostDream framework comprises three distinct processes: (1) We introduce 3D model distillation that fits differentiable representations from the 3D assets obtained through feed-forward generation. (2) A novel multi-view SDS loss is designed, which utilizes a multi-view aware 2D diffusion model to refine the 3D assets. (3) We propose to use prompt and multi-view consistent normal maps as guidance in refinement.Our extensive experiment is conducted on different differentiable 3D representations, revealing that BoostDream excels in generating high-quality 3D assets rapidly, overcoming the Janus problem compared to conventional SDS-based methods. This breakthrough signifies a substantial advancement in both the efficiency and quality of 3D generation processes.


title: A Cross-Language Investigation into Jailbreak Attacks in Large Language Models

abstract: Large Language Models (LLMs) have become increasingly popular for their advanced text generation capabilities across various domains. However, like any software, they face security challenges, including the risk of 'jailbreak' attacks that manipulate LLMs to produce prohibited content. A particularly underexplored area is the Multilingual Jailbreak attack, where malicious questions are translated into various languages to evade safety filters. Currently, there is a lack of comprehensive empirical studies addressing this specific threat. To address this research gap, we conducted an extensive empirical study on Multilingual Jailbreak attacks. We developed a novel semantic-preserving algorithm to create a multilingual jailbreak dataset and conducted an exhaustive evaluation on both widely-used open-source and commercial LLMs, including GPT-4 and LLaMa. Additionally, we performed interpretability analysis to uncover patterns in Multilingual Jailbreak attacks and implemented a fine-tuning mitigation method. Our findings reveal that our mitigation strategy significantly enhances model defense, reducing the attack success rate by 96.2%. This study provides valuable insights into understanding and mitigating Multilingual Jailbreak attacks.


title: Detection and Recovery Against Deep Neural Network Fault Injection Attacks Based on Contrastive Learning

abstract: Deep Neural Network (DNN) models when implemented on executing devices as the inference engines are susceptible to Fault Injection Attacks (FIAs) that manipulate model parameters to disrupt inference execution with disastrous performance. This work introduces Contrastive Learning (CL) of visual representations i.e., a self-supervised learning approach into the deep learning training and inference pipeline to implement DNN inference engines with self-resilience under FIAs. Our proposed CL based FIA Detection and Recovery (CFDR) framework features (i) real-time detection with only a single batch of testing data and (ii) fast recovery effective even with only a small amount of unlabeled testing data. Evaluated with the CIFAR-10 dataset on multiple types of FIAs, our CFDR shows promising detection and recovery effectiveness.


title: Towards Catastrophe theory for Khovanov-Rozansky homology

abstract: We briefly summarise our results on jumps in the analytic formulas for the Khovanov(-Rozansky) polynomials. We conclude from the empiric data that there are ``regular'' and ``weird'' catastrophes, which drastically differ by form of the associated jumps in the Khovanov(-Rozansky) polynomials. This is the first step towards the catastrophe theory for the cohomological knot invariants. In particular, it can be another way to see these quantities as observables in cohomological quantum field theory.


title: The transversal game

abstract: Two players take it turn to claim empty cells from an $n\times n$ grid. The first player (if any) to occupy a transversal (a set of $ n $ cells having no two cells in the same row or column) is the winner. What is the outcome of the game given optimal play? Our aim in this paper is to show that for $n\ge 4$ the first player has a winning strategy. This answers a question of Erickson.


title: Tracing quantum correlations back to collective interferences

abstract: In this paper, we investigate the possibility of explaining nonclassical correlations between two quantum systems in terms of quantum interferences between collective states of the two systems. We achieve this by mapping the relations between different measurement contexts in the product Hilbert space of a pair of two-level systems onto an analogous sequence of interferences between paths in a single-particle interferometer. The relations between different measurement outcomes are then traced to the distribution of probability currents in the interferometer, where paradoxical relations between the outcomes are identified with currents connecting two states that are orthogonal and should therefore exclude each other. We show that the relation between probability currents and correlations can be represented by continuous conditional (quasi)probability currents through the interferometer, given by weak values; the violation of the noncontextual assumption is expressed by negative conditional currents in some of the paths. Since negative conditional currents correspond to the assignment of negative conditional probabilities to measurements results in different measurement contexts, the necessity of such negative probability currents represents a failure of noncontextual local realism. Our results help to explain the meaning of nonlocal correlations in quantum mechanics, and support Feynman's claim that interference is the origin of all quantum phenomena.


title: Heavy-fermions in frustrated Hund's metal with portions of incipient flat-bands

abstract: Flat-bands induced by destructive interference of hoppings in frustrated lattices such as kagome metals, have been extensively studied in recent years since they may lead to strongly correlated phenomena. However, in realistic multiorbital $d$-electron materials, such flat-bands usually appear in small portions of Brillouin zone and are away from Fermi level (dubbed as ``incipient"). Whether such incipient flat-band portions can induce very strong electron correlations is an open question. Here, by density functional theory plus dynamical mean-field theory calculations on the superconducting kagome CsCr$_3$Sb$_5$ and triangular CrB$_2$, we show that the roles of such incipient flat-bands in driving electron correlations can be significantly amplified by Hund's coupling $J_{\text{H}}$ in a Hund's metal. As a result, even moderately $d$-electron heavy-fermions could be induced by enhancing the orbital differentiation and Kondo-like effect of Hund's metals. This provides a flexible route for generating $d$-electron heavy-fermion, and for controllably inducing electron correlations and magnetic fluctuations suitable for emergence of unconventional superconductivity, in frustrated Hund's metals with portions of incipient flat-bands.


title: MolPLA: A Molecular Pretraining Framework for Learning Cores, R-Groups and their Linker Joints

abstract: Molecular core structures and R-groups are essential concepts in drug development. Integration of these concepts with conventional graph pre-training approaches can promote deeper understanding in molecules. We propose MolPLA, a novel pre-training framework that employs masked graph contrastive learning in understanding the underlying decomposable parts inmolecules that implicate their core structure and peripheral R-groups. Furthermore, we formulate an additional framework that grants MolPLA the ability to help chemists find replaceable R-groups in lead optimization scenarios. Experimental results on molecular property prediction show that MolPLA exhibits predictability comparable to current state-of-the-art models. Qualitative analysis implicate that MolPLA is capable of distinguishing core and R-group sub-structures, identifying decomposable regions in molecules and contributing to lead optimization scenarios by rationally suggesting R-group replacements given various query core templates. The code implementation for MolPLA and its pre-trained model checkpoint is available at https://github.com/dmis-lab/MolPLA


title: Extrinsicaly Rewarded Soft Q Imitation Learning with Discriminator

abstract: Imitation learning is often used in addition to reinforcement learning in environments where reward design is difficult or where the reward is sparse, but it is difficult to be able to imitate well in unknown states from a small amount of expert data and sampling data. Supervised learning methods such as Behavioral Cloning do not require sampling data, but usually suffer from distribution shift. The methods based on reinforcement learning, such as inverse reinforcement learning and Generative Adversarial imitation learning (GAIL), can learn from only a few expert data. However, they often need to interact with the environment. Soft Q imitation learning (SQIL) addressed the problems, and it was shown that it could learn efficiently by combining Behavioral Cloning and soft Q-learning with constant rewards. In order to make this algorithm more robust to distribution shift, we propose more efficient and robust algorithm by adding to this method a reward function based on adversarial inverse reinforcement learning that rewards the agent for performing actions in status similar to the demo. We call this algorithm Discriminator Soft Q Imitation Learning (DSQIL). We evaluated it on MuJoCo environments.


title: Driven bright solitons on a mid-infrared laser chip

abstract: Despite the ongoing progress in integrated optical frequency comb technology, compact sources of short bright pulses in the mid-infrared wavelength range from 3 {\mu}m to 12 {\mu}m so far remained beyond reach. The state-of-the-art ultrafast pulse emitters in the mid-infrared are complex, bulky, and inefficient systems based on the downconversion of near-infrared or visible pulsed laser sources. Here we show a purely DC-driven semiconductor laser chip that generates one picosecond solitons at the center wavelength of 8.3 {\mu}m at GHz repetition rates. The soliton generation scheme is akin to that of passive nonlinear Kerr resonators. It relies on a fast bistability in active nonlinear laser resonators, unlike traditional passive mode-locking which relies on saturable absorbers or active mode-locking by gain modulation in semiconductor lasers. Monolithic integration of all components - drive laser, active ring resonator, coupler, and pump filter - enables turnkey generation of bright solitons that remain robust for hours of continuous operation without active stabilization. Such devices can be readily produced at industrial laser foundries using standard fabrication protocols. Our work unifies the physics of active and passive microresonator frequency combs, while simultaneously establishing a technology for nonlinear integrated photonics in the mid-infrared.


title: Contractible subshifts

abstract: We introduce the notion of a contractible subshift. This is a strengthening of the notion of strong irreducibility, where we require that the gluings are given by a block map. We show that a subshift is a retract of a full shift if and only if it is a contractible SFT with a fixed point. For virtually polycyclic groups, contractibility implies dense periodic points. We introduce a ``homotopy theory'' framework for working with this notion, and ``contractibility'' is in fact simply an analog of the usual contractibility in algebraic topology. We also explore the symbolic dynamical analogs of homotopy equivalence and equiconnectedness of subshifts. Contractibility is implied by the map extension property of Meyerovitch, and among SFTs, it implies the finite extension property of Brice\~no, McGoff and Pavlov. We include thorough comparisons with these classes. We also encounter some new group-geometric notions, in particular a periodic variant of Gromov's asymptotic dimension of a group.


title: Activity Detection for Massive Connectivity in Cell-free Networks with Unknown Large-scale Fading, Channel Statistics, Noise Variance, and Activity Probability: A Bayesian Approach

abstract: Activity detection is an important task in the next generation grant-free multiple access. While there are a number of existing algorithms designed for this purpose, they mostly require precise information about the network, such as large-scale fading coefficients, small-scale fading channel statistics, noise variance at the access points, and user activity probability. Acquiring these information would take a significant overhead and their estimated values might not be accurate. This problem is even more severe in cell-free networks as there are many of these parameters to be acquired. Therefore, this paper sets out to investigate the activity detection problem without the above-mentioned information. In order to handle so many unknown parameters, this paper employs the Bayesian approach, where the unknown variables are endowed with prior distributions which effectively act as regularizations. Together with the likelihood function, a maximum a posteriori (MAP) estimator and a variational inference algorithm are derived. Extensive simulations demonstrate that the proposed methods, even without the knowledge of these system parameters, perform better than existing state-of-the-art methods, such as covariance-based and approximate message passing methods.


title: Leveraging Nested MLMC for Sequential Neural Posterior Estimation with Intractable Likelihoods

abstract: Sequential neural posterior estimation (SNPE) techniques have been recently proposed for dealing with simulation-based models with intractable likelihoods. They are devoted to learning the posterior from adaptively proposed simulations using neural network-based conditional density estimators. As a SNPE technique, the automatic posterior transformation (APT) method proposed by Greenberg et al. (2019) performs notably and scales to high dimensional data. However, the APT method bears the computation of an expectation of the logarithm of an intractable normalizing constant, i.e., a nested expectation. Although atomic APT was proposed to solve this by discretizing the normalizing constant, it remains challenging to analyze the convergence of learning. In this paper, we propose a nested APT method to estimate the involved nested expectation instead. This facilitates establishing the convergence analysis. Since the nested estimators for the loss function and its gradient are biased, we make use of unbiased multi-level Monte Carlo (MLMC) estimators for debiasing. To further reduce the excessive variance of the unbiased estimators, this paper also develops some truncated MLMC estimators by taking account of the trade-off between the bias and the average cost. Numerical experiments for approximating complex posteriors with multimodal in moderate dimensions are provided.


title: Addressing Distribution Shift in Time Series Forecasting with Instance Normalization Flows

abstract: Due to non-stationarity of time series, the distribution shift problem largely hinders the performance of time series forecasting. Existing solutions either fail for the shifts beyond simple statistics or the limited compatibility with forecasting models. In this paper, we propose a general decoupled formulation for time series forecasting, with no reliance on fixed statistics and no restriction on forecasting architectures. Then, we make such a formulation formalized into a bi-level optimization problem, to enable the joint learning of the transformation (outer loop) and forecasting (inner loop). Moreover, the special requirements of expressiveness and bi-direction for the transformation motivate us to propose instance normalization flows (IN-Flow), a novel invertible network for time series transformation. Extensive experiments demonstrate our method consistently outperforms state-of-the-art baselines on both synthetic and real-world data.


title: Secure ISAC MIMO Systems: Exploiting Interference With Bayesian Cram\'er-Rao Bound Optimization

abstract: In this paper, we present a signaling design for secure integrated sensing and communication (ISAC) systems comprising a dual-functional multi-input multi-output (MIMO) base station (BS) that simultaneously communicates with multiple users while detecting targets present in their vicinity, which are regarded as potential eavesdroppers. In particular, assuming that the distribution of each parameter to be estimated is known \textit{a priori}, we focus on optimizing the targets' sensing performance. To this end, we derive and minimize the Bayesian Cram\'er-Rao bound (BCRB), while ensuring certain communication quality of service (QoS) by exploiting constructive interference (CI). The latter scheme enforces that the received signals at the eavesdropping targets fall into the destructive region of the signal constellation, to deteriorate their decoding probability, thus enhancing the ISAC's system physical-layer security (PLS) capability. To tackle the nonconvexity of the formulated problem, a tailored successive convex approximation method is proposed for its efficient solution. Our extensive numerical results verify the effectiveness of the proposed secure ISAC design showing that the proposed algorithm outperforms block-level precoding techniques.


title: All-optical complex field imaging using diffractive processors

abstract: Complex field imaging, which captures both the amplitude and phase information of input optical fields or objects, can offer rich structural insights into samples, such as their absorption and refractive index distributions. However, conventional image sensors are intensity-based and inherently lack the capability to directly measure the phase distribution of a field. This limitation can be overcome using interferometric or holographic methods, often supplemented by iterative phase retrieval algorithms, leading to a considerable increase in hardware complexity and computational demand. Here, we present a complex field imager design that enables snapshot imaging of both the amplitude and quantitative phase information of input fields using an intensity-based sensor array without any digital processing. Our design utilizes successive deep learning-optimized diffractive surfaces that are structured to collectively modulate the input complex field, forming two independent imaging channels that perform amplitude-to-amplitude and phase-to-intensity transformations between the input and output planes within a compact optical design, axially spanning ~100 wavelengths. The intensity distributions of the output fields at these two channels on the sensor plane directly correspond to the amplitude and quantitative phase profiles of the input complex field, eliminating the need for any digital image reconstruction algorithms. We experimentally validated the efficacy of our complex field diffractive imager designs through 3D-printed prototypes operating at the terahertz spectrum, with the output amplitude and phase channel images closely aligning with our numerical simulations. We envision that this complex field imager will have various applications in security, biomedical imaging, sensing and material science, among others.


title: Long-term X-ray temporal and spectral study of a Seyfert galaxy Mrk 6

abstract: We present a long-term X-ray study of a nearby Active Galactic Nucleus Mrk 6, utilizing observations from XMM-Newton, Suzaku, Swift and NuSTAR observatories, spanning 22 years from 2001 to 2022. From timing analysis, we estimated variance, normalized variance, and fractional rms amplitude in different energy bands.The temporal study shows fractional rms amplitude ($F_{\rm var}$) below $10\%$ for the shorter timescale $(\sim60 ~\rm ks)$ and above $20\%$ for the longer timescale ($\sim \rm weeks$ ). A complex correlation is observed between the soft $(0.5-3.0$ keV) and hard $(3.0-10.0$ keV) X-ray bands of different epochs of observations. This result prompts a detailed investigation through spectral analysis, employing various phenomenological and physical models on the X-ray spectra. Our analysis reveals a heterogeneous structure of the obscuring material surrounding Mrk 6. A partially ionized absorber exhibits a rapid change in location and extends up to the narrow line regions or torus. In contrast, another component, located far from the central engine, remained relatively stable. During the observation period, the source luminosity in the 3.0--10.0 keV range varies between $(3-15) \times10^{42}$ erg $\rm sec^{-1}$.


title: Passive environment-assisted quantum transduction with GKP states

abstract: Quantum transducers convert quantum signals from one carrier to another through hybrid interfaces of physical systems. For a quantum transducer between two bosonic modes, direct quantum transduction without shared entanglement or classical communication typically requires a conversion efficiency exceeding 0.5 which is challenging for current experiments. We propose the passive environment-assisted quantum transduction to overcome this stringent requirement. Without internal losses, the quantum transducer realizes a beam splitter unitary between two modes. The added noises to the transduction process from mode 1 to mode 2 is determined by the initial state of mode 2, which can be engineered to enhance the transduction performance. We find that by choosing the ideal Gottesman-Kitaev-Preskill (GKP) states as the initial states of both modes, perfect quantum transduction can be achieved at arbitrarily low conversion efficiencies. In practice, it is crucial to also consider the finite energy constraints and high fidelity quantum transduction remains achievable with GKP states at the few-photon level.


title: A Literature Review on Fetus Brain Motion Correction in MRI

abstract: This paper provides a comprehensive review of the latest advancements in fetal motion correction in MRI. We delve into various contemporary methodologies and technological advancements aimed at overcoming these challenges. It includes traditional 3D fetal MRI correction methods like Slice to Volume Registration (SVR), deep learning-based techniques such as Convolutional Neural Networks (CNNs), Long Short-Term Memory (LSTM) Networks, Transformers, Generative Adversarial Networks (GANs) and most recent advancements of Diffusion Models. The insights derived from this literature review reflect a thorough understanding of both the technical intricacies and practical implications of fetal motion in MRI studies, offering a reasoned perspective on potential solutions and future improvements in this field.


title: The Circular Polarization Reverse in Magnetar Bursts

abstract: Magnetars, whose magnetic fields are strongest in the neutron stars, show diverse bursting activities. The shape of the magnetar deviates from an exactly pure spherical shape because of its strong magnetic field, and it can be a triaxial body. We study the free precession of the triaxial magnetar focusing on the unstable situation, in which the main rotation axis turns upside-down. This flip is the so-called Dzhanibekov effect. We find that during the flip, the Euler force can suddenly disturb the force balance on the magnetar surface, which may result in a crack at the surface. We suggest that the crack can trigger bursting activities of the magnetar, such as X-ray short bursts and flares with sufficiently large baryon fractions. In the burst with a large baryon fraction, right- or left-handed circularly polarized photons are selectively scattered, depending on the magnetic field direction. The association between the flip and the X-ray bursts will be confirmed by the observations of X-ray circular polarization. We also discuss the association of fast radio bursts, ultrahigh-energy cosmic rays, and gravitational waves.


title: Graph Fairness Learning under Distribution Shifts

abstract: Graph neural networks (GNNs) have achieved remarkable performance on graph-structured data. However, GNNs may inherit prejudice from the training data and make discriminatory predictions based on sensitive attributes, such as gender and race. Recently, there has been an increasing interest in ensuring fairness on GNNs, but all of them are under the assumption that the training and testing data are under the same distribution, i.e., training data and testing data are from the same graph. Will graph fairness performance decrease under distribution shifts? How does distribution shifts affect graph fairness learning? All these open questions are largely unexplored from a theoretical perspective. To answer these questions, we first theoretically identify the factors that determine bias on a graph. Subsequently, we explore the factors influencing fairness on testing graphs, with a noteworthy factor being the representation distances of certain groups between the training and testing graph. Motivated by our theoretical analysis, we propose our framework FatraGNN. Specifically, to guarantee fairness performance on unknown testing graphs, we propose a graph generator to produce numerous graphs with significant bias and under different distributions. Then we minimize the representation distances for each certain group between the training graph and generated graphs. This empowers our model to achieve high classification and fairness performance even on generated graphs with significant bias, thereby effectively handling unknown testing graphs. Experiments on real-world and semi-synthetic datasets demonstrate the effectiveness of our model in terms of both accuracy and fairness.


title: HawkEye: Advancing Robust Regression with Bounded, Smooth, and Insensitive Loss Function

abstract: Support vector regression (SVR) has garnered significant popularity over the past two decades owing to its wide range of applications across various fields. Despite its versatility, SVR encounters challenges when confronted with outliers and noise, primarily due to the use of the $\varepsilon$-insensitive loss function. To address this limitation, SVR with bounded loss functions has emerged as an appealing alternative, offering enhanced generalization performance and robustness. Notably, recent developments focus on designing bounded loss functions with smooth characteristics, facilitating the adoption of gradient-based optimization algorithms. However, it's crucial to highlight that these bounded and smooth loss functions do not possess an insensitive zone. In this paper, we address the aforementioned constraints by introducing a novel symmetric loss function named the HawkEye loss function. It is worth noting that the HawkEye loss function stands out as the first loss function in SVR literature to be bounded, smooth, and simultaneously possess an insensitive zone. Leveraging this breakthrough, we integrate the HawkEye loss function into the least squares framework of SVR and yield a new fast and robust model termed HE-LSSVR. The optimization problem inherent to HE-LSSVR is addressed by harnessing the adaptive moment estimation (Adam) algorithm, known for its adaptive learning rate and efficacy in handling large-scale problems. To our knowledge, this is the first time Adam has been employed to solve an SVR problem. To empirically validate the proposed HE-LSSVR model, we evaluate it on UCI, synthetic, and time series datasets. The experimental outcomes unequivocally reveal the superiority of the HE-LSSVR model both in terms of its remarkable generalization performance and its efficiency in training time.


title: WikiTexVC: MediaWiki's native LaTeX to MathML converter for Wikipedia

abstract: MediaWiki and Wikipedia authors usually use LaTeX to define mathematical formulas in the wiki text markup. In the Wikimedia ecosystem, these formulas were processed by a long cascade of web services and finally delivered to users' browsers in rendered form for visually readable representation as SVG. With the latest developments of supporting MathML Core in Chromium-based browsers, MathML continues its path to be a de facto standard markup language for mathematical notation in the web. Conveying formulas in MathML enables semantic annotation and machine readability for extended interpretation of mathematical content, in example for accessibility technologies. With this work, we present WikiTexVC, a novel method for validating LaTeX formulas from wiki texts and converting them to MathML, which is directly integrated into MediaWiki. This mitigates the shortcomings of previously used rendering methods in MediaWiki in terms of robustness, maintainability and performance. In addition, there is no need for a multitude of web services running in the background, but processing takes place directly within MediaWiki instances. We validated this method with an extended dataset of over 300k formulas which have been incorporated as automated tests to the MediaWiki continuous integration instances. Furthermore, we conducted an evaluation with 423 formulas, comparing the tree edit distance for produced parse trees to other MathML renderers. Our method has been made available Open Source and can be used on German Wikipedia and is delivered with recent MediaWiki versions. As a practical example of enabling semantic annotations within our method, we present a new macro that adds content to formula disambiguation to facilitate accessibility for visually impaired people.


title: The G\^ateaux derivative of the curvilinear boundary crossing probability of a diffusion process

abstract: For a general time-inhomogenous diffusion process $X$ and a boundary function $g,$ we analyse the probability $F(g)$ that $X$ stays beneath the boundary $g$ during a given finite time interval. We prove that, for $g \in C^2,$ the functional $F(g)$ is G\^ateaux-differentiable in directions $h \in H \cup C^2,$ where $H$ is the Cameron--Martin space, and derive a compact representation for the derivative of $F$. It is shown that, in the time-homogenous case, this representation coincides with the representation in terms of Brownian meander functionals obtained in this special case by Borovkov & Downes (2010). Our results can be useful when approximating $F(g)$ with computable values $F(\widehat{g})$ for special boundaries $\widehat{g}$ that are close to $g.$ We also obtain auxiliary results that can be of independent interest as well: (i)~a probabilistic expression for the limiting spatial derivative of the boundary crossing probability with respect to the initial value of the process, as the initial value approaches the boundary, and (ii) a martingale representation for the indicator of the boundary non-crossing event for time-dependent boundaries.


title: Can Large Language Models be Trusted for Evaluation? Scalable Meta-Evaluation of LLMs as Evaluators via Agent Debate

abstract: Despite the utility of Large Language Models (LLMs) across a wide range of tasks and scenarios, developing a method for reliably evaluating LLMs across varied contexts continues to be challenging. Modern evaluation approaches often use LLMs to assess responses generated by LLMs. However, the meta-evaluation conducted to assess the effectiveness of these LLMs as evaluators is typically constrained by the coverage of existing benchmarks or requires extensive human annotation. This underscores the urgency of methods for scalable meta-evaluation that can effectively, reliably, and efficiently evaluate the performance of LLMs as evaluators across diverse tasks and scenarios, particularly in potentially new, user-defined scenarios. To fill this gap, we propose ScaleEval, an agent-debate-assisted meta-evaluation framework that leverages the capabilities of multiple communicative LLM agents. This framework supports multi-round discussions to assist human annotators in discerning the most capable LLMs as evaluators, which significantly eases their workload in cases that used to require large-scale annotations during meta-evaluation. We release the code for our framework, which is publicly available at: \url{https://github.com/GAIR-NLP/scaleeval}.


title: Analysis of Time-Evolution of Gaussian Wavepackets in Non-Hermitian Systems

abstract: Simulation and analysis of multidimensional dynamics of a quantum non-Hmeritian system is a challenging problem. Gaussian wavepacket dynamics has proven to be an intuitive semiclassical approach to approximately solving the dynamics of quantum systems. A Gaussian wavepacket approach is proposed for a continuous space extension to the Hatano-Nelson model that enables transparent analysis of the dynamics in terms of complex classical trajectories. We demonstrate certain cases where the configuration space trajectory can be made fully real by transforming the initial conditions to account for the non-Hermiticity appropriately through the momentum coordinates. However, in general the complex phase space is unavoidable. For the cases where the trajectory is real, the effective force can be decomposed into that due to the potential energy surface and that due to the imaginary vector potential. The impact of the vector potential on the trajectory of the wavepacket is directly proportional to both the strength of the vector potential and the width of the wavepacket.


title: Forms of biisometric operators and biorthogonality

abstract: The paper proves two results involving a pair (A,B) of P-biisometric or (m,P)-biisometric Hilbert-space operators for arbitrary positive integer m and positive operator P. It is shown that if A and B are power bounded and the pair (A,B) is (m,P)-biisometric for some m, then it is a P-biisometric pair. The important case when P is invertible is treated in detail. It is also shown that if (A,B) is P-biisometric, then there are biorthogonal sequences with respect to the inner product <.;.>_P=<P.;.> that have a shift-like behaviour with respect to this inner product.


title: Accelerated Cloud for Artificial Intelligence (ACAI)

abstract: Training an effective Machine learning (ML) model is an iterative process that requires effort in multiple dimensions. Vertically, a single pipeline typically includes an initial ETL (Extract, Transform, Load) of raw datasets, a model training stage, and an evaluation stage where the practitioners obtain statistics of the model performance. Horizontally, many such pipelines may be required to find the best model within a search space of model configurations. Many practitioners resort to maintaining logs manually and writing simple glue code to automate the workflow. However, carrying out this process on the cloud is not a trivial task in terms of resource provisioning, data management, and bookkeeping of job histories to make sure the results are reproducible. We propose an end-to-end cloud-based machine learning platform, Accelerated Cloud for AI (ACAI), to help improve the productivity of ML practitioners. ACAI achieves this goal by enabling cloud-based storage of indexed, labeled, and searchable data, as well as automatic resource provisioning, job scheduling, and experiment tracking. Specifically, ACAI provides practitioners (1) a data lake for storing versioned datasets and their corresponding metadata, and (2) an execution engine for executing ML jobs on the cloud with automatic resource provisioning (auto-provision), logging and provenance tracking. To evaluate ACAI, we test the efficacy of our auto-provisioner on the MNIST handwritten digit classification task, and we study the usability of our system using experiments and interviews. We show that our auto-provisioner produces a 1.7x speed-up and 39% cost reduction, and our system reduces experiment time for ML scientists by 20% on typical ML use cases.


title: WideSA: A High Array Utilization Mapping Scheme for Uniform Recurrences on the Versal ACAP Architecture

abstract: The Versal Adaptive Compute Acceleration Platform (ACAP) is a new architecture that combines AI Engines (AIEs) with reconfigurable fabric. This architecture offers significant acceleration potential for uniform recurrences in various domains, such as deep learning, high-performance computation, and signal processing. However, efficiently mapping these computations onto the Versal ACAP architecture while achieving high utilization of AIEs poses a challenge. To address this issue, we propose a mapping scheme called \fname, which aims to accelerate uniform recurrences on the Versal ACAP architecture by leveraging the features of both the hardware and the computations. Considering the array architecture of AIEs, our approach utilizes space-time transformations based on the polyhedral model to generate legally optimized systolic array mappings. Concurrently, we have developed a routing-aware PLIO assignment algorithm tailored for communication on the AIE array, and the algorithm aims at successful compilation while maximizing array utilization. Furthermore, we introduce an automatic mapping framework. This framework is designed to generate the corresponding executable code for uniform recurrences, which encompasses the AIE kernel program, programmable logic bitstreams, and the host program. The experimental results validate the effectiveness of our mapping scheme. Specifically, when applying our scheme to matrix multiplication computations on the VCK5000 board, we achieve a throughput of 4.15TOPS on float data type, which is 1.11$\times$ higher compared to the state-of-the-art accelerator on the Versal ACAP architecture.


title: On the Stability of Datatic Control Systems

abstract: The development of feedback controllers is undergoing a paradigm shift from $\textit{modelic}$ (model-driven) control to $\textit{datatic}$ (data-driven) control. Stability, as a fundamental property in control, is less well studied in datatic control paradigm. The difficulty is that traditional stability criteria rely on explicit system models, which are not available in those systems with datatic description. Some pioneering works explore stability criteria for datatic systems with special forms such as linear systems, homogeneous systems, and polynomial systems. However, these systems imply too strong assumptions on the inherent connection among data points, which do not hold in general nonlinear systems. This paper proposes a stability verification algorithm for general datatic control systems called $\eta$-testing. Our stability criterion only relies on a weak assumption of Lipschitz continuity so as to extend information from known data points to unmeasured regions. This information restricts the time derivative of any unknown state to the intersection of a set of closed balls. Inside the intersection, the worst-case time derivative of Lyapunov function is estimated by solving a quadratically constrained linear program (QCLP). By comparing the optimal values of QCLPs to zero in the whole state space, a sufficient condition of system stability can be checked. We test our algorithm on three datatic control systems, including both linear and nonlinear ones. Results show that our algorithm successfully verifies the stability, instability, and critical stability of tested systems.


title: Simulation aspects of patterning polymer films via evaporative lithography and composite substrates

abstract: The continuing development of evaporative lithography is important for many areas such as the creation of photonic crystals for optronics and microelectronics, the development of biosensors for medical applications and biotechnology, and for the formation of functional coatings for nanotechnology, including the application of thin, protective polymer coatings. The article proposes a mathematical model that allows us to explain the basic mechanisms of the formation of thin polymer films (less than 50 $\mu$m thick) during their deposition onto a composite substrate by methanol evaporation from a solution. If the thermal conductivity of the substrate is spatially non-uniform, this results in inhomogeneous evaporation along the free film surface. Therefore, as the film dries, a patterned polymer coating is left behind on the substrate. The mathematical model described here is based on the lubrication approximation and takes into account the dependence of the solution density on the concentration. The numerical computation results are in qualitative agreement with the experimental data of other authors. The article shows that solutal Marangoni flow plays a primary role in the process under consideration. This study allows us to better understand the mechanisms that can be used in evaporative lithography.


title: Performance Insights-based AI-driven Football Transfer Fee Prediction

abstract: We developed an artificial intelligence approach to predict the transfer fee of a football player. This model can help clubs make better decisions about which players to buy and sell, which can lead to improved performance and increased club budgets. Having collected data on player performance, transfer fees, and other factors that might affect a player's value, we then used this data to train a machine learning model that can accurately predict a player's impact on the game. We further passed the obtained results as one of the features to the predictor of transfer fees. The model can help clubs identify players who are undervalued and who could be sold for a profit. It can also help clubs avoid overpaying for players. We believe that our model can be a valuable tool for football clubs. It can help them make better decisions about player recruitment and transfers.


title: Learnable Prompt as Pseudo-Imputation: Reassessing the Necessity of Traditional EHR Data Imputation in Downstream Clinical Prediction

abstract: Analyzing the health status of patients based on Electronic Health Records (EHR) is a fundamental research problem in medical informatics. The presence of extensive missing values in EHR makes it challenging for deep neural networks to directly model the patient's health status based on EHR. Existing deep learning training protocols require the use of statistical information or imputation models to reconstruct missing values; however, the protocols inject non-realistic data into downstream EHR analysis models, significantly limiting model performance. This paper introduces Learnable Prompt as Pseudo Imputation (PAI) as a new training protocol. PAI no longer introduces any imputed data but constructs a learnable prompt to model the implicit preferences of the downstream model for missing values, resulting in a significant performance improvement for all EHR analysis models. Additionally, our experiments show that PAI exhibits higher robustness in situations of data insufficiency and high missing rates. More importantly, in a real-world application involving cross-institutional data with zero-shot evaluation, PAI demonstrates stronger model generalization capabilities for non-overlapping features.


title: Enhancing Translation Validation of Compiler Transformations with Large Language Models

abstract: This paper presents a framework that integrates Large Language Models (LLMs) into translation validation, targeting LLVM compiler transformations where formal verification tools fall short. Our framework first utilizes existing formal verification tools for translation validation. In this work, we use Alive2, a well-known tool in LLVM compiler verification, as an example. When formal verification tools are unable to confirm a transformation's soundness, our framework employs fine-tuned LLMs for prediction. It then applies fuzzing to transformations predicted as potentially unsound by the LLMs due to return values or memory inconsistencies, aiming to find counterexamples. In cases where transformations are unsound for other reasons or sound, or if no counterexamples emerge, the framework directly reports these outcomes without further fuzzing. This methodology has shown effectiveness in complex application such as deep-learning accelerator designs, where traditional formal verification tools struggle.


title: The Activity of Black Hole Imprints on the Internal Plateau and the Subsequent Sharp Decay

abstract: A stellar-mass black hole (BH) or a millisecond magnetar is believed to be born as the central engine of Gamma-ray bursts (GRBs). The presence of plateaus in the X-ray extended emission or afterglow of GRBs is widely accepted as an indicator of magnetar central engine, particularly those with a sharp decay (faster than $t^{-3}$), so-called internal plateau. However, an alternative model, by taking the evolution of the magnetic flux at the BH horizon into account, suggests that an internal plateau can also arise from a Blandford-Znajek (BZ) mechanism powered jet (hereafter referred to as the BZ jet). In this study, we propose that a precessional BZ jet would manifest a Quasi-Periodic Oscillation (QPO) signature on the internal plateau and the subsequent sharp decay. Such lightcurves cannot be readily explained by the activity of a short-lived, supermassive magnetar, thus favoring a Kerr BH as the central engine. The X-ray afterglow of GRB 050904, comprising nine flares, is characterized by a QPO-modulated plateau and sharp decay, which can be well reproduced by a precessional BZ jet model. Therefore, one potential clue for distinguishing between these two engines lies in whether QPO signature throughout the entire plateau and the subsequent sharp decay, as the magnetar scenario suggests a collapse at the end of the plateau.


title: Scattering of ultrashort electron wave packets: optical theorem, differential phase contrast and angular asymmetries

abstract: Recent advances in electron microscopy allowed the generation of high-energy electron wave packets of ultrashort duration. Here we present a non-perturbative S-matrix theory for scattering of ultrashort electron wave packets by atomic targets. We apply the formalism to a case of elastic scattering and derive a generalized optical theorem for ultrashort wave-packet scattering. By numerical simulations with 1-fs wave packets, we find in angular distributions of electrons on a detector one-fold and anomalous two-fold azimuthal asymmetries. We discuss how the asymmetries relate to the coherence properties of the electron beam, and to the magnitude and phase of the scattering amplitude. The essential role of the phase of the exact scattering amplitude is revealed by comparison with results obtained using the first-Born approximation. Our work paves a way for controlling electron-matter interaction by the lateral and transversal coherence properties of pulsed electron beams.


title: Online Algorithm for Node Feature Forecasting in Temporal Graphs

abstract: In this paper, we propose an online algorithm mspace for forecasting node features in temporal graphs, which captures spatial cross-correlation among different nodes as well as the temporal auto-correlation within a node. The algorithm can be used for both probabilistic and deterministic multi-step forecasting, making it applicable for estimation and generation tasks. Comparative evaluations against various baselines, including temporal graph neural network (TGNN) models and classical Kalman filters, demonstrate that mspace performs at par with the state-of-the-art and even surpasses them on some datasets. Importantly, mspace demonstrates consistent performance across datasets with varying training sizes, a notable advantage over TGNN models that require abundant training samples to effectively learn the spatiotemporal trends in the data. Therefore, employing mspace is advantageous in scenarios where the training sample availability is limited. Additionally, we establish theoretical bounds on multi-step forecasting error of mspace and show that it scales linearly with the number of forecast steps $q$ as $\mathcal{O}(q)$. For an asymptotically large number of nodes $n$, and timesteps $T$, the computational complexity of mspace grows linearly with both $n$, and $T$, i.e., $\mathcal{O}(nT)$, while its space complexity remains constant $\mathcal{O}(1)$. We compare the performance of various mspace variants against ten recent TGNN baselines and two classical baselines, ARIMA and the Kalman filter across ten real-world datasets. Additionally, we propose a technique to generate synthetic datasets to aid in evaluating node feature forecasting methods, with the potential to serve as a benchmark for future research. Lastly, we have investigate the interpretability of different mspace variants by analyzing model parameters alongside dataset characteristics to derive model and data-centric insights.


title: Kinematic Optimization of a Robotic Arm for Automation Tasks with Human Demonstration

abstract: Robotic arms are highly common in various automation processes such as manufacturing lines. However, these highly capable robots are usually degraded to simple repetitive tasks such as pick-and-place. On the other hand, designing an optimal robot for one specific task consumes large resources of engineering time and costs. In this paper, we propose a novel concept for optimizing the fitness of a robotic arm to perform a specific task based on human demonstration. Fitness of a robot arm is a measure of its ability to follow recorded human arm and hand paths. The optimization is conducted using a modified variant of the Particle Swarm Optimization for the robot design problem. In the proposed approach, we generate an optimal robot design along with the required path to complete the task. The approach could reduce the time-to-market of robotic arms and enable the standardization of modular robotic parts. Novice users could easily apply a minimal robot arm to various tasks. Two test cases of common manufacturing tasks are presented yielding optimal designs and reduced computational effort by up to 92%.


title: Kinesthetic-based In-Hand Object Recognition with an Underactuated Robotic Hand

abstract: Tendon-based underactuated hands are intended to be simple, compliant and affordable. Often, they are 3D printed and do not include tactile sensors. Hence, performing in-hand object recognition with direct touch sensing is not feasible. Adding tactile sensors can complicate the hardware and introduce extra costs to the robotic hand. Also, the common approach of visual perception may not be available due to occlusions. In this paper, we explore whether kinesthetic haptics can provide in-direct information regarding the geometry of a grasped object during in-hand manipulation with an underactuated hand. By solely sensing actuator positions and torques over a period of time during motion, we show that a classifier can recognize an object from a set of trained ones with a high success rate of almost 95%. In addition, the implementation of a real-time majority vote during manipulation further improves recognition. Additionally, a trained classifier is also shown to be successful in distinguishing between shape categories rather than just specific objects.


title: PBSCSR: The Piano Bootleg Score Composer Style Recognition Dataset

abstract: This article motivates, describes, and presents the PBSCSR dataset for studying composer style recognition of piano sheet music. Our overarching goal was to create a dataset for studying composer style recognition that is "as accessible as MNIST and as challenging as ImageNet". To achieve this goal, we use a previously proposed feature representation of sheet music called a bootleg score, which encodes the position of noteheads relative to the staff lines. Using this representation, we sample fixed-length bootleg score fragments from piano sheet music images on IMSLP. The dataset itself contains 40,000 62x64 bootleg score images for a 9-way classification task, 100,000 62x64 bootleg score images for a 100-way classification task, and 29,310 unlabeled variable-length bootleg score images for pretraining. The labeled data is presented in a form that mirrors MNIST images, in order to make it extremely easy to visualize, manipulate, and train models in an efficient manner. Additionally, we include relevant metadata to allow access to the underlying raw sheet music images and other related data on IMSLP. We describe several research tasks that could be studied with the dataset, including variations of composer style recognition in a few-shot or zero-shot setting. For tasks that have previously proposed models, we release code and baseline results for future works to compare against. We also discuss open research questions that the PBSCSR data is especially well suited to facilitate research on and areas of fruitful exploration in future work.


title: Guessing What, Noise or Codeword?

abstract: In this paper, we distinguish two guessing algorithms for decoding binary linear codes. One is the guessing noise decoding (GND) algorithm, and the other is the guessing codeword decoding (GCD) algorithm. We prove that the GCD is a maximum likelihood (ML) decoding algorithm and that the GCD is more efficient than GND for most practical applications. We also introduce several variants of ordered statistic decoding (OSD) to trade off the complexity of the Gaussian elimination (GE) and that of the guessing, which may find applications in decoding short block codes in the high signal-to-noise ratio (SNR) region.


title: Accurate and efficient prediction of the band gaps and optical spectra of chalcopyrite semiconductors from a non-empirical range-separated dielectric-dependent hybrid: Comparison with many-body perturbation theory

abstract: The accurate prediction of electronic and optical properties in chalcopyrite semiconductors has been a persistent challenge for density functional theory (DFT) based approaches. Addressing this issue, we demonstrate that very accurate results can be obtained using a non-empirical screened dielectric-dependent hybrid (DDH) functional. This novel approach showcases its impressive capability to accurately determine band gaps, optical bowing parameters, and optical absorption spectra for chalcopyrite systems. What sets the screened DDH functional apart is its adeptness in capturing the many-body physics associated with highly localized $d$ electrons. Notably, the accuracy is comparable to the many-body perturbation based methods (such as $G_0W_0$ or its various approximations for band gaps and Bethe-Salpeter equation (BSE) on the top of the $G_0W_0$ or its various approximations for optical spectra) with less computational cost, ensuring a more accessible application across various research domains. The present results show the predictive power of the screened DDH functional, pointing toward promising applications where computational efficiency and predictive accuracy are crucial considerations. Overall, the screened DDH functional offers a compelling balance between cost-effectiveness and precision, making it a valuable tool for future endeavors in exploring chalcopyrite semiconductors and beyond.


title: Vanadium-Doped Molybdenum Disulfide Monolayers with Tunable Electronic and Magnetic Properties: Do Vanadium-Vacancy Pairs Matter?

abstract: Monolayers of molybdenum disulfide (MoS2) are the most studied two-dimensional (2D) transition-metal dichalcogenides (TMDs), due to its exceptional optical, electronic, and opto-electronic properties. Recent studies have shown the possibility of incorporating a small amount of magnetic transition metals (e.g., Fe, Co, Mn, V) into MoS2 to form a 2D dilute magnetic semiconductor (2D-DMS). However, the origin of the observed ferromagnetism has remained elusive, due to the presence of randomly generated sulfur vacancies during synthesis that can pair with magnetic dopants to form complex dopant-vacancy configurations altering the magnetic order induced by the dopants. By combining high-angle annular dark-field scanning transmission electron microscopy (HAADF-STEM) imaging with first-principles density functional theory (DFT) calculations and magnetometry data, we demonstrate the critical effects of sulfur vacancies and their pairings with vanadium atoms on the magnetic ordering in V-doped MoS2 (V-MoS2) monolayers. Additionally, we fabricated a series of field effect transistors on these V-MoS2 monolayers and observed the emergence of p-type behavior as the vanadium concentration increased. Our study sheds light on the origin of ferromagnetism in V-MoS2 monolayers and provides a foundation for future research on defect engineering to tune the electronic and magnetic properties of atomically thin TMD-based DMSs.


title: Detecting LLM-Assisted Writing in Scientific Communication: Are We There Yet?

abstract: Large Language Models (LLMs), exemplified by ChatGPT, have significantly reshaped text generation, particularly in the realm of writing assistance. While ethical considerations underscore the importance of transparently acknowledging LLM use, especially in scientific communication, genuine acknowledgment remains infrequent. A potential avenue to encourage accurate acknowledging of LLM-assisted writing involves employing automated detectors. Our evaluation of four cutting-edge LLM-generated text detectors reveals their suboptimal performance compared to a simple ad-hoc detector designed to identify abrupt writing style changes around the time of LLM proliferation. We contend that the development of specialized detectors exclusively dedicated to LLM-assisted writing detection is necessary. Such detectors could play a crucial role in fostering more authentic recognition of LLM involvement in scientific communication, addressing the current challenges in acknowledgment practices.


title: Encoding Temporal Statistical-space Priors via Augmented Representation

abstract: Modeling time series data remains a pervasive issue as the temporal dimension is inherent to numerous domains. Despite significant strides in time series forecasting, high noise-to-signal ratio, non-normality, non-stationarity, and lack of data continue challenging practitioners. In response, we leverage a simple representation augmentation technique to overcome these challenges. Our augmented representation acts as a statistical-space prior encoded at each time step. In response, we name our method Statistical-space Augmented Representation (SSAR). The underlying high-dimensional data-generating process inspires our representation augmentation. We rigorously examine the empirical generalization performance on two data sets with two downstream temporal learning algorithms. Our approach significantly beats all five up-to-date baselines. Moreover, the highly modular nature of our approach can easily be applied to various settings. Lastly, fully-fledged theoretical perspectives are available throughout the writing for a clear and rigorous understanding.


title: Quantum entanglement transfer assisted via Duffing nonlinearity

abstract: We propose a scheme to enhance quantum entanglement in an optomechanical system by exploiting the so-called Duffing nonlinearity. Our model system consists of two mechanically coupled mechanical resonators, both driven by an optical field. One resonator supports Duffing nonlinearity, while the other does not. The resonators are coupled to each other via the so-called phonon hopping mechanism. The hopping rate is $\theta$-phase-dependent that induces Exceptional Points (EPs) singularities in the system. Interestingly, while the resonator with Duffing nonlinearity exhibits vanishing bipartite entanglement, we observe an entanglement transfer phenomenon into the other mechanical resonator. This nonlinearly induced entanglement demonstrates superior robustness against thermal fluctuations compared to entanglement generated without the nonlinearity. Additionally, this entanglement features the sudden death and revival phenomenon, where the peaks happen at the multiple of $\theta=\frac{\pi}{2}$. This work opens a new avenue for exploiting nonlinear resources to generate robust quantum entanglement, paving the way for advancements in quantum information processing, quantum sensing, and quantum computing within complex systems.


title: An Embeddable Implicit IUVD Representation for Part-based 3D Human Surface Reconstruction

abstract: To reconstruct a 3D human surface from a single image, it is important to consider human pose, shape and clothing details simultaneously. In recent years, a combination of parametric body models (such as SMPL) that capture body pose and shape prior, and neural implicit functions that learn flexible clothing details, has been used to integrate the advantages of both approaches. However, the combined representation introduces additional computation, e.g. signed distance calculation, in 3D body feature extraction, which exacerbates the redundancy of the implicit query-and-infer process and fails to preserve the underlying body shape prior. To address these issues, we propose a novel IUVD-Feedback representation, which consists of an IUVD occupancy function and a feedback query algorithm. With this representation, the time-consuming signed distance calculation is replaced by a simple linear transformation in the IUVD space, leveraging the SMPL UV maps. Additionally, the redundant query points in the query-and-infer process are reduced through a feedback mechanism. This leads to more reasonable 3D body features and more effective query points, successfully preserving the parametric body prior. Moreover, the IUVD-Feedback representation can be embedded into any existing implicit human reconstruction pipelines without modifying the trained neural networks. Experiments on THuman2.0 dataset demonstrate that the proposed IUVD-Feedback representation improves result robustness and achieves three times faster acceleration in the query-and-infer process. Furthermore, this representation has the potential to be used in generative applications by leveraging its inherited semantic information from the parametric body model.


title: Reviving Undersampling for Long-Tailed Learning

abstract: The training datasets used in long-tailed recognition are extremely unbalanced, resulting in significant variation in per-class accuracy across categories. Prior works mostly used average accuracy to evaluate their algorithms, which easily ignores those worst-performing categories. In this paper, we aim to enhance the accuracy of the worst-performing categories and utilize the harmonic mean and geometric mean to assess the model's performance. We revive the balanced undersampling idea to achieve this goal. In few-shot learning, balanced subsets are few-shot and will surely under-fit, hence it is not used in modern long-tailed learning. But, we find that it produces a more equitable distribution of accuracy across categories with much higher harmonic and geometric mean accuracy, and, but lower average accuracy. Moreover, we devise a straightforward model ensemble strategy, which does not result in any additional overhead and achieves improved harmonic and geometric mean while keeping the average accuracy almost intact when compared to state-of-the-art long-tailed learning methods. We validate the effectiveness of our approach on widely utilized benchmark datasets for long-tailed learning. Our code is at \href{https://github.com/yuhao318/BTM/}{https://github.com/yuhao318/BTM/}.


title: SpeechBERTScore: Reference-Aware Automatic Evaluation of Speech Generation Leveraging NLP Evaluation Metrics

abstract: While subjective assessments have been the gold standard for evaluating speech generation, there is a growing need for objective metrics that are highly correlated with human subjective judgments due to their cost efficiency. This paper proposes reference-aware automatic evaluation methods for speech generation inspired by evaluation metrics in natural language processing. The proposed SpeechBERTScore computes the BERTScore for self-supervised dense speech features of the generated and reference speech, which can have different sequential lengths. We also propose SpeechBLEU and SpeechTokenDistance, which are computed on speech discrete tokens. The evaluations on synthesized speech show that our method correlates better with human subjective ratings than mel cepstral distortion and a recent mean opinion score prediction model. Also, they are effective in noisy speech evaluation and have cross-lingual applicability.


title: Emerging two-dimensional conductivity at Mott-band insulator interface

abstract: Intriguingly conducting perovskite interfaces between ordinary band insulators are widely explored, whereas similar interfaces with Mott insulators are still not quite understood. Here we address the (001), (110), and (111) interfaces between the LaTiO$_{3}$ Mott- and large band gap KTaO$_{3}$ insulators. Based on first-principles calculations, we reveal a mechanism of interfacial conductivity, which is distinct from a formerly studied one applicable to interfaces between polar wide band insulators. Here the key factor causing conductivity is the matching of oxygen octahedra tilting in KTaO$_{3}$ and LaTiO$_{3}$ which, due to a small gap in the LaTiO$_{3}$ results in its sensitivity to the crystal structure, yields metalization of its overlayer and following charge transfer from Ti to Ta. Our findings, also applicable to other Mott insulators interfaces, shed light on the emergence of conductivity observed in LaTiO$_{3}$/KTaO$_{3}$~(110) where the ''polar`` arguments are not applicable and on the emergence of superconductivity in these structures.


title: Traversable Wormholes in Minimally Geometrical Deformed Trace-Free Gravity using Gravitational Decoupling

abstract: In this work, we investigate wormhole solutions through the utilization of gravitational decoupling, employing the Minimal Geometric Deformation (MGD) procedure within the framework of Trace-Free Gravity. We base our investigation on static and spherically symmetric Morris-Thorne traversable wormholes, considering both constant and variable equation of state parameters. We derive the field equations and extract the shape function for each scenario. Moreover, we explore the gravitational decoupling technique and examine various forms of energy density for both a smeared and particle-like gravitational source, encompassing the realm of noncommutative geometry and a statically charged fluid. We also examinethe wormhole geometry through the utilization of embedding diagrams. Through our analysis, we uncover a violation of the Null Energy Condition (NEC). To conclude, we employ the Gauss-Bonnet theorem to determine the weak deflection angle for the wormhole configurations.


title: Mild Solution of Semilinear Rough Stochastic Evolution Equations

abstract: In this paper, we investigate a semilinear stochastic parabolic equation with a linear rough term $du_{t}=\left[L_{t}u_{t}+f\left(t, u_{t}\right)\right]dt+\left(G_{t}u_{t}+g_{t}\right)d\mathbf{X}_{t}+h\left(t, u_{t}\right)dW_{t}$, where $\left(L_{t}\right)_{t \in \left[0, T\right]}$ is a family of unbounded operators acting on a monotone family of interpolation Hilbert spaces, $\mathbf{X}$ is a two-step $\alpha$-H\"older rough path with $\alpha \in \left(1/3, 1/2\right]$ and $W$ is a Brownian motion. Existence and uniqueness of the mild solution are given through the stochastic controlled rough path approach and fixed-point argument. As a technical tool to define rough stochastic convolutions, we also develop a general mild stochastic sewing lemma, which is applicable for processes according to a monotone family.


title: GaSb-based Interband Cascade Laser with hybrid superlattice plasmon-enhanced claddings

abstract: We present an interband cascade laser (ICL) emitting at 5.2 {\mu}m consisting of an 8-stage active region and a hybrid cladding composed of outer plasmon-enhanced InAs_0.915 Sb_0.085 and inner InAs/AlSb superlattice claddings. The hybrid cladding architecture shows an increase in mode-confinement in the active region by 11.2 % according to the simulation. This is a consequence of a significantly lower refractive index of plasmon-enhanced claddings. The threshold current density is 242 A/cm^2 in pulsed operation at room temperature. This is the lowest value reported to date for ICLs emitting at wavelengths longer than 5 {\mu}m. We also report close to record value threshold power density of 840 W/cm^2 for ICLs at such wavelengths.


title: Mass, spectroscopy and two-neutron decay of $^{16}$Be

abstract: The structure and decay of the most neutron-rich beryllium isotope, $^{16}$Be, has been investigated following proton knockout from a high-energy $^{17}$B beam. Two relatively narrow resonances were observed for the first time, with energies of $0.84(3)$ and $2.15(5)$ MeV above the two-neutron decay threshold and widths of $0.32(8)$ and $0.95(15)$ MeV respectively. These were assigned to be the ground ($J^{\pi}=0^+$) and first excited ($2^+$) state, with $E_x=1.31(6)$ MeV. The mass excess of $^{16}$Be was thus deduced to be $56.93(13)$ MeV, some $0.5$ MeV more bound than the only previous measurement. Both states were observed to decay by direct two-neutron emission. Calculations incorporating the evolution of the wavefunction during the decay as a genuine three-body process reproduced the principal characteristics of the neutron-neutron energy spectra for both levels, indicating that the ground state exhibits a strong spatially compact dineutron component, while the 2$^+$ level presents a far more diffuse neutron-neutron distribution.


title: H2O-Danube-1.8B Technical Report

abstract: We present H2O-Danube, a series of small 1.8B language models consisting of H2O-Danube-1.8B, trained on 1T tokens, and the incremental improved H2O-Danube2-1.8B trained on an additional 2T tokens. Our models exhibit highly competitive metrics across a multitude of benchmarks and, as of the time of this writing, H2O-Danube2-1.8B achieves the top ranking on Open LLM Leaderboard for all models below the 2B parameter range. The models follow core principles of LLama 2 and Mistral, and we leverage and refine various techniques for pre-training large language models. We additionally release chat models trained with supervised fine-tuning followed by direct preference optimization. We make all models openly available under Apache 2.0 license further democratizing LLMs to a wider audience economically.


title: Localizing uniformly moving mono-frequent sources using an inverse 2.5D approach

abstract: Localizing linearly moving sound sources using microphone arrays is particularly challenging as the transient nature of the signal leads to relatively short observation periods. Commonly, a moving focus is used and most methods operate at least partially in the time domain. In contrast, here an inverse source localization algorithm for mono-frequent uniformly moving sources that acts entirely in the frequency domain is presented. For this, a 2.5D approach is utilized and a transfer function between sources and a microphone grid is derived. By solving a least squares problem using the data at the microphone grid, the unknown source distribution in the moving frame can be determined. For that the measured time signals need to be transformed into the frequency domain using a windowed discrete Fourier transform (DFT), which leads to effects such as spectral leakage that depends on the length of the time interval and the analysis window used. To include these effects in the numerical model, the calculation of the transfer matrix is modified using the Fourier transform of the analysis window. Currently, this approach is limited to mono-frequent sources as this allows a simplification of the calculation and reduces the computational effort. The least squares problem is solved using a Tikhonov regularization employing an L-curve approach to determine a suitable regularization parameter. As a moving source is considered, the Doppler effect allows to enhance the stability of the system by combining the transfer functions for multiple frequencies in the measured signals. The performance of the approach is validated using simulated data of a moving point source with or without a reflecting ground. Numerical experiments are performed to show the effect of the choice of frequencies in the receiver spectrum, the effect of the DFT, the frequency of the source, and the distance of source and receiver.


title: Provably Robust Multi-bit Watermarking for AI-generated Text via Error Correction Code

abstract: Large Language Models (LLMs) have been widely deployed for their remarkable capability to generate texts resembling human language. However, they could be misused by criminals to create deceptive content, such as fake news and phishing emails, which raises ethical concerns. Watermarking is a key technique to mitigate the misuse of LLMs, which embeds a watermark (e.g., a bit string) into a text generated by a LLM. Consequently, this enables the detection of texts generated by a LLM as well as the tracing of generated texts to a specific user. The major limitation of existing watermark techniques is that they cannot accurately or efficiently extract the watermark from a text, especially when the watermark is a long bit string. This key limitation impedes their deployment for real-world applications, e.g., tracing generated texts to a specific user. This work introduces a novel watermarking method for LLM-generated text grounded in \textbf{error-correction codes} to address this challenge. We provide strong theoretical analysis, demonstrating that under bounded adversarial word/token edits (insertion, deletion, and substitution), our method can correctly extract watermarks, offering a provable robustness guarantee. This breakthrough is also evidenced by our extensive experimental results. The experiments show that our method substantially outperforms existing baselines in both accuracy and robustness on benchmark datasets. For instance, when embedding a bit string of length 12 into a 200-token generated text, our approach attains an impressive match rate of $98.4\%$, surpassing the performance of Yoo et al. (state-of-the-art baseline) at $85.6\%$. When subjected to a copy-paste attack involving the injection of 50 tokens to generated texts with 200 words, our method maintains a substantial match rate of $90.8\%$, while the match rate of Yoo et al. diminishes to below $65\%$.


title: Simulations of early structure formation: Properties of halos that host primordial star formation

abstract: Population III (pop III) stars were born in halos characterised by a pristine gas composition. In such a halo, once the gas density reaches n$_{\mathrm{H}} \sim$ 1 cm$^{-3}$, molecular cooling leads to the collapse of the gas and the birth of pop III stars. Halo properties, such as the chemical abundances, mass, and angular momentum can affect the collapse of the gas, thereby leading to the pop III initial mass function (IMF) of star formation. We want to study the properties of primordial halos and how halos that host early star formation differ from other types of halos. The aim of this study is to obtain a representative population of halos at a given redshift hosting a cold and massive gas cloud that enables the birth of the first stars. We investigated the growth of primordial halos in a $\Lambda$CDM Universe in a large cosmological simulation. We used the hydrodynamic code RAMSES and the chemical solver KROME to study halo formation with non-equilibrium thermochemistry. We then identified structures in the dark and baryonic matter fields, thereby linking the presence or absence of dense gas clouds to the mass and the physical properties of the hosting halos. In our simulations, the mass threshold for a halo for hosting a cold dense gas cloud is $\simeq 7 \times 10^5 M_{\odot}$ and the threshold in the H$_2$ mass fraction is found to be $\simeq 2 \times 10^{-4}$. This is in agreement with previous works. We find that the halo history and accretion rate play a minor role. Here, we present halos with higher HD abundances, which are shown to be colder, as the temperature in the range between $10^2 - 10^4 \, \mathrm{cm^{-3}}$ depends on the HD abundance to a large extent. The higher fraction of HD is linked to the higher spin parameter that is seen for the dense gas.