title: Multi-fidelity physics constrained neural networks for dynamical systems

abstract: Physics-constrained neural networks are commonly employed to enhance prediction robustness compared to purely data-driven models, achieved through the inclusion of physical constraint losses during the model training process. However, one of the major challenges of physics-constrained neural networks consists of the training complexity especially for high-dimensional systems. In fact, conventional physics-constrained models rely on singular-fidelity data necessitating the assessment of physical constraints within high-dimensional fields, which introduces computational difficulties. Furthermore, due to the fixed input size of the neural networks, employing multi-fidelity training data can also be cumbersome. In this paper, we propose the Multi-Scale Physics-Constrained Neural Network (MSPCNN), which offers a novel methodology for incorporating data with different levels of fidelity into a unified latent space through a customised multi-fidelity autoencoder. Additionally, multiple decoders are concurrently trained to map latent representations of inputs into various fidelity physical spaces. As a result, during the training of predictive models, physical constraints can be evaluated within low-fidelity spaces, yielding a trade-off between training efficiency and accuracy. In addition, unlike conventional methods, MSPCNN also manages to employ multi-fidelity data to train the predictive model. We assess the performance of MSPCNN in two fluid dynamics problems, namely a two-dimensional Burgers' system and a shallow water system. Numerical results clearly demonstrate the enhancement of prediction accuracy and noise robustness when introducing physical constraints in low-fidelity fields. On the other hand, as expected, the training complexity can be significantly reduced by computing physical constraint loss in the low-fidelity field rather than the high-fidelity one.


title: RobustTSF: Towards Theory and Design of Robust Time Series Forecasting with Anomalies

abstract: Time series forecasting is an important and forefront task in many real-world applications. However, most of time series forecasting techniques assume that the training data is clean without anomalies. This assumption is unrealistic since the collected time series data can be contaminated in practice. The forecasting model will be inferior if it is directly trained by time series with anomalies. Thus it is essential to develop methods to automatically learn a robust forecasting model from the contaminated data. In this paper, we first statistically define three types of anomalies, then theoretically and experimentally analyze the loss robustness and sample robustness when these anomalies exist. Based on our analyses, we propose a simple and efficient algorithm to learn a robust forecasting model. Extensive experiments show that our method is highly robust and outperforms all existing approaches. The code is available at https://github.com/haochenglouis/RobustTSF.


title: Benchmark for CEC 2024 Competition on Multiparty Multiobjective Optimization

abstract: The competition focuses on Multiparty Multiobjective Optimization Problems (MPMOPs), where multiple decision makers have conflicting objectives, as seen in applications like UAV path planning. Despite their importance, MPMOPs remain understudied in comparison to conventional multiobjective optimization. The competition aims to address this gap by encouraging researchers to explore tailored modeling approaches. The test suite comprises two parts: problems with common Pareto optimal solutions and Biparty Multiobjective UAV Path Planning (BPMO-UAVPP) problems with unknown solutions. Optimization algorithms for the first part are evaluated using Multiparty Inverted Generational Distance (MPIGD), and the second part is evaluated using Multiparty Hypervolume (MPHV) metrics. The average algorithm ranking across all problems serves as a performance benchmark.


title: Universal Post-Training Reverse-Engineering Defense Against Backdoors in Deep Neural Networks

abstract: A variety of defenses have been proposed against backdoors attacks on deep neural network (DNN) classifiers. Universal methods seek to reliably detect and/or mitigate backdoors irrespective of the incorporation mechanism used by the attacker, while reverse-engineering methods often explicitly assume one. In this paper, we describe a new detector that: relies on internal feature map of the defended DNN to detect and reverse-engineer the backdoor and identify its target class; can operate post-training (without access to the training dataset); is highly effective for various incorporation mechanisms (i.e., is universal); and which has low computational overhead and so is scalable. Our detection approach is evaluated for different attacks on benchmark CIFAR-10 and CIFAR-100 image classifiers.


title: Assessing Costs of Community Solar Integration via Optimal Distribution Grid Expansion

abstract: This paper presents a comprehensive analysis of distribution grid upgrades costs necessary to integrate Community Solar (CS) projects. The innovative methodology proposed for this quantification is based on incremental least-cost expansion of the distribution system, encompassing both traditional and non-traditional grid upgrade strategies. Realistic infrastructure investment costs are obtained using a dataset of over 2,500 feeders, including various loading scenarios, and compared with empirical costs of integrating real CS projects. The results are then used to evaluate costs and deferrals from the consumers' and project developers' perspectives, assess the nature of the infrastructure upgrades and explore the potential benefits of a strategic siting of CS projects. This analysis is summarized in a set of regulatory and policy recommendations to support planning and valuation aspects related to CS.


title: Generating In-Distribution Proxy Graphs for Explaining Graph Neural Networks

abstract: Graph Neural Networks (GNNs) have become a building block in graph data processing, with wide applications in critical domains. The growing needs to deploy GNNs in high-stakes applications necessitate explainability for users in the decision-making processes. A popular paradigm for the explainability of GNNs is to identify explainable subgraphs by comparing their labels with the ones of original graphs. This task is challenging due to the substantial distributional shift from the original graphs in the training set to the set of explainable subgraphs, which prevents accurate prediction of labels with the subgraphs. To address it, in this paper, we propose a novel method that generates proxy graphs for explainable subgraphs that are in the distribution of training data. We introduce a parametric method that employs graph generators to produce proxy graphs. A new training objective based on information theory is designed to ensure that proxy graphs not only adhere to the distribution of training data but also preserve explanatory factors. Such generated proxy graphs can be reliably used to approximate the predictions of the labels of explainable subgraphs. Empirical evaluations across various datasets demonstrate our method achieves more accurate explanations for GNNs.


title: EffiBench: Benchmarking the Efficiency of Automatically Generated Code

abstract: Code generation models have increasingly become integral to aiding software development. Although current research has thoroughly examined the correctness of the code produced by code generation models, a vital aspect that plays a pivotal role in green computing and sustainability efforts has often been neglected. This paper presents EffiBench, a benchmark with 1,000 efficiency-critical coding problems to assess the efficiency of code generated by code generation models. EffiBench contains a diverse set of LeetCode coding problems. Each problem is paired with an executable human-written canonical solution, which obtains the SOTA efficiency on the LeetCode solution leaderboard. With EffiBench, we empirically examine the ability of 42 large language models (35 open-source and 7 closed-source) to generate efficient code. Our evaluation results demonstrate that the efficiency of the code generated by LLMs is generally worse than the efficiency of human-written canonical solutions. For example, GPT-4 generated code has an average \textbf{3.12} times execution time that of the human-written canonical solutions. In the most extreme cases, the execution time and total memory usage of GPT-4 generated code are \textbf{13.89} and \textbf{43.92} times that of the canonical solutions. The source code of EffiBench is released on https://github.com/huangd1999/EffiBench. We also provide the LeaderBoard at https://huggingface.co/spaces/EffiBench/effibench-leaderboard.


title: Computing Isogenies at Singular Points of the Modular Polynomial

abstract: In this paper we present a method which, given a singular point $(j_1, j_2)$ on $Y_0(\ell)$ with $j_1, j_2 \neq 0, 1728$ and an elliptic curve $E$ with $j$-invariant ${j_1}$, returns an elliptic curve $\widetilde{E}$ with $j$-invariant ${j_2}$ that admits a normalized $\ell$-isogeny $\phi\colon E\to \widetilde{E}$. The isogeny $\phi$ can then be efficiently computed from $E$ and $\widetilde{E}$ using an algorithm of Bostan, Morain, Salvy, and Schost.


title: Hamiltonian analysis for perturbative $\lambda R$ gravity

abstract: The Hamiltonian analysis for the linearized $\lambda R$ gravity around the Minkowski background is performed. The first-class and second-class constraints for arbitrary values of $\lambda$ are presented, and two physical degrees of freedom are reported. In addition, we remove the second-class constraints, and the generalized Dirac brackets are constructed; then, the equivalence between General Relativity and the $\lambda R$ theory is shown.


title: Critical behavior around the fixed points driven by fermion-fermion interactions and disorders in the nodal-line superconductors

abstract: We systematically investigate the intricate interplay between short-range fermion-fermion interactions and disorder scatterings beneath the superconducting dome of noncentrosymmetric nodal-line superconductors. Employing the renormalization group that unbiasedly treats all kinds of potential degrees of freedom, we establish energy-dependent coupled flows for all associated interaction parameters. Decoding the low-energy information from these coupled evolutions leads to the emergence of several intriguing behavior in the low-energy regime. At first, we identify eight distinct types of fixed points, which are determined by the competition of all interaction parameters and dictate the low-energy properties. Next, we carefully examine and unveil distinct fates of physical implications as approaching such fixed points. The density of states of quasiparticles displays a linear dependence on frequency around the first fixed point, while other fixed points present diverse frequency-dependent behavior. Compressibility and specific heat exhibit unique trends around different fixed points, with the emergence of non-Fermi-liquid behavior nearby the fifth fixed point. Furthermore, after evaluating the susceptibilities of the potential states, we find that a certain phase transition below the critical temperature can be induced when the system approaches the fifth fixed point, transitioning from the nodal-line superconducting state to another superconducting state. This research would enhance our understanding of the unique behavior in the low-energy regime of nodal-line superconductors.


title: $\alpha$-Divergence Loss Function for Neural Density Ratio Estimation

abstract: Recently, neural networks have produced state-of-the-art results for density-ratio estimation (DRE), a fundamental technique in machine learning. However, existing methods bear optimization issues that arise from the loss functions of DRE: a large sample requirement of Kullback--Leibler (KL)-divergence, vanishing of train loss gradients, and biased gradients of the loss functions. Thus, an $\alpha$-divergence loss function ($\alpha$-Div) that offers concise implementation and stable optimization is proposed in this paper. Furthermore, technical justifications for the proposed loss function are presented. The stability of the proposed loss function is empirically demonstrated and the estimation accuracy of DRE tasks is investigated. Additionally, this study presents a sample requirement for DRE using the proposed loss function in terms of the upper bound of $L_1$ error, which connects a curse of dimensionality as a common problem in high-dimensional DRE tasks.


title: Learning General Parameterized Policies for Infinite Horizon Average Reward Constrained MDPs via Primal-Dual Policy Gradient Algorithm

abstract: This paper explores the realm of infinite horizon average reward Constrained Markov Decision Processes (CMDP). To the best of our knowledge, this work is the first to delve into the regret and constraint violation analysis of average reward CMDPs with a general policy parametrization. To address this challenge, we propose a primal dual based policy gradient algorithm that adeptly manages the constraints while ensuring a low regret guarantee toward achieving a global optimal policy. In particular, we demonstrate that our proposed algorithm achieves $\tilde{\mathcal{O}}({T}^{4/5})$ objective regret and $\tilde{\mathcal{O}}({T}^{4/5})$ constraint violation bounds.


title: A Plug-in Tiny AI Module for Intelligent and Selective Sensor Data Transmission

abstract: Applications in the Internet of Things (IoT) utilize machine learning to analyze sensor-generated data. However, a major challenge lies in the lack of targeted intelligence in current sensing systems, leading to vast data generation and increased computational and communication costs. To address this challenge, we propose a novel sensing module to equip sensing frameworks with intelligent data transmission capabilities by integrating a highly efficient machine learning model placed near the sensor. This model provides prompt feedback for the sensing system to transmit only valuable data while discarding irrelevant information by regulating the frequency of data transmission. The near-sensor model is quantized and optimized for real-time sensor control. To enhance the framework's performance, the training process is customized and a "lazy" sensor deactivation strategy utilizing temporal information is introduced. The suggested method is orthogonal to other IoT frameworks and can be considered as a plugin for selective data transmission. The framework is implemented, encompassing both software and hardware components. The experiments demonstrate that the framework utilizing the suggested module achieves over 85% system efficiency in terms of energy consumption and storage, with negligible impact on performance. This methodology has the potential to significantly reduce data output from sensors, benefiting a wide range of IoT applications.


title: Locally-Adaptive Quantization for Streaming Vector Search

abstract: Retrieving the most similar vector embeddings to a given query among a massive collection of vectors has long been a key component of countless real-world applications. The recently introduced Retrieval-Augmented Generation is one of the most prominent examples. For many of these applications, the database evolves over time by inserting new data and removing outdated data. In these cases, the retrieval problem is known as streaming similarity search. While Locally-Adaptive Vector Quantization (LVQ), a highly efficient vector compression method, yields state-of-the-art search performance for non-evolving databases, its usefulness in the streaming setting has not been yet established. In this work, we study LVQ in streaming similarity search. In support of our evaluation, we introduce two improvements of LVQ: Turbo LVQ and multi-means LVQ that boost its search performance by up to 28% and 27%, respectively. Our studies show that LVQ and its new variants enable blazing fast vector search, outperforming its closest competitor by up to 9.4x for identically distributed data and by up to 8.8x under the challenging scenario of data distribution shifts (i.e., where the statistical distribution of the data changes over time). We release our contributions as part of Scalable Vector Search, an open-source library for high-performance similarity search.


title: MLIP: Enhancing Medical Visual Representation with Divergence Encoder and Knowledge-guided Contrastive Learning

abstract: The scarcity of annotated data has sparked significant interest in unsupervised pre-training methods that leverage medical reports as auxiliary signals for medical visual representation learning. However, existing research overlooks the multi-granularity nature of medical visual representation and lacks suitable contrastive learning techniques to improve the models' generalizability across different granularities, leading to the underutilization of image-text information. To address this, we propose MLIP, a novel framework leveraging domain-specific medical knowledge as guiding signals to integrate language information into the visual domain through image-text contrastive learning. Our model includes global contrastive learning with our designed divergence encoder, local token-knowledge-patch alignment contrastive learning, and knowledge-guided category-level contrastive learning with expert knowledge. Experimental evaluations reveal the efficacy of our model in enhancing transfer performance for tasks such as image classification, object detection, and semantic segmentation. Notably, MLIP surpasses state-of-the-art methods even with limited annotated data, highlighting the potential of multimodal pre-training in advancing medical representation learning.


title: TCI-Former: Thermal Conduction-Inspired Transformer for Infrared Small Target Detection

abstract: Infrared small target detection (ISTD) is critical to national security and has been extensively applied in military areas. ISTD aims to segment small target pixels from background. Most ISTD networks focus on designing feature extraction blocks or feature fusion modules, but rarely describe the ISTD process from the feature map evolution perspective. In the ISTD process, the network attention gradually shifts towards target areas. We abstract this process as the directional movement of feature map pixels to target areas through convolution, pooling and interactions with surrounding pixels, which can be analogous to the movement of thermal particles constrained by surrounding variables and particles. In light of this analogy, we propose Thermal Conduction-Inspired Transformer (TCI-Former) based on the theoretical principles of thermal conduction. According to thermal conduction differential equation in heat dynamics, we derive the pixel movement differential equation (PMDE) in the image domain and further develop two modules: Thermal Conduction-Inspired Attention (TCIA) and Thermal Conduction Boundary Module (TCBM). TCIA incorporates finite difference method with PMDE to reach a numerical approximation so that target body features can be extracted. To further remove errors in boundary areas, TCBM is designed and supervised by boundary masks to refine target body features with fine boundary details. Experiments on IRSTD-1k and NUAA-SIRST demonstrate the superiority of our method.


title: Calibration and Correctness of Language Models for Code

abstract: Machine learning models are widely used but can also often be wrong. Users would benefit from a reliable indication of whether a given output from a given model should be trusted, so a rational decision can be made whether to use the output or not. For example, outputs can be associated with a confidence measure; if this confidence measure is strongly associated with likelihood of correctness, then the model is said to be well-calibrated. In this case, for example, high-confidence outputs could be safely accepted, and low-confidence outputs rejected. Calibration has so far been studied in mostly non-generative (e.g., classification) settings, especially in Software Engineering. However, generated code can quite often be wrong: Developers need to know when they should e.g., directly use, use after careful review, or discard model-generated code; thus Calibration is vital in generative settings. However, the notion of correctness of generated code is non-trivial, and thus so is Calibration. In this paper we make several contributions. We develop a framework for evaluating the Calibration of code-generating models. We consider several tasks, correctness criteria, datasets, and approaches, and find that by and large generative code models are not well-calibrated out of the box. We then show how Calibration can be improved, using standard methods such as Platt scaling. Our contributions will lead to better-calibrated decision-making in the current use of code generated by language models, and offers a framework for future research to further improve calibration methods for generative models in Software Engineering.


title: Phase transitions for a unidirectional elephant random walk with a power law memory

abstract: For the standard elephant random walk, Laulin (2022) studied the case when the increment of the random walk is not uniformly distributed over the past history instead has a power law distribution. We study such a problem for the unidirectional elephant random walk introduced by Harbola, Kumar and Lindenberg (2014). Depending on the memory parameter $p$ and the power law exponent $\beta$, we obtain three distinct phases in one such phase the elephant travels only a finite distance almost surely, and the other two phases are distinguished by the speed at which the elephant travels.


title: Red or Blue Tensor Spectrum from GW170817-compatible Einstein-Gauss-Bonnet Theory: A Detailed Analysis

abstract: In this work we shall prove that the tensor spectral index of the primordial tensor perturbations for GW170817-compatible Einstein-Gauss-Bonnet theories, takes the approximate simplified form $n_{\mathcal{T}}\simeq 2\left(-1+\frac{1}{\lambda(\phi)} \right)\epsilon_1$ at leading order, with $\lambda (\phi)$ being a function of the scalar field which depends on the scalar field potential and the second derivative of the scalar-Gauss-Bonnet coupling $\xi''(\phi)$. With our analysis we aim to provide a definitive criterion for selecting Einstein-Gauss-Bonnet models that can provide a blue-tilted inflationary phenomenology, by simply looking at the scalar potential and the scalar-Gauss-Bonnet coupling. We shall prove this using two distinct approaches and as we show the tilt of the tensor spectral index is determined by the values of the potential $V(\phi)$ and of scalar-Gauss-Bonnet coupling at first horizon crossing. Specifically the blue-tilted tensor spectral index can occur when $\xi''(\phi_*)V(\phi_*)>0$ at first horizon crossing.


title: Non-minimal Derivative Coupling Theories Compatible with GW170817

abstract: In this work we aim to revive the interest for non-minimal derivative coupling theories of gravity, in light of the GW170817 event. These theories include a string motivated non-minimal kinetic term for the scalar field of the form $\sim \xi(\phi) G^{\mu\nu}\partial_\mu\phi\partial_\nu\phi$ and predict that the primordial tensor perturbations have a speed that it is distinct from the speed of light. Due to the fact that the Universe is classical during and in the post-inflationary epoch, there is no fundamental reason for the graviton to change its mass, the GW170817 event severely constrained these theories. We analyze and formalize the inflationary phenomenology of these theories, using both the latest Planck data and the GW170817 event data to constrain these theories. Due to the fact that there is no constraint in the choice of the scalar potential and the non-minimal coupling function, we provide several classes of viable models, using convenient forms of the minimal coupling function in terms of the scalar potential, aiming for analyticity, and we discuss the advantages and disadvantages of each viable model.


title: Nonlinear subspace clustering by functional link neural networks

abstract: Nonlinear subspace clustering based on a feed-forward neural network has been demonstrated to provide better clustering accuracy than some advanced subspace clustering algorithms. While this approach demonstrates impressive outcomes, it involves a balance between effectiveness and computational cost. In this study, we employ a functional link neural network to transform data samples into a nonlinear domain. Subsequently, we acquire a self-representation matrix through a learning mechanism that builds upon the mapped samples. As the functional link neural network is a single-layer neural network, our proposed method achieves high computational efficiency while ensuring desirable clustering performance. By incorporating the local similarity regularization to enhance the grouping effect, our proposed method further improves the quality of the clustering results. Additionally, we introduce a convex combination subspace clustering scheme, which combining a linear subspace clustering method with the functional link neural network subspace clustering approach. This combination approach allows for a dynamic balance between linear and nonlinear representations. Extensive experiments confirm the advancement of our methods. The source code will be released on https://lshi91.github.io/ soon.


title: Feature Selection using the concept of Peafowl Mating in IDS

abstract: Cloud computing has high applicability as an Internet based service that relies on sharing computing resources. Cloud computing provides services that are Infrastructure based, Platform based and Software based. The popularity of this technology is due to its superb performance, high level of computing ability, low cost of services, scalability, availability and flexibility. The obtainability and openness of data in cloud environment make it vulnerable to the world of cyber-attacks. To detect the attacks Intrusion Detection System is used, that can identify the attacks and ensure information security. Such a coherent and proficient Intrusion Detection System is proposed in this paper to achieve higher certainty levels regarding safety in cloud environment. In this paper, the mating behavior of peafowl is incorporated into an optimization algorithm which in turn is used as a feature selection algorithm. The algorithm is used to reduce the huge size of cloud data so that the IDS can work efficiently on the cloud to detect intrusions. The proposed model has been experimented with NSL-KDD dataset as well as Kyoto dataset and have proved to be a better as well as an efficient IDS.


title: Affordable Generative Agents

abstract: The emergence of large language models (LLMs) has significantly advanced the simulation of believable interactive agents. However, the substantial cost on maintaining the prolonged agent interactions poses challenge over the deployment of believable LLM-based agents. Therefore, in this paper, we develop Affordable Generative Agents (AGA), a framework for enabling the generation of believable and low-cost interactions on both agent-environment and inter-agents levels. Specifically, for agent-environment interactions, we substitute repetitive LLM inferences with learned policies; while for inter-agent interactions, we model the social relationships between agents and compress auxiliary dialogue information. Extensive experiments on multiple environments show the effectiveness and efficiency of our proposed framework. Also, we delve into the mechanisms of emergent believable behaviors lying in LLM agents, demonstrating that agents can only generate finite behaviors in fixed environments, based upon which, we understand ways to facilitate emergent interaction behaviors. Our code is publicly available at: \url{https://github.com/AffordableGenerativeAgents/Affordable-Generative-Agents}.


title: Neural Scaling Laws on Graphs

abstract: Deep graph models (e.g., graph neural networks and graph transformers) have become important techniques for leveraging knowledge across various types of graphs. Yet, the scaling properties of deep graph models have not been systematically investigated, casting doubt on the feasibility of achieving large graph models through enlarging the model and dataset sizes. In this work, we delve into neural scaling laws on graphs from both model and data perspectives. We first verify the validity of such laws on graphs, establishing formulations to describe the scaling behaviors. For model scaling, we investigate the phenomenon of scaling law collapse and identify overfitting as the potential reason. Moreover, we reveal that the model depth of deep graph models can impact the model scaling behaviors, which differ from observations in other domains such as CV and NLP. For data scaling, we suggest that the number of graphs can not effectively metric the graph data volume in scaling law since the sizes of different graphs are highly irregular. Instead, we reform the data scaling law with the number of edges as the metric to address the irregular graph sizes. We further demonstrate the reformed law offers a unified view of the data scaling behaviors for various fundamental graph tasks including node classification, link prediction, and graph classification. This work provides valuable insights into neural scaling laws on graphs, which can serve as an essential step toward large graph models.


title: Variance Alignment Score: A Simple But Tough-to-Beat Data Selection Method for Multimodal Contrastive Learning

abstract: In recent years, data selection has emerged as a core issue for large-scale visual-language model pretraining, especially on noisy web-curated datasets. One widely adopted strategy assigns quality scores such as CLIP similarity for each sample and retains the data pairs with the highest scores. However, these approaches are agnostic of data distribution and always fail to select the most informative samples. To solve this problem, we propose a simple yet theoretically principled metric named Variance Alignment Score (VAS), which has the form $\langle \Sigma_{\text{test}}, \Sigma_i\rangle$. Here, $\Sigma_{\text{test}}$ represents the target (cross-)covariance matrix we aim to align, potentially based on prior knowledge, while $\Sigma_i$ denotes the tensor product of single or multi-modal representations for the $i$-th sample. We further design a new data selection method that maximizes the total VAS. We provide theoretical analysis in a simplified setting to demonstrate the theoretical advantage of VAS over random or other existing data selection. Experimentally, applying VAS and CLIP scores together can outperform baselines by a margin of $1.3\%$ average on 38 evaluation sets for noisy dataset DataComp and $2.5\%$ on VTAB for high-quality dataset CC12M. Additionally, our ablation study also shows visual features are better than text for calculating VAS, and the related classical experimental design methods may fail under this context.


title: AnthroScore: A Computational Linguistic Measure of Anthropomorphism

abstract: Anthropomorphism, or the attribution of human-like characteristics to non-human entities, has shaped conversations about the impacts and possibilities of technology. We present AnthroScore, an automatic metric of implicit anthropomorphism in language. We use a masked language model to quantify how non-human entities are implicitly framed as human by the surrounding context. We show that AnthroScore corresponds with human judgments of anthropomorphism and dimensions of anthropomorphism described in social science literature. Motivated by concerns of misleading anthropomorphism in computer science discourse, we use AnthroScore to analyze 15 years of research papers and downstream news articles. In research papers, we find that anthropomorphism has steadily increased over time, and that papers related to language models have the most anthropomorphism. Within ACL papers, temporal increases in anthropomorphism are correlated with key neural advancements. Building upon concerns of scientific misinformation in mass media, we identify higher levels of anthropomorphism in news headlines compared to the research papers they cite. Since AnthroScore is lexicon-free, it can be directly applied to a wide range of text sources.


title: Break the Sequential Dependency of LLM Inference Using Lookahead Decoding

abstract: Autoregressive decoding of large language models (LLMs) is memory bandwidth bounded, resulting in high latency and significant wastes of the parallel processing power of modern accelerators. Existing methods for accelerating LLM decoding often require a draft model (e.g., speculative decoding), which is nontrivial to obtain and unable to generalize. In this paper, we introduce Lookahead decoding, an exact, parallel decoding algorithm that accelerates LLM decoding without needing auxiliary models or data stores. It allows trading per-step log(FLOPs) to reduce the number of total decoding steps, is more parallelizable on single or multiple modern accelerators, and is compatible with concurrent memory-efficient attention (e.g., FlashAttention). Our implementation of Lookahead decoding can speed up autoregressive decoding by up to 1.8x on MT-bench and 4x with strong scaling on multiple GPUs in code completion tasks. Our code is avialable at https://github.com/hao-ai-lab/LookaheadDecoding


title: The Metallicity Distribution in the LMC and the SMC based on the Tip-RGB Colors

abstract: The color index $(J-K)_0$ of tip-red giant branch (TRGB) is used to study the metallicity distribution in the Large and Small Magellanic Cloud. With the most complete and pure sample of red member stars so far, the areas are divided into 154 and 70 bins for the LMC and SMC respectively with similar number of stars by the Voronoi binning. For each bin, the position of TRGB on the near-infrared color-magnitude diagram, specifically $(J-K)_0/K_0$, is determined by the Poison-Noise weighted method. Converting the color index of TRGB into metallicity, the metallicity gradients in the LMC and the SMC are obtained in four major directions. For the LMC, the gradient to the north is $-0.006 \pm 0.004$ dex kpc$^{-1}$, to the south $-0.010 \pm 0.005$ dex kpc$^{-1}$, to the east $-0.006 \pm 0.003$ dex kpc$^{-1}$, and to the west $-0.010 \pm 0.003$ dex kpc$^{-1}$. The farthest distance extends to 16 kpc. For the SMC, the gradients to the north, south, east, and west are $-0.017 \pm 0.031$ dex kpc$^{-1}$, $-0.016 \pm 0.007$ dex kpc$^{-1}$, $-0.003 \pm 0.002$ dex kpc$^{-1}$, and $-0.004 \pm 0.003$ dex kpc$^{-1}$, respectively. The farthest distance for the SMC extends to 27 kpc. The gradient is large from the center to 1 kpc.


title: Multiple sequences Prophet Inequality Under Observation Constraints

abstract: In our problem, we are given access to a number of sequences of nonnegative i.i.d. random variables, whose realizations are observed sequentially. All sequences are of the same finite length. The goal is to pick one element from each sequence in order to maximize a reward equal to the expected value of the sum of the selections from all sequences. The decision on which element to pick is irrevocable, i.e., rejected observations cannot be revisited. Furthermore, the procedure terminates upon having a single selection from each sequence. Our observation constraint is that we cannot observe the current realization of all sequences at each time instant. Instead, we can observe only a smaller, yet arbitrary, subset of them. Thus, together with a stopping rule that determines whether we choose or reject the sample, the solution requires a sampling rule that determines which sequence to observe at each instant. The problem can be solved via dynamic programming, but with an exponential complexity in the length of the sequences. In order to make the solution computationally tractable, we introduce a decoupling approach and determine each stopping time using either a single-sequence dynamic programming, or a Prophet Inequality inspired threshold method, with polynomial complexity in the length of the sequences. We prove that the decoupling approach guarantees at least 0.745 of the optimal expected reward of the joint problem. In addition, we describe how to efficiently compute the optimal number of samples for each sequence, and its' dependence on the variances.


title: DiffVein: A Unified Diffusion Network for Finger Vein Segmentation and Authentication

abstract: Finger vein authentication, recognized for its high security and specificity, has become a focal point in biometric research. Traditional methods predominantly concentrate on vein feature extraction for discriminative modeling, with a limited exploration of generative approaches. Suffering from verification failure, existing methods often fail to obtain authentic vein patterns by segmentation. To fill this gap, we introduce DiffVein, a unified diffusion model-based framework which simultaneously addresses vein segmentation and authentication tasks. DiffVein is composed of two dedicated branches: one for segmentation and the other for denoising. For better feature interaction between these two branches, we introduce two specialized modules to improve their collective performance. The first, a mask condition module, incorporates the semantic information of vein patterns from the segmentation branch into the denoising process. Additionally, we also propose a Semantic Difference Transformer (SD-Former), which employs Fourier-space self-attention and cross-attention modules to extract category embedding before feeding it to the segmentation task. In this way, our framework allows for a dynamic interplay between diffusion and segmentation embeddings, thus vein segmentation and authentication tasks can inform and enhance each other in the joint training. To further optimize our model, we introduce a Fourier-space Structural Similarity (FourierSIM) loss function, which is tailored to improve the denoising network's learning efficacy. Extensive experiments on the USM and THU-MVFV3V datasets substantiates DiffVein's superior performance, setting new benchmarks in both vein segmentation and authentication tasks.


title: Islamic Lifestyle Applications: Meeting the Spiritual Needs of Modern Muslims

abstract: We evaluated contemporary Islamic lifestyle applications supporting religious practices and motivation among Muslims. We reviewed 11 popular applications using self-determination theory and the technology-as-experience framework to assess their support for motivation and affective needs. Most applications lack features that foster autonomy, competence, and relatedness. We also interviewed ten devoted Muslim application users to gain insights into their experiences and unmet needs. Our findings indicate that existing applications fall short in providing comprehensive learning, social connections, and scholar consultations. We propose design implications based on our results, including guided religious information, shareability, virtual community engagement, scholarly question-answering, and personalized reminders. We aim to inform the design of Islamic lifestyle applications that better facilitate ritual practices, benefitting application designers and Muslim communities. Our research provides valuable insights into the untapped potential for lifestyle applications to act as religious companions supporting Muslims' spiritual journey.


title: Parsimonious Learning-Augmented Approximations for Dense Instances of $\mathcal{NP}$-hard Problems

abstract: The classical work of (Arora et al., 1999) provides a scheme that gives, for any $\epsilon>0$, a polynomial time $1-\epsilon$ approximation algorithm for dense instances of a family of $\mathcal{NP}$-hard problems, such as Max-CUT and Max-$k$-SAT. In this paper we extend and speed up this scheme using a logarithmic number of one-bit predictions. We propose a learning augmented framework which aims at finding fast algorithms which guarantees approximation consistency, smoothness and robustness with respect to the prediction error. We provide such algorithms, which moreover use predictions parsimoniously, for dense instances of various optimization problems.


title: Improving the Learning of Code Review Successive Tasks with Cross-Task Knowledge Distillation

abstract: Code review is a fundamental process in software development that plays a pivotal role in ensuring code quality and reducing the likelihood of errors and bugs. However, code review can be complex, subjective, and time-consuming. Quality estimation, comment generation, and code refinement constitute the three key tasks of this process, and their automation has traditionally been addressed separately in the literature using different approaches. In particular, recent efforts have focused on fine-tuning pre-trained language models to aid in code review tasks, with each task being considered in isolation. We believe that these tasks are interconnected, and their fine-tuning should consider this interconnection. In this paper, we introduce a novel deep-learning architecture, named DISCOREV, which employs cross-task knowledge distillation to address these tasks simultaneously. In our approach, we utilize a cascade of models to enhance both comment generation and code refinement models. The fine-tuning of the comment generation model is guided by the code refinement model, while the fine-tuning of the code refinement model is guided by the quality estimation model. We implement this guidance using two strategies: a feedback-based learning objective and an embedding alignment objective. We evaluate DISCOREV by comparing it to state-of-the-art methods based on independent training and fine-tuning. Our results show that our approach generates better review comments, as measured by the BLEU score, as well as more accurate code refinement according to the CodeBLEU score


title: Prediction modelling with many correlated and zero-inflated predictors: assessing a nonnegative garrote approach

abstract: Building prediction models from mass-spectrometry data is challenging due to the abundance of correlated features with varying degrees of zero-inflation, leading to a common interest in reducing the features to a concise predictor set with good predictive performance. In this study, we formally established and examined regularized regression approaches, designed to address zero-inflated and correlated predictors. In particular, we describe a novel two-stage regularized regression approach (ridge-garrote) explicitly modelling zero-inflated predictors using two component variables, comprising a ridge estimator in the first stage and subsequently applying a nonnegative garrote estimator in the second stage. We contrasted ridge-garrote with one-stage methods (ridge, lasso) and other two-stage regularized regression approaches (lasso-ridge, ridge-lasso) for zero-inflated predictors. We assessed the predictive performance and predictor selection properties of these methods in a comparative simulation study and a real-data case study to predict kidney function using peptidomic features derived from mass-spectrometry. In the simulation study, the predictive performance of all assessed approaches was comparable, yet the ridge-garrote approach consistently selected more parsimonious models compared to its competitors in most scenarios. While lasso-ridge achieved higher predictive accuracy than its competitors, it exhibited high variability in the number of selected predictors. Ridge-lasso exhibited slightly superior predictive accuracy than ridge-garrote but at the expense of selecting more noise predictors. Overall, ridge emerged as a favourable option when variable selection is not a primary concern, while ridge-garrote demonstrated notable practical utility in selecting a parsimonious set of predictors, with only minimal compromise in predictive accuracy.


title: Training Implicit Networks for Image Deblurring using Jacobian-Free Backpropagation

abstract: Recent efforts in applying implicit networks to solve inverse problems in imaging have achieved competitive or even superior results when compared to feedforward networks. These implicit networks only require constant memory during backpropagation, regardless of the number of layers. However, they are not necessarily easy to train. Gradient calculations are computationally expensive because they require backpropagating through a fixed point. In particular, this process requires solving a large linear system whose size is determined by the number of features in the fixed point iteration. This paper explores a recently proposed method, Jacobian-free Backpropagation (JFB), a backpropagation scheme that circumvents such calculation, in the context of image deblurring problems. Our results show that JFB is comparable against fine-tuned optimization schemes, state-of-the-art (SOTA) feedforward networks, and existing implicit networks at a reduced computational cost.


title: Trustworthiness of $\mathbb{X}$ Users: A One-Class Classification Approach

abstract: $\mathbb{X}$ (formerly Twitter) is a prominent online social media platform that plays an important role in sharing information making the content generated on this platform a valuable source of information. Ensuring trust on $\mathbb{X}$ is essential to determine the user credibility and prevents issues across various domains. While assigning credibility to $\mathbb{X}$ users and classifying them as trusted or untrusted is commonly carried out using traditional machine learning models, there is limited exploration about the use of One-Class Classification (OCC) models for this purpose. In this study, we use various OCC models for $\mathbb{X}$ user classification. Additionally, we propose using a subspace-learning-based approach that simultaneously optimizes both the subspace and data description for OCC. We also introduce a novel regularization term for Subspace Support Vector Data Description (SSVDD), expressing data concentration in a lower-dimensional subspace that captures diverse graph structures. Experimental results show superior performance of the introduced regularization term for SSVDD compared to baseline models and state-of-the-art techniques for $\mathbb{X}$ user classification.


title: RIDERS: Radar-Infrared Depth Estimation for Robust Sensing

abstract: Dense depth recovery is crucial in autonomous driving, serving as a foundational element for obstacle avoidance, 3D object detection, and local path planning. Adverse weather conditions, including haze, dust, rain, snow, and darkness, introduce significant challenges to accurate dense depth estimation, thereby posing substantial safety risks in autonomous driving. These challenges are particularly pronounced for traditional depth estimation methods that rely on short electromagnetic wave sensors, such as visible spectrum cameras and near-infrared LiDAR, due to their susceptibility to diffraction noise and occlusion in such environments. To fundamentally overcome this issue, we present a novel approach for robust metric depth estimation by fusing a millimeter-wave Radar and a monocular infrared thermal camera, which are capable of penetrating atmospheric particles and unaffected by lighting conditions. Our proposed Radar-Infrared fusion method achieves highly accurate and finely detailed dense depth estimation through three stages, including monocular depth prediction with global scale alignment, quasi-dense Radar augmentation by learning Radar-pixels correspondences, and local scale refinement of dense depth using a scale map learner. Our method achieves exceptional visual quality and accurate metric estimation by addressing the challenges of ambiguity and misalignment that arise from directly fusing multi-modal long-wave features. We evaluate the performance of our approach on the NTU4DRadLM dataset and our self-collected challenging ZJU-Multispectrum dataset. Especially noteworthy is the unprecedented robustness demonstrated by our proposed method in smoky scenarios. Our code will be released at \url{https://github.com/MMOCKING/RIDERS}.


title: Modeling local predictive ability using power-transformed Gaussian processes

abstract: A Gaussian process is proposed as a model for the posterior distribution of the local predictive ability of a model or expert, conditional on a vector of covariates, from historical predictions in the form of log predictive scores. Assuming Gaussian expert predictions and a Gaussian data generating process, a linear transformation of the predictive score follows a noncentral chi-squared distribution with one degree of freedom. Motivated by this we develop a non-central chi-squared Gaussian process regression to flexibly model local predictive ability, with the posterior distribution of the latent GP function and kernel hyperparameters sampled by Hamiltonian Monte Carlo. We show that a cube-root transformation of the log scores is approximately Gaussian with homoscedastic variance, which makes it possible to estimate the model much faster by marginalizing the latent GP function analytically. Linear pools based on learned local predictive ability are applied to predict daily bike usage in Washington DC.


title: Particle motion and tidal force in a non-vacuum-charged naked singularity

abstract: In this article, we investigate the gravitational field of a charged, non-vacuum, non-rotating, spherically symmetric body of mass $M$ assuming a static solution to the Einstein-Maxwell field equations. We demonstrate that the characteristics of perihelion precession of orbits in Schwarzschild and Null singularity spacetimes are similar, whereas, in the case of charged naked singularity (CNS) spacetime, the characteristics are the opposite of those in Schwarzschild and Null singularity spacetime. Here we discuss some novel features of the timelike and lightlike geodesics in this spacetime. We also discuss the comparative study of tidal force in the null singularity spacetime and charged naked singularity spacetime.


title: HotRAP: Hot Record Retention and Promotion for LSM-trees with tiered storage

abstract: The multi-level design of Log-Structured Merge-trees (LSM-trees) naturally fits the tiered storage architecture: the upper levels (recently inserted/updated records) are kept in fast storage to guarantee performance while the lower levels (the majority of records) are placed in slower but cheaper storage to reduce cost. However, frequently accessed records may have been compacted and reside in slow storage, and existing algorithms are inefficient in promoting these ``hot'' records to fast storage, leading to compromised read performance. We present HotRAP, a key-value store based on RocksDB that can timely promote hot records individually from slow to fast storage and keep them in fast storage while they are hot. HotRAP uses an on-disk data structure (a specially-made LSM-tree) to track the hotness of keys and includes three pathways to ensure that hot records reach fast storage with short delays. Our experiments show that HotRAP outperforms state-of-the-art LSM-trees on tiered storage by up to 3.3$\times$ compared to the second best for read-only and read-write-balanced workloads with common access skew patterns.


title: Finite modular axion and radiative moduli stabilization

abstract: We propose a simple setup which can stabilize a modulus field of the finite modular symmetry by the Coleman-Weinberg potential. Our scenario leads to a large hierarchy suppressing instanton-like corrections $e^{2\pi i\tau}$ and to a light axion identified as $\mathrm{Re} \tau$, where $\tau$ is the modulus field. This stabilization mechanism provides the axion solution to the strong CP problem. The potential has a minimum at a large $\mathrm{Im}\tau$ which suppresses explicit $U(1)_{\mathrm{PQ}}$ violation terms proportional to $e^{-2\pi {\mathrm{Im}\tau}}$, and hence the quality of the axion is ensured by the residual symmetry associated with the $T$-transformation, $\tau \to \tau +1$, around the fixed point $\tau \sim i\infty$.


title: Searching for singlet vector-like leptons via pair production at ILC

abstract: Vector-like leptons (VLLs) as one kind of the most intriguing particles, have been widely concerned in several extensions of the Standard Model (SM). In this work, we explore the discovery potential of VLLs via pair production in the context of models that satisfy asymptotic safety at the International Linear Collider (ILC). The expected sensitivities of the ILC with the center of mass energy $\sqrt{s} =$ 1 TeV and the integrated luminosity $\mathcal{L}$ = 1 ab$^{-1}$ to the parameter space of this kind of VLL models are derived. The results we obtained show that, for the VLL with mass $M_F$ in the region of $M_{F}\in$ [101GeV, 463GeV], the Yukawa coupling $\kappa $ can be as low as $\kappa \in$ [0.032, 0.098].


title: The (1,0) tensor and hypermultiplets in loop space

abstract: We show that the (1,0) tensor and hypermultiplet superconformal symmetry variations can be uplifted to loop space if we assume that two lightlike conformal Killing vectors commute. Upon dimensional reduction we make contact with five dimensional super-Yang-Mills and its nonabelian generalization that we subsequently uplift back to loop space where we conjecture a nonabelian generalization of the (1,0) superconformal symmetry variations and demonstrate their on-shell closure.


title: Multiple-Crop Human Mesh Recovery with Contrastive Learning and Camera Consistency in A Single Image

abstract: We tackle the problem of single-image Human Mesh Recovery (HMR). Previous approaches are mostly based on a single crop. In this paper, we shift the single-crop HMR to a novel multiple-crop HMR paradigm. Cropping a human from image multiple times by shifting and scaling the original bounding box is feasible in practice, easy to implement, and incurs neglectable cost, but immediately enriches available visual details. With multiple crops as input, we manage to leverage the relation among these crops to extract discriminative features and reduce camera ambiguity. Specifically, (1) we incorporate a contrastive learning scheme to enhance the similarity between features extracted from crops of the same human. (2) We also propose a crop-aware fusion scheme to fuse the features of multiple crops for regressing the target mesh. (3) We compute local cameras for all the input crops and build a camera-consistency loss between the local cameras, which reward us with less ambiguous cameras. Based on the above innovations, our proposed method outperforms previous approaches as demonstrated by the extensive experiments.


title: A Compact Gas-Kinetic Scheme with Scalable Geometric Multigrid Acceleration for Steady-State Computation on 3D Unstructured Meshes

abstract: In this paper, we present an advanced high-order compact gas-kinetic scheme (CGKS) for 3D unstructured mixed-element meshes, augmented with a geometric multigrid technique to accelerate steady-state convergence. The scheme evolves cell-averaged flow variables and their gradients on the original mesh. Mesh coarsening employs a two-step parallel agglomeration algorithm using a random hash for cell interface selection and a geometric skewness metric for deletion confirmation, ensuring both efficiency and robustness. For the coarser meshes, first-order kinetic flux vector splitting (KFVS) schemes with explicit or implicit time-stepping are used. The proposed multigrid CGKS is tested across various flow regimes on hybrid unstructured meshes, demonstrating significant improvements. A three-layer V-cycle multigrid strategy, coupled with an explicit forward Euler method on coarser levels, results in a convergence rate up to ten times faster than standard CGKS. In contrast, the implicit lower-upper symmetric Gauss-Seidel (LU-SGS) method offers limited convergence acceleration. Our findings indicate that the explicit multigrid CGKS is highly scalable and effective for large-scale computations, marking a substantial step forward in computational fluid dynamics.


title: The cataclysmic variable orbital period gap: More evident than ever

abstract: Recently, large and homogeneous samples of cataclysmic variables (CVs) identified by the Sloan Digital Sky Survey (SDSS) were published. In these samples, the famous orbital period gap, which is a dearth of systems in the orbital period range ~2-3 hr and the defining feature of most evolutionary models for CVs, has been claimed not to be clearly present. If true, this finding would completely change our picture of CV evolution. In this Letter we focus on potential differences with respect to the orbital period gap between CVs in which the magnetic field of the white dwarf is strong enough to connect with that of the donor star, so-called polars, and non-polar CVs as the white dwarf magnetic field in polars has been predicted to reduce the strength of angular momentum loss through magnetic braking. We separated the SDSS I-IV sample of CVs into polars and non-polar systems and performed statistical tests to evaluate whether the period distributions are bimodal as predicted by the standard model for CV evolution or not. We confirm the existence of a period gap in the SDSS I-IV sample of non-polar CVs with >98 per cent confidence. The boundaries of the orbital period gap are 147 and 191 minutes, with the lower boundary being different to previously published values (129 min). The orbital period distribution of polars from SDSS I-IV is clearly different and does not show a similar period gap. The SDSS samples as well as previous samples of CVs are consistent with the standard theory of CV evolution. Magnetic braking does indeed seem get disrupted around the fully convective boundary, which causes a detached phase during CV evolution. In polars, the white dwarf magnetic field reduces the strength of magnetic braking and consequently the orbital period distribution of polars does not display an equally profound and extended period gap as non-polars.


title: Investigating Content Planning for Navigating Trade-offs in Knowledge-Grounded Dialogue

abstract: Knowledge-grounded dialogue generation is a challenging task because it requires satisfying two fundamental yet often competing constraints: being responsive in a manner that is specific to what the conversation partner has said while also being attributable to an underlying source document. In this work, we bring this trade-off between these two objectives (specificity and attribution) to light and ask the question: Can explicit content planning before the response generation help the model to address this challenge? To answer this question, we design a framework called PLEDGE, which allows us to experiment with various plan variables explored in prior work, supporting both metric-agnostic and metric-aware approaches. While content planning shows promise, our results on whether it can actually help to navigate this trade-off are mixed -- planning mechanisms that are metric-aware (use automatic metrics during training) are better at automatic evaluations but underperform in human judgment compared to metric-agnostic mechanisms. We discuss how this may be caused by over-fitting to automatic metrics and the need for future work to better calibrate these metrics towards human judgment. We hope the observations from our analysis will inform future work that aims to apply content planning in this context.


title: Exploring the Robustness of Task-oriented Dialogue Systems for Colloquial German Varieties

abstract: Mainstream cross-lingual task-oriented dialogue (ToD) systems leverage the transfer learning paradigm by training a joint model for intent recognition and slot-filling in English and applying it, zero-shot, to other languages. We address a gap in prior research, which often overlooked the transfer to lower-resource colloquial varieties due to limited test data. Inspired by prior work on English varieties, we craft and manually evaluate perturbation rules that transform German sentences into colloquial forms and use them to synthesize test sets in four ToD datasets. Our perturbation rules cover 18 distinct language phenomena, enabling us to explore the impact of each perturbation on slot and intent performance. Using these new datasets, we conduct an experimental evaluation across six different transformers. Here, we demonstrate that when applied to colloquial varieties, ToD systems maintain their intent recognition performance, losing 6% (4.62 percentage points) in accuracy on average. However, they exhibit a significant drop in slot detection, with a decrease of 31% (21 percentage points) in slot F1 score. Our findings are further supported by a transfer experiment from Standard American English to synthetic Urban African American Vernacular English.


title: Prototypical Contrastive Learning through Alignment and Uniformity for Recommendation

abstract: Graph Collaborative Filtering (GCF), one of the most widely adopted recommendation system methods, effectively captures intricate relationships between user and item interactions. Graph Contrastive Learning (GCL) based GCF has gained significant attention as it leverages self-supervised techniques to extract valuable signals from real-world scenarios. However, many methods usually learn the instances of discrimination tasks that involve the construction of contrastive pairs through random sampling. GCL approaches suffer from sampling bias issues, where the negatives might have a semantic structure similar to that of the positives, thus leading to a loss of effective feature representation. To address these problems, we present the \underline{Proto}typical contrastive learning through \underline{A}lignment and \underline{U}niformity for recommendation, which is called \textbf{ProtoAU}. Specifically, we first propose prototypes (cluster centroids) as a latent space to ensure consistency across different augmentations from the origin graph, aiming to eliminate the need for random sampling of contrastive pairs. Furthermore, the absence of explicit negatives means that directly optimizing the consistency loss between instance and prototype could easily result in dimensional collapse issues. Therefore, we propose aligning and maintaining uniformity in the prototypes of users and items as optimization objectives to prevent falling into trivial solutions. Finally, we conduct extensive experiments on four datasets and evaluate their performance on the task of link prediction. Experimental results demonstrate that the proposed ProtoAU outperforms other representative methods. The source codes of our proposed ProtoAU are available at \url{https://github.com/oceanlvr/ProtoAU}.


title: Translation Errors Significantly Impact Low-Resource Languages in Cross-Lingual Learning

abstract: Popular benchmarks (e.g., XNLI) used to evaluate cross-lingual language understanding consist of parallel versions of English evaluation sets in multiple target languages created with the help of professional translators. When creating such parallel data, it is critical to ensure high-quality translations for all target languages for an accurate characterization of cross-lingual transfer. In this work, we find that translation inconsistencies do exist and interestingly they disproportionally impact low-resource languages in XNLI. To identify such inconsistencies, we propose measuring the gap in performance between zero-shot evaluations on the human-translated and machine-translated target text across multiple target languages; relatively large gaps are indicative of translation errors. We also corroborate that translation errors exist for two target languages, namely Hindi and Urdu, by doing a manual reannotation of human-translated test instances in these two languages and finding poor agreement with the original English labels these instances were supposed to inherit.


title: Risk-Sensitive Diffusion for Perturbation-Robust Optimization

abstract: The essence of score-based generative models (SGM) is to optimize a score-based model towards the score function. However, we show that noisy samples incur another objective function, rather than the one with score function, which will wrongly optimize the model. To address this problem, we first consider a new setting where every noisy sample is paired with a risk vector, indicating the data quality (e.g., noise level). This setting is very common in real-world applications, especially for medical and sensor data. Then, we introduce risk-sensitive SDE, a type of stochastic differential equation (SDE) parameterized by the risk vector. With this tool, we aim to minimize a measure called perturbation instability, which we define to quantify the negative impact of noisy samples on optimization. We will prove that zero instability measure is only achievable in the case where noisy samples are caused by Gaussian perturbation. For non-Gaussian cases, we will also provide its optimal coefficients that minimize the misguidance of noisy samples. To apply risk-sensitive SDE in practice, we extend widely used diffusion models to their risk-sensitive versions and derive a risk-free loss that is efficient for computation. We also have conducted numerical experiments to confirm the validity of our theorems and show that they let SGM be robust to noisy samples for optimization.


title: GliDe with a CaPE: A Low-Hassle Method to Accelerate Speculative Decoding

abstract: Speculative decoding is a relatively new decoding framework that leverages small and efficient draft models to reduce the latency of LLMs. In this study, we introduce GliDe and CaPE, two low-hassle modifications to vanilla speculative decoding to further improve the decoding speed of a frozen LLM. Specifically, GliDe is a modified draft model architecture that reuses the cached keys and values from the target LLM, while CaPE is a proposal expansion method that uses the draft model's confidence scores to help select additional candidate tokens for verification. Extensive experiments on different benchmarks demonstrate that our proposed GliDe draft model significantly reduces the expected decoding latency. Additional evaluation using walltime reveals that GliDe can accelerate Vicuna models up to 2.17x and further extend the improvement to 2.61x with CaPE. We will release our code, data, and the trained draft models.


title: Graph Configurations and Independent Bondage Numbers of Planar Graphs

abstract: The independent domination number of a finite graph G is the minimum cardinality of an independent dominating set of vertices. The independent bondage number of G is the minimum cardinality of a set of edges whose deletion results in a graph with a larger independent domination number than that of G. In this research, we enhance the existing upper bound on the independent bondage number of a planar graph with a minimum degree of at least three by identifying specific configurations within such planar graphs.


title: Revisiting the Markov Property for Machine Translation

abstract: In this paper, we re-examine the Markov property in the context of neural machine translation. We design a Markov Autoregressive Transformer~(MAT) and undertake a comprehensive assessment of its performance across four WMT benchmarks. Our findings indicate that MAT with an order larger than 4 can generate translations with quality on par with that of conventional autoregressive transformers. In addition, counter-intuitively, we also find that the advantages of utilizing a higher-order MAT do not specifically contribute to the translation of longer sentences.


title: DeCoF: Generated Video Detection via Frame Consistency: The First Benchmark Dataset

abstract: The escalating quality of video generated by advanced video generation methods results in new security challenges, while there have been few relevant research efforts: 1) There is no open-source dataset for generated video detection, 2) No generated video detection method has been proposed so far. To this end, we propose an open-source dataset and a detection method for generated video for the first time. First, we propose a scalable dataset consisting of 964 prompts, covering various forgery targets, scenes, behaviors, and actions, as well as various generation models with different architectures and generation methods, including the most popular commercial models like OpenAI's Sora and Google's Veo. Second, we found via probing experiments that spatial artifact-based detectors lack generalizability. Hence, we propose a simple yet effective \textbf{de}tection model based on \textbf{f}rame \textbf{co}nsistency (\textbf{DeCoF}), which focuses on temporal artifacts by eliminating the impact of spatial artifacts during feature learning. Extensive experiments demonstrate the efficacy of DeCoF in detecting videos generated by unseen video generation models and confirm its powerful generalizability across several commercially proprietary models. Our code and dataset will be released at \url{https://github.com/wuwuwuyue/DeCoF}.


title: A reformulation to Embedding a Neural Network in a linear program without integer variables

abstract: In this technical report, a new formulation for embedding a neural network into an optimization model is described. This formulation does not require binary variables to properly compute the output of the neural network for specific types of problems. Preliminary experiments show that this reformulation resulted in faster computation times when solving a proposed showcase model, in which non-linearity is necessary to be computed. This is in comparison with the classic formulation and off-the-shelf tools of commercial solvers.


title: Formation of Fan-spine Magnetic Topology through Flux Emergence and Subsequent Jet Production

abstract: Fan-spine magnetic structure, as a fundamental three-dimensional topology in magnetic reconnection theory, plays a crucial role in producing solar jets. However, how fan-spine configurations form in the solar atmosphere remains elusive. Using the Chinese H$\alpha$ Solar Explorer (CHASE) and the Solar Dynamics Observatory (SDO), we present a case study on the complete buildup of fan-spine topology driven by flux emergence and the subsequent jet production. Two fan-spine structures and the two associated null points are present. Variations in null-point heights and locations were tracked over time during flux emergence. The north fan-spine structure is found to be created through magnetic reconnection between the newly emerged flux and the background field. Gentle reconnection persistently occurs after formation of the north fan-spine structure, resulting in weak plasma outflows. Subsequently, as flux emergence and magnetic helicity injection continue, the formation and eruption of mini-filaments after reconnection at the quasi-separatrix layer between the two nulls trigger three homologous jets. The CHASE observations reveal that the circular flare ribbon, inner bright patch, and remote brightening all exhibit redshifted signatures during these jet ejections. This work unveils the key role of flux emergence in the formation of fan-spine topology, and highlights the importance of mini-filaments for subsequent jet production.


title: DCS-Net: Pioneering Leakage-Free Point Cloud Pretraining Framework with Global Insights

abstract: Masked autoencoding and generative pretraining have achieved remarkable success in computer vision and natural language processing, and more recently, they have been extended to the point cloud domain. Nevertheless, existing point cloud models suffer from the issue of information leakage due to the pre-sampling of center points, which leads to trivial proxy tasks for the models. These approaches primarily focus on local feature reconstruction, limiting their ability to capture global patterns within point clouds. In this paper, we argue that the reduced difficulty of pretext tasks hampers the model's capacity to learn expressive representations. To address these limitations, we introduce a novel solution called the Differentiable Center Sampling Network (DCS-Net). It tackles the information leakage problem by incorporating both global feature reconstruction and local feature reconstruction as non-trivial proxy tasks, enabling simultaneous learning of both the global and local patterns within point cloud. Experimental results demonstrate that our method enhances the expressive capacity of existing point cloud models and effectively addresses the issue of information leakage.


title: Recent Advances in Digital Image and Video Forensics, Anti-forensics and Counter Anti-forensics

abstract: Image and video forensics have recently gained increasing attention due to the proliferation of manipulated images and videos, especially on social media platforms, such as Twitter and Instagram, which spread disinformation and fake news. This survey explores image and video identification and forgery detection covering both manipulated digital media and generative media. However, media forgery detection techniques are susceptible to anti-forensics; on the other hand, such anti-forensics techniques can themselves be detected. We therefore further cover both anti-forensics and counter anti-forensics techniques in image and video. Finally, we conclude this survey by highlighting some open problems in this domain.


title: Physical Perception Network and an All-weather Multi-modality Benchmark for Adverse Weather Image Fusion

abstract: Multi-modality image fusion (MMIF) integrates the complementary information from different modal images to provide comprehensive and objective interpretation of a scenes. However, existing MMIF methods lack the ability to resist different weather interferences in real-life scenarios, preventing them from being useful in practical applications such as autonomous driving. To bridge this research gap, we proposed an all-weather MMIF model. Regarding deep learning architectures, their network designs are often viewed as a black box, which limits their multitasking capabilities. For deweathering module, we propose a physically-aware clear feature prediction module based on an atmospheric scattering model that can deduce variations in light transmittance from both scene illumination and depth. For fusion module, We utilize a learnable low-rank representation model to decompose images into low-rank and sparse components. This highly interpretable feature separation allows us to better observe and understand images. Furthermore, we have established a benchmark for MMIF research under extreme weather conditions. It encompasses multiple scenes under three types of weather: rain, haze, and snow, with each weather condition further subdivided into various impact levels. Extensive fusion experiments under adverse weather demonstrate that the proposed algorithm has excellent detail recovery and multi-modality feature extraction capabilities.


title: Feasibility of PET-enabled dual-energy CT imaging: First physical phantom and patient results

abstract: X-ray computed tomography (CT) in PET/CT is commonly operated with a single energy, resulting in a limitation of lacking tissue composition information. Dual-energy (DE) spectral CT enables material decomposition by using two different x-ray energies and may be combined with PET for improved multimodality imaging, but would either require hardware upgrade or increase radiation dose due to the added second x-ray CT scan. Recently proposed PET-enabled DECT method allows dual-energy spectral imaging using a conventional PET/CT scanner without the need for a second x-ray CT scan. A gamma-ray CT (gCT) image at 511 keV can be generated from the existing time-of-flight PET data with the maximum-likelihood attenuation and activity (MLAA) approach and is then combined with the low-energy x-ray CT image to form dual-energy spectral imaging. To improve the image quality of gCT, a kernel MLAA method was further proposed by incorporating x-ray CT as a priori information. The concept of this PET-enabled DECT has been validated using simulation studies, but not yet with 3D real data. In this work, we developed a general open-source implementation for gCT reconstruction from PET data and use this implementation for the first real data validation with both a physical phantom study and a human subject study on a uEXPLORER total-body PET/CT system. These results have demonstrated the feasibility of this method for spectral imaging and material decomposition.


title: Crash-perching on vertical poles with a hugging-wing robot

abstract: Perching with winged Unmanned Aerial Vehicles has often been solved by means of complex control or intricate appendages. Here, we present a simple yet novel method that relies on passive wing morphing for crash-landing on trees and other types of vertical poles. Inspired by the adaptability of animals' and bats' limbs in gripping and holding onto trees, we design dual-purpose wings that enable both aerial gliding and perching on poles. With an upturned nose design, the robot can passively reorient from horizontal flight to vertical upon a head-on crash with a pole, followed by hugging with its wings to perch. We characterize the performance of reorientation and perching in terms of impact speed and angle, pole material, and size. The robot robustly reorients at impact angles above 15{\deg} and speeds of 3 m/s to 9 m/s, and can hold onto various pole types larger than 28% of its wingspan in diameter. We demonstrate crash-perching on tree trunks with an overall success rate of 71%. The method opens up new possibilities for the use of aerial robots in applications such as inspection, maintenance, and biodiversity conservation.


title: Wireguard: An Efficient Solution for Securing IoT Device Connectivity

abstract: The proliferation of vulnerable Internet-of-Things (IoT) devices has enabled large-scale cyberattacks. Solutions like Hestia and HomeSnitch have failed to comprehensively address IoT security needs. This research evaluates if Wireguard, an emerging VPN protocol, can provide efficient security tailored for resource-constrained IoT systems. We compared Wireguards performance against standard protocols OpenVPN and IPsec in a simulated IoT environment. Metrics measured included throughput, latency, and jitter during file transfers. Initial results reveal Wireguard's potential as a lightweight yet robust IoT security solution despite disadvantages for Wireguard in our experimental environment. With further testing, Wireguards simplicity and low overhead could enable widespread VPN adoption to harden IoT devices against attacks. The protocols advantages in setup time, performance, and compatibility make it promising for integration especially on weak IoT processors and networks.


title: Deep Semantic-Visual Alignment for Zero-Shot Remote Sensing Image Scene Classification

abstract: Deep neural networks have achieved promising progress in remote sensing (RS) image classification, for which the training process requires abundant samples for each class. However, it is time-consuming and unrealistic to annotate labels for each RS category, given the fact that the RS target database is increasing dynamically. Zero-shot learning (ZSL) allows for identifying novel classes that are not seen during training, which provides a promising solution for the aforementioned problem. However, previous ZSL models mainly depend on manually-labeled attributes or word embeddings extracted from language models to transfer knowledge from seen classes to novel classes. Besides, pioneer ZSL models use convolutional neural networks pre-trained on ImageNet, which focus on the main objects appearing in each image, neglecting the background context that also matters in RS scene classification. To address the above problems, we propose to collect visually detectable attributes automatically. We predict attributes for each class by depicting the semantic-visual similarity between attributes and images. In this way, the attribute annotation process is accomplished by machine instead of human as in other methods. Moreover, we propose a Deep Semantic-Visual Alignment (DSVA) that take advantage of the self-attention mechanism in the transformer to associate local image regions together, integrating the background context information for prediction. The DSVA model further utilizes the attribute attention maps to focus on the informative image regions that are essential for knowledge transfer in ZSL, and maps the visual images into attribute space to perform ZSL classification. With extensive experiments, we show that our model outperforms other state-of-the-art models by a large margin on a challenging large-scale RS scene classification benchmark.


title: Seeing is not always believing: The Space of Harmless Perturbations

abstract: Existing works have extensively studied adversarial examples, which are minimal perturbations that can mislead the output of deep neural networks (DNNs) while remaining imperceptible to humans. However, in this work, we reveal the existence of a harmless perturbation space, in which perturbations drawn from this space, regardless of their magnitudes, leave the network output unchanged when applied to inputs. Essentially, the harmless perturbation space emerges from the usage of non-injective functions (linear or non-linear layers) within DNNs, enabling multiple distinct inputs to be mapped to the same output. For linear layers with input dimensions exceeding output dimensions, any linear combination of the orthogonal bases of the nullspace of the parameter consistently yields no change in their output. For non-linear layers, the harmless perturbation space may expand, depending on the properties of the layers and input samples. Inspired by this property of DNNs, we solve for a family of general perturbation spaces that are redundant for the DNN's decision, and can be used to hide sensitive data and serve as a means of model identification. Our work highlights the distinctive robustness of DNNs (i.e., consistency under large magnitude perturbations) in contrast to adversarial examples (vulnerability for small imperceptible noises).


title: Decomposition-based and Interference Perception for Infrared and Visible Image Fusion in Complex Scenes

abstract: Infrared and visible image fusion has emerged as a prominent research in computer vision. However, little attention has been paid on complex scenes fusion, causing existing techniques to produce sub-optimal results when suffers from real interferences. To fill this gap, we propose a decomposition-based and interference perception image fusion method. Specifically, we classify the pixels of visible image from the degree of scattering of light transmission, based on which we then separate the detail and energy information of the image. This refined decomposition facilitates the proposed model in identifying more interfering pixels that are in complex scenes. To strike a balance between denoising and detail preservation, we propose an adaptive denoising scheme for fusing detail components. Meanwhile, we propose a new weighted fusion rule by considering the distribution of image energy information from the perspective of multiple directions. Extensive experiments in complex scenes fusions cover adverse weathers, noise, blur, overexposure, fire, as well as downstream tasks including semantic segmentation, object detection, salient object detection and depth estimation, consistently indicate the effectiveness and superiority of the proposed method compared with the recent representative methods.


title: Settling Decentralized Multi-Agent Coordinated Exploration by Novelty Sharing

abstract: Exploration in decentralized cooperative multi-agent reinforcement learning faces two challenges. One is that the novelty of global states is unavailable, while the novelty of local observations is biased. The other is how agents can explore in a coordinated way. To address these challenges, we propose MACE, a simple yet effective multi-agent coordinated exploration method. By communicating only local novelty, agents can take into account other agents' local novelty to approximate the global novelty. Further, we newly introduce weighted mutual information to measure the influence of one agent's action on other agents' accumulated novelty. We convert it as an intrinsic reward in hindsight to encourage agents to exert more influence on other agents' exploration and boost coordinated exploration. Empirically, we show that MACE achieves superior performance in three multi-agent environments with sparse rewards.


title: Self-attention Networks Localize When QK-eigenspectrum Concentrates

abstract: The self-attention mechanism prevails in modern machine learning. It has an interesting functionality of adaptively selecting tokens from an input sequence by modulating the degree of attention localization, which many researchers speculate is the basis of the powerful model performance but complicates the underlying mechanism of the learning dynamics. In recent years, mainly two arguments have connected attention localization to the model performances. One is the rank collapse, where the embedded tokens by a self-attention block become very similar across different tokens, leading to a less expressive network. The other is the entropy collapse, where the attention probability approaches non-uniform and entails low entropy, making the learning dynamics more likely to be trapped in plateaus. These two failure modes may apparently contradict each other because the rank and entropy collapses are relevant to uniform and non-uniform attention, respectively. To this end, we characterize the notion of attention localization by the eigenspectrum of query-key parameter matrices and reveal that a small eigenspectrum variance leads attention to be localized. Interestingly, the small eigenspectrum variance prevents both rank and entropy collapse, leading to better model expressivity and trainability.


title: Analyzing the Evaluation of Cross-Lingual Knowledge Transfer in Multilingual Language Models

abstract: Recent advances in training multilingual language models on large datasets seem to have shown promising results in knowledge transfer across languages and achieve high performance on downstream tasks. However, we question to what extent the current evaluation benchmarks and setups accurately measure zero-shot cross-lingual knowledge transfer. In this work, we challenge the assumption that high zero-shot performance on target tasks reflects high cross-lingual ability by introducing more challenging setups involving instances with multiple languages. Through extensive experiments and analysis, we show that the observed high performance of multilingual models can be largely attributed to factors not requiring the transfer of actual linguistic knowledge, such as task- and surface-level knowledge. More specifically, we observe what has been transferred across languages is mostly data artifacts and biases, especially for low-resource languages. Our findings highlight the overlooked drawbacks of existing cross-lingual test data and evaluation setups, calling for a more nuanced understanding of the cross-lingual capabilities of multilingual models.


title: Weak-measurement-based pseudospin pointer: A cost-effective scheme for precision measurement

abstract: As an essential component of state-of-the-art quantum technologies, fast and efficient quantum measurements are in persistent demand over time. We present a proof-of-principle experiment on a new dimensionless pseudo-spin pointer based on weak measurement. In the context of optical parameter estimation, we demonstrate that the parametric distribution's moment is obtained experimentally by employing the dimensionless pointer without measuring the distribution literally. In addition to the sheer liberation of experimental expense, the photon-countering-based pointer is well-calibrated for the detection of weak signals. We show that for signals $3$-$4$ orders of weaker in strength than the area-array camera method, an order of improvement in precision is achieved experimentally.


title: Are Large Language Models Good Prompt Optimizers?

abstract: LLM-based Automatic Prompt Optimization, which typically utilizes LLMs as Prompt Optimizers to self-reflect and refine prompts, has shown promising performance in recent studies. Despite the success, the underlying mechanism of this approach remains unexplored, and the true effectiveness of LLMs as Prompt Optimizers requires further validation. In this work, we conducted a comprehensive study to uncover the actual mechanism of LLM-based Prompt Optimization. Our findings reveal that the LLM optimizers struggle to identify the true causes of errors during reflection, tending to be biased by their own prior knowledge rather than genuinely reflecting on the errors. Furthermore, even when the reflection is semantically valid, the LLM optimizers often fail to generate appropriate prompts for the target models with a single prompt refinement step, partly due to the unpredictable behaviors of the target models. Based on the observations, we introduce a new "Automatic Behavior Optimization" paradigm, which directly optimizes the target model's behavior in a more controllable manner. We hope our study can inspire new directions for automatic prompt optimization development.


title: Lattice-dynamics and in-plane antiferromagnetism in MnxZn1_xPS3 across the entire composition range

abstract: Alloyed MnxZn1_xPS3 samples have been grown covering the whole compositional range and studied by means of Raman spectroscopy at temperatures covering from 4K up to 850K. Our results, supported by SQUID magnetic measurements, allowed, from one hand, to complete the magnetic phase diagram of MnxZn1_xPS3 and establish x>0.3 as the composition at which the alloy retains antiferromagnetism and, from the other hand, to identify the Raman signatures indicative of a magnetic transition. The origin of these Raman signatures is discussed in terms of spin-phonon coupling resulting in the appearance of low- and high-frequency zone-folded phonon modes. For the alloy, an assignment of the 1st and 2nd order modes is provided with the aid of first-principle lattice-dynamical calculations. The compositional dependence of all phonon modes is described and the presence of zone-folded modes is shown to take place for both, the alloy and MnPS3. Finally, a comparison of the Raman spectra of ZnPS3 to other compounds of the transition-metal phosphorous trisulfide family allowed shows that low-frequency phonon peaks exhibit an abnormally large broadening. This is consistent with previous claims on the occurrence of a second-order Jahn-Teller effect that takes place for ZnPS3 and Zn-rich MnxZn1_xPS3.


title: D\'ej\`a Vu Memorization in Vision-Language Models

abstract: Vision-Language Models (VLMs) have emerged as the state-of-the-art representation learning solution, with myriads of downstream applications such as image classification, retrieval and generation. A natural question is whether these models memorize their training data, which also has implications for generalization. We propose a new method for measuring memorization in VLMs, which we call d\'ej\`a vu memorization. For VLMs trained on image-caption pairs, we show that the model indeed retains information about individual objects in the training images beyond what can be inferred from correlations or the image caption. We evaluate d\'ej\`a vu memorization at both sample and population level, and show that it is significant for OpenCLIP trained on as many as 50M image-caption pairs. Finally, we show that text randomization considerably mitigates memorization while only moderately impacting the model's downstream task performance.


title: Learning Structure-Aware Representations of Dependent Types

abstract: Agda is a dependently-typed programming language and a proof assistant, pivotal in proof formalization and programming language theory. This paper extends the Agda ecosystem into machine learning territory, and, vice versa, makes Agda-related resources available to machine learning practitioners. We introduce and release a novel dataset of Agda program-proofs that is elaborate and extensive enough to support various machine learning applications -- the first of its kind. Leveraging the dataset's ultra-high resolution, detailing proof states at the sub-type level, we propose a novel neural architecture targeted at faithfully representing dependently-typed programs on the basis of structural rather than nominal principles. We instantiate and evaluate our architecture in a premise selection setup, where it achieves strong initial results.


title: ParZC: Parametric Zero-Cost Proxies for Efficient NAS

abstract: Recent advancements in Zero-shot Neural Architecture Search (NAS) highlight the efficacy of zero-cost proxies in various NAS benchmarks. Several studies propose the automated design of zero-cost proxies to achieve SOTA performance but require tedious searching progress. Furthermore, we identify a critical issue with current zero-cost proxies: they aggregate node-wise zero-cost statistics without considering the fact that not all nodes in a neural network equally impact performance estimation. Our observations reveal that node-wise zero-cost statistics significantly vary in their contributions to performance, with each node exhibiting a degree of uncertainty. Based on this insight, we introduce a novel method called Parametric Zero-Cost Proxies (ParZC) framework to enhance the adaptability of zero-cost proxies through parameterization. To address the node indiscrimination, we propose a Mixer Architecture with Bayesian Network (MABN) to explore the node-wise zero-cost statistics and estimate node-specific uncertainty. Moreover, we propose DiffKendall as a loss function to directly optimize Kendall's Tau coefficient in a differentiable manner so that our ParZC can better handle the discrepancies in ranking architectures. Comprehensive experiments on NAS-Bench-101, 201, and NDS demonstrate the superiority of our proposed ParZC compared to existing zero-shot NAS methods. Additionally, we demonstrate the versatility and adaptability of ParZC by transferring it to the Vision Transformer search space.


title: CFD-DEM modeling of fracture initiation with polymer injection in granular media

abstract: We numerically study mechanisms and conditions of fracture initiation in granular material induced by non-Newtonian polymer solutions. A coupling approach of computational fluid dynamics and discrete element method is utilized to model the fluid flow in a porous medium. The flow behavior of polymer solutions and drag force acting on particles are calculated based on a power-law model. The adequacy of the numerical model is confirmed by comparing the results with a laboratory experiment. The numerical results are consistent with the experimental data presenting similar tendencies in dimensionless parameters that incorporate fluid flow rate, rheology, peak pressure, and confining stress. Results show that fluid flow rate, rheology, and solid material characteristics strongly influence fracture initiation behavior. Injecting a more viscous guar-based solution results in wider fractures induced by a grain displacement. A less viscous XG-based solution creates more linear fractures dominated by an infiltration. The peak pressure ratio between two fluids is higher in rigid material compared to softer material. Finally, the dimensionless parameters $1/\Pi_1$ and $\tau_2$, which consider fluid and solid material properties accordingly, are good indicators in determining fracture initiation induced by shear-thinning fluids. Our numerical results show that fracture initiation occurs above $1/\Pi_1 = 0.06$ and $\tau_2 = 2\cdot 10^{-7}$.


title: Study of Star-formation in Dual Nuclei Galaxies using UVIT observations

abstract: We have used the Ultraviolet Imaging Telescope (UVIT) aboard AstroSat to study star formation in a sample of nine dual nuclei galaxies with separations ~11 kpc, which is an expected outcome of galaxy mergers. To minimize the contribution of active galactic nuclei (AGN) emission, we have used mid-IR color cut-offs and masked the AGN-dominated nuclei. The UV continuum slope ($\beta$) is used to calculate the internal extinction (A$_V$) which ranges from 0.53 to 4.04 in the FUV band and 0.44 to 3.10 in the NUV band for the sample. We have detected $1-20$ star-forming clumps (SFCs) in our sample galaxies. The extinction-corrected total FUV star-formation rate (SFR) ranges from $\sim$0.35 to $\sim$32 M$_\odot$ yr$^{-1}$. Our analyses of A$_V$, specific SFR (sSFR) show that dual nuclei sources are associated with dusty, star-forming galaxies. The FUV$-$NUV color maps show redder color in the nuclear and disk regions while bluer color is observed in the outskirts of most galaxies which can be due to embedded dust or different stellar populations. We have found some signatures of possible stellar/AGN feedback like a ring of star formation, a redder ring around blue nuclei, etc. However, further observations are required to confirm this.


title: From Synthetic to Real: Unveiling the Power of Synthetic Data for Video Person Re-ID

abstract: In this paper, we study a new problem of cross-domain video based person re-identification (Re-ID). Specifically, we take the synthetic video dataset as the source domain for training and use the real-world videos for testing, which significantly reduces the dependence on real training data collection and annotation. To unveil the power of synthetic data for video person Re-ID, we first propose a self-supervised domain invariant feature learning strategy for both static and temporal features. Then, to further improve the person identification ability in the target domain, we develop a mean-teacher scheme with the self-supervised ID consistency loss. Experimental results on four real datasets verify the rationality of cross-synthetic-real domain adaption and the effectiveness of our method. We are also surprised to find that the synthetic data performs even better than the real data in the cross-domain setting.


title: Prismatic crystals for smooth schemes in characteristic $p$ with Frobenius lifting mod $p^2$

abstract: Let $(A,(p))$ be a crystalline prism with $A_n = A/p^{n+1}A$ for all $n\geq 0$. Let $\frakX_0$ be a smooth scheme over $A_0$. Suppose that $\frakX_0$ admits a lifting $\frakX_n$ over $A_n$ and the absolute Frobenius $\rF_{\frakX_0}:\frakX_0\to \frakX_0$ admits a lifting over $A_1$. Then we show that there is an equivalence between the category of the prismatic crystals of truncation $n$ on $(\frakX_0/A)_{\Prism}$ and the category of $p$-connections over $\frakX_n$, which is compatible with cohomologies. This generalises a previous work of Ogus. We also give some remarks on trivializing the Hodge--Tate gerbe $\pi_{\frakX_0}^{\rm HT}:\frakX_0^{\rm HT}\to\frakX_0$ introduced by Bhatt--Lurie.