title: BRAINTEASER: Lateral Thinking Puzzles for Large Language Models

abstract: The success of language models has inspired the NLP community to attend to tasks that require implicit and complex reasoning, relying on human-like commonsense mechanisms. While such vertical thinking tasks have been relatively popular, lateral thinking puzzles have received little attention. To bridge this gap, we devise BRAINTEASER: a multiple-choice Question Answering task designed to test the model's ability to exhibit lateral thinking and defy default commonsense associations. We design a three-step procedure for creating the first lateral thinking benchmark, consisting of data collection, distractor generation, and generation of adversarial examples, leading to 1,100 puzzles with high-quality annotations. To assess the consistency of lateral reasoning by models, we enrich BRAINTEASER based on a semantic and contextual reconstruction of its questions. Our experiments with state-of-the-art instruction- and commonsense language models reveal a significant gap between human and model performance, which is further widened when consistency across adversarial formats is considered. We make all of our code and data available to stimulate work on developing and evaluating lateral thinking models.


title: Learning Separable Hidden Unit Contributions for Speaker-Adaptive Lip-Reading

abstract: In this paper, we propose a novel method for speaker adaptation in lip reading, motivated by two observations. Firstly, a speaker's own characteristics can always be portrayed well by his/her few facial images or even a single image with shallow networks, while the fine-grained dynamic features associated with speech content expressed by the talking face always need deep sequential networks to represent accurately. Therefore, we treat the shallow and deep layers differently for speaker adaptive lip reading. Secondly, we observe that a speaker's unique characteristics ( e.g. prominent oral cavity and mandible) have varied effects on lip reading performance for different words and pronunciations, necessitating adaptive enhancement or suppression of the features for robust lip reading. Based on these two observations, we propose to take advantage of the speaker's own characteristics to automatically learn separable hidden unit contributions with different targets for shallow layers and deep layers respectively. For shallow layers where features related to the speaker's characteristics are stronger than the speech content related features, we introduce speaker-adaptive features to learn for enhancing the speech content features. For deep layers where both the speaker's features and the speech content features are all expressed well, we introduce the speaker-adaptive features to learn for suppressing the speech content irrelevant noise for robust lip reading. Our approach consistently outperforms existing methods, as confirmed by comprehensive analysis and comparison across different settings. Besides the evaluation on the popular LRW-ID and GRID datasets, we also release a new dataset for evaluation, CAS-VSR-S68h, to further assess the performance in an extreme setting where just a few speakers are available but the speech content covers a large and diversified range.


title: Adaptive finite element approximation of bilinear optimal control with fractional Laplacian

abstract: We investigate the application of a posteriori error estimates to a fractional optimal control problem with pointwise control constraints. Specifically, we address a problem in which the state equation is formulated as an integral form of the fractional Laplacian equation, with the control variable embedded within the state equation as a coefficient. We propose two distinct finite element discretization approaches for an optimal control problem. The first approach employs a fully discrete scheme where the control variable is discretized using piecewise constant functions. The second approach, a semi-discrete scheme, does not discretize the control variable. Using the first-order optimality condition, the second-order optimality condition, and a solution regularity analysis for the optimal control problem, we devise a posteriori error estimates. We subsequently demonstrate the reliability and efficiency of the proposed error estimators. Based on the established error estimates framework, an adaptive refinement strategy is developed to help achieve the optimal convergence rate. The effectiveness of the refinement strategy is verified by numerical experiments.


title: Video-CSR: Complex Video Digest Creation for Visual-Language Models

abstract: We present a novel task and human annotated dataset for evaluating the ability for visual-language models to generate captions and summaries for real-world video clips, which we call Video-CSR (Captioning, Summarization and Retrieval). The dataset contains 4.8K YouTube video clips of 20-60 seconds in duration and covers a wide range of topics and interests. Each video clip corresponds to 5 independently annotated captions (1 sentence) and summaries (3-10 sentences). Given any video selected from the dataset and its corresponding ASR information, we evaluate visual-language models on either caption or summary generation that is grounded in both the visual and auditory content of the video. Additionally, models are also evaluated on caption- and summary-based retrieval tasks, where the summary-based retrieval task requires the identification of a target video given excerpts of a corresponding summary. Given the novel nature of the paragraph-length video summarization task, we perform extensive comparative analyses of different existing evaluation metrics and their alignment with human preferences. Finally, we propose a foundation model with competitive generation and retrieval capabilities that serves as a baseline for the Video-CSR task. We aim for Video-CSR to serve as a useful evaluation set in the age of large language models and complex multi-modal tasks.


title: Invariants of real vector bundles

abstract: For a compact smooth manifold with corners (or finite CW-complex) $X$, we can prescribe a finite set of spin or spin$^h$ manifolds (possibly with boundary) mapping into it so that every real vector bundle over $X$ is determined, up to stable equivalence, by the Dirac indices of the real vector bundle when pulled-back onto those prescribed spin or spin$^h$ manifolds.


title: Local to Global: A Distributed Quantum Approximate Optimization Algorithm for Pseudo-Boolean Optimization Problems

abstract: With the rapid advancement of quantum computing, Quantum Approximate Optimization Algorithm (QAOA) is considered as a promising candidate to demonstrate quantum supremacy, which exponentially solves a class of Quadratic Unconstrained Binary Optimization (QUBO) problems. However, limited qubit availability and restricted coherence time challenge QAOA to solve large-scale pseudo-Boolean problems on currently available Near-term Intermediate Scale Quantum (NISQ) devices. In this paper, we propose a distributed QAOA which can solve a general pseudo-Boolean problem by converting it to a simplified Ising model. Different from existing distributed QAOAs' assuming that local solutions are part of a global one, which is not often the case, we introduce community detection using Louvian algorithm to partition the graph where subgraphs are further compressed by community representation and merged into a higher level subgraph. Recursively and backwards, local solutions of lower level subgraphs are updated by heuristics from solutions of higher level subgraphs. Compared with existing methods, our algorithm incorporates global heuristics into local solutions such that our algorithm is proven to achieve a higher approximation ratio and outperforms across different graph configurations. Also, ablation studies validate the effectiveness of each component in our method.


title: Pushing the Limits of Pre-training for Time Series Forecasting in the CloudOps Domain

abstract: Time series has been left behind in the era of pre-training and transfer learning. While research in the fields of natural language processing and computer vision are enjoying progressively larger datasets to train massive models, the most popular time series datasets consist of only tens of thousands of time steps, limiting our ability to study the effectiveness of pre-training and scaling. Recent studies have also cast doubt on the need for expressive models and scale. To alleviate these issues, we introduce three large-scale time series forecasting datasets from the cloud operations (CloudOps) domain, the largest having billions of observations, enabling further study into pre-training and scaling of time series models. We build the empirical groundwork for studying pre-training and scaling of time series models and pave the way for future research by identifying a promising candidate architecture. We show that it is a strong zero-shot baseline and benefits from further scaling, both in model and dataset size. Accompanying these datasets and results is a suite of comprehensive benchmark results comparing classical and deep learning baselines to our pre-trained method - achieving a 27% reduction in error on the largest dataset. Code and datasets can be found https://github.com/SalesforceAIResearch/pretrain-time-series-cloudops.


title: sign.mt: Real-Time Multilingual Sign Language Translation Application

abstract: This demo paper presents sign.mt, an open-source application pioneering real-time multilingual bi-directional translation between spoken and signed languages. Harnessing state-of-the-art open-source models, this tool aims to address the communication divide between the hearing and the deaf, facilitating seamless translation in both spoken-to-signed and signed-to-spoken translation directions. Promising reliable and unrestricted communication, sign.mt offers offline functionality, crucial in areas with limited internet connectivity. It further enhances user engagement by offering customizable photo-realistic sign language avatars, thereby encouraging a more personalized and authentic user experience. Licensed under CC BY-NC-SA 4.0, sign.mt signifies an important stride towards open, inclusive communication. The app can be used, and modified for personal and academic uses, and even supports a translation API, fostering integration into a wider range of applications. However, it is by no means a finished product. We invite the NLP community to contribute towards the evolution of sign.mt. Whether it be the integration of more refined models, the development of innovative pipelines, or user experience improvements, your contributions can propel this project to new heights. Available at https://sign.mt, it stands as a testament to what we can achieve together, as we strive to make communication accessible to all.


title: Systematic Search for Water Fountain Candidates using the Databases of Circumstellar Maser Sources

abstract: Water fountains (WFs) are thought to be objects in the morphological evolution of the circumstellar envelopes of low- and intermediate-mass evolved stars, transitioning from spherically symmetric to asymmetric shapes. We used databases of circumstellar 1612 MHz OH and 22.235 GHz H$_2$O maser sources to search for new WF candidates using the criterion of a larger velocity range of the H$_2$O maser emission compared to that of the OH maser emission. Thus, it is in principle possible to identify WFs with an H$_2$O velocity ranges smaller than those for the previously known WFs. For the OH maser line, we analyzed database entries of 8,474 observations from 2,195 sources, and 6,085 observations from 3,642 sources for H$_2$O maser line. After a close examination of the velocity ranges and line profiles, we identified 11 sources that meet the criterion mentioned above. We examined the IRAS colors of the selected sources and found that two of them (IRAS 19069+0916 and IRAS 19319+2214) are in the color region for post-AGB stars. We find that the maser velocity criterion can discover other astrophysically interesting objects than just WFs. Such objects may include peculiar planetary nebulae with maser emissions and stellar merger remnants.


title: Guideline Learning for In-context Information Extraction

abstract: Large language models (LLMs) can perform a new task by merely conditioning on task instructions and a few input-output examples, without optimizing any parameters. This is called In-Context Learning (ICL). In-context Information Extraction (IE) has recently garnered attention in the research community. However, the performance of In-context IE generally lags behind the state-of-the-art supervised expert models. We highlight a key reason for this shortfall: underspecified task description. The limited-length context struggles to thoroughly express the intricate IE task instructions and various edge cases, leading to misalignment in task comprehension with humans. In this paper, we propose a Guideline Learning (GL) framework for In-context IE which reflectively learns and follows guidelines. During the learning phrase, GL automatically synthesizes a set of guidelines based on a few error cases, and during inference, GL retrieves helpful guidelines for better ICL. Moreover, we propose a self-consistency-based active learning method to enhance the efficiency of GL. Experiments on event extraction and relation extraction show that GL can significantly improve the performance of in-context IE.


title: Robust-GBDT: GBDT with Nonconvex Loss for Tabular Classification in the Presence of Label Noise and Class Imbalance

abstract: Dealing with label noise in tabular classification tasks poses a persistent challenge in machine learning. While robust boosting methods have shown promise in binary classification, their effectiveness in complex, multi-class scenarios is often limited. Additionally, issues like imbalanced datasets, missing values, and computational inefficiencies further complicate their practical utility. This study introduces Robust-GBDT, a groundbreaking approach that combines the power of Gradient Boosted Decision Trees (GBDT) with the resilience of nonconvex loss functions against label noise. By leveraging local convexity within specific regions, Robust-GBDT demonstrates unprecedented robustness, challenging conventional wisdom. Through seamless integration of advanced GBDT with a novel Robust Focal Loss tailored for class imbalance, Robust-GBDT significantly enhances generalization capabilities, particularly in noisy and imbalanced datasets. Notably, its user-friendly design facilitates integration with existing open-source code, enhancing computational efficiency and scalability. Extensive experiments validate Robust-GBDT's superiority over other noise-robust methods, establishing a new standard for accurate classification amidst label noise. This research heralds a paradigm shift in machine learning, paving the way for a new era of robust and precise classification across diverse real-world applications.


title: Helmholtz-Weyl decomposition on a time dependent domain for time periodic Navier-Stokes flows with large flux

abstract: We consider the Helmholtz-Weyl decomposition on a time dependent bounded domain $\Omega(t)$ in $\mathbb{R}^3$. Especially, we investigate the domain dependence of each component in the decomposition, namely, the harmonic vector fields (i.e., $\mathrm{div}$ and $\mathrm{rot}$ free vectors), vector potentials, and scalar potentials equipped with suitable boundary conditions, when $\Omega(t)$ moves along to $t\in\mathbb{R}$. As an application, we construct a time periodic solution of the incompressible Navier-Stokes equations for some large boundary data with non-zero fluxes.


title: Unleashing the Multilingual Encoder Potential: Boosting Zero-Shot Performance via Probability Calibration

abstract: Pretrained multilingual encoder models can directly perform zero-shot multilingual tasks or linguistic probing by reformulating the input examples into cloze-style prompts. This is accomplished by predicting the probabilities of the label words at the masked token position, without requiring any updates to the model parameters. However, the performance of this method is limited by the model's bias toward predicting label words which frequently occurred during the pretraining. These words typically receive high probabilities. To address this issue, we combine the models with calibration techniques which modify the probabilities of label words predicted by the models. We first validate the effectiveness of a proposed simple calibration method together with other existing techniques on monolingual encoders in both zero- and few-shot scenarios. We subsequently employ these calibration techniques on multilingual encoders, resulting in substantial performance improvements across a wide range of tasks.


title: CO-ASnet :A Smart Contract Architecture Design based on Blockchain Technology with Active Sensor Networks

abstract: The influence of opinion leaders impacts different aspects of social finance. How to analyse the utility of opinion leaders' influence in realizing assets on the blockchain and adopt a compliant regulatory scheme is worth exploring and pondering. Taking Musk's call on social media to buy Dogecoin as an example, this paper uses an event study to empirically investigate the phenomenon in which opinion leaders use ICOs (initial coin offerings) to exert influence. The results show that opinion leaders can use ICOs to influence the price of token assets with money and data traffic in their social network. They can obtain excess returns and reduce the cost of realization so that the closed loop of influence realization will be accelerated. Based on this phenomenon and the results of its impact, we use the ChainLink Oracle with Active Sensor Networks(CO-ASnet) to design a safe and applicable decentralized regulatory scheme that can constructively provide risk assessment strategies and early warning measures for token issuance. The influence realization of opinion leaders in blockchain issuance is bound to receive widespread attention, and this paper will provide an exemplary reference for regulators and enterprises to explore the boundaries of blockchain financial product development and governance.


title: Progress in Analytical Solutions for High Order Harmonic Generation in Semiconductor Superlattice Multipliers

abstract: In this study, we address the limitations of previous solutions for modeling high-order harmonics in semiconductor superlattices (SSLs). Earlier research proposed a step function ansatz that effectively modeled high-order even and odd harmonics but introduced numerical noise. An upgrade using a logistic function addressed the noise problem but eliminated high-order odd harmonics. To overcome both limitations, we examined the impact of the y-intercept value in the discontinuity of the step function and proposed a modified logistic function as a new ansatz. The modified logistic function delivers accurate results, preserving high-order odd harmonics up to the 50th order similar to the previous ansatz while also eliminating numerical noise. This research contributes to a more efficient and robust analytical approach for modeling SSLs, notably by avoiding time-consuming numerical solutions and enhancing our understanding of nonlinear phenomena in GHz-THz devices.


title: Performance Analysis of RIS-Aided Double Spatial Scattering Modulation for mmWave MIMO Systems

abstract: In this paper, we investigate a practical structure of reconfigurable intelligent surface (RIS)-based double spatial scattering modulation (DSSM) for millimeter-wave (mmWave) multiple-input multiple-output (MIMO) systems. A suboptimal detector is proposed, in which the beam direction is first demodulated according to the received beam strength, and then the remaining information is demodulated by adopting the maximum likelihood algorithm. Based on the proposed suboptimal detector, we derive the conditional pairwise error probability expression. Further, the exact numerical integral and closed-form expressions of unconditional pairwise error probability (UPEP) are derived via two different approaches. To provide more insights, we derive the upper bound and asymptotic expressions of UPEP. In addition, the diversity gain of the RIS-DSSM scheme was also given. Furthermore, the union upper bound of average bit error probability (ABEP) is obtained by combining the UPEP and the number of error bits. Simulation results are provided to validate the derived upper bound and asymptotic expressions of ABEP. We found an interesting phenomenon that the ABEP performance of the proposed system-based phase shift keying is better than that of the quadrature amplitude modulation. Additionally, the performance advantage of ABEP is more significant with the increase in the number of RIS elements.


title: Enhancing Argument Structure Extraction with Efficient Leverage of Contextual Information

abstract: Argument structure extraction (ASE) aims to identify the discourse structure of arguments within documents. Previous research has demonstrated that contextual information is crucial for developing an effective ASE model. However, we observe that merely concatenating sentences in a contextual window does not fully utilize contextual information and can sometimes lead to excessive attention on less informative sentences. To tackle this challenge, we propose an Efficient Context-aware ASE model (ECASE) that fully exploits contextual information by enhancing modeling capacity and augmenting training data. Specifically, we introduce a sequence-attention module and distance-weighted similarity loss to aggregate contextual information and argumentative information. Additionally, we augment the training data by randomly masking discourse markers and sentences, which reduces the model's reliance on specific words or less informative sentences. Our experiments on five datasets from various domains demonstrate that our model achieves state-of-the-art performance. Furthermore, ablation studies confirm the effectiveness of each module in our model.


title: DialCoT Meets PPO: Decomposing and Exploring Reasoning Paths in Smaller Language Models

abstract: Chain-of-Thought (CoT) prompting has proven to be effective in enhancing the reasoning capabilities of Large Language Models (LLMs) with at least 100 billion parameters. However, it is ineffective or even detrimental when applied to reasoning tasks in Smaller Language Models (SLMs) with less than 10 billion parameters. To address this limitation, we introduce Dialogue-guided Chain-of-Thought (DialCoT) which employs a dialogue format to generate intermediate reasoning steps, guiding the model toward the final answer. Additionally, we optimize the model's reasoning path selection using the Proximal Policy Optimization (PPO) algorithm, further enhancing its reasoning capabilities. Our method offers several advantages compared to previous approaches. Firstly, we transform the process of solving complex reasoning questions by breaking them down into a series of simpler sub-questions, significantly reducing the task difficulty and making it more suitable for SLMs. Secondly, we optimize the model's reasoning path selection through the PPO algorithm. We conduct comprehensive experiments on four arithmetic reasoning datasets, demonstrating that our method achieves significant performance improvements compared to state-of-the-art competitors.


title: Decentralized Federated Learning via MIMO Over-the-Air Computation: Consensus Analysis and Performance Optimization

abstract: Decentralized federated learning (DFL), inherited from distributed optimization, is an emerging paradigm to leverage the explosively growing data from wireless devices in a fully distributed manner.DFL enables joint training of machine learning model under device to device (D2D) communication fashion without the coordination of a parameter server. However, the deployment of wireless DFL is facing some pivotal challenges. Communication is a critical bottleneck due to the required extensive message exchange between neighbor devices to share the learned model. Besides, consensus becomes increasingly difficult as the number of devices grows because there is no available central server to perform coordination. To overcome these difficulties, this paper proposes employing over-the-air computation (Aircomp) to improve communication efficiency by exploiting the superposition property of analog waveform in multi-access channels, and introduce the mixing matrix mechanism to promote consensus using the spectral property of symmetric doubly stochastic matrix. Specifically, we develop a novel multiple-input multiple-output over-the-air DFL (MIMO OA-DFL) framework to study over-the-air DFL problem over MIMO multiple access channels. We conduct a general convergence analysis to quantitatively capture the influence of aggregation weight and communication error on the MIMO OA-DFL performance in \emph{ad hoc} networks. The result shows that the communication error together with the spectral gap of mixing matrix has a significant impact on the learning performance. Based on this, a joint communication-learning optimization problem is formulated to optimize transceiver beamformers and mixing matrix. Extensive numerical experiments are performed to reveal the characteristics of different topologies and demonstrate the substantial learning performance enhancement of our proposed algorithm.


title: Towards Scalable Wireless Federated Learning: Challenges and Solutions

abstract: The explosive growth of smart devices (e.g., mobile phones, vehicles, drones) with sensing, communication, and computation capabilities gives rise to an unprecedented amount of data. The generated massive data together with the rapid advancement of machine learning (ML) techniques spark a variety of intelligent applications. To distill intelligence for supporting these applications, federated learning (FL) emerges as an effective distributed ML framework, given its potential to enable privacy-preserving model training at the network edge. In this article, we discuss the challenges and solutions of achieving scalable wireless FL from the perspectives of both network design and resource orchestration. For network design, we discuss how task-oriented model aggregation affects the performance of wireless FL, followed by proposing effective wireless techniques to enhance the communication scalability via reducing the model aggregation distortion and improving the device participation. For resource orchestration, we identify the limitations of the existing optimization-based algorithms and propose three task-oriented learning algorithms to enhance the algorithmic scalability via achieving computation-efficient resource allocation for wireless FL. We highlight several potential research issues that deserve further study.


title: FedFed: Feature Distillation against Data Heterogeneity in Federated Learning

abstract: Federated learning (FL) typically faces data heterogeneity, i.e., distribution shifting among clients. Sharing clients' information has shown great potentiality in mitigating data heterogeneity, yet incurs a dilemma in preserving privacy and promoting model performance. To alleviate the dilemma, we raise a fundamental question: \textit{Is it possible to share partial features in the data to tackle data heterogeneity?} In this work, we give an affirmative answer to this question by proposing a novel approach called {\textbf{Fed}erated \textbf{Fe}ature \textbf{d}istillation} (FedFed). Specifically, FedFed partitions data into performance-sensitive features (i.e., greatly contributing to model performance) and performance-robust features (i.e., limitedly contributing to model performance). The performance-sensitive features are globally shared to mitigate data heterogeneity, while the performance-robust features are kept locally. FedFed enables clients to train models over local and shared data. Comprehensive experiments demonstrate the efficacy of FedFed in promoting model performance.


title: Partial Rank Similarity Minimization Method for Quality MOS Prediction of Unseen Speech Synthesis Systems in Zero-Shot and Semi-supervised setting

abstract: This paper introduces a novel objective function for quality mean opinion score (MOS) prediction of unseen speech synthesis systems. The proposed function measures the similarity of relative positions of predicted MOS values, in a mini-batch, rather than the actual MOS values. That is the partial rank similarity is measured (PRS) rather than the individual MOS values as with the L1 loss. Our experiments on out-of-domain speech synthesis systems demonstrate that the PRS outperforms L1 loss in zero-shot and semi-supervised settings, exhibiting stronger correlation with ground truth. These findings highlight the importance of considering rank order, as done by PRS, when training MOS prediction models. We also argue that mean squared error and linear correlation coefficient metrics may be unreliable for evaluating MOS prediction models. In conclusion, PRS-trained models provide a robust framework for evaluating speech quality and offer insights for developing high-quality speech synthesis systems. Code and models are available at github.com/nii-yamagishilab/partial_rank_similarity/


title: Revisiting Block-based Quantisation: What is Important for Sub-8-bit LLM Inference?

abstract: The inference of Large language models (LLMs) requires immense computation and memory resources. To curtail these costs, quantisation has merged as a promising solution, but existing LLM quantisation mainly focuses on 8-bit. In this work, we explore the statistical and learning properties of the LLM layer and attribute the bottleneck of LLM quantisation to numerical scaling offsets. To address this, we adapt block quantisations for LLMs, a family of methods that share scaling factors across packed numbers. Block quantisations efficiently reduce the numerical scaling offsets solely from an arithmetic perspective, without additional treatments in the computational path. Our nearly-lossless quantised 6-bit LLMs achieve a $19\times$ higher arithmetic density and $5\times$ memory density than the float32 baseline, surpassing the prior art 8-bit quantisation by $2.5\times$ in arithmetic density and $1.2\times$ in memory density, without requiring any data calibration or re-training. We also share our insights into sub-8-bit LLM quantisation, including the mismatch between activation and weight distributions, optimal fine-tuning strategies, and a lower quantisation granularity inherent in the statistical properties of LLMs. The latter two tricks enable nearly-lossless 4-bit LLMs on downstream tasks. Our code is open-sourced.


title: Quantum Gravity Phenomenology and Particle Physics

abstract: Quantum gravity phenomenology has been historically regarded as a difficult endeavour, due to the apparent scarcity of phenomena involving the required scales of length (Planck length $l_P$) and energy (Planck energy $E_P$). It was realized, however, that one can look for cumulative effects of a quantum theory of gravity at energies $E/E_P \ll 1$ if even tiny effects are amplified by the large time of flight or very high energies, common to astrophysical phenomena. In the this work, complementary to the COST action CA18108 White Book, we put forward a proposal that quantum gravity phenomenology can be fruitfully pursued also with the help of terrestrial particles accelerators. We first discuss the theoretical background, and then concentrate on deformed discrete symmetries C,P,T. We investigate possible experimental signatures of CPT deformation, particularly concerning the difference in decay time between particles and antiparticles, and fields interference.


title: Characterizing Aqueous Foams by In-situ Viscosity Measurement in a Foam Column

abstract: Foam characterization is essential in many applications of foams, such as cleaning, food processing, cosmetics, and oil production, due to these applications diversified requirements. The standard characterization method, the foam column test, cannot provide sufficient information for in-depth studies. Hence, there have been many studies that incorporated different characterization methods into the standard test. It should be enlightening and feasible to measure the foam viscosity, which is both of practical and fundamental interest, during the foam column test, but it has never been done before. Here, we demonstrate a method to characterize aqueous foams and their aging behaviors with simultaneous measurement of foam viscosity and foam height. Using a vibration viscometer, we integrate foam column experiments with in-situ foam viscosity measurements. We studied the correlation among the foam structure, foam height, and foam viscosity during the foam decay process. We found a drastic decrease in foam viscosity in the early foam decay while the foam height remained unchanged, which is explained by coarsening. This method is much more sensitive and time-efficient than conventional foam-height-based methods by comparing the half-life. This method successfully characterizes the stability of foams made of various combinations of surfactants and gases.


title: Cross-head mutual Mean-Teaching for semi-supervised medical image segmentation

abstract: Semi-supervised medical image segmentation (SSMIS) has witnessed substantial advancements by leveraging limited labeled data and abundant unlabeled data. Nevertheless, existing state-of-the-art (SOTA) methods encounter challenges in accurately predicting labels for the unlabeled data, giving rise to disruptive noise during training and susceptibility to erroneous information overfitting. Moreover, applying perturbations to inaccurate predictions further reduces consistent learning. To address these concerns, we propose a novel Cross-head mutual mean-teaching Network (CMMT-Net) incorporated strong-weak data augmentation, thereby benefitting both self-training and consistency learning. Specifically, our CMMT-Net consists of both teacher-student peer networks with a share encoder and dual slightly different decoders, and the pseudo labels generated by one mean teacher head are adopted to supervise the other student branch to achieve a mutual consistency. Furthermore, we propose mutual virtual adversarial training (MVAT) to smooth the decision boundary and enhance feature representations. To diversify the consistency training samples, we employ Cross-Set CutMix strategy, which also helps address distribution mismatch issues. Notably, CMMT-Net simultaneously implements data, feature, and network perturbations, amplifying model diversity and generalization performance. Experimental results on three publicly available datasets indicate that our approach yields remarkable improvements over previous SOTA methods across various semi-supervised scenarios. Code and logs will be available at https://github.com/Leesoon1984/CMMT-Net.


title: FLatS: Principled Out-of-Distribution Detection with Feature-Based Likelihood Ratio Score

abstract: Detecting out-of-distribution (OOD) instances is crucial for NLP models in practical applications. Although numerous OOD detection methods exist, most of them are empirical. Backed by theoretical analysis, this paper advocates for the measurement of the "OOD-ness" of a test case $\boldsymbol{x}$ through the likelihood ratio between out-distribution $\mathcal P_{\textit{out}}$ and in-distribution $\mathcal P_{\textit{in}}$. We argue that the state-of-the-art (SOTA) feature-based OOD detection methods, such as Maha and KNN, are suboptimal since they only estimate in-distribution density $p_{\textit{in}}(\boldsymbol{x})$. To address this issue, we propose FLatS, a principled solution for OOD detection based on likelihood ratio. Moreover, we demonstrate that FLatS can serve as a general framework capable of enhancing other OOD detection methods by incorporating out-distribution density $p_{\textit{out}}(\boldsymbol{x})$ estimation. Experiments show that FLatS establishes a new SOTA on popular benchmarks. Our code is publicly available at https://github.com/linhaowei1/FLatS.


title: Analysis of multiphysics finite element method for quasi-static thermo-poroelasticity with a nonlinear convective transport term

abstract: In this paper, we propose a multiphysics finite element method for a quasi-static thermo-poroelasticity model with a nonlinear convective transport term. To design some stable numerical methods and reveal the multi-physical processes of deformation, diffusion and heat, we introduce three new variables to reformulate the original model into a fluid coupled problem. Then, we introduce an Newton's iterative algorithm by replacing the convective transport term with $\nabla T^{i}\cdot(\bm{K}\nabla p^{i-1})$, $\nabla T^{i-1}\cdot(\bm{K}\nabla p^{i})$ and $\nabla T^{i-1}\cdot(\bm{K}\nabla p^{i-1})$, and apply the Banach fixed point theorem to prove the convergence of the proposed method. Then, we propose a multiphysics finite element method with Newton's iterative algorithm, which is equivalent to a stabilized method, can effectively overcome the numerical oscillation caused by the nonlinear thermal convection term. Also, we prove that the fully discrete multiphysics finite element method has an optimal convergence order. Finally, we draw conclusions to summarize the main results of this paper.


title: Spectral extremal results on edge blow-up of graphs

abstract: Let ${\rm ex}(n,F)$ and ${\rm spex}(n,F)$ be the maximum size and maximum spectral radius of an $F$-free graph of order $n$, respectively. The value ${\rm spex}(n,F)$ is called the spectral extremal value of $F$. Nikiforov [J. Graph Theory 62 (2009) 362--368] gave the spectral Stability Lemma, which implies that for every $\varepsilon>0$, sufficiently large $n$ and a non-bipartite graph $H$ with chromatic number $\chi(H)$, the extremal graph for ${\rm spex}(n,H)$ can be obtained from the Tur\'{a}n graph $T_{\chi(H)-1}(n)$ by adding and deleting at most $\varepsilon n^2$ edges. It is still a challenging problem to determine the exact spectral extremal values of many non-bipartite graphs. Given a graph $F$ and an integer $p\geq 2$, the edge blow-up of $F$, denoted by $F^{p+1}$, is the graph obtained from replacing each edge in $F$ by a $K_{p+1}$ where the new vertices of $K_{p+1}$ are all distinct. In this paper, we determine the exact spectral extremal values of the edge blow-up of all non-bipartite graphs and provide the asymptotic spectral extremal values of the edge blow-up of all bipartite graphs for sufficiently large $n$, which can be seen as a spectral version of the theorem on ${\rm ex}(n,F^{p+1})$ given by Yuan [J. Combin. Theory Ser. B 152 (2022) 379--398]. As applications, on the one hand, we generalize several previous results on ${\rm spex}(n,F^{p+1})$ for $F$ being a matching and a star for $p\geq 3$. On the other hand, we obtain the exact values of ${\rm spex}(n,F^{p+1})$ for $F$ being a path, a cycle and a complete graph.


title: Learning Generalizable Agents via Saliency-Guided Features Decorrelation

abstract: In visual-based Reinforcement Learning (RL), agents often struggle to generalize well to environmental variations in the state space that were not observed during training. The variations can arise in both task-irrelevant features, such as background noise, and task-relevant features, such as robot configurations, that are related to the optimal decisions. To achieve generalization in both situations, agents are required to accurately understand the impact of changed features on the decisions, i.e., establishing the true associations between changed features and decisions in the policy model. However, due to the inherent correlations among features in the state space, the associations between features and decisions become entangled, making it difficult for the policy to distinguish them. To this end, we propose Saliency-Guided Features Decorrelation (SGFD) to eliminate these correlations through sample reweighting. Concretely, SGFD consists of two core techniques: Random Fourier Functions (RFF) and the saliency map. RFF is utilized to estimate the complex non-linear correlations in high-dimensional images, while the saliency map is designed to identify the changed features. Under the guidance of the saliency map, SGFD employs sample reweighting to minimize the estimated correlations related to changed features, thereby achieving decorrelation in visual RL tasks. Our experimental results demonstrate that SGFD can generalize well on a wide range of test environments and significantly outperforms state-of-the-art methods in handling both task-irrelevant variations and task-relevant variations.


title: A view-parametric extension of d'Ocagne-Koenderink formula for a surface in $\mathbb{R}^3$

abstract: In this paper, we consider the orthogonal projection of a surface in $\mathbb{R}^3$ for a given view direction. We then introduce and investigate several invariants of the families of the plane curves that locally configure the projection image of the surface. Using the invariants, we also show an extension of d'Ocagne-Koenderink formula that associates a local behavior of the projection image of a surface with Gaussian curvature of the surface.


title: Safe Exit Controllers Synthesis for Continuous-time Stochastic Systems

abstract: This paper tackles the problem of generating safe exit controllers for continuous-time systems described by stochastic differential equations (SDEs). The primary aim is to develop controllers that maximize the lower bounds of the exit probability that the system escapes from a safe but uncomfortable set within a specified time frame and guide it towards a comfortable set. The paper considers two distinct cases: one in which the boundary of the safe set is a subset of the boundary of the uncomfortable set, and the other where the boundaries of the two sets do not intersect. To begin, we present a sufficient condition for establishing lower bounds on the exit probability in the first case. This condition serves as a guideline for constructing an online linear programming problem. The linear programming problem is designed to implicitly synthesize an optimal exit controller that maximizes the lower bounds of the exit probability. The method employed in the first case is then extended to the second one. Finally, we demonstrate the effectiveness of the proposed approaches on one example.


title: Broad-line region in active galactic nuclei: Dusty or dustless?

abstract: Context. Dust in active galactic nuclei is clearly present right outside the broad-line region (BLR) in the form of a dusty molecular torus. However, some models of the BLR predict that dust may also exist within the BLR. Aims. We study the reprocessing of radiation by the BLR with the aim of observing how the presence of dust affects the reprocessed continuum and the line properties. Methods. We calculated a range of models using the CLOUDY photoionisation code for dusty and dustless plasma. We paid particular attention to the well-studied object NGC 5548, and we compared the line equivalent width predictions with the data from observations for this object. Results. We obtained a rough agreement between the expected equivalent widths of the H$\beta$ and Mg II lines and the observed values for NGC 5548 for the line distances implied by the time-delay measurement (for H$\beta)$ and the radius-luminosity relation (for Mg II) when the medium is dusty. We found the incident radiation to be consistent with the radiation seen by the observer, so no shielding between the inner disc and the BLR is required. High ionisation lines such as He II, however, clearly form in the inner dustless region. When the additional absorber is present, the H$\beta$ emitting region moves closer to the dustless part of the accretion disc surface.


title: Impact of choices for center-of-mass correction energy on the surface energy of Skyrme energy density functionals

abstract: In the framework of nuclear energy density functional (EDF) methods, many nuclear phenomena can be related to the deformation of intrinsic states. Their accurate modeling relies on the correct description of the change of nuclear binding energy with deformation. The two most important contributions to the deformation energy have their origin in shell effects and the surface energy coefficient of nuclear matter. In a first step, we build nine series of parametrizations with a systematically varied surface-energy coefficient a_surf for three frequently-used options for the CM correction (none, one-body term only, full one-body and two-body contributions) combined with three values for the isoscalar effective mass m^*_0/m (0.7, 0.8, 0.85) and analyse how well each of these parametrizations can be adjusted to the properties of spherical nuclei and infinite nuclear matter. In a second step, we performed additional fits without the constraint on surface energy, adding one ``best-fit" parametrization to each of the nine series. We then benchmark these parametrizations to the deformation properties of heavy nuclei by means of three-dimensional Hartree-Fock-Bogoliubov calculations that allow for non-axial and/or non-reflection symmetric configurations. We perform a detailed correlation analysis between surface and volume properties of nuclear matter using the nine series of parametrizations. The best fits out of each series are then benchmarked on the fission barriers of Pu240 and Hg180, as well as on the properties of deformed states at normal and superdeformation for actinides and nuclei in the neutron-deficient Hg region. (see paper for full abstract)


title: A Privacy-Preserving Trajectory Synthesis Method Based on Vector Translation Invariance Supporting Traffic Constraints

abstract: With the popularization of different kinds of smart terminals and the development of autonomous driving technology, more and more services based on spatio-temporal data have emerged in our lives, such as online taxi services, traffic flow prediction, and tracking virus propagation. However, the privacy concerns of spatio-temporal data greatly limit the use of them. To address this issue, differential privacy method based on spatio-temporal data has been proposed. In differential privacy, a good aggregation query can highly improve the data utility. But the mainstream aggregation query methods are based on area partitioning, which is difficult to generate trajectory with high utility for they are hard to take time and constraints into account. Motivated by this, we propose an aggregation query based on the relationships between trajectories, so it can greatly improve the data utility as compared to the existing methods. The trajectory synthesis task can be regarded as an optimization problem of finding trajectories that match the relationships between trajectories. We adopt gradient descent to find new trajectories that meet the conditions, and during the gradient descent, we can easily take the constraints into account by adding penalty terms which area partitioning based query is hard to achieve. We carry out extensive experiments to validate that the trajectories generated by our method have higher utility and the theoretic analysis shows that our method is safe and reliable.


title: Benchmarking Large Language Models with Augmented Instructions for Fine-grained Information Extraction

abstract: Information Extraction (IE) is an essential task in Natural Language Processing. Traditional methods have relied on coarse-grained extraction with simple instructions. However, with the emergence of Large Language Models (LLMs), there is a need to adapt IE techniques to leverage the capabilities of these models. This paper introduces a fine-grained IE benchmark dataset tailored for LLMs, employing augmented instructions for each information type, which includes task descriptions, extraction rules, output formats, and examples. Through extensive evaluations, we observe that encoder-decoder models, particularly T5 and FLAN-T5, perform well in generalizing to unseen information types, while ChatGPT exhibits greater adaptability to new task forms. Our results also indicate that performance is not solely dictated by model scale, and highlight the significance of architecture, data diversity, and learning techniques. This work paves the way for a more refined and versatile utilization of LLMs in Information Extraction.


title: Asymmetrically Decentralized Federated Learning

abstract: To address the communication burden and privacy concerns associated with the centralized server in Federated Learning (FL), Decentralized Federated Learning (DFL) has emerged, which discards the server with a peer-to-peer (P2P) communication framework. However, most existing DFL algorithms are based on symmetric topologies, such as ring and grid topologies, which can easily lead to deadlocks and are susceptible to the impact of network link quality in practice. To address these issues, this paper proposes the DFedSGPSM algorithm, which is based on asymmetric topologies and utilizes the Push-Sum protocol to effectively solve consensus optimization problems. To further improve algorithm performance and alleviate local heterogeneous overfitting in Federated Learning (FL), our algorithm combines the Sharpness Aware Minimization (SAM) optimizer and local momentum. The SAM optimizer employs gradient perturbations to generate locally flat models and searches for models with uniformly low loss values, mitigating local heterogeneous overfitting. The local momentum accelerates the optimization process of the SAM optimizer. Theoretical analysis proves that DFedSGPSM achieves a convergence rate of $\mathcal{O}(\frac{1}{\sqrt{T}})$ in a non-convex smooth setting under mild assumptions. This analysis also reveals that better topological connectivity achieves tighter upper bounds. Empirically, extensive experiments are conducted on the MNIST, CIFAR10, and CIFAR100 datasets, demonstrating the superior performance of our algorithm compared to state-of-the-art optimizers.


title: Shear-Induced Phase Behavior and Topological Defects in Two-Dimensional Crystals

abstract: We investigate through numerical simulations how a two-dimensional crystal yields and flows under an applied shear. We focus over a range that allows us to both address the response in the limit of an infinitesimal shear rate and describe the phase behavior of the system at a finite shear rate. In doing so, we carefully discuss the role of the topological defects and of the finite-size effects. We map out the whole phase diagram of the flowing steady state in the plane formed by temperature and shear rate. Shear-induced melting of the two-dimensional crystal is found to proceed in two steps: first, the solid loses long-range bond-orientational order and flows, even for an infinitesimal shear rate (in the thermodynamic limit). The resulting flowing hexatic phase then melts to a flowing, rather isotropic, liquid at a finite shear rate that depends on temperature. Finally, at a high shear rate, a third regime corresponding to a strongly anisotropic string-like flowing phase appears.


title: How Reliable Are AI-Generated-Text Detectors? An Assessment Framework Using Evasive Soft Prompts

abstract: In recent years, there has been a rapid proliferation of AI-generated text, primarily driven by the release of powerful pre-trained language models (PLMs). To address the issue of misuse associated with AI-generated text, various high-performing detectors have been developed, including the OpenAI detector and the Stanford DetectGPT. In our study, we ask how reliable these detectors are. We answer the question by designing a novel approach that can prompt any PLM to generate text that evades these high-performing detectors. The proposed approach suggests a universal evasive prompt, a novel type of soft prompt, which guides PLMs in producing "human-like" text that can mislead the detectors. The novel universal evasive prompt is achieved in two steps: First, we create an evasive soft prompt tailored to a specific PLM through prompt tuning; and then, we leverage the transferability of soft prompts to transfer the learned evasive soft prompt from one PLM to another. Employing multiple PLMs in various writing tasks, we conduct extensive experiments to evaluate the efficacy of the evasive soft prompts in their evasion of state-of-the-art detectors.


title: Origin of the broadband emission from the transition blazar B2 1308+326

abstract: Transition blazars exhibit a shift from one subclass to the next during different flux states. It is therefore crucial to study them to understand the underlying physics of blazars. We probe the origin of the multi-wavelength emission from the transition blazar B2 1308+326 using 14-year-long gamma-ray light curve from Fermi and the quasi-simultaneous data from Swift. We used the Bayesian block algorithm to identify epochs of flaring and quiescent flux states and modelled the broadband SEDs for these epochs. We employed the one-zone leptonic model in which the synchrotron emission causes the low-energy part of the SED and the high-energy part is produced by the IC emission of external seed photons. We also investigated its multi-band variability properties and gamma-ray flux distribution, and the correlation between optical and gamma-ray emissions. We observed a historically bright flare from B2 1308+326 across the optical to gamma-ray bands in June and July 2022. The highest daily averaged gamma-ray flux was (14.24$\pm$2.36) $\times$ 10$^{-7}$ ph cm$^{-2}$ s$^{-1}$ and was detected on 1 July 2022. The gamma-ray flux distribution was found to be log-normal. The optical and gamma-ray emissions are well correlated with zero time lag. The synchrotron peak frequency changes from $\sim 8 \times$ 10$^{12}$ Hz (in the quiescent state) to $\sim 6 \times$ 10$^{14}$ Hz (in the flaring state), together with a decrease in the Compton dominance providing a hint that the source transitions from a LSP to an ISP. The SEDs for these two states are well-fitted by one-zone leptonic models. The parameters in the model fits are essentially consistent between both SEDs, except for the Doppler-beaming factor, which changes from $\sim$15.6 to $\sim$27 during the transition. An increase in the Doppler factor might cause both the flare and the transition of B2 1308+326 from an LSP to an ISP blazar.


title: Resonant excitation of plasma waves in a plasma channel

abstract: We demonstrate resonant excitation of a plasma wave by a train of short laser pulses guided in a pre-formed plasma channel, for parameters relevant to a plasma-modulated plasma accelerator (P-MoPA). We show experimentally that a train of $N \approx 10$ short pulses, of total energy $\sim 1$ J, can be guided through $110$ mm long plasma channels with on-axis densities in the range $10^{17} - 10^{18}$ cm$^{-3}$. The spectrum of the transmitted train is found to be strongly red-shifted when the plasma period is tuned to the intra-train pulse spacing. Numerical simulations are found to be in excellent agreement with the measurements and indicate that the resonantly excited plasma waves have an amplitude in the range $3$ - $10$ GV m$^{-1}$, corresponding to an accelerator stage energy gain of order $1$ GeV.


title: Bi-functional metamaterial based on Helmholtz resonators for sound and heat insulation

abstract: Over the last few decades, both heat and broadband sound reduction have become increasingly significant as a result of concerns about the environment and noise pollution. In order to address this challenge, we provide a finite element analysis study of an acoustic metamaterial panel consisting of a unit cell made of two Helmholtz Resonators with a guide in between. These panels can attenuate and control both sound propagation and heat flux. For noise pollution in a building, we first determine the geometric dimension that corresponds to the operative frequency range. Furthermore, we investigate the sound transmission loss of the proposed panel as a function of the periodicity of an array of unit cells. Additionally, we investigate the thermal flux induced by the panel, especially within a 24-hour period. The simulation results show that the proposed panel provides a level of sound attenuation within the frequency range of 400 Hz to 2.5 kHz, as well as interesting heat protection. The structure is compared to panels made up of a homogeneous medium and without Helmholtz resonators.


title: Intelligent DRL-Based Adaptive Region of Interest for Delay-sensitive Telemedicine Applications

abstract: Telemedicine applications have recently received substantial potential and interest, especially after the COVID-19 pandemic. Remote experience will help people get their complex surgery done or transfer knowledge to local surgeons, without the need to travel abroad. Even with breakthrough improvements in internet speeds, the delay in video streaming is still a hurdle in telemedicine applications. This imposes using image compression and region of interest (ROI) techniques to reduce the data size and transmission needs. This paper proposes a Deep Reinforcement Learning (DRL) model that intelligently adapts the ROI size and non-ROI quality depending on the estimated throughput. The delay and structural similarity index measure (SSIM) comparison are used to assess the DRL model. The comparison findings and the practical application reveal that DRL is capable of reducing the delay by 13% and keeping the overall quality in an acceptable range. Since the latency has been significantly reduced, these findings are a valuable enhancement to telemedicine applications.


title: Role of Centrosymmetry in the Photophysics of Molecular Aggregates

abstract: To understand the photophysics of molecular aggregates, exciton model of J- and H-aggregate has been extensively utilized. However, it lacks consideration of crystal symmetry. Although discrete molecules may lack symmetry, their aggregates can exhibit a high degree of symmetry. Herein, we utilized group theory to study the optical properties of centrosymmetric molecular aggregates, showing that their optical selection rules (transition dipole moment and spin-orbit coupling) are determined by the symmetry of singlet and triplet excited states and the intermolecular orbital overlap. Symmetry-forbidden electronic transitions are closely related to ultralong organic phosphorescence. Our model's scope is broad, as over 50% of organic crystals belong to centrosymmetric space groups according to Cambridge Structural Database.


title: Trapped ion-mediated interactions between two distant trapped atoms

abstract: We theoretically show that when two largely separated trapped atoms interact with a trapped ion via Rydberg excitation of the atoms, the ion-mediated interaction between the atoms exceeds the direct atom-atom interaction by several orders of magnitude. Since the motion of the atoms is much slower than the motion of the ion, we resort to Born-Oppenheimer approximation to calculate the ion-mediated adiabatic potential. We also calculate the ion-mediated phonon modes of the atoms that are separated by more than 10 micron. For cylindrical geometry of the system and both the atoms being excited to the same Rydberg state, the stretched and center-of-mass (COM) axial or transverse phonon modes are found to be almost degenerate, while the phonon modes are non-degenerate when one atom is in a Rydberg state and the other in the ground state. We discuss the non-adiabatic effects in the system that give rise to a Gauge structure and associated geometric phase in the system. This study may open a new perspective in quantum computing and exploring molecular physics associated with a conical intersection using an ion-atom hybrid architecture.


title: A Federated Learning Algorithms Development Paradigm

abstract: At present many distributed and decentralized frameworks for federated learning algorithms are already available. However, development of such a framework targeting smart Internet of Things in edge systems is still an open challenge. A solution to that challenge named Python Testbed for Federated Learning Algorithms (PTB-FLA) appeared recently. This solution is written in pure Python, it supports both centralized and decentralized algorithms, and its usage was validated and illustrated by three simple algorithm examples. In this paper, we present the federated learning algorithms development paradigm based on PTB-FLA. The paradigm comprises the four phases named by the code they produce: (1) the sequential code, (2) the federated sequential code, (3) the federated sequential code with callbacks, and (4) the PTB-FLA code. The development paradigm is validated and illustrated in the case study on logistic regression, where both centralized and decentralized algorithms are developed.


title: Zero-Shot Detection of Machine-Generated Codes

abstract: This work proposes a training-free approach for the detection of LLMs-generated codes, mitigating the risks associated with their indiscriminate usage. To the best of our knowledge, our research is the first to investigate zero-shot detection techniques applied to code generated by advanced black-box LLMs like ChatGPT. Firstly, we find that existing training-based or zero-shot text detectors are ineffective in detecting code, likely due to the unique statistical properties found in code structures. We then modify the previous zero-shot text detection method, DetectGPT (Mitchell et al., 2023) by utilizing a surrogate white-box model to estimate the probability of the rightmost tokens, allowing us to identify code snippets generated by language models. Through extensive experiments conducted on the python codes of the CodeContest and APPS dataset, our approach demonstrates its effectiveness by achieving state-of-the-art detection results on text-davinci-003, GPT-3.5, and GPT-4 models. Moreover, our method exhibits robustness against revision attacks and generalizes well to Java codes. We also find that the smaller code language model like PolyCoder-160M performs as a universal code detector, outperforming the billion-scale counterpart. The codes will be available at https://github.com/ Xianjun-Yang/Code_detection.git


title: Investigating the origin of optical flares from the TeV blazar S4 0954+65

abstract: Aims. We aim to investigate the extreme variability properties of the TeV blazar S4 0954+65 using optical photometric and polarisation observations carried out between 2017 and 2023 using three ground-based telescopes. Methods. We examined an extensive dataset comprised of 138 intraday (observing duration shorter than a day) light curves (LCs) of S4 0954+65 for flux, spectral, and polarisation variations on diverse timescales. For the variable LCs, we computed the minimum variability timescales. We investigated flux-flux correlations and colour variations to look for spectral variations on long (several weeks to years) timescales. Additionally, we looked for connections between optical R-band flux and polarisation degree. Results. We found significant variations in 59 out of 138 intraday LCs. We detected a maximum change of 0.58$\pm$0.11 in V-band magnitude within $\sim$2.64 h and a corresponding minimum variability timescale of 18.21$\pm$4.87 mins on 2017 March 25. During the course of our observing campaign, the source brightness changed by $\sim$4 magnitudes in V and R bands; however, we did not find any strong spectral variations. The slope of the relative spectral energy distribution was 1.37$\pm$0.04. The degree of polarisation varied from $\sim$ 3% to 39% during our monitoring. We observed a change of $\sim$120 degrees in polarisation angle (PA) within $\sim$3 h on 2022 April 13. No clear correlation was found between optical flux and the degree of polarisation. Conclusions. The results of our optical flux, colour, and polarisation study provide hints that turbulence in the relativistic jet could be responsible for the intraday optical variations in the blazar S4 0954+65. However, the long-term flux variations may be caused by changes in the Doppler factor.


title: How Graph Neural Networks Learn: Lessons from Training Dynamics

abstract: A long-standing goal in deep learning has been to characterize the learning behavior of black-box models in a more interpretable manner. For graph neural networks (GNNs), considerable advances have been made in formalizing what functions they can represent, but whether GNNs will learn desired functions during the optimization process remains less clear. To fill this gap, we study their training dynamics in function space. In particular, we find that the gradient descent optimization of GNNs implicitly leverages the graph structure to update the learned function, as can be quantified by a phenomenon which we call \emph{kernel-graph alignment}. We provide theoretical explanations for the emergence of this phenomenon in the overparameterized regime and empirically validate it on real-world GNNs. This finding offers new interpretable insights into when and why the learned GNN functions generalize, highlighting their limitations in heterophilic graphs. Practically, we propose a parameter-free algorithm that directly uses a sparse matrix (i.e. graph adjacency) to update the learned function. We demonstrate that this embarrassingly simple approach can be as effective as GNNs while being orders-of-magnitude faster.


title: Strongly positive amphicheiral knots with doubly symmetric diagrams

abstract: We determine the prime strongly positive amphicheiral knots up to 16 crossings and show that a large fraction of them admit knot diagrams with a double symmetry (rotational symmetry for strongly positive amphicheirality and an additional mirror symmetry for the ribbon property). The remaining knots are presented as `almost doubly symmetric' diagrams, defined as diagrams with double symmetry where exactly one symmetric pair of crossings is switched. We also find that the rosette knot 14a19470, which has period 7, is the first prime strongly positive amphicheiral knot in the knot tables which is not slice.


title: OV-PARTS: Towards Open-Vocabulary Part Segmentation

abstract: Segmenting and recognizing diverse object parts is a crucial ability in applications spanning various computer vision and robotic tasks. While significant progress has been made in object-level Open-Vocabulary Semantic Segmentation (OVSS), i.e., segmenting objects with arbitrary text, the corresponding part-level research poses additional challenges. Firstly, part segmentation inherently involves intricate boundaries, while limited annotated data compounds the challenge. Secondly, part segmentation introduces an open granularity challenge due to the diverse and often ambiguous definitions of parts in the open world. Furthermore, the large-scale vision and language models, which play a key role in the open vocabulary setting, struggle to recognize parts as effectively as objects. To comprehensively investigate and tackle these challenges, we propose an Open-Vocabulary Part Segmentation (OV-PARTS) benchmark. OV-PARTS includes refined versions of two publicly available datasets: Pascal-Part-116 and ADE20K-Part-234. And it covers three specific tasks: Generalized Zero-Shot Part Segmentation, Cross-Dataset Part Segmentation, and Few-Shot Part Segmentation, providing insights into analogical reasoning, open granularity and few-shot adapting abilities of models. Moreover, we analyze and adapt two prevailing paradigms of existing object-level OVSS methods for OV-PARTS. Extensive experimental analysis is conducted to inspire future research in leveraging foundational models for OV-PARTS. The code and dataset are available at https://github.com/OpenRobotLab/OV_PARTS.


title: Enhancing Representations through Heterogeneous Self-Supervised Learning

abstract: Incorporating heterogeneous representations from different architectures has facilitated various vision tasks, e.g., some hybrid networks combine transformers and convolutions. However, complementarity between such heterogeneous architectures has not been well exploited in self-supervised learning. Thus, we propose Heterogeneous Self-Supervised Learning (HSSL), which enforces a base model to learn from an auxiliary head whose architecture is heterogeneous from the base model. In this process, HSSL endows the base model with new characteristics in a representation learning way without structural changes. To comprehensively understand the HSSL, we conduct experiments on various heterogeneous pairs containing a base model and an auxiliary head. We discover that the representation quality of the base model moves up as their architecture discrepancy grows. This observation motivates us to propose a search strategy that quickly determines the most suitable auxiliary head for a specific base model to learn and several simple but effective methods to enlarge the model discrepancy. The HSSL is compatible with various self-supervised methods, achieving superior performances on various downstream tasks, including image classification, semantic segmentation, instance segmentation, and object detection. Our source code will be made publicly available.


title: Lightweight In-Context Tuning for Multimodal Unified Models

abstract: In-context learning (ICL) involves reasoning from given contextual examples. As more modalities comes, this procedure is becoming more challenging as the interleaved input modalities convolutes the understanding process. This is exemplified by the observation that multimodal models often struggle to effectively extrapolate from contextual examples to perform ICL. To address these challenges, we introduce MultiModal In-conteXt Tuning (M$^2$IXT), a lightweight module to enhance the ICL capabilities of multimodal unified models. The proposed M$^2$IXT module perceives an expandable context window to incorporate various labeled examples of multiple modalities (e.g., text, image, and coordinates). It can be prepended to various multimodal unified models (e.g., OFA, Unival, LLaVA) of different architectures and trained via a mixed-tasks strategy to enable rapid few-shot adaption on multiple tasks and datasets. When tuned on as little as 50K multimodal data, M$^2$IXT can boost the few-shot ICL performance significantly (e.g., 18\% relative increase for OFA), and obtained state-of-the-art results across an array of tasks including visual question answering, image captioning, visual grounding, and visual entailment, while being considerably small in terms of model parameters (e.g., $\sim$$20\times$ smaller than Flamingo or MMICL), highlighting the flexibility and effectiveness of M$^2$IXT as a multimodal in-context learner.


title: The impact of the pandemic of Covid-19 on child poverty in North Macedonia: Simulation-based estimates

abstract: The objective of this paper is to estimate the expected effects of the pandemic of Covid-19 for child poverty in North Macedonia. We rely on MK-MOD Tax & Benefit Microsimulation Model for North Macedonia based on the Survey on Income and Living Conditions 2019. The simulation takes into account the development of income, as per the observed developments in the first three quarters of 2020, derived from the Labor Force Survey, which incorporates the raw effect of the pandemic and the government response. In North Macedonia, almost no government measure directly aimed the income of children, however, three key and largest measures addressed household income: the wage subsidy of 14.500 MKD per worker in the hardest hit companies, relaxation of the criteria for obtaining the guaranteed minimum income, and one-off support to vulnerable groups of the population in two occasions. Results suggest that the relative child poverty rate is estimated to increase from 27.8 percent before the pandemic to 32.4 percent during the pandemic. This increase puts additional 19,000 children below the relative poverty threshold. Results further suggest that absolute poverty is likely to reduce primarily because of the automatic stabilizers in the case of social assistance and because of the one-time cash assistance.


title: Mathematical analysis of modified level-set equations

abstract: The linear transport equation allows to advect level-set functions to represent moving sharp interfaces in multiphase flows as zero level-sets. A recent development in computational fluid dynamics is to modify the linear transport equation by introducing a nonlinear term to preserve certain geometrical features of the level-set function, where the zero level-set must stay invariant under the modification. The present work establishes mathematical justification for a specific class of modified level-set equations on a bounded domain, generated by a given smooth velocity field in the framework of the initial/boundary value problem of Hamilton-Jacobi equations. The first main result is the existence of smooth solutions defined in a time-global tubular neighborhood of the zero level-set, where an infinite iteration of the method of characteristics within a fixed small time interval is demonstrated; the smooth solution is shown to possess the desired geometrical feature. The second main result is the existence of time-global viscosity solutions defined in the whole domain, where standard Perron's method and the comparison principle are exploited. In the first and second main results, the zero level-set is shown to be identical with the original one. The third main result is that the viscosity solution coincides with the local-in-space smooth solution in a time-global tubular neighborhood of the zero level-set, where a new aspect of localized doubling the number of variables is utilized.


title: Proofs of conjectures on Ramanujan-type series of level 3

abstract: A Ramanujan-type series satisfies $$ \frac{1}{\pi} = \sum_{n=0}^{\infty} \frac{\left( \frac{1}{2} \right)_{n} \left( \frac{1}{s} \right)_{n} \left(1 - \frac{1}{s} \right)_{n} }{ \left( 1 \right)_{n}^{3} } z^{n} (a + b n), $$ where $s \in \{ 2, 3, 4, 6 \}$, and where $a$, $b$, and $z$ are real algebraic numbers. The level $3$ case whereby $s = 3$ has been considered as the most mysterious and the most challenging, out of all possible values for $s$, and this motivates the development of new techniques for constructing Ramanujan-type series of level $3$. Chan and Liaw introduced an alternating analogue of the Borwein brothers' identity for Ramanujan-type series of level $3$; subsequently, Chan, Liaw, and Tian formulated another proof of the Chan-Liaw identity, via the use of Ramanujan's class invariant. Using the elliptic lambda function and the elliptic alpha function, we prove, using a limiting case of the Kummer-Goursat transformation, a new identity for evaluating $z$, $a$, and $b$ for Ramanujan-type series such that $s = 3$ and $z < 0$, and we apply this new identity to prove three conjectured formulas for quadratic-irrational, Ramanujan-type series that had been discovered via numerical experiments with Maple in 2012 by Aldawoud. We also apply our identity to prove a new Ramanujan-type series of level $3$ with quartic values for $z < 0$, $a$, and $b$.


title: Nonlinear Orbital and Spin Edelstein Effect in Centrosymmetric Metals

abstract: Nonlinear spintronics combines nonlinear dynamics with spintronics, opening up new possibilities beyond linear responses. A recent theoretical work [Xiao et al., Phys. Rev. Lett. 130, 166302 (2023)] predicts the nonlinear generation of spin density [nonlinear spin Edelstein effect (NSEE)] in centrosymmetric metals based on symmetry analysis combined with first principle calculation. However, its microscopic mechanism is limited to a specific set of materials with local inversion symmetry breaking and is not applicable to general materials. This paper focuses on the fundamental role of orbital degrees of freedom for the nonlinear generation in centrosymmetric systems. Using a combination of tight-binding model and density functional theory calculations, we demonstrate that nonlinear orbital density can arise independently of spin-orbit coupling. In contrast, spin density follows through spin-orbit coupling. We further elucidate the microscopic mechanism responsible for this phenomenon, which involves the NSEE induced by electric-field-induced orbital Rashba texture. In addition, we also explore the potential applications of the nonlinear orbital and spin Edelstein effect for field-free switching of magnetization.


title: Poverty during Covid-19 in North Macedonia: Analysis of the distributional impact of the crisis and government response

abstract: In this paper we simulate the poverty effect of the Covid-19 pandemic in North Macedonia and we analyze the income-saving power of three key government measures: the employment-retention scheme, the relaxed Guaranteed Minimum Income support, and one-off cash allowances. In this attempt, the counterfactual scenarios are simulated by using MK-MOD, the Macedonian Tax and Benefit Microsimulation Model, incorporating actual data on the shock-s magnitude from the second quarter of 2020. The results suggest that without the government interventions, of the country-s two million citizens, an additional 120,000 people would have been pushed into poverty by COVID-19, where 340,000 were already poor before the pandemic. Of the 120,000 newly poor about 16,000 would have been pushed into destitute poverty. The government-s automatic stabilizers worked to shield the poorest people, though these were clearly pro-feminine. In all, the analyzed government measures recovered more than half of the income loss, which curbed the poverty-increasing effect and pulled an additional 34,000 people out of extreme poverty. The employment-retention measure was regressive and pro-masculine; the Guaranteed Minimum Income relaxation (including automatic stabilizers) was progressive and pro-feminine; and the one-off support has been pro-youth.


title: Breaking Down Word Semantics from Pre-trained Language Models through Layer-wise Dimension Selection

abstract: Contextual word embeddings obtained from pre-trained language model (PLM) have proven effective for various natural language processing tasks at the word level. However, interpreting the hidden aspects within embeddings, such as syntax and semantics, remains challenging. Disentangled representation learning has emerged as a promising approach, which separates specific aspects into distinct embeddings. Furthermore, different linguistic knowledge is believed to be stored in different layers of PLM. This paper aims to disentangle semantic sense from BERT by applying a binary mask to middle outputs across the layers, without updating pre-trained parameters. The disentangled embeddings are evaluated through binary classification to determine if the target word in two different sentences has the same meaning. Experiments with cased BERT$_{\texttt{base}}$ show that leveraging layer-wise information is effective and disentangling semantic sense further improve performance.


title: Utilizing Contextual Clues and Role Correlations for Enhancing Document-level Event Argument Extraction

abstract: Document-level event argument extraction is a crucial yet challenging task within the field of information extraction. Current mainstream approaches primarily focus on the information interaction between event triggers and their arguments, facing two limitations: insufficient context interaction and the ignorance of event correlations. Here, we introduce a novel framework named CARLG (Contextual Aggregation of clues and Role-based Latent Guidance), comprising two innovative components: the Contextual Clues Aggregation (CCA) and the Role-based Latent Information Guidance (RLIG). The CCA module leverages the attention weights derived from a pre-trained encoder to adaptively assimilates broader contextual information, while the RLIG module aims to capture the semantic correlations among event roles. We then instantiate the CARLG framework into two variants based on two types of current mainstream EAE approaches. Notably, our CARLG framework introduces less than 1% new parameters yet significantly improving the performance. Comprehensive experiments across the RAMS, WikiEvents, and MLEE datasets confirm the superiority of CARLG, showing significant superiority in terms of both performance and inference speed compared to major benchmarks. Further analyses demonstrate the effectiveness of the proposed modules.


title: Minimum wage and manufacturing labor share: Evidence from North Macedonia

abstract: The objective of the paper is to understand if the minimum wage plays a role for the labor share of manufacturing workers in North Macedonia. We decompose labor share movements on those along a share-capital curve, shifts of this locus, and deviations from it. We use the capital-output ratio, total factor productivity and prices of inputs to capture these factors, while the minimum wage is introduced as an element that moves the curve off. We estimate a panel of 20 manufacturing branches over the 2012-2019 period with FE, IV and system-GMM estimators. We find that the role of the minimum wage for the labor share is industry-specific. For industrial branches which are labor-intensive and low-pay, it increases workers' labor share, along a complementarity between capital and labor. For capital-intensive branches, it reduces labor share, likely through the job loss channel and along a substitutability between labor and capital. This applies to both branches where foreign investment and heavy industry are nested.


title: VITS-based Singing Voice Conversion System with DSPGAN post-processing for SVCC2023

abstract: This paper presents the T02 team's system for the Singing Voice Conversion Challenge 2023 (SVCC2023). Our system entails a VITS-based SVC model, incorporating three modules: a feature extractor, a voice converter, and a post-processor. Specifically, the feature extractor provides F0 contours and extracts speaker-independent linguistic content from the input singing voice by leveraging a HuBERT model. The voice converter is employed to recompose the speaker timbre, F0, and linguistic content to generate the waveform of the target speaker. Besides, to further improve the audio quality, a fine-tuned DSPGAN vocoder is introduced to re-synthesise the waveform. Given the limited target speaker data, we utilize a two-stage training strategy to adapt the base model to the target speaker. During model adaptation, several tricks, such as data augmentation and joint training with auxiliary singer data, are involved. Official challenge results show that our system achieves superior performance, especially in the cross-domain task, ranking 1st and 2nd in naturalness and similarity, respectively. Further ablation justifies the effectiveness of our system design.


title: Dynamic Multi-Domain Knowledge Networks for Chest X-ray Report Generation

abstract: The automated generation of radiology diagnostic reports helps radiologists make timely and accurate diagnostic decisions while also enhancing clinical diagnostic efficiency. However, the significant imbalance in the distribution of data between normal and abnormal samples (including visual and textual biases) poses significant challenges for a data-driven task like automatically generating diagnostic radiology reports. Therefore, we propose a Dynamic Multi-Domain Knowledge(DMDK) network for radiology diagnostic report generation. The DMDK network consists of four modules: Chest Feature Extractor(CFE), Dynamic Knowledge Extractor(DKE), Specific Knowledge Extractor(SKE), and Multi-knowledge Integrator(MKI) module. Specifically, the CFE module is primarily responsible for extracting the unprocessed visual medical features of the images. The DKE module is responsible for extracting dynamic disease topic labels from the retrieved radiology diagnostic reports. We then fuse the dynamic disease topic labels with the original visual features of the images to highlight the abnormal regions in the original visual features to alleviate the visual data bias problem. The SKE module expands upon the conventional static knowledge graph to mitigate textual data biases and amplify the interpretability capabilities of the model via domain-specific dynamic knowledge graphs. The MKI distills all the knowledge and generates the final diagnostic radiology report. We performed extensive experiments on two widely used datasets, IU X-Ray and MIMIC-CXR. The experimental results demonstrate the effectiveness of our method, with all evaluation metrics outperforming previous state-of-the-art models.


title: Linear Loop Synthesis for Quadratic Invariants

abstract: Invariants are key to formal loop verification as they capture loop properties that are valid before and after each loop iteration. Yet, generating invariants is a notorious task already for syntactically restricted classes of loops. Rather than generating invariants for given loops, in this paper we synthesise loops that exhibit a predefined behaviour given by an invariant. From the perspective of formal loop verification, the synthesised loops are thus correct by design and no longer need to be verified. To overcome the hardness of reasoning with arbitrarily strong invariants, in this paper we construct simple (non-nested) while loops with linear updates that exhibit polynomial equality invariants. Rather than solving arbitrary polynomial equations, we consider loop properties defined by a single quadratic invariant in any number of variables. We present a procedure that, given a quadratic equation, decides whether a loop with affine updates satisfying this equation exists. Furthermore, if the answer is positive, the procedure synthesises a loop and ensures its variables achieve infinitely many different values.


title: Homogenization of some evolutionary non-Newtonian flows in porous media

abstract: In this paper, we consider the homogenization of evolutionary incompressible purely viscous non-Newtonian flows of Carreau-Yasuda type in porous media with small perforation parameter $0< \varepsilon \ll 1$, where the small holes are periodically distributed. Darcy's law is recovered in the homogenization limit. Applying Poincar\'e type inequality in porous media allows us to derive the uniform estimates on velocity field, of which the gradient is small of size $\varepsilon$ in $L^{2}$ space. This indicates the nonlinear part in the viscosity coefficient does not contribute in the limit and a linear model (Darcy's law) is obtained. The estimates of the pressure rely on a proper extension from the perforated domain to the homogeneous non-perforated domain. By integrating the equations in time variable such that each term in the resulting equations has certain continuity in time, we can establish the extension of the pressure by applying the dual formula with the restriction operator.


title: MCPSim: A Geant4-based generic simulation toolkit for electron multipliers represented by Microchannel Plate

abstract: The simulation of the instruments based on the cascade multiplication of electrons has always been an important and challenging subject in no matter high energy physics, astrophysics, radiography and other fields. In this work, a generic simulation toolkit is developed based on Geant4, ROOT and CADMesh toolkits for the electron multipliers based on the emission process of secondary electrons, especially for Microchannel Plate (MCP). Geometry of instruments can be directly imported by standard CAD files and multiple kinds of electromagnetic fields are supported. MCPSim is capable for simulating the general hadronic, weak and electromagnetic processes together with secondary electron emission, which provides a wider range of applications. Users are able to configure the simulation and define the output information by a simple textfile. By comparing with experimental measurements, good agreement is found. MCPSim is expected to guide the design and optimization of such electron multipliers and will be continuously developed and maintained to better satisfy the present and future requirements.


title: Distribution-Based Trajectory Clustering

abstract: Trajectory clustering enables the discovery of common patterns in trajectory data. Current methods of trajectory clustering rely on a distance measure between two points in order to measure the dissimilarity between two trajectories. The distance measures employed have two challenges: high computational cost and low fidelity. Independent of the distance measure employed, existing clustering algorithms have another challenge: either effectiveness issues or high time complexity. In this paper, we propose to use a recent Isolation Distributional Kernel (IDK) as the main tool to meet all three challenges. The new IDK-based clustering algorithm, called TIDKC, makes full use of the distributional kernel for trajectory similarity measuring and clustering. TIDKC identifies non-linearly separable clusters with irregular shapes and varied densities in linear time. It does not rely on random initialisation and is robust to outliers. An extensive evaluation on 7 large real-world trajectory datasets confirms that IDK is more effective in capturing complex structures in trajectories than traditional and deep learning-based distance measures. Furthermore, the proposed TIDKC has superior clustering performance and efficiency to existing trajectory clustering algorithms.


title: Cross-domain Robust Deepfake Bias Expansion Network for Face Forgery Detection

abstract: The rapid advancement of deepfake technologies raises significant concerns about the security of face recognition systems. While existing methods leverage the clues left by deepfake techniques for face forgery detection, malicious users may intentionally manipulate forged faces to obscure the traces of deepfake clues and thereby deceive detection tools. Meanwhile, attaining cross-domain robustness for data-based methods poses a challenge due to potential gaps in the training data, which may not encompass samples from all relevant domains. Therefore, in this paper, we introduce a solution - a Cross-Domain Robust Bias Expansion Network (BENet) - designed to enhance face forgery detection. BENet employs an auto-encoder to reconstruct input faces, maintaining the invariance of real faces while selectively enhancing the difference between reconstructed fake faces and their original counterparts. This enhanced bias forms a robust foundation upon which dependable forgery detection can be built. To optimize the reconstruction results in BENet, we employ a bias expansion loss infused with contrastive concepts to attain the aforementioned objective. In addition, to further heighten the amplification of forged clues, BENet incorporates a Latent-Space Attention (LSA) module. This LSA module effectively captures variances in latent features between the auto-encoder's encoder and decoder, placing emphasis on inconsistent forgery-related information. Furthermore, BENet incorporates a cross-domain detector with a threshold to determine whether the sample belongs to a known distribution. The correction of classification results through the cross-domain detector enables BENet to defend against unknown deepfake attacks from cross-domain. Extensive experiments demonstrate the superiority of BENet compared with state-of-the-art methods in intra-database and cross-database evaluations.


title: Bidirectional Knowledge Reconfiguration for Lightweight Point Cloud Analysis

abstract: Point cloud analysis faces computational system overhead, limiting its application on mobile or edge devices. Directly employing small models may result in a significant drop in performance since it is difficult for a small model to adequately capture local structure and global shape information simultaneously, which are essential clues for point cloud analysis. This paper explores feature distillation for lightweight point cloud models. To mitigate the semantic gap between the lightweight student and the cumbersome teacher, we propose bidirectional knowledge reconfiguration (BKR) to distill informative contextual knowledge from the teacher to the student. Specifically, a top-down knowledge reconfiguration and a bottom-up knowledge reconfiguration are developed to inherit diverse local structure information and consistent global shape knowledge from the teacher, respectively. However, due to the farthest point sampling in most point cloud models, the intermediate features between teacher and student are misaligned, deteriorating the feature distillation performance. To eliminate it, we propose a feature mover's distance (FMD) loss based on optimal transportation, which can measure the distance between unordered point cloud features effectively. Extensive experiments conducted on shape classification, part segmentation, and semantic segmentation benchmarks demonstrate the universality and superiority of our method.


title: UReader: Universal OCR-free Visually-situated Language Understanding with Multimodal Large Language Model

abstract: Text is ubiquitous in our visual world, conveying crucial information, such as in documents, websites, and everyday photographs. In this work, we propose UReader, a first exploration of universal OCR-free visually-situated language understanding based on the Multimodal Large Language Model (MLLM). By leveraging the shallow text recognition ability of the MLLM, we only finetuned 1.2% parameters and the training cost is much lower than previous work following domain-specific pretraining and finetuning paradigms. Concretely, UReader is jointly finetuned on a wide range of Visually-situated Language Understanding tasks via a unified instruction format. To enhance the visual text and semantic understanding, we further apply two auxiliary tasks with the same format, namely text reading and key points generation tasks. We design a shape-adaptive cropping module before the encoder-decoder architecture of MLLM to leverage the frozen low-resolution vision encoder for processing high-resolution images. Without downstream finetuning, our single model achieves state-of-the-art ocr-free performance in 8 out of 10 visually-situated language understanding tasks, across 5 domains: documents, tables, charts, natural images, and webpage screenshots. Codes and instruction-tuning datasets will be released.


title: Pulsed-mode metalorganic vapor-phase epitaxy of GaN on graphene-coated c-sapphire for freestanding GaN thin films

abstract: We report the growth of high-quality GaN epitaxial thin films on graphene-coated c-sapphire substrates using pulsed-mode metalorganic vapor-phase epitaxy, together with the fabrication of freestanding GaN films by simple mechanical exfoliation for transferable light-emitting diodes (LEDs). High-quality GaN films grown on the graphene-coated sapphire substrates were easily lifted off using thermal release tape and transferred onto foreign substrates. Furthermore, we revealed that the pulsed operation of ammonia flow during GaN growth was a critical factor for the fabrication of high-quality freestanding GaN films. These films, exhibiting excellent single crystallinity, were utilized to fabricate transferable GaN LEDs by heteroepitaxially growing InxGa1-xN/GaN multiple quantum wells and a p-GaN layer on the GaN films, showing their potential application in advanced optoelectronic devices.


title: Instances and Labels: Hierarchy-aware Joint Supervised Contrastive Learning for Hierarchical Multi-Label Text Classification

abstract: Hierarchical multi-label text classification (HMTC) aims at utilizing a label hierarchy in multi-label classification. Recent approaches to HMTC deal with the problem of imposing an over-constrained premise on the output space by using contrastive learning on generated samples in a semi-supervised manner to bring text and label embeddings closer. However, the generation of samples tends to introduce noise as it ignores the correlation between similar samples in the same batch. One solution to this issue is supervised contrastive learning, but it remains an underexplored topic in HMTC due to its complex structured labels. To overcome this challenge, we propose $\textbf{HJCL}$, a $\textbf{H}$ierarchy-aware $\textbf{J}$oint Supervised $\textbf{C}$ontrastive $\textbf{L}$earning method that bridges the gap between supervised contrastive learning and HMTC. Specifically, we employ both instance-wise and label-wise contrastive learning techniques and carefully construct batches to fulfill the contrastive learning objective. Extensive experiments on four multi-path HMTC datasets demonstrate that HJCL achieves promising results and the effectiveness of Contrastive Learning on HMTC.


title: ed-cec: improving rare word recognition using asr postprocessing based on error detection and context-aware error correction

abstract: Automatic speech recognition (ASR) systems often encounter difficulties in accurately recognizing rare words, leading to errors that can have a negative impact on downstream tasks such as keyword spotting, intent detection, and text summarization. To address this challenge, we present a novel ASR postprocessing method that focuses on improving the recognition of rare words through error detection and context-aware error correction. Our method optimizes the decoding process by targeting only the predicted error positions, minimizing unnecessary computations. Moreover, we leverage a rare word list to provide additional contextual knowledge, enabling the model to better correct rare words. Experimental results across five datasets demonstrate that our proposed method achieves significantly lower word error rates (WERs) than previous approaches while maintaining a reasonable inference speed. Furthermore, our approach exhibits promising robustness across different ASR systems.


title: Fast-DetectGPT: Efficient Zero-Shot Detection of Machine-Generated Text via Conditional Probability Curvature

abstract: Large language models (LLMs) have shown the ability to produce fluent and cogent content, presenting both productivity opportunities and societal risks. To build trustworthy AI systems, it is imperative to distinguish between machine-generated and human-authored content. The leading zero-shot detector, DetectGPT, showcases commendable performance but is marred by its intensive computational costs. In this paper, we introduce the concept of conditional probability curvature to elucidate discrepancies in word choices between LLMs and humans within a given context. Utilizing this curvature as a foundational metric, we present **Fast-DetectGPT**, an optimized zero-shot detector, which substitutes DetectGPT's perturbation step with a more efficient sampling step. Our evaluations on various datasets, source models, and test conditions indicate that Fast-DetectGPT not only surpasses DetectGPT by a relative around 75% in both the white-box and black-box settings but also accelerates the detection process by a factor of 340, as detailed in Table 1. See \url{https://github.com/baoguangsheng/fast-detect-gpt} for code, data, and results.