title: Guaranteed Sampling Flexibility for Low-tubal-rank Tensor Completion

abstract: While Bernoulli sampling is extensively studied in tensor completion, t-CUR sampling approximates low-tubal-rank tensors via lateral and horizontal subtensors. However, both methods lack sufficient flexibility for diverse practical applications. To address this, we introduce Tensor Cross-Concentrated Sampling (t-CCS), a novel and straightforward sampling model that advances the matrix cross-concentrated sampling concept within a tensor framework. t-CCS effectively bridges the gap between Bernoulli and t-CUR sampling, offering additional flexibility that can lead to computational savings in various contexts. A key aspect of our work is the comprehensive theoretical analysis provided. We establish a sufficient condition for the successful recovery of a low-rank tensor from its t-CCS samples. In support of this, we also develop a theoretical framework validating the feasibility of t-CUR via uniform random sampling and conduct a detailed theoretical sampling complexity analysis for tensor completion problems utilizing the general Bernoulli sampling model. Moreover, we introduce an efficient non-convex algorithm, the Iterative t-CUR Tensor Completion (ITCURTC) algorithm, specifically designed to tackle the t-CCS-based tensor completion. We have intensively tested and validated the effectiveness of the t-CCS model and the ITCURTC algorithm across both synthetic and real-world datasets.


title: RAEmoLLM: Retrieval Augmented LLMs for Cross-Domain Misinformation Detection Using In-Context Learning based on Emotional Information

abstract: Misinformation is prevalent in various fields such as education, politics, health, etc., causing significant harm to society. However, current methods for cross-domain misinformation detection rely on time and resources consuming fine-tuning and complex model structures. With the outstanding performance of LLMs, many studies have employed them for misinformation detection. Unfortunately, they focus on in-domain tasks and do not incorporate significant sentiment and emotion features (which we jointly call affect). In this paper, we propose RAEmoLLM, the first retrieval augmented (RAG) LLMs framework to address cross-domain misinformation detection using in-context learning based on affective information. It accomplishes this by applying an emotion-aware LLM to construct a retrieval database of affective embeddings. This database is used by our retrieval module to obtain source-domain samples, which are subsequently used for the inference module's in-context few-shot learning to detect target domain misinformation. We evaluate our framework on three misinformation benchmarks. Results show that RAEmoLLM achieves significant improvements compared to the zero-shot method on three datasets, with the highest increases of 20.69%, 23.94%, and 39.11% respectively. This work will be released on https://github.com/lzw108/RAEmoLLM.


title: Report on the 12th Annual USA Junior Mathematical Olympiad

abstract: We present the problems and solutions to the 12th Annual USA Junior Mathematical Olympiad.


title: Exact black hole solutions in scalar-tensor theories

abstract: General Relativity allows for a unique black hole solution, characterized by its mass M, angular momentum J, and electric charge Q. Black holes in General Relativity are thus said to have no hair, that is, no other independent physical quantity (no-hair theorem). Despite the numerous successes of General Relativity, some limitations remain, like the central singularity possessed by black holes, where the curvature of spacetime becomes infinite. Modified theories of gravity try to solve some of these shortcomings. This thesis tests the no-hair theorem in a popular modification of gravity, called scalar-tensor theories, where a unique degree of freedom (a scalar field) is added on top of the usual metric of spacetime of General Relativity. Using various symmetries, new black holes, called hairy black holes, are obtained. Some of them evade strongly the no-hair theorem, being characterized by a new quantity (primary scalar hair), distinct from M, J or Q. An interesting progress is also achieved, since in certain cases, the usual singularity disappears: the curvature of spacetime remains bounded even at the core of the black hole. Moreover, theoretical links are established between scalar-tensor theories (which take place in the usual four dimensions of spacetime), and theories of gravity in higher dimensions, by Kaluza-Klein reduction. Finally, certain particular properties of scalar-tensor theories enable to transform initial black hole solutions into other solutions with very distinct geometry, like wormholes or non-stationary black holes.


title: The Potential and Challenges of Evaluating Attitudes, Opinions, and Values in Large Language Models

abstract: Recent advances in Large Language Models (LLMs) have sparked wide interest in validating and comprehending the human-like cognitive-behavioral traits LLMs may have. These cognitive-behavioral traits include typically Attitudes, Opinions, Values (AOV). However, measuring AOV embedded within LLMs remains opaque, and different evaluation methods may yield different results. This has led to a lack of clarity on how different studies are related to each other and how they can be interpreted. This paper aims to bridge this gap by providing an overview of recent works on the evaluation of AOV in LLMs. Moreover, we survey related approaches in different stages of the evaluation pipeline in these works. By doing so, we address the potential and challenges with respect to understanding the model, human-AI alignment, and downstream application in social sciences. Finally, we provide practical insights into evaluation methods, model enhancement, and interdisciplinary collaboration, thereby contributing to the evolving landscape of evaluating AOV in LLMs.


title: InstructCMP: Length Control in Sentence Compression through Instruction-based Large Language Models

abstract: Extractive summarization can produce faithful summaries but often requires additional constraints such as a desired summary length. Traditional sentence compression models do not typically consider the constraints because of their restricted model abilities, which require model modifications for coping with them. To bridge this gap, we propose Instruction-based Compression (InstructCMP), an approach to the sentence compression task that can consider the length constraint through instructions by leveraging the zero-shot task-solving abilities of Large Language Models (LLMs). For this purpose, we created new evaluation datasets by transforming traditional sentence compression datasets into an instruction format. By using the datasets, we first reveal that the current LLMs still face challenges in accurately controlling the length for a compressed text. To address this issue, we propose an approach named "length priming," that incorporates additional length information into the instructions without external resources. While the length priming effectively works in a zero-shot setting, a training dataset with the instructions would further improve the ability of length control. Thus, we additionally created a training dataset in an instruction format to fine-tune the model on it. Experimental results and analysis show that applying the length priming significantly improves performances of InstructCMP in both zero-shot and fine-tuning settings without the need of any model modifications.


title: Atomistic theory of twist-angle dependent intralayer and interlayer exciton properties in twisted bilayer materials

abstract: Twisted bilayers of two-dimensional (2D) materials have emerged as a highly tunable platform to study and engineer properties of excitons. However, the atomistic description of these properties has remained a significant challenge as a consequence of the large unit cells of the emergent moir\'e superlattices. To address this problem, we introduce an efficient approach to solve the Bethe-Salpeter equation that exploits the localization of atomic Wannier functions. We then use this approach to study intra- and interlayer excitons in twisted WS$_{2}$/WSe$_{2}$ at a range of twist angles. In agreement with experiment, we find that the optical spectrum exhibits three low-energy peaks for twist angles small than $2^\circ$. The energy splitting between the peaks is described accurately. We also find two low-energy interlayer excitons with weak oscillator strengths. Our approach opens up new opportunities for the design of light-matter interactions in ultrathin materials.


title: Gateway to all-optical spin switching in Heusler ferrimagnets: Pancharatnam-Berry tensor and magnetic moment ratio

abstract: All-optical spin switching (AOS) is a new phenomenon found in a small group of magnetic media, where a single laser pulse can switch spins from one direction to another, without assistance of a magnetic field, on a time scale much shorter than existing magnetic technology. However, despite intensive efforts over a decade, its underlying working principle remains elusive. Here through manganese-based Heusler ferrimagnets, we show that a group of flat bands around the Fermi level act as gateway states to form efficient channels or spin switching, where their noncentrosymmetry allows us to correlate the spin dynamics to the second-order optical response. To quantify their efficacy, we introduce the third-rank Pancharatnam-Berry tensor (PB tensor), $\boldsymbol{\eta}^{(3)}=\langle i |{\bf p} |m\rangle \langle m|{\bf p} |f\rangle \langle f|{\bf p} |i\rangle,$ where $|i\rangle$, $|m\rangle$ and $|f\rangle$ are initial, intermediate and final band states, respectively, and ${\bf p}$ is the momentum operator. A picture emerges: Those which show AOS, such as the recently discovered Mn$_2$RuGa, always have a large PB tensor element} but have a small sublattice spin moment ratio, consistent with the prior experimental small remanence criterion. This does not only reveal that the delicate balance between the large PB tensor element and the small sublattice spin ratio plays a decisive role in AOS, but also, conceptually, connects the $n$th-order nonlinear optics to $(n+1)$th-rank PB tensors in general.

categories: cond-mat.mtrl-sci cond-mat.mes-hall physics.comp-ph physics.optics


title: An Analysis on Quantizing Diffusion Transformers

abstract: Diffusion Models (DMs) utilize an iterative denoising process to transform random noise into synthetic data. Initally proposed with a UNet structure, DMs excel at producing images that are virtually indistinguishable with or without conditioned text prompts. Later transformer-only structure is composed with DMs to achieve better performance. Though Latent Diffusion Models (LDMs) reduce the computational requirement by denoising in a latent space, it is extremely expensive to inference images for any operating devices due to the shear volume of parameters and feature sizes. Post Training Quantization (PTQ) offers an immediate remedy for a smaller storage size and more memory-efficient computation during inferencing. Prior works address PTQ of DMs on UNet structures have addressed the challenges in calibrating parameters for both activations and weights via moderate optimization. In this work, we pioneer an efficient PTQ on transformer-only structure without any optimization. By analysing challenges in quantizing activations and weights for diffusion transformers, we propose a single-step sampling calibration on activations and adapt group-wise quantization on weights for low-bit quantization. We demonstrate the efficiency and effectiveness of proposed methods with preliminary experiments on conditional image generation.


title: Large and layer dependent nonlinear optical absorption of MXene 2D thin films

abstract: As a rapidly expanding family of two dimensional (2D) materials, MXenes have recently gained considerable attention due to their appealing properties. Here, by developing a solution based coating method that enables transfer free and layer by layer film coating, we investigate the layer dependent nonlinear optical absorption of Ti3C2Tx films, an important member of the MXene family. By using the Zscan technique, we characterize the nonlinear absorption of the prepared MXene films consisting of different numbers of monolayers. The results show that there is a strong and layer dependent nonlinear absorption behavior, transitioning from revisable saturable absorption (RSA) to saturable absorption (SA) as the layer number increases from 5 to 30. Notably, the nonlinear absorption coefficient beta varies significantly within this range, changing from 7.13 x 100 cm/GW to -2.69 100 cm/GW. We also characterize the power dependent nonlinear absorption of the MXene films at various incident laser intensities, and a decreasing trend in beta is observed for increasing laser intensity. These results reveal the intriguing layer dependent nonlinear optical properties of 2D MXene films, highlighting their versatility and potential for implementing high-performance nonlinear photonic devices.


title: Grading Massive Open Online Courses Using Large Language Models

abstract: Massive open online courses (MOOCs) offer free education globally to anyone with a computer and internet access. Despite this democratization of learning, the massive enrollment in these courses makes it impractical for one instructor to assess every student's writing assignment. As a result, peer grading, often guided by a straightforward rubric, is the method of choice. While convenient, peer grading often falls short in terms of reliability and validity. In this study, we explore the feasibility of using large language models (LLMs) to replace peer grading in MOOCs. Specifically, we use two LLMs, GPT-4 and GPT-3.5, across three MOOCs: Introductory Astronomy, Astrobiology, and the History and Philosophy of Astronomy. To instruct LLMs, we use three different prompts based on the zero-shot chain-of-thought (ZCoT) prompting technique: (1) ZCoT with instructor-provided correct answers, (2) ZCoT with both instructor-provided correct answers and rubrics, and (3) ZCoT with instructor-provided correct answers and LLM-generated rubrics. Tested on 18 settings, our results show that ZCoT, when augmented with instructor-provided correct answers and rubrics, produces grades that are more aligned with those assigned by instructors compared to peer grading. Finally, our findings indicate a promising potential for automated grading systems in MOOCs, especially in subjects with well-defined rubrics, to improve the learning experience for millions of online learners worldwide.


title: Nonminimally coupled scalar field in Schwarzschild--de Sitter spacetime: Geodesic synchrotron radiation

abstract: We analyze the scalar radiation emitted by a source interacting with a nonminimally coupled scalar field in four-dimensional Schwarzschild--de Sitter spacetime. We obtain the emission probability using quantum field theory in curved spacetimes at tree level. We find that the source emits synchrotron-type radiation for orbits near the photon sphere for all allowed values of the parameters. We also find that the emitted power strongly depends on the coupling to the curvature scalar. In particular, the previously observed enhancement in the contribution of lower multipoles to the emitted power in this spacetime with minimal coupling is absent when conformal coupling is considered.


title: Beyond the Hype: A Cautionary Tale of ChatGPT in the Programming Classroom

abstract: Due to the proliferation of Large Language Models research and the use of various Artificial Intelligence (AI) tools, the field of information systems (IS) and computer science (CS) has evolved. The use of tools such as ChatGPT to complete various student programming exercises (e.g., in Python) and assignments has gained prominence amongst various academic institutions. However, recent literature has suggested that the use of ChatGPT in academia is problematic and the impact on teaching and learning should be further scrutinized. More specifically, little is known about how ChatGPT can be practically used with code (programming) writing to complete programming exercises amongst IS and CS undergraduate university students. Furthermore, the paper provides insights for academics who teach programming to create more challenging exercises and how to engage responsibly in the use of ChatGPT to promote classroom integrity. In this paper, we used Complex Adaptive Systems (CAS) theory as a theoretical guide to understand the various dynamics through classroom code demonstrations. Using ChatGPT 3.5, we analyzed the various practical programming examples from past IS exercises and compared those with memos created by tutors and lecturers in a university setting. This paper highlights common ways of assessment, programming errors created by ChatGPT and the potential consideration for IS academics to ensure the development of critical programming skills among students.


title: Exploiting Diffusion Prior for Out-of-Distribution Detection

abstract: Out-of-distribution (OOD) detection is crucial for deploying robust machine learning models, especially in areas where security is critical. However, traditional OOD detection methods often fail to capture complex data distributions from large scale date. In this paper, we present a novel approach for OOD detection that leverages the generative ability of diffusion models and the powerful feature extraction capabilities of CLIP. By using these features as conditional inputs to a diffusion model, we can reconstruct the images after encoding them with CLIP. The difference between the original and reconstructed images is used as a signal for OOD identification. The practicality and scalability of our method is increased by the fact that it does not require class-specific labeled ID data, as is the case with many other methods. Extensive experiments on several benchmark datasets demonstrates the robustness and effectiveness of our method, which have significantly improved the detection accuracy.


title: From Intentions to Techniques: A Comprehensive Taxonomy and Challenges in Text Watermarking for Large Language Models

abstract: With the rapid growth of Large Language Models (LLMs), safeguarding textual content against unauthorized use is crucial. Text watermarking offers a vital solution, protecting both - LLM-generated and plain text sources. This paper presents a unified overview of different perspectives behind designing watermarking techniques, through a comprehensive survey of the research literature. Our work has two key advantages, (1) we analyze research based on the specific intentions behind different watermarking techniques, evaluation datasets used, watermarking addition, and removal methods to construct a cohesive taxonomy. (2) We highlight the gaps and open challenges in text watermarking to promote research in protecting text authorship. This extensive coverage and detailed analysis sets our work apart, offering valuable insights into the evolving landscape of text watermarking in language models.


title: Exploring Safety-Utility Trade-Offs in Personalized Language Models

abstract: As large language models (LLMs) become increasingly integrated into daily applications, it is essential to ensure they operate fairly across diverse user demographics. In this work, we show that LLMs suffer from personalization bias, where their performance is impacted when they are personalized to a user's identity. We quantify personalization bias by evaluating the performance of LLMs along two axes - safety and utility. We measure safety by examining how benign LLM responses are to unsafe prompts with and without personalization. We measure utility by evaluating the LLM's performance on various tasks, including general knowledge, mathematical abilities, programming, and reasoning skills. We find that various LLMs, ranging from open-source models like Llama (Touvron et al., 2023) and Mistral (Jiang et al., 2023) to API-based ones like GPT-3.5 and GPT-4o (Ouyang et al., 2022), exhibit significant variance in performance in terms of safety-utility trade-offs depending on the user's identity. Finally, we discuss several strategies to mitigate personalization bias using preference tuning and prompt-based defenses.


title: Rare leptonic and semi-leptonic decays at LHCb

abstract: Rare leptonic and semi-leptonic decays offer an excellent opportunity to test the Standard Model of Particle Physics. These proceedings report on two recent LHCb measurements. The first is an observation of the rare $J/\psi \to \mu^{+}\mu^{-}\mu^{+}\mu^{-}$ decay and the second is a comprehensive measurement of local and nonlocal contributions to the $B^0 \to K^{*0}\mu^{+}\mu^{-}$ decay.


title: Investigating Annotator Bias in Large Language Models for Hate Speech Detection

abstract: Data annotation, the practice of assigning descriptive labels to raw data, is pivotal in optimizing the performance of machine learning models. However, it is a resource-intensive process susceptible to biases introduced by annotators. The emergence of sophisticated Large Language Models (LLMs), like ChatGPT presents a unique opportunity to modernize and streamline this complex procedure. While existing research extensively evaluates the efficacy of LLMs, as annotators, this paper delves into the biases present in LLMs, specifically GPT 3.5 and GPT 4o when annotating hate speech data. Our research contributes to understanding biases in four key categories: gender, race, religion, and disability. Specifically targeting highly vulnerable groups within these categories, we analyze annotator biases. Furthermore, we conduct a comprehensive examination of potential factors contributing to these biases by scrutinizing the annotated data. We introduce our custom hate speech detection dataset, HateSpeechCorpus, to conduct this research. Additionally, we perform the same experiments on the ETHOS (Mollas et al., 2022) dataset also for comparative analysis. This paper serves as a crucial resource, guiding researchers and practitioners in harnessing the potential of LLMs for dataannotation, thereby fostering advancements in this critical field. The HateSpeechCorpus dataset is available here: https://github.com/AmitDasRup123/HateSpeechCorpus


title: How Neural Networks Learn the Support is an Implicit Regularization Effect of SGD

abstract: We investigate the ability of deep neural networks to identify the support of the target function. Our findings reveal that mini-batch SGD effectively learns the support in the first layer of the network by shrinking to zero the weights associated with irrelevant components of input. In contrast, we demonstrate that while vanilla GD also approximates the target function, it requires an explicit regularization term to learn the support in the first layer. We prove that this property of mini-batch SGD is due to a second-order implicit regularization effect which is proportional to $\eta / b$ (step size / batch size). Our results are not only another proof that implicit regularization has a significant impact on training optimization dynamics but they also shed light on the structure of the features that are learned by the network. Additionally, they suggest that smaller batches enhance feature interpretability and reduce dependency on initialization.


title: No evidence for a dip in the binary black hole mass spectrum

abstract: Stellar models indicate that the core compactness of a star, which is a common proxy for its explodability in a supernova, does not increase monotonically with the star's mass. Rather, the core compactness dips sharply over a range of carbon-oxygen core masses; this range may be somewhat sensitive to the star's metallicity and evolutionary history. Stars in this compactness dip are expected to experience supernovae leaving behind neutron stars, whereas stars on either side of this range are expected to form black holes. This results in a hypothetical mass range in which black holes should seldom form. Quantitatively, when applied to binary stripped stars, these models predict a dearth of binary black holes with component masses $\approx 10 M_\odot - 15 M_\odot$. The population of gravitational-wave signals indicates weak evidence for a dip in the distribution of chirp masses of merging binary black holes near $\approx 10 M_\odot - 12 M_\odot$. This feature could be linked to the hypothetical component mass gap described above, but this interpretation depends on what assumptions are made of the binaries' mass ratios. Here, we directly probe the distribution of binary black hole component masses to look for evidence of a gap. We find no evidence for this feature using data from the third gravitational-wave transient catalogue (GWTC-3). If this gap does exist in nature, we find that it is unlikely to be resolvable by the end of the current (fourth) LIGO-Virgo-KAGRA (LVK) observing run.


title: Universal bound on Ergotropy and No-Go Theorem by the Eigenstate Thermalization Hypothesis

abstract: We show that the maximum extractable work (ergotropy) from a quantum many-body system is constrained by local athermality of an initial state and local entropy decrease brought about by quantum operations. The obtained universal bound on ergotropy implies that the eigenstate thermalization hypothesis prohibits work extraction from energy eigenstates by means of finite-time unitary operations. This no-go property implies that Planck's principle, a form of the second law of thermodynamics, holds even for pure quantum states. Our result bridges two independently studied concepts of quantum thermodynamics, the second law and thermalization, via intrasystem correlations in many-body systems as a resource for work extraction.


title: Matrix periods and competition periods of Boolean Toeplitz matrices II

abstract: This paper is a follow-up to the paper [Matrix periods and competition periods of Boolean Toeplitz matrices, {\it Linear Algebra Appl.} 672:228--250, (2023)]. Given subsets $S$ and $T$ of $\{1,\ldots,n-1\}$, an $n\times n$ Toeplitz matrix $A=T_n\langle S ; T \rangle$ is defined to have $1$ as the $(i,j)$-entry if and only if $j-i \in S$ or $i-j \in T$. In the previous paper, we have shown that the matrix period and the competition period of Toeplitz matrices $A=T_n\langle S; T \rangle$ satisfying the condition ($\star$) $\max S+\min T \le n$ and $\min S+\max T \le n$ are $d^+/d$ and $1$, respectively, where $d^+= \gcd (s+t \mid s \in S, t \in T)$ and $d = \gcd(d, \min S)$. In this paper, we claim that even if ($\star$) is relaxed to the existence of elements $s \in S$ and $t \in T$ satisfying $s+t \le n$ and $\gcd(s,t)=1$, the same result holds. There are infinitely many Toeplitz matrices that do not satisfy ($\star$) but the relaxed condition. For example, for any positive integers $k, n$ with $2k+1 \le n$, it is easy to see that $T_n\langle k, n-k;k+1, n-k-1 \rangle$ does not satisfies ($\star$) but satisfies the relaxed condition. Furthermore, we show that the limit of the matrix sequence $\{A^m(A^T)^m\}_{m=1}^\infty$ is $T_n\langle d^+,2d^+, \ldots, \lfloor n/d^+\rfloor d^+\rangle$.


title: $B_c^{\pm}$-$^{12}$C states and detailed study of momentum space method for $\Upsilon$- and $\eta_b$-nucleus bound states

abstract: We perform a detailed study of the $\Upsilon$-, $\eta_b$- and $B_c$-nucleus systems in momentum space to calculate the bound-state energies and the corresponding coordinate space radial wave functions. A comparison is made among different methods to obtain the partial wave decomposition of meson-nucleus potentials in momentum space, namely, (i) the spherical Bessel transform of the numerically obtained original potential in coordinate space, (ii) the partial wave decomposition of the Fourier transform of the Woods-Saxon approximated form for the original potential, and (iii) the spherical Bessel transform of the Woods-Saxon approximation of the numerically obtained original potential. The strong nuclear bound-state energies for the $\Upsilon$-$^{4}$He, $\Upsilon$-$^{12}$C, $\eta_b$-$^{4}$He, $\eta_b$-$^{12}$C, $B_c$-$^{4}$He (no Coulomb), and $B_c$-$^{12}$C (no Coulomb) systems and the corresponding wave functions in coordinate space are compared for the three methods. Furthermore, as an initial and realistic study, the $B_c^{\pm}$-$^{12}$C bound states are studied for the first time, with the effects of self-consistently calculated Coulomb potentials in $^{12}$C (when the $B_c^{\pm}$ mesons are absent).


title: Text Grafting: Near-Distribution Weak Supervision for Minority Classes in Text Classification

abstract: For extremely weak-supervised text classification, pioneer research generates pseudo labels by mining texts similar to the class names from the raw corpus, which may end up with very limited or even no samples for the minority classes. Recent works have started to generate the relevant texts by prompting LLMs using the class names or definitions; however, there is a high risk that LLMs cannot generate in-distribution (i.e., similar to the corpus where the text classifier will be applied) data, leading to ungeneralizable classifiers. In this paper, we combine the advantages of these two approaches and propose to bridge the gap via a novel framework, \emph{text grafting}, which aims to obtain clean and near-distribution weak supervision for minority classes. Specifically, we first use LLM-based logits to mine masked templates from the raw corpus, which have a high potential for data synthesis into the target minority class. Then, the templates are filled by state-of-the-art LLMs to synthesize near-distribution texts falling into minority classes. Text grafting shows significant improvement over direct mining or synthesis on minority classes. We also use analysis and case studies to comprehend the property of text grafting.


title: Grammaticality Representation in ChatGPT as Compared to Linguists and Laypeople

abstract: Large language models (LLMs) have demonstrated exceptional performance across various linguistic tasks. However, it remains uncertain whether LLMs have developed human-like fine-grained grammatical intuition. This preregistered study (https://osf.io/t5nes) presents the first large-scale investigation of ChatGPT's grammatical intuition, building upon a previous study that collected laypeople's grammatical judgments on 148 linguistic phenomena that linguists judged to be grammatical, ungrammatical, or marginally grammatical (Sprouse, Schutze, & Almeida, 2013). Our primary focus was to compare ChatGPT with both laypeople and linguists in the judgement of these linguistic constructions. In Experiment 1, ChatGPT assigned ratings to sentences based on a given reference sentence. Experiment 2 involved rating sentences on a 7-point scale, and Experiment 3 asked ChatGPT to choose the more grammatical sentence from a pair. Overall, our findings demonstrate convergence rates ranging from 73% to 95% between ChatGPT and linguists, with an overall point-estimate of 89%. Significant correlations were also found between ChatGPT and laypeople across all tasks, though the correlation strength varied by task. We attribute these results to the psychometric nature of the judgment tasks and the differences in language processing styles between humans and LLMs.


title: Parametric Resonance in Networked Oscillators

abstract: We investigate parametric resonance in oscillator networks subjected to periodically time-varying oscillations in the edge strengths. Such models are inspired by the well-known parametric resonance phenomena for single oscillators, as well as the potential rich phenomenology when such parametric excitations are present in a variety of applications like deep brain stimulation, AC power transmission networks, as well as vehicular flocking formations. We consider cases where a single edge, a subgraph, or the entire network is subjected to forcing, and in each case, we characterize an interesting interplay between the parametric resonance modes and the eigenvalues/vectors of the graph Laplacian. Our analysis is based on a novel treatment of multiple-scale perturbation analysis that we develop for the underlying high-dimensional dynamic equations.


title: Incentivizing Quality Text Generation via Statistical Contracts

abstract: While the success of large language models (LLMs) increases demand for machine-generated text, current pay-per-token pricing schemes create a misalignment of incentives known in economics as moral hazard: Text-generating agents have strong incentive to cut costs by preferring a cheaper model over the cutting-edge one, and this can be done "behind the scenes" since the agent performs inference internally. In this work, we approach this issue from an economic perspective, by proposing a pay-for-performance, contract-based framework for incentivizing quality. We study a principal-agent game where the agent generates text using costly inference, and the contract determines the principal's payment for the text according to an automated quality evaluation. Since standard contract theory is inapplicable when internal inference costs are unknown, we introduce cost-robust contracts. As our main theoretical contribution, we characterize optimal cost-robust contracts through a direct correspondence to optimal composite hypothesis tests from statistics, generalizing a result of Saig et al. (NeurIPS'23). We evaluate our framework empirically by deriving contracts for a range of objectives and LLM evaluation benchmarks, and find that cost-robust contracts sacrifice only a marginal increase in objective value compared to their cost-aware counterparts.


title: Identification of Physical Properties in Acoustic Tubes Using Physics-Informed Neural Networks

abstract: Physics-informed Neural Networks (PINNs) is a method for numerical simulation that incorporates a loss function corresponding to the governing equations into a neural network. While PINNs have been explored for their utility in inverse analysis, their application in acoustic analysis remains limited. This study presents a method to identify loss parameters in acoustic tubes using PINNs. We categorized the loss parameters into two groups: one dependent on the tube's diameter and another constant, independent of it. The latter were set as the trainable parameters of the neural network. The problem of identifying the loss parameter was formulated as an optimization problem, with the physical properties being determined through this process. The neural network architecture employed was based on our previously proposed ResoNet, which is designed for analyzing acoustic resonance. The efficacy of the proposed method is assessed through both forward and inverse analysis, specifically through the identification of loss parameters. The findings demonstrate that it is feasible to accurately identify parameters that significantly impact the sound field under analysis. By merely altering the governing equations in the loss function, this method could be adapted to various sound fields, suggesting its potential for broad application.


title: Neumann cut-offs and essential self-adjointness on complete Riemannian manifolds with boundary

abstract: We generalize some fundamental results for noncompact Riemannian manfolds without boundary, that only require completeness and no curvature assumptions, to manifolds with boundary: let $M$ be a smooth Riemannian manifold with boundary $\partial M$ and let $\hat{C}^\infty_c(M)$ denote the space of smooth compactly supported cut-off functions with vanishing normal derivative, Neumann cut-offs. We show, among other things, that under completeness: - $\hat{C}^\infty_c(M)$ is dense in $W^{1,p}(\mathring{M})$ for all $p\in (1,\infty)$; this generalizes a classical result by Aubin [2] for $\partial M=\emptyset$. - $M$ admits a sequence of first order cut-off functions in $\hat{C}^\infty_c(M)$; for $\partial M=\emptyset$ this result can be traced back to Gaffney [7]. - the Laplace-Beltrami operator with domain of definition $\hat{C}^\infty_c(M)$ is essentially self-adjoint; this is a generalization of a classical result by Strichartz [20] for $\partial M=\emptyset$.


title: Catalytic evolution of cooperation in a population with behavioural bimodality

abstract: The remarkable adaptability of humans in response to complex environments is often demonstrated by the context-dependent adoption of different behavioral modes. However, the existing game-theoretic studies mostly focus on the single-mode assumption, and the impact of this behavioral multimodality on the evolution of cooperation remains largely unknown. Here, we study how cooperation evolves in a population with two behavioral modes. Specifically, we incorporate Q-learning and Tit-for-Tat (TFT) rules into our toy model, where prisoner's dilemma game is played and we investigate the impact of the mode mixture on the evolution of cooperation. While players in Q-learning mode aim to maximize their accumulated payoffs, players within TFT mode repeat what their neighbors have done to them. In a structured mixing implementation where the updating rule is fixed for each individual, we find that the mode mixture greatly promotes the overall cooperation prevalence. The promotion is even more significant in the probabilistic mixing, where players randomly select one of the two rules at each step. Finally, this promotion is robust when players are allowed to adaptively choose the two modes by real-time comparison. In all three scenarios, players within the Q-learning mode act as catalyzer that turns the TFT players to be more cooperative, and as a result drive the whole population to be highly cooperative. The analysis of Q-tables explains the underlying mechanism of cooperation promotion, which captures the ``psychologic evolution" in the players' mind. Our study indicates that the variety of behavioral modes is non-negligible, and could be crucial to clarify the emergence of cooperation in the real world.


title: All-electron $BSE@GW$ method with Numeric Atom-Centered Orbitals for Extended Systems

abstract: Green's function theory has emerged as a powerful many-body approach not only in condensed matter physics but also in quantum chemistry in recent years. We have developed a new all-electron implementation of the BSE@GW formalism using numeric atom-centered orbital basis sets (Liu et al., J. Chem. Phys. 152, 044105 (2020)). We present our recent developments in implementing this formalism for extended systems with periodic boundary conditions. We discuss its numerical implementation and various convergence tests pertaining to numerical atom-centered orbitals, auxiliary basis sets for the resolution-of-identity formalism, and Brillouin zone sampling. Proof-of-principle examples are presented to compare with other formalisms, illustrating the new all-electron BSE@GW method for extended systems.


title: Embedded cylindrical and doughnut-shaped $\lambda$-hypersurfaces

abstract: In the paper, we construct, for $\lambda>0$, complete embedded and non-convex $\lambda$-hypersurfaces, which are diffeomorphic to a cylinder. Hence, one can not expect that $\lambda$-hypersurfaces share a common conclusion on the planar domain conjecture even if the planar domain conjecture of T. Ilmanen for self-shrinkers of mean curvature flow are solved by Brendle \cite{B} affirmatively. Furthermore, for a fixed $\lambda<0$ which may have small $|\lambda|$, we can construct two compact embedded $\lambda$-hypersurfaces which are diffeomorphic to $\mathbb{S}^{1}\times \mathbb{S}^{n-1}$, but they are not isometric to each other.


title: Time-dependent density functional theory study of induced-fission dynamics of $^{226}$Th

abstract: A microscopic finite-temperature model based on time-dependent nuclear density functional theory (TDDFT), is employed to study the induced-fission process of $^{226}$Th. The saddle-to-scission dynamics of this process is explored, starting from various points on the deformation surface of Helmholtz free energy at a temperature that corresponds to the experimental excitation energy, and following self-consistent isentropic fission trajectories as they evolve toward scission. Dissipation effects and the formation of excited fragments are investigated and, in particular, the difference in the evolution of the local temperature along asymmetric and symmetric fission trajectories. The relative entropies and entanglement between fission fragments emerging at scission are analyzed.


title: Conversational Agents as Catalysts for Critical Thinking: Challenging Design Fixation in Group Design

abstract: This paper investigates the potential of LLM-based conversational agents (CAs) to enhance critical reflection and mitigate design fixation in group design work. By challenging AI-generated recommendations and prevailing group opinions, these agents address issues such as groupthink and promote a more dynamic and inclusive design process. Key design considerations include optimizing intervention timing, ensuring clarity in counterarguments, and balancing critical thinking with designers' satisfaction. CAs can also adapt to various roles, supporting individual and collective reflection. Our work aligns with the "Death of the Design Researcher?" workshop's goals, emphasizing the transformative potential of generative AI in reshaping design practices and promoting ethical considerations. By exploring innovative uses of generative AI in group design contexts, we aim to stimulate discussion and open new pathways for future research and development, ultimately contributing to practical tools and resources for design researchers.


title: Mitigating the binary viewing angle bias for standard sirens

abstract: The inconsistency between experiments in the measurements of the local Universe expansion rate, the Hubble constant, suggests unknown systematics in the existing experiments or new physics. Gravitational-wave standard sirens, a method to independently provide direct measurements of the Hubble constant, have the potential to address this tension. Before that, it is critical to ensure there is no substantial systematics in the standard siren method. A significant systematic has been identified when the viewing angle of the gravitational-wave sources, the compact binary coalescences, is inferred inaccurately from electromagnetic observations of the sources. Such systematic has led to more than 10% discrepancy in the standard siren Hubble constant measurements with the observations of binary neutron star merger, GW170817. In this Letter, we develop a new formalism to infer and mitigate this systematic. We demonstrate that the systematic uncertainty of the Hubble constant measurements can be reduced to smaller than their statistical uncertainty with 5, 10, and 20 binary neutron star merger observations. We show that our formalism successfully reduces the systematics even if the shape of the biased viewing angle distribution does not follow precisely the model we choose. Our formalism ensures unbiased standard siren Hubble constant measurements when the binary viewing angles are inferred from electromagnetic observations.


title: Field-free Josephson diode effect in a d-wave superconductor heterostructure

abstract: We study superconductor/normal region/superconductor (S|N|S) Josephson junction formed using superconductors with d, d + id', and d + is superconducting pairings. We show that the quality factor of the Josephson diode effect and its sign can be substantially tuned by the external magnetic field, gate voltage, and the length of the junction for all three types of pairings. We also identify the conditions under which the anomalous Josephson and Josephson diode effects can appear in the junction by analyzing appropriate symmetries. In particular, by breaking a {\pi}-rotation symmetry, we show how a large field-free Josephson diode effect can be realized even in the absence of spin-orbit coupling. We also study the role of edge states appearing in the case of chiral superconductor with d + id' pairing. Our results demonstrate that the Josephson diode effect in a planar geometry can be used as a signature of unconventional superconducting pairings.


title: Model Adaptation for Time Constrained Embodied Control

abstract: When adopting a deep learning model for embodied agents, it is required that the model structure be optimized for specific tasks and operational conditions. Such optimization can be static such as model compression or dynamic such as adaptive inference. Yet, these techniques have not been fully investigated for embodied control systems subject to time constraints, which necessitate sequential decision-making for multiple tasks, each with distinct inference latency limitations. In this paper, we present MoDeC, a time constraint-aware embodied control framework using the modular model adaptation. We formulate model adaptation to varying operational conditions on resource and time restrictions as dynamic routing on a modular network, incorporating these conditions as part of multi-task objectives. Our evaluation across several vision-based embodied environments demonstrates the robustness of MoDeC, showing that it outperforms other model adaptation methods in both performance and adherence to time constraints in robotic manipulation and autonomous driving applications


title: Neural Lineage

abstract: Given a well-behaved neural network, is possible to identify its parent, based on which it was tuned? In this paper, we introduce a novel task known as neural lineage detection, aiming at discovering lineage relationships between parent and child models. Specifically, from a set of parent models, neural lineage detection predicts which parent model a child model has been fine-tuned from. We propose two approaches to address this task. (1) For practical convenience, we introduce a learning-free approach, which integrates an approximation of the finetuning process into the neural network representation similarity metrics, leading to a similarity-based lineage detection scheme. (2) For the pursuit of accuracy, we introduce a learning-based lineage detector comprising encoders and a transformer detector. Through experimentation, we have validated that our proposed learning-free and learning-based methods outperform the baseline in various learning settings and are adaptable to a variety of visual models. Moreover, they also exhibit the ability to trace cross-generational lineage, identifying not only parent models but also their ancestors.


title: Dynamic Order Template Prediction for Generative Aspect-Based Sentiment Analysis

abstract: Aspect-based sentiment analysis (ABSA) assesses sentiments towards specific aspects within texts, resulting in detailed sentiment tuples. Previous ABSA models often use static templates to predict all of the elements in the tuples, and these models often fail to accurately capture dependencies between elements. Multi-view prompting method improves the performance of ABSA by predicting tuples with various templates and then ensembling the results. However, this method suffers from inefficiencies and out-of-distribution errors. In this paper, we propose a Dynamic Order Template (DOT) method for ABSA, which dynamically generates necessary views for each instance based on instance-level entropy. Ensuring the diverse and relevant view generation, our proposed method improves F1-scores on ASQP and ACOS datasets while significantly reducing inference time.


title: Are Large Language Models a Good Replacement of Taxonomies?

abstract: Large language models (LLMs) demonstrate an impressive ability to internalize knowledge and answer natural language questions. Although previous studies validate that LLMs perform well on general knowledge while presenting poor performance on long-tail nuanced knowledge, the community is still doubtful about whether the traditional knowledge graphs should be replaced by LLMs. In this paper, we ask if the schema of knowledge graph (i.e., taxonomy) is made obsolete by LLMs. Intuitively, LLMs should perform well on common taxonomies and at taxonomy levels that are common to people. Unfortunately, there lacks a comprehensive benchmark that evaluates the LLMs over a wide range of taxonomies from common to specialized domains and at levels from root to leaf so that we can draw a confident conclusion. To narrow the research gap, we constructed a novel taxonomy hierarchical structure discovery benchmark named TaxoGlimpse to evaluate the performance of LLMs over taxonomies. TaxoGlimpse covers ten representative taxonomies from common to specialized domains with in-depth experiments of different levels of entities in this taxonomy from root to leaf. Our comprehensive experiments of eighteen state-of-the-art LLMs under three prompting settings validate that LLMs can still not well capture the knowledge of specialized taxonomies and leaf-level entities.


title: RePrompt: Planning by Automatic Prompt Engineering for Large Language Models Agents

abstract: In this past year, large language models (LLMs) have had remarkable success in domains outside the traditional natural language processing, and people are starting to explore the usage of LLMs in more general and close to application domains like code generation, travel planning, and robot controls. Connecting these LLMs with great capacity and external tools, people are building the so-called LLM agents, which are supposed to help people do all kinds of work in everyday life. In all these domains, the prompt to the LLMs has been shown to make a big difference in what the LLM would generate and thus affect the performance of the LLM agents. Therefore, automatic prompt engineering has become an important question for many researchers and users of LLMs. In this paper, we propose a novel method, \textsc{RePrompt}, which does "gradient descent" to optimize the step-by-step instructions in the prompt of the LLM agents based on the chat history obtained from interactions with LLM agents. By optimizing the prompt, the LLM will learn how to plan in specific domains. We have used experiments in PDDL generation and travel planning to show that our method could generally improve the performance for different reasoning tasks when using the updated prompt as the initial prompt.


title: Eliciting New Perspectives in RtD Studies through Annotated Portfolios: A Case Study of Robotic Artefacts

abstract: In this paper, we investigate how to elicit new perspectives in research-through-design (RtD) studies through annotated portfolios. Situating the usage in human-robot interaction (HRI), we used two robotic artefacts as a case study: we first created our own annotated portfolio and subsequently ran online workshops during which we asked HRI experts to annotate our robotic artefacts. We report on the different aspects revealed about the value, use, and further improvements of the robotic artefacts through using the annotated portfolio technique ourselves versus using it with experts. We suggest that annotated portfolios - when performed by external experts - allow design researchers to obtain a form of creative and generative peer critique. Our paper offers methodological considerations for conducting expert annotation sessions. Further, we discuss the use of annotated portfolios to unveil designerly HRI knowledge in RtD studies.


title: Emergent Wigner phases in moir\'e superlattice from deep learning

abstract: Moir\'e superlattice designed in stacked van der Waals material provides a dynamic platform for hosting exotic and emergent condensed matter phenomena. However, the relevance of strong correlation effects and the large size of moir\'e unit cells pose significant challenges for traditional computational techniques. To overcome these challenges, we develop an unsupervised deep learning approach to uncover electronic phases emerging from moir\'e systems based on variational optimization of neural network many-body wavefunction. Our approach has identified diverse quantum states, including novel phases such as generalized Wigner crystals, Wigner molecular crystals, and previously unreported Wigner covalent crystals. These discoveries provide insights into recent experimental studies and suggest new phases for future exploration. They also highlight the crucial role of spin polarization in determining Wigner phases. More importantly, our proposed deep learning approach is proven general and efficient, offering a powerful framework for studying moir\'e physics.

categories: physics.comp-ph cond-mat.dis-nn cond-mat.str-el physics.chem-ph


title: Towards Understanding Emotions for Engaged Mental Health Conversations

abstract: Providing timely support and intervention is crucial in mental health settings. As the need to engage youth comfortable with texting increases, mental health providers are exploring and adopting text-based media such as chatbots, community-based forums, online therapies with licensed professionals, and helplines operated by trained responders. To support these text-based media for mental health--particularly for crisis care--we are developing a system to perform passive emotion-sensing using a combination of keystroke dynamics and sentiment analysis. Our early studies of this system posit that the analysis of short text messages and keyboard typing patterns can provide emotion information that may be used to support both clients and responders. We use our preliminary findings to discuss the way forward for applying AI to support mental health providers in providing better care.


title: Robots in Family Routines: Development of and Initial Insights from the Family-Robot Routines Inventory

abstract: Despite advances in areas such as the personalization of robots, sustaining adoption of robots for long-term use in families remains a challenge. Recent studies have identified integrating robots into families' routines and rituals as a promising approach to support long-term adoption. However, few studies explored the integration of robots into family routines and there is a gap in systematic measures to capture family preferences for robot integration. Building upon existing routine inventories, we developed Family-Robot Routines Inventory (FRRI), with 24 family routines and 24 child routine items, to capture parents' attitudes toward and expectations from the integration of robotic technology into their family routines. Using this inventory, we collected data from 150 parents through an online survey. Our analysis indicates that parents had varying perceptions for the utility of integrating robots into their routines. For example, parents found robot integration to be more helpful in children's individual routines, than to the collective routines of their families. We discuss the design implications of these preliminary findings, and how they may serve as a first step toward understanding the diverse challenges and demands of designing and integrating household robots for families.


title: Embedding of $\mathcal Q_p$ into tent spaces via Carleson measures

abstract: In this paper, we show that for $0<t<p \le 1$, $\mu$ is a $p$-Carleson measure if and only if $id: \mathcal Q_t \mapsto \mathcal T_{p, 2}^2(\mu)$ is bounded. Our result shows that a "tiny-perturbed" version of a conjecture due to Liu, Lou, and Zhu is true.


title: Diffusion Models in Low-Level Vision: A Survey

abstract: Deep generative models have garnered significant attention in low-level vision tasks due to their generative capabilities. Among them, diffusion model-based solutions, characterized by a forward diffusion process and a reverse denoising process, have emerged as widely acclaimed for their ability to produce samples of superior quality and diversity. This ensures the generation of visually compelling results with intricate texture information. Despite their remarkable success, a noticeable gap exists in a comprehensive survey that amalgamates these pioneering diffusion model-based works and organizes the corresponding threads. This paper proposes the comprehensive review of diffusion model-based techniques. We present three generic diffusion modeling frameworks and explore their correlations with other deep generative models, establishing the theoretical foundation. Following this, we introduce a multi-perspective categorization of diffusion models, considering both the underlying framework and the target task. Additionally, we summarize extended diffusion models applied in other tasks, including medical, remote sensing, and video scenarios. Moreover, we provide an overview of commonly used benchmarks and evaluation metrics. We conduct a thorough evaluation, encompassing both performance and efficiency, of diffusion model-based techniques in three prominent tasks. Finally, we elucidate the limitations of current diffusion models and propose seven intriguing directions for future research. This comprehensive examination aims to facilitate a profound understanding of the landscape surrounding denoising diffusion models in the context of low-level vision tasks. A curated list of diffusion model-based techniques in over 20 low-level vision tasks can be found at https://github.com/ChunmingHe/awesome-diffusion-models-in-low-level-vision.


title: Breaking Boundaries: Investigating the Effects of Model Editing on Cross-linguistic Performance

abstract: The integration of pretrained language models (PLMs) like BERT and GPT has revolutionized NLP, particularly for English, but it has also created linguistic imbalances. This paper strategically identifies the need for linguistic equity by examining several knowledge editing techniques in multilingual contexts. We evaluate the performance of models such as Mistral, TowerInstruct, OpenHathi, Tamil-Llama, and Kan-Llama across languages including English, German, French, Italian, Spanish, Hindi, Tamil, and Kannada. Our research identifies significant discrepancies in normal and merged models concerning cross-lingual consistency. We employ strategies like 'each language for itself' (ELFI) and 'each language for others' (ELFO) to stress-test these models. Our findings demonstrate the potential for LLMs to overcome linguistic barriers, laying the groundwork for future research in achieving linguistic inclusivity in AI technologies.


title: Computing the Frequency Response of Biochemical Networks: A Python module

abstract: In this paper, a set of Python methods is described that can be used to compute the frequency response of an arbitrary biochemical network given any input and output. Models can be provided in standard SBML or Antimony format. The code takes into account any conserved moieties so that this software can be used to also study signaling networks where moiety cycles are common. A utility method is also provided to make it easy to plot standard Bode plots from the generated results. The code also takes into account the possibility that the phase shift could exceed 180 degrees which can result in ugly discontinues in the Bode plot. In the paper, some of the theory behind the method is provided as well as some commentary on the code and several illustrative examples to show the code in operation. Illustrative examples include linear reaction chains of varying lengths and the effect of negative feedback on the frequency response. Software License: MIT Open Source Availability: The code is available from https://github.com/sys-bio/frequencyResponse.


title: Active search for Bifurcations

abstract: Bifurcations mark qualitative changes of long-term behavior in dynamical systems and can often signal sudden ("hard") transitions or catastrophic events (divergences). Accurately locating them is critical not just for deeper understanding of observed dynamic behavior, but also for designing efficient interventions. When the dynamical system at hand is complex, possibly noisy, and expensive to sample, standard (e.g. continuation based) numerical methods may become impractical. We propose an active learning framework, where Bayesian Optimization is leveraged to discover saddle-node or Hopf bifurcations, from a judiciously chosen small number of vector field observations. Such an approach becomes especially attractive in systems whose state x parameter space exploration is resource-limited. It also naturally provides a framework for uncertainty quantification (aleatoric and epistemic), useful in systems with inherent stochasticity.


title: Graspness Discovery in Clutters for Fast and Accurate Grasp Detection

abstract: Efficient and robust grasp pose detection is vital for robotic manipulation. For general 6 DoF grasping, conventional methods treat all points in a scene equally and usually adopt uniform sampling to select grasp candidates. However, we discover that ignoring where to grasp greatly harms the speed and accuracy of current grasp pose detection methods. In this paper, we propose "graspness", a quality based on geometry cues that distinguishes graspable areas in cluttered scenes. A look-ahead searching method is proposed for measuring the graspness and statistical results justify the rationality of our method. To quickly detect graspness in practice, we develop a neural network named cascaded graspness model to approximate the searching process. Extensive experiments verify the stability, generality and effectiveness of our graspness model, allowing it to be used as a plug-and-play module for different methods. A large improvement in accuracy is witnessed for various previous methods after equipping our graspness model. Moreover, we develop GSNet, an end-to-end network that incorporates our graspness model for early filtering of low-quality predictions. Experiments on a large-scale benchmark, GraspNet-1Billion, show that our method outperforms previous arts by a large margin (30+ AP) and achieves a high inference speed. The library of GSNet has been integrated into AnyGrasp, which is at https://github.com/graspnet/anygrasp_sdk.


title: Scorecards for Synthetic Medical Data Evaluation and Reporting

abstract: The growing utilization of synthetic medical data (SMD) in training and testing AI-driven tools in healthcare necessitates a systematic framework for assessing SMD quality. The current lack of a standardized methodology to evaluate SMD, particularly in terms of its applicability in various medical scenarios, is a significant hindrance to its broader acceptance and utilization in healthcare applications. Here, we outline an evaluation framework designed to meet the unique requirements of medical applications, and introduce the concept of SMD scorecards, which can serve as comprehensive reports that accompany artificially generated datasets. This can help standardize evaluation and enable SMD developers to assess and further enhance the quality of SMDs by identifying areas in need of attention and ensuring that the synthetic data more accurately approximate patient data.


title: Modified Line Search Sequential Quadratic Methods for Equality-Constrained Optimization with Unified Global and Local Convergence Guarantees

abstract: In this paper, we propose a method that has foundations in the line search sequential quadratic programming paradigm for solving general nonlinear equality constrained optimization problems. The method employs a carefully designed modified line search strategy that utilizes second-order information of both the objective and constraint functions, as required, to mitigate the Maratos effect. Contrary to classical line search sequential quadratic programming methods, our proposed method is endowed with global convergence and local superlinear convergence guarantees. Moreover, we extend the method and analysis to the setting in which the constraint functions are deterministic but the objective function is stochastic or can be represented as a finite-sum. We also design and implement a practical inexact matrix-free variant of the method. Finally, numerical results illustrate the efficiency and efficacy of the method.


title: Federated Face Forgery Detection Learning with Personalized Representation

abstract: Deep generator technology can produce high-quality fake videos that are indistinguishable, posing a serious social threat. Traditional forgery detection methods directly centralized training on data and lacked consideration of information sharing in non-public video data scenarios and data privacy. Naturally, the federated learning strategy can be applied for privacy protection, which aggregates model parameters of clients but not original data. However, simple federated learning can't achieve satisfactory performance because of poor generalization capabilities for the real hybrid-domain forgery dataset. To solve the problem, the paper proposes a novel federated face forgery detection learning with personalized representation. The designed Personalized Forgery Representation Learning aims to learn the personalized representation of each client to improve the detection performance of individual client models. In addition, a personalized federated learning training strategy is utilized to update the parameters of the distributed detection model. Here collaborative training is conducted on multiple distributed client devices, and shared representations of these client models are uploaded to the server side for aggregation. Experiments on several public face forgery detection datasets demonstrate the superior performance of the proposed algorithm compared with state-of-the-art methods. The code is available at \emph{https://github.com/GANG370/PFR-Forgery.}


title: Designing Interactions with Autonomous Physical Systems

abstract: In this position paper, we present a collection of four different prototyping approaches which we have developed and applied to prototype and evaluate interfaces for and interactions around autonomous physical systems. Further, we provide a classification of our approaches aiming to support other researchers and designers in choosing appropriate prototyping platforms and representations.


title: Vul-RAG: Enhancing LLM-based Vulnerability Detection via Knowledge-level RAG

abstract: Vulnerability detection is essential for software quality assurance. In recent years, deep learning models (especially large language models) have shown promise in vulnerability detection. In this work, we propose a novel LLM-based vulnerability detection technique Vul-RAG, which leverages knowledge-level retrieval-augmented generation (RAG) framework to detect vulnerability for the given code in three phases. First, Vul-RAG constructs a vulnerability knowledge base by extracting multi-dimension knowledge via LLMs from existing CVE instances; second, for a given code snippet, Vul-RAG} retrieves the relevant vulnerability knowledge from the constructed knowledge base based on functional semantics; third, Vul-RAG leverages LLMs to check the vulnerability of the given code snippet by reasoning the presence of vulnerability causes and fixing solutions of the retrieved vulnerability knowledge. Our evaluation of Vul-RAG on our constructed benchmark PairVul shows that Vul-RAG substantially outperforms all baselines by 12.96\%/110\% relative improvement in accuracy/pairwise-accuracy. In addition, our user study shows that the vulnerability knowledge generated by Vul-RAG can serve as high-quality explanations which can improve the manual detection accuracy from 0.60 to 0.77.


title: Few-Shot Recognition via Stage-Wise Augmented Finetuning

abstract: Few-shot recognition aims to train a classification model with only a few labeled examples of pre-defined concepts, where annotation can be costly in a downstream task. In another related research area, zero-shot recognition, which assumes no access to any downstream-task data, has been greatly advanced by using pretrained Vision-Language Models (VLMs). In this area, retrieval-augmented learning (RAL) effectively boosts zero-shot accuracy by retrieving and learning from external data relevant to downstream concepts. Motivated by these advancements, our work explores RAL for few-shot recognition. While seemingly straightforward despite being under-explored in the literature (till now!), we present novel challenges and opportunities for applying RAL for few-shot recognition. First, perhaps surprisingly, simply finetuning the VLM on a large amount of retrieved data barely surpasses state-of-the-art zero-shot methods due to the imbalanced distribution of retrieved data and its domain gaps compared to few-shot annotated data. Second, finetuning a VLM on few-shot examples alone significantly outperforms prior methods, and finetuning on the mix of retrieved and few-shot data yields even better results. Third, to mitigate the imbalanced distribution and domain gap issue, we propose Stage-Wise Augmented fineTuning (SWAT) method, which involves end-to-end finetuning on mixed data for the first stage and retraining the classifier solely on the few-shot data in the second stage. Extensive experiments show that SWAT achieves the best performance on standard benchmark datasets, resoundingly outperforming prior works by ~10% in accuracy. Code is available at https://github.com/tian1327/SWAT.


title: GoldCoin: Grounding Large Language Models in Privacy Laws via Contextual Integrity Theory

abstract: Privacy issues arise prominently during the inappropriate transmission of information between entities. Existing research primarily studies privacy by exploring various privacy attacks, defenses, and evaluations within narrowly predefined patterns, while neglecting that privacy is not an isolated, context-free concept limited to traditionally sensitive data (e.g., social security numbers), but intertwined with intricate social contexts that complicate the identification and analysis of potential privacy violations. The advent of Large Language Models (LLMs) offers unprecedented opportunities for incorporating the nuanced scenarios outlined in privacy laws to tackle these complex privacy issues. However, the scarcity of open-source relevant case studies restricts the efficiency of LLMs in aligning with specific legal statutes. To address this challenge, we introduce a novel framework, GoldCoin, designed to efficiently ground LLMs in privacy laws for judicial assessing privacy violations. Our framework leverages the theory of contextual integrity as a bridge, creating numerous synthetic scenarios grounded in relevant privacy statutes (e.g., HIPAA), to assist LLMs in comprehending the complex contexts for identifying privacy risks in the real world. Extensive experimental results demonstrate that GoldCoin markedly enhances LLMs' capabilities in recognizing privacy risks across real court cases, surpassing the baselines on different judicial tasks.


title: The stability of sheath to the nonisentropic Euler-Poisson system with fluid-boundary interaction

abstract: In the present paper, we define the sheath by a monotone stationary solution to the nonisentropic Euler-Poisson system under a condition known as the Bohm criterion and consider a situation in which charged particles accumulate on the boundary due to the flux from the inner region. Under this fluid-boundary interactive setting, we prove the large time asymptotic stability of the sheath provided that the initial perturbation is sufficiently small in some weighted Sobolev spaces. Moreover, the convergence rate of the solution toward the sheath is obtained. The proof is based on the weighted energy method.


title: Recent and Upcoming Developments in Randomized Numerical Linear Algebra for Machine Learning

abstract: Large matrices arise in many machine learning and data analysis applications, including as representations of datasets, graphs, model weights, and first and second-order derivatives. Randomized Numerical Linear Algebra (RandNLA) is an area which uses randomness to develop improved algorithms for ubiquitous matrix problems. The area has reached a certain level of maturity; but recent hardware trends, efforts to incorporate RandNLA algorithms into core numerical libraries, and advances in machine learning, statistics, and random matrix theory, have lead to new theoretical and practical challenges. This article provides a self-contained overview of RandNLA, in light of these developments.


title: Limit Results for Estimation of Connectivity Matrix in Multi-layer Stochastic Block Models

abstract: Multi-layer networks arise naturally in various domains including biology, finance and sociology, among others. The multi-layer stochastic block model (multi-layer SBM) is commonly used for community detection in the multi-layer networks. Most of current literature focuses on statistical consistency of community detection methods under multi-layer SBMs. However, the asymptotic distributional properties are also indispensable which play an important role in statistical inference. In this work, we aim to study the estimation and asymptotic properties of the layer-wise scaled connectivity matrices in the multi-layer SBMs. We develop a novel and efficient method to estimate the scaled connectivity matrices. Under the multi-layer SBM and its variant multi-layer degree-corrected SBM, we establish the asymptotic normality of the estimated matrices under mild conditions, which can be used for interval estimation and hypothesis testing. Simulations show the superior performance of proposed method over existing methods in two considered statistical inference tasks. We also apply the method to a real dataset and obtain interpretable results.


title: On the Metastability of Quantum Fields in Thermal Bath

abstract: We investigate the metastability of scalar fields in quantum field theories at finite temperature, focusing on a detailed understanding of the bounce solution. At finite temperature, the bounce solution depends on two variables: the Euclidean time $\tau$ and the spatial radial distance $r$, and it is periodic in the $\tau$ direction. We propose a novel method to determine the bounce that describes transitions in a thermal bath, suitable for numerical calculations. Two types of bounces exist for transitions in the thermal bath: $\tau$-dependent and $\tau$-independent bounces. We apply our method to compute these bounces in several models, including both thin-wall and thick-wall scenarios, to examine their properties. Specifically, we evaluate the critical temperature below which the $\tau$-independent bounce becomes destabilized due to fluctuations, rendering it irrelevant. We demonstrate that in the thick-wall case, the $\tau$-dependent bounce smoothly transitions into the $\tau$-independent one as temperature increases, whereas in the thin-wall case, the transition between the two types of bounces is discontinuous.


title: Fuzzy simplicial sets and their application to geometric data analysis

abstract: In this article, we expand upon the concepts introduced in \cite{Spivak09} about the relationship between the category $\mathbf{UM}$ of uber metric spaces and the category $\mathbf{sFuz}$ of fuzzy simplicial sets. We show that fuzzy simplicial sets can be regarded as natural combinatorial generalizations of metric relations. Furthermore, we take inspiration from UMAP to apply the theory to dimension reduction (manifold learning) and data visualization, while refining some of their constructions to put the corresponding theory on a more solid footing. A generalization of the adjunction between $\mathbf{UM}$ and $\mathbf{sFuz}$ will allow us to view the adjunctions used in both publications as special cases. Moreover, we derive an explicit description of colimits in $\mathbf{UM}$ and the realization functor $\text{Re}:\mathbf{sFuz}\to\mathbf{UM}$, as well as rigorous definitions of functors that make it possible to recursively merge sets of fuzzy simplicial sets. We show that $\mathbf{UM}$ and the category of extended-pseudo metric spaces $\mathbf{EPMet}$ can be embedded into $\mathbf{sFuz}$ and provide a description of the adjunctions between the category of truncated fuzzy simplicial sets and $\mathbf{sFuz}$, which we relate to persistent homology. Combining those constructions, we can show a surprising connection between the well-known dimension reduction methods UMAP and Isomap and derive an alternative algorithm, which we call IsUMap, that combines some of the strengths of both methods. We compare it with UMAP and Isomap and provide explanations for observed differences.


title: On the limitations of H alpha luminosity as a star formation tracer in spatially resolved observations

abstract: This study examines the limitations of H$\alpha$ luminosity as a tracer of star formation rates (SFR) in spatially resolved observations. We carry out high-resolution simulations of a Milky Way-like galaxy including both supernova and photoionization feedback, and from these we generate synthetic H$\alpha$ emission maps that we compare to maps of the true distribution of young stellar objects (YSOs) on scales from whole-galaxy to individual molecular clouds ($\lesssim 100$ pc). Our results reveal significant spatial mismatches between H$\alpha$ and true YSO maps on sub-100 pc scales, primarily due to ionizing photon leakage, with a secondary contribution from young stars drifting away from their parent molecular clouds. On small scales these effect contribute significantly to the observed anti-correlation between gas and star formation, such that there is noticeably less anti-correlation if we replace an H$\alpha$-based star formation map with a YSO-based one; this in turn implies that previous studies have underestimated the time it takes for young stars to disperse their parent molecular clouds. However, these effects are limited in dense regions with hydrogen columns $N_\mathrm{H} > 3 \times 10^{21}$ cm$^{-2}$, where the H$\alpha$- and YSO-based SFR maps show better agreement. Based on this finding we propose a calibration model that can precisely measure the SFR of large molecular clouds (mean radius > 100 pc) with a combination of H$\alpha$ and CO observations, which provides a foundation for future study of star formation processes in extragalactic molecular clouds.


title: DELRec: Distilling Sequential Pattern to Enhance LLM-based Recommendation

abstract: Sequential recommendation (SR) tasks enhance recommendation accuracy by capturing the connection between users' past interactions and their changing preferences. Conventional models often focus solely on capturing sequential patterns within the training data, neglecting the broader context and semantic information embedded in item titles from external sources. This limits their predictive power and adaptability. Recently, large language models (LLMs) have shown promise in SR tasks due to their advanced understanding capabilities and strong generalization abilities. Researchers have attempted to enhance LLMs' recommendation performance by incorporating information from SR models. However, previous approaches have encountered problems such as 1) only influencing LLMs at the result level; 2) increased complexity of LLMs recommendation methods leading to reduced interpretability; 3) incomplete understanding and utilization of SR models information by LLMs. To address these problems, we proposes a novel framework, DELRec, which aims to extract knowledge from SR models and enable LLMs to easily comprehend and utilize this supplementary information for more effective sequential recommendations. DELRec consists of two main stages: 1) SR Models Pattern Distilling, focusing on extracting behavioral patterns exhibited by SR models using soft prompts through two well-designed strategies; 2) LLMs-based Sequential Recommendation, aiming to fine-tune LLMs to effectively use the distilled auxiliary information to perform SR tasks. Extensive experimental results conducted on three real datasets validate the effectiveness of the DELRec framework.


title: DeFiGuard: A Price Manipulation Detection Service in DeFi using Graph Neural Networks

abstract: The prosperity of Decentralized Finance (DeFi) unveils underlying risks, with reported losses surpassing 3.2 billion USD between 2018 and 2022 due to vulnerabilities in Decentralized Applications (DApps). One significant threat is the Price Manipulation Attack (PMA) that alters asset prices during transaction execution. As a result, PMA accounts for over 50 million USD in losses. To address the urgent need for efficient PMA detection, this paper introduces a novel detection service, DeFiGuard, using Graph Neural Networks (GNNs). In this paper, we propose cash flow graphs with four distinct features, which capture the trading behaviors from transactions. Moreover, DeFiGuard integrates transaction parsing, graph construction, model training, and PMA detection. Evaluations on a dataset of 208 PMA and 2,080 non-PMA transactions show that DeFiGuard with GNN models outperforms the baseline in Accuracy, TPR, FPR, and AUC-ROC. The results of ablation studies suggest that the combination of the four proposed node features enhances DeFiGuard's efficacy. Moreover, DeFiGuard classifies transactions within 0.892 to 5.317 seconds, which provides sufficient time for the victims (DApps and users) to take action to rescue their vulnerable funds. In conclusion, this research offers a significant step towards safeguarding the DeFi landscape from PMAs using GNNs.


title: Dynamic Modeling and Control for an Offshore Semisubmersible Floating Wind Turbine

abstract: Floating wind turbines (FWTs) hold significant potential for the exploitation of offshore renewable energy resources. Nevertheless, prior to the construction of FWTs, it is imperative to tackle several critical challenges, especially the issue of performance degradation under combined wind and wave loads. This study initiates with the development of a simplified nonlinear dynamical model for a semi-submersible FWT. In particular, both the rotor dynamics and the finite rotations of the platform are considered in presented modeling approach, thereby effectively capturing the complex interplay between the platform, tower, nacelle, and rotor under combined wind and wave loads. Subsequently, based on the developed FWT model, a novel adaptive nonlinear pitch controller is formulated with the goal of striking a trade-off between regulating power generation and reducing platform motion. Notably, the proposed control strategy adopts a continuous control approach, strategically beneficial in circumventing the chattering phenomenon commonly associated with sliding mode control. Furthermore, the controller integrates an online approximator and a robust integral of the sign of the tracking error, facilitating real-time learning of system unknown dynamics while compensating for bounded disturbances. Finally, both the accuracy of the established nonlinear FWT model in predicting key dynamics and the superiority of the presented pitch controller are validated through comprehensive comparative studies.


title: Distributed Stochastic Gradient Descent with Staleness: A Stochastic Delay Differential Equation Based Framework

abstract: Distributed stochastic gradient descent (SGD) has attracted considerable recent attention due to its potential for scaling computational resources, reducing training time, and helping protect user privacy in machine learning. However, the staggers and limited bandwidth may induce random computational/communication delays, thereby severely hindering the learning process. Therefore, how to accelerate asynchronous SGD by efficiently scheduling multiple workers is an important issue. In this paper, a unified framework is presented to analyze and optimize the convergence of asynchronous SGD based on stochastic delay differential equations (SDDEs) and the Poisson approximation of aggregated gradient arrivals. In particular, we present the run time and staleness of distributed SGD without a memorylessness assumption on the computation times. Given the learning rate, we reveal the relevant SDDE's damping coefficient and its delay statistics, as functions of the number of activated clients, staleness threshold, the eigenvalues of the Hessian matrix of the objective function, and the overall computational/communication delay. The formulated SDDE allows us to present both the distributed SGD's convergence condition and speed by calculating its characteristic roots, thereby optimizing the scheduling policies for asynchronous/event-triggered SGD. It is interestingly shown that increasing the number of activated workers does not necessarily accelerate distributed SGD due to staleness. Moreover, a small degree of staleness does not necessarily slow down the convergence, while a large degree of staleness will result in the divergence of distributed SGD. Numerical results demonstrate the potential of our SDDE framework, even in complex learning tasks with non-convex objective functions.


title: Contextual Knowledge Graph

abstract: Knowledge Graphs (KGs) are foundational structures in many AI applications, representing entities and their interrelations through triples. However, triple-based KGs lack the contextual information of relational knowledge, like temporal dynamics and provenance details, which are crucial for comprehensive knowledge representation and effective reasoning. Instead, \textbf{Contextual Knowledge Graphs} (CKGs) expand upon the conventional structure by incorporating additional information such as time validity, geographic location, and source provenance. This integration provides a more nuanced and accurate understanding of knowledge, enabling KGs to offer richer insights and support more sophisticated reasoning processes. In this work, we first discuss the inherent limitations of triple-based KGs and introduce the concept of contextual KGs, highlighting their advantages in knowledge representation and reasoning. We then present \textbf{KGR$^3$, a context-enriched KG reasoning paradigm} that leverages large language models (LLMs) to retrieve candidate entities and related contexts, rank them based on the retrieved information, and reason whether sufficient information has been obtained to answer a query. Our experimental results demonstrate that KGR$^3$ significantly improves performance on KG completion (KGC) and KG question answering (KGQA) tasks, validating the effectiveness of incorporating contextual information on KG representation and reasoning.


title: Emotion-LLaMA: Multimodal Emotion Recognition and Reasoning with Instruction Tuning

abstract: Accurate emotion perception is crucial for various applications, including human-computer interaction, education, and counseling. However, traditional single-modality approaches often fail to capture the complexity of real-world emotional expressions, which are inherently multimodal. Moreover, existing Multimodal Large Language Models (MLLMs) face challenges in integrating audio and recognizing subtle facial micro-expressions. To address this, we introduce the MERR dataset, containing 28,618 coarse-grained and 4,487 fine-grained annotated samples across diverse emotional categories. This dataset enables models to learn from varied scenarios and generalize to real-world applications. Furthermore, we propose Emotion-LLaMA, a model that seamlessly integrates audio, visual, and textual inputs through emotion-specific encoders. By aligning features into a shared space and employing a modified LLaMA model with instruction tuning, Emotion-LLaMA significantly enhances both emotional recognition and reasoning capabilities. Extensive evaluations show Emotion-LLaMA outperforms other MLLMs, achieving top scores in Clue Overlap (7.83) and Label Overlap (6.25) on EMER, an F1 score of 0.9036 on MER2023 challenge, and the highest UAR (45.59) and WAR (59.37) in zero-shot evaluations on DFEW dataset.


title: How Good are LLMs at Relation Extraction under Low-Resource Scenario? Comprehensive Evaluation

abstract: Relation Extraction (RE) serves as a crucial technology for transforming unstructured text into structured information, especially within the framework of Knowledge Graph development. Its importance is emphasized by its essential role in various downstream tasks. Besides the conventional RE methods which are based on neural networks and pre-trained language models, large language models (LLMs) are also utilized in the research field of RE. However, on low-resource languages (LRLs), both conventional RE methods and LLM-based methods perform poorly on RE due to the data scarcity issues. To this end, this paper constructs low-resource relation extraction datasets in 10 LRLs in three regions (Central Asia, Southeast Asia and Middle East). The corpora are constructed by translating the original publicly available English RE datasets (NYT10, FewRel and CrossRE) using an effective multilingual machine translation. Then, we use the language perplexity (PPL) to filter out the low-quality data from the translated datasets. Finally, we conduct an empirical study and validate the performance of several open-source LLMs on these generated LRL RE datasets.


title: Explainable Bayesian Recurrent Neural Smoother to Capture Global State Evolutionary Correlations

abstract: Through integrating the evolutionary correlations across global states in the bidirectional recursion, an explainable Bayesian recurrent neural smoother (EBRNS) is proposed for offline data-assisted fixed-interval state smoothing. At first, the proposed model, containing global states in the evolutionary interval, is transformed into an equivalent model with bidirectional memory. This transformation incorporates crucial global state information with support for bi-directional recursive computation. For the transformed model, the joint state-memory-trend Bayesian filtering and smoothing frameworks are derived by introducing the bidirectional memory iteration mechanism and offline data into Bayesian estimation theory. The derived frameworks are implemented using the Gaussian approximation to ensure analytical properties and computational efficiency. Finally, the neural network modules within EBRNS and its two-stage training scheme are designed. Unlike most existing approaches that artificially combine deep learning and model-based estimation, the bidirectional recursion and internal gated structures of EBRNS are naturally derived from Bayesian estimation theory, explainably integrating prior model knowledge, online measurement, and offline data. Experiments on representative real-world datasets demonstrate that the high smoothing accuracy of EBRNS is accompanied by data efficiency and a lightweight parameter scale.


title: Optimum signal duration for Human Activity Recognition based on Deep Convolutional Neural Networks

abstract: Human Activity Recognition (HAR) stands as a pivotal technique within pattern recognition, dedicated to deciphering human movements and actions utilizing one or multiple sensory inputs. Its significance extends across diverse applications, encompassing monitoring, security protocols, and the development of human-in-the-loop technologies. However, prevailing studies in HAR often overlook the integration of human-centered devices, wherein distinct parameters and criteria hold varying degrees of importance compared to other applications. Notably, within this realm, curtailing the sensor observation period assumes paramount importance to safeguard the efficiency of exoskeletons and prostheses. This study embarks on the optimization of this observation period specifically tailored for HAR using Inertial Measurement Unit (IMU) sensors. Employing a Deep Convolutional Neural Network (DCNN), the aim is to identify activities based on segments of IMU signals spanning durations from 0.1 to 4 seconds. Intriguingly, the outcomes spotlight an optimal observation duration of 0.5 seconds, showcasing an impressive classification accuracy of 99.95%. This revelation holds immense significance, elucidating the criticality of precise temporal analysis within HAR, particularly concerning human-centric devices. Such findings not only enhance our understanding of the optimal observation period but also lay the groundwork for refining the performance and efficacy of devices crucially relied upon for aiding human mobility and functionality.


title: Tunable Fano and Dicke resonant tunneling of double quantum dots sandwiched between topological insulators

abstract: We study the resonant tunneling in double quantum dots (DQD) sandwiched between surfaces of topological insulator (TI) Bi$_2$Te$_3$, which possess strong spin-orbit coupling (SOC) and $^{d}C_{3v}$ double group symmetry. Distinct from the spin-conserved case with two-dimensional electron gas (2DEG) electrodes, the conductance displays an asymmetrical double-peak Fano-type lineshape rather than Dicke-type lineshape in the zero-field cases. While a Landau-Zener-like lineshape trajectory, which is identified as a signal of competition effect, could be developed by increasing the strength of interdot hopping. Furthermore, when applying an in-plane Zeeman field, we find that the conductance lineshape crossover between Fano and Dicke type could be driven by tilting the field orientation. Moreover, the rotational symmetry of the system could also be revealed from the lineshape trajectory. Our findings will contribute to a better understanding of the resonant tunneling in the presence of electrode SOC and may be confirmed experimentally in the future.


title: Unanimity of two selves in decision making

abstract: We propose a new model of incomplete preferences under uncertainty, which we call unanimous dual-self preferences. Act f is considered more desirable than act g when, and only when, both the evaluation of an optimistic self, computed as the welfare level attained in a best-case scenario, and that of a pessimistic self, computed as the welfare level attained in a worst-case scenario, rank f above g. Our comparison criterion involves multiple priors, as best and worst cases are determined among sets of probability distributions, and is, generically, less conservative than Bewley preferences and twofold multi-prior preferences, the two ambiguity models that are closest to ours


title: Peripheral Poisson Boundary on Full Fock space

abstract: The operator space generated by peripheral eigenvectors of a unital normal completely positive map $P$ on a von Neumann algebra has a C*-algebra structure. This C*-algebra is known as the \textit{peripheral Poisson boundary} of $P$. For a separable Hilbert space $H$, consider the full fock space defined over $H$. In this paper, we study the peripheral Poisson boundary of the completely positive map, induced by left creation operators of the basis vectors of $H$, on $B(\mcal F(H))$ and explore its behavior with respect to the Poisson boundary.


title: Two-Timescale Optimization Framework for Decentralized Linear-Quadratic Optimal Control

abstract: This study investigates a decentralized linear-quadratic optimal control problem, and several approximate separable constrained optimization problems are formulated for the first time based on the selection of sparsity promoting functions. First, for the optimization problem with weighted $\ell_1$ sparsity promoting function, a two-timescale algorithm is adopted that is based on the BSUM (Block Successive Upper-bound Minimization) framework and a differential equation solver. Second, a piecewise quadratic sparsity promoting function is introduced, and the induced optimization problem demonstrates an accelerated convergence rate by performing the same two-timescale algorithm. Finally, the optimization problem with $\ell_0$ sparsity promoting function is considered that is nonconvex and discontinuous, and can be approximated by successive coordinatewise convex optimization problems.


title: Self-Distillation Prototypes Network: Learning Robust Speaker Representations without Supervision

abstract: Training speaker-discriminative and robust speaker verification systems without explicit speaker labels remains a persisting challenge. In this paper, we propose a new self-supervised speaker verification approach, Self-Distillation Prototypes Network (SDPN), which effectively facilitates self-supervised speaker representation learning. SDPN assigns the representation of the augmented views of an utterance to the same prototypes as the representation of the original view, thereby enabling effective knowledge transfer between the views. Originally, due to the lack of negative pairs in the SDPN training process, the network tends to align positive pairs very closely in the embedding space, a phenomenon known as model collapse. To alleviate this problem, we introduce a diversity regularization term to embeddings in SDPN. Comprehensive experiments on the VoxCeleb datasets demonstrate the superiority of SDPN in self-supervised speaker verification. SDPN sets a new state-of-the-art on the VoxCeleb1 speaker verification evaluation benchmark, achieving Equal Error Rate 1.80%, 1.99%, and 3.62% for trial VoxCeleb1-O, VoxCeleb1-E and VoxCeleb1-H respectively, without using any speaker labels in training.


title: Linear-T Resistivity from Spatially Random Vector Coupling

abstract: Recently, Patel et.al introduced a higher dimensional version of the SYK model with random coupling in Yukawa interaction to find the linear-$T$ resistivity. We test the universality of the mechanism by replacing the scalar with vector field in various dimensions. We find that it works for vector as well as scalar interaction, although the details are very different. However, this mechanism for the linear-$T$ resistivity works only in $(2+1)$ dimension not in higher dimension independent of the interaction type. Based on these results, we explore the role of spatial random disorder and find a simple understanding how such random scattering converts the Fermi liquid to the strange metal by changing the behavior of the self-energies of involved boson and fermion.