title: A Chinese Dataset for Evaluating the Safeguards in Large Language Models

abstract: Many studies have demonstrated that large language models (LLMs) can produce harmful responses, exposing users to unexpected risks when LLMs are deployed. Previous studies have proposed comprehensive taxonomies of the risks posed by LLMs, as well as corresponding prompts that can be used to examine the safety mechanisms of LLMs. However, the focus has been almost exclusively on English, and little has been explored for other languages. Here we aim to bridge this gap. We first introduce a dataset for the safety evaluation of Chinese LLMs, and then extend it to two other scenarios that can be used to better identify false negative and false positive examples in terms of risky prompt rejections. We further present a set of fine-grained safety assessment criteria for each risk type, facilitating both manual annotation and automatic evaluation in terms of LLM response harmfulness. Our experiments on five LLMs show that region-specific risks are the prevalent type of risk, presenting the major issue with all Chinese LLMs we experimented with. Our data is available at https://github.com/Libr-AI/do-not-answer. Warning: this paper contains example data that may be offensive, harmful, or biased.


title: 23.8 GHz Acoustic Filter in Periodically Poled Piezoelectric Film Lithium Niobate with 1.52 dB IL and 19.4% FBW

abstract: This paper reports the first piezoelectric acoustic filter in periodically poled piezoelectric film (P3F) lithium niobate (LiNbO3) at 23.8 GHz with low insertion loss (IL) of 1.52 dB and 3-dB fractional bandwidth (FBW) of 19.4%. The filter features a compact footprint of 0.64 mm2. The third-order ladder filter is implemented with electrically coupled resonators in 150 nm bi-layer P3F 128 rotated Y-cut LiNbO3 thin film, operating in second-order symmetric (S2) Lamb mode. The record-breaking performance is enabled by the P3F LiNbO3 platform, where piezoelectric thin films of alternating orientations are transferred subsequently, facilitating efficient higher-order Lamb mode operation with simultaneously high quality factor (Q) and coupling coefficient (k2) at millimeter-wave (mmWave). Also, the multi-layer P3F stack promises smaller footprints and better nonlinearity than single-layer counterparts, thanks to the higher capacitance density and lower thermal resistance. Upon further development, the reported P3F LiNbO3 platform is promising for compact filters at mmWave.


title: Browse and Concentrate: Comprehending Multimodal Content via prior-LLM Context Fusion

abstract: With the bloom of Large Language Models (LLMs), Multimodal Large Language Models (MLLMs) that incorporate LLMs with pre-trained vision models have recently demonstrated impressive performance across diverse vision-language tasks. However, they fall short to comprehend context involving multiple images. A primary reason for this shortcoming is that the visual features for each images are encoded individually by frozen encoders before feeding into the LLM backbone, lacking awareness of other images and the multimodal instructions. We term this issue as prior-LLM modality isolation and propose a two phase paradigm, browse-and-concentrate, to enable in-depth multimodal context fusion prior to feeding the features into LLMs. This paradigm initially "browses" through the inputs for essential insights, and then revisits the inputs to "concentrate" on crucial details, guided by these insights, to achieve a more comprehensive understanding of the multimodal inputs. Additionally, we develop training strategies specifically to enhance the understanding of multi-image inputs. Our method markedly boosts the performance on 7 multi-image scenarios, contributing to increments on average accuracy by 2.13% and 7.60% against strong MLLMs baselines with 3B and 11B LLMs, respectively.


title: Nanomechanical crystalline AlN resonators with high quality factors for quantum optoelectromechanics

abstract: High-$Q_m$ mechanical resonators are crucial for applications where low noise and long coherence time are required, as mirror suspensions, quantum cavity optomechanical devices, or nanomechanical sensors. Tensile strain in the material enables the use of dissipation dilution and strain engineering techniques, which increase the mechanical quality factor. These techniques have been employed for high-$Q_m$ mechanical resonators made from amorphous materials and, recently, from crystalline materials such as InGaP, SiC, and Si. A strained crystalline film exhibiting substantial piezoelectricity expands the capability of high-$Q_m$ nanomechanical resonators to directly utilize electronic degrees of freedom. In this work we realize nanomechanical resonators with $Q_m$ up to $2.9\times 10^{7}$ made from tensile-strained 290 nm-thick AlN, which is an epitaxially-grown crystalline material offering strong piezoelectricity. We demonstrate nanomechanical resonators that exploit dissipation dilution and strain engineering to reach a $Q_m \times f_m$-product approaching $10^{13}$ Hz at room temperature. We realize a novel resonator geometry, triangline, whose shape follows the Al-N bonds and offers a central pad that we pattern with a photonic crystal. This allows us to reach an optical reflectivity above 80% for efficient coupling to out-of-plane light. The presented results pave the way for quantum optoelectromechanical devices at room temperature based on tensile-strained AlN.

categories: cond-mat.mes-hall cond-mat.mtrl-sci physics.app-ph physics.optics quant-ph


title: Thermodynamic concentration inequalities and tradeoff relations

abstract: Thermodynamic tradeoff relations quantify the fundamental concept of "no free lunch" in the physical world, suggesting that faster and more precise physical processes come at a higher thermodynamic cost. The key elements in these tradeoff relations are the thermodynamic uncertainty relation and speed limit, which are closely related to information inequalities from which other tradeoff relations are derived. Concentration inequalities are relations that complement information inequalities in statistical analyses and have been widely used in various fields. However, their role in thermodynamic tradeoff relations remains unclear. This study develops thermodynamic concentration inequalities that provide bounds for the distribution of observables in quantum and classical Markov processes. We derive a set of tradeoff relations that generalise speed limits and thermodynamic uncertainty relations from the developed thermodynamic concentration inequalities. The derived tradeoff relations hold under minimal assumptions of the underlying physical processes. This study clarifies the role of concentration inequalities in thermodynamics, paving the way for deriving new tradeoff relations.


title: Zero shot VLMs for hate meme detection: Are we there yet?

abstract: Multimedia content on social media is rapidly evolving, with memes gaining prominence as a distinctive form. Unfortunately, some malicious users exploit memes to target individuals or vulnerable communities, making it imperative to identify and address such instances of hateful memes. Extensive research has been conducted to address this issue by developing hate meme detection models. However, a notable limitation of traditional machine/deep learning models is the requirement for labeled datasets for accurate classification. Recently, the research community has witnessed the emergence of several visual language models that have exhibited outstanding performance across various tasks. In this study, we aim to investigate the efficacy of these visual language models in handling intricate tasks such as hate meme detection. We use various prompt settings to focus on zero-shot classification of hateful/harmful memes. Through our analysis, we observe that large VLMs are still vulnerable for zero-shot hate meme detection.


title: Molecular Dynamics Simulations of Anisotropic Particles Accelerated by Neural-Net Predicted Interactions

abstract: Rigid bodies, made of smaller composite beads, are commonly used to simulate anisotropic particles with molecular dynamics or Monte Carlo methods. To accurately represent the particle shape and to obtain smooth and realistic effective pair interactions between two rigid bodies, each body may need to contain hundreds of spherical beads. Given an interacting pair of particles, traditional MD methods calculate the inter-body distances between the beads of the rigid bodies within a certain distance. For a system containing many anisotropic particles, distance calculations are computationally costly and limit the attainable system size and simulation time. However, the effective interaction between two rigid particles only depends on the distance between their center of masses and their relative orientation. Therefore, a function directly mapping the center of mass distance and orientation to the interaction energy between the two rigid bodies, would completely bypass inter-bead distance calculations. It is challenging to derive such a general function analytically for most non-spherical rigid bodies. We have trained neural nets, powerful tools to fit nonlinear functions to complex datasets, to achieve this task. The pair configuration is taken as input and the energy, forces and torques between two rigid particles are predicted directly. We show that MD simulations of cubes and cylinders performed with forces and torques obtained from the gradients of the energy neural-nets quantitatively match traditional simulations that uses composite rigid bodies. Both structural quantities and dynamic measures are in agreement, while achieving up to 23 times speed up over traditional molecular dynamics, depending on hardware and system size. The method can, in principle, be applied to any irregular shape with any pair interaction, provided that sufficient training data can be obtained.


title: The matching problem with linear transfers is equivalent to a hide-and-seek game

abstract: Matching problems with linearly transferable utility (LTU) generalize the well-studied transferable utility (TU) case by relaxing the assumption that utility is transferred one-for-one within matched pairs. We show that LTU matching problems can be reframed as nonzero-sum games between two players, thus generalizing a result from von Neumann. The underlying linear programming structure of TU matching problems, however, is lost when moving to LTU. These results draw a new bridge between non-TU matching problems and the theory of bimatrix games, with consequences notably regarding the computation of stable outcomes.


title: Dictionary Learning Improves Patch-Free Circuit Discovery in Mechanistic Interpretability: A Case Study on Othello-GPT

abstract: Sparse dictionary learning has been a rapidly growing technique in mechanistic interpretability to attack superposition and extract more human-understandable features from model activations. We ask a further question based on the extracted more monosemantic features: How do we recognize circuits connecting the enormous amount of dictionary features? We propose a circuit discovery framework alternative to activation patching. Our framework suffers less from out-of-distribution and proves to be more efficient in terms of asymptotic complexity. The basic unit in our framework is dictionary features decomposed from all modules writing to the residual stream, including embedding, attention output and MLP output. Starting from any logit, dictionary feature or attention score, we manage to trace down to lower-level dictionary features of all tokens and compute their contribution to these more interpretable and local model behaviors. We dig in a small transformer trained on a synthetic task named Othello and find a number of human-understandable fine-grained circuits inside of it.


title: Heterogeneity-aware Cross-school Electives Recommendation: a Hybrid Federated Approach

abstract: In the era of modern education, addressing cross-school learner diversity is crucial, especially in personalized recommender systems for elective course selection. However, privacy concerns often limit cross-school data sharing, which hinders existing methods' ability to model sparse data and address heterogeneity effectively, ultimately leading to suboptimal recommendations. In response, we propose HFRec, a heterogeneity-aware hybrid federated recommender system designed for cross-school elective course recommendations. The proposed model constructs heterogeneous graphs for each school, incorporating various interactions and historical behaviors between students to integrate context and content information. We design an attention mechanism to capture heterogeneity-aware representations. Moreover, under a federated scheme, we train individual school-based models with adaptive learning settings to recommend tailored electives. Our HFRec model demonstrates its effectiveness in providing personalized elective recommendations while maintaining privacy, as it outperforms state-of-the-art models on both open-source and real-world datasets.


title: MPI Implementation Profiling for Better Application Performance

abstract: While application profiling has been a mainstay in the HPC community for years, profiling of MPI and other communication middleware has not received the same degree of exploration. This paper adds to the discussion of MPI profiling, contributing two general-purpose profiling methods as well as practical applications of these methods to an existing implementation. The ability to detect performance defects in MPI codes using these methods increases the potential of further research and development in communication optimization.


title: Enhancing Multilingual Capabilities of Large Language Models through Self-Distillation from Resource-Rich Languages

abstract: While large language models (LLMs) have been pre-trained on multilingual corpora, their performance still lags behind in most languages compared to a few resource-rich languages. One common approach to mitigate this issue is to translate training data from resource-rich languages into other languages and then continue training. However, using the data obtained solely relying on translation while ignoring the original capabilities of LLMs across languages is not always effective, which we show will limit the performance of cross-lingual knowledge transfer. In this work, we propose SDRRL, a method based on Self-Distillation from Resource-Rich Languages that effectively improve multilingual performance by leveraging the internal capabilities of LLMs on resource-rich languages. We evaluate on different LLMs (LLaMA-2 and SeaLLM) and source languages across various comprehension and generation tasks, experimental results demonstrate that SDRRL can significantly enhance multilingual capabilities while minimizing the impact on original performance in resource-rich languages.


title: Self-organized clustering, prediction, and superposition of long-term cognitive decline from short-term individual cognitive test scores in Alzheimer's disease

abstract: Progressive cognitive decline spanning across decades is characteristic of Alzheimer's disease (AD). Various predictive models have been designed to realize its early onset and study the long-term trajectories of cognitive test scores across populations of interest. Research efforts have been geared towards superimposing patients' cognitive test scores with the long-term trajectory denoting gradual cognitive decline, while considering the heterogeneity of AD. Multiple trajectories representing cognitive assessment for the long-term have been developed based on various parameters, highlighting the importance of classifying several groups based on disease progression patterns. In this study, a novel method capable of self-organized prediction, classification, and the overlay of long-term cognitive trajectories based on short-term individual data was developed, based on statistical and differential equation modeling. We validated the predictive accuracy of the proposed method for the long-term trajectory of cognitive test score results on two cohorts: the Alzheimer's Disease Neuroimaging Initiative (ADNI) study and the Japanese ADNI study. We also presented two practical illustrations of the simultaneous evaluation of risk factor associated with both the onset and the longitudinal progression of AD, and an innovative randomized controlled trial design for AD that standardizes the heterogeneity of patients enrolled in a clinical trial. These resources would improve the power of statistical hypothesis testing and help evaluate the therapeutic effect. The application of predicting the trajectory of longitudinal disease progression goes beyond AD, and is especially relevant for progressive and neurodegenerative disorders.


title: On Li-Lin's open problem

abstract: In this paper, we give a first negative answer to a question proposed by Li and Lin (Arch Ration Mech Anal 203(3): 943-968, 2012). Meanwhile we also give a second positive answer to the Li-Lin's open problem. The first positive answer was given by G. Cerami, X. Zhong and W. Zou (Calc. Var. Partial Differential Equations, 54(2): 1793-1829, 2015).


title: Dislike of general opinion makes for tight elections

abstract: In modern democracies, the outcome of elections and referendums is often remarkably tight. The repetition of these divisive events are the hallmark of a split society; to the physicist, however, it is an astonishing feat for such large collections of diverse individuals. Many sociophysics models reproduce the emergence of collective human behavior with interacting agents, which respond to their environment according to simple rules, modulated by random fluctuations. A paragon of this class is the Ising model which, when interactions are strong, predicts that order can emerge from a chaotic initial state. In contrast with many elections, however, this model favors a strong majority. Here, we introduce a new element to this classical theory, which accounts for the influence of opinion polls on the electorate. This brings about a new phase in which two groups divide the opinion equally. These political camps are spatially segregated, and the sharp boundary that separates them makes the system size-dependent, even in the limit of a large electorate. Election data show that, over the last 30 years, countries with more than about a million voters often found themselves in this state, whereas elections in smaller countries yielded more consensual results. We suggest that this transition hinges on the electorate's awareness of the general opinion.


title: Language-Codec: Reducing the Gaps Between Discrete Codec Representation and Speech Language Models

abstract: In recent years, large language models have achieved significant success in generative tasks (e.g., speech cloning and audio generation) related to speech, audio, music, and other signal domains. A crucial element of these models is the discrete acoustic codecs, which serves as an intermediate representation replacing the mel-spectrogram. However, there exist several gaps between discrete codecs and downstream speech language models. Specifically, 1) most codec models are trained on only 1,000 hours of data, whereas most speech language models are trained on 60,000 hours; 2) Achieving good reconstruction performance requires the utilization of numerous codebooks, which increases the burden on downstream speech language models; 3) The initial channel of the codebooks contains excessive information, making it challenging to directly generate acoustic tokens from weakly supervised signals such as text in downstream tasks. Consequently, leveraging the characteristics of speech language models, we propose Language-Codec. In the Language-Codec, we introduce a Mask Channel Residual Vector Quantization (MCRVQ) mechanism along with improved Fourier transform structures and larger training datasets to address the aforementioned gaps. We compare our method with competing audio compression algorithms and observe significant outperformance across extensive evaluations. Furthermore, we also validate the efficiency of the Language-Codec on downstream speech language models. The source code and pre-trained models can be accessed at https://github.com/jishengpeng/languagecodec .


title: Some Riemannian properties of $\mathbf{SU_n}$ endowed with a bi-invariant metric

abstract: We study some properties of $SU_n$ endowed with the Frobenius metric $\phi$, which is, up to a positive constant multiple, the unique bi-invariant Riemannian metric on $SU_n$. In particular we express the distance between $P, Q \in SU_n$ in terms of eigenvalues of $P^*Q$; we compute the diameter of $(SU_n, \phi)$ and we determine its diametral pairs; we prove that the set of all minimizing geodesic segments with endpoints $P$, $Q$ can be parametrized by means of a compact connected submanifold of $\mathfrak{su}_n$, diffeomorphic to a suitable complex Grassmannian depending on $P$ and $Q$.


title: Modeling the mechanisms of antibody mixtures in viral infections: the cases of sequential homologous and heterologous dengue infections

abstract: Antibodies play an essential role in the immune response to viral infections, vaccination, or antibody therapy. Nevertheless, they can be either protective or harmful during the immune response. In addition, competition or cooperation between antibodies, when mixed, can enhance or reduce this protective or harmful effect. Using the laws of chemical reactions to model the binding of antibodies to antigens and their actions to neutralize or enhance infection, we propose a new approach to modeling the activity of the antigen-antibody complex. The resulting expression covers not only purely competitive or purely independent binding between antibodies but also synergistic binding which, depending on the type of antibody, can promote either neutralization or enhancement of the viral activity. We then integrate this expression of viral activity in a within-host model, involving both healthy and infected target cells, virus replication, and the production of two antibodies during sequential infections. We investigate the existence of steady-states (disease-free and endemic) and their local and global asymptotic stability. We complete our study with numerical simulations to illustrate different scenarios. In particular, the scenario where both antibodies are neutralizing (homologous sequential DENV infection) and the scenario where one antibody is neutralizing and the other enhancing (heterologous sequential DENV infection). Our model indicates that efficient viral neutralization is associated with purely independent antibody binding, whereas strong enhancement of viral activity is expected in the case of purely competitive antibody binding. The model developed here has several potential applications for a variety of viral infections involving different antibody molecules. It could also be useful for studying the efficacy of vaccines and antibody-based therapies, for example for HIV.


title: An Exotic Path to Glue states Decay

abstract: Glueballs are the most obvious, but this far not fully tested prediction of Quantum Chromodynamics. The lowest expected glueball states, in particular $0^{++}$ states are difficult to characterize, since they share the quantum numbers of the "vacuum" and of a number of possible quark-antiquark states. In this paper, we argue that the more easily identifiable exotics provide us with strong hints on the way to pursue the chase, and in particular the relation with quantum anomalies and the $\eta$ and $\eta '$ states.


title: Polarization of Autonomous Generative AI Agents Under Echo Chambers

abstract: Online social networks often create echo chambers where people only hear opinions reinforcing their beliefs. An echo chamber often generates polarization, leading to conflicts caused by people with radical opinions, such as the January 6, 2021, attack on the US Capitol. The echo chamber has been viewed as a human-specific problem, but this implicit assumption is becoming less reasonable as large language models, such as ChatGPT, acquire social abilities. In response to this situation, we investigated the potential for polarization to occur among a group of autonomous AI agents based on generative language models in an echo chamber environment. We had AI agents discuss specific topics and analyzed how the group's opinions changed as the discussion progressed. As a result, we found that the group of agents based on ChatGPT tended to become polarized in echo chamber environments. The analysis of opinion transitions shows that this result is caused by ChatGPT's high prompt understanding ability to update its opinion by considering its own and surrounding agents' opinions. We conducted additional experiments to investigate under what specific conditions AI agents tended to polarize. As a result, we identified factors that strongly influence polarization, such as the agent's persona. These factors should be monitored to prevent the polarization of AI agents.


title: Representation formulas and far-field behavior of time-periodic incompressible viscous flow around a translating rigid body

abstract: This paper is concerned with integral representations and asymptotic expansions of solutions to the time-periodic incompressible Navier-Stokes equations for fluid flow in the exterior of a rigid body that moves with constant velocity. Using the time-periodic Oseen fundamental solution, we derive representation formulas for solutions with suitable regularity. From these formulas, the decomposition of the velocity component of the fundamental solution into steady-state and purely periodic parts and their detailed decay rate in space, we deduce complete information on the asymptotic structure of the velocity and pressure fields.


title: SlopeSeeker: A Search Tool for Exploring a Dataset of Quantifiable Trends

abstract: Natural language and search interfaces intuitively facilitate data exploration and provide visualization responses to diverse analytical queries based on the underlying datasets. However, these interfaces often fail to interpret more complex analytical intents, such as discerning subtleties and quantifiable differences between terms like "bump" and "spike" in the context of COVID cases, for example. We address this gap by extending the capabilities of a data exploration search interface for interpreting semantic concepts in time series trends. We first create a comprehensive dataset of semantic concepts by mapping quantifiable univariate data trends such as slope and angle to crowdsourced, semantically meaningful trend labels. The dataset contains quantifiable properties that capture the slope-scalar effect of semantic modifiers like "sharply" and "gradually," as well as multi-line trends (e.g., "peak," "valley"). We demonstrate the utility of this dataset in SlopeSeeker, a tool that supports natural language querying of quantifiable trends, such as "show me stocks that tanked in 2010." The tool incorporates novel scoring and ranking techniques based on semantic relevance and visual prominence to present relevant trend chart responses containing these semantic trend concepts. In addition, SlopeSeeker provides a faceted search interface for users to navigate a semantic hierarchy of concepts from general trends (e.g., "increase") to more specific ones (e.g., "sharp increase"). A preliminary user evaluation of the tool demonstrates that the search interface supports greater expressivity of queries containing concepts that describe data trends. We identify potential future directions for leveraging our publicly available quantitative semantics dataset in other data domains and for novel visual analytics interfaces.


title: Forming Long-range Order of Semiconducting Polymers through Liquid-phase Directional Molecular Assemblies

abstract: Intermolecular interactions are crucial in determining the morphology of solution-processed semiconducting polymer thin films. However, these random interactions often lead to disordered or short-range ordered structures. Achieving long-range order in these films has been a challenge due to limited control over microscopic interactions in current techniques. Here, we present a molecular-level methodology that leverages spatial matching of intermolecular dynamics among solutes, solvents, and substrates to induce directional molecular assembly in weakly bonded polymers. Within the optimized dynamic scale of 2.5 \r{A} between polymer side chains and self-assembled monolayers (SAMs) on nanogrooved substrates, our approach transforms random aggregates into unidirectional fibers with a remarkable increase in the anisotropic stacking ratio from 1 to 11. The Flory-Huggins-based molecular stacking model accurately predicts the transitioning order on various SAMs, validated by morphologic and spectroscopic observations. The enhanced structural ordering spans over 3 orders of magnitude in length, raising from the smallest 7.3 nm random crystallites to >14 um unidirectional fibers on sub-millimeter areas. Overall, this study provides insights into the control of complex intermolecular interactions and offers enhanced molecular-level controllability in solution-based processes.


title: Copyleft for Alleviating AIGC Copyright Dilemma: What-if Analysis, Public Perception and Implications

abstract: As AIGC has impacted our society profoundly in the past years, ethical issues have received tremendous attention. The most urgent one is the AIGC copyright dilemma, which can immensely stifle the development of AIGC and greatly cost the entire society. Given the complexity of AIGC copyright governance and the fact that no perfect solution currently exists, previous work advocated copyleft on AI governance but without substantive analysis. In this paper, we take a step further to explore the feasibility of copyleft to alleviate the AIGC copyright dilemma. We conduct a mixed-methods study from two aspects: qualitatively, we use a formal what-if analysis to clarify the dilemma and provide case studies to show the feasibility of copyleft; quantitatively, we perform a carefully designed survey to find out how the public feels about copylefting AIGC. The key findings include: a) people generally perceive the dilemma, b) they prefer to use authorized AIGC under loose restriction, and c) they are positive to copyleft in AIGC and willing to use it in the future.


title: Degree of the subspace variety

abstract: Subspace varieties are algebraic varieties whose elements are tensors with bounded multilinear rank. In this paper, we compute their degrees by computing their volumes.


title: Distribution of supersingular primes for abelian surfaces

abstract: Let $A/K$ be an absolutely simple abelian surface defined over a number field $K$. We give unconditional upper bounds for the number of prime ideals $\mathfrak{p}$ of $K$ with norm up to $x$ such that $A$ has supersingular reduction at $\mathfrak{p}$ when $A$ has a trivial endomorphism ring, real multiplication, and quaternion multiplication, respectively. Particularly, in the real multiplication case and when $K=\mathbb{Q}$, the bound is related to an upper bound for the distribution of Frobenius traces of $A$. Also in the real multiplication case, we provide unconditional upper bounds for a variant of the problem, which concerns the number of prime ideals for which the reduction of $A$ at the prime has a particular Newton datum and is not simple.


title: Reformatted Alignment

abstract: The quality of finetuning data is crucial for aligning large language models (LLMs) with human values. Current methods to improve data quality are either labor-intensive or prone to factual errors caused by LLM hallucinations. This paper explores elevating the quality of existing instruction data to better align with human values, introducing a simple and effective approach named ReAlign, which reformats the responses of instruction data into a format that better aligns with pre-established criteria and the collated evidence. This approach minimizes human annotation, hallucination, and the difficulty in scaling, remaining orthogonal to existing alignment techniques. Experimentally, ReAlign significantly boosts the general alignment ability, math reasoning, factuality, and readability of the LLMs. Encouragingly, without introducing any additional data or advanced training techniques, and merely by reformatting the response, LLaMA-2-13B's mathematical reasoning ability on GSM8K can be improved from 46.77% to 56.63% in accuracy. Additionally, a mere 5% of ReAlign data yields a 67% boost in general alignment ability measured by the Alpaca dataset. This work highlights the need for further research into the science and mechanistic interpretability of LLMs. We have made the associated code and data publicly accessible to support future studies at https://github.com/GAIR-NLP/ReAlign.


title: Bayesian Parameter-Efficient Fine-Tuning for Overcoming Catastrophic Forgetting

abstract: Although motivated by the adaptation of text-to-speech synthesis models, we argue that more generic parameter-efficient fine-tuning (PEFT) is an appropriate framework to do such adaptation. However, catastrophic forgetting remains an issue with PEFT, damaging the pre-trained model's inherent capabilities. We demonstrate that existing Bayesian learning techniques can be applied to PEFT to prevent catastrophic forgetting as long as the parameter shift of the fine-tuned layers can be calculated differentiably. In a principled series of experiments on language modeling and speech synthesis tasks, we utilize established Laplace approximations, including diagonal and Kronecker factored approaches, to regularize PEFT with the low-rank adaptation (LoRA) and compare their performance in pre-training knowledge preservation. Our results demonstrate that catastrophic forgetting can be overcome by our methods without degrading the fine-tuning performance, and using the Kronecker factored approximations produces a better preservation of the pre-training knowledge than the diagonal ones.


title: A lower bound on the size of maximal abelian subgroups

abstract: Let $G$ be a $p$-group for some prime $p$. Let $n$ be the positive integer so that $|G:Z(G)| = p^n$. Suppose $A$ is a maximal abelian subgroup of $G$. Let $$p^l = {\rm max} \{|Z(C_G (g)):Z(G)| : g \in G \setminus Z(G)\},$$ $$p^b = {\rm max} \{|cl(g)| : g \in G \setminus Z(G) \},$$ and $p^a = |A:Z(G)|$. Then we show that $a \ge n/(b+l)$.


title: CovRL: Fuzzing JavaScript Engines with Coverage-Guided Reinforcement Learning for LLM-based Mutation

abstract: Fuzzing is an effective bug-finding technique but it struggles with complex systems like JavaScript engines that demand precise grammatical input. Recently, researchers have adopted language models for context-aware mutation in fuzzing to address this problem. However, existing techniques are limited in utilizing coverage guidance for fuzzing, which is rather performed in a black-box manner. This paper presents a novel technique called CovRL (Coverage-guided Reinforcement Learning) that combines Large Language Models (LLMs) with reinforcement learning from coverage feedback. Our fuzzer, CovRL-Fuzz, integrates coverage feedback directly into the LLM by leveraging the Term Frequency-Inverse Document Frequency (TF-IDF) method to construct a weighted coverage map. This map is key in calculating the fuzzing reward, which is then applied to the LLM-based mutator through reinforcement learning. CovRL-Fuzz, through this approach, enables the generation of test cases that are more likely to discover new coverage areas, thus improving vulnerability detection while minimizing syntax and semantic errors, all without needing extra post-processing. Our evaluation results indicate that CovRL-Fuzz outperforms the state-of-the-art fuzzers in terms of code coverage and bug-finding capabilities: CovRL-Fuzz identified 48 real-world security-related bugs in the latest JavaScript engines, including 39 previously unknown vulnerabilities and 11 CVEs.


title: Second Order Meanfield Approximation for calculating Dynamics in Au-Nanoparticle Networks

abstract: Exploiting physical processes for fast and energy-efficient computation bears great potential in the advancement of modern hardware components. This paper explores non-linear charge tunneling in nanoparticle networks, controlled by external voltages. The dynamics are described by a master equation, which describes the development of a distribution function over the set of charge occupation numbers. The driving force behind this evolution are charge tunneling events among nanoparticles and their associated rates. In this paper, we introduce two meanfield approximations to this master equation. By parametrization of the distribution function using its first- and second-order statistical moments, and a subsequent projection of the dynamics onto the resulting moment manifold, one can deterministically calculate expected charges and currents. Unlike a kinetic Monte Carlo approach, which extracts samples from the distribution function, this meanfield approach avoids any random elements. A comparison of results between the meanfield approximation and an already available kinetic Monte Carlo simulation demonstrates great accuracy. Our analysis also reveals that transitioning from a first-order to a second-order approximation significantly enhances the accuracy. Furthermore, we demonstrate the applicability of our approach to time-dependent simulations, using eulerian time-integration schemes.

categories: physics.comp-ph cs.ET cs.NA math.NA physics.data-an


title: Holographic transport in anisotropic plasmas

abstract: We study energy-momentum and charge transport in strongly interacting holographic quantum field theories in an anisotropic thermal state by contrasting three different holographic methods to compute transport coefficients: standard holographic calculation of retarded Greens functions, a method based on the null-focusing equation near horizon and the novel method based on background variations. Employing these methods we compute anisotropic shear and bulk viscosities and conductivities with anisotropy induced externally, for example by an external magnetic field. We show that all three methods yield consistent results. The novel method allows us to read off the transport coefficients from the horizon data and express them in analytic form from which we derive universal relations among them. Furthermore we extend the method based on the null-focusing equation to Gauss-Bonnet theory to compute higher derivative corrections to the aforementioned transport coefficients.


title: Pushing Auto-regressive Models for 3D Shape Generation at Capacity and Scalability

abstract: Auto-regressive models have achieved impressive results in 2D image generation by modeling joint distributions in grid space. In this paper, we extend auto-regressive models to 3D domains, and seek a stronger ability of 3D shape generation by improving auto-regressive models at capacity and scalability simultaneously. Firstly, we leverage an ensemble of publicly available 3D datasets to facilitate the training of large-scale models. It consists of a comprehensive collection of approximately 900,000 objects, with multiple properties of meshes, points, voxels, rendered images, and text captions. This diverse labeled dataset, termed Objaverse-Mix, empowers our model to learn from a wide range of object variations. However, directly applying 3D auto-regression encounters critical challenges of high computational demands on volumetric grids and ambiguous auto-regressive order along grid dimensions, resulting in inferior quality of 3D shapes. To this end, we then present a novel framework Argus3D in terms of capacity. Concretely, our approach introduces discrete representation learning based on a latent vector instead of volumetric grids, which not only reduces computational costs but also preserves essential geometric details by learning the joint distributions in a more tractable order. The capacity of conditional generation can thus be realized by simply concatenating various conditioning inputs to the latent vector, such as point clouds, categories, images, and texts. In addition, thanks to the simplicity of our model architecture, we naturally scale up our approach to a larger model with an impressive 3.6 billion parameters, further enhancing the quality of versatile 3D generation. Extensive experiments on four generation tasks demonstrate that Argus3D can synthesize diverse and faithful shapes across multiple categories, achieving remarkable performance.


title: AnyGPT: Unified Multimodal LLM with Discrete Sequence Modeling

abstract: We introduce AnyGPT, an any-to-any multimodal language model that utilizes discrete representations for the unified processing of various modalities, including speech, text, images, and music. AnyGPT can be trained stably without any alterations to the current large language model (LLM) architecture or training paradigms. Instead, it relies exclusively on data-level preprocessing, facilitating the seamless integration of new modalities into LLMs, akin to the incorporation of new languages. We build a multimodal text-centric dataset for multimodal alignment pre-training. Utilizing generative models, we synthesize the first large-scale any-to-any multimodal instruction dataset. It consists of 108k samples of multi-turn conversations that intricately interweave various modalities, thus equipping the model to handle arbitrary combinations of multimodal inputs and outputs. Experimental results demonstrate that AnyGPT is capable of facilitating any-to-any multimodal conversation while achieving performance comparable to specialized models across all modalities, proving that discrete representations can effectively and conveniently unify multiple modalities within a language model. Demos are shown in https://junzhan2000.github.io/AnyGPT.github.io/


title: Variational properties of local functionals driven by arbitrary anisotropies

abstract: We provide integral representation and $\Gamma$-compactness results for anisotropic local functionals depending on arbitrary Lipschitz continuous vector fields. In particular, neither bracket-generating assumptions nor linear independence conditions are required.


title: Impact of laser focussing and radiation reaction on particle spectra from nonlinear Breit-Wheeler pair production in the nonperturbative regime

abstract: Near-future experiments intend to detect strong-field Breit-Wheeler pair creation from the collision between bremsstrahlung bursts containing GeV-$\gamma$ quanta and high-intensity laser pulses. In this theoretical study, we investigate the influence of laser focusing, radiation reaction and a broad bremsstrahlung $\gamma$ spectrum on the energy and angular distributions of created pairs. Understanding the role of these inherent reaction attributes provides relevant insights for experimental detection strategies and data interpretation. We show that the inclusion of radiation reaction leads to a narrow energy spectrum of the yielded particles, whose maximum is shifted to substantially lower energies as compared to the case in which radiative energy losses are ignored. The broad bremsstrahlung spectrum also has distinct influence on the particle distributions, whereas the impact of laser focusing turns out to be rather moderate in the considered parameter regime.


title: Self-projective sets

abstract: Self-projective sets are natural fractal sets which describe the action of a semigroup of matrices on projective space. In recent years there has been growing interest in studying the dimension theory of self-projective sets, as well as progress in the understanding of closely related objects such as Furstenberg measures. The aim of this survey is twofold: first to motivate the study of these objects from several different perspectives and second to make the study of these objects more accessible for readers with expertise in iterated function systems.


title: Half Space Property in RCD(0,N) spaces

abstract: The goal of this note is to prove the Half Space Property for $RCD(0,N)$ spaces, namely that if $(X,d,m)$ is a parabolic $RCD(0,N)$ space and $ C \subset X \times \mathbb{R}$ is locally the boundary of a locally perimeter minimizing set and it is contained in a half space, then $C$ is a locally finite union of horizontal slices. If the assumption of local perimeter minimizing is strengthened into global perimeter minimizing, then the conclusion can be strengthened into uniqueness of the horizontal slice. As a consequence, we obtain oscillation estimates and a Half Space Theorem for minimal hypersurfaces in products $M \times \mathbb{R}$, where $M$ is a parabolic smooth manifold (possibly weighted and with boundary) with non-negative Ricci curvature. On the way of proving the main results, we also obtain some properties of Green's functions on $RCD(K,N)$ spaces that are of independent interest.


title: Diffusion Tempering Improves Parameter Estimation with Probabilistic Integrators for Ordinary Differential Equations

abstract: Ordinary differential equations (ODEs) are widely used to describe dynamical systems in science, but identifying parameters that explain experimental measurements is challenging. In particular, although ODEs are differentiable and would allow for gradient-based parameter optimization, the nonlinear dynamics of ODEs often lead to many local minima and extreme sensitivity to initial conditions. We therefore propose diffusion tempering, a novel regularization technique for probabilistic numerical methods which improves convergence of gradient-based parameter optimization in ODEs. By iteratively reducing a noise parameter of the probabilistic integrator, the proposed method converges more reliably to the true parameters. We demonstrate that our method is effective for dynamical systems of different complexity and show that it obtains reliable parameter estimates for a Hodgkin-Huxley model with a practically relevant number of parameters.


title: Kernel KMeans clustering splits for end-to-end unsupervised decision trees

abstract: Trees are convenient models for obtaining explainable predictions on relatively small datasets. Although there are many proposals for the end-to-end construction of such trees in supervised learning, learning a tree end-to-end for clustering without labels remains an open challenge. As most works focus on interpreting with trees the result of another clustering algorithm, we present here a novel end-to-end trained unsupervised binary tree for clustering: Kauri. This method performs a greedy maximisation of the kernel KMeans objective without requiring the definition of centroids. We compare this model on multiple datasets with recent unsupervised trees and show that Kauri performs identically when using a linear kernel. For other kernels, Kauri often outperforms the concatenation of kernel KMeans and a CART decision tree.


title: Empirical Study on Updating Key-Value Memories in Transformer Feed-forward Layers

abstract: The feed-forward networks (FFNs) in transformers are recognized as a group of key-value neural memories to restore abstract high-level knowledge. In this work, we conduct an empirical ablation study on updating keys (the 1st layer in the FFNs layer) or values (the 2nd layer in the FFNs layer). We compare those two methods in various knowledge editing and fine-tuning tasks of large language models to draw insights to understand FFNs further. Code is available at $\href{https://github.com/qiuzh20/Tuning-keys-v.s.-values}{this\,repo}$.


title: Task-Oriented Dialogue with In-Context Learning

abstract: We describe a system for building task-oriented dialogue systems combining the in-context learning abilities of large language models (LLMs) with the deterministic execution of business logic. LLMs are used to translate between the surface form of the conversation and a domain-specific language (DSL) which is used to progress the business logic. We compare our approach to the intent-based NLU approach predominantly used in industry today. Our experiments show that developing chatbots with our system requires significantly less effort than established approaches, that these chatbots can successfully navigate complex dialogues which are extremely challenging for NLU-based systems, and that our system has desirable properties for scaling task-oriented dialogue systems to a large number of tasks. We make our implementation available for use and further study.


title: The Fundamental Limits of Least-Privilege Learning

abstract: The promise of least-privilege learning -- to find feature representations that are useful for a learning task but prevent inference of any sensitive information unrelated to this task -- is highly appealing. However, so far this concept has only been stated informally. It thus remains an open question whether and how we can achieve this goal. In this work, we provide the first formalisation of the least-privilege principle for machine learning and characterise its feasibility. We prove that there is a fundamental trade-off between a representation's utility for a given task and its leakage beyond the intended task: it is not possible to learn representations that have high utility for the intended task but, at the same time prevent inference of any attribute other than the task label itself. This trade-off holds under realistic assumptions on the data distribution and regardless of the technique used to learn the feature mappings that produce these representations. We empirically validate this result for a wide range of learning techniques, model architectures, and datasets.


title: Rotation curves in protoplanetary disks with thermal stratification

abstract: In recent years the gas kinematics probed by molecular lines detected with ALMA has opened a new window to study protoplanetary disks. High spatial and spectral resolution observations have revealed the complexity of protoplanetary disk structure and correctly interpreting these data allow us to gain a better comprehension of the planet formation process. We investigate the impact of thermal stratification on the azimuthal velocity of protoplanetary disks. High resolution gas observations are showing velocity differences between CO isotopologues, which cannot be adequately explained with vertically isothermal models. The aim of this work is to determine whether a stratified model can explain this discrepancy. We analytically solve the hydrostatic equilibrium for a stratified disk and we derive the azimuthal velocity. We test the model with SPH numerical simulations and then we use it to fit for star mass, disk mass and scale radius of the sources in the MAPS sample. In particular, we use 12CO and 13CO datacubes.


title: Learning to Defer in Content Moderation: The Human-AI Interplay

abstract: Successful content moderation in online platforms relies on a human-AI collaboration approach. A typical heuristic estimates the expected harmfulness of a post and uses fixed thresholds to decide whether to remove it and whether to send it for human review. This disregards the prediction uncertainty, the time-varying element of human review capacity and post arrivals, and the selective sampling in the dataset (humans only review posts filtered by the admission algorithm). In this paper, we introduce a model to capture the human-AI interplay in content moderation. The algorithm observes contextual information for incoming posts, makes classification and admission decisions, and schedules posts for human review. Only admitted posts receive human reviews on their harmfulness. These reviews help educate the machine-learning algorithms but are delayed due to congestion in the human review system. The classical learning-theoretic way to capture this human-AI interplay is via the framework of learning to defer, where the algorithm has the option to defer a classification task to humans for a fixed cost and immediately receive feedback. Our model contributes to this literature by introducing congestion in the human review system. Moreover, unlike work on online learning with delayed feedback where the delay in the feedback is exogenous to the algorithm's decisions, the delay in our model is endogenous to both the admission and the scheduling decisions. We propose a near-optimal learning algorithm that carefully balances the classification loss from a selectively sampled dataset, the idiosyncratic loss of non-reviewed posts, and the delay loss of having congestion in the human review system. To the best of our knowledge, this is the first result for online learning in contextual queueing systems and hence our analytical framework may be of independent interest.


title: Mixed Gaussian Flow for Diverse Trajectory Prediction

abstract: Existing trajectory prediction studies intensively leverage generative models. Normalizing flow is one of the genres with the advantage of being invertible to derive the probability density of predicted trajectories. However, mapping from a standard Gaussian by a flow-based model hurts the capacity to capture complicated patterns of trajectories, ignoring the under-represented motion intentions in the training data. To solve the problem, we propose a flow-based model to transform a mixed Gaussian prior into the future trajectory manifold. The model shows a better capacity for generating diverse trajectory patterns. Also, by associating each sub-Gaussian with a certain subspace of trajectories, we can generate future trajectories with controllable motion intentions. In such a fashion, the flow-based model is not encouraged to simply seek the most likelihood of the intended manifold anymore but a family of controlled manifolds with explicit interpretability. Our proposed method is demonstrated to show state-of-the-art performance in the quantitative evaluation of sampling well-aligned trajectories in top-M generated candidates. We also demonstrate that it can generate diverse, controllable, and out-of-distribution trajectories. Code is available at https://github.com/mulplue/MGF.


title: Significance of Chirp MFCC as a Feature in Speech and Audio Applications

abstract: A novel feature, based on the chirp z-transform, that offers an improved representation of the underlying true spectrum is proposed. This feature, the chirp MFCC, is derived by computing the Mel frequency cepstral coefficients from the chirp magnitude spectrum, instead of the Fourier transform magnitude spectrum. The theoretical foundations for the proposal, and the experimental validation using product of likelihood Gaussians, to show the improved class separation offered by the proposed chirp MFCC, when compared with vanilla MFCC are discussed. Further, real world evaluation of the feature is performed using three diverse tasks, namely, speech-music classification, speaker identification, and speech commands recognition. It is shown in all three tasks that the proposed chirp MFCC offers considerable improvements.


title: BEARS Make Neuro-Symbolic Models Aware of their Reasoning Shortcuts

abstract: Neuro-Symbolic (NeSy) predictors that conform to symbolic knowledge - encoding, e.g., safety constraints - can be affected by Reasoning Shortcuts (RSs): They learn concepts consistent with the symbolic knowledge by exploiting unintended semantics. RSs compromise reliability and generalization and, as we show in this paper, they are linked to NeSy models being overconfident about the predicted concepts. Unfortunately, the only trustworthy mitigation strategy requires collecting costly dense supervision over the concepts. Rather than attempting to avoid RSs altogether, we propose to ensure NeSy models are aware of the semantic ambiguity of the concepts they learn, thus enabling their users to identify and distrust low-quality concepts. Starting from three simple desiderata, we derive bears (BE Aware of Reasoning Shortcuts), an ensembling technique that calibrates the model's concept-level confidence without compromising prediction accuracy, thus encouraging NeSy architectures to be uncertain about concepts affected by RSs. We show empirically that bears improves RS-awareness of several state-of-the-art NeSy models, and also facilitates acquiring informative dense annotations for mitigation purposes.


title: Convergence of Gradient Descent for Recurrent Neural Networks: A Nonasymptotic Analysis

abstract: We analyze recurrent neural networks trained with gradient descent in the supervised learning setting for dynamical systems, and prove that gradient descent can achieve optimality \emph{without} massive overparameterization. Our in-depth nonasymptotic analysis (i) provides sharp bounds on the network size $m$ and iteration complexity $\tau$ in terms of the sequence length $T$, sample size $n$ and ambient dimension $d$, and (ii) identifies the significant impact of long-term dependencies in the dynamical system on the convergence and network width bounds characterized by a cutoff point that depends on the Lipschitz continuity of the activation function. Remarkably, this analysis reveals that an appropriately-initialized recurrent neural network trained with $n$ samples can achieve optimality with a network size $m$ that scales only logarithmically with $n$. This sharply contrasts with the prior works that require high-order polynomial dependency of $m$ on $n$ to establish strong regularity conditions. Our results are based on an explicit characterization of the class of dynamical systems that can be approximated and learned by recurrent neural networks via norm-constrained transportation mappings, and establishing local smoothness properties of the hidden state with respect to the learnable parameters.


title: Synthetic location trajectory generation using categorical diffusion models

abstract: Diffusion probabilistic models (DPMs) have rapidly evolved to be one of the predominant generative models for the simulation of synthetic data, for instance, for computer vision, audio, natural language processing, or biomolecule generation. Here, we propose using DPMs for the generation of synthetic individual location trajectories (ILTs) which are sequences of variables representing physical locations visited by individuals. ILTs are of major importance in mobility research to understand the mobility behavior of populations and to ultimately inform political decision-making. We represent ILTs as multi-dimensional categorical random variables and propose to model their joint distribution using a continuous DPM by first applying the diffusion process in a continuous unconstrained space and then mapping the continuous variables into a discrete space. We demonstrate that our model can synthesize realistic ILPs by comparing conditionally and unconditionally generated sequences to real-world ILPs from a GNSS tracking data set which suggests the potential use of our model for synthetic data generation, for example, for benchmarking models used in mobility research.


title: Understanding the Effects of Noise in Text-to-SQL: An Examination of the BIRD-Bench Benchmark

abstract: Text-to-SQL, which involves translating natural language into Structured Query Language (SQL), is crucial for enabling broad access to structured databases without expert knowledge. However, designing models for such tasks is challenging due to numerous factors, including the presence of 'noise,' such as ambiguous questions and syntactical errors. This study provides an in-depth analysis of the distribution and types of noise in the widely used BIRD-Bench benchmark and the impact of noise on models. While BIRD-Bench was created to model dirty and noisy database values, it was not created to contain noise and errors in the questions and gold queries. We found that noise in questions and gold queries are prevalent in the dataset, with varying amounts across domains, and with an uneven distribution between noise types. The presence of incorrect gold SQL queries, which then generate incorrect gold answers, has a significant impact on the benchmark's reliability. Surprisingly, when evaluating models on corrected SQL queries, zero-shot baselines surpassed the performance of state-of-the-art prompting methods. We conclude that informative noise labels and reliable benchmarks are crucial to developing new Text-to-SQL methods that can handle varying types of noise. All datasets, annotations, and code are available at https://github.com/niklaswretblad/the-effects-of-noise-in-text-to-SQL.


title: Symplectic billiards for pairs of polygons

abstract: We introduce symplectic billiards for pairs of possibly non-convex polygons. After establishing basic properties, we give several criteria on pairs of polygons for the symplectic billiard map to be fully periodic, i.e. $\textit{every}$ orbit is periodic. First fully periodic examples were discovered by Albers-Tabachnikov [AT18] and Albers-Banhatti-Sadlo-Schwartz-Tabachnikov in [ABS+19]. Our criteria allow us to construct a plethora of new examples. Moreover, we provide an example of a pair of polygons where the symplectic billiard map is fully periodic while having orbits of arbitrarily large period. After giving a class of examples which provably have isolated periodic orbits (and are thus not fully periodic) we exhibit the first example without any periodic orbits at all. It is open whether being fully periodic with unbounded period or having no periodic orbits at all is possible in the single polygon setting. Finally, we prove that if one replaces polygons by smooth strictly convex curves then there are always infinitely many periodic orbits.


title: Constrained Boundary Labeling

abstract: Boundary labeling is a technique used to label dense sets of feature points in an illustration. It involves placing labels along a rectangular boundary box and connecting each label with its corresponding feature using non-crossing leader lines. Although boundary labeling is well-studied, semantic constraints on the labels have not been investigated thoroughly. In this paper, we consider grouping and ordering constraints for boundary labeling: Grouping constraints enforce that all labels in a group are placed consecutively on the boundary, and ordering constraints enforce a partial order over the labels. We show that finding an admissible labeling for labels of uniform size that can be placed on fixed candidate positions on two opposite sides of the boundary is NP-complete. Furthermore, we show that it is also weakly NP-hard to find an admissible labeling for non-uniform labels that can slide along one side of the boundary. However, we obtain polynomial-time algorithms in the one-sided setting for either fixed candidate positions or uniform-height labels. Finally, we experimentally confirm that our approach has also practical relevance.


title: Unconditional quantum MAGIC advantage in shallow circuit computation

abstract: Quantum theory promises computation speed-ups than classical means. The full power is believed to reside in "magic" states, or equivalently non-Clifford operations -- the secret sauce to establish universal quantum computing. Despite the celebrated Gottesman-Knill Theorem stating that magic-free computation can be efficiently simulated by a classical computer, it is still questionable whether "magic" is really magical. Indeed, all the existing results establish its supremacy for efficient computation upon unproven complexity assumptions or queries to black-box oracles. In this work, we show that the magic advantage can be unconditionally established, at least in a shallow circuit with a constant depth. For this purpose, we first construct a specific nonlocal game inspired by the linear binary constraint system, which requires the magic resource to generate the desired nonlocal statistics or quantum "pseudo telepathy." For a relation problem targeting generating such correlations between arbitrary nonlocal computation sites, we construct a shallow circuit with bounded fan-in gates that takes the strategy for quantum pseudo telepathy as a sub-routine to solve the problem with certainty. In contrast, magic-free counterparts inevitably require a logarithmic circuit depth to the input size, and the separation is proven optimal. As by-products, we prove that the nonlocal game we construct has non-unique perfect winning strategies, answering an open problem in quantum self-testing. We also provide an efficient algorithm to aid the search for potential magic-requiring nonlocal games similar to the current one. We anticipate our results to enlighten the ultimate establishment of the unconditional advantage of universal quantum computation.


title: Finite-temperature grain boundary properties from quasistatic atomistics

abstract: Grain boundary (GB) properties greatly influence the mechanical, electrical, and thermal response of polycrystalline materials. Most computational studies of GB properties at finite temperatures use molecular dynamics (MD), which is computationally expensive, limited in the range of accessible timescales, and requires cumbersome techniques like thermodynamic integration to estimate free energies. This restricts the reasonable computation (without incurring excessive computational expense) of GB properties to regimes that are often unrealistic, such as zero temperature or extremely high strain rates. Consequently, there is a need for simulation methodology that avoids the timescale limitations of MD, while providing reliable estimates of GB properties. The Gaussian Phase-Packet (GPP) method is a temporal coarse-graining technique that can predict relaxed atomic structures at finite temperature in the quasistatic limit. This work applies GPP, combined with the quasiharmonic approximation for computing the free energy, to the problem of determining the free energy and shear coupling factor of grain boundaries in metals over a range of realistic temperatures. Validation is achieved by comparison to thermodynamic integration, which confirms that the presented approach captures relaxed-energy GB structures and shear coupling factors at finite temperature with a high degree of accuracy.


title: A high-order, fully well-balanced, unconditionally positivity-preserving finite volume framework for flood simulations

abstract: In this work, we present a high-order finite volume framework for the numerical simulation of shallow water flows. The method is designed to accurately capture complex dynamics inherent in shallow water systems, particularly suited for applications such as tsunami simulations. The arbitrarily high-order framework ensures precise representation of flow behaviors, crucial for simulating phenomena characterized by rapid changes and fine-scale features. Thanks to an {\it ad-hoc} reformulation in terms of production-destruction terms, the time integration ensures positivity preservation without any time-step restrictions, a vital attribute for physical consistency, especially in scenarios where negative water depth reconstructions could lead to unrealistic results. In order to introduce the preservation of general steady equilibria dictated by the underlying balance law, the high-order reconstruction and numerical flux are blended in a convex fashion with a well-balanced approximation, which is able to provide exact preservation of both static and moving equilibria. Through numerical experiments, we demonstrate the effectiveness and robustness of the proposed approach in capturing the intricate dynamics of shallow water flows, while preserving key physical properties essential for flood simulations.


title: Analysis of Levenshtein Transformer's Decoder and Its Variants

abstract: Levenshtein transformer (LevT) is a non-autoregressive machine translation model with high decoding efficiency and comparable translation quality in terms of bleu score, due to its parallel decoding and iterative refinement procedure. Are there any deficiencies of its translations and what improvements could be made? In this report, we focus on LevT's decoder and analyse the decoding results length, subword generation, and deletion module's capability. We hope to identify weaknesses of the decoder for future improvements. We also compare translations of the original LevT, knowledge-distilled LevT, LevT with translation memory, and the KD-LevT with translation memory to see how KD and translation memory can help.


title: Derivative-Free iterative One-Step Reconstruction for Multispectral CT

abstract: Image reconstruction in Multispectral Computed Tomography (MSCT) requires solving a challenging nonlinear inverse problem, commonly tackled via iterative optimization algorithms. Existing methods necessitate computing the derivative of the forward map and potentially its regularized inverse. In this work, we present a simple yet highly effective algorithm for MSCT image reconstruction, utilizing iterative update mechanisms that leverage the full forward model in the forward step and a derivative-free adjoint problem. Our approach demonstrates both fast convergence and superior performance compared to existing algorithms, making it an interesting candidate for future work. We also discuss further generalizations of our method and its combination with additional regularization and other data discrepancy terms.


title: Lax Additivity

abstract: We introduce notions of lax semiadditive and lax additive $(\infty,2)$-categories, categorifying the classical notions of semiadditive and additive 1-categories. To establish a well-behaved axiomatic framework, we develop a calculus of lax matrices and use it to prove that in locally cocomplete $(\infty,2)$-categories lax limits and lax colimits agree and are absolute. In the lax additive setting, we categorify fundamental constructions from homological algebra such as mapping complexes and mapping cones and establish their basic properties.


title: An Interview Study on Third-Party Cyber Threat Hunting Processes in the U.S. Department of Homeland Security

abstract: Cybersecurity is a major challenge for large organizations. Traditional cybersecurity defense is reactive. Cybersecurity operations centers keep out adversaries and incident response teams clean up after break-ins. Recently a proactive stage has been introduced: Cyber Threat Hunting (TH) looks for potential compromises missed by other cyber defenses. TH is mandated for federal executive agencies and government contractors. As threat hunting is a new cybersecurity discipline, most TH teams operate without a defined process. The practices and challenges of TH have not yet been documented. To address this gap, this paper describes the first interview study of threat hunt practitioners. We obtained access and interviewed 11 threat hunters associated with the U.S. government's Department of Homeland Security. Hour-long interviews were conducted. We analyzed the transcripts with process and thematic coding.We describe the diversity among their processes, show that their processes differ from the TH processes reported in the literature, and unify our subjects' descriptions into a single TH process.We enumerate common TH challenges and solutions according to the subjects. The two most common challenges were difficulty in assessing a Threat Hunter's expertise, and developing and maintaining automation. We conclude with recommendations for TH teams (improve planning, focus on automation, and apprentice new members) and highlight directions for future work (finding a TH process that balances flexibility and formalism, and identifying assessments for TH team performance).


title: Water Vapour Transit Ambiguities for Habitable M-Earths

abstract: We have shown in a recent study, using 3D climate simulations, that dayside land cover has a substantial impact on the climate of a synchronously rotating temperate rocky planet such as Proxima Centauri b. Building on that result, we generate synthetic transit spectra from our simulations to assess the impact of these land-induced climate uncertainties on water vapour transit signals. We find that distinct climate regimes will likely be very difficult to differentiate in transit spectra, even under the more favourable conditions of smaller planets orbiting ultracool dwarfs. Further, we show that additional climate ambiguities arise when both land cover and atmosphere mass are unknown, as is likely to be the case for transiting planets. While water vapour may be detectable under favourable conditions, it may be nearly impossible to infer a rocky planet's surface conditions or climate state from its transit spectrum due to the interdependent effects of land cover and atmosphere mass on surface temperature, humidity, and terminator cloud cover.


title: Stability of the coronal magnetic field around large confined and eruptive solar flares

abstract: In order to improve our understanding on the pre-requisites of eruptive solar flares, we study and compare different measures that characterize the eruptive potential of solar active regions - the critical height for torus instability as a local measure and the helicity ratio as a global measure - with the structural properties of the underlying magnetic field, namely the altitude of the center of the current-carrying magnetic structure. Using time series of 3D optimization-based nonlinear force-free magnetic field models for 10 different active regions (ARs) around the time of large solar flares, we determine the altitudes of the current-weighted centers of the non-potential model structures. Based on the potential magnetic field, we inspect the decay index, $n$, in multiple vertical planes oriented along of or perpendicular to the flare-relevant polarity inversion line, and estimate the critical height ($h_{\mathrm{crit}}$) for torus instability (TI) using different thresholds of $n$. The critical heights are interpreted with respect to the altitudes of the current-weighted centers of the associated non-potential structures, as well as the eruptive character of the associated flares, and the eruptive potential of the host AR, as characterized by the helicity ratio. Our most important findings are that (i) $h_{\mathrm{crit}}$ is more segregated in terms of flare type than the helicity ratio, and that (ii) coronal field configurations with a higher eruptive potential (in terms of the helicity ratio) also appear to be more prone to TI. Furthermore, we find no pronounced differences in the altitudes of the non-potential structures prior to confined and eruptive flares.


title: Shallow Synthesis of Knowledge in GPT-Generated Texts: A Case Study in Automatic Related Work Composition

abstract: Numerous AI-assisted scholarly applications have been developed to aid different stages of the research process. We present an analysis of AI-assisted scholarly writing generated with ScholaCite, a tool we built that is designed for organizing literature and composing Related Work sections for academic papers. Our evaluation method focuses on the analysis of citation graphs to assess the structural complexity and inter-connectedness of citations in texts and involves a three-way comparison between (1) original human-written texts, (2) purely GPT-generated texts, and (3) human-AI collaborative texts. We find that GPT-4 can generate reasonable coarse-grained citation groupings to support human users in brainstorming, but fails to perform detailed synthesis of related works without human intervention. We suggest that future writing assistant tools should not be used to draft text independently of the human author.


title: JWST MIRI MRS Images Disk Winds, Water, and CO in an Edge-On Protoplanetary Disk

abstract: We present JWST MIRI MRS observations of the edge-on protoplanetary disk around the young sub-solar mass star Tau 042021, acquired as part of the Cycle 1 GO program "Mapping Inclined Disk Astrochemical Signatures (MIDAS)." These data resolve the mid-IR spatial distributions of H$_2$, revealing X-shaped emission extending to ~200 au above the disk midplane with a semi-opening angle of $35 \pm 5$ degrees. We do not velocity-resolve the gas in the spectral images, but the measured semi-opening angle of the H$_2$ is consistent with an MHD wind origin. A collimated, bipolar jet is seen in forbidden emission lines from [Ne II], [Ne III], [Ni II], [Fe II], [Ar II], and [S III]. Extended H$_2$O and CO emission lines are also detected, reaching diameters between ~90 and 190 au, respectively. Hot molecular emission is not expected at such radii, and we interpret its extended spatial distribution as scattering of inner disk molecular emission by dust grains in the outer disk surface. H I recombination lines, characteristic of inner disk accretion shocks, are similarly extended, and are likely also scattered light from the innermost star-disk interface. Finally, we detect extended PAH emission at 11.3 microns co-spatial with the scattered light continuum, making this the first low-mass T Tauri star around which extended PAHs have been confirmed, to our knowledge. MIRI MRS line images of edge-on disks provide an unprecedented window into the outflow, accretion, and scattering processes within protoplanetary disks, allowing us to constrain the disk lifetimes and accretion and mass loss mechanisms.


title: Lyapunov Densities For Markov Processes: An Application To Quantum Systems With Non-Demolition Measurements

abstract: Stochastic convergence of discrete time Markov processes has been analysed based on a dual Lyapunov approach. Using some existing results on ergodic theory of Markov processes, it has been shown that existence of a properly subinvariant function (counterpart of the Lyapunov density in deterministic systems) implies sweeping of a Markov process out of the sets where this function is integrable. Such a function can be used as a certificate of convergence in probability of a stochastic system. We apply this technique to Markov processes induced by a quantum system with non-demolition measurement and propose dual Lyapunov certificates to certify sweeping.


title: Low-mass Runaways from the Orion Nebula Cluster -- Kinematic Age Constraints on Star Cluster Formation

abstract: In their early, formative stages star clusters can undergo rapid dynamical evolution leading to strong gravitational interactions and ejection of ``runaway'' stars at high velocities. While O/B runaway stars have been well studied, lower-mass runaways are so far very poorly characterised, even though they are expected to be much more common. We carried out spectroscopic observations with MAG2-MIKE to follow-up 27 high priority candidate runaways consistent with having been ejected from the Orion Nebula Cluster (ONC) $>2.5$ Myr ago, based on Gaia astrometry. We derive spectroscopic youth indicators (Li \& H$\alpha$) and radial velocities, enabling detection of bona fide runaway stars via signatures of youth and 3D traceback. We successfully confirmed 10 of the candidates as low-mass Young Stellar Objects (YSOs) on the basis of our spectroscopic criteria and derived radial velocities (RVs) with which we performed 3D traceback analysis. Three of these confirmed YSOs have kinematic ejection ages $>4\:$Myr, with the oldest being 4.7~Myr. This yields an estimate for the overall formation time of the ONC to be at least $\sim 5\:$Myr, i.e., about 10 free-fall times, and with a mean star formation efficiency per free-fall time of $\bar{\epsilon}_{\rm ff}\lesssim0.05$. These results favor a scenario of slow, quasi-equilibrium star cluster formation, regulated by magnetic fields and/or protostellar outflow feedback.


title: Open3DSG: Open-Vocabulary 3D Scene Graphs from Point Clouds with Queryable Objects and Open-Set Relationships

abstract: Current approaches for 3D scene graph prediction rely on labeled datasets to train models for a fixed set of known object classes and relationship categories. We present Open3DSG, an alternative approach to learn 3D scene graph prediction in an open world without requiring labeled scene graph data. We co-embed the features from a 3D scene graph prediction backbone with the feature space of powerful open world 2D vision language foundation models. This enables us to predict 3D scene graphs from 3D point clouds in a zero-shot manner by querying object classes from an open vocabulary and predicting the inter-object relationships from a grounded LLM with scene graph features and queried object classes as context. Open3DSG is the first 3D point cloud method to predict not only explicit open-vocabulary object classes, but also open-set relationships that are not limited to a predefined label set, making it possible to express rare as well as specific objects and relationships in the predicted 3D scene graph. Our experiments show that Open3DSG is effective at predicting arbitrary object classes as well as their complex inter-object relationships describing spatial, supportive, semantic and comparative relationships.


title: Non-orthogonal Age-Optimal Information Dissemination in Vehicular Networks: A Meta Multi-Objective Reinforcement Learning Approach

abstract: This paper considers minimizing the age-of-information (AoI) and transmit power consumption in a vehicular network, where a roadside unit (RSU) provides timely updates about a set of physical processes to vehicles. We consider non-orthogonal multi-modal information dissemination, which is based on superposed message transmission from RSU and successive interference cancellation (SIC) at vehicles. The formulated problem is a multi-objective mixed-integer nonlinear programming problem; thus, a Pareto-optimal front is very challenging to obtain. First, we leverage the weighted-sum approach to decompose the multi-objective problem into a set of multiple single-objective sub-problems corresponding to each predefined objective preference weight. Then, we develop a hybrid deep Q-network (DQN)-deep deterministic policy gradient (DDPG) model to solve each optimization sub-problem respective to predefined objective-preference weight. The DQN optimizes the decoding order, while the DDPG solves the continuous power allocation. The model needs to be retrained for each sub-problem. We then present a two-stage meta-multi-objective reinforcement learning solution to estimate the Pareto front with a few fine-tuning update steps without retraining the model for each sub-problem. Simulation results illustrate the efficacy of the proposed solutions compared to the existing benchmarks and that the meta-multi-objective reinforcement learning model estimates a high-quality Pareto frontier with reduced training time.


title: NEO-BENCH: Evaluating Robustness of Large Language Models with Neologisms

abstract: The performance of Large Language Models (LLMs) degrades from the temporal drift between data used for model training and newer text seen during inference. One understudied avenue of language change causing data drift is the emergence of neologisms -- new word forms -- over time. We create a diverse resource of recent English neologisms by using several popular collection methods. We analyze temporal drift using neologisms by comparing sentences containing new words with near-identical sentences that replace neologisms with existing substitute words. Model performance is nearly halved in machine translation when a single neologism is introduced in a sentence. Motivated by these results, we construct a benchmark to evaluate LLMs' ability to generalize to neologisms with various natural language understanding tasks and model perplexity. Models with later knowledge cutoff dates yield lower perplexities and perform better in downstream tasks. LLMs are also affected differently based on the linguistic origins of words, indicating that neologisms are complex for static LLMs to address. We will release our benchmark and code for reproducing our experiments.


title: BINGO innovative assembly for background reduction in bolometric $0\nu\beta\beta$ experiments

abstract: BINGO is a project aiming to set the grounds for large-scale bolometric neutrinoless double-beta-decay experiments capable of investigating the effective Majorana neutrino mass at a few meV level. It focuses on developing innovative technologies to achieve a very low background index, of the order of $10^{-5}$ counts/(keV kg yr) in the region of interest. The BINGO demonstrator, called MINI-BINGO, will be composed of Li$_2$MoO$_4$ and TeO$_2$ crystals coupled to bolometric light detectors designed to investigate the promising double-beta-decay isotopes $^{100}$Mo and $^{130}$Te. This will allow us to reject a significant background in bolometers caused by surface contamination from $\alpha$-active radionuclides by means of light yield selection. In addition, BINGO introduces new methods to mitigate other sources of background, such as surface radioactive contamination, external $\gamma$ radioactivity, and pile-up due to random coincidence of background events. This paper focuses on the description of an innovative assembly designed to reduce the passive materials in line of sight of the detectors, which is expected to be a dominant source of background in next-generation bolometric experiments. We present the performance of two prototype modules -- housing four Li$_2$MoO$_4$ crystals in total -- operated in the Canfranc underground laboratory in Spain within a facility developed for the CROSS double-beta-decay experiment.


title: Towards a tailored mixed-precision sub-8-bit quantization scheme for Gated Recurrent Units using Genetic Algorithms

abstract: Despite the recent advances in model compression techniques for deep neural networks, deploying such models on ultra-low-power embedded devices still proves challenging. In particular, quantization schemes for Gated Recurrent Units (GRU) are difficult to tune due to their dependence on an internal state, preventing them from fully benefiting from sub-8bit quantization. In this work, we propose a modular integer quantization scheme for GRUs where the bit width of each operator can be selected independently. We then employ Genetic Algorithms (GA) to explore the vast search space of possible bit widths, simultaneously optimising for model size and accuracy. We evaluate our methods on four different sequential tasks and demonstrate that mixed-precision solutions exceed homogeneous-precision ones in terms of Pareto efficiency. In our results, we achieve a model size reduction between 25% and 55% while maintaining an accuracy comparable with the 8-bit homogeneous equivalent.


title: Uncertainty quantification in fine-tuned LLMs using LoRA ensembles

abstract: Fine-tuning large language models can improve task specific performance, although a general understanding of what the fine-tuned model has learned, forgotten and how to trust its predictions is still missing. We derive principled uncertainty quantification for fine-tuned LLMs with posterior approximations using computationally efficient low-rank adaptation ensembles. We analyze three common multiple-choice datasets using low-rank adaptation ensembles based on Mistral-7b, and draw quantitative and qualitative conclusions on their perceived complexity and model efficacy on the different target domains during and after fine-tuning. In particular, backed by the numerical experiments, we hypothesise about signals from entropic uncertainty measures for data domains that are inherently difficult for a given architecture to learn.


title: On the Byzantine-Resilience of Distillation-Based Federated Learning

abstract: Federated Learning (FL) algorithms using Knowledge Distillation (KD) have received increasing attention due to their favorable properties with respect to privacy, non-i.i.d. data and communication cost. These methods depart from transmitting model parameters and, instead, communicate information about a learning task by sharing predictions on a public dataset. In this work, we study the performance of such approaches in the byzantine setting, where a subset of the clients act in an adversarial manner aiming to disrupt the learning process. We show that KD-based FL algorithms are remarkably resilient and analyze how byzantine clients can influence the learning process compared to Federated Averaging. Based on these insights, we introduce two new byzantine attacks and demonstrate that they are effective against prior byzantine-resilient methods. Additionally, we propose FilterExp, a novel method designed to enhance the byzantine resilience of KD-based FL algorithms and demonstrate its efficacy. Finally, we provide a general method to make attacks harder to detect, improving their effectiveness.


title: L-QLES: Sparse Laplacian generator for evaluating Quantum Linear Equation Solvers

abstract: L-QLES is an open source python code for generating 1D, 2D and 3D Laplacian operators and associated Poisson equations and their classical solutions. Its goal is to provide quantum algorithm developers with a flexible test case framework where features of industrial applications can be incorporated without the need for end-user domain knowledge or reliance on inflexible one-off industry supplied matrix sets. A sample set of 1, 2, and 3 dimensional Laplacians are suggested and used to compare the performance of the Prepare-Select and FABLE block encoding techniques. Results show that large matrices are not needed to investigate industrial characteristics. A matrix with a condition number of 17,000 can be encoded using 13 qubits. L-QLES has also been produced to enable algorithm developers to investigate and optimise both the classical and quantum aspects of the inevitable hybrid nature of quantum linear equation solvers. Prepare-Select encoding that takes over an hour of classical preprocessing time to decompose a 4,096x4,096 matrix into Pauli strings can be can investigated using L-QLES matrices. Similarly, row-column query oracles that have success probabilities $\le 10^{-7}$ for the same matrix can be investigated.


title: High-quality Data-to-Text Generation for Severely Under-Resourced Languages with Out-of-the-box Large Language Models

abstract: The performance of NLP methods for severely under-resourced languages cannot currently hope to match the state of the art in NLP methods for well resourced languages. We explore the extent to which pretrained large language models (LLMs) can bridge this gap, via the example of data-to-text generation for Irish, Welsh, Breton and Maltese. We test LLMs on these under-resourced languages and English, in a range of scenarios. We find that LLMs easily set the state of the art for the under-resourced languages by substantial margins, as measured by both automatic and human evaluations. For all our languages, human evaluation shows on-a-par performance with humans for our best systems, but BLEU scores collapse compared to English, casting doubt on the metric's suitability for evaluating non-task-specific systems. Overall, our results demonstrate the great potential of LLMs to bridge the performance gap for under-resourced languages.


title: The Quantitative Fractional Helly theorem

abstract: Two celebrated extensions of Helly's theorem are the Fractional Helly theorem of Katchalski and Liu (1979) and the Quantitative Volume theorem of B\'ar\'any, Katchalski, and Pach (1982). Improving on several recent works, we prove an optimal combination of these two results. We show that given a family $\mathcal{F}$ of $n$ convex sets in $\mathbb{R}^d$ such that at least $\alpha \binom{n}{d+1}$ of the $(d+1)$-tuples of $\mathcal{F}$ have an intersection of volume at least 1, then one can select $\Omega_{d,\alpha}(n)$ members of $\mathcal{F}$ whose intersection has volume at least $\Omega_d(1)$. Furthermore, with the help of this theorem, we establish a quantitative version of the $(p,q)$ theorem of Alon and Kleitman. Let $p\geq q\geq d+1$ and let $\mathcal{F}$ be a finite family of convex sets in $\mathbb{R}^d$ such that among any $p$ elements of $\mathcal{F}$, there are $q$ that have an intersection of volume at least $1$. Then, we prove that there exists a family $T$ of $O_{p,q}(1)$ ellipsoids of volume $\Omega_d(1)$ such that every member of $\mathcal{F}$ contains at least one element of $T$. Finally, we present extensions about the diameter version of the Quantitative Helly theoerm.


title: Any2Graph: Deep End-To-End Supervised Graph Prediction With An Optimal Transport Loss

abstract: We propose Any2graph, a generic framework for end-to-end Supervised Graph Prediction (SGP) i.e. a deep learning model that predicts an entire graph for any kind of input. The framework is built on a novel Optimal Transport loss, the Partially-Masked Fused Gromov-Wasserstein, that exhibits all necessary properties (permutation invariance, differentiability and scalability) and is designed to handle any-sized graphs. Numerical experiments showcase the versatility of the approach that outperform existing competitors on a novel challenging synthetic dataset and a variety of real-world tasks such as map construction from satellite image (Sat2Graph) or molecule prediction from fingerprint (Fingerprint2Graph).


title: Dynamics, quantum states and Compton scattering in nonlinear gravitational waves

abstract: The classical dynamics and the construction of quantum states in a plane wave curved spacetime are examined, paying particular attention to the similarities with the case of an electromagnetic plane wave in flat spacetime. A natural map connecting the dynamics of a particle in the Rosen metric and the motion of a charged particle in an electromagnetic plane wave is unveiled. We then discuss how this map can be translated into the quantum description by exploiting the large number of underlying symmetries. We examine the complete analogy between Volkov solutions and fermion states in the Rosen chart and properly extend this to massive vector bosons. We finally report the squared S-matrix element of Compton scattering in a sandwich plane wave spacetime in the form of a two-dimensional integral.


title: Secure Federated Learning Across Heterogeneous Cloud and High-Performance Computing Resources -- A Case Study on Federated Fine-tuning of LLaMA 2

abstract: Federated learning enables multiple data owners to collaboratively train robust machine learning models without transferring large or sensitive local datasets by only sharing the parameters of the locally trained models. In this paper, we elaborate on the design of our Advanced Privacy-Preserving Federated Learning (APPFL) framework, which streamlines end-to-end secure and reliable federated learning experiments across cloud computing facilities and high-performance computing resources by leveraging Globus Compute, a distributed function as a service platform, and Amazon Web Services. We further demonstrate the use case of APPFL in fine-tuning a LLaMA 2 7B model using several cloud resources and supercomputers.


title: Analysis of Persian News Agencies on Instagram, A Words Co-occurrence Graph-based Approach

abstract: The rise of the Internet and the exponential increase in data have made manual data summarization and analysis a challenging task. Instagram social network is a prominent social network widely utilized in Iran for information sharing and communication across various age groups. The inherent structure of Instagram, characterized by its text-rich content and graph-like data representation, enables the utilization of text and graph processing techniques for data analysis purposes. The degree distributions of these networks exhibit scale-free characteristics, indicating non-random growth patterns. Recently, word co-occurrence has gained attention from researchers across multiple disciplines due to its simplicity and practicality. Keyword extraction is a crucial task in natural language processing. In this study, we demonstrated that high-precision extraction of keywords from Instagram posts in the Persian language can be achieved using unsupervised word co-occurrence methods without resorting to conventional techniques such as clustering or pre-trained models. After graph visualization and community detection, it was observed that the top topics covered by news agencies are represented by these graphs. This approach is generalizable to new and diverse datasets and can provide acceptable outputs for new data. To the author's knowledge, this method has not been employed in the Persian language before on Instagram social network. The new crawled data has been publicly released on GitHub for exploration by other researchers. By employing this method, it is possible to use other graph-based algorithms, such as community detections. The results help us to identify the key role of different news agencies in information diffusion among the public, identify hidden communities, and discover latent patterns among a massive amount of data.


title: Exact Ansatz of Fermion-Boson Systems for a Quantum Device

abstract: We present an exact ansatz for the eigenstate problem of mixed fermion-boson systems that can be implemented on quantum devices. Based on a generalization of the electronic contracted Schr\"odinger equation (CSE), our approach guides a trial wave function to the ground state of any arbitrary mixed Hamiltonian by directly measuring residuals of the mixed CSE on a quantum device. Unlike density-functional and coupled-cluster theories applied to electron-phonon or electron-photon systems, the accuracy of our approach is not limited by the unknown exchange-correlation functional or the uncontrolled form of the exponential ansatz. To test the performance of the method, we study the Tavis-Cummings model, commonly used in polaritonic quantum chemistry. Our results demonstrate that the CSE is a powerful tool in the development of quantum algorithms for solving general fermion-boson many-body problems.