title: Sigma: Siamese Mamba Network for Multi-Modal Semantic Segmentation

abstract: Multi-modal semantic segmentation significantly enhances AI agents' perception and scene understanding, especially under adverse conditions like low-light or overexposed environments. Leveraging additional modalities (X-modality) like thermal and depth alongside traditional RGB provides complementary information, enabling more robust and reliable segmentation. In this work, we introduce Sigma, a Siamese Mamba network for multi-modal semantic segmentation, utilizing the Selective Structured State Space Model, Mamba. Unlike conventional methods that rely on CNNs, with their limited local receptive fields, or Vision Transformers (ViTs), which offer global receptive fields at the cost of quadratic complexity, our model achieves global receptive fields coverage with linear complexity. By employing a Siamese encoder and innovating a Mamba fusion mechanism, we effectively select essential information from different modalities. A decoder is then developed to enhance the channel-wise modeling ability of the model. Our method, Sigma, is rigorously evaluated on both RGB-Thermal and RGB-Depth segmentation tasks, demonstrating its superiority and marking the first successful application of State Space Models (SSMs) in multi-modal perception tasks. Code is available at https://github.com/zifuwan/Sigma.


title: Incoherent polariton dynamics and nonlinearities in organic light-emitting diodes

abstract: Organic light-emitting diodes (OLEDs) have redefined lighting with their environment-friendliness and flexibility. However, only 25 % of the electronic states of fluorescent molecules can emit light upon electrical excitation, limiting the overall efficiency of OLEDs. Strong light-matter coupling, achieved by confining light within OLEDs using mirrors, generates polaritons - hybrid light-matter states - that could activate the remaining 75 % electronic states. Here, we show how different processes in such polariton OLEDs can be expected to change using a phenomenological quantum master equation model. We are especially interested in reverse inter-system crossing happening directly from the dark triplet states to the emitting lower polariton. We derive a simple expression for the enhancement factor of polaritonic RISC in the linear regime. In addition, we explore the extension of our model to higher dimensions and study some potential effects of strong coupling on nonlinear processes such as triplet-triplet annihilation.


title: Variability-Aware Approximate Circuit Synthesis via Genetic Optimization

abstract: One of the major barriers that CMOS devices face at nanometer scale is increasing parameter variation due to manufacturing imperfections. Process variations severely inhibit the reliable operation of circuits, as the operational frequency at the nominal process corner is insufficient to suppress timing violations across the entire variability spectrum. To avoid variability-induced timing errors, previous efforts impose pessimistic and performance-degrading timing guardbands atop the operating frequency. In this work, we employ approximate computing principles and propose a circuit-agnostic automated framework for generating variability-aware approximate circuits that eliminate process-induced timing guardbands. Variability effects are accurately portrayed with the creation of variation-aware standard cell libraries, fully compatible with standard EDA tools. The underlying transistors are fully calibrated against industrial measurements from Intel 14nm FinFET in which both electrical characteristics of transistors and variability effects are accurately captured. In this work, we explore the design space of approximate variability-aware designs to automatically generate circuits of reduced variability and increased performance without the need for timing guardbands. Experimental results show that by introducing negligible functional error of merely $5.3\times 10^{-3}$, our variability-aware approximate circuits can be reliably operated under process variations without sacrificing the application performance.


title: The prominent and heterogeneous gender disparities in scientific novelty: evidence from biomedical doctoral theses

abstract: Scientific novelty is the essential driving force for research breakthroughs and innovation. However, little is known about how early-career scientists pursue novel research paths, and the gender disparities in this process. To address this research gap, this study investigates a comprehensive dataset of 279,424 doctoral theses in biomedical sciences authored by US Ph.D. graduates. Spanning from 1980 to 2016, the data originates from the ProQuest Dissertations & Theses Database. This study aims to shed light on Ph.D. students' pursuit of scientific novelty in their doctoral theses and assess gender-related differences in this process. Using a combinatorial approach and a pre-trained Bio-BERT model, we quantify the scientific novelty of doctoral theses based on bio-entities. Applying fractional logistic and quantile regression models, this study reveals a decreasing trend in scientific novelty over time and heterogeneous gender disparities in doctoral theses. Specifically, female students consistently exhibited lower scientific novelty levels than their male peers. When supervised by female advisors, students' theses are found to be less novel than those under male advisors. The significant interaction effect of female students and female advisors suggests that female advisors may amplify the gender disparity in scientific novelty. Moreover, heterogeneous gender disparities in scientific novelty are identified, with non-top-tier universities displaying more pronounced disparities, while the differences at higher percentile ranges were comparatively more minor. These findings indicate a potential underrepresentation of female scientists pursuing novel research during the early stages of their careers. Notably, the outcomes of this study hold significant policy implications for advancing the careers of female scientists.


title: Synthetic 33-Bus Microgrid: Dynamic Model and Time-Series Parameters

abstract: This report provides the detailed description of the synthetic 33-bus microgrid (MG), including its structure, dynamic models, and time-series parameters of loads and generations. The network structure is adapted from the IEEE 33-bus distribution network, with additional converter-interfaced renewable energy resources and energy storage systems. Time-series parameters is generated based on the open-source ARPA-E PERFORM datasets.


title: A Novel BERT-based Classifier to Detect Political Leaning of YouTube Videos based on their Titles

abstract: A quarter of US adults regularly get their news from YouTube. Yet, despite the massive political content available on the platform, to date no classifier has been proposed to identify the political leaning of YouTube videos. To fill this gap, we propose a novel classifier based on Bert -- a language model from Google -- to classify YouTube videos merely based on their titles into six categories, namely: Far Left, Left, Center, Anti-Woke, Right, and Far Right. We used a public dataset of 10 million YouTube video titles (under various categories) to train and validate the proposed classifier. We compare the classifier against several alternatives that we trained on the same dataset, revealing that our classifier achieves the highest accuracy (75%) and the highest F1 score (77%). To further validate the classification performance, we collect videos from YouTube channels of numerous prominent news agencies, such as Fox News and New York Times, which have widely known political leanings, and apply our classifier to their video titles. For the vast majority of cases, the predicted political leaning matches that of the news agency.


title: The Future of MEV

abstract: This paper analyzes the Execution Tickets proposal on Ethereum Research, unveiling its potential to revolutionize the Ethereum blockchain's economic model. At the core of this proposal lies a novel ticketing mechanism poised to redefine how the Ethereum protocol distributes the value associated with proposing execution payloads. This innovative approach enables the Ethereum protocol to directly broker Maximal Extractable Value (MEV), traditionally an external revenue stream for validators. The implementation of Execution Tickets goes beyond optimizing validator compensation; it also introduces a new Ethereum native asset with a market capitalization expected to correlate closely with the present value of all value associated with future block production. The analysis demonstrates that the Execution Ticket system can facilitate a more equitable distribution of value within the Ethereum ecosystem, and pave the way for a more secure and economically robust blockchain network.


title: An Exact Invariant for Relativistic Linear Harmonic Oscillator with Time-dependent Frequency

abstract: In this paper we give an exact invariant for a relativistic linear harmonic oscillator with time-dependent frequency. This is accomplished, following Eliezer and Gray \cite{EliezerGray}, for the non-relativistic case, by associating a relativistic plane isotropic harmonic oscillator with this problem. This exact invariant reflects the conservation of angular momentum of the associated relativistic plane isotropic oscillator. Departures in the physical interpretations of this exact invariant caused by relativistic effects are pointed out.


title: Logic Query of Thoughts: Guiding Large Language Models to Answer Complex Logic Queries with Knowledge Graphs

abstract: Despite the superb performance in many tasks, large language models (LLMs) bear the risk of generating hallucination or even wrong answers when confronted with tasks that demand the accuracy of knowledge. The issue becomes even more noticeable when addressing logic queries that require multiple logic reasoning steps. On the other hand, knowledge graph (KG) based question answering methods are capable of accurately identifying the correct answers with the help of knowledge graph, yet its accuracy could quickly deteriorate when the knowledge graph itself is sparse and incomplete. It remains a critical challenge on how to integrate knowledge graph reasoning with LLMs in a mutually beneficial way so as to mitigate both the hallucination problem of LLMs as well as the incompleteness issue of knowledge graphs. In this paper, we propose 'Logic-Query-of-Thoughts' (LGOT) which is the first of its kind to combine LLMs with knowledge graph based logic query reasoning. LGOT seamlessly combines knowledge graph reasoning and LLMs, effectively breaking down complex logic queries into easy to answer subquestions. Through the utilization of both knowledge graph reasoning and LLMs, it successfully derives answers for each subquestion. By aggregating these results and selecting the highest quality candidate answers for each step, LGOT achieves accurate results to complex questions. Our experimental findings demonstrate substantial performance enhancements, with up to 20% improvement over ChatGPT.


title: Accelerating Matrix Factorization by Dynamic Pruning for Fast Recommendation

abstract: Matrix factorization (MF) is a widely used collaborative filtering (CF) algorithm for recommendation systems (RSs), due to its high prediction accuracy, great flexibility and high efficiency in big data processing. However, with the dramatically increased number of users/items in current RSs, the computational complexity for training a MF model largely increases. Many existing works have accelerated MF, by either putting in additional computational resources or utilizing parallel systems, introducing a large cost. In this paper, we propose algorithmic methods to accelerate MF, without inducing any additional computational resources. In specific, we observe fine-grained structured sparsity in the decomposed feature matrices when considering a certain threshold. The fine-grained structured sparsity causes a large amount of unnecessary operations during both matrix multiplication and latent factor update, increasing the computational time of the MF training process. Based on the observation, we firstly propose to rearrange the feature matrices based on joint sparsity, which potentially makes a latent vector with a smaller index more dense than that with a larger index. The feature matrix rearrangement is given to limit the error caused by the later performed pruning process. We then propose to prune the insignificant latent factors by an early stopping process during both matrix multiplication and latent factor update. The pruning process is dynamically performed according to the sparsity of the latent factors for different users/items, to accelerate the process. The experiments show that our method can achieve 1.2-1.65 speedups, with up to 20.08% error increase, compared with the conventional MF training process. We also prove the proposed methods are applicable considering different hyperparameters including optimizer, optimization strategy and initialization method.


title: WGMR Self-Injection Locking Method Based on Enhanced Optical Feedback with Auxiliary Prism

abstract: The optical feedback intensity is an important parameter for realizing narrow linewidth lasers in Whispering-gallery-mode resonator (WGMR) self-injection locking technology. We proposed an approach that enhances the intensity of intracavity feedback in crystalline WGMR by using only a single coated auxiliary prism. Compared to the Rayleigh scattering, the feedback intensity of the enhanced scheme increased by more than a hundred times. Furthermore, we demonstrated that, with the enhanced approach, the instantaneous linewidth of the laser was suppressed to 7 Hz level, the locking range was expanded up to 8 GHz, and the relative intensity noise (RIN) was reduced to -152 dBc/Hz@10MHz. The feedback enhanced design is compact, easy-to-operated and can be integrated with the WGMR. It provides a miniaturized solution for controlling optical feedback intensity in WGMR self-injection locking technology.


title: What AIs are not Learning (and Why): Bio-Inspired Foundation Models for Robots

abstract: It is hard to make robots (including telerobots) that are useful, and harder to make autonomous robots that are robust and general. Current smart robots are created using manual programming, mathematical models, planning frameworks, and reinforcement learning. These methods do not lead to the leaps in performance and generality seen with deep learning, generative AI, and foundation models (FMs). Today's robots do not learn to provide home care, to be nursing assistants, or to do household chores nearly as well as people do. Addressing the aspirational opportunities of robot service applications requires improving how they are created. The high cost of bipedal multi-sensory robots ("bodies") is a significant obstacle for both research and deployment. A deeper issue is that mainstream FMs ("minds") do not support sensing, acting, and learning in context in the real world. They do not lead to robots that communicate well or collaborate. They do not lead to robots that try to learn by experimenting, by asking others, or by imitation learning as appropriate. They do not lead to robots that know enough to be deployed widely in service applications. This paper focuses on what human-compatible service robots need to know. It recommends developing experiential (aka "robotic") FMs for bootstrapping them.


title: The Use of Generative Search Engines for Knowledge Work and Complex Tasks

abstract: Until recently, search engines were the predominant method for people to access online information. The recent emergence of large language models (LLMs) has given machines new capabilities such as the ability to generate new digital artifacts like text, images, code etc., resulting in a new tool, a generative search engine, which combines the capabilities of LLMs with a traditional search engine. Through the empirical analysis of Bing Copilot (Bing Chat), one of the first publicly available generative search engines, we analyze the types and complexity of tasks that people use Bing Copilot for compared to Bing Search. Findings indicate that people use the generative search engine for more knowledge work tasks that are higher in cognitive complexity than were commonly done with a traditional search engine.


title: Algorithmic Collective Action in Recommender Systems: Promoting Songs by Reordering Playlists

abstract: We investigate algorithmic collective action in transformer-based recommender systems. Our use case is a collective of fans aiming to promote the visibility of an artist by strategically placing one of their songs in the existing playlists they control. The success of the collective is measured by the increase in test-time recommendations of the targeted song. We introduce two easily implementable strategies towards this goal and test their efficacy on a publicly available recommender system model released by a major music streaming platform. Our findings reveal that even small collectives (controlling less than 0.01% of the training data) can achieve up 25x amplification of recommendations by strategically choosing the position at which to insert the song. We then focus on investigating the externalities of the strategy. We find that the performance loss for the platform is negligible, and the recommendations of other songs are largely preserved, minimally impairing the user experience of participants. Moreover, the costs are evenly distributed among other artists. Taken together, our findings demonstrate how collective action strategies can be effective while not necessarily being adversarial, raising new questions around incentives, social dynamics, and equilibria in recommender systems.


title: Accelerating Recommender Model Training by Dynamically Skipping Stale Embeddings

abstract: Training recommendation models pose significant challenges regarding resource utilization and performance. Prior research has proposed an approach that categorizes embeddings into popular and non-popular classes to reduce the training time for recommendation models. We observe that, even among the popular embeddings, certain embeddings undergo rapid training and exhibit minimal subsequent variation, resulting in saturation. Consequently, updates to these embeddings lack any contribution to model quality. This paper presents Slipstream, a software framework that identifies stale embeddings on the fly and skips their updates to enhance performance. This capability enables Slipstream to achieve substantial speedup, optimize CPU-GPU bandwidth usage, and eliminate unnecessary memory access. SlipStream showcases training time reductions of 2x, 2.4x, 1.2x, and 1.175x across real-world datasets and configurations, compared to Baseline XDL, Intel-optimized DRLM, FAE, and Hotline, respectively.


title: Towards Effective Next POI Prediction: Spatial and Semantic Augmentation with Remote Sensing Data

abstract: The next point-of-interest (POI) prediction is a significant task in location-based services, yet its complexity arises from the consolidation of spatial and semantic intent. This fusion is subject to the influences of historical preferences, prevailing location, and environmental factors, thereby posing significant challenges. In addition, the uneven POI distribution further complicates the next POI prediction procedure. To address these challenges, we enrich input features and propose an effective deep-learning method within a two-step prediction framework. Our method first incorporates remote sensing data, capturing pivotal environmental context to enhance input features regarding both location and semantics. Subsequently, we employ a region quad-tree structure to integrate urban remote sensing, road network, and POI distribution spaces, aiming to devise a more coherent graph representation method for urban spatial. Leveraging this method, we construct the QR-P graph for the user's historical trajectories to encapsulate historical travel knowledge, thereby augmenting input features with comprehensive spatial and semantic insights. We devise distinct embedding modules to encode these features and employ an attention mechanism to fuse diverse encodings. In the two-step prediction procedure, we initially identify potential spatial zones by predicting user-preferred tiles, followed by pinpointing specific POIs of a designated type within the projected tiles. Empirical findings from four real-world location-based social network datasets underscore the remarkable superiority of our proposed approach over competitive baseline methods.


title: Selecting Query-bag as Pseudo Relevance Feedback for Information-seeking Conversations

abstract: Information-seeking dialogue systems are widely used in e-commerce systems, with answers that must be tailored to fit the specific settings of the online system. Given the user query, the information-seeking dialogue systems first retrieve a subset of response candidates, then further select the best response from the candidate set through re-ranking. Current methods mainly retrieve response candidates based solely on the current query, however, incorporating similar questions could introduce more diverse content, potentially refining the representation and improving the matching process. Hence, in this paper, we proposed a Query-bag based Pseudo Relevance Feedback framework (QB-PRF), which constructs a query-bag with related queries to serve as pseudo signals to guide information-seeking conversations. Concretely, we first propose a Query-bag Selection module (QBS), which utilizes contrastive learning to train the selection of synonymous queries in an unsupervised manner by leveraging the representations learned from pre-trained VAE. Secondly, we come up with a Query-bag Fusion module (QBF) that fuses synonymous queries to enhance the semantic representation of the original query through multidimensional attention computation. We verify the effectiveness of the QB-PRF framework on two competitive pretrained backbone models, including BERT and GPT-2. Experimental results on two benchmark datasets show that our framework achieves superior performance over strong baselines.


title: Photon Transitions in Arbitrary Time-Varying Metamaterials

abstract: We present a general theory for calculating photon transitions in arbitrarily time-varying metamaterials. This theory circumvents the difficulties of conventional approaches in solving such a general problem by exploiting the eigenstates of time-dependent number operators. We demonstrate here the temporal evolution of these operators and the related transition probabilities for the cases of logistic and linear permittivity profiles. The theory is potentially extensible to arbitrary space-time modulations and may hence lead to multiple novel quantum effects and applications.


title: Pattern formation from Gauge/Gravity Duality

abstract: In the framework of the AdS/CFT correspondence, we report a complex scalar field dynamics in a $2+1$ dimensional black hole background can provide a scheme to study the pattern formation process in $1+1$ dimensional reaction-diffusion systems. The patterns include plane wave, defect turbulence, phase turbulence, spatio-temporal intermittency where defect chaos coexists with stable plane wave, and coherent structures. A phase diagram is obtained by studying the linear instability of the plane wave solutions to determine the onset of the holographic version of the Benjamin-Feir instability near a supercritical Hopf bifurcation.


title: Comment on "Non-reciprocal topological solitons in active metamaterials"

abstract: In the recent work "Non-reciprocal topological solitons in active metamaterials" (see arXiv:2312.03544v1), for an analytical understanding of the system under consideration, the authors derive an ordinary differential equation for the sine-Gordon (anti)soliton velocity, with the perturbation theory in the adiabatic approximation, via the inverse scattering transform formalism, see Eq. (3) in their work. Here we note that the latter equation for the (anti)soliton velocity also follows from an energy balance approach.

categories: nlin.PS cond-mat.mtrl-sci cond-mat.soft physics.optics


title: Recursive index for assessing value added of individual scientific publications

abstract: An aggregated recursive K-index is proposed as a new scientometric indicator of added value and scientific research output of individual publications. This index can be used instead of or in addition to the H-index (J.E. Hirsch. An index to quantify an individual's scientific research output, arXiv:physics/0508025). In particular, it is proposed to switch from a pure strategy for assessing the quality and effectiveness of R&D using the H-index (Hirsch index) to a mixed strategy (in the context of publication activity as a combination of cooperative and noncooperative games) using the K-index on subnational and H-index on international or differentiated levels. In the context of a hybrid strategy of the scientist's payoff functions. This transition is correct and in demand for a number of national scientific systems with limited financial, material, infrastructural and linguistic (in terms of the English language) potential. Scientific systems with highly developed indigenous (autochthonous) characteristics are also needed in some scientific areas.


title: Quantum matter and gravitation: photons in a waveguide

abstract: The conditions required by quantum matter to modify space-time geometry are explored within the framework of the general theory of relativity. The required characteristics for space-time modification in solid state structures, are met in either (a) massive photon Bose-Einstein condensate in a waveguide, or (b) the massive photons in superconductor's bulk, or (c) the Bose-Einstein condensate of acoustic phonons, or (d) a metal-insulator-topological insulator heterostructure.


title: A Clifford algebra model in phase space

abstract: I show how the isomorphism between the Lie groups of types $B_2$ and $C_2$ leads to a faithful action of the Clifford algebra $\mathcal C\ell(3,2)$ on the phase space of 2-dimensional dynamics, and hence to a mapping from Dirac spinors modulo scalars into this same phase space. Extending to the phase space of 3-dimensional dynamics allows one to embed all the gauge groups of the Standard Model as well, and hence unify the electro-weak and strong forces into a single algebraic structure, identified as the gauge group of Hamiltonian dynamics. The gauge group transforms between phase space coordinates appropriate for arbitrary observers, and therefore shows how the apparently arbitrary parameters of the Standard Model transform between mutually accelerating observers. In particular, it is possible to calculate the transformation between an inertial frame and the laboratory frame, in order to explain how macroscopic laboratory mechanics emerges from quantum mechanics, and to show how to write down a quantum theory of gravity that is consistent with quantum mechanics, but is not consistent with General Relativity.


title: When Abel Kills Cain: What Machine Translation Cannot Capture

abstract: The article aims at identifying what, from a structural point of view, AI based automatic translators cannot fully capture. It focuses on the machine's mistakes, in order to try to explain its causes. The biblical story of Ca\"in and Abel has been chosen because of its rich interpretive and critical tradition, but also because of its semantic difficulty. The investigation begins with the observation, for the translation of this text, of the language pairs and interfaces offered by the best known machine translation services (Google Translate, DeepL). A typology of the most frequent translation errors is then established. Finally, contemporary translations are compared, in order to underline the unique contribution of each. In conclusion, the article suggests a revision of translation theory and, corArtificial Intelligence, Translation, Limitations, Interpretation, Comparison, Unicityelatively, a reformulation of its technology concerning cultural texts.


title: The Advective Flux Transport Model: Improving the Far-Side with Active Regions observed by STEREO 304\r{A}

abstract: Observations the Sun's photospheric magnetic field are often confined to the Sun-Earth line. Surface flux transport (SFT) models, such as the Advective Flux Transport (AFT) model, simulate the evolution of the photospheric magnetic field to produce magnetic maps over the entire surface of the Sun. While these models are able to evolve active regions that transit the near-side of the Sun, new far-side side flux emergence is typically neglected. We demonstrate a new method for creating improved maps of magnetic field over the Sun's entire photosphere using data obtained by the STEREO mission. The STEREO He II 304 \AA intensity images are used to infer the time, location, and total unsigned magnetic flux of far-side active regions. We have developed and automatic detection algorithm for finding and ingesting new far-side active region emergence into the AFT model. We conduct a series of simulations to investigate the impact of including active region emergence in AFT, both with and without data assimilation of magnetograms. We find that while the He II 304 \AA can be used to improve surface flux models, but care must taken to mitigate intensity surges from flaring events. We estimate that during Solar Cycle 24 maximum (2011-2015), 4-6 x 10^22 Mx of flux is missing from SFT models that do not include far-side data. We find that while He II 304 \AA data alone can be used to create synchronic maps of photospheric magnetic field that resemble the observations, it is insufficient to produce a complete picture without direct magnetic observations from magnetographs.


title: Similar Data Points Identification with LLM: A Human-in-the-loop Strategy Using Summarization and Hidden State Insights

abstract: This study introduces a simple yet effective method for identifying similar data points across non-free text domains, such as tabular and image data, using Large Language Models (LLMs). Our two-step approach involves data point summarization and hidden state extraction. Initially, data is condensed via summarization using an LLM, reducing complexity and highlighting essential information in sentences. Subsequently, the summarization sentences are fed through another LLM to extract hidden states, serving as compact, feature-rich representations. This approach leverages the advanced comprehension and generative capabilities of LLMs, offering a scalable and efficient strategy for similarity identification across diverse datasets. We demonstrate the effectiveness of our method in identifying similar data points on multiple datasets. Additionally, our approach enables non-technical domain experts, such as fraud investigators or marketing operators, to quickly identify similar data points tailored to specific scenarios, demonstrating its utility in practical applications. In general, our results open new avenues for leveraging LLMs in data analysis across various domains.


title: Analyzing Economic Convergence Across the Americas: A Survival Analysis Approach to GDP per Capita Trajectories

abstract: By integrating survival analysis, machine learning algorithms, and economic interpretation, this research examines the temporal dynamics associated with attaining a 5 percent rise in purchasing power parity-adjusted GDP per capita over a period of 120 months (2013-2022). A comparative investigation reveals that DeepSurv is proficient at capturing non-linear interactions, although standard models exhibit comparable performance under certain circumstances. The weight matrix evaluates the economic ramifications of vulnerabilities, risks, and capacities. In order to meet the GDPpc objective, the findings emphasize the need of a balanced approach to risk-taking, strategic vulnerability reduction, and investment in governmental capacities and social cohesiveness. Policy guidelines promote individualized approaches that take into account the complex dynamics at play while making decisions.


title: Translation-based Video-to-Video Synthesis

abstract: Translation-based Video Synthesis (TVS) has emerged as a vital research area in computer vision, aiming to facilitate the transformation of videos between distinct domains while preserving both temporal continuity and underlying content features. This technique has found wide-ranging applications, encompassing video super-resolution, colorization, segmentation, and more, by extending the capabilities of traditional image-to-image translation to the temporal domain. One of the principal challenges faced in TVS is the inherent risk of introducing flickering artifacts and inconsistencies between frames during the synthesis process. This is particularly challenging due to the necessity of ensuring smooth and coherent transitions between video frames. Efforts to tackle this challenge have induced the creation of diverse strategies and algorithms aimed at mitigating these unwanted consequences. This comprehensive review extensively examines the latest progress in the realm of TVS. It thoroughly investigates emerging methodologies, shedding light on the fundamental concepts and mechanisms utilized for proficient video synthesis. This survey also illuminates their inherent strengths, limitations, appropriate applications, and potential avenues for future development.


title: Assessing ML Classification Algorithms and NLP Techniques for Depression Detection: An Experimental Case Study

abstract: Depression has affected millions of people worldwide and has become one of the most common mental disorders. Early mental disorder detection can reduce costs for public health agencies and prevent other major comorbidities. Additionally, the shortage of specialized personnel is very concerning since Depression diagnosis is highly dependent on expert professionals and is time-consuming. Recent research has evidenced that machine learning (ML) and Natural Language Processing (NLP) tools and techniques have significantly bene ted the diagnosis of depression. However, there are still several challenges in the assessment of depression detection approaches in which other conditions such as post-traumatic stress disorder (PTSD) are present. These challenges include assessing alternatives in terms of data cleaning and pre-processing techniques, feature selection, and appropriate ML classification algorithms. This paper tackels such an assessment based on a case study that compares different ML classifiers, specifically in terms of data cleaning and pre-processing, feature selection, parameter setting, and model choices. The case study is based on the Distress Analysis Interview Corpus - Wizard-of-Oz (DAIC-WOZ) dataset, which is designed to support the diagnosis of mental disorders such as depression, anxiety, and PTSD. Besides the assessment of alternative techniques, we were able to build models with accuracy levels around 84% with Random Forest and XGBoost models, which is significantly higher than the results from the comparable literature which presented the level of accuracy of 72% from the SVM model.


title: MIMIR: A Streamlined Platform for Personalized Agent Tuning in Domain Expertise

abstract: Recently, large language models (LLMs) have evolved into interactive agents, proficient in planning, tool use, and task execution across a wide variety of tasks. However, without specific agent tuning, open-source models like LLaMA currently struggle to match the efficiency of GPT- 4, particularly given the scarcity of agent-tuning datasets for fine-tuning. In response, we introduce \textsc{Mimir}: a streamlined platform offering a customizable pipeline that enables users to leverage both private knowledge and publicly available, legally compliant datasets at scale for \textbf{personalized agent tuning}. Additionally, \textsc{Mimir} supports the generation of general instruction-tuning datasets from the same input. This dual capability ensures that language agents developed through the platform possess both specific agent abilities and general competencies. \textsc{Mimir} integrates these features into a cohesive end-to-end platform, facilitating everything from the uploading of personalized files to one-click agent fine-tuning.


title: Language Model Evolution: An Iterated Learning Perspective

abstract: With the widespread adoption of Large Language Models (LLMs), the prevalence of iterative interactions among these models is anticipated to increase. Notably, recent advancements in multi-round self-improving methods allow LLMs to generate new examples for training subsequent models. At the same time, multi-agent LLM systems, involving automated interactions among agents, are also increasing in prominence. Thus, in both short and long terms, LLMs may actively engage in an evolutionary process. We draw parallels between the behavior of LLMs and the evolution of human culture, as the latter has been extensively studied by cognitive scientists for decades. Our approach involves leveraging Iterated Learning (IL), a Bayesian framework that elucidates how subtle biases are magnified during human cultural evolution, to explain some behaviors of LLMs. This paper outlines key characteristics of agents' behavior in the Bayesian-IL framework, including predictions that are supported by experimental verification with various LLMs. This theoretical framework could help to more effectively predict and guide the evolution of LLMs in desired directions.


title: CONFLARE: CONFormal LArge language model REtrieval

abstract: Retrieval-augmented generation (RAG) frameworks enable large language models (LLMs) to retrieve relevant information from a knowledge base and incorporate it into the context for generating responses. This mitigates hallucinations and allows for the updating of knowledge without retraining the LLM. However, RAG does not guarantee valid responses if retrieval fails to identify the necessary information as the context for response generation. Also, if there is contradictory content, the RAG response will likely reflect only one of the two possible responses. Therefore, quantifying uncertainty in the retrieval process is crucial for ensuring RAG trustworthiness. In this report, we introduce a four-step framework for applying conformal prediction to quantify retrieval uncertainty in RAG frameworks. First, a calibration set of questions answerable from the knowledge base is constructed. Each question's embedding is compared against document embeddings to identify the most relevant document chunks containing the answer and record their similarity scores. Given a user-specified error rate ({\alpha}), these similarity scores are then analyzed to determine a similarity score cutoff threshold. During inference, all chunks with similarity exceeding this threshold are retrieved to provide context to the LLM, ensuring the true answer is captured in the context with a (1-{\alpha}) confidence level. We provide a Python package that enables users to implement the entire workflow proposed in our work, only using LLMs and without human intervention.


title: On the existence of Newton series and the asymptotics of finite differences

abstract: Suppose a complex function $f$ has a Lebesgue measurable inverse Laplace transform. We show that the $n$th order forward and backward differences of $f$ at $z_0\in\mathbb{C}$ tend to zero as $n\to\infty$ whenever $z_0$ lies in the region of absolute convergence of $f$. Under the same hypothesis, we show that the Newton series of $f$ centered at $z_0$ exists and converges in the half-plane $\Re(z)>\Re(z_0)$. Assuming instead that $f$ has a Lebesgue measurable inverse Fourier transform, we show that the $n$th order forward, backward, and central differences of $f$ at any $y\in\mathbb{R}$ are $o(2^n)$. Consequently, we show that the binomial sum $\sum_{k\geq0}{n\choose k}f(k)$ is $o(2^n)$.


title: Designing for Human-Agent Alignment: Understanding what humans want from their agents

abstract: Our ability to build autonomous agents that leverage Generative AI continues to increase by the day. As builders and users of such agents it is unclear what parameters we need to align on before the agents start performing tasks on our behalf. To discover these parameters, we ran a qualitative empirical research study about designing agents that can negotiate during a fictional yet relatable task of selling a camera online. We found that for an agent to perform the task successfully, humans/users and agents need to align over 6 dimensions: 1) Knowledge Schema Alignment 2) Autonomy and Agency Alignment 3) Operational Alignment and Training 4) Reputational Heuristics Alignment 5) Ethics Alignment and 6) Human Engagement Alignment. These empirical findings expand previous work related to process and specification alignment and the need for values and safety in Human-AI interactions. Subsequently we discuss three design directions for designers who are imagining a world filled with Human-Agent collaborations.


title: Kakeya problem and projection problem for $k$-geodesics in Grassmannians

abstract: The Kakeya problem in $\mathbb{R}^n$ is about estimating the size of union of $k$-planes; the projection problem in $\mathbb{R}^n$ is about estimating the size of projection of a set onto every $k$-plane ($1\le k\le n-1$). The $k=1$ case has been studied on general manifolds in which $1$-planes become geodesics, while $k\ge 2$ cases were still only considered in $\mathbb{R}^n$. We formulate these problems on homogeneous spaces, where $k$-planes are replaced by $k$-dimensional totally geodesic submanifolds. After formulating the problem, we prove a sharp estimate for Grassmannians.


title: Investigating Regularization of Self-Play Language Models

abstract: This paper explores the effects of various forms of regularization in the context of language model alignment via self-play. While both reinforcement learning from human feedback (RLHF) and direct preference optimization (DPO) require to collect costly human-annotated pairwise preferences, the self-play fine-tuning (SPIN) approach replaces the rejected answers by data generated from the previous iterate. However, the SPIN method presents a performance instability issue in the learning phase, which can be mitigated by playing against a mixture of the two previous iterates. In the same vein, we propose in this work to address this issue from two perspectives: first, by incorporating an additional Kullback-Leibler (KL) regularization to stay at the proximity of the reference policy; second, by using the idea of fictitious play which smoothens the opponent policy across all previous iterations. In particular, we show that the KL-based regularizer boils down to replacing the previous policy by its geometric mixture with the base policy inside of the SPIN loss function. We finally discuss empirical results on MT-Bench as well as on the Hugging Face Open LLM Leaderboard.


title: Conversational Disease Diagnosis via External Planner-Controlled Large Language Models

abstract: The development of large language models (LLMs) has brought unprecedented possibilities for artificial intelligence (AI) based medical diagnosis. However, the application perspective of LLMs in real diagnostic scenarios is still unclear because they are not adept at collecting patient data proactively. This study presents a LLM-based diagnostic system that enhances planning capabilities by emulating doctors. Our system involves two external planners to handle planning tasks. The first planner employs a reinforcement learning approach to formulate disease screening questions and conduct initial diagnoses. The second planner uses LLMs to parse medical guidelines and conduct differential diagnoses. By utilizing real patient electronic medical record data, we constructed simulated dialogues between virtual patients and doctors and evaluated the diagnostic abilities of our system. We demonstrated that our system obtained impressive performance in both disease screening and differential diagnoses tasks. This research represents a step towards more seamlessly integrating AI into clinical settings, potentially enhancing the accuracy and accessibility of medical diagnostics.


title: Reason from Fallacy: Enhancing Large Language Models' Logical Reasoning through Logical Fallacy Understanding

abstract: Large Language Models (LLMs) have demonstrated good performance in many reasoning tasks, but they still struggle with some complicated reasoning tasks including logical reasoning. One non-negligible reason for LLMs' suboptimal performance on logical reasoning is their overlooking of understanding logical fallacies correctly. To evaluate LLMs' capability of logical fallacy understanding (LFU), we propose five concrete tasks from three cognitive dimensions of WHAT, WHY, and HOW in this paper. Towards these LFU tasks, we have successfully constructed a new dataset LFUD based on GPT-4 accompanied by a little human effort. Our extensive experiments justify that our LFUD can be used not only to evaluate LLMs' LFU capability, but also to fine-tune LLMs to obtain significantly enhanced performance on logical reasoning.


title: Quantity and quantitative properties in physics and metrology

abstract: I discuss various aspects of the concept of a quantity in physics and metrology and related consideration in reference documents of IUPAP, IUPAC, ISO, IEC, and JCGM.


title: Transducers with Pronunciation-aware Embeddings for Automatic Speech Recognition

abstract: This paper proposes Transducers with Pronunciation-aware Embeddings (PET). Unlike conventional Transducers where the decoder embeddings for different tokens are trained independently, the PET model's decoder embedding incorporates shared components for text tokens with the same or similar pronunciations. With experiments conducted in multiple datasets in Mandarin Chinese and Korean, we show that PET models consistently improve speech recognition accuracy compared to conventional Transducers. Our investigation also uncovers a phenomenon that we call error chain reactions. Instead of recognition errors being evenly spread throughout an utterance, they tend to group together, with subsequent errors often following earlier ones. Our analysis shows that PET models effectively mitigate this issue by substantially reducing the likelihood of the model generating additional errors following a prior one. Our implementation will be open-sourced with the NeMo toolkit.


title: Tidal Disruption of Planetesimals from an Eccentric Debris Disk Following a White Dwarf Natal Kick

abstract: The surfaces of many white dwarfs are polluted by metals, implying a recent accretion event. The tidal disruption of planetesimals is a viable source of white dwarf pollution and offers a unique window into the composition of exoplanet systems. The question of how planetary material enters the tidal disruption radius of the white dwarf is currently unresolved. Using a series of $N$-body simulations, we explore the response of the surrounding planetesimal debris disk as the white dwarf receives a natal kick caused by anisotropic mass loss on the asymptotic giant branch. We find that the kick can form an apse-aligned, eccentric debris disk in the range 30 to 240 AU which corresponds to the orbits of Neptune, the Kuiper Belt, and the scattered disk in our solar system. In addition, many planetesimals beyond 240 AU flip to counter-rotating orbits. Assuming an isotropic distribution of kicks, we predict that approximately 80% of white dwarf debris disks should exhibit significant apsidal alignment and fraction of counter-rotating orbits. The eccentric disk is able to efficiently and continuously torque planetesimals onto radial, star-grazing orbits. We show that the kick causes both an initial burst in tidal disruption events as well as an extended period of 100 Myr where tidal disruption rates are consistent with observed mass accretion rates on polluted white dwarfs.


title: ProLoc: Robust Location Proofs in Hindsight

abstract: Many online services rely on self-reported locations of user devices like smartphones. To mitigate harm from falsified self-reported locations, the literature has proposed location proof services (LPSs), which provide proof of a device's location by corroborating its self-reported location using short-range radio contacts with either trusted infrastructure or nearby devices that also report their locations. This paper presents ProLoc, a new LPS that extends prior work in two ways. First, ProLoc relaxes prior work's proofs that a device was at a given location to proofs that a device was within distance "d" of a given location. We argue that these weaker proofs, which we call "region proofs", are important because (i) region proofs can be constructed with few requirements on device reporting behavior as opposed to precise location proofs, and (ii) a quantitative bound on a device's distance from a known epicenter is useful for many applications. For example, in the context of citizen reporting near an unexpected event (earthquake, violent protest, etc.), knowing the verified distances of the reporting devices from the event's epicenter would be valuable for ranking the reports by relevance or flagging fake reports. Second, ProLoc includes a novel mechanism to prevent collusion attacks where a set of attacker-controlled devices corroborate each others' false locations. Ours is the first mechanism that does not need additional infrastructure to handle attacks with made-up devices, which an attacker can create in any number at any location without any cost. For this, we rely on a variant of TrustRank applied to the self-reported trajectories and encounters of devices. Our goal is to prevent retroactive attacks where the adversary cannot predict ahead of time which fake location it will want to report, which is the case for the reporting of unexpected events.


title: SELF-[IN]CORRECT: LLMs Struggle with Refining Self-Generated Responses

abstract: Can LLMs continually improve their previous outputs for better results? An affirmative answer would require LLMs to be better at discriminating among previously-generated alternatives, than generating initial responses. We explore the validity of this hypothesis in practice. We first introduce a unified framework that allows us to compare the generative and discriminative capability of any model on any task. Then, in our resulting experimental analysis of several LLMs, we do not observe the performance of those models on discrimination to be reliably better than generation. We hope these findings inform the growing literature on self-improvement AI systems.


title: GENEVIC: GENetic data Exploration and Visualization via Intelligent interactive Console

abstract: Summary: The vast generation of genetic data poses a significant challenge in efficiently uncovering valuable knowledge. Introducing GENEVIC, an AI-driven chat framework that tackles this challenge by bridging the gap between genetic data generation and biomedical knowledge discovery. Leveraging generative AI, notably ChatGPT, it serves as a biologist's 'copilot'. It automates the analysis, retrieval, and visualization of customized domain-specific genetic information, and integrates functionalities to generate protein interaction networks, enrich gene sets, and search scientific literature from PubMed, Google Scholar, and arXiv, making it a comprehensive tool for biomedical research. In its pilot phase, GENEVIC is assessed using a curated database that ranks genetic variants associated with Alzheimer's disease, schizophrenia, and cognition, based on their effect weights from the Polygenic Score Catalog, thus enabling researchers to prioritize genetic variants in complex diseases. GENEVIC's operation is user-friendly, accessible without any specialized training, secured by Azure OpenAI's HIPAA-compliant infrastructure, and evaluated for its efficacy through real-time query testing. As a prototype, GENEVIC is set to advance genetic research, enabling informed biomedical decisions. Availability and implementation: GENEVIC is publicly accessible at https://genevic-anath2024.streamlit.app. The underlying code is open-source and available via GitHub at https://github.com/anath2110/GENEVIC.git.


title: Quantifying age-specific household contacts in Aotearoa New Zealand for infectious disease modelling

abstract: Accounting for population age structure and age-specific contact patterns is crucial for accurate modelling of human infectious disease dynamics and impact. A common approach is to use synthetic contact matrices, which estimate the number of contacts between individuals of different ages in specific settings. These contact matrices are frequently based on data collected from populations with very different demographic and socioeconomic characteristics from the population of interest. Here we use a comprehensive household composition dataset based on New Zealand census and administrative data to construct household contact matrices and a synthetic population that can be used for modelling. We investigate the behaviour of a compartment-based and an agent-based epidemic model parameterised using this data, compared to a commonly used synthetic contact matrix. We find that using the household composition data leads to lower attack rates in older age groups compared to using the synthetic contact matrix. This difference becomes larger when household transmission is more dominant relative to non-household transmission. In addition, explicitly account for household structure in an agent-based models leads to lower attack rates at all ages. We provide electronic versions of the synthetic population and household contact matrix for other researchers to use in infectious disease models.


title: Robust Nonparametric Stochastic Frontier Analysis

abstract: Benchmarking tools, including stochastic frontier analysis (SFA), data envelopment analysis (DEA), and its stochastic extension (StoNED) are core tools in economics used to estimate an efficiency envelope and production inefficiencies from data. The problem appears in a wide range of fields -- for example, in global health the frontier can quantify efficiency of interventions and funding of health initiatives. Despite their wide use, classic benchmarking approaches have key limitations that preclude even wider applicability. Here we propose a robust non-parametric stochastic frontier meta-analysis (SFMA) approach that fills these gaps. First, we use flexible basis splines and shape constraints to model the frontier function, so specifying a functional form of the frontier as in classic SFA is no longer necessary. Second, the user can specify relative errors on input datapoints, enabling population-level analyses. Third, we develop a likelihood-based trimming strategy to robustify the approach to outliers, which otherwise break available benchmarking methods. We provide a custom optimization algorithm for fast and reliable performance. We implement the approach and algorithm in an open source Python package `sfma'. Synthetic and real examples show the new capabilities of the method, and are used to compare SFMA to state of the art benchmarking packages that implement DEA, SFA, and StoNED.


title: CBR-RAG: Case-Based Reasoning for Retrieval Augmented Generation in LLMs for Legal Question Answering

abstract: Retrieval-Augmented Generation (RAG) enhances Large Language Model (LLM) output by providing prior knowledge as context to input. This is beneficial for knowledge-intensive and expert reliant tasks, including legal question-answering, which require evidence to validate generated text outputs. We highlight that Case-Based Reasoning (CBR) presents key opportunities to structure retrieval as part of the RAG process in an LLM. We introduce CBR-RAG, where CBR cycle's initial retrieval stage, its indexing vocabulary, and similarity knowledge containers are used to enhance LLM queries with contextually relevant cases. This integration augments the original LLM query, providing a richer prompt. We present an evaluation of CBR-RAG, and examine different representations (i.e. general and domain-specific embeddings) and methods of comparison (i.e. inter, intra and hybrid similarity) on the task of legal question-answering. Our results indicate that the context provided by CBR's case reuse enforces similarity between relevant components of the questions and the evidence base leading to significant improvements in the quality of generated answers.


title: Approximate Bayesian Computation As An Informed Fuzzing-Inference System

abstract: The power of fuzz testing lies in its random, often brute-force, generation and execution of inputs to trigger unexpected behaviors and vulnerabilities in software applications. However, given the reality of infinite possible input sequences, pursuing all test combinations would not only be computationally expensive, but practically impossible. Approximate Bayesian Computation (ABC), a form of Bayesian simulation, represents a novel, probabilistic approach to addressing this problem. The parameter space for working with these types of problems is effectively infinite, and the application of these techniques is untested in relevant literature. We use a relaxed, manual implementation of two ABC methods, a Sequential Monte Carlo (SMC) simulation, and a Markov Chain Monte Carlo (MCMC) simulation. We found promising results with the SMC posterior and mixed results with MCMC posterior distributions on our white-box fuzz-test function.


title: Stabilization of Multi Fractional Order Differential Equation with Delay Time and Feedback Control

abstract: The purpose of this article is to introduce the original results which devoted with the nonlinear control system problems involves of nonlinear differential equations of fractional orders. Thus, this system is described with a mixed of ordinary derivatives in the first and second order that, are unstable before feedback gain. More precisely, we investigate and analysis the nonlinear control system in related to feedback gain matrix. In addition, we prove that the considered system is locally asymptotically stabilizable via certain conditions. Then, this work reinforce through some application examples that programmed for illustrating and showing the stabilizability of the current systems with high efficiency and accuracy.


title: Sen2Chain: An Open-Source Toolbox for Processing Sentinel-2 Satellite Images and Producing Time-Series of Spectral Indices

abstract: The increasing availability of free high-resolution earth observation data covering any point on the globe every few days led to the emergence of new remote sensing tools that can manipulate the very large volumes of data generated by those satellites. We present Sen2Chain, an open-source Python tool that can automate the processing of large time series of Sentinel-2 images for their use in various fields (e.g., environmental health, natural hazards, ecology). Sen2Chain allows downloading images from various earth observation data suppliers, applying geometric and atmospheric corrections using ESA's Sen2Cor tool, and generating and applying cloud masks. Sen2Chain's ability to extract time series of spectral indices (e.g NDVI, NDWI) provides simplified access to value-added environmental information for a wide range of end-users and applications. Sen2Chain enables all data processing stages to be customized and chained together, with the possibility to automate and parallelize the processing, and optimize data management. Sen2Chain is paving the way for the creation and processing of a large earth observation image database dedicated to users who require time-series and/or perform regular environmental observations. The Web tool Sen2Extract is also presented, which enables end-users with no expertise in remote sensing to easily extract time-series for 11 spectral indices values for specific regions of interest.


title: AuditGPT: Auditing Smart Contracts with ChatGPT

abstract: To govern smart contracts running on Ethereum, multiple Ethereum Request for Comment (ERC) standards have been developed, each containing a set of rules to guide the behaviors of smart contracts. Violating the ERC rules could cause serious security issues and financial loss, signifying the importance of verifying smart contracts follow ERCs. Today's practices of such verification are to either manually audit each single contract or use expert-developed, limited-scope program-analysis tools, both of which are far from being effective in identifying ERC rule violations. This paper presents a tool named AuditGPT that leverages large language models (LLMs) to automatically and comprehensively verify ERC rules against smart contracts. To build AuditGPT, we first conduct an empirical study on 222 ERC rules specified in four popular ERCs to understand their content, their security impacts, their specification in natural language, and their implementation in Solidity. Guided by the study, we construct AuditGPT by separating the large, complex auditing process into small, manageable tasks and design prompts specialized for each ERC rule type to enhance LLMs' auditing performance. In the evaluation, AuditGPT successfully pinpoints 418 ERC rule violations and only reports 18 false positives, showcasing its effectiveness and accuracy. Moreover, AuditGPT beats an auditing service provided by security experts in effectiveness, accuracy, and cost, demonstrating its advancement over state-of-the-art smart-contract auditing practices.


title: PREDIS-MHI Thermal Data

abstract: Tertiary buildings could be an important lever to meet the goals necessitated by the energy transition. The availability of high-quality datasets from this sector will be a crucial enabler in meeting these goals by developing and testing new energy management approaches in the buildings. In this paper, we present the thermal energy datasets available and published online for the PREDIS-MHI zone of the GreEn-ER building, a tertiary building with more than a thousand sensors used for research, teaching, and administrative activities in Grenoble. PREDIS-MHI platform is a net-zero sub-section that is energetically isolated from the rest of the building. Its data has been used in a wide range of applications from indoor temperature forecasting, thermal simulation calibration, and even occupant comfort experiments


title: Visual Knowledge in the Big Model Era: Retrospect and Prospect

abstract: Visual knowledge is a new form of knowledge representation that can encapsulate visual concepts and their relations in a succinct, comprehensive, and interpretable manner, with a deep root in cognitive psychology. As the knowledge about the visual world has been identified as an indispensable component of human cognition and intelligence, visual knowledge is poised to have a pivotal role in establishing machine intelligence. With the recent advance of Artificial Intelligence (AI) techniques, large AI models (or foundation models) have emerged as a potent tool capable of extracting versatile patterns from broad data as implicit knowledge, and abstracting them into an outrageous amount of numeric parameters. To pave the way for creating visual knowledge empowered AI machines in this coming wave, we present a timely review that investigates the origins and development of visual knowledge in the pre-big model era, and accentuates the opportunities and unique role of visual knowledge in the big model era.


title: An inertial self-adaptive algorithm for solving split feasibility problems and fixed point problems in the class of demicontractive mappings

abstract: We propose a hybrid inertial self-adaptive algorithm for solving the split feasibility problem and fixed point problem in the class of demicontractive mappings. Our results are very general and extend several related results existing in literature from the class of nonexpansive or quasi-nonexpansive mappings to the larger class of demicontractive mappings. Examples to illustrate numerically the effectiveness of the new analytical results are presented.


title: Suppressing Modulation Instability with Reinforcement Learning

abstract: Modulation instability is a phenomenon of spontaneous pattern formation in nonlinear media, oftentimes leading to an unpredictable behaviour and a degradation of a signal of interest. We propose an approach based on reinforcement learning to suppress the unstable modes by optimizing the parameters for the time modulation of the potential in the nonlinear system. We test our approach in 1D and 2D cases and propose a new class of physically-meaningful reward functions to guarantee tamed instability.

categories: nlin.PS cs.AI cs.LG cs.SY eess.SY physics.app-ph


title: A Real-time Anomaly Detection Using Convolutional Autoencoder with Dynamic Threshold

abstract: The majority of modern consumer-level energy is generated by real-time smart metering systems. These frequently contain anomalies, which prevent reliable estimates of the series' evolution. This work introduces a hybrid modeling approach combining statistics and a Convolutional Autoencoder with a dynamic threshold. The threshold is determined based on Mahalanobis distance and moving averages. It has been tested using real-life energy consumption data collected from smart metering systems. The solution includes a real-time, meter-level anomaly detection system that connects to an advanced monitoring system. This makes a substantial contribution by detecting unusual data movements and delivering an early warning. Early detection and subsequent troubleshooting can financially benefit organizations and consumers and prevent disasters from occurring.


title: Half-Space Feature Learning in Neural Networks

abstract: There currently exist two extreme viewpoints for neural network feature learning -- (i) Neural networks simply implement a kernel method (a la NTK) and hence no features are learned (ii) Neural networks can represent (and hence learn) intricate hierarchical features suitable for the data. We argue in this paper neither interpretation is likely to be correct based on a novel viewpoint. Neural networks can be viewed as a mixture of experts, where each expert corresponds to a (number of layers length) path through a sequence of hidden units. We use this alternate interpretation to motivate a model, called the Deep Linearly Gated Network (DLGN), which sits midway between deep linear networks and ReLU networks. Unlike deep linear networks, the DLGN is capable of learning non-linear features (which are then linearly combined), and unlike ReLU networks these features are ultimately simple -- each feature is effectively an indicator function for a region compactly described as an intersection of (number of layers) half-spaces in the input space. This viewpoint allows for a comprehensive global visualization of features, unlike the local visualizations for neurons based on saliency/activation/gradient maps. Feature learning in DLGNs is shown to happen and the mechanism with which this happens is through learning half-spaces in the input space that contain smooth regions of the target function. Due to the structure of DLGNs, the neurons in later layers are fundamentally the same as those in earlier layers -- they all represent a half-space -- however, the dynamics of gradient descent impart a distinct clustering to the later layer neurons. We hypothesize that ReLU networks also have similar feature learning behaviour.


title: JobFormer: Skill-Aware Job Recommendation with Semantic-Enhanced Transformer

abstract: Job recommendation aims to provide potential talents with suitable job descriptions (JDs) consistent with their career trajectory, which plays an essential role in proactive talent recruitment. In real-world management scenarios, the available JD-user records always consist of JDs, user profiles, and click data, in which the user profiles are typically summarized as the user's skill distribution for privacy reasons. Although existing sophisticated recommendation methods can be directly employed, effective recommendation still has challenges considering the information deficit of JD itself and the natural heterogeneous gap between JD and user profile. To address these challenges, we proposed a novel skill-aware recommendation model based on the designed semantic-enhanced transformer to parse JDs and complete personalized job recommendation. Specifically, we first model the relative items of each JD and then adopt an encoder with the local-global attention mechanism to better mine the intra-job and inter-job dependencies from JD tuples. Moreover, we adopt a two-stage learning strategy for skill-aware recommendation, in which we utilize the skill distribution to guide JD representation learning in the recall stage, and then combine the user profiles for final prediction in the ranking stage. Consequently, we can embed rich contextual semantic representations for learning JDs, while skill-aware recommendation provides effective JD-user joint representation for click-through rate (CTR) prediction. To validate the superior performance of our method for job recommendation, we present a thorough empirical analysis of large-scale real-world and public datasets to demonstrate its effectiveness and interpretability.


title: Faraday: Synthetic Smart Meter Generator for the smart grid

abstract: Access to smart meter data is essential to rapid and successful transitions to electrified grids, underpinned by flexibility delivered by low carbon technologies, such as electric vehicles (EV) and heat pumps, and powered by renewable energy. Yet little of this data is available for research and modelling purposes due consumer privacy protections. Whilst many are calling for raw datasets to be unlocked through regulatory changes, we believe this approach will take too long. Synthetic data addresses these challenges directly by overcoming privacy issues. In this paper, we present Faraday, a Variational Auto-encoder (VAE)-based model trained over 300 million smart meter data readings from an energy supplier in the UK, with information such as property type and low carbon technologies (LCTs) ownership. The model produces household-level synthetic load profiles conditioned on these labels, and we compare its outputs against actual substation readings to show how the model can be used for real-world applications by grid modellers interested in modelling energy grids of the future.


title: Achieving High-Performance Fault-Tolerant Routing in HyperX Interconnection Networks

abstract: Interconnection networks are key actors that condition the performance of current large datacenter and supercomputer systems. Both topology and routing are critical aspects that must be carefully considered for a competitive system network design. Moreover, when daily failures are expected, this tandem should exhibit resilience and robustness. Low-diameter networks, including HyperX, are cheaper than typical Fat Trees. But, to be really competitive, they have to employ evolved routing algorithms to both balance traffic and tolerate failures. In this paper, SurePath, an efficient fault-tolerant routing mechanism for HyperX topology is introduced and evaluated. SurePath leverages routes provided by standard routing algorithms and a deadlock avoidance mechanism based on an Up/Down escape subnetwork. This mechanism not only prevents deadlock but also allows for a fault-tolerant solution for these networks. SurePath is thoroughly evaluated in the paper under different traffic patterns, showing no performance degradation under extremely faulty scenarios.


title: Parameter Efficient Quasi-Orthogonal Fine-Tuning via Givens Rotation

abstract: With the increasingly powerful performances and enormous scales of pretrained models, promoting parameter efficiency in fine-tuning has become a crucial need for effective and efficient adaptation to various downstream tasks. One representative line of fine-tuning methods is Orthogonal Fine-tuning (OFT), which rigorously preserves the angular distances within the parameter space to preserve the pretrained knowledge. Despite the empirical effectiveness, OFT still suffers low parameter efficiency at $\mathcal{O}(d^2)$ and limited capability of downstream adaptation. Inspired by Givens rotation, in this paper, we proposed quasi-Givens Orthogonal Fine-Tuning (qGOFT) to address the problems. We first use $\mathcal{O}(d)$ Givens rotations to accomplish arbitrary orthogonal transformation in $SO(d)$ with provable equivalence, reducing parameter complexity from $\mathcal{O}(d^2)$ to $\mathcal{O}(d)$. Then we introduce flexible norm and relative angular adjustments under soft orthogonality regularization to enhance the adaptation capability of downstream semantic deviations. Extensive experiments on various tasks and pretrained models validate the effectiveness of our methods.


title: DeepLINK-T: deep learning inference for time series data using knockoffs and LSTM

abstract: High-dimensional longitudinal time series data is prevalent across various real-world applications. Many such applications can be modeled as regression problems with high-dimensional time series covariates. Deep learning has been a popular and powerful tool for fitting these regression models. Yet, the development of interpretable and reproducible deep-learning models is challenging and remains underexplored. This study introduces a novel method, Deep Learning Inference using Knockoffs for Time series data (DeepLINK-T), focusing on the selection of significant time series variables in regression while controlling the false discovery rate (FDR) at a predetermined level. DeepLINK-T combines deep learning with knockoff inference to control FDR in feature selection for time series models, accommodating a wide variety of feature distributions. It addresses dependencies across time and features by leveraging a time-varying latent factor structure in time series covariates. Three key ingredients for DeepLINK-T are 1) a Long Short-Term Memory (LSTM) autoencoder for generating time series knockoff variables, 2) an LSTM prediction network using both original and knockoff variables, and 3) the application of the knockoffs framework for variable selection with FDR control. Extensive simulation studies have been conducted to evaluate DeepLINK-T's performance, showing its capability to control FDR effectively while demonstrating superior feature selection power for high-dimensional longitudinal time series data compared to its non-time series counterpart. DeepLINK-T is further applied to three metagenomic data sets, validating its practical utility and effectiveness, and underscoring its potential in real-world applications.


title: Robust Depth Enhancement via Polarization Prompt Fusion Tuning

abstract: Existing depth sensors are imperfect and may provide inaccurate depth values in challenging scenarios, such as in the presence of transparent or reflective objects. In this work, we present a general framework that leverages polarization imaging to improve inaccurate depth measurements from various depth sensors. Previous polarization-based depth enhancement methods focus on utilizing pure physics-based formulas for a single sensor. In contrast, our method first adopts a learning-based strategy where a neural network is trained to estimate a dense and complete depth map from polarization data and a sensor depth map from different sensors. To further improve the performance, we propose a Polarization Prompt Fusion Tuning (PPFT) strategy to effectively utilize RGB-based models pre-trained on large-scale datasets, as the size of the polarization dataset is limited to train a strong model from scratch. We conducted extensive experiments on a public dataset, and the results demonstrate that the proposed method performs favorably compared to existing depth enhancement baselines. Code and demos are available at https://lastbasket.github.io/PPFT/.


title: SpatialTracker: Tracking Any 2D Pixels in 3D Space

abstract: Recovering dense and long-range pixel motion in videos is a challenging problem. Part of the difficulty arises from the 3D-to-2D projection process, leading to occlusions and discontinuities in the 2D motion domain. While 2D motion can be intricate, we posit that the underlying 3D motion can often be simple and low-dimensional. In this work, we propose to estimate point trajectories in 3D space to mitigate the issues caused by image projection. Our method, named SpatialTracker, lifts 2D pixels to 3D using monocular depth estimators, represents the 3D content of each frame efficiently using a triplane representation, and performs iterative updates using a transformer to estimate 3D trajectories. Tracking in 3D allows us to leverage as-rigid-as-possible (ARAP) constraints while simultaneously learning a rigidity embedding that clusters pixels into different rigid parts. Extensive evaluation shows that our approach achieves state-of-the-art tracking performance both qualitatively and quantitatively, particularly in challenging scenarios such as out-of-plane rotation.


title: Confusion of extragalactic sources in the far infrared: a baseline assessment of the performance of PRIMAger in intensity and polarization

abstract: Because of their limited angular resolution, far-infrared telescopes are usually affected by confusion phenomenon. Since several galaxies can be located in the same instrumental beam, only the brightest objects emerge from the fluctuations caused by fainter sources. The probe far-infrared mission for astrophysics imager (PRIMAger) will observe the mid- and far-infrared (25-235 $\mu$m) sky both in intensity and polarization. We aim to provide predictions of the confusion level and its consequences for future surveys. We produced simulated PRIMAger maps affected only by the confusion noise using the simulated infrared extragalactic sky (SIDES) semi-empirical simulation. We then estimated the confusion limit in these maps and extracted the sources using a basic blind extractor. By comparing the input galaxy catalog and the extracted source catalog, we derived various performance metrics as completeness, purity, and the accuracy of various measurements. In intensity, we predict that the confusion limit increases rapidly with increasing wavelength. The confusion limit in polarization is more than 100x lower. The measured flux density is dominated by the brightest galaxy in the beam, but other objects also contribute at longer wavelength (~30% at 235 $\mu$m). We also show that galaxy clustering has a mild impact on confusion in intensity (up to 25%), while it is negligible in polarization. In intensity, a basic blind extraction will be sufficient to detect galaxies at the knee of the luminosity function up to z~3 and 10$^{11}$ M$_\odot$ main-sequence galaxies up to z~5. In polarization for a conservative sensitivity, we expect ~8 000 detections up to z=2.5 opening a totally new window on the high-z dust polarization. Finally, we show that intensity surveys at short wavelength and polarization surveys at long wavelength tend to reach confusion at similar depth. There is thus a strong synergy.


title: Substructures within Substructures in the Complex Post-Merging System A514 Unveiled by High-Resolution Magellan/Megacam Weak Lensing

abstract: Abell 514 (A514) at $z=0.071$ is an intriguing merging system exhibiting highly elongated (~1 Mpc) X-ray features and three large-scale (300~500 kpc) bent radio jets. To dissect this system with its multi-wavelength data, it is critical to robustly identify and quantify its dark matter (DM) substructures. We present a weak-lensing analysis of A514 using deep Magellan/Megacam observations. Combining two optical band filter imaging data obtained under optimal seeing (~0.''6) and leveraging the proximity of A514, we achieve a high source density of ~$46\mbox{arcmin}^{-2}$ or ~$\mathrm{6940Mpc^{-2}}$, which enables high-resolution mass reconstruction. We unveil the complex DM substructures of A514, which are characterized by the NW and SE subclusters separated by ~$0.7$Mpc, each exhibiting a bimodal mass distribution. The total mass of the NW subcluster is estimated to be $\mathrm{M^{NW}_{200c} = 1.08_{-0.22}^{+0.24} \times 10^{14} M_{\odot}}$ and is further resolved into the eastern ($\mathrm{M^{NW_E}_{200c} = 2.6_{-1.1}^{+1.4} \times 10^{13} M_{\odot}})$ and western ($\mathrm{M^{NW_W}_{200c} = 7.1_{-2.0}^{+2.3} \times 10^{13} M_{\odot}}$) components. The mass of the SE subcluster is $\mathrm{M^{SE}_{200c} = 1.55_{-0.26}^{+0.28} \times 10^{14} M_{\odot}}$, which is also further resolved into the northern ($\mathrm{M^{SE_N}_{200c} = 2.9_{-1.3}^{+1.8} \times 10^{13} M_{\odot}}$) and southern ($\mathrm{M^{SE_S}_{200c} = 8.5_{-2.6}^{+3.0} \times 10^{13} M_{\odot}}$) components. These four substructures coincide with the A514 brightest galaxies and are detected with significances ranging from 3.4$\sigma$ to 4.8$\sigma$. Comparison of the dark matter substructures with the X-ray distribution suggests that A514 might have experienced an off-axis collision, and the NW and SE subclusters are currently near their apocenters.


title: Quantum Spin Chains and Symmetric Functions

abstract: We consider the question of what quantum spin chains naturally encode in their Hilbert space. It turns out that quantum spin chains are rather rich systems, naturally encoding solutions to various problems in combinatorics, group theory, and algebraic geometry. In the case of the XX Heisenberg spin chain these are given by skew Kostka numbers, skew characters of the symmetric group, and Littlewood-Richardson coefficients. As we show, this is revealed by a fermionic representation of the theory of "quantized" symmetric functions formulated by Fomin and Greene, which provides a powerful framework for constructing operators extracting this data from the Hilbert space of quantum spin chains. Furthermore, these operators are diagonalized by the Bethe basis of the quantum spin chain. Underlying this is the fact that quantum spin chains are examples of "quantum integrable systems." This is somewhat analogous to bosons encoding permanents and fermions encoding determinants. This points towards considering quantum integrable systems, and the combinatorics associated with them, as potentially interesting targets for quantum computers.


title: Relativistic head-on collisions of $U(1)$ gauged Q-balls

abstract: We investigate the collision dynamics of $U(1)$ gauged Q-balls by performing high-resolution numerical simulations in axisymmetry. Focusing on the case of relativistic head-on collisions, we consider the effects of the initial velocity, relative phase, relative charge, and electromagnetic coupling strength on the outcome of the collision. We find that the collision dynamics can depend strongly on these parameters; most notably, electromagnetic effects can significantly alter the outcome of the collision when the gauge coupling is large. When the gauge coupling is small, we find that the dynamics generally resemble those of ordinary (non-gauged) Q-balls.


title: Critical behavior of dirty parafermionic chains

abstract: A family of $\mathbb Z_n$-symmetric non-Hermitian models of Baxter was shown by Fendley to be exactly solvable via a parafermionic generalization of the Clifford algebra. We study these models with spatially random couplings, and obtain several exact results on thermodynamic singularities as the distributions of couplings are varied. We find that these singularities, independent of $n$, are identical to those in the random transverse-field Ising chain; correspondingly the models host infinite-randomness critical points. Similarities in structure to exact methods for random Ising models, a strong-disorder renormalization group, and generalizations to other models with free spectra, are discussed.

categories: cond-mat.stat-mech cond-mat.dis-nn cond-mat.str-el math-ph math.MP


title: Searching for Emission Lines at $z>11$: The Role of Damped Lyman-$\alpha$ and Hints About the Escape of Ionizing Photons

abstract: We describe new ultra-deep James Webb Space Telescope (JWST) NIRSpec PRISM and grating spectra for the galaxies JADES-GS-z11-0 ($z_{\mathrm{spec}} = 11.122^{+0.005}_{-0.003}$) and JADES-GS-z13-0 ($z_{\mathrm{spec}} = 13.20^{+0.03}_{-0.04}$), the most distant spectroscopically-confirmed galaxy discovered in the first year of JWST observations. The extraordinary depth of these observations (75 hours and 56 hours, respectively) provides a unique opportunity to explore the redshifts, stellar properties, UV magnitudes, and slopes for these two sources. For JADES-GS-z11-0, we find evidence for multiple emission lines, including [OII]3726,3729 and [NeIII]3869, resulting in a spectroscopic redshift we determine with 94% confidence. At this spectroscopic redshift, the Lyman-$\alpha$ break in JADES-GS-z11-0 can be fit with a damped Lyman-$\alpha$ absorber with $\log{(N_\mathrm{HI}/\mathrm{cm}^{-2})} = 22.42^{+0.093}_{-0.120}$. We present stringent upper limits on the emission line fluxes and line equivalent widths for JADES-GS-z13-0. These results demonstrate how neutral hydrogen fraction and Lyman-damping wings may impact the recovery of spectroscopic redshifts for sources like these, providing insight into the overprediction of the photometric redshifts seen for distant galaxies observed with JWST. In addition, we analyze updated NIRCam photometry to calculate the morphological properties of these resolved sources, and find a secondary source $0.3^{\prime\prime}$ south of JADES-GS-z11-0 at a similar photometric redshift, hinting at how galaxies grow through interactions in the early Universe.


title: Hypothesis Generation with Large Language Models

abstract: Effective generation of novel hypotheses is instrumental to scientific progress. So far, researchers have been the main powerhouse behind hypothesis generation by painstaking data analysis and thinking (also known as the Eureka moment). In this paper, we examine the potential of large language models (LLMs) to generate hypotheses. We focus on hypothesis generation based on data (i.e., labeled examples). To enable LLMs to handle arbitrarily long contexts, we generate initial hypotheses from a small number of examples and then update them iteratively to improve the quality of hypotheses. Inspired by multi-armed bandits, we design a reward function to inform the exploitation-exploration tradeoff in the update process. Our algorithm is able to generate hypotheses that enable much better predictive performance than few-shot prompting in classification tasks, improving accuracy by 31.7% on a synthetic dataset and by 13.9%, 3.3% and, 24.9% on three real-world datasets. We also outperform supervised learning by 12.8% and 11.2% on two challenging real-world datasets. Furthermore, we find that the generated hypotheses not only corroborate human-verified theories but also uncover new insights for the tasks.


title: Parameter estimation from Ly$\alpha$ forest in Fourier space using Information Maximising Neural Network

abstract: We aim to present a robust parameter estimation with simulated Lya forest spectra from Sherwood-Relics simulations suite using Information Maximizing Neural Network(IMNN) to extract maximal information from Lya 1D-transmitted flux in Fourier space. We perform 1D estimations using IMNN for IGM thermal parameters $T_0$ & $\gamma$ at z=2-4 and cosmological parameters $\sigma_8$ & $n_s$ at z=3-4. We compare our results with estimates from power spectrum using posterior distribution from Markov Chain Monte Carlo(MCMC). We then check robustness of IMNN estimates against deviation in spectral noise levels,continuum uncertainties & instrumental smoothing effects. Using mock Lya forest sightlines from publicly available CAMELS project we also check the robustness of the trained IMNN on a different simulation. We also perform a 2D-parameter estimation for $T_0$ & HI photoionization rates $\Gamma_{HI}$. We obtain improved estimates of $T_0$ & $\gamma$ using IMNN over standard MCMC approach. These estimates are also more robust against SNR deviations at z=2 & 3. At z=4 the sensitivity to noise deviations is on par with MCMC estimates. The IMNN also provides $T_0$ and $\gamma$ estimates which are robust against continuum uncertainties by extracting continuum-independent small-scale information from Fourier domain. In case of $\sigma_8$ & $n_s$ IMNN performs on par with MCMC but still offers a significant speed boost in estimating parameters from a new dataset. The improved estimates with IMNN are seen for high instrumental-resolution(FWHM=6km/s). At medium or low resolutions IMNN performs similar to MCMC suggesting an improved extraction of small-scale information with IMNN. We also find that IMNN estimates are robust against the choice of simulation. By performing a 2D-parameter estimation for $T_0$ & $\Gamma_{HI}$ we also demonstrate how to take forward this approach observationally in the future.


title: Signatures of fragmentation for periodically driven fermions

abstract: We study the possible signatures of prethermal strong Hilbert space fragmentation (HSF) for one-dimensional (1D) fermions subjected to a periodic drive. We extend the results of Phys. Rev. Lett. 130, 120401 (2023) to show the possibility of such fragmentation for a large class of experimentally relevant drive protocols. Moreover, we demonstrate the persistence of HSF when the fermion chain is taken away from half-filling. Both these analysis indicate the robustness of the fragmentation phenomenon reported earlier. We also provide an alternate derivation of the Floquet Hamiltonian of the driven chain which yields insight into the generic nested commutator structure of its higher order terms. Finally, we study the density-density out-of-time-correlators (OTOC) of the driven chain both away and near the special drive frequencies at which its first order Floquet Hamiltonian exhibits fragmentation. We show that these OTOCs, for a chain with open boundary condition, exhibit a distinct periodic unscrambling of information at special drive frequencies; such unscrambling can therefore serve as a marker of prethermal HSF. We provide an approximate analytic explanation of the role of HSF behind such periodic unscrambling and discuss experiments which can detect signatures of strong HSF in such driven chains.


title: Optical absorption signatures of superconductors driven by Van Hove singularities

abstract: Due to the diverging density of states (DOS), Van Hove singularities (VHS) near the Fermi level are known to boost the susceptibility to a wide variety of electronic instabilities, including superconductivity. We theoretically show that the number of VHS in the normal state can be qualitatively inferred from the optical absorption spectra Re $\sigma_{ii}(\omega)$ in the superconducting state. The key feature is the absorption peak at frequency $\omega=2\Delta$ from the optical transition across the superconducting gap $\Delta$, which is forbidden in a single-band clean superconductor when the inversion symmetry is preserved and the band is quadratic. Although VHS dispersions are mostly quadratic, we find that a divergent peak occurs when there are multiple VHS on the Fermi surface under an applied current. In contrast, we find non-diverging weak peaks when there is only a single VHS. Depending on whether this single VHS has logarithmically or power-law divergent DOS, the peaks in Re $\sigma_{xx}(\omega)$ and Re $\sigma_{yy}(\omega)$ are nearly isotropic and anisotropic, respectively. Therefore, we propose that experimentally measured peak magnitude and anisotropy in the optical absorption spectra of VH-driven superconductors can be used to determine the number and type of VHS on the Fermi surface. Disorders could even facilitate in distinguishing the multiple and single VHS scenarios since only the diverging peak in the latter case is expected to survive.


title: Hydrodynamical simulations favor a pure deflagration origin of the near-Chandrasekhar mass supernova remnant 3C 397

abstract: Suzaku X-ray observations of the Type Ia supernova remnant (SNR) 3C 397 discovered exceptionally high mass ratios of Mn/Fe, Ni/Fe, and Cr/Fe, consistent with a near $M_{\rm Ch}$ progenitor white dwarf (WD). The Suzaku observations have established 3C 397 as our best candidate for a near-$M_{\rm Ch}$ SNR Ia, and opened the way to address additional outstanding questions about the origin and explosion mechanism of these transients. In particular, subsequent XMM-Newton observations revealed an unusually clumpy distribution of iron group elemental (IGE) abundances within the ejecta of 3C 397. In this paper, we undertake a suite of two dimensional hydrodynamical models, varying both the explosion mechanism -- either deflagration-to-detonation (DDT), or pure deflagration -- WD progenitors, and WD progenitor metallicity, and analyze their detailed nucleosynthetic abundances and associated clumping. We find that pure deflagrations naturally give rise to clumpy distributions of neutronized species concentrated towards the outer limb of the remnant, and confirm DDTs have smoothly structured ejecta with a central concentration of neutronization. Our findings indicate that 3C 397 was most likely a pure deflagration of a high central density WD. We discuss a range of implications of these findings for the broader SN Ia progenitor problem.


title: Bipartite Fluctuations of Critical Fermi Surfaces

abstract: We investigate the scaling behaviors of bipartite fluctuations $\mathcal{F}$ of conserved quantities across a class of interaction-driven quantum phase transitions out of Landau fermi liquids, where other phases involve fermi-surface states of fractionalized degrees of freedom. Examples of such phases include (compressible) composite fermi liquids for spinless electrons and (incompressible) spin-liquid Mott insulators for spin-$1/2$ electrons. The two sides of the critical points are typically distinguished by distinct leading-order scalings of bipartite charge fluctuations, $\mathcal{F}\sim L\log (L)$ in Landau fermi liquids, and $\mathcal{F}\sim L$ in the other phases, where $L$ is the linear size of the subsystem under bipartition. In the case of composite fermi liquids (with continuous translational and rotational invariance), we also identify a universal constant term $-\mathtt{F}(\theta)\sigma_{xy}/\pi$ arising when the subsystem geometry incorporates a sharp corner. Here, $\mathtt{F}(\theta)$ represents a function of the corner angle, and $\sigma_{xy}$ denotes the Hall conductivity. At the critical point of each example, we find that the leading-order scaling $\mathcal{F}\sim L$ is accompanied by a subleading universal corner contribution $-\mathtt{F}(\theta)C_{\rho}\log(L)$ with the same angle dependence $\mathtt{F}(\theta)$. The universal coefficient $C_{\rho}$ is linked to the predicted universal longitudinal (and Hall) resistivity jump $\Delta\rho_{xx}$ (and $\Delta\rho_{xy}$) at the critical point.


title: Scope Ambiguities in Large Language Models

abstract: Sentences containing multiple semantic operators with overlapping scope often create ambiguities in interpretation, known as scope ambiguities. These ambiguities offer rich insights into the interaction between semantic structure and world knowledge in language processing. Despite this, there has been little research into how modern large language models treat them. In this paper, we investigate how different versions of certain autoregressive language models -- GPT-2, GPT-3/3.5, Llama 2 and GPT-4 -- treat scope ambiguous sentences, and compare this with human judgments. We introduce novel datasets that contain a joint total of almost 1,000 unique scope-ambiguous sentences, containing interactions between a range of semantic operators, and annotated for human judgments. Using these datasets, we find evidence that several models (i) are sensitive to the meaning ambiguity in these sentences, in a way that patterns well with human judgments, and (ii) can successfully identify human-preferred readings at a high level of accuracy (over 90% in some cases).


title: Detecting Ultralight Dark Matter Gravitationally with Laser Interferometers in Space

abstract: Ultralight dark matter (ULDM) is one of the leading well-motivated dark matter candidates, predicted in many theories beyond the standard model of particle physics and cosmology. There have been increasing interests in searching for ULDM in physical and astronomical experiments, mostly assuming there are additional interactions other than gravity between ULDM and normal matter. Here we demonstrate that even if ULDM has only gravitational interaction, it shall induce gravitational perturbations in solar system that may be large enough to cause detectable signals in future gravitational-wave (GW) laser interferometers in space. We investigate the sensitivities of Michelson time-delay interferometer to ULDM of various spins, and show vector ULDM with mass $m\lesssim 10^{-18}~$eV can be probed by space-based GW detectors aiming at $\mu$Hz frequencies. Our findings exhibit that GW detectors may directly probe ULDM in some mass ranges that otherwise are challenging to examine.


title: Disorder operators in 2D Fermi and non-Fermi liquids through multidimensional bosonization

abstract: Disorder operators are a type of non-local observables for quantum many-body systems, measuring the fluctuations of symmetry charges inside a region. It has been shown that disorder operators can reveal global aspects of many-body states that are otherwise difficult to access through local measurements. We study disorder operator for U(1) (charge or spin) symmetry in 2D Fermi and non-Fermi liquid states, using the multidimensional bosonization formalism. For a region $A$, the logarithm of the charge disorder parameter in a Fermi liquid with isotropic interactions scales asympototically as $l_A\ln l_A$, with $l_A$ being the linear size of the region $A$. We calculate the proportionality coefficient in terms of Landau parameters of the Fermi liquid theory. We then study models of Fermi surface coupled to gapless bosonic fields realizing non-Fermi liquid states. In a simple spinless model, where the fermion density is coupled to a critical scalar, we find that at the quantum critical point, the scaling behavior of the charge disorder operators is drastically modified to $l_A \ln^2 l_A$. We also consider the composite Fermi liquid state and argue that the charge disorder operator scales as $l_A$.