title: Fundamental limits to the generation of highly displaced bright squeezed light using linear optics and parametric amplifiers

abstract: High quality squeezed light is an important resource for a variety of applications. Multiple methods for generating squeezed light are known, having been demonstrated theoretically and experimentally. However, the effectiveness of these methods -- in particular, the inherent limitations to the signals that can be produced -- has received little consideration. Here we present a comparative theoretical analysis for generating a highly-displaced high-brightness squeezed light from a linear optical method -- a beam-splitter mixing a squeezed vacuum and a strong coherent state -- and parametric amplification methods including an optical parametric oscillator, an optical parametric amplifier, and a dissipative optomechanical squeezer seeded with coherent states. We show that the quality of highly-displaced high-brightness squeeze states that can be generated using these methods is limited on a fundamental level by the physical mechanism utilized; across all methods there are significant tradeoffs between brightness, squeezing, and overall uncertainty. We explore the nature and extent of these tradeoffs specific to each mechanism and identify the optimal operation modes for each, and provide an argument for why this type of tradeoff is unavoidable for parametric amplifier type squeezers.


title: Controlling The Contrast Between Absorptivity and Emissivity in Nonreciprocal Thermal Emitters

abstract: Recent advancements in nonreciprocal thermal emitters challenge the conventional Kirchhoff's law, which states that emissivity and absorptivity should be equal for a given direction, frequency, and polarization. These emitters can break Kirchhoff's law and enable unprecedented thermal photon control capabilities. However, current studies mainly focus on increasing the magnitude of the contrast between emissivity and absorptivity, with little attention paid to how the sign or bandwidth of the contrast may be controlled. In this work, we show such control ability can be achieved by coupling resonances that can provide opposite contrasts between emissivity and absorptivity.


title: Theory of mobility edge and non-ergodic extended phase in coupled random matrices

abstract: The mobility edge, as a central concept in disordered models for localization-delocalization transitions, has rarely been discussed in the context of random matrix theory (RMT). Here we report a new class of random matrix model by direct coupling between two random matrices, showing that their overlapped spectra and un-overlapped spectra exhibit totally different scaling behaviors, which can be used to construct tunable mobility edges. This model is a direct generalization of the Rosenzweig-Porter model, which hosts ergodic, localized, and non-ergodic extended (NEE) phases. A generic theory for these phase transitions is presented, which applies equally well to dense, sparse, and even corrected random matrices in different ensembles. We show that the phase diagram is fully characterized by two scaling exponents, and they are mapped out in various conditions. Our model provides a general framework to realize the mobility edges and non-ergodic phases in a controllable way in RMT, which pave avenue for many intriguing applications both from the pure mathematics of RMT and the possible implementations of ME in many-body models, chiral symmetry breaking in QCD and the stability of the large ecosystems.


title: Interpretable by Design: Wrapper Boxes Combine Neural Performance with Faithful Explanations

abstract: Can we preserve the accuracy of neural models while also providing faithful explanations? We present wrapper boxes, a general approach to generate faithful, example-based explanations for model predictions while maintaining predictive performance. After training a neural model as usual, its learned feature representation is input to a classic, interpretable model to perform the actual prediction. This simple strategy is surprisingly effective, with results largely comparable to those of the original neural model, as shown across three large pre-trained language models, two datasets of varying scale, four classic models, and four evaluation metrics. Moreover, because these classic models are interpretable by design, the subset of training examples that determine classic model predictions can be shown directly to users.


title: Against negative splitting: the case for alternative pacing strategies for elite marathon athletes in official events

abstract: Objectives: Negative splitting (i.e., finishing the race faster) is a tactic commonly employed by elite marathon athletes, even though research supporting the strategy is scarce. The presence of pacers allows the main runner to run behind a formation, preserving energy. Our aim is to show that, in the presence of pacers, the most efficient pacing strategy is positive splitting. Methods: We evaluated the performance of an elite marathon runner from an energetic standpoint, including drag values obtained through Computational Fluid Dynamics (CFD). In varying simulations for different pacing strategies, the energy for both the main runner and his pacer were conserved and the total race time was calculated. Results: In order to achieve minimum race time, the main runner must start the race faster and run behind the pacers, and when the pacers drop out, finish the race slower. Optimal race times are obtained when the protected phase is run 2.4 to 2.6% faster than the unprotected phase. Conclusion: Our results provide strong evidence that positive splitting is indeed the best pacing strategy when at least one pacer is present, causing significant time savings in official marathon events.


title: Painterly Image Harmonization via Adversarial Residual Learning

abstract: Image compositing plays a vital role in photo editing. After inserting a foreground object into another background image, the composite image may look unnatural and inharmonious. When the foreground is photorealistic and the background is an artistic painting, painterly image harmonization aims to transfer the style of background painting to the foreground object, which is a challenging task due to the large domain gap between foreground and background. In this work, we employ adversarial learning to bridge the domain gap between foreground feature map and background feature map. Specifically, we design a dual-encoder generator, in which the residual encoder produces the residual features added to the foreground feature map from main encoder. Then, a pixel-wise discriminator plays against the generator, encouraging the refined foreground feature map to be indistinguishable from background feature map. Extensive experiments demonstrate that our method could achieve more harmonious and visually appealing results than previous methods.


title: Observational Evidence to Support a Dense Ambient Medium Shaping the Jet in 3C 84

abstract: Highly collimated relativistic jets are a defining feature of certain active galactic nuclei (AGN), yet their formation mechanism remains elusive. Previous observations and theoretical models have proposed that the ambient medium surrounding the jets could exert pressure, playing a crucial role in shaping the jets. However, direct observational confirmation of such a medium has been lacking. In this study, we present very long baseline interferometric (VLBI) observations of 3C 84 (NGC 1275), located at the center of the Perseus Cluster. Through monitoring observations with the Very Long Baseline Array (VLBA) at 43 GHz, a jet knot was detected to have been ejected from the sub-parsec scale core in the late 2010s. Intriguingly, this knot propagated in a direction significantly offset from the parsec-scale jet direction. To delve deeper into the matter, we employ follow-up VLBA 43 GHz observations, tracing the knot's trajectory until the end of 2022. We discovered that the knot abruptly changed its trajectory in the early 2020s, realigning itself with the parsec-scale jet direction. Additionally, we present results from an observation of 3C 84 with the Global VLBI Alliance (GVA) at 22 GHz, conducted near the monitoring period. By jointly analyzing the GVA 22 GHz image with a VLBA 43 GHz image observed about one week apart, we generated a spectral index map, revealing an inverted spectrum region near the edge of the jet where the knot experienced deflection. These findings suggest the presence of a dense, cold ambient medium characterized by an electron density exceeding $\sim10^5\ {\rm cm^{-3}}$, which guides the jet's propagation on parsec scales and significantly contributes to the overall shaping of the jet.


title: Explore Spurious Correlations at the Concept Level in Language Models for Text Classification

abstract: Language models (LMs) have achieved notable success in numerous NLP tasks, employing both fine-tuning and in-context learning (ICL) methods. While language models demonstrate exceptional performance, they face robustness challenges due to spurious correlations arising from imbalanced label distributions in training data or ICL exemplars. Previous research has primarily concentrated on word, phrase, and syntax features, neglecting the concept level, often due to the absence of concept labels and difficulty in identifying conceptual content in input texts. This paper introduces two main contributions. First, we employ ChatGPT to assign concept labels to texts, assessing concept bias in models during fine-tuning or ICL on test data. We find that LMs, when encountering spurious correlations between a concept and a label in training or prompts, resort to shortcuts for predictions. Second, we introduce a data rebalancing technique that incorporates ChatGPT-generated counterfactual data, thereby balancing label distribution and mitigating spurious correlations. Our method's efficacy, surpassing traditional token removal approaches, is validated through extensive testing.


title: Autonomous Large Language Model Agents Enabling Intent-Driven Mobile GUI Testing

abstract: GUI testing checks if a software system behaves as expected when users interact with its graphical interface, e.g., testing specific functionality or validating relevant use case scenarios. Currently, deciding what to test at this high level is a manual task since automated GUI testing tools target lower level adequacy metrics such as structural code coverage or activity coverage. We propose DroidAgent, an autonomous GUI testing agent for Android, for semantic, intent-driven automation of GUI testing. It is based on Large Language Models and support mechanisms such as long- and short-term memory. Given an Android app, DroidAgent sets relevant task goals and subsequently tries to achieve them by interacting with the app. Our empirical evaluation of DroidAgent using 15 apps from the Themis benchmark shows that it can set up and perform realistic tasks, with a higher level of autonomy. For example, when testing a messaging app, DroidAgent created a second account and added a first account as a friend, testing a realistic use case, without human intervention. On average, DroidAgent achieved 61% activity coverage, compared to 51% for current state-of-the-art GUI testing techniques. Further, manual analysis shows that 317 out of the 374 autonomously created tasks are realistic and relevant to app functionalities, and also that DroidAgent interacts deeply with the apps and covers more features.


title: The Use of Symmetry for Models with Variable-size Variables

abstract: This paper shows the universal representations of symmetric functions with multidimensional variable-size variables, which help assessing the justification of approximation methods aggregating the information of each variable by moments. It then discusses how the results give insights into economic applications, including two-step policy function estimation, moment-based Markov equilibrium, and aggregative games.


title: The ALMA-QUARKS survey: -- I. Survey description and data reduction

abstract: This paper presents an overview of the QUARKS survey, which stands for `Querying Underlying mechanisms of massive star formation with ALMA-Resolved gas Kinematics and Structures'. The QUARKS survey is observing 139 massive clumps covered by 156 pointings at ALMA Band 6 ($\lambda\sim$ 1.3 mm). In conjunction with data obtained from the ALMA-ATOMS survey at Band 3 ($\lambda\sim$ 3 mm), QUARKS aims to carry out an unbiased statistical investigation of massive star formation process within protoclusters down to a scale of 1000 au. This overview paper describes the observations and data reduction of the QUARKS survey, and gives a first look at an exemplar source, the mini-starburst Sgr B2(M). The wide-bandwidth (7.5 GHz) and high-angular-resolution (~0.3 arcsec) observations of the QUARKS survey allow to resolve much more compact cores than could be done by the ATOMS survey, and to detect previously unrevealed fainter filamentary structures. The spectral windows cover transitions of species including CO, SO, N$_2$D$^+$, SiO, H$_{30}\alpha$, H$_2$CO, CH$_3$CN and many other complex organic molecules, tracing gas components with different temperatures and spatial extents. QUARKS aims to deepen our understanding of several scientific topics of massive star formation, such as the mass transport within protoclusters by (hub-)filamentary structures, the existence of massive starless cores, the physical and chemical properties of dense cores within protoclusters, and the feedback from already formed high-mass young protostars.


title: Refining Perception Contracts: Case Studies in Vision-based Safe Auto-landing

abstract: Perception contracts provide a method for evaluating safety of control systems that use machine learning for perception. A perception contract is a specification for testing the ML components, and it gives a method for proving end-to-end system-level safety requirements. The feasibility of contract-based testing and assurance was established earlier in the context of straight lane keeping: a 3-dimensional system with relatively simple dynamics. This paper presents the analysis of two 6 and 12-dimensional flight control systems that use multi-stage, heterogeneous, ML-enabled perception. The paper advances methodology by introducing an algorithm for constructing data and requirement guided refinement of perception contracts (DaRePC). The resulting analysis provides testable contracts which establish the state and environment conditions under which an aircraft can safety touchdown on the runway and a drone can safely pass through a sequence of gates. It can also discover conditions (e.g., low-horizon sun) that can possibly violate the safety of the vision-based control system.


title: Quantum Locally Recoverable Codes

abstract: Classical locally recoverable codes, which permit highly efficient recovery from localized errors as well as global recovery from larger errors, provide some of the most useful codes for distributed data storage in practice. In this paper, we initiate the study of quantum locally recoverable codes (qLRCs). In the long term, like their classical counterparts, such qLRCs may be used for large-scale quantum data storage. Our results also have concrete implications for quantum LDPC codes, which are applicable to near-term quantum error-correction. After defining quantum local recoverability, we provide an explicit construction of qLRCs based on the classical LRCs of Tamo and Barg (2014), which we show have (1) a close-to-optimal rate-distance tradeoff (i.e. near the Singleton bound), (2) an efficient decoder, and (3) permit good spatial locality in a physical implementation. Although the analysis is significantly more involved than in the classical case, we obtain close-to-optimal parameters by introducing a "folded" version of our quantum Tamo-Barg (qTB) codes, which we then analyze using a combination of algebraic techniques. We furthermore present and analyze two additional constructions using more basic techniques, namely random qLRCs, and qLRCs from AEL distance amplification. Each of these constructions has some advantages, but neither achieves all 3 properties of our folded qTB codes described above. We complement these constructions with Singleton-like bounds that show our qLRC constructions achieve close-to-optimal parameters. We also apply these results to obtain Singleton-like bounds for qLDPC codes, which to the best of our knowledge are novel. We then show that even the weakest form of a stronger locality property called local correctability, which permits more robust local recovery and is achieved by certain classical codes, is impossible quantumly.


title: The Role of Public Health in the Fight Against Cancer: Awareness, Prevention, and Early Detection

abstract: Cancer, as a complex and devastating sickness, poses a great public health challenge on a global scale. Its far-attaining impact necessitates a devoted branch of medicine referred to as oncology, which makes a specialty in the prevention, diagnosis, and treatment of cancer. In this paper, we aim to offer a complete evaluation of the oncology sector, delving into its rich history, numerous forms of most cancers, diagnostic methods, and treatment alternatives. By exploring recent advances in oncology, which include precision remedy, immunotherapy, and the integration of era, we shed mild on the promising traits of the subject. However, it is miles essential to know the continual challenges that we face, such as the high costs related to remedy and the emergence of drug resistance. Despite these challenges, the final goal of oncology remains unwavering - to provide exceptional feasible outcomes for sufferers of most cancers, using both healing and palliative remedy strategies. As our knowledge of this complicated ailment continues to adapt, we must prioritize prevention and early detection and deal with disparities in access to care. By fostering collaboration and operating collectively, we can seriously improve the lives of tens of millions of individuals affected by cancer around the arena.


title: Review of AlexNet for Medical Image Classification

abstract: In recent years, the rapid development of deep learning has led to a wide range of applications in the field of medical image classification. The variants of neural network models with ever-increasing performance share some commonalities: to try to mitigate overfitting, improve generalization, avoid gradient vanishing and exploding, etc. AlexNet first utilizes the dropout technique to mitigate overfitting and the ReLU activation function to avoid gradient vanishing. Therefore, we focus our discussion on AlexNet, which has contributed greatly to the development of CNNs in 2012. After reviewing over 40 papers, including journal papers and conference papers, we give a narrative on the technical details, advantages, and application areas of AlexNet.


title: Modelling of the Electric Vehicle Charging Infrastructure as Cyber Physical Power Systems: A Review on Components, Standards, Vulnerabilities and Attacks

abstract: The increasing number of electric vehicles (EVs) has led to the growing need to establish EV charging infrastructures (EVCIs) with fast charging capabilities to reduce congestion at the EV charging stations (EVCS) and also provide alternative solutions for EV owners without residential charging facilities. The EV charging stations are broadly classified based on i) where the charging equipment is located - on-board and off-board charging stations, and ii) the type of current and power levels - AC and DC charging stations. The DC charging stations are further classified into fast and extreme fast charging stations. This article focuses mainly on several components that model the EVCI as a cyberphysical system (CPS).


title: ConeQuest: A Benchmark for Cone Segmentation on Mars

abstract: Over the years, space scientists have collected terabytes of Mars data from satellites and rovers. One important set of features identified in Mars orbital images is pitted cones, which are interpreted to be mud volcanoes believed to form in regions that were once saturated in water (i.e., a lake or ocean). Identifying pitted cones globally on Mars would be of great importance, but expert geologists are unable to sort through the massive orbital image archives to identify all examples. However, this task is well suited for computer vision. Although several computer vision datasets exist for various Mars-related tasks, there is currently no open-source dataset available for cone detection/segmentation. Furthermore, previous studies trained models using data from a single region, which limits their applicability for global detection and mapping. Motivated by this, we introduce ConeQuest, the first expert-annotated public dataset to identify cones on Mars. ConeQuest consists of >13k samples from 3 different regions of Mars. We propose two benchmark tasks using ConeQuest: (i) Spatial Generalization and (ii) Cone-size Generalization. We finetune and evaluate widely-used segmentation models on both benchmark tasks. Results indicate that cone segmentation is a challenging open problem not solved by existing segmentation models, which achieve an average IoU of 52.52% and 42.55% on in-distribution data for tasks (i) and (ii), respectively. We believe this new benchmark dataset will facilitate the development of more accurate and robust models for cone segmentation. Data and code are available at https://github.com/kerner-lab/ConeQuest.


title: Structured Estimation of Heterogeneous Time Series

abstract: How best to model structurally heterogeneous processes is a foundational question in the social, health and behavioral sciences. Recently, Fisher et al., (2022) introduced the multi-VAR approach for simultaneously estimating multiple-subject multivariate time series characterized by common and individualizing features using penalized estimation. This approach differs from many popular modeling approaches for multiple-subject time series in that qualitative and quantitative differences in a large number of individual dynamics are well-accommodated. The current work extends the multi-VAR framework to include new adaptive weighting schemes that greatly improve estimation performance. In a small set of simulation studies we compare adaptive multi-VAR with these new penalty weights to common alternative estimators in terms of path recovery and bias. Furthermore, we provide toy examples and code demonstrating the utility of multi-VAR under different heterogeneity regimes using the multivar package for R (Fisher, 2022).


title: Regularizing Parameterized Black Hole Spacetimes with Kerr Symmetries

abstract: Parameterized Kerr spacetimes allow us to test the nature of black holes in model-independent ways. Such spacetimes contain several arbitrary functions and, as a matter of practicality, one Taylor expands them about infinity and keeps only to finite orders in the expansion. In this paper, we focus on the parameterized spacetime preserving Killing symmetries of a Kerr spacetime and show that an unphysical divergence may appear in the metric if such a truncation is performed in the series expansion. To remedy this, we redefine the arbitrary functions so that the divergence disappears, at least for several known black hole solutions that can be mapped to the parameterized Kerr spacetime. We propose two restricted classes of the refined parameterized Kerr spacetime that only contain one or two arbitrary functions and yet can reproduce exactly all the example black hole spacetimes considered in this paper. The Petrov class of the parameterized Kerr spacetime is of type I while that for the restricted class with one arbitrary function remains type D. We also compute the ringdown frequencies and the shapes of black hole shadows for the parameterized spacetime and show how they deviate from Kerr. The refined black hole metrics with Kerr symmetries presented here are practically more useful than those proposed in previous literature.


title: Unramified Grothendieck-Serre for isotropic groups

abstract: The Grothendieck-Serre conjecture predicts that every generically trivial torsor under a reductive group $G$ over a regular semilocal ring $R$ is trivial. We establish this for unramified $R$ granted that $G$ is totally isotropic, that is, has a "maximally transversal" parabolic $R$-subgroup. We also use purity for the Brauer group to reduce the conjecture for unramified $R$ to simply connected $G$--a much less direct such reduction of Panin had been a step in solving the equal characteristic case of Grothendieck-Serre. We base the group-theoretic aspects of our arguments on the geometry of the stack $\mathrm{Bun}_G$, instead of the affine Grassmannian used previously, and we quickly reprove the crucial weak $\mathbb{P}^1$-invariance input: for any reductive group $H$ over a semilocal ring $A$, every $H$-torsor $\mathscr{E}$ on $\mathbb{P}^1_A$ satisfies $\mathscr{E}|_{\{t = 0\}} \simeq \mathscr{E}|_{\{t = \infty\}}$. For the geometric aspects, we develop reembedding and excision techniques for relative curves with finiteness weakened to quasi-finiteness, thus overcoming a known obstacle in mixed characteristic, and show that every generically trivial torsor over $R$ under a totally isotropic $G$ trivializes over every affine open of $\mathrm{Spec}(R) \setminus Z$ for some closed $Z$ of codimension $\ge 2$.


title: Deep Neural Network Identification of Limnonectes Species and New Class Detection Using Image Data

abstract: As is true of many complex tasks, the work of discovering, describing, and understanding the diversity of life on Earth (viz., biological systematics and taxonomy) requires many tools. Some of this work can be accomplished as it has been done in the past, but some aspects present us with challenges which traditional knowledge and tools cannot adequately resolve. One such challenge is presented by species complexes in which the morphological similarities among the group members make it difficult to reliably identify known species and detect new ones. We address this challenge by developing new tools using the principles of machine learning to resolve two specific questions related to species complexes. The first question is formulated as a classification problem in statistics and machine learning and the second question is an out-of-distribution (OOD) detection problem. We apply these tools to a species complex comprising Southeast Asian stream frogs (Limnonectes kuhlii complex) and employ a morphological character (hind limb skin texture) traditionally treated qualitatively in a quantitative and objective manner. We demonstrate that deep neural networks can successfully automate the classification of an image into a known species group for which it has been trained. We further demonstrate that the algorithm can successfully classify an image into a new class if the image does not belong to the existing classes. Additionally, we use the larger MNIST dataset to test the performance of our OOD detection algorithm. We finish our paper with some concluding remarks regarding the application of these methods to species complexes and our efforts to document true biodiversity. This paper has online supplementary materials.


title: Multi-Set Inoculation: Assessing Model Robustness Across Multiple Challenge Sets

abstract: Language models, given their black-box nature, often exhibit sensitivity to input perturbations, leading to trust issues due to hallucinations. To bolster trust, it's essential to understand these models' failure modes and devise strategies to enhance their performance. In this study, we propose a framework to study the effect of input perturbations on language models of different scales, from pre-trained models to large language models (LLMs). We use fine-tuning to train a robust model to perturbations, and we investigate whether exposure to one perturbation improves or degrades the model's performance on other perturbations. To address multi-perturbation robustness, we suggest three distinct training strategies. We also extend the framework to LLMs via a chain of thought(COT) prompting with exemplars. We instantiate our framework for the Tabular-NLI task and show that the proposed strategies train the model robust to different perturbations without losing accuracy on a given dataset.


title: Influence maximization in multilayer networks based on adaptive coupling degree

abstract: Influence Maximization(IM) aims to identify highly influential nodes to maximize influence spread in a network. Previous research on the IM problem has mainly concentrated on single-layer networks, disregarding the comprehension of the coupling structure that is inherent in multilayer networks. To solve the IM problem in multilayer networks, we first propose an independent cascade model (MIC) in a multilayer network where propagation occurs simultaneously across different layers. Consequently, a heuristic algorithm, i.e., Adaptive Coupling Degree (ACD), which selects seed nodes with high spread influence and a low degree of overlap of influence, is proposed to identify seed nodes for IM in a multilayer network. By conducting experiments based on MIC, we have demonstrated that our proposed method is superior to the baselines in terms of influence spread and time cost in 6 synthetic and 4 real-world multilayer networks.


title: Merger Response of Halo Anisotropy Properties

abstract: Anisotropy properties -- halo spin, shape, position offset, velocity offset, and orientation -- are an important family of dark matter halo properties that indicate the level of directional variation of the internal structures of haloes. These properties reflect the dynamical state of haloes, which in turn depends on the mass assembly history. In this work, we study the evolution of anisotropy properties in response to merger activity using the IllustrisTNG simulations. We find that the response trajectories of the anisotropy properties significantly deviate from secular evolution. These trajectories have the same qualitative features and timescales across a wide range of merger and host properties. We propose explanations for the behaviour of these properties and connect their evolution to the relevant stages of merger dynamics. We measure the relevant dynamical timescales. We also explore the dependence of the strength of the response on time of merger, merger ratio, and mass of the main halo. These results provide insight into the physics of halo mergers and their effects on the statistical behaviour of halo properties. This study paves the way towards a physical understanding of scaling relations, particularly to how systematics in their scatter are connected to the mass assembly histories of haloes.


title: Friedrichs extensions for a class of singular discrete linear Hamiltonian systems

abstract: This paper is concerned with the characterizations of the Friedrichs extension for a class of singular discrete linear Hamiltonian systems. The existence of recessive solutions and the existence of the Friedrichs extension are proved under some conditions. The self-adjoint boundary conditions are obtained by applying the recessive solutions and then the characterization of the Friedrichs extension is obtained in terms of boundary conditions via linear independently recessive solutions.


title: It Takes Two to Negotiate: Modeling Social Exchange in Online Multiplayer Games

abstract: Online games are dynamic environments where players interact with each other, which offers a rich setting for understanding how players negotiate their way through the game to an ultimate victory. This work studies online player interactions during the turn-based strategy game, Diplomacy. We annotated a dataset of over 10,000 chat messages for different negotiation strategies and empirically examined their importance in predicting long- and short-term game outcomes. Although negotiation strategies can be predicted reasonably accurately through the linguistic modeling of the chat messages, more is needed for predicting short-term outcomes such as trustworthiness. On the other hand, they are essential in graph-aware reinforcement learning approaches to predict long-term outcomes, such as a player's success, based on their prior negotiation history. We close with a discussion of the implications and impact of our work. The dataset is available at https://github.com/kj2013/claff-diplomacy.


title: EDMSound: Spectrogram Based Diffusion Models for Efficient and High-Quality Audio Synthesis

abstract: Audio diffusion models can synthesize a wide variety of sounds. Existing models often operate on the latent domain with cascaded phase recovery modules to reconstruct waveform. This poses challenges when generating high-fidelity audio. In this paper, we propose EDMSound, a diffusion-based generative model in spectrogram domain under the framework of elucidated diffusion models (EDM). Combining with efficient deterministic sampler, we achieved similar Fr\'echet audio distance (FAD) score as top-ranked baseline with only 10 steps and reached state-of-the-art performance with 50 steps on the DCASE2023 foley sound generation benchmark. We also revealed a potential concern regarding diffusion based audio generation models that they tend to generate samples with high perceptual similarity to the data from training data. Project page: https://agentcooper2002.github.io/EDMSound/


title: Mesonic decay constant and mass ratios and the conformal window

abstract: Two particular ratios related to mesons are proposed for the study of the conformal window in $SU(3)$ gauge theory and fundamental fermions. Lattice and other studies indicate that the lower end, $N_f^*$, is at around 7 - 13 flavors which is a wide range without a clear consensus. Here we propose the decay constant to mass ratios of mesons, $f_{PS,V} / m_V$, as a proxy since below the conformal window lattice studies have shown that they are largely $N_f$-independent while at the upper end of the conformal window they are vanishing. The drop from the non-zero constant value to zero at $N_f = 16.5$ might be indicative of $N_f^*$. We compute $f_V / m_V$ to N$^3$LO and $f_{PS} / m_V$ to NNLO order in (p)NRQCD. The results are unambiguously reliable just below $N_f = 16.5$, hence the results are expanded \'a la Banks-Zaks in $\varepsilon = 16.5 - N_f$. The convergence properties of the series and matching with the non-perturbative infinite volume, continuum and chiral extrapolated lattice results at $N_f = 10$ suggest that the perturbative results might be reliable down to $N_f = 12$. A sudden drop is observed at $N_f = 12$ and $N_f = 13$ in $f_V / m_V$ and $f_{PS} / m_V$, respectively.


title: On the Calibration of Multilingual Question Answering LLMs

abstract: Multilingual pre-trained Large Language Models (LLMs) are incredibly effective at Question Answering (QA), a core task in Natural Language Understanding, achieving high accuracies on several multilingual benchmarks. However, little is known about how well their confidences are calibrated. In this paper, we comprehensively benchmark the calibration of several multilingual LLMs (MLLMs) on a variety of QA tasks. We perform extensive experiments, spanning encoder-only, encoder-decoder, and decoder-only QA models (size varying from 110M to 7B parameters) and diverse languages, including both high- and low-resource ones. We study different dimensions of calibration in in-distribution, out-of-distribution, and cross-lingual transfer settings, and investigate strategies to improve it, including post-hoc methods and regularized fine-tuning. For decoder-only LLMs such as LlaMa2, we additionally find that in-context learning improves confidence calibration on multilingual data. We also conduct several ablation experiments to study the effect of language distances, language corpus size, and model size on calibration, and how multilingual models compare with their monolingual counterparts for diverse tasks and languages. Our experiments suggest that the multilingual QA models are poorly calibrated for languages other than English and incorporating a small set of cheaply translated multilingual samples during fine-tuning/calibration effectively enhances the calibration performance.


title: CLN-VC: Text-Free Voice Conversion Based on Fine-Grained Style Control and Contrastive Learning with Negative Samples Augmentation

abstract: Better disentanglement of speech representation is essential to improve the quality of voice conversion. Recently contrastive learning is applied to voice conversion successfully based on speaker labels. However, the performance of model will reduce in conversion between similar speakers. Hence, we propose an augmented negative sample selection to address the issue. Specifically, we create hard negative samples based on the proposed speaker fusion module to improve learning ability of speaker encoder. Furthermore, considering the fine-grain modeling of speaker style, we employ a reference encoder to extract fine-grained style and conduct the augmented contrastive learning on global style. The experimental results show that the proposed method outperforms previous work in voice conversion tasks.


title: Managing Biotechnology and Healthcare Innovation Challenges and Opportunities for Startups and Small Companies

abstract: The biotechnology industry poses challenges and possibilities for startups and small businesses. It is characterized by high charges and complex policies, making it difficult for such agencies to set up themselves. However, it additionally offers avenues for innovation and increase. This paper delves into powerful techniques that can be a resource in managing biotechnology innovation, which includes partnerships, highbrow assets improvement, virtual technologies, customer engagement, and government investment. These strategies are important for fulfillment in an industry that is constantly evolving. By embracing agility and area of interest focus, startups and small companies can successfully compete in this dynamic discipline.


title: GUGA-based MRCI approach with Core-Valence Separation Approximation (CVS) for the calculation of the Core-Excited States of molecules

abstract: We develop and demonstrate how to use the GUGA-based MRCISD with Core-Valence Separation approximation (CVS) to compute the core-excited states. Firstly, perform a normal SCF or valence MCSCF calculation to optimize the molecular orbitals. Secondly, rotate the optimized target core orbitals and append to the active space, form an extended CVS active space, and perform a CVS-MCSCF calculation for core-excited states. Finally, construct the CVS-MRCI expansion space, and perform a CVS-MRCI calculation to optimize the CI coefficients based on the variational method. The CVS approximation with GUGA-based methods can be implemented by flexible truncation of the Distinct Row Table (DRT). Eliminating the valence-excited configurations from the CVS-MRCI expansion space can prevent variational collapse in the Davidson iteration diagonalization. The accuracy of the CVS-MRCI scheme was investigated for excitation energies and compared with that of the CVS-MCSCF method. The results show that CVS-MRCI is capable of reproducing well-matched vertical core excitation energies that are consistent with experiments, by combining large basis sets and a rational reference space. The calculation results also highlight the fact that the dynamic correlation between electrons makes an undeniable contribution in core-excited states.


title: CP-EB: Talking Face Generation with Controllable Pose and Eye Blinking Embedding

abstract: This paper proposes a talking face generation method named "CP-EB" that takes an audio signal as input and a person image as reference, to synthesize a photo-realistic people talking video with head poses controlled by a short video clip and proper eye blinking embedding. It's noted that not only the head pose but also eye blinking are both important aspects for deep fake detection. The implicit control of poses by video has already achieved by the state-of-art work. According to recent research, eye blinking has weak correlation with input audio which means eye blinks extraction from audio and generation are possible. Hence, we propose a GAN-based architecture to extract eye blink feature from input audio and reference video respectively and employ contrastive training between them, then embed it into the concatenated features of identity and poses to generate talking face images. Experimental results show that the proposed method can generate photo-realistic talking face with synchronous lips motions, natural head poses and blinking eyes.


title: High-Precision Fruit Localization Using Active Laser-Camera Scanning: Robust Laser Line Extraction for 2D-3D Transformation

abstract: Recent advancements in deep learning-based approaches have led to remarkable progress in fruit detection, enabling robust fruit identification in complex environments. However, much less progress has been made on fruit 3D localization, which is equally crucial for robotic harvesting. Complex fruit shape/orientation, fruit clustering, varying lighting conditions, and occlusions by leaves and branches have greatly restricted existing sensors from achieving accurate fruit localization in the natural orchard environment. In this paper, we report on the design of a novel localization technique, called Active Laser-Camera Scanning (ALACS), to achieve accurate and robust fruit 3D localization. The ALACS hardware setup comprises a red line laser, an RGB color camera, a linear motion slide, and an external RGB-D camera. Leveraging the principles of dynamic-targeting laser-triangulation, ALACS enables precise transformation of the projected 2D laser line from the surface of apples to the 3D positions. To facilitate laser pattern acquisitions, a Laser Line Extraction (LLE) method is proposed for robust and high-precision feature extraction on apples. Comprehensive evaluations of LLE demonstrated its ability to extract precise patterns under variable lighting and occlusion conditions. The ALACS system achieved average apple localization accuracies of 6.9 11.2 mm at distances ranging from 1.0 m to 1.6 m, compared to 21.5 mm by a commercial RealSense RGB-D camera, in an indoor experiment. Orchard evaluations demonstrated that ALACS has achieved a 95% fruit detachment rate versus a 71% rate by the RealSense camera. By overcoming the challenges of apple 3D localization, this research contributes to the advancement of robotic fruit harvesting technology.


title: Refined Coreset Selection: Towards Minimal Coreset Size under Model Performance Constraints

abstract: Coreset selection is powerful in reducing computational costs and accelerating data processing for deep learning algorithms. It strives to identify a small subset from large-scale data, so that training only on the subset practically performs on par with full data. Practitioners regularly desire to identify the smallest possible coreset in realistic scenes while maintaining comparable model performance, to minimize costs and maximize acceleration. Motivated by this desideratum, for the first time, we pose the problem of refined coreset selection, in which the minimal coreset size under model performance constraints is explored. Moreover, to address this problem, we propose an innovative method, which maintains optimization priority order over the model performance and coreset size, and efficiently optimizes them in the coreset selection procedure. Theoretically, we provide the convergence guarantee of the proposed method. Empirically, extensive experiments confirm its superiority compared with previous strategies, often yielding better model performance with smaller coreset sizes.


title: A note on orientation-reversing distance one surgeries on non-null-homologous knots

abstract: We show that there are no distance one surgeries on non-null-homologous knots in $M$ that yield $-M$ ($M$ with opposite orientation) if $M$ is a 3-manifold obtained by a Dehn surgery on a knot $K$ in $S^{3}$, such that the order of its first homology is divisible by $9$ but is not divisible by $27$. As an application, we show several knots, including the $(2,9)$ torus knot, do not have chirally cosmetic bandings. This simplifies a proof of the result first proven by Yang; the $(2,k)$ torus knot $(k>1)$ has a chirally cosmetic banding if and only if $k=5$.


title: Federated Learning for Sparse Principal Component Analysis

abstract: In the rapidly evolving realm of machine learning, algorithm effectiveness often faces limitations due to data quality and availability. Traditional approaches grapple with data sharing due to legal and privacy concerns. The federated learning framework addresses this challenge. Federated learning is a decentralized approach where model training occurs on client sides, preserving privacy by keeping data localized. Instead of sending raw data to a central server, only model updates are exchanged, enhancing data security. We apply this framework to Sparse Principal Component Analysis (SPCA) in this work. SPCA aims to attain sparse component loadings while maximizing data variance for improved interpretability. Beside the L1 norm regularization term in conventional SPCA, we add a smoothing function to facilitate gradient-based optimization methods. Moreover, in order to improve computational efficiency, we introduce a least squares approximation to original SPCA. This enables analytic solutions on the optimization processes, leading to substantial computational improvements. Within the federated framework, we formulate SPCA as a consensus optimization problem, which can be solved using the Alternating Direction Method of Multipliers (ADMM). Our extensive experiments involve both IID and non-IID random features across various data owners. Results on synthetic and public datasets affirm the efficacy of our federated SPCA approach.


title: The Future of Sustainability in Germany: Areas for Improvement and Innovation

abstract: This paper reviews the literature on biodegradable waste management in Germany, a multifaceted endeavor that reflects its commitment to sustainability and environmental responsibility. It examines the processes and benefits of separate collection, recycling, and eco-friendly utilization of biodegradable materials, which produce valuable byproducts such as compost, digestate, and biogas. These byproducts serve as organic fertilizers, peat substitutes, and renewable energy sources, contributing to ecological preservation and economic prudence. The paper also discusses the global implications of biodegradable waste management, such as preventing methane emissions from landfills, a major source of greenhouse gas, and reusing organic matter and essential nutrients. Moreover, the paper explores how biodegradable waste management reduces waste volume, facilitates waste sorting and incineration, and sets a global example for addressing climate change and working toward a sustainable future. The paper highlights the importance of a comprehensive and holistic approach to sustainability that encompasses waste management, renewable energy, transportation, agriculture, waste reduction, and urban development.


title: First Sagittarius A* Event Horizon Telescope Results. II. EHT and Multi-wavelength Observations, Data Processing, and Calibration

abstract: We present Event Horizon Telescope (EHT) 1.3 mm measurements of the radio source located at the position of the supermassive black hole Sagittarius A* (Sgr A*), collected during the 2017 April 5--11 campaign. The observations were carried out with eight facilities at six locations across the globe. Novel calibration methods are employed to account for Sgr A*'s flux variability. The majority of the 1.3 mm emission arises from horizon scales, where intrinsic structural source variability is detected on timescales of minutes to hours. The effects of interstellar scattering on the image and its variability are found to be subdominant to intrinsic source structure. The calibrated visibility amplitudes, particularly the locations of the visibility minima, are broadly consistent with a blurred ring with a diameter of $\sim$50 $\mu$as, as determined in later works in this series. Contemporaneous multi-wavelength monitoring of Sgr A* was performed at 22, 43, and 86 GHz and at near infrared and X-ray wavelengths. Several X-ray flares from Sgr A* are detected by Chandra, one at low significance jointly with Swift on 2017 April 7 and the other at higher significance jointly with NuSTAR on 2017 April 11. The brighter April 11 flare is not observed simultaneously by the EHT but is followed by a significant increase in millimeter flux variability immediately after the X-ray outburst, indicating a likely connection in the emission physics near the event horizon. We compare Sgr A*'s broadband flux during the EHT campaign to its historical spectral energy distribution and find both the quiescent and flare emission are consistent with its long-term behaviour.


title: First Sagittarius A* Event Horizon Telescope Results. I. The Shadow of the Supermassive Black Hole in the Center of the Milky Way

abstract: We present the first Event Horizon Telescope (EHT) observations of Sagittarius A* (Sgr A$^*$), the Galactic center source associated with a supermassive black hole. These observations were conducted in 2017 using a global interferometric array of eight telescopes operating at a wavelength of $\lambda=1.3\,{\rm mm}$. The EHT data resolve a compact emission region with intrahour variability. A variety of imaging and modeling analyses all support an image that is dominated by a bright, thick ring with a diameter of $51.8 \pm 2.3$\,\uas (68\% credible interval). The ring has modest azimuthal brightness asymmetry and a comparatively dim interior. Using a large suite of numerical simulations, we demonstrate that the EHT images of Sgr A$^*$ are consistent with the expected appearance of a Kerr black hole with mass ${\sim}4 \times 10^6\,{\rm M}_\odot$, which is inferred to exist at this location based on previous infrared observations of individual stellar orbits as well as maser proper motion studies. Our model comparisons disfavor scenarios where the black hole is viewed at high inclination ($i > 50^\circ$), as well as non-spinning black holes and those with retrograde accretion disks. Our results provide direct evidence for the presence of a supermassive black hole at the center of the Milky Way galaxy, and for the first time we connect the predictions from dynamical measurements of stellar orbits on scales of $10^3-10^5$ gravitational radii to event horizon-scale images and variability. Furthermore, a comparison with the EHT results for the supermassive black hole M87$^*$ shows consistency with the predictions of general relativity spanning over three orders of magnitude in central mass.


title: Velocity Gradient and Stellar Polarization: Magnetic Field Tomography towards the L1688 Cloud

abstract: Magnetic fields are a defining yet enigmatic aspect of the interstellar medium (ISM), with their three-dimensional mapping posing a substantial challenge. In this study, we harness the innovative Velocity Gradient Technique (VGT), underpinned by magnetohydrodynamic (MHD) turbulence theories, to elucidate the magnetic field structure by applying it to the atomic neutral hydrogen (HI) emission line and the molecular tracer $^{12}$CO. We construct the tomography of the magnetic field in the low-mass star-forming region L1688, utilizing two approaches: (1) VGT-HI combined with the Galactic rotational curve, and (2) stellar polarization paired with precise star parallax measurements. Our analysis reveals that the magnetic field orientations deduced from stellar polarization undergo a distinct directional change in the vicinity of L1688, providing evidence that the misalignment between VGT-HI and stellar polarization stems from the influence of the molecular cloud's magnetic field on the polarization of starlight. When comparing VGT-$^{12}$CO to stellar polarization and Planck polarization data, we observe that VGT-$^{12}$CO effectively reconciles the misalignment noted with VGT-HI, showing statistical alignment with Planck polarization measurements. This indicates that VGT-$^{12}$CO could be integrated with VGT-HI, offering vital insights into the magnetic fields of molecular clouds, thereby enhancing the accuracy of our 3D magnetic field reconstructions.


title: Enhancing Recommender System Performance by Histogram Equalization

abstract: Recommender system has been researched for decades with millions of different versions of algorithms created in the industry. In spite of the huge amount of work spent on the field, there are many basic questions to be answered in the field. The most fundamental question to be answered is the accuracy problem, and in recent years, fairness becomes the new buzz word for researchers. In this paper, we borrow an idea from image processing, namely, histogram equalization. As a preprocessing step to recommender system algorithms, histogram equalization could enhance both the accuracy and fairness metrics of the recommender system algorithms. In the experiment section, we prove that our new approach could improve vanilla algorithms by a large margin in accuracy metric and stay competitive on fairness metrics.


title: Hadamard products and BPS networks

abstract: We study examples of fourth-order Picard-Fuchs operators that are Hadamard products of two second-order Picard-Fuchs operators. Each second-order Picard-Fuchs operator is associated with a family of elliptic curves, and the Hadamard product computes period integrals on the fibred product of the two elliptic surfaces. We construct 3-cycles on this geometry as the union of 2-cycles in the fibre over contours on the base. We then use the special Lagrangian condition to constrain the contours on the base. This leads to a construction that is reminiscent of spectral networks and exponential networks that have previously appeared in string theory literature.


title: Moonrise: Novel and Cartoon Writing System Built Upon Blockchain Systems

abstract: Writing novels or drawing cartoons is a prolonged and interesting process that needs imagination and a lot of rethinking and rewriting. Blockchain systems has a very strong feature that tampering is not allowed for the system. In order to keep the revision history of novel writing / cartoon drawing, we apply blockchain systems such as HyperLedger to the problem and create a novel writer / cartoon illustrator system that is capable of keeping record of what has been written and greatly enhancing the writing performance of the author.


title: Safer-Instruct: Aligning Language Models with Automated Preference Data

abstract: Reinforcement learning from human feedback (RLHF) is a vital strategy for enhancing model capability in language models. However, annotating preference data for RLHF is a resource-intensive and creativity-demanding process, while existing automatic generation methods face limitations in data diversity and quality. In response, we present Safer-Instruct, a novel pipeline for automatically constructing large-scale preference data. Our approach leverages reversed instruction tuning, instruction induction, and expert model evaluation to efficiently generate high-quality preference data without human annotators. To verify the effectiveness of Safer-Instruct, we apply the pipeline to construct a safety preference dataset as a case study. Finetuning an Alpaca model on this synthetic dataset not only demonstrates improved harmlessness but also outperforms models fine-tuned on human-annotated safety preference data, all the while maintaining a competitive edge in downstream tasks. Importantly, our Safer-Instruct framework is versatile and can be applied to generate preference data across various domains, extending its utility beyond safety preferences. It addresses the challenges in preference data acquisition and advances the development of more capable and responsible AI systems. For dataset and code implementation, see https://github.com/uscnlp-lime/safer-instruct


title: System-Wide Emergency Policy for Transitioning from Main to Secondary Fuel

abstract: Inspired by the challenges of running the Israel's power system -- with its increasing integration of renewables, significant load uncertainty, and primary reliance on natural gas -- we investigate an emergency scenario where there's a need to transition temporarily to a pricier secondary fuel until the emergency resolves. Our objective is to devise tools that can assist power system operators in making decisions during such critical periods. We frame this challenge as a Markov Decision Process (MDP) optimization, considering uncertainties like potential failures of dual-fuel generators during the transition, operator attentiveness under stress, available but finite amount of primary fuel (linepack available in the natural gas part of the system), power forecast (net demand after renewable production), and the cost implications of unavoidable load shedding. By solving the MDP in a simplified context, we identify viable policies through simulations of multiple parametrized Markov Processes (MPs). We verify our methodology using a realistic open-source model replicating Israel's power-gas infrastructure and outline next steps for refining and adapting this approach.


title: An Eye on Clinical BERT: Investigating Language Model Generalization for Diabetic Eye Disease Phenotyping

abstract: Diabetic eye disease is a major cause of blindness worldwide. The ability to monitor relevant clinical trajectories and detect lapses in care is critical to managing the disease and preventing blindness. Alas, much of the information necessary to support these goals is found only in the free text of the electronic medical record. To fill this information gap, we introduce a system for extracting evidence from clinical text of 19 clinical concepts related to diabetic eye disease and inferring relevant attributes for each. In developing this ophthalmology phenotyping system, we are also afforded a unique opportunity to evaluate the effectiveness of clinical language models at adapting to new clinical domains. Across multiple training paradigms, we find that BERT language models pretrained on out-of-distribution clinical data offer no significant improvement over BERT language models pretrained on non-clinical data for our domain. Our study tempers recent claims that language models pretrained on clinical data are necessary for clinical NLP tasks and highlights the importance of not treating clinical language data as a single homogeneous domain.


title: The black widow pulsar J1641+8049 in the optical, radio and X-rays

abstract: PSR J1641+8049 is a 2 ms black widow pulsar with the 2.2 h orbital period detected in the radio and $\gamma$-rays. We performed new phase-resolved multi-band photometry of PSR J1641+8049 using the OSIRIS instrument at the Gran Telescopio Canarias. The obtained data were analysed together with the new radio-timing observations from the Canadian Hydrogen Intensity Mapping Experiment (CHIME), the X-ray data from the Spectrum-RG/eROSITA all-sky survey, and all available optical photometric observations. An updated timing solution based on CHIME data is presented, which accounts for secular and periodic modulations in pulse dispersion. The system parameters obtained through the light curve analysis, including the distance to the source 4.6-4.8 kpc and the orbital inclination 56-59 deg, are found to be consistent with previous studies. However, the optical flux of the source at the maximum brightness phase faded by a factor of $\sim$2 as compared to previous observations. Nevertheless, the face of the J1641+8049 companion remains one of the most heated (8000-9500 K) by a pulsar among the known black widow pulsars. We also report a new estimation on the pulsar proper motion of $\approx$2 mas yr$^{-1}$, which yields a spin down luminosity of $\approx$4.87$\times 10^{34}$ ergs s$^{-1}$ and a corresponding heating efficiency of the companion by the pulsar of 0.3-0.7. The pulsar was not detected in X-rays implying its X-ray-luminosity was <3 $\times$ 10$^{31}$ erg s$^{-1}$ at the date of observations.


title: Low Complexity High Speed Deep Neural Network Augmented Wireless Channel Estimation

abstract: The channel estimation (CE) in wireless receivers is one of the most critical and computationally complex signal processing operations. Recently, various works have shown that the deep learning (DL) based CE outperforms conventional minimum mean square error (MMSE) based CE, and it is hardware-friendly. However, DL-based CE has higher complexity and latency than popularly used least square (LS) based CE. In this work, we propose a novel low complexity high-speed Deep Neural Network-Augmented Least Square (LC-LSDNN) algorithm for IEEE 802.11p wireless physical layer and efficiently implement it on Zynq system on chip (ZSoC). The novelty of the LC-LSDNN is to use different DNNs for real and imaginary values of received complex symbols. This helps reduce the size of DL by 59% and optimize the critical path, allowing it to operate at 60% higher clock frequency. We also explore three different architectures for MMSE-based CE. We show that LC-LSDNN significantly outperforms MMSE and state-of-the-art DL-based CE for a wide range of signal-to-noise ratios (SNR) and different wireless channels. Also, it is computationally efficient, with around 50% lower resources than existing DL-based CE.


title: Enabling CMF Estimation in Data-Constrained Scenarios: A Semantic-Encoding Knowledge Mining Model

abstract: Precise estimation of Crash Modification Factors (CMFs) is central to evaluating the effectiveness of various road safety treatments and prioritizing infrastructure investment accordingly. While customized study for each countermeasure scenario is desired, the conventional CMF estimation approaches rely heavily on the availability of crash data at given sites. This not only makes the estimation costly, but the results are also less transferable, since the intrinsic similarities between different safety countermeasure scenarios are not fully explored. Aiming to fill this gap, this study introduces a novel knowledge-mining framework for CMF prediction. This framework delves into the connections of existing countermeasures and reduces the reliance of CMF estimation on crash data availability and manual data collection. Specifically, it draws inspiration from human comprehension processes and introduces advanced Natural Language Processing (NLP) techniques to extract intricate variations and patterns from existing CMF knowledge. It effectively encodes unstructured countermeasure scenarios into machine-readable representations and models the complex relationships between scenarios and CMF values. This new data-driven framework provides a cost-effective and adaptable solution that complements the case-specific approaches for CMF estimation, which is particularly beneficial when availability of crash data or time imposes constraints. Experimental validation using real-world CMF Clearinghouse data demonstrates the effectiveness of this new approach, which shows significant accuracy improvements compared to baseline methods. This approach provides insights into new possibilities of harnessing accumulated transportation knowledge in various applications.


title: On Doubly Robust Estimation with Nonignorable Missing Data Using Instrumental Variables

abstract: Suppose we are interested in the mean of an outcome that is subject to nonignorable nonresponse. This paper develops new semiparametric estimation methods with instrumental variables which affect nonresponse, but not the outcome. The proposed estimators remain consistent and asymptotically normal even under partial model misspecifications for two variation independent nuisance components. We evaluate the performance of the proposed estimators via a simulation study, and apply them in adjusting for missing data induced by HIV testing refusal in the evaluation of HIV seroprevalence in Mochudi, Botswana, using interviewer experience as an instrumental variable.


title: Routing to the Expert: Efficient Reward-guided Ensemble of Large Language Models

abstract: The complementary potential of Large Language Models (LLM) assumes off-the-shelf LLMs have heterogeneous expertise in a wide range of domains and tasks so that an ensemble of LLMs can achieve consistently better performance. Existing ensemble methods for LLMs mainly focus on reward model ranking of outputs, leading to significant computation overhead. To combat this issue, we revisit the complementary potential of LLMs and further elaborate it by mining latent expertise with off-the-shelf reward models. We propose Zooter, a reward-guided routing method distilling rewards on training queries to train a routing function, which can precisely distribute each query to the LLM with expertise about it. We also integrate a tag-based label enhancement to mitigate noise from uncertainty when using rewards as silver supervision. Zooter shows computation efficiency in inference as it introduces only a minor computation overhead of a routing function compared with reward model ranking methods. We evaluate Zooter on a comprehensive benchmark collection with 26 subsets on different domains and tasks. Zooter outperforms the best single model on average and ranks first on 44% of tasks, even surpassing multiple reward model ranking methods.


title: Discovery of Diffuse Radio Source in Abell 1060

abstract: Non-thermal components in the intra-cluster medium (ICM) such as turbulence, magnetic field, and cosmic rays imprint the past and current energetic activities of jets from active galactic neuclie (AGN) of member galaxies as well as disturbance caused by galaxy cluster mergers. Meter- and centimeter-radio observations of synchrotron radiation allow us to diagnose the nonthermal component. Here we report on our discovery of an unidentified diffuse radio source, named the Flying Fox, near the center of the Abell 1060 field. The Flying Fox has an elongated ring-like structure and a central bar shape, but there is no obvious host galaxy. The average spectral index of the Flying Fox is -1.4, which is steeper than those for radio sources seen at meter wavelength. We discussed the possibilities of radio lobes, phoenixes, radio halos and relics, and Odd Radio Circle (ORC). In conclusion, the Flying Fox is not clearly explained by known radio sources.


title: Near 6 GHz Sezawa Mode Surface Acoustic Wave Resonators using AlScN on SiC

abstract: Surface Acoustic Wave (SAW) devices featuring Aluminum Scandium Nitride (AlScN) on a 4H-Silicon Carbide (SiC) substrate, offer a unique blend of high sound velocity, low thermal resistance, substantial piezoelectric response, simplified fabrication, as well as suitability for high-temperature and harsh environment operation. This study presents high-frequency SAW resonators employing AlScN thin films on SiC substrates, utilizing the second SAW mode (referred to as the Sezawa mode). The resonators achieve remarkable performance, boasting a K2 value of 5.5% and a maximum Q-factor (Qmax) of 1048 at 4.7 GHz, outperforming previous benchmarks. Additionally, a SAW resonator with a 960 nm wavelength attains 5.9 GHz frequency with record K2 (4.0%) and Qmax (887). Our study underscores the potential of the AlScN on SiC platform for advanced radio-frequency applications.


title: Attribute Diversity Determines the Systematicity Gap in VQA

abstract: The degree to which neural networks can generalize to new combinations of familiar concepts, and the conditions under which they are able to do so, has long been an open question. In this work, we study the systematicity gap in visual question answering: the performance difference between reasoning on previously seen and unseen combinations of object attributes. To test, we introduce a novel diagnostic dataset, CLEVR-HOPE. We find that while increased quantity of training data does not reduce the systematicity gap, increased training data diversity of the attributes in the unseen combination does. In all, our experiments suggest that the more distinct attribute type combinations are seen during training, the more systematic we can expect the resulting model to be.


title: Synthesis and Arithmetic of Single Qutrit Circuits

abstract: In this paper we study single qutrit quantum circuits consisting of words over the Clifford+ $\mathcal{D}$ gate set, where $\mathcal{D}$ consists of cyclotomic gates of the form $\text{diag}(\pm\xi^{a},\pm\xi^{b},\pm\xi^{c}),$ where $\xi$ is a primitive $9$-th root of unity and $a,b,c$ are integers. We characterize classes of qutrit unit vectors $z$ with entries in $\mathbb{Z}[\xi, \frac{1}{\chi}]$ based on the possibility of reducing their smallest denominator exponent (sde) with respect to $\chi := 1 - \xi,$ by acting an appropriate gate in Clifford+$\mathcal{D}$. We do this by studying the notion of `derivatives mod $3$' of an arbitrary element of $\mathbb{Z}[\xi]$ and using it to study the smallest denominator exponent of $HDz$ where $H$ is the qutrit Hadamard gate and $D \in \mathcal{D}.$ In addition, we reduce the problem of finding all unit vectors of a given sde to that of finding integral solutions of a positive definite quadratic form along with some additional constraints. As a consequence we prove that the Clifford + $\mathcal{D}$ gates naturally arise as gates with sde $0$ and $3$ in the group $U(3,\mathbb{Z}[\xi, \frac{1}{\chi}])$ of $3 \times 3$ unitaries with entries in $\mathbb{Z}[\xi, \frac{1}{\chi}]$


title: First Sagittarius A* Event Horizon Telescope Results. IV. Variability, Morphology, and Black Hole Mass

abstract: In this paper we quantify the temporal variability and image morphology of the horizon-scale emission from Sgr A*, as observed by the EHT in 2017 April at a wavelength of 1.3 mm. We find that the Sgr A* data exhibit variability that exceeds what can be explained by the uncertainties in the data or by the effects of interstellar scattering. The magnitude of this variability can be a substantial fraction of the correlated flux density, reaching $\sim$100\% on some baselines. Through an exploration of simple geometric source models, we demonstrate that ring-like morphologies provide better fits to the Sgr A* data than do other morphologies with comparable complexity. We develop two strategies for fitting static geometric ring models to the time-variable Sgr A* data; one strategy fits models to short segments of data over which the source is static and averages these independent fits, while the other fits models to the full dataset using a parametric model for the structural variability power spectrum around the average source structure. Both geometric modeling and image-domain feature extraction techniques determine the ring diameter to be $51.8 \pm 2.3$ $\mu$as (68\% credible intervals), with the ring thickness constrained to have an FWHM between $\sim$30\% and 50\% of the ring diameter. To bring the diameter measurements to a common physical scale, we calibrate them using synthetic data generated from GRMHD simulations. This calibration constrains the angular size of the gravitational radius to be $4.8_{-0.7}^{+1.4}$ \mathrm{\mu as}, which we combine with an independent distance measurement from maser parallaxes to determine the mass of Sgr A* to be $4.0_{-0.6}^{+1.1} \times 10^6$ M$_{\odot}$.


title: Artificial General Intelligence, Existential Risk, and Human Risk Perception

abstract: Artificial general intelligence (AGI) does not yet exist, but given the pace of technological development in artificial intelligence, it is projected to reach human-level intelligence within roughly the next two decades. After that, many experts expect it to far surpass human intelligence and to do so rapidly. The prospect of superintelligent AGI poses an existential risk to humans because there is no reliable method for ensuring that AGI goals stay aligned with human goals. Drawing on publicly available forecaster and opinion data, the author examines how experts and non-experts perceive risk from AGI. The findings indicate that the perceived risk of a world catastrophe or extinction from AGI is greater than for other existential risks. The increase in perceived risk over the last year is also steeper for AGI than for other existential threats (e.g., nuclear war or human-caused climate change). That AGI is a pressing existential risk is something on which experts and non-experts agree, but the basis for such agreement currently remains obscure.


title: Definable quotients in d-minimal structures

abstract: We consider d-minimal expansions of ordered fields. We demonstrate the existence of definable quotients of definable sets by definable equivalence relations when several technical conditions are satisfied. These conditions are satisfied when there is a definable proper action of a definable group $G$ on a locally closed definable subset $X$ of $F^n$, where $F$ is the universe.


title: A guide to the QCD light-cone sum rule for $b$-quark decays

abstract: We overview the current status and future perspectives of the QCD-based method of light-cone sum rules. The two main versions of these sum rules, using light-meson and $B$-meson distribution amplitudes are introduced and the most important applications of the method are discussed. We also outline open problems and future perspectives of this method.


title: Quantum synchronization via Active-Passive-Decomposition configuration: An open quantum system study

abstract: In this paper, we study the synchronization of dissipative quantum harmonic oscillators in the framework of quantum open system via the Active-Passive Decomposition (APD) configuration. We show that two or more quantum systems may be synchronized when the quantum systems of interest are embedded in dissipative environments and influenced by a common classical system. Such a classical system is typically termed as a controller, which (1) can drive quantum systems to cross different regimes (e.g., from periodic to chaotic motions) and (2) constructs the so-called Active-Passive Decomposition configuration such that all the quantum objects under consideration may be synchronized. The main findings of this paper is that we demonstrate that the complete synchronizations measured by the standard quantum deviation may be achieved for both stable regimes (quantum limit circles) and unstable regimes (quantum chaotic motions). As an example, we numerically show in an optomechanical setup that the complete synchronization can be realized in quantum mechanical resonators.


title: Debate Helps Supervise Unreliable Experts

abstract: As AI systems are used to answer more difficult questions and potentially help create new knowledge, judging the truthfulness of their outputs becomes more difficult and more important. How can we supervise unreliable experts, which have access to the truth but may not accurately report it, to give answers that are systematically true and don't just superficially seem true, when the supervisor can't tell the difference between the two on their own? In this work, we show that debate between two unreliable experts can help a non-expert judge more reliably identify the truth. We collect a dataset of human-written debates on hard reading comprehension questions where the judge has not read the source passage, only ever seeing expert arguments and short quotes selectively revealed by 'expert' debaters who have access to the passage. In our debates, one expert argues for the correct answer, and the other for an incorrect answer. Comparing debate to a baseline we call consultancy, where a single expert argues for only one answer which is correct half of the time, we find that debate performs significantly better, with 84% judge accuracy compared to consultancy's 74%. Debates are also more efficient, being 68% of the length of consultancies. By comparing human to AI debaters, we find evidence that with more skilled (in this case, human) debaters, the performance of debate goes up but the performance of consultancy goes down. Our error analysis also supports this trend, with 46% of errors in human debate attributable to mistakes by the honest debater (which should go away with increased skill); whereas 52% of errors in human consultancy are due to debaters obfuscating the relevant evidence from the judge (which should become worse with increased skill). Overall, these results show that debate is a promising approach for supervising increasingly capable but potentially unreliable AI systems.


title: Impact of Nap on Performance in Different Working Memory Tasks Using EEG

abstract: Electroencephalography (EEG) has been widely used to study the relationship between naps and working memory, yet the effects of naps on distinct working memory tasks remain unclear. Here, participants performed word-pair and visuospatial working memory tasks pre- and post-nap sessions. We found marked differences in accuracy and reaction time between tasks performed pre- and post-nap. In order to identify the impact of naps on performance in each working memory task, we employed clustering to classify participants as high- or low-performers. Analysis of sleep architecture revealed significant variations in sleep onset latency and rapid eye movement (REM) proportion. In addition, the two groups exhibited prominent differences, especially in the delta power of the Non-REM 3 stage linked to memory. Our results emphasize the interplay between nap-related neural activity and working memory, underlining specific EEG markers associated with cognitive performance.


title: Can Large Language Models Follow Concept Annotation Guidelines? A Case Study on Scientific and Financial Domains

abstract: Although large language models (LLMs) exhibit remarkable capacity to leverage in-context demonstrations, it is still unclear to what extent they can learn new concepts or facts from ground-truth labels. To address this question, we examine the capacity of instruction-tuned LLMs to follow in-context concept guidelines for sentence labeling tasks. We design guidelines that present different types of factual and counterfactual concept definitions, which are used as prompts for zero-shot sentence classification tasks. Our results show that although concept definitions consistently help in task performance, only the larger models (with 70B parameters or more) have limited ability to work under counterfactual contexts. Importantly, only proprietary models such as GPT-3.5 and GPT-4 can recognize nonsensical guidelines, which we hypothesize is due to more sophisticated alignment methods. Finally, we find that Falcon-180B-chat is outperformed by Llama-2-70B-chat is most cases, which indicates that careful fine-tuning is more effective than increasing model scale. Altogether, our simple evaluation method reveals significant gaps in concept understanding between the most capable open-source language models and the leading proprietary APIs.


title: Evaluating Robustness of Dialogue Summarization Models in the Presence of Naturally Occurring Variations

abstract: Dialogue summarization task involves summarizing long conversations while preserving the most salient information. Real-life dialogues often involve naturally occurring variations (e.g., repetitions, hesitations) and existing dialogue summarization models suffer from performance drop on such conversations. In this study, we systematically investigate the impact of such variations on state-of-the-art dialogue summarization models using publicly available datasets. To simulate real-life variations, we introduce two types of perturbations: utterance-level perturbations that modify individual utterances with errors and language variations, and dialogue-level perturbations that add non-informative exchanges (e.g., repetitions, greetings). We conduct our analysis along three dimensions of robustness: consistency, saliency, and faithfulness, which capture different aspects of the summarization model's performance. We find that both fine-tuned and instruction-tuned models are affected by input variations, with the latter being more susceptible, particularly to dialogue-level perturbations. We also validate our findings via human evaluation. Finally, we investigate if the robustness of fine-tuned models can be improved by training them with a fraction of perturbed data and observe that this approach is insufficient to address robustness challenges with current models and thus warrants a more thorough investigation to identify better solutions. Overall, our work highlights robustness challenges in dialogue summarization and provides insights for future research.


title: Aligned: A Platform-based Process for Alignment

abstract: We are introducing Aligned, a platform for global governance and alignment of frontier models, and eventually superintelligence. While previous efforts at the major AI labs have attempted to gather inputs for alignment, these are often conducted behind closed doors. We aim to set the foundation for a more trustworthy, public-facing approach to safety: a constitutional committee framework. Initial tests with 680 participants result in a 30-guideline constitution with 93% overall support. We show the platform naturally scales, instilling confidence and enjoyment from the community. We invite other AI labs and teams to plug and play into the Aligned ecosystem.


title: K-BMPC: Derivative-based Koopman Bilinear Model Predictive Control for Tractor-Trailer Trajectory Tracking with Unknown Parameters

abstract: Nonlinear dynamics bring difficulties to controller design for control-affine systems such as tractor-trailer vehicles, especially when the parameters in the dynamics are unknown. To address this constraint, we propose a derivative-based lifting function construction method, show that the corresponding infinite dimensional Koopman bilinear model over the lifting function is equivalent to the original control-affine system. Further, we analyze the propagation and bounds of state prediction errors caused by the truncation in derivative order. The identified finite dimensional Koopman bilinear model would serve as predictive model in the next step. Koopman Bilinear Model Predictive control (K-BMPC) is proposed to solve the trajectory tracking problem. We linearize the bilinear model around the estimation of the lifted state and control input. Then the bilinear Model Predictive Control problem is approximated by a quadratic programming problem. Further, the estimation is updated at each iteration until the convergence is reached. Moreover, we implement our algorithm on a tractor-trailer system, taking into account the longitudinal and side slip effects. The open-loop simulation shows the proposed Koopman bilinear model captures the dynamics with unknown parameters and has good prediction performance. Closed-loop tracking results show the proposed K-BMPC exhibits elevated tracking precision with the commendable computational efficiency. The experimental results demonstrate the feasibility of K-BMPC.


title: Joint User Pairing and Beamforming Design of Multi-STAR-RISs-Aided NOMA in the Indoor Environment via Multi-Agent Reinforcement Learning

abstract: The development of 6G/B5G wireless networks, which have requirements that go beyond current 5G networks, is gaining interest from academia and industry. However, to increase 6G/B5G network quality, conventional cellular networks that rely on terrestrial base stations are constrained geographically and economically. Meanwhile, NOMA allows multiple users to share the same resources, which improves the spectral efficiency of the system and has the advantage of supporting a larger number of users. Additionally, by intelligently manipulating the phase and amplitude of both the reflected and transmitted signals, STAR-RISs can achieve improved coverage, increased spectral efficiency, and enhanced communication reliability. However, STAR-RISs must simultaneously optimize the amplitude and phase shift corresponding to reflection and transmission, which makes the existing terrestrial networks more complicated and is considered a major challenging issue. Motivated by the above, we study the joint user pairing for NOMA and beamforming design of Multi-STAR-RISs in an indoor environment. Then, we formulate the optimization problem with the objective of maximizing the total throughput of MUs by jointly optimizing the decoding order, user pairing, active beamforming, and passive beamforming. However, the formulated problem is a MINLP. To address this challenge, we first introduce the decoding order for NOMA networks. Next, we decompose the original problem into two subproblems, namely: 1) MU pairing and 2) Beamforming optimization under the optimal decoding order. For the first subproblem, we employ correlation-based K-means clustering to solve the user pairing problem. Then, to jointly deal with beamforming vector optimizations, we propose MAPPO, which can make quick decisions in the given environment owing to its low complexity.


title: Fermionic steering is not nonlocal in the background of dilaton black hole

abstract: We study the redistribution of the fermionic steering and the relation among fermionic Bell nonlocality, steering, and entanglement in the background of the Garfinkle-Horowitz-Strominger dilaton black hole. We analyze the meaning of the fermionic steering in terms of the Bell inequality in curved spacetime. We find that the fermionic steering, which is previously found to survive in the extreme dilaton black hole, cannot be considered to be nonlocal. We also find that the dilaton gravity can redistribute the fermionic steering, but cannot redistribute Bell nonlocality, which means that the physically inaccessible steering is also not nonlocal. Unlike the inaccessible entanglement, the inaccessible steering may increase non-monotonically with the dilaton. Furthermore, we obtain some monogamy relations between the fermionic steering and entanglement in dilaton spacetime. In addition, we show the difference between the fermionic and bosonic steering in curved spacetime.


title: A collage of results on the divisibility and indivisibility of class numbers of quadratic fields

abstract: The investigation of the ideal class group $Cl_K$ of an algebraic number field $K$ is one of the key subjects of inquiry in algebraic number theory since it encodes a lot of arithmetic information about K. There is a considerable amount of research on many topics linked to quadratic field class groups notably intriguing aspect is the divisibility of the class numbers. This article discusses a few recent results on the divisibility of class numbers and the Izuka conjecture. We also discuss the quantitative aspect of the Izuka conjecture.


title: PLUG: Leveraging Pivot Language in Cross-Lingual Instruction Tuning

abstract: Instruction tuning has remarkably advanced large language models (LLMs) in understanding and responding to diverse human instructions. Despite the success in high-resource languages, its application in lower-resource ones faces challenges due to the imbalanced foundational abilities of LLMs across different languages, stemming from the uneven language distribution in their pre-training data. To tackle this issue, we propose pivot language guided generation (PLUG), an approach that utilizes a high-resource language, primarily English, as the pivot to enhance instruction tuning in lower-resource languages. It trains the model to first process instructions in the pivot language, and then produce responses in the target language. To evaluate our approach, we introduce a benchmark, X-AlpacaEval, of instructions in 4 languages (Chinese, Korean, Italian, and Spanish), each annotated by professional translators. Our approach demonstrates a significant improvement in the instruction-following abilities of LLMs by 29% on average, compared to directly responding in the target language alone. Further experiments validate the versatility of our approach by employing alternative pivot languages beyond English to assist languages where LLMs exhibit lower proficiency. Our code and data are available at https://github.com/ytyz1307zzh/PLUG.


title: Ab Initio Construction of Poincar\'e and AdS Particle

abstract: We study the construction of a manifestly covariant worldline action from a coadjoint orbit. A coadjoint orbit is a submanifold in the dual vector space of the Lie algebra and generated by coadjoint actions. Since a coadjoint orbit is a symplectic space, we derive the worldline particle action from the symplectic two-form. One subtlety in formulating worldline particle actions from coadjoint orbits is choosing the coordinate system that sufficiently illustrates physical properties of the particles. We introduce Hamiltonian constraints by the defining conditions of the isometry. This allows us to write a manifestly covariant worldline action. We demonstrate our method to the both massive and massless particles in Minkowski and AdS spacetime.


title: Four-body bound states in momentum space: the Yakubovsky approach without two-body $t-$matrices

abstract: This study presents a solution to the Yakubovsky equations for four-body bound states in momentum space, bypassing the common use of two-body $t-$matrices. Typically, such solutions are dependent on the fully-off-shell two-body $t-$matrices, which are obtained from the Lippmann-Schwinger integral equation for two-body subsystem energies controlled by the second and third Jacobi momenta. Instead, we use a version of the Yakubovsky equations that doesn't require $t-$matrices, facilitating the direct use of two-body interactions. This approach streamlines the programming and reduces computational time. Numerically, we found that this direct approach to the Yakubovsky equations, using 2B interactions, produces four-body binding energy results consistent with those obtained from the conventional $t-$matrix dependent Yakubovsky equations, for both separable (Yamaguchi and Gaussian) and non-separable (Malfliet-Tjon) interactions.


title: Schur indices for $\mathcal{N}=4$ super-Yang-Mills with more general gauge groups

abstract: We study the unflavored Schur indices in the $\mathcal{N}=4$ super-Yang-Mills theory for the $B_n,C_n,D_n, G_2$ gauge groups. We explore two methods, namely the character expansion method and the Fermi gas method, to efficiently compute the $q$-series expansion of the Schur indices to some high orders. Using the available data and the modular properties, we are able to fix the exact formulas for the general gauge groups up to some high ranks and discover some interesting new features. We also identify some empirical modular anomaly equations, but unlike the case of $A_n$ groups, they are quite complicated and not sufficiently useful to fix exact formulas for gauge groups of arbitrary rank.


title: Stochastic Geometry-based Trajectory Design for Multi-Purpose UAVs: Package and Data Delivery

abstract: With the advancements achieved in drones' flexibility, low cost, and high efficiency, they obtain huge application opportunities in various industries, such as aerial delivery and future communication networks. However, the increasing transportation needs and expansion of network capacity demands for UAVs will cause aerial traffic conflicts in the future. To address this issue, in this paper, we explore the idea of multi-purpose UAVs, which act as aerial wireless communication data relays and means of aerial transportation simultaneously to deliver data and packages at the same time. While UAVs deliver the packages from warehouses to residential areas, we design their trajectories which enable them to collect data from multiple Internet of Things (IoT) clusters and forward the collected data to terrestrial base stations (TBSs). To select the serving nearby IoT clusters, UAVs rank them based on their priorities and distances. From the perspectives of data and package delivery, respectively, we propose two algorithms that design the optimal UAVs trajectory to maximize the transmitted data or minimize the round trip time. Specifically, we use tools from stochastic geometry to model the locations of IoT clusters and TBSs. Given the nature of random locations, the proposed algorithm applies to general cases. Our numerical results show that multi-purpose UAVs are practical and have great potential to enhance the energy/time-efficiency of future networks.


title: Scalable Federated Learning for Clients with Different Input Image Sizes and Numbers of Output Categories

abstract: Federated learning is a privacy-preserving training method which consists of training from a plurality of clients but without sharing their confidential data. However, previous work on federated learning do not explore suitable neural network architectures for clients with different input images sizes and different numbers of output categories. In this paper, we propose an effective federated learning method named ScalableFL, where the depths and widths of the local models for each client are adjusted according to the clients' input image size and the numbers of output categories. In addition, we provide a new bound for the generalization gap of federated learning. In particular, this bound helps to explain the effectiveness of our scalable neural network approach. We demonstrate the effectiveness of ScalableFL in several heterogeneous client settings for both image classification and object detection tasks.


title: Shuffle series

abstract: We apply operad theory to enumerative combinatorics in order to count the number of shuffles between series-parallel posets and chains. We work with three types of shuffles, two of them noncommutative, for example a local deck-divider shuffle $A$ between $P$ and $Q$ is a shuffle of the posets in which, on every maximal chain $m\subset A$, the minimum and maximum elements belong to $P$ and no two consecutive points of $Q$ appear consecutively on $m$. The number of local deck-divider shuffles of $P$ and $Q$ differ from the number of local deck-divider shuffles of $Q$ and $P$. The generating functions whose $n$ coefficient counts shuffles between a poset $P$ and $1<2<\cdots<n$ are called shuffle series. We explain how shuffle series are isomorphic to order series as algebras over the operad of series parallel posets. The weak and strict order polynomials are well known in the literature. At the level of generating series, with the theory of sets with a negative number of elements, we introduce a third order series and prove a theorem in the style of Stanley's Reciprocity Theorem compatible with the structure of algebras over the operad of finite posets. We conclude by describing the relationship of our work with the combinatorial properties of the operadic tensor product of free trees operads.


title: Decomposing Uncertainty for Large Language Models through Input Clarification Ensembling

abstract: Uncertainty decomposition refers to the task of decomposing the total uncertainty of a predictive model into aleatoric (data) uncertainty, resulting from inherent randomness in the data-generating process, and epistemic (model) uncertainty, resulting from missing information in the model's training data. In large language models (LLMs) specifically, identifying sources of uncertainty is an important step toward improving reliability, trustworthiness, and interpretability, but remains an important open research question. In this paper, we introduce an uncertainty decomposition framework for LLMs, called input clarification ensembling, which can be applied to any pre-trained LLM. Our approach generates a set of clarifications for the input, feeds them into an LLM, and ensembles the corresponding predictions. We show that, when aleatoric uncertainty arises from ambiguity or under-specification in LLM inputs, this approach makes it possible to factor an (unclarified) LLM's predictions into separate aleatoric and epistemic terms, using a decomposition similar to the one employed by Bayesian neural networks. Empirical evaluations demonstrate that input clarification ensembling provides accurate and reliable uncertainty quantification on several language processing tasks. Code and data are available at https://github.com/UCSB-NLP-Chang/llm_uncertainty.


title: Think-in-Memory: Recalling and Post-thinking Enable LLMs with Long-Term Memory

abstract: Memory-augmented Large Language Models (LLMs) have demonstrated remarkable performance in long-term human-machine interactions, which basically relies on iterative recalling and reasoning of history to generate high-quality responses. However, such repeated recall-reason steps easily produce biased thoughts, \textit{i.e.}, inconsistent reasoning results when recalling the same history for different questions. On the contrary, humans can keep thoughts in the memory and recall them without repeated reasoning. Motivated by this human capability, we propose a novel memory mechanism called TiM (Think-in-Memory) that enables LLMs to maintain an evolved memory for storing historical thoughts along the conversation stream. The TiM framework consists of two crucial stages: (1) before generating a response, a LLM agent recalls relevant thoughts from memory, and (2) after generating a response, the LLM agent post-thinks and incorporates both historical and new thoughts to update the memory. Thus, TiM can eliminate the issue of repeated reasoning by saving the post-thinking thoughts as the history. Besides, we formulate the basic principles to organize the thoughts in memory based on the well-established operations, (\textit{i.e.}, insert, forget, and merge operations), allowing for dynamic updates and evolution of the thoughts. Furthermore, we introduce Locality-Sensitive Hashing into TiM to achieve efficient retrieval for the long-term conversations. We conduct qualitative and quantitative experiments on real-world and simulated dialogues covering a wide range of topics, demonstrating that equipping existing LLMs with TiM significantly enhances their performance in generating responses for long-term interactions.