title: Efficient End-to-End Visual Document Understanding with Rationale Distillation

abstract: Understanding visually situated language requires interpreting complex layouts of textual and visual elements. Pre-processing tools, such as optical character recognition (OCR), can map document image inputs to textual tokens, then large language models (LLMs) can reason over text. However, such methods have high computational and engineering complexity. Can small pretrained image-to-text models accurately understand visual documents through similar recognition and reasoning steps instead? We propose Rationale Distillation (RD), which incorporates the outputs of OCR tools, LLMs, and larger multimodal models as intermediate "rationales", and trains a small student model to predict both rationales and answers. On three visual document understanding benchmarks representing infographics, scanned documents, and figures, our Pix2Struct (282M parameters) student model finetuned with RD outperforms the base model by 4-5% absolute accuracy with only 1% higher computational cost.


title: Digital Socrates: Evaluating LLMs through Explanation Critiques

abstract: While LLMs can provide reasoned explanations along with their answers, the nature and quality of those explanations are still poorly understood. In response, our goal is to define a detailed way of characterizing the explanation capabilities of modern models and to create a nuanced, interpretable explanation evaluation tool that can generate such characterizations automatically, without relying on expensive API calls or human annotations. Our approach is to (a) define the new task of explanation critiquing - identifying and categorizing any main flaw in an explanation and providing suggestions to address the flaw, (b) create a sizeable, human-verified dataset for this task, and (c) train an open-source, automatic critique model (called Digital Socrates) using this data. Through quantitative and qualitative analysis, we demonstrate how Digital Socrates is useful for revealing insights about student models by examining their reasoning chains, and how it can provide high-quality, nuanced, automatic evaluation of those model explanations for the first time. Digital Socrates thus fills an important gap in evaluation tools for understanding and improving the explanation behavior of models.


title: Comprehensive Evaluation and Insights into the Use of Deep Neural Networks to Detect and Quantify Lymphoma Lesions in PET/CT Images

abstract: This study performs comprehensive evaluation of four neural network architectures (UNet, SegResNet, DynUNet, and SwinUNETR) for lymphoma lesion segmentation from PET/CT images. These networks were trained, validated, and tested on a diverse, multi-institutional dataset of 611 cases. Internal testing (88 cases; total metabolic tumor volume (TMTV) range [0.52, 2300] ml) showed SegResNet as the top performer with a median Dice similarity coefficient (DSC) of 0.76 and median false positive volume (FPV) of 4.55 ml; all networks had a median false negative volume (FNV) of 0 ml. On the unseen external test set (145 cases with TMTV range: [0.10, 2480] ml), SegResNet achieved the best median DSC of 0.68 and FPV of 21.46 ml, while UNet had the best FNV of 0.41 ml. We assessed reproducibility of six lesion measures, calculated their prediction errors, and examined DSC performance in relation to these lesion measures, offering insights into segmentation accuracy and clinical relevance. Additionally, we introduced three lesion detection criteria, addressing the clinical need for identifying lesions, counting them, and segmenting based on metabolic characteristics. We also performed expert intra-observer variability analysis revealing the challenges in segmenting ``easy'' vs. ``hard'' cases, to assist in the development of more resilient segmentation algorithms. Finally, we performed inter-observer agreement assessment underscoring the importance of a standardized ground truth segmentation protocol involving multiple expert annotators. Code is available at: https://github.com/microsoft/lymphoma-segmentation-dnn


title: On Retrieval Augmentation and the Limitations of Language Model Training

abstract: Augmenting a language model (LM) with $k$-nearest neighbors ($k$NN) retrieval on its training data alone can decrease its perplexity, though the underlying reasons for this remain elusive. In this work, we rule out one previously posited possibility -- the "softmax bottleneck." We then create a new dataset to evaluate LM generalization ability in the setting where training data contains additional information that is not causally relevant. This task is challenging even for GPT-3.5 Turbo. We show that, for both GPT-2 and Mistral 7B, $k$NN retrieval augmentation consistently improves performance in this setting. Finally, to make $k$NN retrieval more accessible, we propose using a multi-layer perceptron model that maps datastore keys to values as a drop-in replacement for traditional retrieval. This reduces storage costs by over 25x.


title: Warp and flare of the old Galactic disc as traced by the red clump stars

abstract: Our study aims to investigate the outer disc structure of the Milky Way galaxy using the red clump (RC) stars. We analysed the distribution of the largest sample of RC stars to date, homogeneously covering the entire Galactic plane in the range of $40^\circ \le \ell \le 340^\circ$ and $-10^\circ \le b \le +10^\circ$. This sample allows us to model the RC star distribution in the Galactic disc to better constrain the properties of the flare and warp of the Galaxy. Our results show that the scale length of the old stellar disc weakly depends on azimuth, with an average value of $1.95 \pm0.26$ kpc. On the other hand, a significant disc flaring is detected, where the scale height of the disc increases from 0.38 kpc in the solar neighbourhood to $\sim 2.2$ kpc at R $\approx 15$ kpc. The flare exhibits a slight asymmetry, with $\sim 1$ kpc more scale height below the Galactic plane as compared to the Northern flare. We also confirm the warping of the outer disc, which can be modelled with $Z_w = (0.0057 \pm 0.0050)~ [R-(7358 \pm 368) (pc)]^{1.40 \pm 0.09} \sin(\phi - (-2^\circ.03 \pm 0^\circ .18))$. Our analysis reveals a noticeable north-south asymmetry in the warp, with a greater amplitude observed in the southern direction compared to the northern. Comparing our findings with younger tracers from the literature, we observe an age dependency of both the flare and warp. An increase in flare strength with age suggests the secular evolution of the disc as the preferred mechanism for forming the flare. The increase of the maximum warp amplitude with age indicates that the warp dynamics could be the possible cause of the variation in the warp properties with age.


title: Optical polarisation study of Galactic Open clusters

abstract: Dust is a ubiquitous component in our Galaxy. It accounts for only $1\%$ mass of the ISM but still is an essential part of the Galaxy. It affects our view of the Galaxy by obscuring the starlight at shorter wavelengths and re-emitting in longer wavelengths. Studying the dust distribution in the Galaxy at longer wavelengths may cause discrepancies due to distance ambiguity caused by unknown Galactic potential. However, another aspect of dust, i.e., the polarisation of the background starlight, when combined with distance information, will help to give direct observational evidence of the number of dust clouds encountered in the line of sight. We observed 15 open clusters distributed at increasing distances in three lines of sight using two Indian national facilities. The measured polarisation results used to scrutinize the dust distribution and orientation of the local plane of sky magnetic fields towards selected directions. The analysis of the stars observed towards the distant cluster King 8 cluster shows two foreground layers at a distance of $\sim 500$ pc and $\sim$ 3500 pc. Similar analysis towards different clusters also results in multiple dust layers.


title: Simulating Opinion Dynamics with Networks of LLM-based Agents

abstract: Accurately simulating human opinion dynamics is crucial for understanding a variety of societal phenomena, including polarization and the spread of misinformation. However, the agent-based models (ABMs) commonly used for such simulations often over-simplify human behavior. We propose a new approach to simulating opinion dynamics based on populations of Large Language Models (LLMs). Our findings reveal a strong inherent bias in LLM agents towards producing accurate information, leading simulated agents to consensus in line with scientific reality. This bias limits their utility for understanding resistance to consensus views on issues like climate change. After inducing confirmation bias through prompt engineering, however, we observed opinion fragmentation in line with existing agent-based modeling and opinion dynamics research. These insights highlight the promise and limitations of LLM agents in this domain and suggest a path forward: refining LLMs with real-world discourse to better simulate the evolution of human beliefs.


title: Take One Step at a Time to Know Incremental Utility of Demonstration: An Analysis on Reranking for Few-Shot In-Context Learning

abstract: In-Context Learning (ICL) is an emergent capability of Large Language Models (LLMs). Only a few demonstrations enable LLMs to be used as blackbox for new tasks. Previous studies have shown that using LLMs' outputs as labels is effective in training models to select demonstrations. Such a label is expected to estimate utility of a demonstration in ICL; however, it has not been well understood how different labeling strategies affect results on target tasks. This paper presents an analysis on different utility functions by focusing on LLMs' output probability given ground-truth output, and task-specific reward given LLMs' prediction. Unlike the previous work, we introduce a novel labeling method, incremental utility, which estimates how much incremental knowledge is brought into the LLMs by a demonstration. We conduct experiments with instruction-tuned LLMs on binary/multi-class classification, segmentation, and translation across Arabic, English, Finnish, Japanese, and Spanish. Our results show that (1) the probability is effective when the probability values are distributed across the whole value range (on the classification tasks), and (2) the downstream metric is more robust when nuanced reward values are provided with long outputs (on the segmentation and translation tasks). We then show that the proposed incremental utility further helps ICL by contrasting how the LLMs perform with and without the demonstrations.


title: GAIA: Delving into Gradient-based Attribution Abnormality for Out-of-distribution Detection

abstract: Detecting out-of-distribution (OOD) examples is crucial to guarantee the reliability and safety of deep neural networks in real-world settings. In this paper, we offer an innovative perspective on quantifying the disparities between in-distribution (ID) and OOD data -- analyzing the uncertainty that arises when models attempt to explain their predictive decisions. This perspective is motivated by our observation that gradient-based attribution methods encounter challenges in assigning feature importance to OOD data, thereby yielding divergent explanation patterns. Consequently, we investigate how attribution gradients lead to uncertain explanation outcomes and introduce two forms of abnormalities for OOD detection: the zero-deflation abnormality and the channel-wise average abnormality. We then propose GAIA, a simple and effective approach that incorporates Gradient Abnormality Inspection and Aggregation. The effectiveness of GAIA is validated on both commonly utilized (CIFAR) and large-scale (ImageNet-1k) benchmarks. Specifically, GAIA reduces the average FPR95 by 23.10% on CIFAR10 and by 45.41% on CIFAR100 compared to advanced post-hoc methods.


title: Production of dileptons in ultra-peripheral heavy ion collisions with two-photon processes

abstract: We study the photoproduction process of dileptons in heavy ion collision at Relativistic Heavy Ion Collider (RHIC) and Large Hadron Collider (LHC) energys. The equivalent photon approximation, which equates the electromagnetic field of high-energy charged particles to the virtual photon flux, is used to calculate the processes of dileptons production. The numerical results demonstrate that the experimental study of dileptons in ultra-peripheral collisions is feasible at RHIC and LHC energies.


title: Homography Initialization and Dynamic Weighting Algorithm Based on a Downward-Looking Camera and IMU

abstract: In recent years, the technology in visual-inertial odometry (VIO) has matured considerably and has been widely used in many applications. However, we still encounter challenges when applying VIO to a micro air vehicle (MAV) equipped with a downward-looking camera. Specifically, VIO cannot compute the correct initialization results during take-off and the cumulative drift is large when the MAV is flying in the air. To overcome these problems, we propose a homographybased initialization method, which utilizes the fact that the features detected by the downward-looking camera during take-off are approximately on the same plane. Then we introduce the prior normal vector and motion field to make states more accurate. In addition, to deal with the cumulative drift, a strategy for dynamically weighting visual residuals is proposed. Finally, we evaluate our method on the collected real-world datasets. The results demonstrate that our system can be successfully initialized no matter how the MAV takes off and the positioning errors are also greatly improved.


title: Apoptosis classification using attention based spatio temporal graph convolution neural network

abstract: Accurate classification of apoptosis plays an important role in cell biology research. There are many state-of-the-art approaches which use deep CNNs to perform the apoptosis classification but these approaches do not account for the cell interaction. Our paper proposes the Attention Graph spatio-temporal graph convolutional network to classify the cell death based on the target cells in the video. This method considers the interaction of multiple target cells at each time stamp. We model the whole video sequence as a set of graphs and classify the target cell in the video as dead or alive. Our method encounters both spatial and temporal relationships.


title: AI Recommendation System for Enhanced Customer Experience: A Novel Image-to-Text Method

abstract: Existing fashion recommendation systems encounter difficulties in using visual data for accurate and personalized recommendations. This research describes an innovative end-to-end pipeline that uses artificial intelligence to provide fine-grained visual interpretation for fashion recommendations. When customers upload images of desired products or outfits, the system automatically generates meaningful descriptions emphasizing stylistic elements. These captions guide retrieval from a global fashion product catalogue to offer similar alternatives that fit the visual characteristics of the original image. On a dataset of over 100,000 categorized fashion photos, the pipeline was trained and evaluated. The F1-score for the object detection model was 0.97, exhibiting exact fashion object recognition capabilities optimized for recommendation. This visually aware system represents a key advancement in customer engagement through personalized fashion recommendations


title: DECDM: Document Enhancement using Cycle-Consistent Diffusion Models

abstract: The performance of optical character recognition (OCR) heavily relies on document image quality, which is crucial for automatic document processing and document intelligence. However, most existing document enhancement methods require supervised data pairs, which raises concerns about data separation and privacy protection, and makes it challenging to adapt these methods to new domain pairs. To address these issues, we propose DECDM, an end-to-end document-level image translation method inspired by recent advances in diffusion models. Our method overcomes the limitations of paired training by independently training the source (noisy input) and target (clean output) models, making it possible to apply domain-specific diffusion models to other pairs. DECDM trains on one dataset at a time, eliminating the need to scan both datasets concurrently, and effectively preserving data privacy from the source or target domain. We also introduce simple data augmentation strategies to improve character-glyph conservation during translation. We compare DECDM with state-of-the-art methods on multiple synthetic data and benchmark datasets, such as document denoising and {\color{black}shadow} removal, and demonstrate the superiority of performance quantitatively and qualitatively.


title: Plug-In RIS: A Novel Approach to Fully Passive Reconfigurable Intelligent Surfaces

abstract: This paper presents a promising design concept for reconfigurable intelligent surfaces (RISs), named plug-in RIS, wherein the RIS is plugged into an appropriate position in the environment, adjusted once according to the location of both base station and blocked region, and operates with fixed beams to enhance the system performance. The plug-in RIS is a novel system design, streamlining RIS-assisted millimeter-wave (mmWave) communication without requiring decoupling two parts of the end-to-end channel, traditional control signal transmission, and online RIS configuration. In plug-in RIS-aided transmission, the transmitter efficiently activates specific regions of the divided large RIS by employing hybrid beamforming techniques, each with predetermined phase adjustments tailored to reflect signals to desired user locations. This user-centric approach enhances connectivity and overall user experience by dynamically illuminating the targeted user based on location. By introducing plug-in RIS's theoretical framework, design principles, and performance evaluation, we demonstrate its potential to revolutionize mmWave communications for the limited channel state information (CSI) scenarios. Simulation results illustrate that plug-in RIS provides power/cost-efficient solutions to overcome blockage in the mmWave communication system and a striking convergence in average bit error rate and achievable rate performance with traditional full CSI-enabled RIS solutions.


title: Mitigating Biases for Instruction-following Language Models via Bias Neurons Elimination

abstract: Instruction-following language models often show undesirable biases. These undesirable biases may be accelerated in the real-world usage of language models, where a wide range of instructions is used through zero-shot example prompting. To solve this problem, we first define the bias neuron, which significantly affects biased outputs, and prove its existence empirically. Furthermore, we propose a novel and practical bias mitigation method, CRISPR, to eliminate bias neurons of language models in instruction-following settings. CRISPR automatically determines biased outputs and categorizes neurons that affect the biased outputs as bias neurons using an explainability method. Experimental results demonstrate the effectiveness of our method in mitigating biases under zero-shot instruction-following settings without losing the model's task performance and existing knowledge. The experimental results reveal the generalizability of our method as it shows robustness under various instructions and datasets. Surprisingly, our method can mitigate the bias in language models by eliminating only a few neurons (at least three).


title: SynDiffix: More accurate synthetic structured data

abstract: This paper introduces SynDiffix, a mechanism for generating statistically accurate, anonymous synthetic data for structured data. Recent open source and commercial systems use Generative Adversarial Networks or Transformed Auto Encoders to synthesize data, and achieve anonymity through overfitting-avoidance. By contrast, SynDiffix exploits traditional mechanisms of aggregation, noise addition, and suppression among others. Compared to CTGAN, ML models generated from SynDiffix are twice as accurate, marginal and column pairs data quality is one to two orders of magnitude more accurate, and execution time is two orders of magnitude faster. Compared to the best commercial product we measured (MostlyAI), ML model accuracy is comparable, marginal and pairs accuracy is 5 to 10 times better, and execution time is an order of magnitude faster. Similar to the other approaches, SynDiffix anonymization is very strong. This paper describes SynDiffix and compares its performance with other popular open source and commercial systems.


title: Differential Rotation of the Solar Chromosphere using multidecadal Ca II K Spectroheliograms

abstract: The study of the differential rotation in the chromosphere of the Sun is of significant importance as it provides valuable insights into the rotational behaviour of the solar atmosphere at higher altitudes and the coupling mechanism between the various layers of the solar atmosphere. In this work, we employed the image correlation technique, explicitly focusing on plages, intending to estimate the chromospheric differential rotation. For this purpose, we have utilized Ca II K spectroheliograms (1907-2007) from the Kodaikanal Solar Observatory (KoSO), recently calibrated with a better technique to ensure accuracy. Our analysis indicates that plages in the chromosphere exhibit faster rotation and a smaller latitudinal gradient when compared to the rotation rate obtained through sunspot tracking. Furthermore, we investigate the temporal analysis of the chromospheric differential rotation parameters across various solar cycles.


title: Decoding Susceptibility: Modeling Misbelief to Misinformation Through a Computational Approach

abstract: Susceptibility to misinformation describes the degree of belief in unverifiable claims, a latent aspect of individuals' mental processes that is not observable. Existing susceptibility studies heavily rely on self-reported beliefs, which can be subject to bias, expensive to collect, and challenging to scale for downstream applications. To address these limitations, in this work, we propose a computational approach to model users' latent susceptibility levels. As shown in previous research, susceptibility is influenced by various factors (e.g., demographic factors, political ideology), and directly influences people's reposting behavior on social media. To represent the underlying mental process, our susceptibility modeling incorporates these factors as inputs, guided by the supervision of people's sharing behavior. Using COVID-19 as a testbed domain, our experiments demonstrate a significant alignment between the susceptibility scores estimated by our computational modeling and human judgments, confirming the effectiveness of this latent modeling approach. Furthermore, we apply our model to annotate susceptibility scores on a large-scale dataset and analyze the relationships between susceptibility with various factors. Our analysis reveals that political leanings and psychological factors exhibit varying degrees of association with susceptibility to COVID-19 misinformation.


title: On the Pauli Spectrum of QAC0

abstract: The circuit class $\mathsf{QAC}^0$ was introduced by Moore (1999) as a model for constant depth quantum circuits where the gate set includes many-qubit Toffoli gates. Proving lower bounds against such circuits is a longstanding challenge in quantum circuit complexity; in particular, showing that polynomial-size $\mathsf{QAC}^0$ cannot compute the parity function has remained an open question for over 20 years. In this work, we identify a notion of the Pauli spectrum of $\mathsf{QAC}^0$ circuits, which can be viewed as the quantum analogue of the Fourier spectrum of classical $\mathsf{AC}^0$ circuits. We conjecture that the Pauli spectrum of $\mathsf{QAC}^0$ circuits satisfies low-degree concentration, in analogy to the famous Linial, Nisan, Mansour theorem on the low-degree Fourier concentration of $\mathsf{AC}^0$ circuits. If true, this conjecture immediately implies that polynomial-size $\mathsf{QAC}^0$ circuits cannot compute parity. We prove this conjecture for the class of depth-$d$, polynomial-size $\mathsf{QAC}^0$ circuits with at most $n^{O(1/d)}$ auxiliary qubits. We obtain new circuit lower bounds and learning results as applications: this class of circuits cannot correctly compute - the $n$-bit parity function on more than $(\frac{1}{2} + 2^{-\Omega(n^{1/d})})$-fraction of inputs, and - the $n$-bit majority function on more than $(\frac{1}{2} + O(n^{-1/4}))$-fraction of inputs. Additionally we show that this class of $\mathsf{QAC}^0$ circuits with limited auxiliary qubits can be learned with quasipolynomial sample complexity, giving the first learning result for $\mathsf{QAC}^0$ circuits. More broadly, our results add evidence that "Pauli-analytic" techniques can be a powerful tool in studying quantum circuits.


title: Online Continual Knowledge Learning for Language Models

abstract: Large Language Models (LLMs) serve as repositories of extensive world knowledge, enabling them to perform tasks such as question-answering and fact-checking. However, this knowledge can become obsolete as global contexts change. In this paper, we introduce a novel problem in the realm of continual learning: Online Continual Knowledge Learning (OCKL). This problem formulation aims to manage the dynamic nature of world knowledge in LMs under real-time constraints. We propose a new benchmark and evaluation metric designed to measure both the rate of new knowledge acquisition and the retention of previously learned knowledge. Our empirical evaluation, conducted using a variety of state-of-the-art methods, establishes robust base-lines for OCKL. Our results reveal that existing continual learning approaches are unfortunately insufficient for tackling the unique challenges posed by OCKL. We identify key factors that influence the trade-off between knowledge acquisition and retention, thereby advancing our understanding of how to train LMs in a continually evolving environment.


title: Reconciling Radio Tomographic Imaging with Phaseless Inverse Scattering

abstract: Radio Tomographic Imaging (RTI) is a phaseless imaging approach that can provide shape reconstruction and localization of objects using received signal strength (RSS) measurements. RSS measurements can be straightforwardly obtained from wireless networks such as Wi-Fi and therefore RTI has been extensively researched and accepted as a good indoor RF imaging technique. However, RTI is formulated on empirical models using an assumption of light-of-sight (LOS) propagation that does not account for intricate scattering effects. There are two main objectives of this work. The first objective is to reconcile and compare the empirical RTI model with formal inverse scattering approaches to better understand why RTI is an effective RF imaging technique. The second objective is to obtain straightforward enhancements to RTI, based on inverse scattering, to enhance its performance. The resulting enhancements can provide reconstructions of the shape and also material properties of the objects that can aid image classification. We also provide numerical and experimental results to compare RTI with the enhanced RTI for indoor imaging applications using low-cost 2.4 GHz Wi-Fi transceivers. These results show that the enhanced RTI can outperform RTI while having similar computational complexity to RTI.


title: Towards Accurate Quantum Chemical Calculations on Noisy Quantum Computers

abstract: Variational quantum eigensolver (VQE) is a hybrid quantum-classical algorithm designed for noisy intermediate-scale quantum (NISQ) computers. It is promising for quantum chemical calculations (QCC) because it can calculate the ground-state energy of a target molecule. Although VQE has a potential to achieve a higher accuracy than classical approximation methods in QCC, it is challenging to achieve it on current NISQ computers due to the significant impact of noises. Density matrix embedding theory (DMET) is a well-known technique to divide a molecule into multiple fragments, which is available to mitigate the noise impact on VQE. However, our preliminary evaluation shows that the naive combination of DMET and VQE does not outperform a gold standard classical method. In this work, we present three approaches to mitigate the noise impact for the DMET+VQE combination. (1) The size of quantum circuits used by VQE is decreased by reducing the number of bath orbitals which represent interactions between multiple fragments in DMET. (2) Reduced density matrices (RDMs), which are used to calculate a molecular energy in DMET, are calculated accurately based on expectation values obtained by executing quantum circuits using a noise-less quantum computer simulator. (3) The parameters of a quantum circuit optimized by VQE are refined with mathematical post-processing. The evaluation using a noisy quantum computer simulator shows that our approaches significantly improve the accuracy of the DMET+VQE combination. Moreover, we demonstrate that on a real NISQ device, the DMET+VQE combination applying our three approaches achieves a higher accuracy than the gold standard classical method.


title: Evaluating In-Context Learning of Libraries for Code Generation

abstract: Contemporary Large Language Models (LLMs) exhibit a high degree of code generation and comprehension capability. A particularly promising area is their ability to interpret code modules from unfamiliar libraries for solving user-instructed tasks. Recent work has shown that large proprietary LLMs can learn novel library usage in-context from demonstrations. These results raise several open questions: whether demonstrations of library usage is required, whether smaller (and more open) models also possess such capabilities, etc. In this work, we take a broader approach by systematically evaluating a diverse array of LLMs across three scenarios reflecting varying levels of domain specialization to understand their abilities and limitations in generating code based on libraries defined in-context. Our results show that even smaller open-source LLMs like Llama-2 and StarCoder demonstrate an adept understanding of novel code libraries based on specification presented in-context. Our findings further reveal that LLMs exhibit a surprisingly high proficiency in learning novel library modules even when provided with just natural language descriptions or raw code implementations of the functions, which are often cheaper to obtain than demonstrations. Overall, our results pave the way for harnessing LLMs in more adaptable and dynamic coding environments.


title: Holographic torus correlators in $\text{AdS}_3$ gravity coupled to scalar field

abstract: This paper investigates holographic torus correlators of generic operators at conformal infinity and a finite cutoff within AdS$_3$ gravity coupled with a free scalar field. Using a near-boundary analysis and solving the gravitational boundary value problem, we solve Einstein's equation and calculate mixed correlators for massless and massive coupled scalar fields. The conformal ward identity on the torus has been reproduced holographically, which can be regarded as a consistency check. Further, recurrence relations for a specific class of higher-point correlators are derived, validating AdS$_3$/CFT$_2$ with non-trivial boundary topology. While the two-point scalar correlator is accurately computed on the thermal AdS$_3$ saddle, the higher-point correlators associated with scalar and stress tensor operators are explored.


title: Multi-objective Quantum Annealing approach for solving flexible job shop scheduling in manufacturing

abstract: Flexible Job Shop Scheduling (FJSSP) is a complex optimization problem crucial for real-world process scheduling in manufacturing. Efficiently solving such problems is vital for maintaining competitiveness. This paper introduces Quantum Annealing-based solving algorithm (QASA) to address FJSSP, utilizing quantum annealing and classical techniques. QASA optimizes multi-criterial FJSSP considering makespan, total workload, and job priority concurrently. It employs Hamiltonian formulation with Lagrange parameters to integrate constraints and objectives, allowing objective prioritization through weight assignment. To manage computational complexity, large instances are decomposed into subproblems, and a decision logic based on bottleneck factors is used. Experiments on benchmark problems show QASA, combining tabu search, simulated annealing, and Quantum Annealing, outperforms a classical solving algorithm (CSA) in solution quality (set coverage and hypervolume ratio metrics). Computational efficiency analysis indicates QASA achieves superior Pareto solutions with a reasonable increase in computation time compared to CSA.


title: Converting Non-Equilibrium Charge Density into Spin Current

abstract: The interconversion between charge and spin degrees of freedom is of both fundamental and technological relevance in spintronics. While a non-equilibrium spin density and a charge current are related by the well known Rashba-Edelstein effect, here we theoretically model the generation of a time-dependent spin current due to a periodic modulation of the charge density, for example by a gate. By using the Boltzmann transport equation, we show that when the chemical potential is varied, a spin current is generated in the time scale it takes for the system to re-equilibrate in the new chemical potential. The effect is ubiquitous in many systems with spin-momentum locking; we compute the strength of the effect in four examples and propose a simple device scheme to measure the spin accumulation resulting from such time-dependent spin currents. Our findings test fundamental theoretical questions about charge-to-spin conversion mechanisms and provide an all-electrical way to generate spin currents without the need for charge currents, magnetic materials or optical methods.


title: On the Quantification of Image Reconstruction Uncertainty without Training Data

abstract: Computational imaging plays a pivotal role in determining hidden information from sparse measurements. A robust inverse solver is crucial to fully characterize the uncertainty induced by these measurements, as it allows for the estimation of the complete posterior of unrecoverable targets. This, in turn, facilitates a probabilistic interpretation of observational data for decision-making. In this study, we propose a deep variational framework that leverages a deep generative model to learn an approximate posterior distribution to effectively quantify image reconstruction uncertainty without the need for training data. We parameterize the target posterior using a flow-based model and minimize their Kullback-Leibler (KL) divergence to achieve accurate uncertainty estimation. To bolster stability, we introduce a robust flow-based model with bi-directional regularization and enhance expressivity through gradient boosting. Additionally, we incorporate a space-filling design to achieve substantial variance reduction on both latent prior space and target posterior space. We validate our method on several benchmark tasks and two real-world applications, namely fastMRI and black hole image reconstruction. Our results indicate that our method provides reliable and high-quality image reconstruction with robust uncertainty estimation.


title: Surface tension and wetting at free surfaces in Smoothed Particle Hydrodynamics

abstract: Surface tension and wetting are dominating physical effects in micro and nanoscale flows. We present an efficient and reliable model of surface tension and equilibrium contact angles in Smoothed Particle Hydrodynamics for free-surface problems. We demonstrate its robustness and accuracy by simulating several notoriously difficult three-dimensional free surface flow problems driven by interfacial tension.


title: RLHFPoison: Reward Poisoning Attack for Reinforcement Learning with Human Feedback in Large Language Models

abstract: Reinforcement Learning with Human Feedback (RLHF) is a methodology designed to align Large Language Models (LLMs) with human preferences, playing an important role in LLMs alignment. Despite its advantages, RLHF relies on human annotators to rank the text, which can introduce potential security vulnerabilities if any adversarial annotator (i.e., attackers) manipulates the ranking score by up-ranking any malicious text to steer the LLM adversarially. To assess the red-teaming of RLHF against human preference data poisoning, we propose RankPoison, a poisoning attack method on candidates' selection of preference rank flipping to reach certain malicious behaviors (e.g., generating longer sequences, which can increase the computational cost). With poisoned dataset generated by RankPoison, we can perform poisoning attacks on LLMs to generate longer tokens without hurting the original safety alignment performance. Moreover, applying RankPoison, we also successfully implement a backdoor attack where LLMs can generate longer answers under questions with the trigger word. Our findings highlight critical security challenges in RLHF, underscoring the necessity for more robust alignment methods for LLMs.


title: Weakly Supervised Anomaly Detection for Chest X-Ray Image

abstract: Chest X-Ray (CXR) examination is a common method for assessing thoracic diseases in clinical applications. While recent advances in deep learning have enhanced the significance of visual analysis for CXR anomaly detection, current methods often miss key cues in anomaly images crucial for identifying disease regions, as they predominantly rely on unsupervised training with normal images. This letter focuses on a more practical setup in which few-shot anomaly images with only image-level labels are available during training. For this purpose, we propose WSCXR, a weakly supervised anomaly detection framework for CXR. WSCXR firstly constructs sets of normal and anomaly image features respectively. It then refines the anomaly image features by eliminating normal region features through anomaly feature mining, thus fully leveraging the scarce yet crucial features of diseased areas. Additionally, WSCXR employs a linear mixing strategy to augment the anomaly features, facilitating the training of anomaly detector with few-shot anomaly images. Experiments on two CXR datasets demonstrate the effectiveness of our approach.


title: Aperiodic points for dual billiards

abstract: Euclidean dual billiard outside a regular $N$-gon or $2N$-gon, for $N>3$ odd, has aperiodic points.


title: Why the Bethe-West-Yennie Formula for Coulomb-Nuclear Interference Is Inconsistent

abstract: We give a new and simple proof of the inconsistency of the Bethe-West-Yennie parametrization for Coulomb-nuclear interference.


title: PELS: A Lightweight and Flexible Peripheral Event Linking System for Ultra-Low Power IoT Processors

abstract: A key challenge for ultra-low-power (ULP) devices is handling peripheral linking, where the main central processing unit (CPU) periodically mediates the interaction among multiple peripherals following wake-up events. Current solutions address this problem by either integrating event interconnects that route single-wire event lines among peripherals or by general-purpose I/O processors, with a strong trade-off between the latency, efficiency of the former, and the flexibility of the latter. In this paper, we present an open-source, peripheral-agnostic, lightweight, and flexible Peripheral Event Linking System (PELS) that combines dedicated event routing with a tiny I/O processor. With the proposed approach, the power consumption of a linking event is reduced by 2.5 times compared to a baseline relying on the main core for the event-linking process, at a low area of just 7 kGE in its minimal configuration, when integrated into a ULP RISC-V IoT processor.


title: Reconstructing Continuous Light Field From Single Coded Image

abstract: We propose a method for reconstructing a continuous light field of a target scene from a single observed image. Our method takes the best of two worlds: joint aperture-exposure coding for compressive light-field acquisition, and a neural radiance field (NeRF) for view synthesis. Joint aperture-exposure coding implemented in a camera enables effective embedding of 3-D scene information into an observed image, but in previous works, it was used only for reconstructing discretized light-field views. NeRF-based neural rendering enables high quality view synthesis of a 3-D scene from continuous viewpoints, but when only a single image is given as the input, it struggles to achieve satisfactory quality. Our method integrates these two techniques into an efficient and end-to-end trainable pipeline. Trained on a wide variety of scenes, our method can reconstruct continuous light fields accurately and efficiently without any test time optimization. To our knowledge, this is the first work to bridge two worlds: camera design for efficiently acquiring 3-D information and neural rendering.


title: Coupled high-finesse optical Fabry-Perot microcavities

abstract: Optical fiber Fabry-Perot cavities have been a development facilitating the efficient integration of high-finesse cavities into fiber-optic assemblies. In this work, we demonstrate coupling of two high-finesse fiber cavities by direct photon tunneling between them. We detect the coupled mode spectra and demonstrated the variability of coupling strength and dissipation rates for different transverse modes. Moreover, we observe very narrow spectral features resulting from a dynamical generalizaton of electromagnetically-induced transparency showing that even dissipative systems without metastable states can feature long-lived coherences.


title: Event Causality Is Key to Computational Story Understanding

abstract: Cognitive science and symbolic AI research suggest that event causality provides vital information for story understanding. However, machine learning systems for story understanding rarely employ event causality, partially due to the lack of methods that reliably identify open-world causal event relations. Leveraging recent progress in large language models, we present the first method for event causality identification that leads to material improvements in computational story understanding. Our technique sets a new state of the art on the COPES dataset (Wang et al., 2023) for causal event relation identification. Further, in the downstream story quality evaluation task, the identified causal relations lead to 3.6-16.6% relative improvement on correlation with human ratings. In the multimodal story video-text alignment task, we attain 4.1-10.9% increase on Clip Accuracy and 4.2-13.5% increase on Sentence IoU. The findings indicate substantial untapped potential for event causality in computational story understanding. The codebase is at https://github.com/insundaycathy/Event-Causality-Extraction.


title: ICXML: An In-Context Learning Framework for Zero-Shot Extreme Multi-Label Classification

abstract: This paper focuses on the task of Extreme Multi-Label Classification (XMC) whose goal is to predict multiple labels for each instance from an extremely large label space. While existing research has primarily focused on fully supervised XMC, real-world scenarios often lack supervision signals, highlighting the importance of zero-shot settings. Given the large label space, utilizing in-context learning approaches is not trivial. We address this issue by introducing In-Context Extreme Multilabel Learning (ICXML), a two-stage framework that cuts down the search space by generating a set of candidate labels through incontext learning and then reranks them. Extensive experiments suggest that ICXML advances the state of the art on two diverse public benchmarks.


title: Levinson's theorem for two-dimensional scattering systems: it was a surprise, it is now topological!

abstract: We prove a general Levinson's theorem for Schr\"odinger operators in two dimensions with threshold obstructions at zero energy. Our results confirm and simplify earlier seminal results of Boll\'e, Gesztesy et al., while providing an explicit topological interpretation. We also derive explicit formulas for the wave operators, and so show that they are elements of a $C^*$-algebra introduced by Cordes. As a consequence of our approach, we provide an evaluation of the spectral shift function at zero in the presence of $p$-resonances.


title: "It's not like Jarvis, but it's pretty close!" -- Examining ChatGPT's Usage among Undergraduate Students in Computer Science

abstract: Large language models (LLMs) such as ChatGPT and Google Bard have garnered significant attention in the academic community. Previous research has evaluated these LLMs for various applications such as generating programming exercises and solutions. However, these evaluations have predominantly been conducted by instructors and researchers, not considering the actual usage of LLMs by students. This study adopts a student-first approach to comprehensively understand how undergraduate computer science students utilize ChatGPT, a popular LLM, released by OpenAI. We employ a combination of student surveys and interviews to obtain valuable insights into the benefits, challenges, and suggested improvements related to ChatGPT. Our findings suggest that a majority of students (over 57%) have a convincingly positive outlook towards adopting ChatGPT as an aid in coursework-related tasks. However, our research also highlights various challenges that must be resolved for long-term acceptance of ChatGPT amongst students. The findings from this investigation have broader implications and may be applicable to other LLMs and their role in computing education.


title: Event-based Motion-Robust Accurate Shape Estimation for Mixed Reflectance Scenes

abstract: Event-based structured light systems have recently been introduced as an exciting alternative to conventional frame-based triangulation systems for the 3D measurements of diffuse surfaces. Important benefits include the fast capture speed and the high dynamic range provided by the event camera - albeit at the cost of lower data quality. So far, both low-accuracy event-based as well as high-accuracy frame-based 3D imaging systems are tailored to a specific surface type, such as diffuse or specular, and can not be used for a broader class of object surfaces ("mixed reflectance scenes"). In this paper, we present a novel event-based structured light system that enables fast 3D imaging of mixed reflectance scenes with high accuracy. On the captured events, we use epipolar constraints that intrinsically enable decomposing the measured reflections into diffuse, two-bounce specular, and other multi-bounce reflections. The diffuse objects in the scene are reconstructed using triangulation. Eventually, the reconstructed diffuse scene parts are used as a "display" to evaluate the specular scene parts via deflectometry. This novel procedure allows us to use the entire scene as a virtual screen, using only a scanning laser and an event camera. The resulting system achieves fast and motion-robust (14Hz) reconstructions of mixed reflectance scenes with < 500 $\mu$m accuracy. Moreover, we introduce a "superfast" capture mode (250Hz) for the 3D measurement of diffuse scenes.


title: Improved TokenPose with Sparsity

abstract: Over the past few years, the vision transformer and its various forms have gained significance in human pose estimation. By treating image patches as tokens, transformers can capture global relationships wisely, estimate the keypoint tokens by leveraging the visual tokens, and recognize the posture of the human body. Nevertheless, global attention is computationally demanding, which poses a challenge for scaling up transformer-based methods to high-resolution features. In this paper, we introduce sparsity in both keypoint token attention and visual token attention to improve human pose estimation. Experimental results on the MPII dataset demonstrate that our model has a higher level of accuracy and proved the feasibility of the method, achieving new state-of-the-art results. The idea can also provide references for other transformer-based models.


title: On the possibility to detect gravitational waves from post-merger super-massive neutron stars with a kilohertz detector

abstract: The detection of a secular post-merger gravitational wave (GW) signal in a binary neutron star (BNS) merger serves as strong evidence for the formation of a long-lived post-merger neutron star (NS), which can help constrain the maximum mass of NSs and differentiate NS equation of states. We specifically focus on the detection of GW emissions from rigidly rotating NSs formed through BNS mergers, using several kilohertz GW detectors that have been designed. We simulate the BNS mergers within the detecting limit of LIGO-Virgo-KARGA O4 and attempt to find out on what fraction the simulated sources may have a detectable secular post-merger GW signal. For kilohertz detectors designed in the same configuration of LIGO A+, we find that the design with peak sensitivity at approximately $2{\rm kHz}$ is most appropriate for such signals. The fraction of sources that have a detectable secular post-merger GW signal would be approximately $0.94\% - 11\%$ when the spindowns of the post-merger rigidly rotating NSs are dominated by GW radiation, while be approximately $0.46\% - 1.6\%$ when the contribution of electromagnetic (EM) radiation to the spin-down processes is non-negligible. We also estimate this fraction based on other well-known proposed kilohertz GW detectors and find that, with advanced design, it can reach approximately $12\% - 45\%$ for the GW-dominated spindown case and $4.7\% - 16\%$ when both the GW and EM radiations are considered.


title: Multi-View Spectrogram Transformer for Respiratory Sound Classification

abstract: Deep neural networks have been applied to audio spectrograms for respiratory sound classification. Existing models often treat the spectrogram as a synthetic image while overlooking its physical characteristics. In this paper, a Multi-View Spectrogram Transformer (MVST) is proposed to embed different views of time-frequency characteristics into the vision transformer. Specifically, the proposed MVST splits the mel-spectrogram into different sized patches, representing the multi-view acoustic elements of a respiratory sound. These patches and positional embeddings are then fed into transformer encoders to extract the attentional information among patches through a self-attention mechanism. Finally, a gated fusion scheme is designed to automatically weigh the multi-view features to highlight the best one in a specific scenario. Experimental results on the ICBHI dataset demonstrate that the proposed MVST significantly outperforms state-of-the-art methods for classifying respiratory sounds.


title: Structured Chemistry Reasoning with Large Language Models

abstract: Large Language Models (LLMs) excel in diverse areas, yet struggle with complex scientific reasoning, especially in the field of chemistry. Different from the simple chemistry tasks (e.g., molecule classification) addressed in previous studies, complex chemistry problems require not only vast knowledge and precise calculation, but also compositional reasoning about rich dynamic interactions of different concepts (e.g., temperature changes). Our study shows that even advanced LLMs, like GPT-4, can fail easily in different ways. Interestingly, the errors often stem not from a lack of domain knowledge within the LLMs, but rather from the absence of an effective reasoning structure that guides the LLMs to elicit the right knowledge, incorporate the knowledge in step-by-step reasoning, and iteratively refine results for further improved quality. On this basis, we introduce StructChem, a simple yet effective prompting strategy that offers the desired guidance and substantially boosts the LLMs' chemical reasoning capability. Testing across four chemistry areas -- quantum chemistry, mechanics, physical chemistry, and kinetics -- StructChem substantially enhances GPT-4's performance, with up to 30\% peak improvement. Our analysis also underscores the unique difficulties of precise grounded reasoning in science with LLMs, highlighting a need for more research in this area. Code is available at \url{https://github.com/ozyyshr/StructChem}.


title: Open Access in Ukraine: characteristics and evolution from 2012 to 2021

abstract: This study investigates development of open access (OA) to publications produced by authors affiliated with Ukrainian universities and research organisations in the period 2012-2021. In order to get a comprehensive overview we assembled data from three popular databases: Dimensions, Web of Science (WoS) and Scopus. Our final dataset consisted of 187,135 records. To determine the OA status of each article, this study utilised Unpaywall data which was obtained via API. It was determined that 71.5% of all considered articles during the observed period were openly available at the time of analysis. Our findings show that gold OA was the most prevalent type of OA through a 10 years studied period. We also took a look at how OA varies by research fields, how dominant large commercial publishers are in disseminating national research and the preferences of authors regarding where to self-archive articles versions. We concluded that Ukraine needs to be thoughtful with engagement with large publishers and make sure academics control publishing, not for profit companies, which would monopolise research output distribution, leaving national publishers behind. Beyond that we put a special emphasis on the importance of FAIRness of national scholarly communication infrastructure in monitoring OA uptake.


title: Journey through Gauge Theories: From Foundations to New Frontiers

abstract: From the humble beginnings of particle physics to groundbreaking discoveries, the journey of particle physics has revolutionized our understanding of the universe. The progression of particle physics, begin from the discovery of new particles, to gauge symmetries and many successful theories in its journey which help in building up the model that explain the underlying makeup of matter, regulated by fundamental forces led to establishment of Standard Model(SM). The discovery of neutrino oscillations compelled scientists to explore theories that extend beyond the Standard Model, which opened up new frontiers in the field of particle physics. The theories have shifted its paradigm to a single comprehensive theory at the scale of 10^14 GeV. This article explains the journey of particle physics from the basic constituent to the theory of everything.


title: Enhancing Deformable Object Manipulation By Using Interactive Perception and Assistive Tools

abstract: In the field of robotic manipulation, the proficiency of deformable object manipulation lags behind human capabilities due to the inherent characteristics of deformable objects. These objects have infinite degrees of freedom, resulting in non-trivial perception and state estimation, and complex dynamics, complicating the prediction of future configurations. Although recent research has focused on deformable object manipulation, most approaches rely on static vision and simple manipulation techniques, limiting the performance level. This paper proposes two solutions to enhance the performance: interactive perception and the use of assistive tools. The first solution posits that optimal perspectives exist during deformable object manipulation, facilitating easier state estimation. By exploring the action-perception regularity, interactive perception facilitates better manipulation and perception. The second solution advocates for the use of assistive tools, a hallmark of human intelligence, to improve manipulation performance. For instance, a folding board can aid in garment folding tasks by reducing object deformation and managing complex dynamics. Hence, this research aims to address the deformable object manipulation problem by incorporating interactive perception and assistive tools to augment manipulation performance.


title: Two-dimensional Control of a Biphoton Joint Spectrum

abstract: Control over the joint spectral amplitude of a photon pair has proved highly desirable for many quantum applications, since it contains the spectral quantum correlations, and has crucial effects on the indistinguishability of photons, as well as promising emerging applications involving complex quantum functions and frequency encoding of qudits. Until today, this has been achieved by engineering a single degree of freedom, either by custom poling nonlinear crystal or by shaping the pump pulse. We present a combined approach where two degrees of freedom, the phase-matching function, and the pump spectrum, are controlled. This approach enables the two-dimensional control of the joint spectral amplitude, generating a variety of spectrally encoded quantum states - including frequency uncorrelated states, frequency-bin Bell states, and biphoton qudit states. In addition, the joint spectral amplitude is controlled by photon bunching and anti-bunching, reflecting the symmetry of the phase-matching function.


title: Evolving Domain Adaptation of Pretrained Language Models for Text Classification

abstract: Adapting pre-trained language models (PLMs) for time-series text classification amidst evolving domain shifts (EDS) is critical for maintaining accuracy in applications like stance detection. This study benchmarks the effectiveness of evolving domain adaptation (EDA) strategies, notably self-training, domain-adversarial training, and domain-adaptive pretraining, with a focus on an incremental self-training method. Our analysis across various datasets reveals that this incremental method excels at adapting PLMs to EDS, outperforming traditional domain adaptation techniques. These findings highlight the importance of continually updating PLMs to ensure their effectiveness in real-world applications, paving the way for future research into PLM robustness against the natural temporal evolution of language.


title: AXI-REALM: A Lightweight and Modular Interconnect Extension for Traffic Regulation and Monitoring of Heterogeneous Real-Time SoCs

abstract: The increasing demand for heterogeneous functionality in the automotive industry and the evolution of chip manufacturing processes have led to the transition from federated to integrated critical real-time embedded systems (CRTESs). This leads to higher integration challenges of conventional timing predictability techniques due to access contention on shared resources, which can be resolved by providing system-level observability and controllability in hardware. We focus on the interconnect as a shared resource and propose AXI-REALM, a lightweight, modular, and technology-independent real-time extension to industry-standard AXI4 interconnects, available open-source. AXI-REALM uses a credit-based mechanism to distribute and control the bandwidth in a multi-subordinate system on periodic time windows, proactively prevents denial of service from malicious actors in the system, and tracks each manager's access and interference statistics for optimal budget and period selection. We provide detailed performance and implementation cost assessment in a 12nm node and an end-to-end functional case study implementing AXI-REALM into an open-source Linux-capable RISC-V SoC. In a system with a general-purpose core and a hardware accelerator's DMA engine causing interference on the interconnect, AXI-REALM achieves fair bandwidth distribution among managers, allowing the core to recover 68.2 % of its performance compared to the case without contention. Moreover, near-ideal performance (above 95 %) can be achieved by distributing the available bandwidth in favor of the core, improving the worst-case memory access latency from 264 to below eight cycles. Our approach minimizes buffering compared to other solutions and introduces only 2.45 % area overhead compared to the original SoC.


title: Zenkai -- Framework For Exploring Beyond Backpropagation

abstract: Zenkai is an open-source framework designed to give researchers more control and flexibility over building and training deep learning machines. It does this by dividing the deep learning machine into layers of semi-autonomous learning machines with their own target and learning algorithm. This is to allow researchers greater exploration such as the use of non-differentiable layers or learning algorithms beyond those based on error backpropagation. Backpropagation Rumelhart et al. [1986] has powered deep learning to become one of the most exciting fields of the 21st century. As a result, a large number of software tools have been developed to support efficient implementation and training of neural networks through the use of backpropa- gation. While these have been critical to the success of deep learning, building frameworks around backpropagation can make it challenging to implement solutions that do not adhere to it. Zenkai aims to make it easier to get around these limitations and help researchers more easily explore new frontiers in deep learning that do not strictly adhere to the backpropagation framework.


title: Quantum-anomalous-Hall current patterns and interference in thin slabs of chiral topological superconductors

abstract: The chiral topological superconductor, which supports propagating nontrivial edge modes while maintaining a gapped bulk, can be realized hybridizing a quantum-anomalous-Hall thin slab with an ordinary $s$-wave superconductor. We show that by sweeping the voltage bias in a normal-hybrid-normal double junction, the pattern of electric currents in the normal leads spans three main regimes. From single-mode edge-current quantization at low bias, to double-mode edge-current oscillations at intermediate voltages and up to diffusive bulk currents at larger voltages. Observing such patterns by resolving the spatial distribution of the local current in the thin slab could provide additional evidence, besides the global conductance, on the physics of chiral topological superconductors.


title: The Wisdom of Partisan Crowds: Comparing Collective Intelligence in Humans and LLM-based Agents

abstract: Human groups are able to converge on more accurate beliefs through deliberation, even in the presence of polarization and partisan bias -- a phenomenon known as the "wisdom of partisan crowds." Generated agents powered by Large Language Models (LLMs) are increasingly used to simulate human collective behavior, yet few benchmarks exist for evaluating their dynamics against the behavior of human groups. In this paper, we examine the extent to which the wisdom of partisan crowds emerges in groups of LLM-based agents that are prompted to role-play as partisan personas (e.g., Democrat or Republican). We find that they not only display human-like partisan biases, but also converge to more accurate beliefs through deliberation as humans do. We then identify several factors that interfere with convergence, including the use of chain-of-thought prompt and lack of details in personas. Conversely, fine-tuning on human data appears to enhance convergence. These findings show the potential and limitations of LLM-based agents as a model of human collective intelligence.


title: Orientably-regular embeddings of complete multigraphs

abstract: An embedding of a graph on an orientable surface is orientably-regular (or rotary, in an equivalent terminology) if the group of orientation-preserving automorphisms of the embedding is transitive (and hence regular) on incident vertex-edge pairs of the graph. A classification of orientably-regular embeddings of complete graphs was obtained by L. D. James and G. A. Jones [in "Regular orientable imbeddings of complete graphs", J. Combinatorial Theory Ser. B 39 (1985), 353-367], pointing out interesting connections to finite fields and Frobenius groups. By a combination of graph-theoretic methods and tools from combinatorial group theory we extend results of James and Jones to classification of orientably-regular embeddings of complete multigraphs with arbitrary edge-multiplicity.


title: Repetitive nonoverlapping sequential pattern mining

abstract: Sequential pattern mining (SPM) is an important branch of knowledge discovery that aims to mine frequent sub-sequences (patterns) in a sequential database. Various SPM methods have been investigated, and most of them are classical SPM methods, since these methods only consider whether or not a given pattern occurs within a sequence. Classical SPM can only find the common features of sequences, but it ignores the number of occurrences of the pattern in each sequence, i.e., the degree of interest of specific users. To solve this problem, this paper addresses the issue of repetitive nonoverlapping sequential pattern (RNP) mining and proposes the RNP-Miner algorithm. To reduce the number of candidate patterns, RNP-Miner adopts an itemset pattern join strategy. To improve the efficiency of support calculation, RNP-Miner utilizes the candidate support calculation algorithm based on the position dictionary. To validate the performance of RNP-Miner, 10 competitive algorithms and 20 sequence databases were selected. The experimental results verify that RNP-Miner outperforms the other algorithms, and using RNPs can achieve a better clustering performance than raw data and classical frequent patterns. All the algorithms were developed using the PyCharm environment and can be downloaded from https://github.com/wuc567/Pattern-Mining/tree/master/RNP-Miner.


title: Improving the Generation Quality of Watermarked Large Language Models via Word Importance Scoring

abstract: The strong general capabilities of Large Language Models (LLMs) bring potential ethical risks if they are unrestrictedly accessible to malicious users. Token-level watermarking inserts watermarks in the generated texts by altering the token probability distributions with a private random number generator seeded by its prefix tokens. However, this watermarking algorithm alters the logits during generation, which can lead to a downgraded text quality if it chooses to promote tokens that are less relevant given the input. In this work, we propose to improve the quality of texts generated by a watermarked language model by Watermarking with Importance Scoring (WIS). At each generation step, we estimate the importance of the token to generate, and prevent it from being impacted by watermarking if it is important for the semantic correctness of the output. We further propose three methods to predict importance scoring, including a perturbation-based method and two model-based methods. Empirical experiments show that our method can generate texts with better quality with comparable level of detection rate.


title: Degenerate spontaneous parametric down-conversion in nonlinear metasurfaces

abstract: We propose a simple scheme of degenerate spontaneous parametric down-conversion (SPDC) in nonlinear metasurfaces or photonic crystal slabs with quasi-guided modes. It employs a band crossing between P- and S-polarized quasi-guided mode bands inside the light cone and a selection rule in the conversion efficiency of the SPDC. The efficiency can be evaluated fully classically via the inverse process of noncollinear second-harmonic generation (SHG). As a toy model, we study the SPDC and SHG in a monolayer of noncentrosymmetric spheres and confirm that the scenario works well to enhance the SPDC.


title: An inexact Matrix-Newton method for solving NEPv

abstract: Our main contribution in this paper is to present an inexact Matrix-Newton algorithm that uses the tools for Newton's method in Banach spaces to solve a particular type of matrix valued problem: the nonlinear eigenvalue problem with eigenvector dependency (NEPv). We provide the conditions for our algorithm to be applicable to NEPv and show how to exploit the problem structure for an ef- ficient implementation. Various numerical experiments are provided that indicate the advantage of quadratic order of convergence over the linear order of the well- established SCF algorithm.


title: Robust Contrastive Learning With Theory Guarantee

abstract: Contrastive learning (CL) is a self-supervised training paradigm that allows us to extract meaningful features without any label information. A typical CL framework is divided into two phases, where it first tries to learn the features from unlabelled data, and then uses those features to train a linear classifier with the labeled data. While a fair amount of existing theoretical works have analyzed how the unsupervised loss in the first phase can support the supervised loss in the second phase, none has examined the connection between the unsupervised loss and the robust supervised loss, which can shed light on how to construct an effective unsupervised loss for the first phase of CL. To fill this gap, our work develops rigorous theories to dissect and identify which components in the unsupervised loss can help improve the robust supervised loss and conduct proper experiments to verify our findings.


title: Facilitating the sharing of electrophysiology data analysis results through in-depth provenance capture

abstract: Scientific research demands reproducibility and transparency, particularly in data-intensive fields like electrophysiology. Electrophysiology data is typically analyzed using scripts that generate output files, including figures. Handling these results poses several challenges due to the complexity and interactivity of the analysis process. These stem from the difficulty to discern the analysis steps, parameters, and data flow from the results, making knowledge transfer and findability challenging in collaborative settings. Provenance information tracks data lineage and processes applied to it, and provenance capture during the execution of an analysis script can address those challenges. We present Alpaca (Automated Lightweight Provenance Capture), a tool that captures fine-grained provenance information with minimal user intervention when running data analysis pipelines implemented in Python scripts. Alpaca records inputs, outputs, and function parameters and structures information according to the W3C PROV standard. We demonstrate the tool using a realistic use case involving multichannel local field potential recordings of a neurophysiological experiment, highlighting how the tool makes result details known in a standardized manner in order to address the challenges of the analysis process. Ultimately, using Alpaca will help to represent results according to the FAIR principles, which will improve research reproducibility and facilitate sharing the results of data analyses.


title: Enhanced opposite Imbert-Fedorov shifts of vortex beams for precise sensing of temperature and thickness

abstract: Imbert-Fedorov (IF) shift, which refers to a tiny transverse splitting induced by spin-orbit interaction at a reflection/refraction interface, is sensitive to the refractive index of a medium and momentum state of incident light. Most of studies have focused on the shift for an incident light beam with a spin angular momentum (SAM) i.e., circular polarization. Compared to SAM, orbital angular momentum (OAM) has infinite dimensions in theory as a new degree of freedom of light and plays an important role in light-matter coupling. We demonstrate experimentally that the relative IF shifts of vortex beams with large opposite OAMs are highly enhanced in resonant structures when light refracts through a double-prism structure (DPS), in which the thickness and temperature of the air gap are precisely sensed via the observed relative IF shifts. The thickness and temperature sensitivities increase as the absolute value of opposite OAMs increases. Our results offer a technological and practical platform for applications in sensing of thickness and temperature, ingredients of environment gas, spatial displacement, chemical substances and deformation structure.


title: Nonreciprocal field transformation with active acoustic metasurfaces

abstract: Field transformation, as an extension of the transformation optics, provides a unique means for nonreciprocal wave manipulation, while the experimental realization remains a significant challenge as it requires stringent material parameters of the metamaterials, e.g., purely nonreciprocal bianisotropic parameters. Here, we develop and demonstrate a nonreciprocal field transformation in a 2D acoustic system, using an active metasurface that can independently control all constitutive parameters and achieve purely nonreciprocal Willis coupling. The field-transforming metasurface enables tailor-made field distribution manipulation, achieving localized field amplification by a predetermined ratio. Interestingly, the metasurface demonstrates the self-adaptive capability to various excitation conditions and can extend to other geometric shapes. The metasurface also achieves nonreciprocal wave propagation for internal and external excitations, demonstrating a one-way acoustic device. Such a field-transforming metasurface not only extends the framework of the transformation theory for nonreciprocal wave manipulation, but also holds significant potential in applications such as ultra-sensitive sensors and nonreciprocal communication.


title: Where Do People Tell Stories Online? Story Detection Across Online Communities

abstract: Story detection in online communities is a challenging task as stories are scattered across communities and interwoven with non-storytelling spans within a single text. We address this challenge by building and releasing the StorySeeker toolkit, including a richly annotated dataset of 502 Reddit posts and comments, a detailed codebook adapted to the social media context, and models to predict storytelling at the document and span level. Our dataset is sampled from hundreds of popular English-language Reddit communities ranging across 33 topic categories, and it contains fine-grained expert annotations, including binary story labels, story spans, and event spans. We evaluate a range of detection methods using our data, and we identify the distinctive textual features of online storytelling, focusing on storytelling span detection, which we introduce as a new task. We illuminate distributional characteristics of storytelling on a large community-centric social media platform, and we also conduct a case study on r/ChangeMyView, where storytelling is used as one of many persuasive strategies, illustrating that our data and models can be used for both inter- and intra-community research. Finally, we discuss implications of our tools and analyses for narratology and the study of online communities.


title: Search for Charged Excited States of Dark Matter with KamLAND-Zen

abstract: Particle dark matter could belong to a multiplet that includes an electrically charged state. WIMP dark matter ($\chi^{0}$) accompanied by a negatively charged excited state ($\chi^{-}$) with a small mass difference (e.g. $<$ 20 MeV) can form a bound-state with a nucleus such as xenon. This bound-state formation is rare and the released energy is $\mathcal{O}(1-10$) MeV depending on the nucleus, making large liquid scintillator detectors suitable for detection. We searched for bound-state formation events with xenon in two experimental phases of the KamLAND-Zen experiment, a xenon-doped liquid scintillator detector. No statistically significant events were observed. For a benchmark parameter set of WIMP mass $m_{\chi^{0}} = 1$ TeV and mass difference $\Delta m = 17$ MeV, we set the most stringent upper limits on the recombination cross section times velocity $\langle\sigma v\rangle$ and the decay-width of $\chi^{-}$ to $9.2 \times 10^{-30}$ ${\rm cm^3/s}$ and $8.7 \times 10^{-14}$ GeV, respectively at 90% confidence level.


title: R-Tuning: Instructing Large Language Models to Say `I Don't Know'

abstract: Large language models (LLMs) have revolutionized numerous domains with their impressive performance but still face their challenges. A predominant issue is the propensity for these models to generate non-existent facts, a concern termed hallucination. Our research is motivated by the observation that previous instruction tuning methods force the model to complete a sentence no matter whether the model knows the knowledge or not. When the question is out of the parametric knowledge, it will try to make up something and fail to indicate when it lacks knowledge. In this paper, we present a new approach called Refusal-Aware Instruction Tuning (R-Tuning). This approach is formalized by first identifying the disparity in knowledge encompassed by pre-trained parameters compared to that of instruction tuning data. Then, we construct the refusal-aware data based on the knowledge intersection, to tune LLMs to refrain from responding to questions beyond its parametric knowledge. Experimental results demonstrate R-Tuning effectively improves a model's ability to answer known questions and refrain from answering unknown questions. Furthermore, when tested on out-of-domain datasets, the refusal ability was found to be a meta-skill that could be generalized to other tasks. Further analysis surprisingly finds that learning the uncertainty results in better calibration and an improved ability to estimate the uncertainty than uncertainty-based testing. Our code is available at https://github.com/shizhediao/R-Tuning.


title: A branching model for intergenerational telomere length dynamics

abstract: We build and study an individual based model of the telomere length's evolution in a population across multiple generations. This model is a continuous time typed branching process, where the type of an individual includes its gamete mean telomere length and its age. We study its Malthusian's behaviour and provide numerical simulations to understand the influence of biologically relevant parameters.


title: Metric and spectral aspects of random complex divisors

abstract: For any integer $n\geq 2$, we prove that for any large enough integer $d$, with large probability the injectivity radius of a random degree $d$ complex hypersurface in $\mathbb{C} \mathit{P}^n$ is larger than $d^{-\frac{3}2(n+1)}$. Here the hypersurface is endowed with the restriction of the ambient Fubini-Study metric, and the probability measure is induced by the Fubini-Study $L^2$-Hermitian product on the space of homogeneous complex polynomials of degree $d$ in $(n+1)$-variables. We also prove that with high probability, the sectional curvatures of the random hypersurface are bounded by $d^{3(n+1)}$, and that its spectral gap is bounded below by $\exp(-d^{\frac{3}2(n+3)})$. These results extend to random submanifolds of higher codimension in any complex projective manifold. Independently, we prove that the diameter of a degree $d$ divisor is bounded by $Cd^3$, which generalizes and amends the bound given in~\cite{feng1999diameter} for planar curves.


title: Trustworthy Large Models in Vision: A Survey

abstract: The rapid progress of Large Models (LMs) has recently revolutionized various fields of deep learning with remarkable grades, ranging from Natural Language Processing (NLP) to Computer Vision (CV). However, LMs are increasingly challenged and criticized by academia and industry due to their powerful performance but untrustworthy behavior, which urgently needs to be alleviated by reliable methods. Despite the abundance of literature on trustworthy LMs in NLP, a systematic survey specifically delving into the trustworthiness of LMs in CV remains absent. In order to mitigate this gap, we summarize four relevant concerns that obstruct the trustworthy usage in vision of LMs in this survey, including 1) human misuse, 2) vulnerability, 3) inherent issue and 4) interpretability. By highlighting corresponding challenge, countermeasures, and discussion in each topic, we hope this survey will facilitate readers' understanding of this field, promote alignment of LMs with human expectations and enable trustworthy LMs to serve as welfare rather than disaster for human society.


title: Quasiconformal curves and quasiconformal maps in metric spaces

abstract: In this paper we study quasiconformal curves which are a special case of quasiregular curves. Namely embeddings $\Omega\rightarrow\mathbb{R}^m$ from some domain $\Omega\subset\mathbb{R}^n$ to $\mathbb{R}^m$, where $n\leq m$, which belong in a suitable Sobolev class and satisfy a certain distortion inequality for some smooth, closed and non-vanishing $n$-form in $\mathbb{R}^m$. These mappings can be seen as quasiconformal mappings between $\Omega$ and $f(\Omega)$. We prove that a quasiconformal curve always satisfies the analytic definition of quasiconformal mappings and the lower half of the modulus inequality. Moreover, we give a sufficient condition for a quasiconformal curve to satisfy the metric definition of quasiconformal mappings. We also show that a quasiconformal map from $\Omega$ to $f(\Omega)\subset \mathbb{R}^m$ is a quasiconformal $\omega$ curve for some form $\omega$ under suitable assumptions. Finally, we show the same is true when we equip the target space $f(\Omega)$ with its intrinsic metric instead of the Euclidean one.


title: MacGyver: Are Large Language Models Creative Problem Solvers?

abstract: We explore the creative problem-solving capabilities of modern LLMs in a novel constrained setting. To this end, we create MACGYVER, an automatically generated dataset consisting of over 1,600 real-world problems deliberately designed to trigger innovative usage of objects and necessitate out-of-the-box thinking. We then present our collection to both LLMs and humans to compare and contrast their problem-solving abilities. MACGYVER is challenging for both groups, but in unique and complementary ways. For instance, humans excel in tasks they are familiar with but struggle with domain-specific knowledge, leading to a higher variance. In contrast, LLMs, exposed to a variety of specialized knowledge, attempt broader problems but fail by proposing physically-infeasible actions. Finally, we provide a detailed error analysis of LLMs, and demonstrate the potential of enhancing their problem-solving ability with novel prompting techniques such as iterative step-wise reflection and divergent-convergent thinking. This work (1) introduces a fresh arena for intelligent agents focusing on intricate aspects of physical reasoning, planning, and unconventional thinking, which supplements the existing spectrum of machine intelligence; and (2) provides insight into the constrained problem-solving capabilities of both humans and AI.


title: Modelling daily mobility using mobile data traffic at fine spatiotemporal scale

abstract: We applied a data-driven approach that explores the usability of the NetMob 2023 dataset in modelling mobility patterns within an urban context. We combined the data with a highly suitable external source, the ENACT dataset, which provides a 1 km x 1km grid with estimates of the day and night population across Europe. We developed three sets of XGBoost models that predict the population in each 100m x 100m grid cell used in NetMob2023 based on the mobile data traffic of the 68 online services covered in the dataset, using the ENACT values as ground truth. The results suggest that the NetMob 2023 data can be useful for the estimation of the day and night population and grid cell level and can explain part of the dynamics of urban mobility.


title: Do Physicians Know How to Prompt? The Need for Automatic Prompt Optimization Help in Clinical Note Generation

abstract: This study examines the effect of prompt engineering on the performance of Large Language Models (LLMs) in clinical note generation. We introduce an Automatic Prompt Optimization (APO) framework to refine initial prompts and compare the outputs of medical experts, non-medical experts, and APO-enhanced GPT3.5 and GPT4. Results highlight GPT4 APO's superior performance in standardizing prompt quality across clinical note sections. A human-in-the-loop approach shows that experts maintain content quality post-APO, with a preference for their own modifications, suggesting the value of expert customization. We recommend a two-phase optimization process, leveraging APO-GPT4 for consistency and expert input for personalization.


title: Chromatic functions, interval orders and increasing forests

abstract: The chromatic quasisymmetric functions (csf) of Shareshian and Wachs associated to unit interval orders have attracted a lot of interest since their introduction in 2016, both in combinatorics and geometry, because of their relation to the famous Stanley-Stembridge conjecture (1993) and to the topology of Hessenberg varieties, respectively. In the present work we study the csf associated to the larger class of interval orders with no restriction on the length of the intervals. Inspired by an article of Abreu and Nigro, we show that these csf are weighted sums of certain quasisymmetric functions associated to the increasing spanning forests of the associated incomparability graphs. Furthermore, we define quasisymmetric functions that include the unicellular LLT symmetric functions and generalize an identity due to Carlsson and Mellit. Finally we conjecture a formula giving their expansion in the type 1 power sum quasisymmetric functions which should extend a theorem of Athanasiadis.


title: Hausdorff measure bound for the nodal sets of Neumann Laplace eigenfunctions

abstract: We study the nodal sets of Neumann Laplace eigenfunctions in a bounded domain with $\mathcal{C}^{1,1}$ boundary. We show that for $u_\lambda$ such that $\Delta u_\lambda + \lambda u_\lambda = 0 $ with the Neumann boundary condition $\partial_\nu u_\lambda = 0$, we have $\mathcal{H}^{n-1}(\{u_\lambda = 0\}) \leq C \sqrt{\lambda}$.


title: Inducing Political Bias Allows Language Models Anticipate Partisan Reactions to Controversies

abstract: Social media platforms are rife with politically charged discussions. Therefore, accurately deciphering and predicting partisan biases using Large Language Models (LLMs) is increasingly critical. In this study, we address the challenge of understanding political bias in digitized discourse using LLMs. While traditional approaches often rely on finetuning separate models for each political faction, our work innovates by employing a singular, instruction-tuned LLM to reflect a spectrum of political ideologies. We present a comprehensive analytical framework, consisting of Partisan Bias Divergence Assessment and Partisan Class Tendency Prediction, to evaluate the model's alignment with real-world political ideologies in terms of stances, emotions, and moral foundations. Our findings reveal the model's effectiveness in capturing emotional and moral nuances, albeit with some challenges in stance detection, highlighting the intricacies and potential for refinement in NLP tools for politically sensitive contexts. This research contributes significantly to the field by demonstrating the feasibility and importance of nuanced political understanding in LLMs, particularly for applications requiring acute awareness of political bias.


title: Sensitivity to keV-MeV dark matter from cosmic-ray scattering with current and the upcoming ground-based arrays CTA and SWGO

abstract: A wealth of astrophysical and cosmological observational evidence shows that the matter content of the universe is made of about 85$\%$ of non-baryonic dark matter. Huge experimental efforts have been deployed to look for the direct detection of dark matter via their scattering on target nucleons, their production in colliders, and their indirect detection via their annihilation products. Inelastic scattering of high-energy cosmic rays off dark matter particles populating the Milky Way halo would produce secondary gamma rays in the final state from the decay of the neutral pions produced in such interactions, providing a new avenue to probe dark matter properties. We compute here the sensitivity for H.E.S.S.-like observatory, a current-generation ground-based Cherenkov telescopes, to the expected gamma-ray flux from collisions of Galactic cosmic rays and dark matter in the center of the Milky Way. We also derive sensitivity prospects for the upcoming Cherenkov Telescope Array (CTA) and Southern Wide-field Gamma-ray Observatory (SWGO). The expected sensitivity allows us to probe a poorly-constrained range of dark matter masses so far, ranging from keV to sub-GeV, and provide complementary constraints on the dark matter-proton scattering cross section traditionally probed by deep underground direct dark matter experiments.


title: The PETALO project

abstract: PETALO (Positron Emission TOF Apparatus with Liquid xenOn) is a project that uses liquid xenon as a scintillation medium, silicon photomultipliers as a readout and fast electronics to provide a significant improvement in PET-TOF technology. Liquid xenon allows one to build a continuous detector with a high stopping power for 511 keV gammas. In addition, SiPMs enable a fast and accurate measurement of the time and energy with a small dark count rate at the low temperatures required by liquid xenon. PETit, the first PETALO prototype built at IFIC (Valencia), consists of an aluminum box with one volume of liquid xenon and two planes of VUV SiPMs, which register the scintillation light emitted in xenon by the gammas coming from a $^{22}$Na radioactive source placed in the middle. The liquid xenon volume is divided in small, highly reflective cells to enhance light collection. The first results of energy resolution are presented.


title: CDMPP: A Device-Model Agnostic Framework for Latency Prediction of Tensor Programs

abstract: Deep Neural Networks (DNNs) have shown excellent performance in a wide range of machine learning applications. Knowing the latency of running a DNN model or tensor program on a specific device is useful in various tasks, such as DNN graph- or tensor-level optimization and device selection. Considering the large space of DNN models and devices that impede direct profiling of all combinations, recent efforts focus on building a predictor to model the performance of DNN models on different devices. However, none of the existing attempts have achieved a cost model that can accurately predict the performance of various tensor programs while supporting both training and inference accelerators. We propose CDMPP, an efficient tensor program latency prediction framework for both cross-model and cross-device prediction. We design an informative but efficient representation of tensor programs, called compact ASTs, and a pre-order-based positional encoding method, to capture the internal structure of tensor programs. We develop a domain-adaption-inspired method to learn domain-invariant representations and devise a KMeans-based sampling algorithm, for the predictor to learn from different domains (i.e., different DNN operators and devices). Our extensive experiments on a diverse range of DNN models and devices demonstrate that CDMPP significantly outperforms state-of-the-art baselines with 14.03% and 10.85% prediction error for cross-model and cross-device prediction, respectively, and one order of magnitude higher training efficiency. The implementation and the expanded dataset are available at https://github.com/joapolarbear/cdmpp.


title: Partial Stabilization of an Orbiting Satellite Model with a Flexible Attachment

abstract: We consider a mathematical model of an orbiting satellite, comprising a rigid carrier body and a flexible boom, operating under the influence of gravity gradient torque. This model is represented by a nonlinear control system, which includes ordinary differential equations governing the carrier body's angular velocity and attitude quaternion, coupled with the Euler-Bernoulli equations that describe the vibration of the flexible component. We propose an explicit feedback design aimed at guaranteeing the partial stability of the closed-loop system in an appropriate Hilbert space.


title: Augmenting Unsupervised Reinforcement Learning with Self-Reference

abstract: Humans possess the ability to draw on past experiences explicitly when learning new tasks and applying them accordingly. We believe this capacity for self-referencing is especially advantageous for reinforcement learning agents in the unsupervised pretrain-then-finetune setting. During pretraining, an agent's past experiences can be explicitly utilized to mitigate the nonstationarity of intrinsic rewards. In the finetuning phase, referencing historical trajectories prevents the unlearning of valuable exploratory behaviors. Motivated by these benefits, we propose the Self-Reference (SR) approach, an add-on module explicitly designed to leverage historical information and enhance agent performance within the pretrain-finetune paradigm. Our approach achieves state-of-the-art results in terms of Interquartile Mean (IQM) performance and Optimality Gap reduction on the Unsupervised Reinforcement Learning Benchmark for model-free methods, recording an 86% IQM and a 16% Optimality Gap. Additionally, it improves current algorithms by up to 17% IQM and reduces the Optimality Gap by 31%. Beyond performance enhancement, the Self-Reference add-on also increases sample efficiency, a crucial attribute for real-world applications.


title: BLT: Can Large Language Models Handle Basic Legal Text?

abstract: We find that the best publicly available LLMs like GPT-4, Claude, and {PaLM 2} currently perform poorly at basic legal text handling. We introduce a benchmark consisting of tasks that lawyers and paralegals would expect LLMs to handle zero-shot, such as looking up the text at a line of a witness deposition or at a subsection of a contract. LLMs' poor performance on this benchmark casts into doubt their reliability as-is for legal practice. However, fine-tuning for these tasks brings even a smaller model to near-perfect performance on our test set and also raises performance on a related legal task. These results suggest that many simple behaviors needed for a domain may not be present in foundational LLMs, without additional engagement from subject matter experts.


title: Whispers of Doubt Amidst Echoes of Triumph in NLP Robustness

abstract: Do larger and more performant models resolve NLP's longstanding robustness issues? We investigate this question using over 20 models of different sizes spanning different architectural choices and pretraining objectives. We conduct evaluations using (a) out-of-domain and challenge test sets, (b) behavioral testing with CheckLists, (c) contrast sets, and (d) adversarial inputs. Our analysis reveals that not all out-of-domain tests provide insight into robustness. Evaluating with CheckLists and contrast sets shows significant gaps in model performance; merely scaling models does not make them adequately robust. Finally, we point out that current approaches for adversarial evaluations of models are themselves problematic: they can be easily thwarted, and in their current forms, do not represent a sufficiently deep probe of model robustness. We conclude that not only is the question of robustness in NLP as yet unresolved, but even some of the approaches to measure robustness need to be reassessed.


title: Photo Stabilization of p-i-n Perovskite Solar Cells with Bathocuproine: MXene

abstract: Interface engineering is one of the promising strategies for the long-term stabilization of perovskite solar cells, preventing chemical decomposition induced by external agents and promoting fast charge transfer. Recently, MXenes-2D structured transition metal carbides and nitrides with various functionalization (=O,-F,-OH) demonstrated high potential for mastering the work function in halide perovskite absorbers and significantly improved the n-type charge collection in solar cells. This work demonstrates that MXenes allow for efficient stabilization of perovskite solar cells besides improving their performances. We introduce a new mixed composite bathocuproine:MXene, i.e., (BCP:MXene) interlayer at the interface between an electron-transport layer (ETL) and a metal cathode in the p-in device structure. Our investigation demonstrates that the use of BCP:MXene interlayer slightly increases the power conversation efficiency (PCE) for PSCs (from 16.5 for reference to 17.5%) but dramatically improves the out of Glove-Box stability. Under ISOS-L-2 light soaking stress at 63$\pm$ 1.5{\textdegree}C, The T80 (time needed to reduce efficiency down to 80% of the initial one) period increased from 460 h to > 2300 h.


title: Fumbling in Babel: An Investigation into ChatGPT's Language Identification Ability

abstract: ChatGPT has recently emerged as a powerful NLP tool that can carry out a variety of tasks. However, the range of languages ChatGPT can handle remains largely a mystery. To uncover which languages ChatGPT `knows', we investigate its language identification (LID) abilities. For this purpose, we compile Babel-670, a benchmark comprising 670 languages representing 24 language families spoken in five continents. Languages in Babel-670 run the gamut from the very high-resource to the very low-resource. We then study ChatGPT's (both GPT-3.5 and GPT-4) ability to (i) identify language names and language codes (ii) under zero- and few-shot conditions (iii) with and without provision of a label set. When compared to smaller finetuned LID tools, we find that ChatGPT lags behind. For example, it has poor performance on African languages. We conclude that current large language models would benefit from further development before they can sufficiently serve diverse communities.