title: Learning Interpretable Rules for Scalable Data Representation and Classification

abstract: Rule-based models, e.g., decision trees, are widely used in scenarios demanding high model interpretability for their transparent inner structures and good model expressivity. However, rule-based models are hard to optimize, especially on large data sets, due to their discrete parameters and structures. Ensemble methods and fuzzy/soft rules are commonly used to improve performance, but they sacrifice the model interpretability. To obtain both good scalability and interpretability, we propose a new classifier, named Rule-based Representation Learner (RRL), that automatically learns interpretable non-fuzzy rules for data representation and classification. To train the non-differentiable RRL effectively, we project it to a continuous space and propose a novel training method, called Gradient Grafting, that can directly optimize the discrete model using gradient descent. A novel design of logical activation functions is also devised to increase the scalability of RRL and enable it to discretize the continuous features end-to-end. Exhaustive experiments on ten small and four large data sets show that RRL outperforms the competitive interpretable approaches and can be easily adjusted to obtain a trade-off between classification accuracy and model complexity for different scenarios. Our code is available at: https://github.com/12wang3/rrl.


title: PPFL: A Personalized Federated Learning Framework for Heterogeneous Population

abstract: Personalization aims to characterize individual preferences and is widely applied across many fields. However, conventional personalized methods operate in a centralized manner and potentially expose the raw data when pooling individual information. In this paper, with privacy considerations, we develop a flexible and interpretable personalized framework within the paradigm of Federated Learning, called PPFL (Population Personalized Federated Learning). By leveraging canonical models to capture fundamental characteristics among the heterogeneous population and employing membership vectors to reveal clients' preferences, it models the heterogeneity as clients' varying preferences for these characteristics and provides substantial insights into client characteristics, which is lacking in existing Personalized Federated Learning (PFL) methods. Furthermore, we explore the relationship between our method and three main branches of PFL methods: multi-task PFL, clustered FL, and decoupling PFL, and demonstrate the advantages of PPFL. To solve PPFL (a non-convex constrained optimization problem), we propose a novel random block coordinate descent algorithm and present the convergence property. We conduct experiments on both pathological and practical datasets, and the results validate the effectiveness of PPFL.


title: From Chaos to Clarity: Claim Normalization to Empower Fact-Checking

abstract: With the rise of social media, users are exposed to many misleading claims. However, the pervasive noise inherent in these posts presents a challenge in identifying precise and prominent claims that require verification. Extracting the important claims from such posts is arduous and time-consuming, yet it is an underexplored problem. Here, we aim to bridge this gap. We introduce a novel task, Claim Normalization (aka ClaimNorm), which aims to decompose complex and noisy social media posts into more straightforward and understandable forms, termed normalized claims. We propose CACN, a pioneering approach that leverages chain-of-thought and claim check-worthiness estimation, mimicking human reasoning processes, to comprehend intricate claims. Moreover, we capitalize on the in-context learning capabilities of large language models to provide guidance and to improve claim normalization. To evaluate the effectiveness of our proposed model, we meticulously compile a comprehensive real-world dataset, CLAN, comprising more than 6k instances of social media posts alongside their respective normalized claims. Our experiments demonstrate that CACN outperforms several baselines across various evaluation measures. Finally, our rigorous error analysis validates CACN's capabilities and pitfalls.


title: Motion Planning for Autonomous Ground Vehicles Using Artificial Potential Fields: A Review

abstract: Autonomous ground vehicle systems have found extensive potential and practical applications in the modern world. The development of an autonomous ground vehicle poses a significant challenge, particularly in identifying the best path plan, based on defined performance metrics such as safety margin, shortest time, and energy consumption. Various techniques for motion planning have been proposed by researchers, one of which is the use of artificial potential fields. Several authors in the past two decades have proposed various modified versions of the artificial potential field algorithms. The variations of the traditional APF approach have given an answer to prior shortcomings. This gives potential rise to a strategic survey on the improved versions of this algorithm. This study presents a review of motion planning for autonomous ground vehicles using artificial potential fields. Each article is evaluated based on criteria that involve the environment type, which may be either static or dynamic, the evaluation scenario, which may be real-time or simulated, and the method used for improving the search performance of the algorithm. All the customized designs of planning models are analyzed and evaluated. At the end, the results of the review are discussed, and future works are proposed.


title: Social Commonsense-Guided Search Query Generation for Open-Domain Knowledge-Powered Conversations

abstract: Open-domain dialog involves generating search queries that help obtain relevant knowledge for holding informative conversations. However, it can be challenging to determine what information to retrieve when the user is passive and does not express a clear need or request. To tackle this issue, we present a novel approach that focuses on generating internet search queries that are guided by social commonsense. Specifically, we leverage a commonsense dialog system to establish connections related to the conversation topic, which subsequently guides our query generation. Our proposed framework addresses passive user interactions by integrating topic tracking, commonsense response generation and instruction-driven query generation. Through extensive evaluations, we show that our approach overcomes limitations of existing query generation techniques that rely solely on explicit dialog information, and produces search queries that are more relevant, specific, and compelling, ultimately resulting in more engaging responses.


title: Pyramidal Hidden Markov Model For Multivariate Time Series Forecasting

abstract: The Hidden Markov Model (HMM) can predict the future value of a time series based on its current and previous values, making it a powerful algorithm for handling various types of time series. Numerous studies have explored the improvement of HMM using advanced techniques, leading to the development of several variations of HMM. Despite these studies indicating the increased competitiveness of HMM compared to other advanced algorithms, few have recognized the significance and impact of incorporating multistep stochastic states into its performance. In this work, we propose a Pyramidal Hidden Markov Model (PHMM) that can capture multiple multistep stochastic states. Initially, a multistep HMM is designed for extracting short multistep stochastic states. Next, a novel time series forecasting structure is proposed based on PHMM, which utilizes pyramid-like stacking to adaptively identify long multistep stochastic states. By employing these two schemes, our model can effectively handle non-stationary and noisy data, while also establishing long-term dependencies for more accurate and comprehensive forecasting. The experimental results on diverse multivariate time series datasets convincingly demonstrate the superior performance of our proposed PHMM compared to its competitive peers in time series forecasting.


title: PulmoBell: Home-based Pulmonary Rehabilitation Assistive Technology for People with COPD

abstract: Chronic Obstructive Pulmonary Disease (COPD) can be fatal and is challenging to live with due to its severe symptoms. Pulmonary rehabilitation (PR) is one of the managements means to maintain COPD in a stable status. However, implementation of PR in the UK has been challenging due to the environmental and personal barriers faced by patients, which hinder their uptake, adherence, and completion of the programmes. Moreover, increased exercise capacity following PR does not always translate into physical activity (PA) and unfortunately, can lead back to exercise capacity seen prior to PR. Current alternative solutions using telerehabilitation methods have limitations on addressing these accessibility problems, and no clear conclusion can be drawn on the efficacy of telerehabilitation in enhancing the sustainability of PR outcomes via promoting PA in patients' everyday life. In this work, the authors propose a novel design of sensor-based assistive product with the aim of facilitating PR and promoting PA maintenance in a home-based setting. Prototypes of different levels of fidelity are presented, followed by an evaluation plan for future research directions.


title: Exploring Artistic Visualization of Physiological Signals for Mindfulness and Relaxation: A Pilot Study

abstract: Mindfulness and relaxation techniques for mental health are increasingly being explored in the human-computer interaction community. Physiological signals and their visualization have often been exploited together in a form of biofeedback with other intervention methods. Here, we aim to contribute to the body of existing work on biofeedback interfaces for mindfulness, with a particular focus on incorporating artistic effects into physiological signal visualization. With an implemented artistic biofeedback interface, we conduct a pilot study where 10 participants attend stress-induction sessions followed by two biofeedback mindfulness sessions: classic biofeedback and artistic visualization. The result demonstrates that artistic visualization-driven biofeedback significantly improves the effectiveness of biofeedback in helping users feel relaxed in comparison with a classic graphical form of biofeedback. Also, it shows that the artistic effect makes it easy to understand what biofeedback represents. Future work includes exploring how advanced physiological computing methods can improve its efficiency and performance.


title: What's in a Prior? Learned Proximal Networks for Inverse Problems

abstract: Proximal operators are ubiquitous in inverse problems, commonly appearing as part of algorithmic strategies to regularize problems that are otherwise ill-posed. Modern deep learning models have been brought to bear for these tasks too, as in the framework of plug-and-play or deep unrolling, where they loosely resemble proximal operators. Yet, something essential is lost in employing these purely data-driven approaches: there is no guarantee that a general deep network represents the proximal operator of any function, nor is there any characterization of the function for which the network might provide some approximate proximal. This not only makes guaranteeing convergence of iterative schemes challenging but, more fundamentally, complicates the analysis of what has been learned by these networks about their training data. Herein we provide a framework to develop learned proximal networks (LPN), prove that they provide exact proximal operators for a data-driven nonconvex regularizer, and show how a new training strategy, dubbed proximal matching, provably promotes the recovery of the log-prior of the true data distribution. Such LPN provide general, unsupervised, expressive proximal operators that can be used for general inverse problems with convergence guarantees. We illustrate our results in a series of cases of increasing complexity, demonstrating that these models not only result in state-of-the-art performance, but provide a window into the resulting priors learned from data.


title: Quantum-walk search in motion

abstract: In quantum computing, the quantum walk search algorithm is designed for locating fixed marked nodes within a graph. However, when multiple marked nodes exist, the conventional search algorithm lacks the capacity to simultaneously amplify the marked nodes as well as identify the correct chronological ordering between the marked nodes, if any. To address this limitation, we explore a potential extension of the algorithm by introducing additional quantum states to label the marked nodes. The labels resolve the ambiguity of simultaneous amplification of the marked nodes. Additionally, by associating the label states with a chronological ordering, we can extend the algorithm to track a moving particle on a two-dimensional surface. Our algorithm efficiently searches for the trajectory of the particle and is supported by a proposed quantum circuit. This concept holds promise for a range of applications, from real-time object tracking to network management and routing.


title: The Law and NLP: Bridging Disciplinary Disconnects

abstract: Legal practice is intrinsically rooted in the fabric of language, yet legal practitioners and scholars have been slow to adopt tools from natural language processing (NLP). At the same time, the legal system is experiencing an access to justice crisis, which could be partially alleviated with NLP. In this position paper, we argue that the slow uptake of NLP in legal practice is exacerbated by a disconnect between the needs of the legal community and the focus of NLP researchers. In a review of recent trends in the legal NLP literature, we find limited overlap between the legal NLP community and legal academia. Our interpretation is that some of the most popular legal NLP tasks fail to address the needs of legal practitioners. We discuss examples of legal NLP tasks that promise to bridge disciplinary disconnects and highlight interesting areas for legal NLP research that remain underexplored.


title: Self-Assistant: Portable Progressive Muscle Relaxation Training Interface for Anxiety Reduction in Office Workers

abstract: Workload often triggers anxiety for office workers. While a variety of stress intervention and management techniques have been explored, there exist only a few of portable tangible interfaces for anxiety reduction. Contributing to the body of work, we introduce Self-Assistant, a portable anxiety intervention training interface. This is based on progressive muscle relaxation training which is an effective way for reducing stress and raise awareness of tension, and provide feelings of deep relaxation. This interface incorporates a stress ball with a pressure sensor and visual indicators which help track the user's anxiety level through squeeze actions. This is designed to help improve self-awareness of anxiety and stress, in turn self-regulating bodily functions, offering rapid and low-sensory stimulus training for anxiety relief. Finally, we discuss application scenarios and future work with Self-Assistant.


title: DePAint: A Decentralized Safe Multi-Agent Reinforcement Learning Algorithm considering Peak and Average Constraints

abstract: The domain of safe multi-agent reinforcement learning (MARL), despite its potential applications in areas ranging from drone delivery and vehicle automation to the development of zero-energy communities, remains relatively unexplored. The primary challenge involves training agents to learn optimal policies that maximize rewards while adhering to stringent safety constraints, all without the oversight of a central controller. These constraints are critical in a wide array of applications. Moreover, ensuring the privacy of sensitive information in decentralized settings introduces an additional layer of complexity, necessitating innovative solutions that uphold privacy while achieving the system's safety and efficiency goals. In this paper, we address the problem of multi-agent policy optimization in a decentralized setting, where agents communicate with their neighbors to maximize the sum of their cumulative rewards while also satisfying each agent's safety constraints. We consider both peak and average constraints. In this scenario, there is no central controller coordinating the agents and both the rewards and constraints are only known to each agent locally/privately. We formulate the problem as a decentralized constrained multi-agent Markov Decision Problem and propose a momentum-based decentralized policy gradient method, DePAint, to solve it. To the best of our knowledge, this is the first privacy-preserving fully decentralized multi-agent reinforcement learning algorithm that considers both peak and average constraints. We then provide theoretical analysis and empirical evaluation of our algorithm in a number of scenarios and compare its performance to centralized algorithms that consider similar constraints.


title: Minireview on Disordered Optical Metasurfaces

abstract: The use of coherent wave phenomena to enhance device performance is a cornerstone of modern optics. In juxtaposition to (locally) periodic metasurfaces, their disordered counterparts exhibit an interplay of destructive and constructive interferences occurring at the same spatial and spectral frequencies. This attribute provides disordered metasurfaces with a remarkable degree of flexibility, setting them apart from the constraints of periodic arrangements. Hereafter, we provide a concise overview of the cutting-edge developments and offer insights into the forthcoming research in this dynamic field.


title: What to Make of Zero: Resolving the Statistical Noise from Conformational Reorganization in Alchemical Binding Free Energy Estimates with Metadynamics Sampling

abstract: We introduce the self-Relative Binding Free Energy (self-RBFE) approach to evaluate the intrinsic statistical variance of dual-topology alchemical binding free energy estimators. The self-RBFE is the relative binding free energy between a ligand and a copy of the same ligand, and its true value is zero. Nevertheless, because the two copies of the ligand move independently, the self-RBFE value produced by a finite-length simulation fluctuates and can be used to measure the variance of the model. The results of this validation provide evidence that a significant fraction of the errors observed in benchmark studies reflect the statistical fluctuations of unconverged estimates rather than the models' accuracy. Furthermore, we find that ligand reorganization is a significant contributing factor to the statistical variance of binding free energy estimates and that metadynamics-accelerated conformational sampling of torsional degrees of freedom of the ligand can drastically reduce the time to convergence.


title: Nonasymptotic Convergence Rate of Quasi-Monte Carlo: Applications to Linear Elliptic PDEs with Lognormal Coefficients and Importance Samplings

abstract: This study analyzes the nonasymptotic convergence behavior of the quasi-Monte Carlo (QMC) method with applications to linear elliptic partial differential equations (PDEs) with lognormal coefficients. Building upon the error analysis presented in (Owen, 2006), we derive a nonasymptotic convergence estimate depending on the specific integrands, the input dimensionality, and the finite number of samples used in the QMC quadrature. We discuss the effects of the variance and dimensionality of the input random variable. Then, we apply the QMC method with importance sampling (IS) to approximate deterministic, real-valued, bounded linear functionals that depend on the solution of a linear elliptic PDE with a lognormal diffusivity coefficient in bounded domains of $\mathbb{R}^d$, where the random coefficient is modeled as a stationary Gaussian random field parameterized by the trigonometric and wavelet-type basis. We propose two types of IS distributions, analyze their effects on the QMC convergence rate, and observe the improvements.


title: Level-raising of even representations of tetrahedral type and equidistribution of lines in the projective plane

abstract: The distribution of auxiliary primes raising the level of even representations of tetrahedral type is studied. Under an equidistribution assumption, the density of primes raising the level of an even, $p$-adic representation is shown to be $$ \frac{p-1}{p}. $$ Data on auxiliary primes $v\leq 10^8$ raising the level of even $3$-adic representations of various conductors are presented. The data support equidistribution for $p=3$. In the process, we prove existence of even, surjective representations $$ \rho^{(\ell)}:\operatorname{Gal}(\overline{\mathbb{Q}}/\mathbb{Q}) \longrightarrow \operatorname{SL}(2,\mathbb{Z}_3) $$ ramified only at $\ell$ and at $3$ for $\ell =163$ and $\ell = 277$. The prime $\ell = 277$ falls outside the class of Shanks primes. Measured by conductor, these are the smallest known examples of totally real extensions of $\mathbb{Q}$ with Galois group $\operatorname{SL}(2, \mathbb{Z}_3)$.


title: On conjugate separability of nilpotent subgroups

abstract: We study groups, all maximal nilpotent subgroups of class at most $k$ in which are malnormal. We show that such groups share many similar properties with the ordinary CSA groups. Similarly, we introduce the class of {\em nilpotency transitive} groups and we show that in presence of a special residuality condition, these two concepts are the equivalent. As a result, we see that the theory of CSA and CT groups is a small part of a more general idea.


title: Toward Flare-Free Images: A Survey

abstract: Lens flare is a common image artifact that can significantly degrade image quality and affect the performance of computer vision systems due to a strong light source pointing at the camera. This survey provides a comprehensive overview of the multifaceted domain of lens flare, encompassing its underlying physics, influencing factors, types, and characteristics. It delves into the complex optics of flare formation, arising from factors like internal reflection, scattering, diffraction, and dispersion within the camera lens system. The diverse categories of flare are explored, including scattering, reflective, glare, orb, and starburst types. Key properties such as shape, color, and localization are analyzed. The numerous factors impacting flare appearance are discussed, spanning light source attributes, lens features, camera settings, and scene content. The survey extensively covers the wide range of methods proposed for flare removal, including hardware optimization strategies, classical image processing techniques, and learning-based methods using deep learning. It not only describes pioneering flare datasets created for training and evaluation purposes but also how they were created. Commonly employed performance metrics such as PSNR, SSIM, and LPIPS are explored. Challenges posed by flare's complex and data-dependent characteristics are highlighted. The survey provides insights into best practices, limitations, and promising future directions for flare removal research. Reviewing the state-of-the-art enables an in-depth understanding of the inherent complexities of the flare phenomenon and the capabilities of existing solutions. This can inform and inspire new innovations for handling lens flare artifacts and improving visual quality across various applications.


title: A global product of fine-scale urban building height based on spaceborne lidar

abstract: Characterizing urban environments with broad coverages and high precision is more important than ever for achieving the UN's Sustainable Development Goals (SDGs) as half of the world's populations are living in cities. Urban building height as a fundamental 3D urban structural feature has far-reaching applications. However, so far, producing readily available datasets of recent urban building heights with fine spatial resolutions and global coverages remains a challenging task. Here, we provide an up-to-date global product of urban building heights based on a fine grid size of 150 m around 2020 by combining the spaceborne lidar instrument of GEDI and multi-sourced data including remotely sensed images (i.e., Landsat-8, Sentinel-2, and Sentinel-1) and topographic data. Our results revealed that the estimated method of building height samples based on the GEDI data was effective with 0.78 of Pearson's r and 3.67 m of RMSE in comparison to the reference data. The mapping product also demonstrated good performance as indicated by its strong correlation with the reference data (i.e., Pearson's r = 0.71, RMSE = 4.60 m). Compared with the currently existing products, our global urban building height map holds the ability to provide a higher spatial resolution (i.e., 150 m) with a great level of inherent details about the spatial heterogeneity and flexibility of updating using the GEDI samples as inputs. This work will boost future urban studies across many fields including climate, environmental, ecological, and social sciences.


title: Computer Vision Datasets and Models Exhibit Cultural and Linguistic Diversity in Perception

abstract: Computer vision often treats human perception as homogeneous: an implicit assumption that visual stimuli are perceived similarly by everyone. This assumption is reflected in the way researchers collect datasets and train vision models. By contrast, literature in cross-cultural psychology and linguistics has provided evidence that people from different cultural backgrounds observe vastly different concepts even when viewing the same visual stimuli. In this paper, we study how these differences manifest themselves in vision-language datasets and models, using language as a proxy for culture. By comparing textual descriptions generated across 7 languages for the same images, we find significant differences in the semantic content and linguistic expression. When datasets are multilingual as opposed to monolingual, descriptions have higher semantic coverage on average, where coverage is measured using scene graphs, model embeddings, and linguistic taxonomies. For example, multilingual descriptions have on average 29.9% more objects, 24.5% more relations, and 46.0% more attributes than a set of monolingual captions. When prompted to describe images in different languages, popular models (e.g. LLaVA) inherit this bias and describe different parts of the image. Moreover, finetuning models on captions from one language performs best on corresponding test data from that language, while finetuning on multilingual data performs consistently well across all test data compositions. Our work points towards the need to account for and embrace the diversity of human perception in the computer vision community.


title: Resetting of free and confined motion with generalized Ornstein-Uhlenbeck distribution

abstract: Recently, a new formalism describing the anomalous diffusion processes, based on the Onsager-Machlup fluctuation theory, has been suggested \cite{Smain, Spub}. We study particles performing this new type of motion, under the action of resetting at a constant rate, or Poissonian resetting. We derive the mean-squared displacement and probability density function, and investigate their dependence on the shape parameter, diffusion coefficient, potential strength and resetting rate.


title: Right, No Matter Why: AI Fact-checking and AI Authority in Health-related Inquiry Settings

abstract: Previous research on expert advice-taking shows that humans exhibit two contradictory behaviors: on the one hand, people tend to overvalue their own opinions undervaluing the expert opinion, and on the other, people often defer to other people's advice even if the advice itself is rather obviously wrong. In our study, we conduct an exploratory evaluation of users' AI-advice accepting behavior when evaluating the truthfulness of a health-related statement in different "advice quality" settings. We find that even feedback that is confined to just stating that "the AI thinks that the statement is false/true" results in more than half of people moving their statement veracity assessment towards the AI suggestion. The different types of advice given influence the acceptance rates, but the sheer effect of getting a suggestion is often bigger than the suggestion-type effect.


title: The Fiedler connection to the parametrized modularity optimization for community detection

abstract: This paper presents a comprehensive analysis of the generalized spectral structure of the modularity matrix $B$, which is introduced by Newman as the kernel matrix for the quadratic-form expression of the modularity function $Q$ used for community detection. The analysis is then seamlessly extended to the resolution-parametrized modularity matrix $B(\gamma)$, where $\gamma$ denotes the resolution parameter. The modularity spectral analysis provides fresh and profound insights into the $\gamma$-dynamics within the framework of modularity maximization for community detection. It provides the first algebraic explanation of the resolution limit at any specific $\gamma$ value. Among the significant findings and implications, the analysis reveals that (1) the maxima of the quadratic function with $B(\gamma)$ as the kernel matrix always reside in the Fiedler space of the normalized graph Laplacian $L$ or the null space of $L$, or their combination, and (2) the Fiedler value of the graph Laplacian $L$ marks the critical $\gamma$ value in the transition of candidate community configuration states between graph division and aggregation. Additionally, this paper introduces and identifies the Fiedler pseudo-set (FPS) as the de facto critical region for the state transition. This work is expected to have an immediate and long-term impact on improvements in algorithms for modularity maximization and on model transformations.


title: Is ChatGPT a game changer for geocoding -- a benchmark for geocoding address parsing techniques

abstract: The remarkable success of GPT models across various tasks, including toponymy recognition motivates us to assess the performance of the GPT-3 model in the geocoding address parsing task. To ensure that the evaluation more accurately mirrors performance in real-world scenarios with diverse user input qualities and resolve the pressing need for a 'gold standard' evaluation dataset for geocoding systems, we introduce a benchmark dataset of low-quality address descriptions synthesized based on human input patterns mining from actual input logs of a geocoding system in production. This dataset has 21 different input errors and variations; contains over 239,000 address records that are uniquely selected from streets across all U.S. 50 states and D.C.; and consists of three subsets to be used as training, validation, and testing sets. Building on this, we train and gauge the performance of the GPT-3 model in extracting address components, contrasting its performance with transformer-based and LSTM-based models. The evaluation results indicate that Bidirectional LSTM-CRF model has achieved the best performance over these transformer-based models and GPT-3 model. Transformer-based models demonstrate very comparable results compared to the Bidirectional LSTM-CRF model. The GPT-3 model, though trailing in performance, showcases potential in the address parsing task with few-shot examples, exhibiting room for improvement with additional fine-tuning. We open source the code and data of this presented benchmark so that researchers can utilize it for future model development or extend it to evaluate similar tasks, such as document geocoding.


title: Euler characteristics of affine ADE Nakajima quiver varieties via collapsing fibers

abstract: We prove a universal substitution formula that compares generating series of Euler characteristics of Nakajima quiver varieties associated with affine ADE diagrams at generic and at certain nongeneric stability conditions via a study of collapsing fibres in the associated variation of GIT map, unifying and generalising earlier results of the last two authors with N\'emethi and of Nakajima. As a special case, we compute generating series of Euler characteristics of noncommutative Quot schemes of Kleinian orbifolds. In type A and rank 1, we give a second, combinatorial proof of our substitution formula, using torus localisation and partition enumeration. This gives a combinatorial model of the fibers of the variation of GIT map, and also leads to relations between our results and the representation theory of the affine and finite Lie algebras in type A.


title: Closed form for $\sum_{k=1}^n k^p$ through the Hermite integral representation of the Hurwitz zeta function

abstract: Sums of positive integer powers have captivated the attention of mathematicians since ancient times. Over the centuries, mathematicians from diverse backgrounds have provided expressions for the sum of positive integer powers of the first $n$ positive integers. In this paper, we contribute to this endeavour by deriving Bernoulli's formula for $\sum_{k=1}^n k^p,$ for all positive integers $n$ and nonegative integers $p$, through the utilization of the Hermite integral representation of the Hurwitz zeta function.


title: Dense pairs of rings

abstract: Outside of the framework of geometric theories, we exhibit complete, respectively model-complete theories of rings whose corresponding theory of pairs is complete, respectively model-complete, using transfer results proven in the seventies for boolean products of structures. It includes certain boolean products of pairs of dp-minimal fields of characteristic $0$. We also show, as in the case of pairs of fields, how it fits in the framework of differential rings.


title: A Quantitative Evaluation of Dense 3D Reconstruction of Sinus Anatomy from Monocular Endoscopic Video

abstract: Generating accurate 3D reconstructions from endoscopic video is a promising avenue for longitudinal radiation-free analysis of sinus anatomy and surgical outcomes. Several methods for monocular reconstruction have been proposed, yielding visually pleasant 3D anatomical structures by retrieving relative camera poses with structure-from-motion-type algorithms and fusion of monocular depth estimates. However, due to the complex properties of the underlying algorithms and endoscopic scenes, the reconstruction pipeline may perform poorly or fail unexpectedly. Further, acquiring medical data conveys additional challenges, presenting difficulties in quantitatively benchmarking these models, understanding failure cases, and identifying critical components that contribute to their precision. In this work, we perform a quantitative analysis of a self-supervised approach for sinus reconstruction using endoscopic sequences paired with optical tracking and high-resolution computed tomography acquired from nine ex-vivo specimens. Our results show that the generated reconstructions are in high agreement with the anatomy, yielding an average point-to-mesh error of 0.91 mm between reconstructions and CT segmentations. However, in a point-to-point matching scenario, relevant for endoscope tracking and navigation, we found average target registration errors of 6.58 mm. We identified that pose and depth estimation inaccuracies contribute equally to this error and that locally consistent sequences with shorter trajectories generate more accurate reconstructions. These results suggest that achieving global consistency between relative camera poses and estimated depths with the anatomy is essential. In doing so, we can ensure proper synergy between all components of the pipeline for improved reconstructions that will facilitate clinical application of this innovative technology.


title: The classical topological invariants of homogeneous spaces

abstract: We study the homogeneous spaces of a simply connected, compact, simple Lie group $G$ through the lens of K-theory. Our methods apply equally well to the case where $G$ is in one of the four infinite families of classical groups, or one of the five exceptional groups. The main examples we study in detail are the four symmetric spaces FII, EIII, EVI, EVIII in Cartan's list of symmetric spaces. These are, respectively, homogeneous spaces for $F_4$, $E_6$, $E_7$, $E_8$ with dimensions $16$, $32$, $64$, $128$. They are the four Rosenfeld projective planes.


title: Bi-Encoders based Species Normalization -- Pairwise Sentence Learning to Rank

abstract: Motivation: Biomedical named-entity normalization involves connecting biomedical entities with distinct database identifiers in order to facilitate data integration across various fields of biology. Existing systems for biomedical named entity normalization heavily rely on dictionaries, manually created rules, and high-quality representative features such as lexical or morphological characteristics. However, recent research has investigated the use of neural network-based models to reduce dependence on dictionaries, manually crafted rules, and features. Despite these advancements, the performance of these models is still limited due to the lack of sufficiently large training datasets. These models have a tendency to overfit small training corpora and exhibit poor generalization when faced with previously unseen entities, necessitating the redesign of rules and features. Contribution: We present a novel deep learning approach for named entity normalization, treating it as a pair-wise learning to rank problem. Our method utilizes the widely-used information retrieval algorithm Best Matching 25 to generate candidate concepts, followed by the application of bi-directional encoder representation from the encoder (BERT) to re-rank the candidate list. Notably, our approach eliminates the need for feature-engineering or rule creation. We conduct experiments on species entity types and evaluate our method against state-of-the-art techniques using LINNAEUS and S800 biomedical corpora. Our proposed approach surpasses existing methods in linking entities to the NCBI taxonomy. To the best of our knowledge, there is no existing neural network-based approach for species normalization in the literature.


title: Einstein-Yang-Mills wormholes haunted by a phantom field

abstract: In this article, we study wormhole spacetimes in the framework of the static spherically symmetric SU(2) Einstein-Yang-Mills theory coupled to a phantom scalar field. We show rigorously the existence of an infinite sequence of symmetric wormhole solutions, labelled by the number of zeros of the Yang-Mills potential. These solutions have previously been discovered numerically. Mathematically, the problem resembles the pure Einstein-Yang-Mills system for black hole initial conditions, which was well-studied in the 90s. The main difference in the present work is that the coupling to the phantom field adds a non-trivial degree of complexity to the analysis. After proving the existence of the symmetric wormhole solutions, we also present numerical evidence for the existence of asymmetric ones.


title: The weak Lefschetz property of artinian algebras associated to paths and cycles

abstract: Given a base field $\Bbbk$ of characteristic zero, for each graph $G$, we associate the artinian algebra $A(G)$ defined by the edge ideal of $G$ and the squares of the variables. We study the weak Lefschetz property of $A(G)$. We classify some classes of graphs with relatively few edges, including paths and cycles, such that its associated artinian ring has the weak Lefschetz property.


title: MoPe: Model Perturbation-based Privacy Attacks on Language Models

abstract: Recent work has shown that Large Language Models (LLMs) can unintentionally leak sensitive information present in their training data. In this paper, we present Model Perturbations (MoPe), a new method to identify with high confidence if a given text is in the training data of a pre-trained language model, given white-box access to the models parameters. MoPe adds noise to the model in parameter space and measures the drop in log-likelihood at a given point $x$, a statistic we show approximates the trace of the Hessian matrix with respect to model parameters. Across language models ranging from $70$M to $12$B parameters, we show that MoPe is more effective than existing loss-based attacks and recently proposed perturbation-based methods. We also examine the role of training point order and model size in attack success, and empirically demonstrate that MoPe accurately approximate the trace of the Hessian in practice. Our results show that the loss of a point alone is insufficient to determine extractability -- there are training points we can recover using our method that have average loss. This casts some doubt on prior works that use the loss of a point as evidence of memorization or unlearning.


title: Pulsating with discrete symmetry

abstract: We propose a class of diffusive lattice models where the internal states of particles are subject to a periodic drive. The discrete symmetry of states enforces an effective energy landscape which can counteract the drive to arrest the dynamics. Such a mechanism is reminiscent of the arrest reported in dense assemblies of pulsating deformable particles, in line with experiments in confluent biological tissues. We show that the competition between arrest and synchronisation promotes an instability which leads to spiral waves. Using analytical coarse-graining, we rationalize the emergence of such spirals in terms of a discrete gauge invariance at the hydrodynamic level.


title: Ultrafast spatiotemporal chiroptical response of dielectric and plasmonic nanospheres

abstract: We theoretically examine the spatiotemporal evolution of enhanced near-field optical chirality (OC) in both plasmonic and dielectric nanospheres when excited by ultrashort optical pulses. We demonstrate distinct spatiotemporal variations in near-field OC arising from the differing natures of plasmonic and dielectric resonators. The electric dipole resonant plasmonic nanosphere generates instantaneous near-field OC that relies on the interference between incident and scattered (induced) fields. Conversely, a resonant dielectric nanosphere sustains long-lasting OC even after the incident field diminishes due to the scattered field from resonant electric and magnetic dipole modes. We further demonstrate the control over the near-field OC using vector beams. Our work opens up opportunities for spatiotemporal control of nanostructure-enhanced chiral-light matter interactions.


title: Geometric quantization results for semi-positive line bundles on a Riemann surface

abstract: In earlier work the authors proved the Bergman kernel expansion for semipositive line bundles over a Riemann surface whose curvature vanishes to atmost finite order at each point. Here we explore the related results and consequences of the expansion in the semipositive case including: Tian's approximation theorem for induced Fubini-Study metrics, leading order asymptotics and composition for Toeplitz operators, asymptotics of zeroes for random sections and the asymptotics of holomorphic torsion.


title: The Corona Australis star formation complex is accelerating away from the Galactic plane

abstract: We study the kinematics of the recently discovered Corona Australis (CrA) chain of clusters by examining the 3D space motion of its young stars using Gaia DR3 and APOGEE-2 data. While we observe linear expansion between the clusters in the Cartesian XY directions, the expansion along Z exhibits a curved pattern. To our knowledge, this is the first time such a nonlinear velocity-position relation has been observed for stellar clusters. We propose a scenario to explain our findings, in which the observed gradient is caused by stellar feedback, accelerating the gas away from the Galactic plane. A traceback analysis confirms that the CrA star formation complex was located near the central clusters of the Scorpius Centaurus (Sco-Cen) OB association 10-15 Myr ago. It contains massive stars and thus offers a natural source of feedback. Based on the velocity of the youngest unbound CrA cluster, we estimate that a median number of about two supernovae would have been sufficient to inject the present-day kinetic energy of the CrA molecular cloud. This number agrees with that of recent studies. The head-tail morphology of the CrA molecular cloud further supports the proposed feedback scenario, in which a feedback force pushed the primordial cloud from the Galactic north, leading to the current separation of 100 pc from the center of Sco-Cen. The formation of spatially and temporally well-defined star formation patterns, such as the CrA chain of clusters, is likely a common process in massive star-forming regions.


title: OV-VG: A Benchmark for Open-Vocabulary Visual Grounding

abstract: Open-vocabulary learning has emerged as a cutting-edge research area, particularly in light of the widespread adoption of vision-based foundational models. Its primary objective is to comprehend novel concepts that are not encompassed within a predefined vocabulary. One key facet of this endeavor is Visual Grounding, which entails locating a specific region within an image based on a corresponding language description. While current foundational models excel at various visual language tasks, there's a noticeable absence of models specifically tailored for open-vocabulary visual grounding. This research endeavor introduces novel and challenging OV tasks, namely Open-Vocabulary Visual Grounding and Open-Vocabulary Phrase Localization. The overarching aim is to establish connections between language descriptions and the localization of novel objects. To facilitate this, we have curated a comprehensive annotated benchmark, encompassing 7,272 OV-VG images and 1,000 OV-PL images. In our pursuit of addressing these challenges, we delved into various baseline methodologies rooted in existing open-vocabulary object detection, VG, and phrase localization frameworks. Surprisingly, we discovered that state-of-the-art methods often falter in diverse scenarios. Consequently, we developed a novel framework that integrates two critical components: Text-Image Query Selection and Language-Guided Feature Attention. These modules are designed to bolster the recognition of novel categories and enhance the alignment between visual and linguistic information. Extensive experiments demonstrate the efficacy of our proposed framework, which consistently attains SOTA performance across the OV-VG task. Additionally, ablation studies provide further evidence of the effectiveness of our innovative models. Codes and datasets will be made publicly available at https://github.com/cv516Buaa/OV-VG.


title: Non-null and Force-Free Electromagnetic Configurations in Kerr Geometry

abstract: Force-Free Electrodynamics (FFE) is known to describe the highly magnetized plasma around pulsars and astrophysical black holes. The equations describing FFE are highly non-linear and the task of finding a well-defined analytical solution has been unyielding. However, FFE can also be understood in terms of 2-dimensional foliations of the ambient 4-dimensional spacetime. The study of the foliations can provide significant insights into the structure of the force-free fields and such foliations can be exploited to generate new null and non-null solutions. In this paper, we present several nonnull solutions to the FFE equations in the Kerr spacetime obtained by applying the aforementioned methods of non-null foliations.


title: Activity-driven emulsification of phase-separating binary mixtures

abstract: Systems containing active components are intrinsically out of equilibrium, while binary mixtures reach their equilibrium configuration when complete phase separation is achieved. Active particles are found to stabilise non-equilibrium morphologies in phase separating binary mixtures by arresting coarsening by exerting active pressure that competes with surface tension driving forces. For moderate activities, an emulsion morphology is stabilised, where the droplet size is well-defined and controlled by activity. Conversely, the ability of active particles to drive phase-separated mixtures away from their equilibrium configuration is shown. A rich co-assembly behaviour is shown due to the competing energy scales involved in the system.


title: The Oxygen Reduction Pathway for Spinel Metal Oxides in Alkaline Media: An Experimentally Supported Ab Initio Study

abstract: Precious-metal-free spinel oxide electrocatalysts are promising candidates for catalyzing the oxygen reduction reaction (ORR) in alkaline fuel cells. In this theory-driven study, we use joint density-functional theory in tandem with supporting electrochemical measurements to identify a novel theoretical pathway for the ORR on cubic Co3O4 nanoparticle electrocatalysts. This pathway aligns more closely with experimental results than previous models. The new pathway employs the cracked adsorbates *(OH)(O) and *(OH)(OH), which, through hydrogen bonding, induce spectator surface *H. This results in an onset potential closely matching experimental values, in stark contrast to the traditional ORR pathway, which keeps adsorbates intact and overestimates the onset potential by 0.7 V. Finally, we introduce electrochemical strain spectroscopy (ESS), a groundbreaking strain analysis technique. ESS combines ab initio calculations with experimental measurements to validate proposed reaction pathways and pinpoint rate-limiting steps.


title: Teleparallel Robertson-Walker geometries and applications

abstract: In teleparallel geometries the coframe and corresponding spin-connection are the principal geometric objects and consequently the appropriate definition of a symmetry is that of an affine symmetry. The set of invariant coframes and their corresponding spin connections that respect the full six dimensional Lie algebra of Robertson-Walker affine symmetries are displayed and discussed. We will refer to such geometries as teleparallel Robertson-Walker (TRW) geometries, where the corresponding derived metric is of Robertson-Walker form and is characterized by the parameter $k = (-1,0,1)$. The field equations are explicitly presented for the $F(T)$ class of teleparallel TRW spacetimes. We are primarily interested in investigating the $k \neq 0$ TRW models. After first studying the $k=0$ models and, in particular, writing their governing field equations in an appropriate form, we then study their late time stability with respect to perturbations in $k$ in both the cases of a vanishing and non-vanishing effective cosmological constant term. As an illustration we consider both quadratic $F(T)$ theories and power-law solutions.


title: Offline Metrics for Evaluating Explanation Goals in Recommender Systems

abstract: Explanations are crucial for improving users' transparency, persuasiveness, engagement, and trust in Recommender Systems (RSs). However, evaluating the effectiveness of explanation algorithms regarding those goals remains challenging due to existing offline metrics' limitations. This paper introduces new metrics for the evaluation and validation of explanation algorithms based on the items and properties used to form the sentence of an explanation. Towards validating the metrics, the results of three state-of-the-art post-hoc explanation algorithms were evaluated for six RSs, comparing the offline metrics results with those of an online user study. The findings show the proposed offline metrics can effectively measure the performance of explanation algorithms and highlight a trade-off between the goals of transparency and trust, which are related to popular properties, and the goals of engagement and persuasiveness, which are associated with the diversification of properties displayed to users. Furthermore, the study contributes to the development of more robust evaluation methods for explanation algorithms in RSs.


title: Modeling Link-level Road Traffic Resilience to Extreme Weather Events Using Crowdsourced Data

abstract: Climate changes lead to more frequent and intense weather events, posing escalating risks to road traffic. Crowdsourced data offer new opportunities to monitor and investigate changes in road traffic flow during extreme weather. This study utilizes diverse crowdsourced data from mobile devices and the community-driven navigation app, Waze, to examine the impact of three weather events (i.e., floods, winter storms, and fog) on road traffic. Three metrics, speed change, event duration, and area under the curve (AUC), are employed to assess link-level traffic change and recovery. In addition, a user's perceived severity is computed to evaluate link-level weather impact based on crowdsourced reports. This study evaluates a range of new data sources, and provides insights into the resilience of road traffic to extreme weather, which are crucial for disaster preparedness, response, and recovery in road transportation systems.


title: Hadwiger's problem for bodies with enough sub-Gaussian marginals

abstract: Hadwiger's conjecture in convex geometry, formulated in 1957, states that every convex body in $\mathbb{R}^n$ can be covered by $2^n$ translations of its interior. Despite significant efforts, the best known bound related to this problem was $\mathcal{O}(4^n \sqrt{n} \log n)$ for more than sixty years. In 2021, Huang, Slomka, Tkocz, and Vritsiou made a major breakthrough by improving the estimate by a factor of $\exp\left(\Omega(\sqrt{n})\right)$. Further, for $\psi_2$ bodies they proved that at most $\exp(-\Omega(n))\cdot4^n$ translations of its interior are needed to cover it. Through a probabilistic approach we show that the bound $\exp(-\Omega(n))\cdot4^n$ can be obtained for convex bodies with sufficiently many well-behaved sub-gaussian marginals. Using a small diameter approximation, we present how the currently best known bound for the general case, due to Campos, Van Hintum, Morris, and Tiba can also be deduced from our results.


title: Grupos y geometr\'ia cubular

abstract: This survey paper, written in spanish, is an extended version of lecture notes for a mini-course taught at the 2022 Summer School in Geometric Group Theory, which took place in the Centro de Ciencias Matem\'aticas in Morelia, Mexico in July 2022. Its main aim is to give an introduction to the study of non-positively curved cube complexes, and through these, to introduce the reader to geometric group theory.


title: Is A 15-minute City within Reach in the United States? An Investigation of Activity-Based Mobility Flows in the 12 Most Populous US Cities

abstract: Enhanced efforts in the transportation sector should be implemented to mitigate the adverse effects of CO2 emissions resulting from zoning-based planning paradigms. The innovative concept of the 15-minute city, with a focus on proximity-based planning, holds promise in minimizing unnecessary travel and advancing the progress toward achieving carbon neutrality. However, an important research question that remains insufficiently explored is: to what extent is a 15-minute city concept within reach for US cities? This paper establishes a comprehensive framework to evaluate the 15-minute city concept using SafeGraph Point of Interest (POI) check-in data in the 12 most populous US cities. The results reveal that residents are more likely to rely on cars due to the fact that most of their essential activities are located beyond convenient walking, cycling, and public transit distances. However, there is significant potential for the implementation of the 15-minute city concept, as most residents' current activities can be accommodated within a 15-minute radius by the aforementioned low-emission modes of transportation. Our findings can offer policymakers insight into how far US cities are away from the 15-minute city and the potential CO2 emission reduction they can expect if the concept is successfully implemented.


title: ARCOQ: Arabic Closest Opposite Questions Dataset

abstract: This paper presents a dataset for closest opposite questions in Arabic language. The dataset is the first of its kind for the Arabic language. It is beneficial for the assessment of systems on the aspect of antonymy detection. The structure is similar to that of the Graduate Record Examination (GRE) closest opposite questions dataset for the English language. The introduced dataset consists of 500 questions, each contains a query word for which the closest opposite needs to be determined from among a set of candidate words. Each question is also associated with the correct answer. We publish the dataset publicly in addition to providing standard splits of the dataset into development and test sets. Moreover, the paper provides a benchmark for the performance of different Arabic word embedding models on the introduced dataset.


title: Minimum Decomposition on Maxmin Trees

abstract: Maxmin trees are trees that consist of nodes that are either local minimums or maximums. Such trees were first studied by Postnikov. Later Dugan, Glennon, Gunnells, and Steingrimsson introduced the concept of weight to these trees and proved a bijection between maximum weight maxmin trees and permutations, defining weights for permutations. In addition, the q-Eulerian polynomial $E_n(x, q)$ is defined which relates descents and weights of permutations. This polynomial was later proven to exhibit a stabilization phenomenon by Agrawal et al. Extracting the formal power series $W_d(t)$ from the stabilization of these coefficients, $W_d(t)$ was conjectured to partially correspond to A256193. In our paper, we introduce a process called minimum decomposition to help us better understand maxmin trees. Using minimum decomposition, we present a new way to calculate the weight of different maxmin trees and prove the bijection between the coefficients of $W_d(t)$ and A256193.


title: Learning Generalizable Manipulation Policies with Object-Centric 3D Representations

abstract: We introduce GROOT, an imitation learning method for learning robust policies with object-centric and 3D priors. GROOT builds policies that generalize beyond their initial training conditions for vision-based manipulation. It constructs object-centric 3D representations that are robust toward background changes and camera views and reason over these representations using a transformer-based policy. Furthermore, we introduce a segmentation correspondence model that allows policies to generalize to new objects at test time. Through comprehensive experiments, we validate the robustness of GROOT policies against perceptual variations in simulated and real-world environments. GROOT's performance excels in generalization over background changes, camera viewpoint shifts, and the presence of new object instances, whereas both state-of-the-art end-to-end learning methods and object proposal-based approaches fall short. We also extensively evaluate GROOT policies on real robots, where we demonstrate the efficacy under very wild changes in setup. More videos and model details can be found in the appendix and the project website: https://ut-austin-rpl.github.io/GROOT .


title: Gravitational Instantons, Weyl Curvature, and Conformally Kaehler Geometry

abstract: In a previous paper, the first two authors classified complete Ricci-flat ALF Riemannian 4-manifolds that are toric and Hermitian, but non-Kaehler. In this article, we consider general Ricci-flat deformations of such spaces, assuming only suitable fall-off conditions. Quite generally, we are able to show that such a deformation must be Hermitian, and must carry a non-trivial Killing vector field with fixed asymptotics. With mild additional hypotheses, we are then able to show that the new Ricci-flat metric must in fact belong to the family of previously classified metrics.


title: Kinetic simulations of non-relativistic high-Mach-number perpendicular shocks propagating in a turbulent medium

abstract: Strong non-relativistic shocks are known to accelerate particles up to relativistic energies. However, for Diffusive Shock Acceleration electrons must have a highly suprathermal energy, implying a need for very efficient pre-acceleration. Most published studies consider shocks propagating through homogeneous plasma, which is an unrealistic assumption for astrophysical environments. Using 2D3V particle-in-cell simulations, we investigate electron acceleration and heating processes at non-relativistic high-Mach-number shocks in electron-ion plasma with a turbulent upstream medium. For this purpose slabs of plasma with compressive turbulence are separately simulated and then inserted into shock simulations, which requires matching of the plasma slabs at the interface. Using a novel procedure of matching electromagnetic fields and currents, we perform simulations of perpendicular shocks setting different intensities of density fluctuations ($\lesssim 10\%$) in the upstream. The new simulation technique provides a framework for studying shocks propagating in turbulent media. We explore the impact of the fluctuations on electron heating, the dynamics of upstream electrons, and the driving of plasma instabilities. Our results indicate that while the presence of the turbulence enhances variations in the upstream magnetic field, their levels remain too low to influence significantly the behavior of electrons at perpendicular shocks.


title: Evaluating Subjective Cognitive Appraisals of Emotions from Large Language Models

abstract: The emotions we experience involve complex processes; besides physiological aspects, research in psychology has studied cognitive appraisals where people assess their situations subjectively, according to their own values (Scherer, 2005). Thus, the same situation can often result in different emotional experiences. While the detection of emotion is a well-established task, there is very limited work so far on the automatic prediction of cognitive appraisals. This work fills the gap by presenting CovidET-Appraisals, the most comprehensive dataset to-date that assesses 24 appraisal dimensions, each with a natural language rationale, across 241 Reddit posts. CovidET-Appraisals presents an ideal testbed to evaluate the ability of large language models -- excelling at a wide range of NLP tasks -- to automatically assess and explain cognitive appraisals. We found that while the best models are performant, open-sourced LLMs fall short at this task, presenting a new challenge in the future development of emotionally intelligent models. We release our dataset at https://github.com/honglizhan/CovidET-Appraisals-Public.


title: Cross-Domain HAR: Few Shot Transfer Learning for Human Activity Recognition

abstract: The ubiquitous availability of smartphones and smartwatches with integrated inertial measurement units (IMUs) enables straightforward capturing of human activities. For specific applications of sensor based human activity recognition (HAR), however, logistical challenges and burgeoning costs render especially the ground truth annotation of such data a difficult endeavor, resulting in limited scale and diversity of datasets. Transfer learning, i.e., leveraging publicly available labeled datasets to first learn useful representations that can then be fine-tuned using limited amounts of labeled data from a target domain, can alleviate some of the performance issues of contemporary HAR systems. Yet they can fail when the differences between source and target conditions are too large and/ or only few samples from a target application domain are available, each of which are typical challenges in real-world human activity recognition scenarios. In this paper, we present an approach for economic use of publicly available labeled HAR datasets for effective transfer learning. We introduce a novel transfer learning framework, Cross-Domain HAR, which follows the teacher-student self-training paradigm to more effectively recognize activities with very limited label information. It bridges conceptual gaps between source and target domains, including sensor locations and type of activities. Through our extensive experimental evaluation on a range of benchmark datasets, we demonstrate the effectiveness of our approach for practically relevant few shot activity recognition scenarios. We also present a detailed analysis into how the individual components of our framework affect downstream performance.


title: Performance bounds for Reduced Order Models with Application to Parametric Transport

abstract: The Kolmogorov $n$-width is an established benchmark to judge the performance of reduced basis and similar methods that produce linear reduced spaces. Although immensely successful in the elliptic regime, this width, shows unsatisfactory slow convergence rates for transport dominated problems. While this has triggered a large amount of work on nonlinear model reduction techniques, we are lacking a benchmark to evaluate their optimal performance. Nonlinear benchmarks like manifold/stable/Lipschitz width applied to the solution manifold are often trivial if the degrees of freedom exceed the parameter dimension and ignore desirable structure as offline/online decompositions. In this paper, we show that the same benchmarks applied to the full reduced order model pipeline from PDE to parametric quantity of interest provide non-trivial benchmarks and we prove lower bounds for transport equations.


title: Effects of phylogeny on coexistence in model communities

abstract: Species' interactions are shaped by their traits. Thus, we expect traits -- in particular, trait (dis)similarity -- to play a central role in determining whether a particular set of species coexists. Traits are, in turn, the outcome of an eco-evolutionary process summarized by a phylogenetic tree. Therefore, the phylogenetic tree associated with a set of species should carry information about the dynamics and assembly properties of the community. Many studies have highlighted the potentially complex ways in which this phylogenetic information is translated into species' ecological properties. However, much less emphasis has been placed on developing clear, quantitative expectations for community properties under a particular hypothesis. To address this gap, we couple a simple model of trait evolution on a phylogenetic tree with Lotka-Volterra community dynamics. This allows us to derive properties of a community of coexisting species as a function of the number of traits, tree topology and the size of the species pool. Our analysis highlights how phylogenies, through traits, affect the coexistence of a set of species. Together, these results provide much-needed baseline expectations for the ways in which evolutionary history, summarized by phylogeny, is reflected in the size and structure of ecological communities.


title: Merging Generated and Retrieved Knowledge for Open-Domain QA

abstract: Open-domain question answering (QA) systems are often built with retrieval modules. However, retrieving passages from a given source is known to suffer from insufficient knowledge coverage. Alternatively, prompting large language models (LLMs) to generate contextual passages based on their parametric knowledge has been shown to improve QA performance. Yet, LLMs tend to "hallucinate" content that conflicts with the retrieved knowledge. Based on the intuition that answers supported by both sources are more likely to be correct, we propose COMBO, a Compatibility-Oriented knowledge Merging for Better Open-domain QA framework, to effectively leverage the two sources of information. Concretely, we match LLM-generated passages with retrieved counterparts into compatible pairs, based on discriminators trained with silver compatibility labels. Then a Fusion-in-Decoder-based reader model handles passage pairs to arrive at the final answer. Experiments show that COMBO outperforms competitive baselines on three out of four tested open-domain QA benchmarks. Further analysis reveals that our proposed framework demonstrates greater efficacy in scenarios with a higher degree of knowledge conflicts.


title: Neural Networks are Integrable

abstract: In this study, we explore the integration of Neural Networks, a powerful class of functions known for their exceptional approximation capabilities. Our primary emphasis is on the integration of multi-layer Neural Networks, a challenging task within this domain. To tackle this challenge, we introduce a novel numerical method that consist of a forward algorithm and a corrective procedure. Our experimental results demonstrate the accuracy achieved through our integration approach.


title: Universal representation by Boltzmann machines with Regularised Axons

abstract: It is widely known that Boltzmann machines are capable of representing arbitrary probability distributions over the values of their visible neurons, given enough hidden ones. However, sampling -- and thus training -- these models can be numerically hard. Recently we proposed a regularisation of the connections of Boltzmann machines, in order to control the energy landscape of the model, paving a way for efficient sampling and training. Here we formally prove that such regularised Boltzmann machines preserve the ability to represent arbitrary distributions. This is in conjunction with controlling the number of energy local minima, thus enabling easy \emph{guided} sampling and training. Furthermore, we explicitly show that regularised Boltzmann machines can store exponentially many arbitrarily correlated visible patterns with perfect retrieval, and we connect them to the Dense Associative Memory networks.


title: The Quantum Focusing Conjecture and the Improved Energy Condition

abstract: By rearranging its terms, the Quantum Focusing Conjecture (QFC) can be viewed as a quantum energy condition, and we can consider various limits. A recent restricted version is a limiting form where the quantum focusing vanishes $\Theta \rightarrow 0$, and has been proven for Braneworld scenario. As a result, we derive an improved quantum null energy condition (INEC) $T_{kk}\geq \frac{\hbar}{2\pi \mathcal{A}}\left(S''_{out}-\frac{1}{2}\theta S'_{out}\right)$, that can be proven with field theory techniques. We sketch the beginning of a proof, and briefly discuss possible interpretations in the absence of one.


title: Characterizing the Ordinary Broad-lined Type Ic SN 2023pel from the Energetic GRB 230812B

abstract: We report observations of the optical counterpart of the long gamma-ray burst (LGRB) GRB 230812B, and its associated supernova (SN) SN 2023pel. The proximity ($z = 0.36$) and high energy ($E_{\gamma, \rm{iso}} \sim 10^{53}$ erg) make it an important event to study as a probe of the connection between massive star core-collapse and relativistic jet formation. With a phenomenological power-law model for the optical afterglow, we find a late-time flattening consistent with the presence of an associated SN. SN 2023pel has an absolute peak $r$-band magnitude of $M_r = -19.46 \pm 0.18$ mag (about as bright as SN 1998bw) and evolves on quicker timescales. Using a radioactive heating model, we derive a nickel mass powering the SN of $M_{\rm{Ni}} = 0.38 \pm 0.01$ $\rm{M_\odot}$, and a peak bolometric luminosity of $L_{\rm{bol}} \sim 1.3 \times 10^{43}$ $\rm{erg}$ $\rm{s^{-1}}$. We confirm SN 2023pel's classification as a broad-lined Type Ic SN with a spectrum taken 15.5 days after its peak in $r$ band, and derive a photospheric expansion velocity of $v_{\rm{ph}} = 11,300 \pm 1,600$ $\rm{km}$ $\rm{s^{-1}}$ at that phase. Extrapolating this velocity to the time of maximum light, we derive the ejecta mass $M_{\rm{ej}} = 1.0 \pm 0.6$ $\rm{M_\odot}$ and kinetic energy $E_{\rm{KE}} = 1.3^{+3.3}_{-1.2} \times10^{51}$ $\rm{erg}$. We find that GRB 230812B/SN 2023pel has SN properties that are mostly consistent with the overall GRB-SN population. The lack of correlations found in the GRB-SN population between SN brightness and $E_{\gamma, \rm{iso}}$ for their associated GRBs, across a broad range of 7 orders of magnitude, provides further evidence that the central engine powering the relativistic ejecta is not coupled to the SN powering mechanism in GRB-SN systems.


title: Learning to bag with a simulation-free reinforcement learning framework for robots

abstract: Bagging is an essential skill that humans perform in their daily activities. However, deformable objects, such as bags, are complex for robots to manipulate. This paper presents an efficient learning-based framework that enables robots to learn bagging. The novelty of this framework is its ability to perform bagging without relying on simulations. The learning process is accomplished through a reinforcement learning algorithm introduced in this work, designed to find the best grasping points of the bag based on a set of compact state representations. The framework utilizes a set of primitive actions and represents the task in five states. In our experiments, the framework reaches a 60 % and 80 % of success rate after around three hours of training in the real world when starting the bagging task from folded and unfolded, respectively. Finally, we test the trained model with two more bags of different sizes to evaluate its generalizability.


title: The role of randomization inference in unraveling individual treatment effects in early phase vaccine trials

abstract: Randomization inference is a powerful tool in early phase vaccine trials when estimating the causal effect of a regimen against a placebo or another regimen. Randomization-based inference often focuses on testing either Fisher's sharp null hypothesis of no treatment effect for any participant or Neyman's weak null hypothesis of no sample average treatment effect. Many recent efforts have explored conducting exact randomization-based inference for other summaries of the treatment effect profile, for instance, quantiles of the treatment effect distribution function. In this article, we systematically review methods that conduct exact, randomization-based inference for quantiles of individual treatment effects (ITEs) and extend some results to a special case where na\"ive participants are expected not to exhibit responses to highly specific endpoints. These methods are suitable for completely randomized trials, stratified completely randomized trials, and a matched study comparing two non-randomized arms from possibly different trials. We evaluate the usefulness of these methods using synthetic data in simulation studies. Finally, we apply these methods to HIV Vaccine Trials Network Study 086 (HVTN 086) and HVTN 205 and showcase a wide range of application scenarios of the methods. R code that replicates all analyses in this article can be found in first author's GitHub page at https://github.com/Zhe-Chen-1999/ITE-Inference.


title: A Pytorch Reproduction of Masked Generative Image Transformer

abstract: In this technical report, we present a reproduction of MaskGIT: Masked Generative Image Transformer, using PyTorch. The approach involves leveraging a masked bidirectional transformer architecture, enabling image generation with only few steps (8~16 steps) for 512 x 512 resolution images, i.e., ~64x faster than an auto-regressive approach. Through rigorous experimentation and optimization, we achieved results that closely align with the findings presented in the original paper. We match the reported FID of 7.32 with our replication and obtain 7.59 with similar hyperparameters on ImageNet at resolution 512 x 512. Moreover, we improve over the official implementation with some minor hyperparameter tweaking, achieving FID of 7.26. At the lower resolution of 256 x 256 pixels, our reimplementation scores 6.80, in comparison to the original paper's 6.18. To promote further research on Masked Generative Models and facilitate their reproducibility, we released our code and pre-trained weights openly at https://github.com/valeoai/MaskGIT-pytorch/


title: Analysis and Calibration of Electron-Dispersive Spectroscope and Scanning Electron Microscope Parameters to Improve their Results

abstract: The Scanning electron microscope (SEM) and Electron-Dispersive Spectroscope (EDS) are two highly effective instruments in the field of nanoscience and nanotechnology. The quality of these instruments is determined by various factors, with high resolution being a crucial one. To determine the practically achievable resolution of the SEM, reference materials such as gold particles on carbon substrate are commonly utilized. On the other hand, high demanding, and usual materials such as brass, aluminum oxide or MEMs are of high importance to be considered in the way of improving material characterization. In this study five different samples were analyzed in four steps to see the effect of astigmatism and aperture misalignment, the mirror effect on the charged uncoated sample in backscattered electron (BSE) and secondary electron (SE) images, compositional and topographical analysis using both qualitative and quantitative methods and finally apply all the steps on a micro-electromechanical system (MEMS) device. This study illustrates the possibility of controlling the mirror effect by adjusting the input parameters even in the cases that the user needs to have low accelerating voltage for the experiment. Besides, the discussion addresses possible reasons for the absence of some peaks in EDS analysis for some specific elements.


title: Value of Assistance for Grasping

abstract: In multiple realistic settings, a robot is tasked with grasping an object without knowing its exact pose and relies on a probabilistic estimation of the pose to decide how to attempt the grasp. We support settings in which it is possible to provide the robot with an observation of the object before a grasp is attempted but this possibility is limited and there is a need to decide which sensing action would be most beneficial. We support this decision by offering a novel Value of Assistance (VOA) measure for assessing the expected effect a specific observation will have on the robot's ability to complete its task. We evaluate our suggested measure in simulated and real-world collaborative grasping settings.


title: O3D: Offline Data-driven Discovery and Distillation for Sequential Decision-Making with Large Language Models

abstract: Recent advancements in large language models (LLMs) have exhibited promising performance in solving sequential decision-making problems. By imitating few-shot examples provided in the prompts (i.e., in-context learning), an LLM agent can interact with an external environment and complete given tasks without additional training. However, such few-shot examples are often insufficient to generate high-quality solutions for complex and long-horizon tasks, while the limited context length cannot consume larger-scale demonstrations with long interaction horizons. To this end, we propose an offline learning framework that utilizes offline data at scale (e.g, logs of human interactions) to improve LLM-powered policies without finetuning. The proposed method O3D (Offline Data-driven Discovery and Distillation) automatically discovers reusable skills and distills generalizable knowledge across multiple tasks based on offline interaction data, advancing the capability of solving downstream tasks. Empirical results under two interactive decision-making benchmarks (ALFWorld and WebShop) verify that O3D can notably enhance the decision-making capabilities of LLMs through the offline discovery and distillation process, and consistently outperform baselines across various LLMs.


title: Be Selfish, But Wisely: Investigating the Impact of Agent Personality in Mixed-Motive Human-Agent Interactions

abstract: A natural way to design a negotiation dialogue system is via self-play RL: train an agent that learns to maximize its performance by interacting with a simulated user that has been designed to imitate human-human dialogue data. Although this procedure has been adopted in prior work, we find that it results in a fundamentally flawed system that fails to learn the value of compromise in a negotiation, which can often lead to no agreements (i.e., the partner walking away without a deal), ultimately hurting the model's overall performance. We investigate this observation in the context of the DealOrNoDeal task, a multi-issue negotiation over books, hats, and balls. Grounded in negotiation theory from Economics, we modify the training procedure in two novel ways to design agents with diverse personalities and analyze their performance with human partners. We find that although both techniques show promise, a selfish agent, which maximizes its own performance while also avoiding walkaways, performs superior to other variants by implicitly learning to generate value for both itself and the negotiation partner. We discuss the implications of our findings for what it means to be a successful negotiation dialogue system and how these systems should be designed in the future.


title: A Novel Quasiparticle Method for Solid State Ion Transport

abstract: The quasiparticle method, which has achieved a great success in solid state electronics and crystal lattice vibration, is adopted to study the solid state ion transport. A general recipe is put forward to map the classical solid state ion system together with the short-range ion-ion repulsion to a quasiparticle quantum system based on which simple tight-binding models are set up to study popular solid state ionic issues. The derived ionic eigen-states and transport can naturally incorporate the concerted behavior. The influence of mobile ion doping to ionic conductivity is investigated by an explicit mean-field expression of ion-ion Coulomb interaction to reveal the mechanism of super-ionic conduction. Similar trick is also applied to study the the Onsager transport originated from ion-electron interference. The so called high-entropy mechanism is also explored where the lattice random distorsion and multi-site percolation exhibit positive influence to increase ionic conductivity. Our method is expected to provide a novel framework to understand and study the solid state ion transport.


title: Urban wireless traffic evolution: the role of new devices and the effect of policy

abstract: The emergence of new wireless technologies, such as the Internet of Things, allows digitalizing new and diverse urban activities. Thus, wireless traffic grows in volume and complexity, making prediction, investment planning, and regulation increasingly difficult. This article characterizes urban wireless traffic evolution, supporting operators to drive mobile network evolution and policymakers to increase national and local competitiveness. We propose a holistic method that widens previous research scope, including new devices and the effect of policy from multiple government levels. We provide an analytical formulation that combines existing complementary methods on traffic evolution research and diverse data sources. Results for a centric area of Helsinki during 2020-2030 indicate that daily volumes increase, albeit a surprisingly large part of the traffic continues to be generated by smartphones. Machine traffic gains importance, driven by surveillance video cameras and connected cars. While camera traffic is sensitive to law enforcement policies and data regulation, car traffic is less affected by transport electrification policy. High-priority traffic remains small, even under encouraging autonomous vehicle policies. We suggest that 5G small cells might be needed around 2025, albeit the utilization of novel radio technology and additional mid-band spectrum could delay this need until 2029. We argue that mobile network operators inevitably need to cooperate in constructing a single, shared small cell network to mitigate the high deployment costs of massively deploying small cells. We also provide guidance to local and national policymakers for IoT-enabled competitive gains via the mitigation of five bottlenecks. For example, local monopolies for mmWave connectivity should be facilitated on space-limited urban furniture or risk an eventual capacity crunch, slowing down digitalization.


title: The progenitor of SN 2023ixf from hydrodynamical modelling

abstract: Context: Supernova (SN) 2023ixf is among the most nearby Type II SNe in the last decades. As such, there is a wealth of observational data of both the event itself and of the associated object identified in pre-explosion images. This allows to perform a variety of studies that aim at determining the SN properties and the nature of the putative progenitor star. Modelling of the light curve is a powerful method to derive physical properties independently of direct progenitor analyses. Aims: To investigate the physical nature of SN 2023ixf based on hydrodynamical modelling of its bolometric light curve and expansion velocities during the complete photospheric phase. Methods: A grid of one dimensional explosions was calculated for evolved stars of different masses. We derived properties of SN 2023ixf and its progenitor by comparing our models with the observations. Results: The observations are well reproduced by the explosion of a star with zero age main sequence mass of f $M_\mathrm{ZAMS} = 12 M_\odot$ , an explosion energy of $1.2 \times 10^{51}$ erg, and a nickel production of 0.05M . This indicates that SN 2023ixf was a normal event. Our modelling suggests a limit of $M_\mathrm{ZAMS} < 15 M_\odot$ and therefore favours the low mass range among the results from pre-explosion observations.


title: PaRaDe: Passage Ranking using Demonstrations with Large Language Models

abstract: Recent studies show that large language models (LLMs) can be instructed to effectively perform zero-shot passage re-ranking, in which the results of a first stage retrieval method, such as BM25, are rated and reordered to improve relevance. In this work, we improve LLM-based re-ranking by algorithmically selecting few-shot demonstrations to include in the prompt. Our analysis investigates the conditions where demonstrations are most helpful, and shows that adding even one demonstration is significantly beneficial. We propose a novel demonstration selection strategy based on difficulty rather than the commonly used semantic similarity. Furthermore, we find that demonstrations helpful for ranking are also effective at question generation. We hope our work will spur more principled research into question generation and passage ranking.


title: Combining Learning and Control in Linear Systems

abstract: In this paper, we provide a theoretical framework that separates the control and learning tasks in a linear system. This separation allows us to combine offline model-based control with online learning approaches and thus circumvent current challenges in deriving optimal control strategies in applications where a large volume of data is added to the system gradually in real time and not altogether in advance. We provide an analytical example to illustrate the framework.


title: LF-Covers and Binomial Edge Ideals of K\"{o}nig Type

abstract: We give a combinatorial characterisation of connected graphs whose binomial edge ideals are of K\"{o}nig type, developed independently to the similar characterisation given by LaClair in arXiv:2304.13299, and exhibit some classes of graphs satisfying our criteria. For any connected Hamiltonian graph $G$ on $n$ vertices, we compute an explicit root of $H_{J(G)}^{n-1}(R)$ as an $F$-finite $F$-module.


title: Violation of the Einstein's Equivalence Principle for a Composite Quantum Body

abstract: Recently, we have started to investigate behavior of a composite quantum body in an external gravitational field in the framework of General Relativity [see, for a review, A. G. Lebed, Mod. Phys. Lett. A, {\bf 35}, 2030010 (2020)]. As the simplest example, we have considered a hydrogen atom in a weak gravitational field. Our results are the following. The Einstein's Equivalence Principle survives for the most of macroscopic ensembles of the atoms, containing the stationary quantum states. On the other hand, we have demonstrated that this principle is sometimes broken. In particular, it is broken for the so-called Gravitational demons, which are the coherent macroscopic ensembles of two or more stationary quantum states in the hydrogen atoms. In the above cited paper we have considered the Gedanken experiment, where the gravitational field is suddenly switched on in a free from gravitation space. In the current paper we consider the much more realistic from experimental point of view Gedanken experiment and come to the same conclusion about violations of the Einstein's Equivalence Principle for the Gravitational demons.


title: Stability of Llarull's theorem in all dimensions

abstract: Llarull's theorem characterizes the round sphere $S^n$ among all spin manifolds whose scalar curvature is bounded from below by $n(n-1)$. In this paper we show that if the scalar curvature is bounded from below by $n(n-1)-\varepsilon$, the underlying manifold is $C^0$-close to a finite number of spheres outside a small bad set. This completely solves Gromov's spherical stability problem.


title: Data Augmentation: a Combined Inductive-Deductive Approach featuring Answer Set Programming

abstract: Although the availability of a large amount of data is usually given for granted, there are relevant scenarios where this is not the case; for instance, in the biomedical/healthcare domain, some applications require to build huge datasets of proper images, but the acquisition of such images is often hard for different reasons (e.g., accessibility, costs, pathology-related variability), thus causing limited and usually imbalanced datasets. Hence, the need for synthesizing photo-realistic images via advanced Data Augmentation techniques is crucial. In this paper we propose a hybrid inductive-deductive approach to the problem; in particular, starting from a limited set of real labeled images, the proposed framework makes use of logic programs for declaratively specifying the structure of new images, that is guaranteed to comply with both a set of constraints coming from the domain knowledge and some specific desiderata. The resulting labeled images undergo a dedicated process based on Deep Learning in charge of creating photo-realistic images that comply with the generated label.


title: Vision Language Models in Autonomous Driving: A Survey and Outlook

abstract: The applications of Vision-Language Models (VLMs) in the field of Autonomous Driving (AD) have attracted widespread attention due to their outstanding performance and the ability to leverage Large Language Models (LLMs). By incorporating language data, driving systems can gain a better understanding of real-world environments, thereby enhancing driving safety and efficiency. In this work, we present a comprehensive and systematic survey of the advances in vision language models in this domain, encompassing perception and understanding, navigation and planning, decision-making and control, end-to-end autonomous driving, and data generation. We introduce the mainstream VLM tasks in AD and the commonly utilized metrics. Additionally, we review current studies and applications in various areas and summarize the existing language-enhanced autonomous driving datasets thoroughly. Lastly, we discuss the benefits and challenges of VLMs in AD and provide researchers with the current research gaps and future trends.


title: A New Discriminant for the Hardy Z-Function and the Corrected Gram's law

abstract: In this paper, we introduce a novel variational framework rooted in algebraic geometry for the analysis of the Hardy $Z$-function. Our primary contribution lies in the definition and exploration of $\Delta_n(\overline{a})$, a newly devised discriminant that measures the realness of consecutive zeros of $Z(t)$. Our investigation into $\Delta_n(\overline{a})$ and its properties yields a wealth of compelling insights into the zeros of $Z(t)$, including the corrected Gram's law, the second-order approximation of $\Delta_n(\overline{a})$, and the discovery of the G-B-G repulsion relation. Collectively, these results provide compelling evidence supporting a new plausibility argument for the Riemann hypothesis.


title: ConViViT -- A Deep Neural Network Combining Convolutions and Factorized Self-Attention for Human Activity Recognition

abstract: The Transformer architecture has gained significant popularity in computer vision tasks due to its capacity to generalize and capture long-range dependencies. This characteristic makes it well-suited for generating spatiotemporal tokens from videos. On the other hand, convolutions serve as the fundamental backbone for processing images and videos, as they efficiently aggregate information within small local neighborhoods to create spatial tokens that describe the spatial dimension of a video. While both CNN-based architectures and pure transformer architectures are extensively studied and utilized by researchers, the effective combination of these two backbones has not received comparable attention in the field of activity recognition. In this research, we propose a novel approach that leverages the strengths of both CNNs and Transformers in an hybrid architecture for performing activity recognition using RGB videos. Specifically, we suggest employing a CNN network to enhance the video representation by generating a 128-channel video that effectively separates the human performing the activity from the background. Subsequently, the output of the CNN module is fed into a transformer to extract spatiotemporal tokens, which are then used for classification purposes. Our architecture has achieved new SOTA results with 90.05 \%, 99.6\%, and 95.09\% on HMDB51, UCF101, and ETRI-Activity3D respectively.


title: Collective charge excitations between moir\'e-minibands in twisted WSe2 bilayers from resonant inelastic light scattering

abstract: We establish low-temperature resonant inelastic light scattering (RILS) spectroscopy as a tool to probe the formation of a series of moir\'e-bands in twisted WSe_{2} bilayers by accessing collective intermoir\'e-band excitations (IMBE). We observe resonances in RILS spectra at energies in agreement with inter-moir\'e band transitions obtained from an ab-initio based continuum model. Transitions between the first and second inter-moir\'e band for a twist angle of about 8{\deg} are reported and between first and second, third and higher bands for a twist of about 3{\deg}. The signatures from IMBE for the latter highlight a strong departure from parabolic bands with flat minibands exhibiting very high density of states in accord with theory. These observations allow to quantify the transition energies at the K-point where the states relevant for correlation physics are hosted.


title: REFER: An End-to-end Rationale Extraction Framework for Explanation Regularization

abstract: Human-annotated textual explanations are becoming increasingly important in Explainable Natural Language Processing. Rationale extraction aims to provide faithful (i.e., reflective of the behavior of the model) and plausible (i.e., convincing to humans) explanations by highlighting the inputs that had the largest impact on the prediction without compromising the performance of the task model. In recent works, the focus of training rationale extractors was primarily on optimizing for plausibility using human highlights, while the task model was trained on jointly optimizing for task predictive accuracy and faithfulness. We propose REFER, a framework that employs a differentiable rationale extractor that allows to back-propagate through the rationale extraction process. We analyze the impact of using human highlights during training by jointly training the task model and the rationale extractor. In our experiments, REFER yields significantly better results in terms of faithfulness, plausibility, and downstream task accuracy on both in-distribution and out-of-distribution data. On both e-SNLI and CoS-E, our best setting produces better results in terms of composite normalized relative gain than the previous baselines by 11% and 3%, respectively.


title: An RKHS Approach for Variable Selection in High-dimensional Functional Linear Models

abstract: High-dimensional functional data has become increasingly prevalent in modern applications such as high-frequency financial data and neuroimaging data analysis. We investigate a class of high-dimensional linear regression models, where each predictor is a random element in an infinite dimensional function space, and the number of functional predictors p can potentially be much greater than the sample size n. Assuming that each of the unknown coefficient functions belongs to some reproducing kernel Hilbert space (RKHS), we regularized the fitting of the model by imposing a group elastic-net type of penalty on the RKHS norms of the coefficient functions. We show that our loss function is Gateaux sub-differentiable, and our functional elastic-net estimator exists uniquely in the product RKHS. Under suitable sparsity assumptions and a functional version of the irrepresentible condition, we derive a non-asymptotic tail bound for the variable selection consistency of our method. The proposed method is illustrated through simulation studies and a real-data application from the Human Connectome Project.


title: Monte Carlo Thought Search: Large Language Model Querying for Complex Scientific Reasoning in Catalyst Design

abstract: Discovering novel catalysts requires complex reasoning involving multiple chemical properties and resultant trade-offs, leading to a combinatorial growth in the search space. While large language models (LLM) have demonstrated novel capabilities for chemistry through complex instruction following capabilities and high quality reasoning, a goal-driven combinatorial search using LLMs has not been explored in detail. In this work, we present a Monte Carlo Tree Search-based approach that improves beyond state-of-the-art chain-of-thought prompting variants to augment scientific reasoning. We introduce two new reasoning datasets: 1) a curation of computational chemistry simulations, and 2) diverse questions written by catalysis researchers for reasoning about novel chemical conversion processes. We improve over the best baseline by 25.8\% and find that our approach can augment scientist's reasoning and discovery process with novel insights.