title: An Irredundant Decomposition of Data Flow with Affine Dependences

abstract: Optimization pipelines targeting polyhedral programs try to maximize the compute throughput. Traditional approaches favor reuse and temporal locality; while the communicated volume can be low, failure to optimize spatial locality may cause a low I/O performance. Memory allocation schemes using data partitioning such as data tiling can improve the spatial locality, but they are domain-specific and rarely applied by compilers when an existing allocation is supplied. In this paper, we propose to derive a partitioned memory allocation for tiled polyhedral programs using their data flow information. We extend the existing MARS partitioning to handle affine dependences, and determine which dependences can lead to a regular, simple control flow for communications. While this paper consists in a theoretical study, previous work on data partitioning in inter-node scenarios has shown performance improvements due to better bandwidth utilization.


title: Editable Stain Transformation Of Histological Images Using Unpaired GANs

abstract: Double staining in histopathology, particularly for metaplastic breast cancer, typically employs H&E and P63 dyes. However, P63's tissue damage and high cost necessitate alternative methods. This study introduces xAI-CycleGAN, an advanced architecture combining Mask CycleGAN with explainability features and structure-preserving capabilities for transforming H&E stained breast tissue images into P63-like images. The architecture allows for output editing, enhancing resemblance to actual images and enabling further model refinement. We showcase xAI-CycleGAN's efficacy in maintaining structural integrity and generating high-quality images. Additionally, a histopathologist survey indicates the generated images' realism is often comparable to actual images, validating our model's high-quality output.


title: Vertex algebras from divisors on Calabi-Yau threefolds

abstract: We construct vertex algebras $\mathbb{V}(Y,S)$ from divisors $S$ on toric Calabi-Yau threefolds $Y$, satisfying conjectures of Gaiotto-Rapcak and Feigin-Gukov, as the kernel of screening operators on lattice vertex algebras determined by the GKM graph of $Y$ and a filtration on $\mathcal{O}_S$. We prove that there are representations of $\mathbb{V}(Y,S)$ on the homology groups of various moduli spaces of coherent sheaves on $Y$ supported on $S$ constructed in a companion paper with Rapcak, defined by certain Hecke modifications of these sheaves along points and curve classes in the divisor $S$. This generalizes the common mathematical formulation of a conjecture of Alday-Gaiotto-Tachikawa, the special case in which $Y=\mathbb{C}^3$ and $S=r[\mathbb{C}^2]$, to toric threefolds and divisors as proposed by Gaiotto-Rapcak. We outline an approach to the general conjecture and prove many special cases and partial results using tools developed in the companion paper, following the proof of the original conjecture by Schiffmann-Vasserot and its generalization to divisors in $\mathbb{C}^3$ by Rapcak-Soibelman-Yang-Zhao. The vertex algebras $\mathbb{V}(Y,S)$ conjecturally include $W$-superalgebras $ W_{f_0,f_1}^\kappa(\mathfrak{gl}_{m|n})$ and genus zero class $\mathcal{S}$ chiral algebras $\mathbb{V}^{\mathcal{S}}_{\text{Gl}_m;f_1,...,f_k}$, each for general nilpotents $f_i$. By definition, this implies the existence of a family of compatible free field realizations of these vertex algebras, relevant to their parabolic induction and inverse quantum Hamiltonian reduction. We prove these conjectures in the examples of lowest non-trivial rank for each case, and outline the proof in general for some cases.

categories: math.RT hep-th math-ph math.AG math.MP math.QA


title: Quantum Optics with Rydberg Superatoms

abstract: Quantum optics based on highly excited atoms, also known as Rydberg atoms, has cemented itself as a powerful platform for the manipulation of light at the few-photon level. The Rydberg blockade, resulting from the strong interaction between individual Rydberg atoms, can turn a large ensemble of atoms into a system which collectively resembles a single two-level emitter, a so-called Rydberg superatom. The coupling of this artificial emitter to a driving photonic mode is collectively enhanced by Rydberg interactions, enabling strong coherent coupling at the few-photon level in free-space. The exquisite level of control achievable through this has already demonstrated its utility in applications of quantum computing and information processing. Here, we review the derivation of the collective coupling between a Rydberg superatom and a single light mode and discuss the similarity of this free-space setup to waveguide quantum electrodynamics systems of quantum emitters coupled to photonic waveguides. We also briefly review applications of Rydberg superatoms to quantum optics such as single-photon generation and single-photon subtraction.


title: Engineering Phase Competition Between Stripe Order and Superconductivity in La$_{1.88}$Sr$_{0.12}$CuO$_4$

abstract: Unconventional superconductivity often couples to other electronic orders in a cooperative or competing fashion. Identifying external stimuli that tune between these two limits is of fundamental interest. Here, we show that $c$-axis strain couples directly to the competing interaction between charge stripe order and superconductivity in La$_{1.88}$Sr$_{0.12}$CuO$_4$ (LSCO). Compressive $c$-axis pressure amplifies stripe order within the superconducting state, while having no impact on the normal state. By contrast, strain dramatically diminishes the magnetic field enhancement of stripe order in the superconducting state. This observation hints to the existence of a ground state without phase competition. As such, c-axis pressure is a promising tuning parameter in the search for ground states where superconductivity adopts broken translational symmetry from charge ordering phenomena.


title: MIRACLE: Inverse Reinforcement and Curriculum Learning Model for Human-inspired Mobile Robot Navigation

abstract: In emergency scenarios, mobile robots must navigate like humans, interpreting stimuli to locate potential victims rapidly without interfering with first responders. Existing socially-aware navigation algorithms face computational and adaptability challenges. To overcome these, we propose a solution, MIRACLE -- an inverse reinforcement and curriculum learning model, that employs gamified learning to gather stimuli-driven human navigational data. This data is then used to train a Deep Inverse Maximum Entropy Reinforcement Learning model, reducing reliance on demonstrator abilities. Testing reveals a low loss of 2.7717 within a 400-sized environment, signifying human-like response replication. Current databases lack comprehensive stimuli-driven data, necessitating our approach. By doing so, we enable robots to navigate emergency situations with human-like perception, enhancing their life-saving capabilities.


title: Metallic mean Wang tiles I: self-similarity, aperiodicity and minimality

abstract: For every positive integer $n$, we introduce a set $\mathcal{T}_n$ made of $(n+3)^2$ Wang tiles (unit squares with labeled edges). We represent a tiling by translates of these tiles as a configuration $\mathbb{Z}^2\to\mathcal{T}_n$. A configuration is valid if the common edge of adjacent tiles have the same label. For every $n\geq1$, we show that the Wang shift $\Omega_n$ defined as the set of valid configurations over the tiles $\mathcal{T}_n$ is self-similar, aperiodic and minimal for the shift action. We say that $\{\Omega_n\}_{n\geq1}$ is a family of metallic mean Wang shifts since the inflation factor of the self-similarity of $\Omega_n$ is the positive root of the polynomial $x^2-nx-1$. This root is sometimes called the $n$-th metallic mean, and in particular, the golden mean when $n=1$ and the silver mean when $n=2$. When $n=1$, the set of Wang tiles $\mathcal{T}_1$ is equivalent to the Ammann aperiodic set of 16 Wang tiles.


title: Quantum Picturalism: Learning Quantum Theory in High School

abstract: Quantum theory is often regarded as challenging to learn and teach, with advanced mathematical prerequisites ranging from complex numbers and probability theory to matrix multiplication, vector space algebra and symbolic manipulation within the Hilbert space formalism. It is traditionally considered an advanced undergraduate or graduate-level subject. In this work, we challenge the conventional view by proposing "Quantum Picturalism" as a new approach to teaching the fundamental concepts of quantum theory and computation. We establish the foundations and methodology for an ongoing educational experiment to investigate the question "From what age can students learn quantum theory if taught using a diagrammatic approach?". We anticipate that the primary benefit of leveraging such a diagrammatic approach, which is conceptually intuitive yet mathematically rigorous, will be eliminating some of the most daunting barriers to teaching and learning this subject while enabling young learners to reason proficiently about high-level problems. We posit that transitioning from symbolic presentations to pictorial ones will increase the appeal of STEM education, attracting more diverse audience.


title: Efficient Inverse Design Optimization through Multi-fidelity Simulations, Machine Learning, and Search Space Reduction Strategies

abstract: This paper introduces a methodology designed to augment the inverse design optimization process in scenarios constrained by limited compute, through the strategic synergy of multi-fidelity evaluations, machine learning models, and optimization algorithms. The proposed methodology is analyzed on two distinct engineering inverse design problems: airfoil inverse design and the scalar field reconstruction problem. It leverages a machine learning model trained with low-fidelity simulation data, in each optimization cycle, thereby proficiently predicting a target variable and discerning whether a high-fidelity simulation is necessitated, which notably conserves computational resources. Additionally, the machine learning model is strategically deployed prior to optimization to compress the design space boundaries, thereby further accelerating convergence toward the optimal solution. The methodology has been employed to enhance two optimization algorithms, namely Differential Evolution and Particle Swarm Optimization. Comparative analyses illustrate performance improvements across both algorithms. Notably, this method is adaptable across any inverse design application, facilitating a synergy between a representative low-fidelity ML model, and high-fidelity simulation, and can be seamlessly applied across any variety of population-based optimization algorithms.}


title: Uniform Bounds for the Number of Rational Points of Bounded Height on Certain Elliptic Curves

abstract: Let $E$ be an elliptic curve defined over a number field $k$ and $\ell$ a prime integer. When $E$ has at least one $k$-rational point of exact order $\ell$, we derive a uniform upper bound $\exp(C \log B / \log \log B)$ for the number of points of $E(k)$ of (exponential) height at most $B$. Here the constant $C = C(k)$ depends on the number field $k$ and is effective. For $\ell = 2$ this generalizes a result of Naccarato which applies for $k=\mathbb{Q}$. We follow methods previously developed by Bombieri and Zannier and further by Naccarato, with the main novelty being the application of Rosen's result on bounding $\ell$-ranks of class groups in certain extensions, which is derived using relative genus theory.


title: Interpretability Illusions in the Generalization of Simplified Models

abstract: A common method to study deep learning systems is to use simplified model representations--for example, using singular value decomposition to visualize the model's hidden states in a lower dimensional space. This approach assumes that the results of these simplifications are faithful to the original model. Here, we illustrate an important caveat to this assumption: even if the simplified representations can accurately approximate the full model on the training set, they may fail to accurately capture the model's behavior out of distribution. We illustrate this by training Transformer models on controlled datasets with systematic generalization splits, including the Dyck balanced-parenthesis languages and a code completion task. We simplify these models using tools like dimensionality reduction and clustering, and then explicitly test how these simplified proxies match the behavior of the original model. We find consistent generalization gaps: cases in which the simplified proxies are more faithful to the original model on the in-distribution evaluations and less faithful on various tests of systematic generalization. This includes cases where the original model generalizes systematically but the simplified proxies fail, and cases where the simplified proxies generalize better. Together, our results raise questions about the extent to which mechanistic interpretations derived using tools like SVD can reliably predict what a model will do in novel situations.


title: Multisymplecticity in finite element exterior calculus

abstract: We consider the application of finite element exterior calculus (FEEC) methods to a class of canonical Hamiltonian PDE systems involving differential forms. Solutions to these systems satisfy a local multisymplectic conservation law, which generalizes the more familiar symplectic conservation law for Hamiltonian systems of ODEs, and which is connected with physically-important reciprocity phenomena, such as Lorentz reciprocity in electromagnetics. We characterize hybrid FEEC methods whose numerical traces satisfy a version of the multisymplectic conservation law, and we apply this characterization to several specific classes of FEEC methods, including conforming Arnold-Falk-Winther-type methods and various hybridizable discontinuous Galerkin (HDG) methods. Interestingly, the HDG-type and other nonconforming methods are shown, in general, to be multisymplectic in a stronger sense than the conforming FEEC methods. This substantially generalizes previous work of McLachlan and Stern [Found. Comput. Math., 20 (2020), pp. 35-69] on the more restricted class of canonical Hamiltonian PDEs in the de Donder-Weyl "grad-div" form.


title: Semiclassical states for the curl-curl problem

abstract: We show the existence of the so-called semiclassical states $\mathbf{U}:\mathbb{R}^3\to\mathbb{R}^3$ to the following curl-curl problem $$ \varepsilon^2\; \nabla \times (\nabla \times \mathbf{U}) + V(x) \mathbf{U} = g(\mathbf{U}), $$ for sufficiently small $\varepsilon > 0$. We study the asymptotic behaviour of solutions as $\varepsilon\to 0^+$ and we investigate also a related nonlinear Schr\"odinger equation involving a singular potential. The problem models large permeability nonlinear materials satisfying the system of Maxwell equations.


title: The SAMI Galaxy Survey: $\Sigma_{\rm SFR}$ drives the presence of complex emission line profiles in star-forming galaxies

abstract: Galactic fountains driven by star formation result in a variety of kinematic structures such as ionised winds and thick gas disks, both of which manifest as complex emission line profiles that can be parametrised by multiple Gaussian components. We use integral field spectroscopy (IFS) from the SAMI Galaxy Survey to spectrally resolve these features, traced by broad H$\alpha$ components, and distinguish them from the star-forming thin disk, traced by narrow components, in 3068 galaxies in the local Universe. Using a matched sample analysis technique, we demonstrate that the presence of complex emission line profiles in star-forming galaxies is most strongly correlated with the global star formation rate (SFR) surface density of the host galaxy measured within $1R_{\rm e}$ ($\Sigma_{{\rm SFR},R_{\rm e}}$), even when controlling for both observational biases, including inclination, amplitude-to-noise and angular scale, and sample biases in parameters such as stellar mass and SFR. Leveraging the spatially resolved nature of the dataset, we determine that the presence of complex emission line profiles within individual spaxels is driven not only by the local $\Sigma_{\rm SFR}$, but by the $\Sigma_{{\rm SFR},R_{\rm e}}$ of the host galaxy. We also parametrise the clumpiness of the SFR within individual galaxies, and find that $\Sigma_{{\rm SFR},R_{\rm e}}$ is a stronger predictor of the presence of complex emission line profiles than clumpiness. We conclude that, with a careful treatment of observational effects, it is possible to identify structures traced by complex emission line profiles, including winds and thick ionised gas disks, at the spatial and spectral resolution of SAMI using the Gaussian decomposition technique.


title: Calculation of SU(2) string tension in the continuum limit by an effective theory of center vortices

abstract: Using an effective theory for an ensemble of center vortices, we observe the area law fall-off in the continuum limit for the SU($2$) gauge group in three-dimensional Euclidean space-time. The string tension is obtained in terms of the intrinsic properties of the vortices and the parameter describing their interactions. A good qualitative agreement between our results and the lattice ones is observed. In addition, we show that the repulsive force between the vortices increases with temperature. This behavior is expected due to the reduction of vortex configuration at higher temperatures, required for the deconfinement regime.


title: Reason2Drive: Towards Interpretable and Chain-based Reasoning for Autonomous Driving

abstract: Large vision-language models (VLMs) have garnered increasing interest in autonomous driving areas, due to their advanced capabilities in complex reasoning tasks essential for highly autonomous vehicle behavior. Despite their potential, research in autonomous systems is hindered by the lack of datasets with annotated reasoning chains that explain the decision-making processes in driving. To bridge this gap, we present Reason2Drive, a benchmark dataset with over 600K video-text pairs, aimed at facilitating the study of interpretable reasoning in complex driving environments. We distinctly characterize the autonomous driving process as a sequential combination of perception, prediction, and reasoning steps, and the question-answer pairs are automatically collected from a diverse range of open-source outdoor driving datasets, including nuScenes, Waymo and ONCE. Moreover, we introduce a novel aggregated evaluation metric to assess chain-based reasoning performance in autonomous systems, addressing the semantic ambiguities of existing metrics such as BLEU and CIDEr. Based on the proposed benchmark, we conduct experiments to assess various existing VLMs, revealing insights into their reasoning capabilities. Additionally, we develop an efficient approach to empower VLMs to leverage object-level perceptual elements in both feature extraction and prediction, further enhancing their reasoning accuracy. The code and dataset will be released.


title: Neutral Hydrogen Mass in Galaxies Estimated via Optical Spectroscopy

abstract: We propose to employ emission line luminosities obtained via optical spectroscopy to estimate the content of neutral hydrogen (HI) in galaxies. We use the optical spectroscopy data from the Mapping of Nearby Galaxies at APO (MaNGA) survey released in the frames of public DR17 of the Sloan Digital Sky Survey (SDSS). We compare the HI mass estimated by us for a large sample of SDSS/MaNGA galaxies with direct HI measurements from the ALFALFA survey and find a tight correlation between the masses with the correlation coefficient (CC) of 0.91 and the r.m.s scatter of 0.15 dex for the logarithmic mass. The obtained relationship is verified via another sample of MaNGA galaxies with HI masses measured with the Green Bank Telescope. Despite the coarser angular resolution of the radio data, the relation between the estimated and measured directly HI mass is tight as well - in this case CC=0.74 and the r.nm.s. is 0.29 dex. The established relations allow us to estimate the total mass of neutral hydrogen as well as the spatial distribution of HI surface density in galaxies from optical spectroscopic observations only in a simple and efficient way.


title: $H$-percolation with a random $H$

abstract: In $H$-percolation, we start with an Erd\H{o}s--R\'enyi graph ${\mathcal G}_{n,p}$ and then iteratively add edges that complete copies of $H$. The process percolates if all edges missing from ${\mathcal G}_{n,p}$ are eventually added. We find the critical threshold $p_c$ when $H={\mathcal G}_{k,1/2}$ is uniformly random, solving a problem of Balogh, Bollob\'as and Morris.


title: Generative agent-based modeling with actions grounded in physical, social, or digital space using Concordia

abstract: Agent-based modeling has been around for decades, and applied widely across the social and natural sciences. The scope of this research method is now poised to grow dramatically as it absorbs the new affordances provided by Large Language Models (LLM)s. Generative Agent-Based Models (GABM) are not just classic Agent-Based Models (ABM)s where the agents talk to one another. Rather, GABMs are constructed using an LLM to apply common sense to situations, act "reasonably", recall common semantic knowledge, produce API calls to control digital technologies like apps, and communicate both within the simulation and to researchers viewing it from the outside. Here we present Concordia, a library to facilitate constructing and working with GABMs. Concordia makes it easy to construct language-mediated simulations of physically- or digitally-grounded environments. Concordia agents produce their behavior using a flexible component system which mediates between two fundamental operations: LLM calls and associative memory retrieval. A special agent called the Game Master (GM), which was inspired by tabletop role-playing games, is responsible for simulating the environment where the agents interact. Agents take actions by describing what they want to do in natural language. The GM then translates their actions into appropriate implementations. In a simulated physical world, the GM checks the physical plausibility of agent actions and describes their effects. In digital environments simulating technologies such as apps and services, the GM may handle API calls to integrate with external tools such as general AI assistants (e.g., Bard, ChatGPT), and digital apps (e.g., Calendar, Email, Search, etc.). Concordia was designed to support a wide array of applications both in scientific research and for evaluating performance of real digital services by simulating users and/or generating synthetic data.


title: Impact of carbon market on production emissions

abstract: The aim of this paper is to address the effect of the carbon emission allowance market on the production policy of a large polluter production firm. We investigate this effect in two cases; when the large polluter cannot affect the risk premium of the allowance market, and when it can change the risk premium by its production. In this simple model, we ignore any possible investment of the firm in pollution reducing technologies. We formulate the problem of optimal production by a stochastic optimization problem. Then, we show that, as expected, the market reduces the optimal production policy in the first case if the firm is not given a generous initial cheap allowance package. However, when the large producer activities can change the market risk premium, the cut on the production and consequently pollution cannot be guaranteed. In fact, there are cases in this model when the optimal production is {\it always} larger than expected, and an increase in production, and thus pollution, can increase the profit of the firm. We conclude that some of the parameters of the market which contribute to this effect can be wisely controlled by the regulators in order to diminish this manipulative behavior of the firm.


title: Towards small and accurate convolutional neural networks for acoustic biodiversity monitoring

abstract: Automated classification of animal sounds is a prerequisite for large-scale monitoring of biodiversity. Convolutional Neural Networks (CNNs) are among the most promising algorithms but they are slow, often achieve poor classification in the field and typically require large training data sets. Our objective was to design CNNs that are fast at inference time and achieve good classification performance while learning from moderate-sized data. Recordings from a rainforest ecosystem were used. Start and end-point of sounds from 20 bird species were manually annotated. Spectrograms from 10 second segments were used as CNN input. We designed simple CNNs with a frequency unwrapping layer (SIMP-FU models) such that any output unit was connected to all spectrogram frequencies but only to a sub-region of time, the Receptive Field (RF). Our models allowed experimentation with different RF durations. Models either used the time-indexed labels that encode start and end-point of sounds or simpler segment-level labels. Models learning from time-indexed labels performed considerably better than their segment-level counterparts. Best classification performances was achieved for models with intermediate RF duration of 1.5 seconds. The best SIMP-FU models achieved AUCs over 0.95 in 18 of 20 classes on the test set. On compact low-cost hardware the best SIMP-FU models evaluated up to seven times faster than real-time data acquisition. RF duration was a major driver of classification performance. The optimum of 1.5 s was in the same range as the duration of the sounds. Our models achieved good classification performance while learning from moderate-sized training data. This is explained by the usage of time-indexed labels during training and adequately sized RF. Results confirm the feasibility of deploying small CNNs with good classification performance on compact low-cost devices.


title: WarpDiffusion: Efficient Diffusion Model for High-Fidelity Virtual Try-on

abstract: Image-based Virtual Try-On (VITON) aims to transfer an in-shop garment image onto a target person. While existing methods focus on warping the garment to fit the body pose, they often overlook the synthesis quality around the garment-skin boundary and realistic effects like wrinkles and shadows on the warped garments. These limitations greatly reduce the realism of the generated results and hinder the practical application of VITON techniques. Leveraging the notable success of diffusion-based models in cross-modal image synthesis, some recent diffusion-based methods have ventured to tackle this issue. However, they tend to either consume a significant amount of training resources or struggle to achieve realistic try-on effects and retain garment details. For efficient and high-fidelity VITON, we propose WarpDiffusion, which bridges the warping-based and diffusion-based paradigms via a novel informative and local garment feature attention mechanism. Specifically, WarpDiffusion incorporates local texture attention to reduce resource consumption and uses a novel auto-mask module that effectively retains only the critical areas of the warped garment while disregarding unrealistic or erroneous portions. Notably, WarpDiffusion can be integrated as a plug-and-play component into existing VITON methodologies, elevating their synthesis quality. Extensive experiments on high-resolution VITON benchmarks and an in-the-wild test set demonstrate the superiority of WarpDiffusion, surpassing state-of-the-art methods both qualitatively and quantitatively.


title: Integrating Pre-Trained Speech and Language Models for End-to-End Speech Recognition

abstract: Advances in machine learning have made it possible to perform various text and speech processing tasks, such as automatic speech recognition (ASR), in an end-to-end (E2E) manner. E2E approaches utilizing pre-trained models are gaining attention for conserving training data and resources. However, most of their applications in ASR involve only one of either a pre-trained speech or a language model. This paper proposes integrating a pre-trained speech representation model and a large language model (LLM) for E2E ASR. The proposed model enables the optimization of the entire ASR process, including acoustic feature extraction and acoustic and language modeling, by combining pre-trained models with a bridge network and also enables the application of remarkable developments in LLM utilization, such as parameter-efficient domain adaptation and inference optimization. Experimental results demonstrate that the proposed model achieves a performance comparable to that of modern E2E ASR models by utilizing powerful pre-training models with the proposed integrated approach.


title: Annihilating branching Brownian motion

abstract: We study an interacting system of competing particles on the real line. Two populations of positive and negative particles evolve according to branching Brownian motion. When opposing particles meet, their charges neutralize and the particles annihilate, as in an inert chemical reaction. We show that, with positive probability, the two populations coexist and that, on this event, the interface is asymptotically linear with a random slope. A variety of generalizations and open problems are discussed.


title: Multicolor bipartite Ramsey number of double stars

abstract: For positive integers $n, m$, the double star $S(n,m)$ is the graph consisting of the disjoint union of two stars $K_{1,n}$ and $K_{1,m}$ together with an edge joining their centers. Finding monochromatic copies of double stars in edge-colored complete bipartite graphs has attracted much attention. The $k$-color bipartite Ramsey number of $ S(n,m)$, denoted by $r_{bip}(S(n,m);k)$, is the smallest integer $N$ such that, in any $k$-coloring of the edges of the complete bipartite graph $K_{N,N}$, there is a monochromatic copy of $S(n,m)$. The study of bipartite Ramsey numbers was initiated in the early 1970s by Faudree and Schelp and, independently, by Gy\'arf\'as and Lehel. The exact value of $r_{bip}(S(n,m);k)$ is only known when $n=m=1$. Applying the Tur\'an argument in the bipartite setting, here we prove that if $k=2$ and $n\ge m$, or $k\ge3$ and $n\ge 2m$, then \[ r_{bip}(S(n,m);k)=kn+1.\]


title: Direct Exoplanet Detection Using Deep Convolutional Image Reconstruction (ConStruct): A New Algorithm for Post-Processing High-Contrast Images

abstract: We present a novel machine-learning approach for detecting faint point sources in high-contrast adaptive optics imaging datasets. The most widely used algorithms for primary subtraction aim to decouple bright stellar speckle noise from planetary signatures by subtracting an approximation of the temporally evolving stellar noise from each frame in an imaging sequence. Our approach aims to improve the stellar noise approximation and increase the planet detection sensitivity by leveraging deep learning in a novel direct imaging post-processing algorithm. We show that a convolutional autoencoder neural network, trained on an extensive reference library of real imaging sequences, accurately reconstructs the stellar speckle noise at the location of a potential planet signal. This tool is used in a post-processing algorithm we call Direct Exoplanet Detection with Convolutional Image Reconstruction, or ConStruct. The reliability and sensitivity of ConStruct are assessed using real Keck/NIRC2 angular differential imaging datasets. Of the 30 unique point sources we examine, ConStruct yields a higher S/N than traditional PCA-based processing for 67$\%$ of the cases and improves the relative contrast by up to a factor of 2.6. This work demonstrates the value and potential of deep learning to take advantage of a diverse reference library of point spread function realizations to improve direct imaging post-processing. ConStruct and its future improvements may be particularly useful as tools for post-processing high-contrast images from the James Webb Space Telescope and extreme adaptive optics instruments, both for the current generation and those being designed for the upcoming 30 meter-class telescopes.


title: p-adic reconstruction of rational functions in multi-loop amplitudes

abstract: Numerical reconstruction techniques are widely employed in the calculation of multi-loop scattering amplitudes. In recent years, it has been observed that the rational functions in multi-loop calculations greatly simplify under partial fractioning. In this article, we present a technique to reconstruct rational functions directly in partial-fractioned form, by evaluating the functions at special integer points chosen for their properties under a p-adic metric. As an application, we apply this technique to reconstruct the largest rational function in the integration-by-parts reduction of one of the rank-5 integrals appearing in 2-loop 5-point full-colour massless QCD amplitude calculations. The number of required numerical probes (per prime field) is found to be around 25 times smaller than in conventional techniques, and the obtained result is 130 times smaller. The reconstructed result displays signs of additional structure that could be used to further reduce its size and the number of required probes.


title: On the Role of the Action Space in Robot Manipulation Learning and Sim-to-Real Transfer

abstract: We study the choice of action space in robot manipulation learning and sim-to-real transfer. We define metrics that assess the performance, and examine the emerging properties in the different action spaces. We train over 250 reinforcement learning~(RL) agents in simulated reaching and pushing tasks, using 13 different control spaces. The choice of spaces spans combinations of common action space design characteristics. We evaluate the training performance in simulation and the transfer to a real-world environment. We identify good and bad characteristics of robotic action spaces and make recommendations for future designs. Our findings have important implications for the design of RL algorithms for robot manipulation tasks, and highlight the need for careful consideration of action spaces when training and transferring RL agents for real-world robotics.


title: Building a Digital Twin for British Cities

abstract: Ever faster computers are enabling us to extend our standard land use transportation interaction (LUTI) models to systems of cities within which individual cities compete for resources within the wider environment in which they interact.As we scale up in this way, we are able to simulate and measure the impacts of large-scale infrastructures at different spatial levels.Here we build a platform, which is essentially a digital twin, for over 8000 urban places in Great Britain where we can rapidly model all flows between these locations using multi-modal spatial interaction models.We first present the structure of the model and then apply it to population, employment and trip flow data for three modes of travel (road, bus and rail) between small spatial units defining the three countries, England, Scotland and Wales.We then tune and train the model to reproduce a baseline, and follow this with a demonstration of the web-based interface used to run and interact with the model and its predictions.Once we have developed the platform, we are able to explore variants of the twin, partitioning the country in different ways, showing how different forms of spatial representation change the performance of the model.We are developing the model at a much finer scale making comparisons of performance while adding an active travel layer that elaborates the twin.We finally illustrate how the model can be used to measure the impacts of new scenarios for rail, simulating the Integrated Rail Plan and the High Speed 2 proposal


title: GeoShapley: A Game Theory Approach to Measuring Spatial Effects in Machine Learning Models

abstract: This paper introduces GeoShapley, a game theory approach to measuring spatial effects in machine learning models. GeoShapley extends the Nobel Prize-winning Shapley value framework in game theory by conceptualizing location as a player in a model prediction game, which enables the quantification of the importance of location and the synergies between location and other features in a model. GeoShapley is a model-agnostic approach and can be applied to statistical or black-box machine learning models in various structures. The interpretation of GeoShapley is directly linked with spatially varying coefficient models for explaining spatial effects and additive models for explaining non-spatial effects. Using simulated data, GeoShapley values are validated against known data-generating processes and are used for cross-comparison of seven statistical and machine learning models. An empirical example of house price modeling is used to illustrate GeoShapley's utility and interpretation with real world data. The method is available as an open-source Python package named geoshapley.


title: Extracting the Asymptotic Behavior of S-matrix Elements from their Phases

abstract: The asymptotic kinematic limits of S-matrices are dominated by large logarithms which, roughly speaking, fall into two categories: those which are controlled by a renormalization group (RG) scale, which we may think of as logs involving ratios of invariant mass scales, and those which are functions of ratios of rapidities, so called "rapidity logs". It has been pointed out by Caron-Huot and Wilhlem [1] that RG anomalous dimension can be extracted from the phase of the S-matrix, which can greatly simplify calculations via unitarity methods. In this paper we generalize the results of [1] to show that the phase can be used to reconstruct rapidity anomalous dimensions, by performing a complex boost. The methodology introduced here also allows one to calculate without the need for a rapidity regulator. We demonstrate the use of this method to derive the rapidity anomalous dimensions in the Sudakov form factor, the two parton soft function and the Regge trajectory in QCD.


title: Fingerprints of the Jahn-Teller and superexchange physics in optical spectra of manganites

abstract: Transition metal oxides incorporating Jahn-Teller (JT) ions Mn3+ (3d4) in manganites and Cu2+ (3d9) in cuprates exhibit outstanding magnetic and electronic properties, including colossal magnetoresistance (CMR) and high-temperature superconductivity (HTSC). The physics of these compounds is associated with the orbitally-degenerate electronic states of JT ions, leading to the linear electron-lattice interaction, complemented by the entirely electronic superexchange (SE) interaction. Here, we discuss the fingerprints of the JT and SE physics in the temperature-dependent complex dielectric function spectra and multi-order Raman scattering spectra measured in a detwinned LaMnO3 crystal, which is a famous compound exhibiting cooperative JT effect, being also a progenitor of magnetic materials exhibiting CMR effect. In accordance with the obtained experimental evidence, the associated effective parameters characterizing the JT and SE physics in manganites are presented.


title: Hybrid Functional Maps for Crease-Aware Non-Isometric Shape Matching

abstract: Non-isometric shape correspondence remains a fundamental challenge in computer vision. Traditional methods using Laplace-Beltrami operator (LBO) eigenmodes face limitations in characterizing high-frequency extrinsic shape changes like bending and creases. We propose a novel approach of combining the non-orthogonal extrinsic basis of eigenfunctions of the elastic thin-shell hessian with the intrinsic ones of the LBO, creating a hybrid spectral space in which we construct functional maps. To this end, we present a theoretical framework to effectively integrate non-orthogonal basis functions into descriptor- and learning-based functional map methods. Our approach can be incorporated easily into existing functional map pipelines across varying applications and is able to handle complex deformations beyond isometries. We show extensive evaluations across various supervised and unsupervised settings and demonstrate significant improvements. Notably, our approach achieves up to 15% better mean geodesic error for non-isometric correspondence settings and up to 45% improvement in scenarios with topological noise.


title: Single-ion optical autocorrelator

abstract: Well isolated quantum systems are exquisite sensors of electromagnetic fields. In this work, we use a single trapped ion for characterizing chirped ultraviolet (UV) picosecond laser pulses. The frequency swept pulses resonantly drive a strong dipole transition via rapid adiabatic passage, resulting in near deterministic population exchange caused by absorption or stimulated emission of photons. When subjecting an ion to counterpropagating pulse pairs, we observe the loss and revival of atomic coherence as a function of the pulse pair spatial overlap enabling quantification of the temporal pulse broadening caused by a frequency chirp in shaped UV pulses with a very low peak power. We find good agreement between measured and applied chirp. The ultrafast population exchange imparts an impulsive force where the estimated change in the mean phonon numbers of 0.5 is measured for two pairs of pulses. The resonant ultrafast kicks could be applied to matter wave interferometry experiments and present a step towards ultrafast entanglement operations in trapped ions.


title: Periodic homogenization of a class of weakly coupled systems of linear PDEs

abstract: In this article, basing upon probabilistic methods, we discuss periodic homogenization of a class of weakly coupled systems of linear elliptic and parabolic partial differential equations. Under the assumption that the systems have rapidly periodically oscillating coefficients, we first prove that the appropriately centered and scaled continuous component of the associated regime switching diffusion process converges weakly to a Brownian motion with covariance matrix given in terms of the coefficients of the systems. The homogenization results then follow by employing probabilistic representation of the solutions to the systems and the continuous mapping theorem. The presented results generalize the well-known results related to periodic homogenization of the classical elliptic boundary-value problem and the classical parabolic initial-value problem for a single equation.


title: Testing Connectedness of Images

abstract: We investigate algorithms for testing whether an image is connected. Given a proximity parameter $\epsilon\in(0,1)$ and query access to a black-and-white image represented by an $n\times n$ matrix of Boolean pixel values, a (1-sided error) connectedness tester accepts if the image is connected and rejects with probability at least 2/3 if the image is $\epsilon$-far from connected. We show that connectedness can be tested nonadaptively with $O(\frac 1{\epsilon^2})$ queries and adaptively with $O(\frac{1}{\epsilon^{3/2}} \sqrt{\log\frac{1}{\epsilon}})$ queries. The best connectedness tester to date, by Berman, Raskhodnikova, and Yaroslavtsev (STOC 2014) had query complexity $O(\frac 1{\epsilon^2}\log \frac 1{\epsilon})$ and was adaptive. We also prove that every nonadaptive, 1-sided error tester for connectedness must make $\Omega(\frac 1\epsilon\log \frac 1\epsilon)$ queries.


title: What Planning Problems Can A Relational Neural Network Solve?

abstract: Goal-conditioned policies are generally understood to be "feed-forward" circuits, in the form of neural networks that map from the current state and the goal specification to the next action to take. However, under what circumstances such a policy can be learned and how efficient the policy will be are not well understood. In this paper, we present a circuit complexity analysis for relational neural networks (such as graph neural networks and transformers) representing policies for planning problems, by drawing connections with serialized goal regression search (S-GRS). We show that there are three general classes of planning problems, in terms of the growth of circuit width and depth as a function of the number of objects and planning horizon, providing constructive proofs. We also illustrate the utility of this analysis for designing neural networks for policy learning.


title: The discrete nonlinear Schr\"odinger equation with linear gain and nonlinear loss: the infinite lattice with nonzero boundary conditions and its finite dimensional approximations

abstract: The study of nonlinear Schr\"odinger-type equations with nonzero boundary conditions define challenging problems both for the continuous (partial differential equation) or the discrete (lattice) counterparts. They are associated with fascinating dynamics emerging by the ubiquitous phenomenon of modulation instability. In this work, we consider the discrete nonlinear Schr\"odinger equation with linear gain and nonlinear loss. For the infinite lattice supplemented with nonzero boundary conditions which describe solutions decaying on the top of a finite background, we give a rigorous proof that for the corresponding initial-boundary value problem, solutions exist for any initial condition, if and only if, the amplitude of the background has a precise value $A_*$ defined by the gain-loss parameters. We argue that this essential property of this infinite lattice can't be captured by finite lattice approximations of the problem. Commonly, such approximations are defined by lattices with periodic boundary conditions or as it is shown herein, by a modified problem closed with Dirichlet boundary conditions. For the finite dimensional dynamical system defined by the periodic lattice, the dynamics for all initial conditions are captured by a global attractor. Analytical arguments corroborated by numerical simulations show that the global attractor is trivial, defined by a plane wave of amplitude $A_*$. Thus, any instability effects or localized phenomena simulated by the finite system can be only transient prior the convergence to this trivial attractor. Aiming to simulate the dynamics of the infinite lattice as accurately as possible, we study the dynamics of localized initial conditions on the constant background and investigate the potential impact of the global asymptotic stability of the background with amplitude $A_*$ in the long-time evolution of the system.


title: Spontaneous Chirality Flipping in an Orthogonal Spin-Charge Ordered Topological Magnet

abstract: The asymmetric distribution of chiral objects with opposite chirality is of great fundamental interests ranging from molecular biology to particle physics. In quantum materials, chiral states can build on inversion-symmetry-breaking lattice structures or emerge from spontaneous magnetic ordering induced by competing interactions. Although the handedness of a chiral state can be changed through external fields, a spontaneous chirality flipping has yet to be discovered. In this letter, we present experimental evidence of chirality flipping via changing temperature in a topological magnet EuAl$_4$, which features orthogonal spin and charge density waves (SDW/CDW). Using circular dichroism of Bragg peaks in the resonant magnetic x-ray scattering, we find that the chirality of the helical SDW flips through a first order phase transition with modified SDW wavelength. Intriguingly, we observe that the CDW couples strongly with the SDW and displays a rare commensurate-to-incommensurate transition at the chirality flipping temperature. Combining with first principles calculations and angle resolved photoemission spectroscopy, we establish the Fermi surface origin of the helical SDW with intertwined spin, charge, and lattice degrees of freedom in EuAl$_4$. Our results reveal an unprecedented spontaneous chirality flipping and lays the groundwork for a new functional manipulation of chirality through momentum dependent spin-charge-lattice interactions.


title: Exact Travelling Wave Solutions using Tanh Method for two-dimensional Stochastic Allen-Cahn equation

abstract: Exact travelling wave solutions to the two-dimensional stochastic Allen-Cahn equation with multiplicative noise are obtained through the hyperbolic tangent (tanh) method. This technique limits the solutions to travelling wave profiles by representing them with a finite tanh power series. This study focuses on how multiplicative noise affects the dynamics of these travelling waves, in particular, occurring of wave propagation failure due to high levels of noise.


title: Canonization of a random graph by two matrix-vector multiplications

abstract: We show that a canonical labeling of a random $n$-vertex graph can be obtained by assigning to each vertex $x$ the triple $(w_1(x),w_2(x),w_3(x))$, where $w_k(x)$ is the number of walks of length $k$ starting from $x$. This takes time $O(n^2)$, where $n^2$ is the input size, by using just two matrix-vector multiplications. The linear-time canonization of a random graph is the classical result of Babai, Erd\H{o}s, and Selkow. For this purpose they use the well-known combinatorial color refinement procedure, and we make a comparative analysis of the two algorithmic approaches.


title: MatterGen: a generative model for inorganic materials design

abstract: The design of functional materials with desired properties is essential in driving technological advances in areas like energy storage, catalysis, and carbon capture. Generative models provide a new paradigm for materials design by directly generating entirely novel materials given desired property constraints. Despite recent progress, current generative models have low success rate in proposing stable crystals, or can only satisfy a very limited set of property constraints. Here, we present MatterGen, a model that generates stable, diverse inorganic materials across the periodic table and can further be fine-tuned to steer the generation towards a broad range of property constraints. To enable this, we introduce a new diffusion-based generative process that produces crystalline structures by gradually refining atom types, coordinates, and the periodic lattice. We further introduce adapter modules to enable fine-tuning towards any given property constraints with a labeled dataset. Compared to prior generative models, structures produced by MatterGen are more than twice as likely to be novel and stable, and more than 15 times closer to the local energy minimum. After fine-tuning, MatterGen successfully generates stable, novel materials with desired chemistry, symmetry, as well as mechanical, electronic and magnetic properties. Finally, we demonstrate multi-property materials design capabilities by proposing structures that have both high magnetic density and a chemical composition with low supply-chain risk. We believe that the quality of generated materials and the breadth of MatterGen's capabilities represent a major advancement towards creating a universal generative model for materials design.


title: Twin-width of sparse random graphs

abstract: We show that the twin-width of every $n$-vertex $d$-regular graph is at most $n^{\frac{d-2}{2d-2}+o(1)}$ and that almost all $d$-regular graphs attain this bound. More generally, we obtain bounds on the twin-width of sparse Erd\H{o}s-Renyi and regular random graphs, complementing the bounds in the denser regime due to Ahn, Chakraborti, Hendrey, Kim and Oum.


title: Evaluating and Mitigating Discrimination in Language Model Decisions

abstract: As language models (LMs) advance, interest is growing in applying them to high-stakes societal decisions, such as determining financing or housing eligibility. However, their potential for discrimination in such contexts raises ethical concerns, motivating the need for better methods to evaluate these risks. We present a method for proactively evaluating the potential discriminatory impact of LMs in a wide range of use cases, including hypothetical use cases where they have not yet been deployed. Specifically, we use an LM to generate a wide array of potential prompts that decision-makers may input into an LM, spanning 70 diverse decision scenarios across society, and systematically vary the demographic information in each prompt. Applying this methodology reveals patterns of both positive and negative discrimination in the Claude 2.0 model in select settings when no interventions are applied. While we do not endorse or permit the use of language models to make automated decisions for the high-risk use cases we study, we demonstrate techniques to significantly decrease both positive and negative discrimination through careful prompt engineering, providing pathways toward safer deployment in use cases where they may be appropriate. Our work enables developers and policymakers to anticipate, measure, and address discrimination as language model capabilities and applications continue to expand. We release our dataset and prompts at https://huggingface.co/datasets/Anthropic/discrim-eval


title: Inverse Design of Vitrimeric Polymers by Molecular Dynamics and Generative Modeling

abstract: Vitrimer is a new class of sustainable polymers with the ability of self-healing through rearrangement of dynamic covalent adaptive networks. However, a limited choice of constituent molecules restricts their property space, prohibiting full realization of their potential applications. Through a combination of molecular dynamics (MD) simulations and machine learning (ML), particularly a novel graph variational autoencoder (VAE) model, we establish a method for generating novel vitrimers and guide their inverse design based on desired glass transition temperature (Tg). We build the first vitrimer dataset of one million and calculate Tg on 8,424 of them by high-throughput MD simulations calibrated by a Gaussian process model. The proposed VAE employs dual graph encoders and a latent dimension overlapping scheme which allows for individual representation of multi-component vitrimers. By constructing a continuous latent space containing necessary information of vitrimers, we demonstrate high accuracy and efficiency of our framework in discovering novel vitrimers with desirable Tg beyond the training regime. The proposed vitrimers with reasonable synthesizability cover a wide range of Tg and broaden the potential widespread usage of vitrimeric materials.


title: On the Role of Edge Dependency in Graph Generative Models

abstract: In this work, we introduce a novel evaluation framework for generative models of graphs, emphasizing the importance of model-generated graph overlap (Chanpuriya et al., 2021) to ensure both accuracy and edge-diversity. We delineate a hierarchy of graph generative models categorized into three levels of complexity: edge independent, node independent, and fully dependent models. This hierarchy encapsulates a wide range of prevalent methods. We derive theoretical bounds on the number of triangles and other short-length cycles producible by each level of the hierarchy, contingent on the model overlap. We provide instances demonstrating the asymptotic optimality of our bounds. Furthermore, we introduce new generative models for each of the three hierarchical levels, leveraging dense subgraph discovery (Gionis & Tsourakakis, 2015). Our evaluation, conducted on real-world datasets, focuses on assessing the output quality and overlap of our proposed models in comparison to other popular models. Our results indicate that our simple, interpretable models provide competitive baselines to popular generative models. Through this investigation, we aim to propel the advancement of graph generative models by offering a structured framework and robust evaluation metrics, thereby facilitating the development of models capable of generating accurate and edge-diverse graphs.


title: Memory Triggers: Unveiling Memorization in Text-To-Image Generative Models through Word-Level Duplication

abstract: Diffusion-based models, such as the Stable Diffusion model, have revolutionized text-to-image synthesis with their ability to produce high-quality, high-resolution images. These advancements have prompted significant progress in image generation and editing tasks. However, these models also raise concerns due to their tendency to memorize and potentially replicate exact training samples, posing privacy risks and enabling adversarial attacks. Duplication in training datasets is recognized as a major factor contributing to memorization, and various forms of memorization have been studied so far. This paper focuses on two distinct and underexplored types of duplication that lead to replication during inference in diffusion-based models, particularly in the Stable Diffusion model. We delve into these lesser-studied duplication phenomena and their implications through two case studies, aiming to contribute to the safer and more responsible use of generative models in various applications.


title: On standing waves of 1D nonlinear Schr\"odinger equation with triple power nonlinearity

abstract: For the one dimensional nonlinear Schr\"odinger equation with triple power nonlinearity and general exponents, we study analytically and numerically the existence and stability of standing waves. Special attention is paid to the curves of non-existence and curves of stability change on the parameter planes.


title: Parameter-Efficient Transfer Learning of Audio Spectrogram Transformers

abstract: The common modus operandi of fine-tuning large pre-trained Transformer models entails the adaptation of all their parameters (i.e., full fine-tuning). While achieving striking results on multiple tasks, this approach becomes unfeasible as the model size and the number of downstream tasks increase. In natural language processing and computer vision, parameter-efficient approaches like prompt-tuning and adapters have emerged as solid alternatives by fine-tuning only a small number of extra parameters, without sacrificing performance accuracy. For audio classification tasks, the Audio Spectrogram Transformer model shows impressive results. However, surprisingly, how to efficiently adapt it to several downstream tasks has not been tackled before. In this paper, we bridge this gap and present a detailed investigation of common parameter-efficient methods, revealing that adapters and LoRA consistently outperform the other methods across four benchmarks. Whereas adapters prove to be more efficient in few-shot learning settings, LoRA turns out to scale better as we increase the number of learnable parameters. We finally carry out ablation studies to find the best configuration for adapters and LoRA.


title: Revisiting the averaged annihilation rate of thermal relics at low temperature

abstract: We derive a low-temperature expansion of the formula to compute the average annihilation rate $\langle \sigma v \rangle$ for dark matter in $\mathbb{Z}_2$-symmetric models, both in the absence and the presence of mass degeneracy in the spectrum near the dark matter candidate. We show that the result obtained in the absence of mass degeneracy is compatible with the analytic formulae in the literature, and that it has a better numerical behaviour for low temperatures. We also provide as ancillary files two Wolfram Mathematica notebooks which perform the two expansions at any order.


title: Efficient Learning in Polyhedral Games via Best Response Oracles

abstract: We study online learning and equilibrium computation in games with polyhedral decision sets, a property shared by both normal-form games and extensive-form games (EFGs), when the learning agent is restricted to using a best-response oracle. We show how to achieve constant regret in zero-sum games and $O(T^{1/4})$ regret in general-sum games while using only $O(\log t)$ best-response queries at a given iteration $t$, thus improving over the best prior result, which required $O(T)$ queries per iteration. Moreover, our framework yields the first last-iterate convergence guarantees for self-play with best-response oracles in zero-sum games. This convergence occurs at a linear rate, though with a condition-number dependence. We go on to show a $O(1/\sqrt{T})$ best-iterate convergence rate without such a dependence. Our results build on linear-rate convergence results for variants of the Frank-Wolfe (FW) algorithm for strongly convex and smooth minimization problems over polyhedral domains. These FW results depend on a condition number of the polytope, known as facial distance. In order to enable application to settings such as EFGs, we show two broad new results: 1) the facial distance for polytopes in standard form is at least $\gamma/\sqrt{k}$ where $\gamma$ is the minimum value of a nonzero coordinate of a vertex of the polytope and $k\leq n$ is the number of tight inequality constraints in the optimal face, and 2) the facial distance for polytopes of the form $\mathbf{A}\boldsymbol{x}=\boldsymbol{b},\mathbf{C}\boldsymbol{x}\leq\boldsymbol{d}, \boldsymbol{x}\geq \mathbf{0}$ where $\boldsymbol{x}\in\mathbb{R}^n$, $\mathbf{C}\geq\boldsymbol{0}$ is a nonzero integral matrix, and $\boldsymbol{d}\geq \boldsymbol{0}$, is at least $1/(\|\mathbf{C}\|_\infty\sqrt{n})$. This yields the first such results for several problems such as sequence-form polytopes, flow polytopes, and matching polytopes.


title: Bayesian estimation of cross-coupling and reflection systematics in 21cm array visibility data

abstract: Observations with radio arrays that target the 21-cm signal originating from the early Universe suffer from a variety of systematic effects. An important class of these are reflections and spurious couplings between antennas. We apply a Hamiltonian Monte Carlo sampler to the modelling and mitigation of these systematics in simulated Hydrogen Epoch of Reionisation Array (HERA) data. This method allows us to form statistical uncertainty estimates for both our models and the recovered visibilities, which is an important ingredient in establishing robust upper limits on the Epoch of Reionisation (EoR) power spectrum. In cases where the noise is large compared to the EoR signal, this approach can constrain the systematics well enough to mitigate them down to the noise level for both systematics studied. Where the noise is smaller than the EoR, our modelling can mitigate the majority of the reflections with there being only a minor level of residual systematics, while cross-coupling sees essentially complete mitigation. Our approach performs similarly to existing filtering/fitting techniques used in the HERA pipeline, but with the added benefit of rigorously propagating uncertainties. In all cases it does not significantly attenuate the underlying signal.


title: Intrinsic Harmonization for Illumination-Aware Compositing

abstract: Despite significant advancements in network-based image harmonization techniques, there still exists a domain disparity between typical training pairs and real-world composites encountered during inference. Most existing methods are trained to reverse global edits made on segmented image regions, which fail to accurately capture the lighting inconsistencies between the foreground and background found in composited images. In this work, we introduce a self-supervised illumination harmonization approach formulated in the intrinsic image domain. First, we estimate a simple global lighting model from mid-level vision representations to generate a rough shading for the foreground region. A network then refines this inferred shading to generate a harmonious re-shading that aligns with the background scene. In order to match the color appearance of the foreground and background, we utilize ideas from prior harmonization approaches to perform parameterized image edits in the albedo domain. To validate the effectiveness of our approach, we present results from challenging real-world composites and conduct a user study to objectively measure the enhanced realism achieved compared to state-of-the-art harmonization methods.


title: PROMISE: A Framework for Developing Complex Conversational Interactions (Technical Report)

abstract: The advent of increasingly powerful language models has raised expectations for language-based interactions. However, controlling these models is a challenge, emphasizing the need to be able to investigate the feasibility and value of their application. We present PROMISE, a framework that facilitates the development of complex language-based interactions with information systems. Its use of state machine modeling concepts enables model-driven, dynamic prompt orchestration across hierarchically nested states and transitions. This improves the control of the behavior of language models and thus enables their effective and efficient use. In this technical report we show the benefits of PROMISE in the context of application scenarios within health information systems and demonstrate its ability to handle complex interactions. We also include code examples and present default user interfaces available as part of PROMISE.


title: OneLLM: One Framework to Align All Modalities with Language

abstract: Multimodal large language models (MLLMs) have gained significant attention due to their strong multimodal understanding capability. However, existing works rely heavily on modality-specific encoders, which usually differ in architecture and are limited to common modalities. In this paper, we present OneLLM, an MLLM that aligns eight modalities to language using a unified framework. We achieve this through a unified multimodal encoder and a progressive multimodal alignment pipeline. In detail, we first train an image projection module to connect a vision encoder with LLM. Then, we build a universal projection module (UPM) by mixing multiple image projection modules and dynamic routing. Finally, we progressively align more modalities to LLM with the UPM. To fully leverage the potential of OneLLM in following instructions, we also curated a comprehensive multimodal instruction dataset, including 2M items from image, audio, video, point cloud, depth/normal map, IMU and fMRI brain activity. OneLLM is evaluated on 25 diverse benchmarks, encompassing tasks such as multimodal captioning, question answering and reasoning, where it delivers excellent performance. Code, data, model and online demo are available at https://github.com/csuhan/OneLLM


title: Return of Unconditional Generation: A Self-supervised Representation Generation Method

abstract: Unconditional generation -- the problem of modeling data distribution without relying on human-annotated labels -- is a long-standing and fundamental challenge in generative models, creating a potential of learning from large-scale unlabeled data. In the literature, the generation quality of an unconditional method has been much worse than that of its conditional counterpart. This gap can be attributed to the lack of semantic information provided by labels. In this work, we show that one can close this gap by generating semantic representations in the representation space produced by a self-supervised encoder. These representations can be used to condition the image generator. This framework, called Representation-Conditioned Generation (RCG), provides an effective solution to the unconditional generation problem without using labels. Through comprehensive experiments, we observe that RCG significantly improves unconditional generation quality: e.g., it achieves a new state-of-the-art FID of 2.15 on ImageNet 256x256, largely reducing the previous best of 5.91 by a relative 64%. Our unconditional results are situated in the same tier as the leading class-conditional ones. We hope these encouraging observations will attract the community's attention to the fundamental problem of unconditional generation. Code is available at https://github.com/LTH14/rcg.


title: Coulomb-Nuclear Interference in polarized pA scattering

abstract: We made the first attempt to understand the observed unusual t dependence of single-spin asymmetry observed in the HJET experiment at RHIC. Usually, the interaction of hadrons is presented as a long-range Coulomb interaction and a short-range strong interaction with Coulomb corrections. Such a division gives rise to a Coulomb phase of the hadronic term. Conversely, here we consider short-range hadronic interaction as a correction to the long-range electromagnetic term, i.e., we treat it as an absorptive correction. This significantly affects the Coulomb-nuclear interference, which is a source of single-spin azimuthal asymmetry at small angles.


title: Skeleton-in-Context: Unified Skeleton Sequence Modeling with In-Context Learning

abstract: In-context learning provides a new perspective for multi-task modeling for vision and NLP. Under this setting, the model can perceive tasks from prompts and accomplish them without any extra task-specific head predictions or model fine-tuning. However, Skeleton sequence modeling via in-context learning remains unexplored. Directly applying existing in-context models from other areas onto skeleton sequences fails due to the inter-frame and cross-task pose similarity that makes it outstandingly hard to perceive the task correctly from a subtle context. To address this challenge, we propose Skeleton-in-Context (SiC), an effective framework for in-context skeleton sequence modeling. Our SiC is able to handle multiple skeleton-based tasks simultaneously after a single training process and accomplish each task from context according to the given prompt. It can further generalize to new, unseen tasks according to customized prompts. To facilitate context perception, we additionally propose a task-unified prompt, which adaptively learns tasks of different natures, such as partial joint-level generation, sequence-level prediction, or 2D-to-3D motion prediction. We conduct extensive experiments to evaluate the effectiveness of our SiC on multiple tasks, including motion prediction, pose estimation, joint completion, and future pose estimation. We also evaluate its generalization capability on unseen tasks such as motion-in-between. These experiments show that our model achieves state-of-the-art multi-task performance and even outperforms single-task methods on certain tasks.


title: Relightable Gaussian Codec Avatars

abstract: The fidelity of relighting is bounded by both geometry and appearance representations. For geometry, both mesh and volumetric approaches have difficulty modeling intricate structures like 3D hair geometry. For appearance, existing relighting models are limited in fidelity and often too slow to render in real-time with high-resolution continuous environments. In this work, we present Relightable Gaussian Codec Avatars, a method to build high-fidelity relightable head avatars that can be animated to generate novel expressions. Our geometry model based on 3D Gaussians can capture 3D-consistent sub-millimeter details such as hair strands and pores on dynamic face sequences. To support diverse materials of human heads such as the eyes, skin, and hair in a unified manner, we present a novel relightable appearance model based on learnable radiance transfer. Together with global illumination-aware spherical harmonics for the diffuse components, we achieve real-time relighting with all-frequency reflections using spherical Gaussians. This appearance model can be efficiently relit under both point light and continuous illumination. We further improve the fidelity of eye reflections and enable explicit gaze control by introducing relightable explicit eye models. Our method outperforms existing approaches without compromising real-time performance. We also demonstrate real-time relighting of avatars on a tethered consumer VR headset, showcasing the efficiency and fidelity of our avatars.


title: A Process for Topic Modelling Via Word Embeddings

abstract: This work combines algorithms based on word embeddings, dimensionality reduction, and clustering. The objective is to obtain topics from a set of unclassified texts. The algorithm to obtain the word embeddings is the BERT model, a neural network architecture widely used in NLP tasks. Due to the high dimensionality, a dimensionality reduction technique called UMAP is used. This method manages to reduce the dimensions while preserving part of the local and global information of the original data. K-Means is used as the clustering algorithm to obtain the topics. Then, the topics are evaluated using the TF-IDF statistics, Topic Diversity, and Topic Coherence to get the meaning of the words on the clusters. The results of the process show good values, so the topic modeling of this process is a viable option for classifying or clustering texts without labels.


title: An Evaluation of State-of-the-Art Large Language Models for Sarcasm Detection

abstract: Sarcasm, as defined by Merriam-Webster, is the use of words by someone who means the opposite of what he is trying to say. In the field of sentimental analysis of Natural Language Processing, the ability to correctly identify sarcasm is necessary for understanding people's true opinions. Because the use of sarcasm is often context-based, previous research has used language representation models, such as Support Vector Machine (SVM) and Long Short-Term Memory (LSTM), to identify sarcasm with contextual-based information. Recent innovations in NLP have provided more possibilities for detecting sarcasm. In BERT: Pre-training of Deep Bidirectional Transformers for Language Understanding, Jacob Devlin et al. (2018) introduced a new language representation model and demonstrated higher precision in interpreting contextualized language. As proposed by Hazarika et al. (2018), CASCADE is a context-driven model that produces good results for detecting sarcasm. This study analyzes a Reddit corpus using these two state-of-the-art models and evaluates their performance against baseline models to find the ideal approach to sarcasm detection.


title: Multi-label Text Classification using GloVe and Neural Network Models

abstract: This study addresses the challenges of multi-label text classification. The difficulties arise from imbalanced data sets, varied text lengths, and numerous subjective feature labels. Existing solutions include traditional machine learning and deep neural networks for predictions. However, both approaches have their limitations. Traditional machine learning often overlooks the associations between words, while deep neural networks, despite their better classification performance, come with increased training complexity and time. This paper proposes a method utilizing the bag-of-words model approach based on the GloVe model and the CNN-BiLSTM network. The principle is to use the word vector matrix trained by the GloVe model as the input for the text embedding layer. Given that the GloVe model requires no further training, the neural network model can be trained more efficiently. The method achieves an accuracy rate of 87.26% on the test set and an F1 score of 0.8737, showcasing promising results.


title: Abstraction via exemplars? A representational case study on lexical category inference in BERT

abstract: Exemplar based accounts are often considered to be in direct opposition to pure linguistic abstraction in explaining language learners' ability to generalize to novel expressions. However, the recent success of neural network language models on linguistically sensitive tasks suggests that perhaps abstractions can arise via the encoding of exemplars. We provide empirical evidence for this claim by adapting an existing experiment that studies how an LM (BERT) generalizes the usage of novel tokens that belong to lexical categories such as Noun/Verb/Adjective/Adverb from exposure to only a single instance of their usage. We analyze the representational behavior of the novel tokens in these experiments, and find that BERT's capacity to generalize to unseen expressions involving the use of these novel tokens constitutes the movement of novel token representations towards regions of known category exemplars in two-dimensional space. Our results suggest that learners' encoding of exemplars can indeed give rise to abstraction like behavior.


title: UID as a Guiding Metric for Automated Authorship Obfuscation

abstract: Protecting the anonymity of authors has become a difficult task given the rise of automated authorship attributors. These attributors are capable of attributing the author of a text amongst a pool of authors with great accuracy. In order to counter the rise of these automated attributors, there has also been a rise of automated obfuscators. These obfuscators are capable of taking some text, perturbing the text in some manner, and, if successful, deceive an automated attributor in misattributing the wrong author. We devised three novel authorship obfuscation methods that utilized a Psycho-linguistic theory known as Uniform Information Density (UID) theory. This theory states that humans evenly distribute information amongst speech or text so as to maximize efficiency. Utilizing this theory in our three obfuscation methods, we attempted to see how successfully we could deceive two separate attributors. Obfuscating 50 human and 50 GPT-3 generated articles from the TuringBench dataset, we observed how well each method did on deceiving the attributors. While the quality of the obfuscation in terms of semantic preservation and sensical changes was high, we were not able to find any evidence to indicate UID was a viable guiding metric for obfuscation. However, due to restrictions in time we were unable to test a large enough sample of article or tune the parameters for our attributors to comment conclusively on UID in obfuscation.


title: Don't Overlook the Grammatical Gender: Bias Evaluation for Hindi-English Machine Translation

abstract: Neural Machine Translation (NMT) models, though state-of-the-art for translation, often reflect social biases, particularly gender bias. Existing evaluation benchmarks primarily focus on English as the source language of translation. For source languages other than English, studies often employ gender-neutral sentences for bias evaluation, whereas real-world sentences frequently contain gender information in different forms. Therefore, it makes more sense to evaluate for bias using such source sentences to determine if NMT models can discern gender from the grammatical gender cues rather than relying on biased associations. To illustrate this, we create two gender-specific sentence sets in Hindi to automatically evaluate gender bias in various Hindi-English (HI-EN) NMT systems. We emphasise the significance of tailoring bias evaluation test sets to account for grammatical gender markers in the source language.


title: Thermal and electrostatic tuning of surface phonon-polaritons in LaAlO3/SrTiO3 heterostructures

abstract: Phonon polaritons are promising for infrared applications due to a strong light-matter coupling and subwavelength energy confinement they offer. Yet, the spectral narrowness of the phonon bands and difficulty to tune the phonon polariton properties hinder further progress in this field. SrTiO3 - a prototype perovskite oxide - has recently attracted attention due to two prominent far-infrared phonon polaritons bands, albeit without any tuning reported so far. Here we show, using cryogenic infrared near-field microscopy, that long-propagating surface phonon polaritons are present both in bare SrTiO3 and in LaAlO3/SrTiO3 heterostructures hosting a two-dimensional electron gas. The presence of the two-dimensional electron gas increases dramatically the thermal variation of the upper limit of the surface phonon polariton band due to temperature dependent polaronic screening of the surface charge carriers. Furthermore, we demonstrate a tunability of the upper surface phonon polariton frequency in LaAlO3/SrTiO3 via electrostatic gating. Our results suggest that oxide interfaces are a new platform bridging unconventional electronics and long-wavelength nanophotonics.


title: Magnetoelectric Properties and Symmetry Classification of Micromagnetic Structures

abstract: The magnetoelectric (ME) effects are caused by interactions of the electrical and magnetic subsystems in a solid. Among the applications of ME effects, there are methods of magnetic reversal under the influence of an electrostatic field and the reverse effect. As a result of the theoretical studies carried out in this thesis, we obtained a complete symmetry classification of all the main micromagnetic structures (domain walls, Bloch lines, Bloch points, and magnetic vortices/skyrmions), where the structures were first divided by their magnetic chirality. The organic connection of this classification with the inhomogeneous magnetoelectric effects in them has been shown. The inhomogeneous ME effect is qualitatively described for each symmetry class. Additionally, the known phenomenological theory of these effects is extended to the cases of crystals of cubic, tetragonal, and orthorhombic systems. The obtained results were analyzed for their compatibility with the existing experimental facts, and the possibility of detecting new phenomena has been suggested.


title: Measuring the Kapitza Resistance between a Passivated Semiconductor and Liquid Helium

abstract: In this paper, we describe an experimental investigation into the effect of passivation layer thickness on heat dissipation between a quartz substrate and liquid helium. We have observed that by depositing SiN from 0 to 240 nm, the Kapitza resistance increases by 0.0365 m^2.K/W per nanometer more than for an unpassivated semiconductor. We hypothesize that this increase in Kapitza resistance represents an additional barrier to the cooling of semiconductor devices in liquid helium.


title: Common fixed point theorems for two mappings in $b$-metric-like spaces

abstract: In this paper, we give some requirements under which two self-mappings have a common fixed point in $b$-metric-like spaces.


title: Sentiment Analysis of Twitter Posts on Global Conflicts

abstract: Sentiment analysis of social media data is an emerging field with vast applications in various domains. In this study, we developed a sentiment analysis model to analyze social media sentiment, especially tweets, during global conflicting scenarios. To establish our research experiment, we identified a recent global dispute incident on Twitter and collected around 31,000 filtered Tweets for several months to analyze human sentiment worldwide.


title: Co-guiding for Multi-intent Spoken Language Understanding

abstract: Recent graph-based models for multi-intent SLU have obtained promising results through modeling the guidance from the prediction of intents to the decoding of slot filling. However, existing methods (1) only model the unidirectional guidance from intent to slot, while there are bidirectional inter-correlations between intent and slot; (2) adopt homogeneous graphs to model the interactions between the slot semantics nodes and intent label nodes, which limit the performance. In this paper, we propose a novel model termed Co-guiding Net, which implements a two-stage framework achieving the mutual guidances between the two tasks. In the first stage, the initial estimated labels of both tasks are produced, and then they are leveraged in the second stage to model the mutual guidances. Specifically, we propose two heterogeneous graph attention networks working on the proposed two heterogeneous semantics label graphs, which effectively represent the relations among the semantics nodes and label nodes. Besides, we further propose Co-guiding-SCL Net, which exploits the single-task and dual-task semantics contrastive relations. For the first stage, we propose single-task supervised contrastive learning, and for the second stage, we propose co-guiding supervised contrastive learning, which considers the two tasks' mutual guidances in the contrastive learning procedure. Experiment results on multi-intent SLU show that our model outperforms existing models by a large margin, obtaining a relative improvement of 21.3% over the previous best model on MixATIS dataset in overall accuracy. We also evaluate our model on the zero-shot cross-lingual scenario and the results show that our model can relatively improve the state-of-the-art model by 33.5% on average in terms of overall accuracy for the total 9 languages.


title: On the Existence and Disjunction Properties in Structural Set Theory

abstract: We formulate a definition of the existence property that works with "structural" set theories, in the mode of ETCS (the elementary theory of the category of sets). We show that a range of structural set theories, when formulated using constructive logic, satisfy the disjunction, numerical existence, and existence properties; in particular, intuitionist ETCS, formulated with separation and Shulman's replacement of contexts axiom, satisfies these properties. As a consequence of this, we show that, working constructively, replacement of contexts is strictly weaker than collection.


title: Large Language Models in Law: A Survey

abstract: The advent of artificial intelligence (AI) has significantly impacted the traditional judicial industry. Moreover, recently, with the development of AI-generated content (AIGC), AI and law have found applications in various domains, including image recognition, automatic text generation, and interactive chat. With the rapid emergence and growing popularity of large models, it is evident that AI will drive transformation in the traditional judicial industry. However, the application of legal large language models (LLMs) is still in its nascent stage. Several challenges need to be addressed. In this paper, we aim to provide a comprehensive survey of legal LLMs. We not only conduct an extensive survey of LLMs, but also expose their applications in the judicial system. We first provide an overview of AI technologies in the legal field and showcase the recent research in LLMs. Then, we discuss the practical implementation presented by legal LLMs, such as providing legal advice to users and assisting judges during trials. In addition, we explore the limitations of legal LLMs, including data, algorithms, and judicial practice. Finally, we summarize practical recommendations and propose future development directions to address these challenges.


title: Comparative Analysis of ChatGPT, GPT-4, and Microsoft Bing Chatbots for GRE Test

abstract: This research paper presents an analysis of how well three artificial intelligence chatbots: Bing, ChatGPT, and GPT-4, perform when answering questions from standardized tests. The Graduate Record Examination is used in this paper as a case study. A total of 137 questions with different forms of quantitative reasoning and 157 questions with verbal categories were used to assess their capabilities. This paper presents the performance of each chatbot across various skills and styles tested in the exam. The proficiency of these chatbots in addressing image-based questions is also explored, and the uncertainty level of each chatbot is illustrated. The results show varying degrees of success across the chatbots, where GPT-4 served as the most proficient, especially in complex language understanding tasks and image-based questions. Results highlight the ability of these chatbots to pass the GRE with a high score, which encourages the use of these chatbots in test preparation. The results also show how important it is to ensure that, if the test is administered online, as it was during COVID, the test taker is segregated from these resources for a fair competition on higher education opportunities.


title: Negotiating with LLMS: Prompt Hacks, Skill Gaps, and Reasoning Deficits

abstract: Large language models LLMs like ChatGPT have reached the 100 Mio user barrier in record time and might increasingly enter all areas of our life leading to a diverse set of interactions between those Artificial Intelligence models and humans. While many studies have discussed governance and regulations deductively from first-order principles, few studies provide an inductive, data-driven lens based on observing dialogues between humans and LLMs especially when it comes to non-collaborative, competitive situations that have the potential to pose a serious threat to people. In this work, we conduct a user study engaging over 40 individuals across all age groups in price negotiations with an LLM. We explore how people interact with an LLM, investigating differences in negotiation outcomes and strategies. Furthermore, we highlight shortcomings of LLMs with respect to their reasoning capabilities and, in turn, susceptiveness to prompt hacking, which intends to manipulate the LLM to make agreements that are against its instructions or beyond any rationality. We also show that the negotiated prices humans manage to achieve span a broad range, which points to a literacy gap in effectively interacting with LLMs.


title: Exploring the Robustness of Model-Graded Evaluations and Automated Interpretability

abstract: There has been increasing interest in evaluations of language models for a variety of risks and characteristics. Evaluations relying on natural language understanding for grading can often be performed at scale by using other language models. We test the robustness of these model-graded evaluations to injections on different datasets including a new Deception Eval. These injections resemble direct communication between the testee and the evaluator to change their grading. We extrapolate that future, more intelligent models might manipulate or cooperate with their evaluation model. We find significant susceptibility to these injections in state-of-the-art commercial models on all examined evaluations. Furthermore, similar injections can be used on automated interpretability frameworks to produce misleading model-written explanations. The results inspire future work and should caution against unqualified trust in evaluations and automated interpretability.


title: Leveraging AI-derived Data for Carbon Accounting: Information Extraction from Alternative Sources

abstract: Carbon accounting is a fundamental building block in our global path to emissions reduction and decarbonization, yet many challenges exist in achieving reliable and trusted carbon accounting measures. We motivate that carbon accounting not only needs to be more data-driven, but also more methodologically sound. We discuss the need for alternative, more diverse data sources that can play a significant role on our path to trusted carbon accounting procedures and elaborate on not only why, but how Artificial Intelligence (AI) in general and Natural Language Processing (NLP) in particular can unlock reasonable access to a treasure trove of alternative data sets in light of the recent advances in the field that better enable the utilization of unstructured data in this process. We present a case study of the recent developments on real-world data via an NLP-powered analysis using OpenAI's GPT API on financial and shipping data. We conclude the paper with a discussion on how these methods and approaches can be integrated into a broader framework for AI-enabled integrative carbon accounting.


title: ChatGPT Application In Summarizing An Evolution Of Deep Learning Techniques In Imaging: A Qualitative Study

abstract: The pursuit of article or text summarization has captured the attention of natural language processing (NLP) practitioners, presenting itself as a formidable challenge. ChatGPT 3.5 exhibits the capacity to condense the content of up to 3000 tokens into a single page, aiming to retain pivotal information from a given text across diverse themes. In a conducted qualitative research endeavor, we selected seven scientific articles and employed the publicly available ChatGPT service to generate summaries of these articles. Subsequently, we engaged six co-authors of the articles in a survey, presenting five questions to evaluate the quality of the summaries compared to the original content. The findings revealed that the summaries produced by ChatGPT effectively encapsulated the crucial information present in the articles, preserving the principal message of each manuscript. Nonetheless, there was a slight diminishment in the technical depth of the summaries as opposed to the original articles. As a result, our conclusion underscores ChatGPT's text summarization capability as a potent tool for extracting essential insights in a manner more aligned with reporting than purely scientific discourse.


title: DP-OPT: Make Large Language Model Your Privacy-Preserving Prompt Engineer

abstract: Large Language Models (LLMs) have emerged as dominant tools for various tasks, particularly when tailored for a specific target by prompt tuning. Nevertheless, concerns surrounding data privacy present obstacles due to the tuned prompts' dependency on sensitive private information. A practical solution is to host a local LLM and optimize a soft prompt privately using data. Yet, hosting a local model becomes problematic when model ownership is protected. Alternative methods, like sending data to the model's provider for training, intensify these privacy issues facing an untrusted provider. In this paper, we present a novel solution called Differentially-Private Offsite Prompt Tuning (DP-OPT) to address this challenge. Our approach involves tuning a discrete prompt on the client side and then applying it to the desired cloud models. We demonstrate that prompts suggested by LLMs themselves can be transferred without compromising performance significantly. To ensure that the prompts do not leak private information, we introduce the first private prompt generation mechanism, by a differentially-private (DP) ensemble of in-context learning with private demonstrations. With DP-OPT, generating privacy-preserving prompts by Vicuna-7b can yield competitive performance compared to non-private in-context learning on GPT3.5 or local private prompt tuning. Codes are available at https://github.com/VITA-Group/DP-OPT .


title: SCStory: Self-supervised and Continual Online Story Discovery

abstract: We present a framework SCStory for online story discovery, that helps people digest rapidly published news article streams in real-time without human annotations. To organize news article streams into stories, existing approaches directly encode the articles and cluster them based on representation similarity. However, these methods yield noisy and inaccurate story discovery results because the generic article embeddings do not effectively reflect the story-indicative semantics in an article and cannot adapt to the rapidly evolving news article streams. SCStory employs self-supervised and continual learning with a novel idea of story-indicative adaptive modeling of news article streams. With a lightweight hierarchical embedding module that first learns sentence representations and then article representations, SCStory identifies story-relevant information of news articles and uses them to discover stories. The embedding module is continuously updated to adapt to evolving news streams with a contrastive learning objective, backed up by two unique techniques, confidence-aware memory replay and prioritized-augmentation, employed for label absence and data scarcity problems. Thorough experiments on real and the latest news data sets demonstrate that SCStory outperforms existing state-of-the-art algorithms for unsupervised online story discovery.


title: Interpretation modeling: Social grounding of sentences by reasoning over their implicit moral judgments

abstract: The social and implicit nature of human communication ramifies readers' understandings of written sentences. Single gold-standard interpretations rarely exist, challenging conventional assumptions in natural language processing. This work introduces the interpretation modeling (IM) task which involves modeling several interpretations of a sentence's underlying semantics to unearth layers of implicit meaning. To obtain these, IM is guided by multiple annotations of social relation and common ground - in this work approximated by reader attitudes towards the author and their understanding of moral judgments subtly embedded in the sentence. We propose a number of modeling strategies that rely on one-to-one and one-to-many generation methods that take inspiration from the philosophical study of interpretation. A first-of-its-kind IM dataset is curated to support experiments and analyses. The modeling results, coupled with scrutiny of the dataset, underline the challenges of IM as conflicting and complex interpretations are socially plausible. This interplay of diverse readings is affirmed by automated and human evaluations on the generated interpretations. Finally, toxicity analyses in the generated interpretations demonstrate the importance of IM for refining filters of content and assisting content moderators in safeguarding the safety in online discourse.