title: Variational Gaussian approximation for the magnetic Schr\"odinger equation

abstract: In the present paper we consider the semiclassical magnetic Schr\"odinger equation, which describes the dynamics of particles under the influence of a magnetic field. The solution of the time-dependent Schr\"odinger equation is approximated by a single Gaussian wave packet via the time-dependent Dirac--Frenkel variational principle. For the approximation we derive ordinary differential equations of motion for the parameters of the variational solution. Moreover, we prove $L^2$-error bounds and observable error bounds for the approximating Gaussian wave packet.


title: Mapping the Empirical Evidence of the GDPR (In-)Effectiveness: A Systematic Review

abstract: In the realm of data protection, a striking disconnect prevails between traditional domains of doctrinal, legal, theoretical, and policy-based inquiries and a burgeoning body of empirical evidence. Much of the scholarly and regulatory discourse remains entrenched in abstract legal principles or normative frameworks, leaving the empirical landscape uncharted or minimally engaged. Since the birth of EU data protection law, a modest body of empirical evidence has been generated but remains widely scattered and unexamined. Such evidence offers vital insights into the perception, impact, clarity, and effects of data protection measures but languishes on the periphery, inadequately integrated into the broader conversation. To make a meaningful connection, we conduct a comprehensive review and synthesis of empirical research spanning nearly three decades (1995- March 2022), advocating for a more robust integration of empirical evidence into the evaluation and review of the GDPR, while laying a methodological foundation for future empirical research.


title: Thermodynamic geometry of a system with unified quantum statistics

abstract: We examine the thermodynamic characteristics of unified quantum statistics as a novel framework that undergoes a crossover between Bose-Einstein and Fermi-Dirac statistics by varying a generalization parameter $\delta$. We find an attractive intrinsic statistical interaction when $\delta\le0.5$ where the thermodynamic curvature remains positive throughout the entire physical range. For $0.5 < \delta < 1$ the system exhibits predominantly Fermi-like behavior at high temperatures, while at low temperatures, the thermodynamic curvature is positive and the system behaves like bosons. As the temperature decreases further, the system undergoes a transition into the condensate phase. We also report on a critical fugacity ($z = Z^*$) defined as the point at which the thermodynamic curvature changes sign, i.e. for $z< Z^*$ ($z > Z^*$), the statistical behavior resembles that of fermions (bosons). Also, we extract the variation of statistical behaviour of the system for different values of generalization parameter with respect to the temperature. We evaluate the critical fugacity and critical $\delta$ dependent condensation temperature of the system. Finally, we investigate the specific heat as a function of temperature and condensation phase transition temperature of the system for different values of generalization parameter in different dimensions.


title: Translating Universal Scene Descriptions into Knowledge Graphs for Robotic Environment

abstract: Robots performing human-scale manipulation tasks require an extensive amount of knowledge about their surroundings in order to perform their actions competently and human-like. In this work, we investigate the use of virtual reality technology as an implementation for robot environment modeling, and present a technique for translating scene graphs into knowledge bases. To this end, we take advantage of the Universal Scene Description (USD) format which is an emerging standard for the authoring, visualization and simulation of complex environments. We investigate the conversion of USD-based environment models into Knowledge Graph (KG) representations that facilitate semantic querying and integration with additional knowledge sources.


title: Improving Conversational Recommendation Systems via Bias Analysis and Language-Model-Enhanced Data Augmentation

abstract: Conversational Recommendation System (CRS) is a rapidly growing research area that has gained significant attention alongside advancements in language modelling techniques. However, the current state of conversational recommendation faces numerous challenges due to its relative novelty and limited existing contributions. In this study, we delve into benchmark datasets for developing CRS models and address potential biases arising from the feedback loop inherent in multi-turn interactions, including selection bias and multiple popularity bias variants. Drawing inspiration from the success of generative data via using language models and data augmentation techniques, we present two novel strategies, 'Once-Aug' and 'PopNudge', to enhance model performance while mitigating biases. Through extensive experiments on ReDial and TG-ReDial benchmark datasets, we show a consistent improvement of CRS techniques with our data augmentation approaches and offer additional insights on addressing multiple newly formulated biases.


title: Gap-free 16-year (2005-2020) sub-diurnal surface meteorological observations across Florida

abstract: The rather unique sub-tropical, flat, peninsular region of Florida is subject to a unique climate with extreme weather events across the year that impacts agriculture, public health, and management of natural resources. Meteorological data at high temporal resolutions especially in the tropical latitudes are essential to understand diurnal and semi-diurnal variations of climate, which are considered to be the fundamental modes of climate variations of our Earth system. However, many meteorological datasets contain gaps that limit their use for validation of models and further detailed observational analysis. The objective of this paper is to apply a set of data gap filling strategies to develop a gap-free dataset with 15-minute observations for the sub-tropical region of Florida. Using data from the Florida Automated Weather Network (FAWN), methods of linear interpolation, trend continuation, reference to external sources, and nearest station substitution were applied to fill in the data gaps depending on the extent of the gap. The outcome of this study provides continuous, publicly accessible surface meteorological observations for 30 FAWN stations at 15-minute intervals for the years 2005-2020.


title: Reachability in Fixed VASS: Expressiveness and Lower Bounds

abstract: The recent years have seen remarkable progress in establishing the complexity of the reachability problem for vector addition systems with states (VASS), equivalently known as Petri nets. Existing work primarily considers the case in which both the VASS as well as the initial and target configurations are part of the input. In this paper, we investigate the reachability problem in the setting where the VASS is fixed and only the initial configuration is variable. We show that fixed VASS fully express arithmetic on initial segments of the natural numbers. It follows that there is a very weak reduction from any fixed such number-theoretic predicate (e.g. primality or square-freeness) to reachability in fixed VASS where configurations are presented in unary. If configurations are given in binary, we show that there is a fixed VASS with five counters whose reachability problem is PSPACE-hard.


title: Stochastic Latent Transformer: Efficient Modelling of Stochastically Forced Zonal Jets

abstract: We present a novel probabilistic deep learning approach, the 'Stochastic Latent Transformer' (SLT), designed for the efficient reduced-order modelling of stochastic partial differential equations. Stochastically driven flow models are pertinent to a diverse range of natural phenomena, including jets on giant planets, ocean circulation, and the variability of midlatitude weather. However, much of the recent progress in deep learning has predominantly focused on deterministic systems. The SLT comprises a stochastically-forced transformer paired with a translation-equivariant autoencoder, trained towards the Continuous Ranked Probability Score. We showcase its effectiveness by applying it to a well-researched zonal jet system, where the interaction between stochastically forced eddies and the zonal mean flow results in a rich low-frequency variability. The SLT accurately reproduces system dynamics across various integration periods, validated through quantitative diagnostics that include spectral properties and the rate of transitions between distinct states. The SLT achieves a five-order-of-magnitude speedup in emulating the zonally-averaged flow compared to direct numerical simulations. This acceleration facilitates the cost-effective generation of large ensembles, enabling the exploration of statistical questions concerning the probabilities of spontaneous transition events.


title: Interferometric Neural Networks

abstract: On the one hand, artificial neural networks have many successful applications in the field of machine learning and optimization. On the other hand, interferometers are integral parts of any field that deals with waves such as optics, astronomy, and quantum physics. Here, we introduce neural networks composed of interferometers and then build generative adversarial networks from them. Our networks do not have any classical layer and can be realized on quantum computers or photonic chips. We demonstrate their applicability for combinatorial optimization, image classification, and image generation. For combinatorial optimization, our network consistently converges to the global optimum or remains within a narrow range of it. In multi-class image classification tasks, our networks achieve accuracies of 93% and 83%. Lastly, we show their capability to generate images of digits from 0 to 9 as well as human faces.


title: Scalar mass conservation in turbulent mixture fraction based combustion models through consistent local flow parameters

abstract: Mixture fraction-based models are widely employed for predicting turbulent non-premixed combustion processes due to their cost-effectiveness and well-established subfilter closure. In these models, the transport of reactive scalars in physical space is decomposed into two components: scalar transport relative to mixture fraction and transport of mixture fraction in physical space. Conventional flamelet models do not consider that these two processes have to be formulated consistently, which can lead to scalar mass conservation errors. In the context of multiphase flows, scalar transport in mixture fraction space is governed by three conditional flow-dependent parameters: the conditional scalar dissipation rate, the conditional scalar diffusion rate, and the conditional spray source term. The evolution of mixture fraction in physical space is typically modeled using the presumed Filtered Density Function (FDF) approach. This paper introduces a novel formulation for the conditional flow parameters that aligns with the presumed FDF approach, thereby ensuring scalar mass conservation. The proposed model is applied to a Large-Eddy Simulation (LES) of the inert ECN Spray A case, with a comparison against a conventional flow parameter model that employs an inverse error function shape for the scalar dissipation rate. The results indicate that the conventional model produces similar conditional dissipation rates to the new model in regions where combustion takes place. However, significant discrepancies are observed in the conditional diffusion rate, highlighting the susceptibility of the conventional model to scalar mass conservation errors for non-unity Lewis number scalars.


title: Simulating CDT quantum gravity

abstract: We provide a hands-on introduction to Monte Carlo simulations in nonperturbative lattice quantum gravity, formulated in terms of Causal Dynamical Triangulations (CDT). We describe explicitly the implementation of Monte Carlo moves and the associated detailed-balance equations in two and three spacetime dimensions. We discuss how to optimize data storage and retrieval, which are nontrivial due to the dynamical nature of the lattices, and how to reconstruct the full geometry from selected stored data. Various aspects of the simulation, including tuning, thermalization and the measurement of observables are also treated. An associated open-source C++ implementation code is freely available online.


title: Design Space Exploration of Sparsity-Aware Application-Specific Spiking Neural Network Accelerators

abstract: Spiking Neural Networks (SNNs) offer a promising alternative to Artificial Neural Networks (ANNs) for deep learning applications, particularly in resource-constrained systems. This is largely due to their inherent sparsity, influenced by factors such as the input dataset, the length of the spike train, and the network topology. While a few prior works have demonstrated the advantages of incorporating sparsity into the hardware design, especially in terms of reducing energy consumption, the impact on hardware resources has not yet been explored. This is where design space exploration (DSE) becomes crucial, as it allows for the optimization of hardware performance by tailoring both the hardware and model parameters to suit specific application needs. However, DSE can be extremely challenging given the potentially large design space and the interplay of hardware architecture design choices and application-specific model parameters. In this paper, we propose a flexible hardware design that leverages the sparsity of SNNs to identify highly efficient, application-specific accelerator designs. We develop a high-level, cycle-accurate simulation framework for this hardware and demonstrate the framework's benefits in enabling detailed and fine-grained exploration of SNN design choices, such as the layer-wise logical-to-hardware ratio (LHR). Our experimental results show that our design can (i) achieve up to $76\%$ reduction in hardware resources and (ii) deliver a speed increase of up to $31.25\times$, while requiring $27\%$ fewer hardware resources compared to sparsity-oblivious designs. We further showcase the robustness of our framework by varying spike train lengths with different neuron population sizes to find the optimal trade-off points between accuracy and hardware latency.


title: HANSEN: Human and AI Spoken Text Benchmark for Authorship Analysis

abstract: Authorship Analysis, also known as stylometry, has been an essential aspect of Natural Language Processing (NLP) for a long time. Likewise, the recent advancement of Large Language Models (LLMs) has made authorship analysis increasingly crucial for distinguishing between human-written and AI-generated texts. However, these authorship analysis tasks have primarily been focused on written texts, not considering spoken texts. Thus, we introduce the largest benchmark for spoken texts - HANSEN (Human ANd ai Spoken tExt beNchmark). HANSEN encompasses meticulous curation of existing speech datasets accompanied by transcripts, alongside the creation of novel AI-generated spoken text datasets. Together, it comprises 17 human datasets, and AI-generated spoken texts created using 3 prominent LLMs: ChatGPT, PaLM2, and Vicuna13B. To evaluate and demonstrate the utility of HANSEN, we perform Authorship Attribution (AA) & Author Verification (AV) on human-spoken datasets and conducted Human vs. AI spoken text detection using state-of-the-art (SOTA) models. While SOTA methods, such as, character ngram or Transformer-based model, exhibit similar AA & AV performance in human-spoken datasets compared to written ones, there is much room for improvement in AI-generated spoken text detection. The HANSEN benchmark is available at: https://huggingface.co/datasets/HANSEN-REPO/HANSEN.


title: Spectral Background-Subtracted Activity Maps

abstract: High-resolution solar spectroscopy provides a wealth of information from photospheric and chromospheric spectral lines. However, the volume of data easily exceeds hundreds of millions of spectra on a single observation day. Therefore, methods are needed to identify spectral signatures of interest in multidimensional datasets. Background-subtracted activity maps (BaSAMs) have previously been used to locate features of solar activity in time series of images and filtergrams. This research note shows how this method can be extended and adapted to spectral data.


title: Integrated Freeway Traffic Control Using Q-Learning with Adjacent Arterial Traffic Considerations

abstract: Numerous studies have shown the effectiveness of intelligent transportation system techniques such as variable speed limit (VSL), lane change (LC) control, and ramp metering (RM) in freeway traffic flow control. The integration of these techniques has the potential to further enhance the traffic operation efficiency of both freeway and adjacent arterial networks. In this regard, we propose a freeway traffic control (FTC) strategy that coordinates VSL, LC, RM actions using a Q-learning (QL) framework which takes into account arterial traffic characteristics. The signal timing and demands of adjacent arterial intersections are incorporated as state variables of the FTC agent. The FTC agent is initially trained offline using a single-section road network, and subsequently deployed online in a connected freeway and arterial simulation network for continuous learning. The arterial network is assumed to be regulated by a traffic-responsive signal control strategy based on a cycle length model. Microscopic simulations demonstrate that the fully-trained FTC agent provides significant reductions in freeway travel time and the number of stops in scenarios with traffic congestion. It clearly outperforms an uncoordinated FTC and a decentralized feedback control strategy. Even though the FTC agent does not control the arterial traffic signals, it leads to shorter average queue lengths at arterial intersections by taking into account the arterial traffic conditions in controlling freeway traffic. These results motivate a future research where the QL framework will also include the control of arterial traffic signals.


title: DISCO: A Large Scale Human Annotated Corpus for Disfluency Correction in Indo-European Languages

abstract: Disfluency correction (DC) is the process of removing disfluent elements like fillers, repetitions and corrections from spoken utterances to create readable and interpretable text. DC is a vital post-processing step applied to Automatic Speech Recognition (ASR) outputs, before subsequent processing by downstream language understanding tasks. Existing DC research has primarily focused on English due to the unavailability of large-scale open-source datasets. Towards the goal of multilingual disfluency correction, we present a high-quality human-annotated DC corpus covering four important Indo-European languages: English, Hindi, German and French. We provide extensive analysis of results of state-of-the-art DC models across all four languages obtaining F1 scores of 97.55 (English), 94.29 (Hindi), 95.89 (German) and 92.97 (French). To demonstrate the benefits of DC on downstream tasks, we show that DC leads to 5.65 points increase in BLEU scores on average when used in conjunction with a state-of-the-art Machine Translation (MT) system. We release code to run our experiments along with our annotated dataset here.


title: Metrically Scaled Monocular Depth Estimation through Sparse Priors for Underwater Robots

abstract: In this work, we address the problem of real-time dense depth estimation from monocular images for mobile underwater vehicles. We formulate a deep learning model that fuses sparse depth measurements from triangulated features to improve the depth predictions and solve the problem of scale ambiguity. To allow prior inputs of arbitrary sparsity, we apply a dense parameterization method. Our model extends recent state-of-the-art approaches to monocular image based depth estimation, using an efficient encoder-decoder backbone and modern lightweight transformer optimization stage to encode global context. The network is trained in a supervised fashion on the forward-looking underwater dataset, FLSea. Evaluation results on this dataset demonstrate significant improvement in depth prediction accuracy by the fusion of the sparse feature priors. In addition, without any retraining, our method achieves similar depth prediction accuracy on a downward looking dataset we collected with a diver operated camera rig, conducting a survey of a coral reef. The method achieves real-time performance, running at 160 FPS on a laptop GPU and 7 FPS on a single CPU core and is suitable for direct deployment on embedded systems. The implementation of this work is made publicly available at https://github.com/ebnerluca/uw_depth.


title: Electronic Goos-H\"anchen shift through double barriers in phosphorene

abstract: We consider fermions in phosphorene through double barriers and study the corresponding Goos-H\"anchen (GH) shift. To accomplish this, we initially compute the corresponding transmission amplitude by applying boundary conditions. From the resulting transmission phase, we extract the GH shift. Our findings reveal that the GH shift's magnitude is contingent upon the energy of the incident electron and the barrier parameters. Additionally, we observe that the GH shift changes sign at the transmission boundaries-specifically, at the transmission resonances occurring immediately before and after the gap region, where transmission is zero.


title: Simple, Scalable and Effective Clustering via One-Dimensional Projections

abstract: Clustering is a fundamental problem in unsupervised machine learning with many applications in data analysis. Popular clustering algorithms such as Lloyd's algorithm and $k$-means++ can take $\Omega(ndk)$ time when clustering $n$ points in a $d$-dimensional space (represented by an $n\times d$ matrix $X$) into $k$ clusters. In applications with moderate to large $k$, the multiplicative $k$ factor can become very expensive. We introduce a simple randomized clustering algorithm that provably runs in expected time $O(\mathrm{nnz}(X) + n\log n)$ for arbitrary $k$. Here $\mathrm{nnz}(X)$ is the total number of non-zero entries in the input dataset $X$, which is upper bounded by $nd$ and can be significantly smaller for sparse datasets. We prove that our algorithm achieves approximation ratio $\smash{\widetilde{O}(k^4)}$ on any input dataset for the $k$-means objective. We also believe that our theoretical analysis is of independent interest, as we show that the approximation ratio of a $k$-means algorithm is approximately preserved under a class of projections and that $k$-means++ seeding can be implemented in expected $O(n \log n)$ time in one dimension. Finally, we show experimentally that our clustering algorithm gives a new tradeoff between running time and cluster quality compared to previous state-of-the-art methods for these tasks.


title: PROMINET: Prototype-based Multi-View Network for Interpretable Email Response Prediction

abstract: Email is a widely used tool for business communication, and email marketing has emerged as a cost-effective strategy for enterprises. While previous studies have examined factors affecting email marketing performance, limited research has focused on understanding email response behavior by considering email content and metadata. This study proposes a Prototype-based Multi-view Network (PROMINET) that incorporates semantic and structural information from email data. By utilizing prototype learning, the PROMINET model generates latent exemplars, enabling interpretable email response prediction. The model maps learned semantic and structural exemplars to observed samples in the training data at different levels of granularity, such as document, sentence, or phrase. The approach is evaluated on two real-world email datasets: the Enron corpus and an in-house Email Marketing corpus. Experimental results demonstrate that the PROMINET model outperforms baseline models, achieving a ~3% improvement in F1 score on both datasets. Additionally, the model provides interpretability through prototypes at different granularity levels while maintaining comparable performance to non-interpretable models. The learned prototypes also show potential for generating suggestions to enhance email text editing and improve the likelihood of effective email responses. This research contributes to enhancing sender-receiver communication and customer engagement in email interactions.


title: CAD -- Contextual Multi-modal Alignment for Dynamic AVQA

abstract: In the context of Audio Visual Question Answering (AVQA) tasks, the audio visual modalities could be learnt on three levels: 1) Spatial, 2) Temporal, and 3) Semantic. Existing AVQA methods suffer from two major shortcomings; the audio-visual (AV) information passing through the network isn't aligned on Spatial and Temporal levels; and, inter-modal (audio and visual) Semantic information is often not balanced within a context; this results in poor performance. In this paper, we propose a novel end-to-end Contextual Multi-modal Alignment (CAD) network that addresses the challenges in AVQA methods by i) introducing a parameter-free stochastic Contextual block that ensures robust audio and visual alignment on the Spatial level; ii) proposing a pre-training technique for dynamic audio and visual alignment on Temporal level in a self-supervised setting, and iii) introducing a cross-attention mechanism to balance audio and visual information on Semantic level. The proposed novel CAD network improves the overall performance over the state-of-the-art methods on average by 9.4% on the MUSIC-AVQA dataset. We also demonstrate that our proposed contributions to AVQA can be added to the existing methods to improve their performance without additional complexity requirements.


title: HI-TOM: A Benchmark for Evaluating Higher-Order Theory of Mind Reasoning in Large Language Models

abstract: Theory of Mind (ToM) is the ability to reason about one's own and others' mental states. ToM plays a critical role in the development of intelligence, language understanding, and cognitive processes. While previous work has primarily focused on first and second-order ToM, we explore higher-order ToM, which involves recursive reasoning on others' beliefs. We introduce HI-TOM, a Higher Order Theory of Mind benchmark. Our experimental evaluation using various Large Language Models (LLMs) indicates a decline in performance on higher-order ToM tasks, demonstrating the limitations of current LLMs. We conduct a thorough analysis of different failure cases of LLMs, and share our thoughts on the implications of our findings on the future of NLP.


title: Vacuum energy of scalar fields on spherical shells with general matching conditions

abstract: In this work we analyze the spectral zeta function for massless scalar fields propagating in a $D$-dimensional flat space under the influence of a shell potential. The shell potential is defined in terms of the two-interval self-adjoint extensions of the Hamiltonian describing the dynamics of the scalar field. After performing the necessary analytic continuation, we utilize the spectral zeta function of the system to compute the vacuum energy of the field.


title: All-rounder: A flexible DNN accelerator with diverse data format support

abstract: Recognizing the explosive increase in the use of DNN-based applications, several industrial companies developed a custom ASIC (e.g., Google TPU, IBM RaPiD, Intel NNP-I/NNP-T) and constructed a hyperscale cloud infrastructure with it. The ASIC performs operations of the inference or training process of DNN models which are requested by users. Since the DNN models have different data formats and types of operations, the ASIC needs to support diverse data formats and generality for the operations. However, the conventional ASICs do not fulfill these requirements. To overcome the limitations of it, we propose a flexible DNN accelerator called All-rounder. The accelerator is designed with an area-efficient multiplier supporting multiple precisions of integer and floating point datatypes. In addition, it constitutes a flexibly fusible and fissionable MAC array to support various types of DNN operations efficiently. We implemented the register transfer level (RTL) design using Verilog and synthesized it in 28nm CMOS technology. To examine practical effectiveness of our proposed designs, we designed two multiply units and three state-of-the-art DNN accelerators. We compare our multiplier with the multiply units and perform architectural evaluation on performance and energy efficiency with eight real-world DNN models. Furthermore, we compare benefits of the All-rounder accelerator to a high-end GPU card, i.e., NVIDIA GeForce RTX30390. The proposed All-rounder accelerator universally has speedup and high energy efficiency in various DNN benchmarks than the baselines.


title: Mock plectic points

abstract: A $p$-arithmetic subgroup of $\mathrm{SL}_2(\mathbb{Q})$ like the Ihara group $\Gamma := \mathrm{SL}_2(\mathbb{Z}[1/p])$ acts by M\"obius transformations on the Poincar\'e upper half plane $\mathcal{H}$ and on Drinfeld's $p$-adic upper half plane $\mathcal{H}_p := \mathbb{P}_1(\mathbb{C}_p)\setminus\mathbb{P}_1(\mathbb{Q}_p)$. The diagonal action of $\Gamma$ on the product is discrete, and the quotient $\Gamma\backslash(\mathcal{H}_p\times \mathcal{H})$ can be envisaged as a "mock Hilbert modular surface". According to a striking prediction of Nekov\'a$\check{\text{r}}$ and Scholl, the CM points on genuine Hilbert modular surfaces should give rise to "plectic Heegner points" that encode non-trivial regulators attached, notably, to elliptic curves of rank two over real quadratic fields. This article develops the analogy between Hilbert modular surfaces and their mock counterparts, with the aim of transposing the plectic philosophy to the mock Hilbert setting, where the analogous plectic invariants are expected to lie in the alternating square of the Mordell-Weil group of certain elliptic curves of rank two over $\mathbb{Q}$.


title: Zero-sound modes for the nuclear equation of state at supra-normal densities

abstract: The meaningful correlations between the zero-sound modes and the stiffness of the nuclear equation of state (EOS) are uncovered in nuclear matter with the relativistic mean-field theory. It is demonstrated that the high-density zero-sound modes merely exist in models with the stiff EOS. While the stiff EOS can be softened by including {\omega}-meson self-interactions (the {\omega}4 term), the weakened coupling of the {\omega}-meson self-interactions reignites the zero sound at high density. These results suggest that the high-density zero-sound modes can be used to probe the stiffness of the EOS at supra-normal densities. The implications and effects of zero sounds are also discussed in heavy ion collisions and neutron stars.


title: Using Knowledge Awareness to improve Safety of Autonomous Driving

abstract: We present a method, which incorporates knowledge awareness into the symbolic computation of discrete controllers for reactive cyber physical systems, to improve decision making about the unknown operating environment under uncertain/incomplete inputs. Assuming an abstract model of the system and the environment, we translate the knowledge awareness of the operating context into linear temporal logic formulas and incorporate them into the system specifications to synthesize a controller. The knowledge base is built upon an ontology model of the environment objects and behavioural rules, which includes also symbolic models of partial input features. The resulting symbolic controller support smoother, early reactions, which improves the security of the system over existing approaches based on incremental symbolic perception. A motion planning case study for an autonomous vehicle has been implemented to validate the approach, and presented results show significant improvements with respect to safety of state-of-the-art symbolic controllers for reactive systems.


title: IntenDD: A Unified Contrastive Learning Approach for Intent Detection and Discovery

abstract: Identifying intents from dialogue utterances forms an integral component of task-oriented dialogue systems. Intent-related tasks are typically formulated either as a classification task, where the utterances are classified into predefined categories or as a clustering task when new and previously unknown intent categories need to be discovered from these utterances. Further, the intent classification may be modeled in a multiclass (MC) or multilabel (ML) setup. While typically these tasks are modeled as separate tasks, we propose IntenDD, a unified approach leveraging a shared utterance encoding backbone. IntenDD uses an entirely unsupervised contrastive learning strategy for representation learning, where pseudo-labels for the unlabeled utterances are generated based on their lexical features. Additionally, we introduce a two-step post-processing setup for the classification tasks using modified adsorption. Here, first, the residuals in the training data are propagated followed by smoothing the labels both modeled in a transductive setting. Through extensive evaluations on various benchmark datasets, we find that our approach consistently outperforms competitive baselines across all three tasks. On average, IntenDD reports percentage improvements of 2.32%, 1.26%, and 1.52% in their respective metrics for few-shot MC, few-shot ML, and the intent discovery tasks respectively.


title: An Infinite Needle in a Finite Haystack: Finding Infinite Counter-Models in Deductive Verification

abstract: First-order logic, and quantifiers in particular, are widely used in deductive verification. Quantifiers are essential for describing systems with unbounded domains, but prove difficult for automated solvers. Significant effort has been dedicated to finding quantifier instantiations that establish unsatisfiability, thus ensuring validity of a system's verification conditions. However, in many cases the formulas are satisfiable: this is often the case in intermediate steps of the verification process. For such cases, existing tools are limited to finding finite models as counterexamples. Yet, some quantified formulas are satisfiable but only have infinite models. Such infinite counter-models are especially typical when first-order logic is used to approximate inductive definitions such as linked lists or the natural numbers. The inability of solvers to find infinite models makes them diverge in these cases. In this paper, we tackle the problem of finding such infinite models. These models allow the user to identify and fix bugs in the modeling of the system and its properties. Our approach consists of three parts. First, we introduce symbolic structures as a way to represent certain infinite models. Second, we describe an effective model finding procedure that symbolically explores a given family of symbolic structures. Finally, we identify a new decidable fragment of first-order logic that extends and subsumes the many-sorted variant of EPR, where satisfiable formulas always have a model representable by a symbolic structure within a known family. We evaluate our approach on examples from the domains of distributed consensus protocols and of heap-manipulating programs. Our implementation quickly finds infinite counter-models that demonstrate the source of verification failures in a simple way, while SMT solvers and theorem provers such as Z3, cvc5, and Vampire diverge.


title: SuperHF: Supervised Iterative Learning from Human Feedback

abstract: While large language models demonstrate remarkable capabilities, they often present challenges in terms of safety, alignment with human values, and stability during training. Here, we focus on two prevalent methods used to align these models, Supervised Fine-Tuning (SFT) and Reinforcement Learning from Human Feedback (RLHF). SFT is simple and robust, powering a host of open-source models, while RLHF is a more sophisticated method used in top-tier models like ChatGPT but also suffers from instability and susceptibility to reward hacking. We propose a novel approach, Supervised Iterative Learning from Human Feedback (SuperHF), which seeks to leverage the strengths of both methods. Our hypothesis is two-fold: that the reward model used in RLHF is critical for efficient data use and model generalization and that the use of Proximal Policy Optimization (PPO) in RLHF may not be necessary and could contribute to instability issues. SuperHF replaces PPO with a simple supervised loss and a Kullback-Leibler (KL) divergence prior. It creates its own training data by repeatedly sampling a batch of model outputs and filtering them through the reward model in an online learning regime. We then break down the reward optimization problem into three components: robustly optimizing the training rewards themselves, preventing reward hacking-exploitation of the reward model that degrades model performance-as measured by a novel METEOR similarity metric, and maintaining good performance on downstream evaluations. Our experimental results show SuperHF exceeds PPO-based RLHF on the training objective, easily and favorably trades off high reward with low reward hacking, improves downstream calibration, and performs the same on our GPT-4 based qualitative evaluation scheme all the while being significantly simpler to implement, highlighting SuperHF's potential as a competitive language model alignment technique.


title: ConvNets Match Vision Transformers at Scale

abstract: Many researchers believe that ConvNets perform well on small or moderately sized datasets, but are not competitive with Vision Transformers when given access to datasets on the web-scale. We challenge this belief by evaluating a performant ConvNet architecture pre-trained on JFT-4B, a large labelled dataset of images often used for training foundation models. We consider pre-training compute budgets between 0.4k and 110k TPU-v4 core compute hours, and train a series of networks of increasing depth and width from the NFNet model family. We observe a log-log scaling law between held out loss and compute budget. After fine-tuning on ImageNet, NFNets match the reported performance of Vision Transformers with comparable compute budgets. Our strongest fine-tuned model achieves a Top-1 accuracy of 90.4%.


title: How to Extend 3D GBSM to Integrated Sensing and Communication Channel with Sharing Feature?

abstract: Integrated Sensing and Communication (ISAC) is a promising technology in 6G systems. The existing 3D Geometry-Based Stochastic Model (GBSM), as standardized for 5G systems, addresses solely communication channels and lacks consideration of the integration with sensing channel. Therefore, this letter extends 3D GBSM to support ISAC research, with a particular focus on capturing the sharing feature of both channels, including shared scatterers, clusters, paths, and similar propagation param-eters, which have been experimentally verified in the literature. The proposed approach can be summarized as follows: Firstly, an ISAC channel model is proposed, where shared and non-shared components are superimposed for both communication and sensing. Secondly, sensing channel is characterized as a cascade of TX-target, radar cross section, and target-RX, with the introduction of a novel parameter S for shared target extraction. Finally, an ISAC channel implementation framework is proposed, allowing flexible configuration of sharing feature and the joint generation of communication and sensing channels. The proposed ISAC channel model can be compatible with the 3GPP standards and offers promising support for ISAC technology evaluation.


title: Conditional Euclidean distance optimization via relative tangency

abstract: We introduce a theory of relative tangency for projective algebraic varieties. The dual variety $X_Z^\vee$ of a variety $X$ relative to a subvariety $Z$ is the set of hyperplanes tangent to $X$ at a point of $Z$. We also introduce the concept of polar classes of $X$ relative to $Z$. We explore the duality of varieties of low rank matrices relative to special linear sections. In this framework, we study the critical points of the Euclidean Distance function from a data point to $X$, lying on $Z$. The locus where the number of such conditional critical points is positive is called the ED data locus of $X$ given $Z$. The generic number of such critical points defines the conditional ED degree of $X$ given $Z$. We show the irreducibility of ED data loci, and we compute their dimensions and degrees in terms of relative characteristic classes.


title: Inversion Sets and Quotient Root Systems

abstract: We provide a recursive description of all decompositions of the positive roots $R^+$ of a quotient root system $R$ into disjoint unions of inversion sets. Our description is type-independent and generalizes the analogous result for type $\mathbb A$ root systems in [USRA]. The main tool is the notion of an inflation of a subset of a quotient root system. This new notion allows us to treat all root systems (and their quotients) uniformly. We also obtain some numerical results about the number of special decompositions. The new sequences we obtain may be considered as extensions of Catalan numbers.


title: Discrete variance decay analysis of spurious mixing

abstract: Expressions for local discrete variance decay (DVD) rates are directly derived from discrete tracer equations without any assumptions on discrete fluxes of the second moment. Spurious mixing (SM) associated with numerical implementations of scalar advection and diffusion is thus estimated. The new framework is shown to avoid the need for second-moment flux definition when solved on finite-volume cell edges but still invoke certain second-moment fluxes when the DVD rates are partitioned to participating cell nodes. These implied discrete fluxes are shown to differ from those proposed in earlier literature (but share the same dissipative part) and thus reveal the non-uniqueness of their nature. They are shown to be ambiguous for high-order advection schemes introducing uncertainty to the locality of any estimates produced by a DVD approach. Additional damping of flux divergence through temporal averaging or some coarse-graining is thus shown to be necessary. Through the application of this technique, SM is found to be correlated with the distribution of eddy kinetic energy. The contribution from vertical advection to SM is found to be relatively small and correlated with the distribution of buoyancy fluxes. The explored high-order schemes are found to demonstrate levels of spurious mixing which may locally exceed background physical mixing.


title: AFLOW for alloys

abstract: Many different types of phases can form within alloys, from highly-ordered intermetallic compounds, to structurally-ordered but chemically-disordered solid solutions, and structurally-disordered (i.e. amorphous) metallic glasses. The different types of phases display very different properties, so predicting phase formation is important for understanding how materials will behave. Here, we review how first-principles data from the AFLOW repository and the aflow++ software can be used to predict phase formation in alloys, and describe some general trends that can be deduced from the data, particularly with respect to the importance of disorder and entropy in multicomponent systems.


title: Role of cilia activity and surrounding viscous fluid on properties of metachronal waves

abstract: Large groups of active cilia collectively beat in a fluid medium as metachronal waves, essential for some microorganisms motility and for flow generation in mucociliary clearance. Several models can predict the emergence of metachronal waves, but what controls the properties of metachronal waves is still unclear. Here, we investigate numerically a simple model for cilia in the presence of noise on regular lattices in one- and two-dimensions. We characterize the wave using spatial correlation and the frequency of collective beating. Our results clearly show that the viscosity of the fluid medium does not affect the wavelength; the activity of the cilia does. These numerical results are supported by a dimensional analysis, which is expected to be robust against the model for active force generation, unless surrounding fluid influences the cilia activity. Interestingly, enhancement of cilia activity increases the wavelength and decreases the beating frequency, keeping the wave velocity almost unchanged. These results might have significance in understanding paramecium locomotion and mucociliary clearance diseases.


title: The Bragg demagnifier: X-ray imaging with kilometer propagation distance within a meter

abstract: We introduce a new X-ray imaging technique to facilitate propagation-based phase contrast of large, centimeter-sized samples. The diffracted X-ray wavefield behind the sample is demagnified by asymmetric Bragg crystal optics, thereby virtually increasing the propagation distance and thus enhancing the image contrast. We demonstrate the significant increase in image contrast compared to conventional phase contrast imaging at the same short physical propagation distance. Additionally, the Bragg demagnifier enables the reduction of image blur caused by the finite X-ray source size. In combination with a subsequent Bragg magnifier, the method will allow for an even higher dose efficiency, rendering this technique a potential candidate for, e.g., low-dose (bio)medical diagnostics.


title: AI Agent as Urban Planner: Steering Stakeholder Dynamics in Urban Planning via Consensus-based Multi-Agent Reinforcement Learning

abstract: In urban planning, land use readjustment plays a pivotal role in aligning land use configurations with the current demands for sustainable urban development. However, present-day urban planning practices face two main issues. Firstly, land use decisions are predominantly dependent on human experts. Besides, while resident engagement in urban planning can promote urban sustainability and livability, it is challenging to reconcile the diverse interests of stakeholders. To address these challenges, we introduce a Consensus-based Multi-Agent Reinforcement Learning framework for real-world land use readjustment. This framework serves participatory urban planning, allowing diverse intelligent agents as stakeholder representatives to vote for preferred land use types. Within this framework, we propose a novel consensus mechanism in reward design to optimize land utilization through collective decision making. To abstract the structure of the complex urban system, the geographic information of cities is transformed into a spatial graph structure and then processed by graph neural networks. Comprehensive experiments on both traditional top-down planning and participatory planning methods from real-world communities indicate that our computational framework enhances global benefits and accommodates diverse interests, leading to improved satisfaction across different demographic groups. By integrating Multi-Agent Reinforcement Learning, our framework ensures that participatory urban planning decisions are more dynamic and adaptive to evolving community needs and provides a robust platform for automating complex real-world urban planning processes.


title: Notes on limits of accessible categories

abstract: Let $\kappa$ be a regular cardinal, $\lambda<\kappa$ be a smaller infinite cardinal, and $\mathsf K$ be a $\kappa$-accessible category where colimits of $\lambda$-indexed chains exist. We show that various category-theoretic constructions applied to $\mathsf K$, such as the inserter and the equifier, produce $\kappa$-accessible categories $\mathsf E$ again, and the most obvious expected description of the full subcategory of $\kappa$-presentable objects in $\mathsf E$ in terms of $\kappa$-presentable objects in $\mathsf K$ holds true. In particular, if $\mathsf C$ is a $\kappa$-small category, then the category of functors $\mathsf C\rightarrow\mathsf K$ is $\kappa$-accessible, and its $\kappa$-presentable objects are precisely all the functors from $\mathsf C$ to the $\kappa$-presentable objects of $\mathsf K$. We proceed to discuss the preservation of $\kappa$-accessibility by conical pseudolimits, lax and oplax limits, and weighted pseudolimits. The results of this paper go back to an unpublished 1977 preprint of Ulmer. Our motivation comes from the theory of flat modules and flat quasi-coherent sheaves.


title: The Hessian equation in quaternionic space

abstract: In this paper, we introduce $m$-subharmonic functions in quaternionic space $\mathbb{H}^{n}$, we define the quaternionic Hessian operator and solve the homogeneous Dirichlet problem for the quaternionic Hessian equation on the unit ball with continuous boundary data.


title: From Heisenberg to Hubbard: An initial state for the shallow quantum simulation of correlated electrons

abstract: The widespread use of the noninteracting ground state as the initial state for the digital quantum simulation of the Fermi-Hubbard model is largely due to the scarcity of alternative easy-to-prepare approximations to the exact ground state in the literature. Exploiting the fact that the spin-$\frac{1}{2}$ Heisenberg model is the effective low-energy theory of the Fermi-Hubbard model at half-filling in the strongly interacting limit, here we propose a three-step deterministic quantum routine to prepare an educated guess of the ground state of the Fermi-Hubbard model through a shallow circuit suitable for near-term quantum hardware. First, the ground state of the Heisenberg model is initialized via a hybrid variational method using an ansatz that explores only the correct symmetry subspace. Second, a general method is devised to convert a multi-spin-$\frac{1}{2}$ wave function into its fermionic version. Third, taking inspiration from the Baeriswyl ansatz, a constant-depth single-parameter layer that adds doublon-holon pairs is applied to this fermionic state. Numerical simulations on chains and ladders with up to 12 sites confirm the improvement over the noninteracting ground state of the overlap with the exact ground state for the intermediate values of the interaction strength at which quantum simulation is bound to be most relevant.


title: DEFT: Data Efficient Fine-Tuning for Pre-Trained Language Models via Unsupervised Core-Set Selection

abstract: Recent advances have led to the availability of many pre-trained language models (PLMs); however, a question that remains is how much data is truly needed to fine-tune PLMs for downstream tasks? In this work, we introduce DEFT-UCS, a data-efficient fine-tuning framework that leverages unsupervised core-set selection to identify a smaller, representative dataset that reduces the amount of data needed to fine-tune PLMs for downstream tasks. We examine the efficacy of DEFT-UCS in the context of text-editing LMs, and compare to the state-of-the art text-editing model, CoEDIT. Our results demonstrate that DEFT-UCS models are just as accurate as CoEDIT, across eight different datasets consisting of six different editing tasks, while finetuned on 70% less data.


title: MixerFlow: MLP-Mixer meets Normalising Flows

abstract: Normalising flows are generative models that transform a complex density into a simpler density through the use of bijective transformations enabling both density estimation and data generation from a single model. %However, the requirement for bijectivity imposes the use of specialised architectures. In the context of image modelling, the predominant choice has been the Glow-based architecture, whereas alternative architectures remain largely unexplored in the research community. In this work, we propose a novel architecture called MixerFlow, based on the MLP-Mixer architecture, further unifying the generative and discriminative modelling architectures. MixerFlow offers an efficient mechanism for weight sharing for flow-based models. Our results demonstrate comparative or superior density estimation on image datasets and good scaling as the image resolution increases, making MixerFlow a simple yet powerful alternative to the Glow-based architectures. We also show that MixerFlow provides more informative embeddings than Glow-based architectures and can integrate many structured transformations such as splines or Kolmogorov-Arnold Networks.


title: Navigating Socio-Emotional Risk through Comfort-Building in a Physics Teaching Community of Practice: A Case Study

abstract: In teacher professional development (PD), grouping teachers with varying levels of experience can be a productive and empowering way to stimulate the exchange and co-generation of content and pedagogical knowledge. However, less experienced teachers can face socio-emotional risks when engaging in collaborative science content reasoning tasks with more experienced colleagues (Finkelstein, Jaber, & Dini, 2018), and these risks may impact the collaborative experience of both parties and the learning environment in teacher PD. This descriptive case study examines the process of productively navigating socio-emotional risks and interpersonal tensions encountered by a veteran and pre-service physics teacher during one episode of discussing physics content. We use a single term, comfort-building, to encapsulate discursive moves that result in increased feelings of comfort and safety by the participants. Comfort-building includes moves that serve to mitigate social risk, ease tension, and avoid discomfort, as well as those geared toward finding common ground and co-navigating challenges. These moves can carve out conversational space for teachers to more confidently face risks associated with being accountable to the physics content knowledge and engage in discipline-based conversations more deeply. The presented episode in this study was followed by video-stimulated individual interviews to determine how consciously the teachers connected their participation to explicit risk and comfort. This case study highlights an affective dimension for consideration in the continued study and facilitation of science teaching communities of practice, especially ones that bring together teachers with a variety of backgrounds and skill sets.


title: Multi-scale Diffusion Denoised Smoothing

abstract: Along with recent diffusion models, randomized smoothing has become one of a few tangible approaches that offers adversarial robustness to models at scale, e.g., those of large pre-trained models. Specifically, one can perform randomized smoothing on any classifier via a simple "denoise-and-classify" pipeline, so-called denoised smoothing, given that an accurate denoiser is available - such as diffusion model. In this paper, we present scalable methods to address the current trade-off between certified robustness and accuracy in denoised smoothing. Our key idea is to "selectively" apply smoothing among multiple noise scales, coined multi-scale smoothing, which can be efficiently implemented with a single diffusion model. This approach also suggests a new objective to compare the collective robustness of multi-scale smoothed classifiers, and questions which representation of diffusion model would maximize the objective. To address this, we propose to further fine-tune diffusion model (a) to perform consistent denoising whenever the original image is recoverable, but (b) to generate rather diverse outputs otherwise. Our experiments show that the proposed multi-scale smoothing scheme combined with diffusion fine-tuning enables strong certified robustness available with high noise level while maintaining its accuracy close to non-smoothed classifiers.


title: Pointwise convergence of some continuous-time polynomial ergodic averages

abstract: In this paper, we study the pointwise convergence of some continuous-time polynomial ergodic averages. Our method is based on the topological models of measurable flows. One of main results of the paper is as follow. Let $(X,\mathcal{X},\mu, (T^{t})_{t\in \mathbb{R}})$ and $(X,\mathcal{X},\mu, (S^{t})_{t\in \mathbb{R}})$ be two measurable flows, $a\in \mathbb{Q}$, and $Q\in \mathbb{R}[t]$ with $\text{deg}\ Q\ge 2$. Then for any $f_1, f_2, g\in L^{\infty}(\mu)$, the limit \begin{equation*} \lim\limits_{M\to\infty}\frac{1}{M}\int_{0}^{M}f_1(T^{t}x)f_2(T^{at}x)g(S^{Q(t)}x)dt \end{equation*} exists for $\mu$-a.e. $x\in X$.


title: Kiki or Bouba? Sound Symbolism in Vision-and-Language Models

abstract: Although the mapping between sound and meaning in human language is assumed to be largely arbitrary, research in cognitive science has shown that there are non-trivial correlations between particular sounds and meanings across languages and demographic groups, a phenomenon known as sound symbolism. Among the many dimensions of meaning, sound symbolism is particularly salient and well-demonstrated with regards to cross-modal associations between language and the visual domain. In this work, we address the question of whether sound symbolism is reflected in vision-and-language models such as CLIP and Stable Diffusion. Using zero-shot knowledge probing to investigate the inherent knowledge of these models, we find strong evidence that they do show this pattern, paralleling the well-known kiki-bouba effect in psycholinguistics. Our work provides a novel method for demonstrating sound symbolism and understanding its nature using computational tools. Our code will be made publicly available.


title: autoMALA: Locally adaptive Metropolis-adjusted Langevin algorithm

abstract: Selecting the step size for the Metropolis-adjusted Langevin algorithm (MALA) is necessary in order to obtain satisfactory performance. However, finding an adequate step size for an arbitrary target distribution can be a difficult task and even the best step size can perform poorly in specific regions of the space when the target distribution is sufficiently complex. To resolve this issue we introduce autoMALA, a new Markov chain Monte Carlo algorithm based on MALA that automatically sets its step size at each iteration based on the local geometry of the target distribution. We prove that autoMALA has the correct invariant distribution, despite continual automatic adjustments of the step size. Our experiments demonstrate that autoMALA is competitive with related state-of-the-art MCMC methods, in terms of the number of log density evaluations per effective sample, and it outperforms state-of-the-art samplers on targets with varying geometries. Furthermore, we find that autoMALA tends to find step sizes comparable to optimally-tuned MALA when a fixed step size suffices for the whole domain.


title: S$^3$-TTA: Scale-Style Selection for Test-Time Augmentation in Biomedical Image Segmentation

abstract: Deep-learning models have been successful in biomedical image segmentation. To generalize for real-world deployment, test-time augmentation (TTA) methods are often used to transform the test image into different versions that are hopefully closer to the training domain. Unfortunately, due to the vast diversity of instance scale and image styles, many augmented test images produce undesirable results, thus lowering the overall performance. This work proposes a new TTA framework, S$^3$-TTA, which selects the suitable image scale and style for each test image based on a transformation consistency metric. In addition, S$^3$-TTA constructs an end-to-end augmentation-segmentation joint-training pipeline to ensure a task-oriented augmentation. On public benchmarks for cell and lung segmentation, S$^3$-TTA demonstrates improvements over the prior art by 3.4% and 1.3%, respectively, by simply augmenting the input data in testing phase.


title: Optical Kinetic Theory of Nonlinear Multi-mode Photonic Networks

abstract: Recent experimental developments in multimode nonlinear photonic circuits (MMNPC), have motivated the development of an optical thermodynamic theory that describes the equilibrium properties of an initial beam excitation. However, a non-equilibrium transport theory for these systems, when they are in contact with thermal reservoirs, is still {\it terra incognita}. Here, by combining Landauer and kinematics formalisms we develop a one-parameter scaling theory that describes the transport in one-dimensional MMNPCs from a ballistic to a diffusive regime. We also derive a photonic version of the Wiedemann -Franz law that connects the thermal and power conductivities. Our work paves the way toward a fundamental understanding of the transport properties of MMNPC and may be useful for the design of all-optical cooling protocols.


title: On-demand driven dissipation for cavity reset and cooling

abstract: We present a superconducting circuit device that provides active, on-demand, tunable dissipation on a target mode of the electromagnetic field. Our device is based on a tunable "dissipator" that can be made lossy when tuned into resonance with a broadband filter mode. When driven parametrically, this dissipator induces loss on any mode coupled to it with energy detuning equal to the drive frequency. We demonstrate the use of this device to reset a superconducting qubit's readout cavity after a measurement, removing photons with a characteristic rate above $50\ \mu\mathrm{s}^{-1}$. We also demonstrate that the dissipation can be driven constantly to simultaneously damp and cool the cavity, effectively eliminating thermal photon fluctuations as a relevant decoherence channel. Our results demonstrate the utility of our device as a modular tool for environmental engineering and entropy removal in circuit QED.


title: Optimal Inflationary Potentials

abstract: Inflation is a highly favoured theory for the early Universe. It is compatible with current observations of the cosmic microwave background and large scale structure and is a driver in the quest to detect primordial gravitational waves. It is also, given the current quality of the data, highly under-determined with a large number of candidate implementations. We use a new method in symbolic regression to generate all possible simple scalar field potentials for one of two possible basis sets of operators. Treating these as single-field, slow-roll inflationary models we then score them with an information-theoretic metric ("minimum description length") that quantifies their efficiency in compressing the information in current data. We explore two possible priors on the parameter space of potentials, one related to the functions' structural complexity and one that uses a Katz back-off language model to prefer functions that may be theoretically motivated. This enables us to identify the inflaton potentials that optimally balance simplicity with accuracy at explaining current data, which may subsequently find theoretical motivation. Our exploratory study opens the door to extraction of fundamental physics directly from data, and may be augmented with more refined theoretical priors in the quest for a complete understanding of the early Universe.


title: The Data Provenance Initiative: A Large Scale Audit of Dataset Licensing & Attribution in AI

abstract: The race to train language models on vast, diverse, and inconsistently documented datasets has raised pressing concerns about the legal and ethical risks for practitioners. To remedy these practices threatening data transparency and understanding, we convene a multi-disciplinary effort between legal and machine learning experts to systematically audit and trace 1800+ text datasets. We develop tools and standards to trace the lineage of these datasets, from their source, creators, series of license conditions, properties, and subsequent use. Our landscape analysis highlights the sharp divides in composition and focus of commercially open vs closed datasets, with closed datasets monopolizing important categories: lower resource languages, more creative tasks, richer topic variety, newer and more synthetic training data. This points to a deepening divide in the types of data that are made available under different license conditions, and heightened implications for jurisdictional legal interpretations of copyright and fair use. We also observe frequent miscategorization of licenses on widely used dataset hosting sites, with license omission of 70%+ and error rates of 50%+. This points to a crisis in misattribution and informed use of the most popular datasets driving many recent breakthroughs. As a contribution to ongoing improvements in dataset transparency and responsible use, we release our entire audit, with an interactive UI, the Data Provenance Explorer, which allows practitioners to trace and filter on data provenance for the most popular open source finetuning data collections: www.dataprovenance.org.


title: The GOOSE Dataset for Perception in Unstructured Environments

abstract: The potential for deploying autonomous systems can be significantly increased by improving the perception and interpretation of the environment. However, the development of deep learning-based techniques for autonomous systems in unstructured outdoor environments poses challenges due to limited data availability for training and testing. To address this gap, we present the German Outdoor and Offroad Dataset (GOOSE), a comprehensive dataset specifically designed for unstructured outdoor environments. The GOOSE dataset incorporates 10 000 labeled pairs of images and point clouds, which are utilized to train a range of state-of-the-art segmentation models on both image and point cloud data. We open source the dataset, along with an ontology for unstructured terrain, as well as dataset standards and guidelines. This initiative aims to establish a common framework, enabling the seamless inclusion of existing datasets and a fast way to enhance the perception capabilities of various robots operating in unstructured environments. The dataset, pre-trained models for offroad perception, and additional documentation can be found at https://goose-dataset.de/.


title: Detecting Pretraining Data from Large Language Models

abstract: Although large language models (LLMs) are widely deployed, the data used to train them is rarely disclosed. Given the incredible scale of this data, up to trillions of tokens, it is all but certain that it includes potentially problematic text such as copyrighted materials, personally identifiable information, and test data for widely reported reference benchmarks. However, we currently have no way to know which data of these types is included or in what proportions. In this paper, we study the pretraining data detection problem: given a piece of text and black-box access to an LLM without knowing the pretraining data, can we determine if the model was trained on the provided text? To facilitate this study, we introduce a dynamic benchmark WIKIMIA that uses data created before and after model training to support gold truth detection. We also introduce a new detection method Min-K% Prob based on a simple hypothesis: an unseen example is likely to contain a few outlier words with low probabilities under the LLM, while a seen example is less likely to have words with such low probabilities. Min-K% Prob can be applied without any knowledge about the pretraining corpus or any additional training, departing from previous detection methods that require training a reference model on data that is similar to the pretraining data. Moreover, our experiments demonstrate that Min-K% Prob achieves a 7.4% improvement on WIKIMIA over these previous methods. We apply Min-K% Prob to three real-world scenarios, copyrighted book detection, contaminated downstream example detection and privacy auditing of machine unlearning, and find it a consistently effective solution.


title: Improving a Named Entity Recognizer Trained on Noisy Data with a Few Clean Instances

abstract: To achieve state-of-the-art performance, one still needs to train NER models on large-scale, high-quality annotated data, an asset that is both costly and time-intensive to accumulate. In contrast, real-world applications often resort to massive low-quality labeled data through non-expert annotators via crowdsourcing and external knowledge bases via distant supervision as a cost-effective alternative. However, these annotation methods result in noisy labels, which in turn lead to a notable decline in performance. Hence, we propose to denoise the noisy NER data with guidance from a small set of clean instances. Along with the main NER model we train a discriminator model and use its outputs to recalibrate the sample weights. The discriminator is capable of detecting both span and category errors with different discriminative prompts. Results on public crowdsourcing and distant supervision datasets show that the proposed method can consistently improve performance with a small guidance set.


title: Covert Planning against Imperfect Observers

abstract: Covert planning refers to a class of constrained planning problems where an agent aims to accomplish a task with minimal information leaked to a passive observer to avoid detection. However, existing methods of covert planning often consider deterministic environments or do not exploit the observer's imperfect information. This paper studies how covert planning can leverage the coupling of stochastic dynamics and the observer's imperfect observation to achieve optimal task performance without being detected. Specifically, we employ a Markov decision process to model the interaction between the agent and its stochastic environment, and a partial observation function to capture the leaked information to a passive observer. Assuming the observer employs hypothesis testing to detect if the observation deviates from a nominal policy, the covert planning agent aims to maximize the total discounted reward while keeping the probability of being detected as an adversary below a given threshold. We prove that finite-memory policies are more powerful than Markovian policies in covert planning. Then, we develop a primal-dual proximal policy gradient method with a two-time-scale update to compute a (locally) optimal covert policy. We demonstrate the effectiveness of our methods using a stochastic gridworld example. Our experimental results illustrate that the proposed method computes a policy that maximizes the adversary's expected reward without violating the detection constraint, and empirically demonstrates how the environmental noises can influence the performance of the covert policies.


title: Learning Generalizable Program and Architecture Representations for Performance Modeling

abstract: Performance modeling is an essential tool in many areas, including performance characterization/optimization, design space exploration, and resource allocation problems, to name a few. However, existing performance modeling approaches have limitations, such as high computational cost for discrete-event simulators, narrow flexibility of hardware emulators, or restricted accuracy/generality of analytical/data-driven models. To address these limitations, this paper proposes PerfVec, a novel deep learning-based performance modeling framework that learns high-dimensional and independent/orthogonal program and microarchitecture representations. Once learned, a program representation can be used to predict its performance on any microarchitecture, and likewise, a microarchitecture representation can be applied in the performance prediction of any program. Additionally, PerfVec yields a foundation model that captures the performance essence of instructions, which can be directly used by developers in numerous performance modeling related tasks without incurring its training cost. The evaluation demonstrates that PerfVec is more general and efficient than previous approaches.


title: Fluctuations and correlations in weakly asymmetric simple exclusion on a ring subject to an atypical current

abstract: We consider the weakly asymmetric simple exclusion process on a ring, driven out of equilibrium by tilting the dynamics so as to enforce a macroscopic current of particles on a large time interval. In this current-biased dynamics, the tilt by the current makes the dynamics non-local, non homogeneous and induces long-range correlations. We compute the correlation structure in the large time, large size limit for a certain range of asymmetry and current strength, recovering heuristic results of Bodineau et al. arXiv:0807.2394. In addition, in this range of parameters, we characterise the full dynamics of fluctuations around the optimal density profile in the current-biased dynamics. The key ingredient at the microscopic scale is a precise relative entropy estimate at the level of correlations. We also discuss how to remove the (technical) restriction on the range of parameters.


title: Using Diffusion Models to Generate Synthetic Labelled Data for Medical Image Segmentation

abstract: Medical image analysis has become a prominent area where machine learning has been applied. However, high quality, publicly available data is limited either due to patient privacy laws or the time and cost required for experts to annotate images. In this retrospective study, we designed and evaluated a pipeline to generate synthetic labeled polyp images for augmenting medical image segmentation models with the aim of reducing this data scarcity. In particular, we trained diffusion models on the HyperKvasir dataset, comprising 1000 images of polyps in the human GI tract from 2008 to 2016. Qualitative expert review, Fr\'echet Inception Distance (FID), and Multi-Scale Structural Similarity (MS-SSIM) were tested for evaluation. Additionally, various segmentation models were trained with the generated data and evaluated using Dice score and Intersection over Union. We found that our pipeline produced images more akin to real polyp images based on FID scores, and segmentation performance also showed improvements over GAN methods when trained entirely, or partially, with synthetic data, despite requiring less compute for training. Moreover, the improvement persists when tested on different datasets, showcasing the transferability of the generated images.


title: QMoE: Practical Sub-1-Bit Compression of Trillion-Parameter Models

abstract: Mixture-of-Experts (MoE) architectures offer a general solution to the high inference costs of large language models (LLMs) via sparse routing, bringing faster and more accurate models, at the cost of massive parameter counts. For example, the SwitchTransformer-c2048 model has 1.6 trillion parameters, requiring 3.2TB of accelerator memory to run efficiently, which makes practical deployment challenging and expensive. In this paper, we present a solution to this memory problem, in form of a new compression and execution framework called QMoE. Specifically, QMoE consists of a scalable algorithm which accurately compresses trillion-parameter MoEs to less than 1 bit per parameter, in a custom format co-designed with bespoke GPU decoding kernels to facilitate efficient end-to-end compressed inference, with minor runtime overheads relative to uncompressed execution. Concretely, QMoE can compress the 1.6 trillion parameter SwitchTransformer-c2048 model to less than 160GB (20x compression, 0.8 bits per parameter) at only minor accuracy loss, in less than a day on a single GPU. This enables, for the first time, the execution of a trillion-parameter model on affordable commodity hardware, like a single server with 4x NVIDIA A6000 or 8x NVIDIA 3090 GPUs, at less than 5% runtime overhead relative to ideal uncompressed inference. The source code and compressed models are available at github.com/IST-DASLab/qmoe.


title: Sky location of Galactic white dwarf binaries in space-based gravitational wave detection

abstract: Quickly localizing the identified white dwarf (WD) binaries is the basic requirement for the space-based gravitational wave (GW) detection. In fact, the amplitude of GW signals are modulated by the periodic motion of GW detectors on the solar orbit. The intensity of the observed signals is enhanced according to the observation time beyond a year to enhance a high signal to noise ratio (SNR). As data gap exists, the completeness of the data observed for a long time depends on filling gaps in the data. Actually, in a year period, the GW sources have a best observation orbit position of GW detectors, where the detector response intensity of GW is maximum. Thus, the best positions, where the direction of GW source is perpendicular to the detection arms, can be searched for the verified GW sources of the sky map to enhance SNR too. For the three arms response intensity of the GW signals changing more clearly with the location of the GW sources relative to the detector, the noises and the suppression of noise by time delay interferometer are ignored. In the four chosen sources, the two verification WD binaries: J0806 and V407 Vul are observed at the best orbit positions by TAIJI for the short time of 2 and 3 days respectively. The intensities of those GWs are above the values of the TAIJI sensitivity curve, significantly. Compared with a single detector, the network of two detectors does not significantly improve the accuracy of location of the verification binaries. These results imply that the searching of GW signals and parameter estimation of GW sources from the experimental data of the space-based mission do not ignore the orbit positions relevant to GW sources.


title: Metal Nanoparticle-Functionalized Three-Dimensional Graphene: a versatile platform towards sensors and energy-related applications

abstract: We demonstrate the first successful functionalization of epitaxial three-dimensional graphene with metal nanoparticles. The functionalization is obtained by immersing the 3D graphene in a nanoparticle colloidal solution. This method is versatile and here is demonstrated for gold and palladium, but can be extended to other types and shapes of nanoparticles. We have measured the nanoparticle density on the top-surface and in the porous layer volume by Scanning Electron Microscopy and Scanning Transmission Electron Microscopy. Samples exhibit a high coverage of nanoparticles with minimal clustering. High quality graphene has been demonstrated to promote the functionalization leading to higher nanoparticle density, both on the surface and in the pores. X-ray Photoelectron Spectroscopy allowed to verify the absence of contamination after the functionalization process. Moreover, it confirmed the thermal stability of the Au- and Pd-functionalized three-dimensional graphene up to 530{\deg}C. Our approach opens up new avenues for utilizing three-dimensional graphene as a versatile platform for catalytic applications, sensors, and energy storage and conversion.


title: Reachability in Continuous Pushdown VASS

abstract: Pushdown Vector Addition Systems with States (PVASS) consist of finitely many control states, a pushdown stack, and a set of counters that can be incremented and decremented, but not tested for zero. Whether the reachability problem is decidable for PVASS is a long-standing open problem. We consider continuous PVASS, which are PVASS with a continuous semantics. This means, the counter values are rational numbers and whenever a vector is added to the current counter values, this vector is first scaled with an arbitrarily chosen rational factor between zero and one. We show that reachability in continuous PVASS is NEXPTIME-complete. Our result is unusually robust: Reachability can be decided in NEXPTIME even if all numbers are specified in binary. On the other hand, NEXPTIME-hardness already holds for coverability, in fixed dimension, for bounded stack, and even if all numbers are specified in unary.


title: Measuring Supermassive Black Hole Properties via Gravitational Radiation from Eccentrically Orbiting Stellar Mass Black Hole Binaries

abstract: There may exist stellar-mass binary black holes (BBH) which merge while orbiting nearby a supermassive black hole (SMBH). In such a triple system, the SMBH will modulate the gravitational waveform of the BBH through orbital Doppler shift and de Sitter precession of the angular momentum. Future space-based GW observatories focused on the milli- and decihertz band will be uniquely poised to observe these waveform modulations, as the GW frequency from stellar-mass BBHs varies slowly in this band while modulation effects accumulate. In this work, we apply the Fisher information matrix formalism to estimate how well space-borne GW detectors can measure properties of BBH+SMBH hierarchical triples using the GW from orbiting BBH. We extend previous work by considering the more realistic case of an eccentric orbit around the SMBH, and notably include the effects of orbital pericenter precession. We find that for detector concepts such as LISA, B-DECIGO, and TianGO, we can extract the SMBH mass and semimajor axis of the orbit with a fractional uncertainty below the 0.1% level over a wide range of triple system parameters. Furthermore, we find that the effects of pericenter precession and orbital eccentricity significantly improve our ability to measure this system. We also find that while LISA could measure these systems, the decihertz detector concepts B-DECIGO and TianGO would enable better sensitivity to the triple's parameters.


title: Can acoustic early dark energy still resolve the Hubble tension?

abstract: In this paper, we re-assess the ability of the acoustic early dark energy (ADE) model to resolve the Hubble tension in light of the new Pantheon+ and S$H_0$ES data on the one hand, and the BOSS LRG and eBOSS QSO data, analysed under the effective field theory of large-scale structures (ETFofLSS) on the other hand. We find that the Pantheon+ data, which favor a larger $\Omega_m$ value than the Pantheon data, have a strong constraining power on the ADE model, while the EFTofLSS analysis of the BOSS and eBOSS data only slightly increases the constraints. We establish that the ADE model is now ruled out as a solution to the Hubble tension, with a remaining tension of $3.6\sigma$. In addition, we find that the axion-like early dark energy model performs better when confronted to the same datasets, with a residual tension of $2.5\sigma$. This work shows that the Pantheon+ data can have a decisive impact on models which aim to resolve the Hubble tension.


title: Finding the saddlepoint faster than sorting

abstract: A saddlepoint of an $n \times n$ matrix $A$ is an entry of $A$ that is a maximum in its row and a minimum in its column. Knuth (1968) gave several different algorithms for finding a saddlepoint. The worst-case running time of these algorithms is $\Theta(n^2)$, and Llewellyn, Tovey, and Trick (1988) showed that this cannot be improved, as in the worst case all entries of A may need to be queried. A strict saddlepoint of $A$ is an entry that is the strict maximum in its row and the strict minimum in its column. The strict saddlepoint (if it exists) is unique, and Bienstock, Chung, Fredman, Sch\"affer, Shor, and Suri (1991) showed that it can be found in time $O(n \log{n})$, where a dominant runtime contribution is sorting the diagonal of the matrix. This upper bound has not been improved since 1991. In this paper we show that the strict saddlepoint can be found in $O(n \log^{*}{n})$ time, where $\log^{*}$ denotes the very slowly growing iterated logarithm function, coming close to the lower bound of $\Omega(n)$. In fact, we can also compute, within the same runtime, the value of a non-strict saddlepoint, assuming one exists. Our algorithm is based on a simple recursive approach, a feasibility test inspired by searching in sorted matrices, and a relaxed notion of saddlepoint.


title: From Molecules to Materials: Pre-training Large Generalizable Models for Atomic Property Prediction

abstract: Foundation models have been transformational in machine learning fields such as natural language processing and computer vision. Similar success in atomic property prediction has been limited due to the challenges of training effective models across multiple chemical domains. To address this, we introduce Joint Multi-domain Pre-training (JMP), a supervised pre-training strategy that simultaneously trains on multiple datasets from different chemical domains, treating each dataset as a unique pre-training task within a multi-task framework. Our combined training dataset consists of $\sim$120M systems from OC20, OC22, ANI-1x, and Transition-1x. We evaluate performance and generalization by fine-tuning over a diverse set of downstream tasks and datasets including: QM9, rMD17, MatBench, QMOF, SPICE, and MD22. JMP demonstrates an average improvement of 59% over training from scratch, and matches or sets state-of-the-art on 34 out of 40 tasks. Our work highlights the potential of pre-training strategies that utilize diverse data to advance property prediction across chemical domains, especially for low-data tasks. Please visit https://nima.sh/jmp for further information.


title: Language Agnostic Code Embeddings

abstract: Recently, code language models have achieved notable advancements in addressing a diverse array of essential code comprehension and generation tasks. Yet, the field lacks a comprehensive deep dive and understanding of the code embeddings of multilingual code models. In this paper, we present a comprehensive study on multilingual code embeddings, focusing on the cross-lingual capabilities of these embeddings across different programming languages. Through probing experiments, we demonstrate that code embeddings comprise two distinct components: one deeply tied to the nuances and syntax of a specific language, and the other remaining agnostic to these details, primarily focusing on semantics. Further, we show that when we isolate and eliminate this language-specific component, we witness significant improvements in downstream code retrieval tasks, leading to an absolute increase of up to +17 in the Mean Reciprocal Rank (MRR).


title: Learning COVID-19 Regional Transmission Using Universal Differential Equations in a SIR model

abstract: Highly-interconnected societies difficult to model the spread of infectious diseases such as COVID-19. Single-region SIR models fail to account for incoming forces of infection and expanding them to a large number of interacting regions involves many assumptions that do not hold in the real world. We propose using Universal Differential Equations (UDEs) to capture the influence of neighboring regions and improve the model's predictions in a combined SIR+UDE model. UDEs are differential equations totally or partially defined by a deep neural network (DNN). We include an additive term to the SIR equations composed by a DNN that learns the incoming force of infection from the other regions. The learning is performed using automatic differentiation and gradient descent to approach the change in the target system caused by the state of the neighboring regions. We compared the proposed model using a simulated COVID-19 outbreak against a single-region SIR and a fully data-driven model composed only of a DNN. The proposed UDE+SIR model generates predictions that capture the outbreak dynamic more accurately, but a decay in performance is observed at the last stages of the outbreak. The single-area SIR and the fully data-driven approach do not capture the proper dynamics accurately. Once the predictions were obtained, we employed the SINDy algorithm to substitute the DNN with a regression, removing the black box element of the model with no considerable increase in the error levels.


title: Two-qubit logic between distant spins in silicon

abstract: Direct interactions between quantum particles naturally fall off with distance. For future-proof qubit architectures, however, it is important to avail of interaction mechanisms on different length scales. In this work, we utilize a superconducting resonator to facilitate a coherent interaction between two semiconductor spin qubits 250 $\mu$m apart. This separation is several orders of magnitude larger than for the commonly employed direct interaction mechanisms in this platform. We operate the system in a regime where the resonator mediates a spin-spin coupling through virtual photons. We report anti-phase oscillations of the populations of the two spins with controllable frequency. The observations are consistent with iSWAP oscillations and ten nanosecond entangling operations. These results hold promise for scalable networks of spin qubit modules on a chip.


title: A Note on the Continuity of Expected Utility Functions

abstract: In this paper, we study the continuity of expected utility functions, and derive a necessary and sufficient condition for a weak order on the space of simple probabilities to have a continuous expected utility function. We also verify that almost the same condition is necessary and sufficient for a weak order on the space of probabilities with compact-support to have a continuous expected utility function.


title: Two-Sided Matching Markets: Impossibility Results on Existence of Efficient and Envy Free Solutions

abstract: The Hylland-Zeckhauser gave a classic pricing-based mechanism (HZ) for a one-sided matching market; it yields allocations satisfying Pareto optimality and envy-freeness (Hylland and Zeckhauser, 1979), and the mechanism is incentive compatible in the large (He et al., 2018). They also studied the exchange extension of HZ and gave an example showing that it may not even admit an equilibrium. In this paper, we consider two models of two sided matching markets: when utility functions are symmetric and when they are non-symmetric. We ask if these models always admit allocations satisfying the two basic properties of Pareto efficiency and envy freeness. Our results are negative. A corollary of the former result is a negative result for non-bipartite matching markets as well.


title: Fingervein Verification using Convolutional Multi-Head Attention Network

abstract: Biometric verification systems are deployed in various security-based access-control applications that require user-friendly and reliable person verification. Among the different biometric characteristics, fingervein biometrics have been extensively studied owing to their reliable verification performance. Furthermore, fingervein patterns reside inside the skin and are not visible outside; therefore, they possess inherent resistance to presentation attacks and degradation due to external factors. In this paper, we introduce a novel fingervein verification technique using a convolutional multihead attention network called VeinAtnNet. The proposed VeinAtnNet is designed to achieve light weight with a smaller number of learnable parameters while extracting discriminant information from both normal and enhanced fingervein images. The proposed VeinAtnNet was trained on the newly constructed fingervein dataset with 300 unique fingervein patterns that were captured in multiple sessions to obtain 92 samples per unique fingervein. Extensive experiments were performed on the newly collected dataset FV-300 and the publicly available FV-USM and FV-PolyU fingervein dataset. The performance of the proposed method was compared with five state-of-the-art fingervein verification systems, indicating the efficacy of the proposed VeinAtnNet.


title: Exploring OCR Capabilities of GPT-4V(ision) : A Quantitative and In-depth Evaluation

abstract: This paper presents a comprehensive evaluation of the Optical Character Recognition (OCR) capabilities of the recently released GPT-4V(ision), a Large Multimodal Model (LMM). We assess the model's performance across a range of OCR tasks, including scene text recognition, handwritten text recognition, handwritten mathematical expression recognition, table structure recognition, and information extraction from visually-rich document. The evaluation reveals that GPT-4V performs well in recognizing and understanding Latin contents, but struggles with multilingual scenarios and complex tasks. Specifically, it showed limitations when dealing with non-Latin languages and complex tasks such as handwriting mathematical expression recognition, table structure recognition, and end-to-end semantic entity recognition and pair extraction from document image. Based on these observations, we affirm the necessity and continued research value of specialized OCR models. In general, despite its versatility in handling diverse OCR tasks, GPT-4V does not outperform existing state-of-the-art OCR models. How to fully utilize pre-trained general-purpose LMMs such as GPT-4V for OCR downstream tasks remains an open problem. The study offers a critical reference for future research in OCR with LMMs. Evaluation pipeline and results are available at https://github.com/SCUT-DLVCLab/GPT-4V_OCR.


title: Can GPT models Follow Human Summarization Guidelines? Evaluating ChatGPT and GPT-4 for Dialogue Summarization

abstract: This study explores the capabilities of prompt-driven Large Language Models (LLMs) like ChatGPT and GPT-4 in adhering to human guidelines for dialogue summarization. Experiments employed DialogSum (English social conversations) and DECODA (French call center interactions), testing various prompts: including prompts from existing literature and those from human summarization guidelines, as well as a two-step prompt approach. Our findings indicate that GPT models often produce lengthy summaries and deviate from human summarization guidelines. However, using human guidelines as an intermediate step shows promise, outperforming direct word-length constraint prompts in some cases. The results reveal that GPT models exhibit unique stylistic tendencies in their summaries. While BERTScores did not dramatically decrease for GPT outputs suggesting semantic similarity to human references and specialised pre-trained models, ROUGE scores reveal grammatical and lexical disparities between GPT-generated and human-written summaries. These findings shed light on the capabilities and limitations of GPT models in following human instructions for dialogue summarization.


title: Effect of initial conditions on current fluctuations in non-interacting active particles

abstract: We investigate the effect of initial conditions on the fluctuations of the integrated density current across the origin ($x=0$) up to a given time $t$ in a one-dimensional system of non-interacting run-and-tumble particles. Each particle has initial probabilities $f^+$ and $f^-$ to move with an initial velocity $+v$ and $-v$ respectively, where $v>0$. We derive exact results for the variance (second cumulant) of the current for quenched and annealed averages over the initial conditions for the magnetization and the density fields associated with the particles. We show that at large times, the variance displays a $\sqrt{t}$ behavior, with a prefactor contingent on the specific density initial conditions used. However, at short times, the variance displays either linear $t$ or quadratic $t^2$ behavior, which depends on the combination of magnetization and density initial conditions, along with the fraction $f^+$ of particles in the positive velocity state at $t=0$. Intriguingly, if $f^+=0$, the variance displays a short time $t^2$ behavior with the same prefactor irrespective of the initial conditions for both fields.


title: Accurate Crop Spraying with RTK and Machine Learning on an Autonomous Field Robot

abstract: The agriculture sector requires a lot of labor and resources. Hence, farmers are constantly being pressed for technology and automation to be cost-effective. In this context, autonomous robots can play a very important role in carrying out agricultural tasks such as spraying, sowing, inspection, and even harvesting. This paper presents one such autonomous robot that is able to identify plants and spray agro-chemicals precisely. The robot uses machine vision technologies to find plants and RTK-GPS technology to navigate the robot along a predetermined path. The experiments were conducted in a field of potted plants in which successful results have been obtained.


title: Improving the Aggregation and Evaluation of NBA Mock Drafts

abstract: Many enthusiasts and experts publish forecasts of the order players are drafted into professional sports leagues, known as mock drafts. Using a novel dataset of mock drafts for the National Basketball Association (NBA), we analyze authors' mock draft accuracy over time and ask how we can reasonably use information from multiple authors. To measure how accurate mock drafts are, we assume that both mock drafts and the actual draft are ranked lists, and we propose that rank-biased distance (RBD) of Webber et al. (2010) is the appropriate error metric for mock draft accuracy. This is because RBD allows mock drafts to have a different length than the actual draft, accounts for players not appearing in both lists, and weights errors early in the draft more than errors later on. We validate that mock drafts, as expected, improve in accuracy over the course of a season, and that accuracy of the mock drafts produced right before their drafts is fairly stable across seasons. To be able to combine information from multiple mock drafts into a single consensus mock draft, we also propose a ranked-list combination method based on the ideas of ranked-choice voting. We show that our method provides improved forecasts over the standard Borda count combination method used for most similar analyses in sports, and that either combination method provides a more accurate forecast over time than any single author.


title: Motility-induced clustering of active particles under soft confinement

abstract: We investigate the structural and dynamic properties of active Brownian particles (APs) confined within a soft annulus-shaped channel. Depending on the strength of the confinement and the P\'eclet number, we observe a novel re-entrant behavior that is not present in unconfined systems. Our findings are substantiated by numerical simulations and analytical considerations, revealing that this behavior arises from the strong coupling between the P\'eclet number and the effective confining dimensionality of the APs. Beyond highlighting the important influence of soft boundaries on APs, our research holds significance for future applications of micro-robotic systems.