title: Server-side Rescoring of Spoken Entity-centric Knowledge Queries for Virtual Assistants

abstract: On-device Virtual Assistants (VAs) powered by Automatic Speech Recognition (ASR) require effective knowledge integration for the challenging entity-rich query recognition. In this paper, we conduct an empirical study of modeling strategies for server-side rescoring of spoken information domain queries using various categories of Language Models (LMs) (N-gram word LMs, sub-word neural LMs). We investigate the combination of on-device and server-side signals, and demonstrate significant WER improvements of 23%-35% on various entity-centric query subpopulations by integrating various server-side LMs compared to performing ASR on-device only. We also perform a comparison between LMs trained on domain data and a GPT-3 variant offered by OpenAI as a baseline. Furthermore, we also show that model fusion of multiple server-side LMs trained from scratch most effectively combines complementary strengths of each model and integrates knowledge learned from domain-specific data to a VA ASR system.


title: Transient grating spectroscopy on a DyCo$_5$ thin film with femtosecond extreme ultraviolet pulses

abstract: Surface acoustic waves (SAWs) are excited by femtosecond extreme ultraviolet (EUV) transient gratings (TGs) in a room-temperature ferrimagnetic DyCo$_5$ alloy. TGs are generated by crossing a pair of EUV pulses from a free electron laser (FEL) with the wavelength of 20.8\,nm matching the Co $M$-edge, resulting in a SAW wavelength of $\Lambda=44$\,nm. Using the pump-probe transient grating scheme in a reflection geometry the excited SAWs could be followed in the time range of -10 to 100\,ps in the thin film. Coherent generation of TGs by ultrafast EUV pulses allows to excite SAW in any material and to investigate their couplings to other dynamics such as spin waves and orbital dynamics. In contrast, we encountered challenges in detecting electronic and magnetic signals, potentially due to the dominance of the larger SAW signal and the weakened reflection signal from underlying layers. A potential solution for the latter challenge involves employing soft X-ray probes, albeit introducing additional complexities associated with the required grazing incidence geometry.


title: Shape effects in the fluctuations of random isochrones on a square lattice

abstract: We consider the isochrone curves in first-passage percolation on a 2D square lattice, i.e. the boundary of the set of points which can be reached in less than a given time from a certain origin. The occurrence of an instantaneous average shape is described in terms of its Fourier components, highlighting a crossover between a diamond and a circular geometry as the noise level is increased. Generally, these isochrones can be understood as fluctuating interfaces with an inhomogeneous local width which reveals the underlying lattice structure. We show that once these inhomogeneities have been taken into account, the fluctuations fall into the Kardar-Parisi-Zhang (KPZ) universality class with very good accuracy, where they reproduce the Family-Vicsek Ansatz with the expected exponents and the Tracy-Widom histogram for the local radial fluctuations.


title: Machine Learning Design of Perovskite Catalytic Properties

abstract: Discovering new materials that efficiently catalyze the oxygen reduction and evolution reactions is critical for facilitating the widespread adoption of solid oxide fuel cell and electrolyzer (SOFC/SOEC) technologies. Here, we develop machine learning (ML) models to predict perovskite catalytic properties critical for SOFC/SOEC applications, including oxygen surface exchange, oxygen diffusivity, and area specific resistance (ASR). The models are based on trivial-to-calculate elemental features and are more accurate and dramatically faster than the best models based on ab initio-derived features, potentially eliminating the need for ab initio calculations in descriptor-based screening. Our model of ASR enables temperature-dependent predictions, has well calibrated uncertainty estimates and online accessibility. Use of temporal cross-validation reveals our model to be effective at discovering new promising materials prior to their initial discovery, demonstrating our model can make meaningful predictions. Using the SHapley Additive ExPlanations (SHAP) approach, we provide detailed discussion of different approaches of model featurization for ML property prediction. Finally, we use our model to screen more than 19 million perovskites to develop a list of promising cheap, earth-abundant, stable, and high performing materials, and find some top materials contain mixtures of less-explored elements (e.g., K, Bi, Y, Ni, Cu) worth exploring in more detail.


title: Search for the wide-orbit massive companion of XO-7b in the follow-up radial-velocity and transit-timing data: no significant clues

abstract: XO-7b is a hot Jupiter transiting a $V = 10.52$ mag G0V-type star. The planetary system is interesting because the linear slope in the discovery radial-velocity (RV) data indicated a wide-orbit massive companion. In 2020 we started an RV campaign for the system with the main scientific goal to follow-up this linear slope, and to put constraints on the orbital period of the companion. Furthermore, we aimed at refining the system parameters and we wanted to probe transit timing variations (TTVs) of XO-7b in order to search for long-term dynamical signs of the companion of XO-7b in the observed-minus-calculated (O-C) data of mid-transit times. Apart from the discovery RVs, we obtained and analyzed 20 follow-up RV observations and TESS photometric data. The previously observed significant linear RV slope was not confirmed with the follow-up RV data, where we detected only a marginal linear slope with the opposite trend. If the announced companion really exists, the most convincing explanation is that both RV datasets were collected near its quadrature position. Based on the RVs we estimated the minimum orbital period, which is $P_\mathrm{orb,min,3} \gtrsim 7900 \pm 1660$ d, and the 'minimum' minimum mass of the companion, which is $(M_3 \sin i)_\mathrm{min} = 16.7 \pm 3.5~\mathrm{M_{Jup}}$. We did not find significant evidence of the companion of XO-7b in the O-C dataset of mid-transit times. We can again conclude that if the announced companion really exists, this is in agreement with previous results that distant companions of exoplanets are only known by RV solutions.


title: REAL: Resilience and Adaptation using Large Language Models on Autonomous Aerial Robots

abstract: Large Language Models (LLMs) pre-trained on internet-scale datasets have shown impressive capabilities in code understanding, synthesis, and general purpose question-and-answering. Key to their performance is the substantial prior knowledge acquired during training and their ability to reason over extended sequences of symbols, often presented in natural language. In this work, we aim to harness the extensive long-term reasoning, natural language comprehension, and the available prior knowledge of LLMs for increased resilience and adaptation in autonomous mobile robots. We introduce REAL, an approach for REsilience and Adaptation using LLMs. REAL provides a strategy to employ LLMs as a part of the mission planning and control framework of an autonomous robot. The LLM employed by REAL provides (i) a source of prior knowledge to increase resilience for challenging scenarios that the system had not been explicitly designed for; (ii) a way to interpret natural-language and other log/diagnostic information available in the autonomy stack, for mission planning; (iii) a way to adapt the control inputs using minimal user-provided prior knowledge about the dynamics/kinematics of the robot. We integrate REAL in the autonomy stack of a real multirotor, querying onboard an offboard LLM at 0.1-1.0 Hz as part the robot's mission planning and control feedback loops. We demonstrate in real-world experiments the ability of the LLM to reduce the position tracking errors of a multirotor under the presence of (i) errors in the parameters of the controller and (ii) unmodeled dynamics. We also show (iii) decision making to avoid potentially dangerous scenarios (e.g., robot oscillates) that had not been explicitly accounted for in the initial prompt design.


title: Normalizing flows as approximations of optimal transport maps via linear-control neural ODEs

abstract: The term "Normalizing Flows" is related to the task of constructing invertible transport maps between probability measures by means of deep neural networks. In this paper, we consider the problem of recovering the $W_2$-optimal transport map $T$ between absolutely continuous measures $\mu,\nu\in\mathcal{P}(\mathbb{R}^n)$ as the flow of a linear-control neural ODE. We first show that, under suitable assumptions on $\mu,\nu$ and on the controlled vector fields, the optimal transport map is contained in the $C^0_c$-closure of the flows generated by the system. Assuming that discrete approximations $\mu_N,\nu_N$ of the original measures $\mu,\nu$ are available, we use a discrete optimal coupling $\gamma_N$ to define an optimal control problem. With a $\Gamma$-convergence argument, we prove that its solutions correspond to flows that approximate the optimal transport map $T$. Finally, taking advantage of the Pontryagin Maximum Principle, we propose an iterative numerical scheme for the resolution of the optimal control problem, resulting in an algorithm for the practical computation of the approximated optimal transport map.


title: Learning to See Physical Properties with Active Sensing Motor Policies

abstract: Knowledge of terrain's physical properties inferred from color images can aid in making efficient robotic locomotion plans. However, unlike image classification, it is unintuitive for humans to label image patches with physical properties. Without labeled data, building a vision system that takes as input the observed terrain and predicts physical properties remains challenging. We present a method that overcomes this challenge by self-supervised labeling of images captured by robots during real-world traversal with physical property estimators trained in simulation. To ensure accurate labeling, we introduce Active Sensing Motor Policies (ASMP), which are trained to explore locomotion behaviors that increase the accuracy of estimating physical parameters. For instance, the quadruped robot learns to swipe its foot against the ground to estimate the friction coefficient accurately. We show that the visual system trained with a small amount of real-world traversal data accurately predicts physical parameters. The trained system is robust and works even with overhead images captured by a drone despite being trained on data collected by cameras attached to a quadruped robot walking on the ground.


title: Analysis of Information Propagation in Ethereum Network Using Combined Graph Attention Network and Reinforcement Learning to Optimize Network Efficiency and Scalability

abstract: Blockchain technology has revolutionized the way information is propagated in decentralized networks. Ethereum plays a pivotal role in facilitating smart contracts and decentralized applications. Understanding information propagation dynamics in Ethereum is crucial for ensuring network efficiency, security, and scalability. In this study, we propose an innovative approach that utilizes Graph Convolutional Networks (GCNs) to analyze the information propagation patterns in the Ethereum network. The first phase of our research involves data collection from the Ethereum blockchain, consisting of blocks, transactions, and node degrees. We construct a transaction graph representation using adjacency matrices to capture the node embeddings; while our major contribution is to develop a combined Graph Attention Network (GAT) and Reinforcement Learning (RL) model to optimize the network efficiency and scalability. It learns the best actions to take in various network states, ultimately leading to improved network efficiency, throughput, and optimize gas limits for block processing. In the experimental evaluation, we analyze the performance of our model on a large-scale Ethereum dataset. We investigate effectively aggregating information from neighboring nodes capturing graph structure and updating node embeddings using GCN with the objective of transaction pattern prediction, accounting for varying network loads and number of blocks. Not only we design a gas limit optimization model and provide the algorithm, but also to address scalability, we demonstrate the use and implementation of sparse matrices in GraphConv, GraphSAGE, and GAT. The results indicate that our designed GAT-RL model achieves superior results compared to other GCN models in terms of performance. It effectively propagates information across the network, optimizing gas limits for block processing and improving network efficiency.


title: Mean Curvature Flow of High Codimension in Complex Projective Space

abstract: We study the mean curvature flow of smooth $m$-dimensional compact submanifolds with quadratic pinching in the Riemannian manifold $\mathbb{C}P^n$. Our main focus is on the case of high codimension, $k\geq 2$. We establish a codimension estimate that shows in regions of high curvature, the submanifold becomes approximately codimension one in a quantifiable way. This estimate enables us to prove at a singular time of the flow, there exists a rescaling that converges to a smooth codimension-one limiting flow in Euclidean space. Under a cylindrical type pinching, we show that this limiting flow is weakly convex and moves by translation. These estimates allow us to analyse the behaviour of the flow near singularities and establish the existence of the limiting flow. Lastly, we prove a decay estimate that shows that the rescaling converges smoothly to a totally geodesic limit in infinite time. This behaviour is only possible if the dimension of the submanifold is even. Our approach relies on the preservation of the quadratic pinching condition along the flow and a gradient estimate that controls the mean curvature in regions of high curvature. This result generalises the work of Pipoli and Sinestrari on the mean curvature flow of submanifolds of the complex projective space.


title: Coronal bright point statistics I. Lifetime, shape, and coronal co-rotation

abstract: Context. The corona of the Sun is the part of the solar atmosphere with temperatures of over one million Kelvin, which needs to be heated internally in order to exist. This heating mechanism remains a mystery; we see large magnetically active regions in the photosphere lead to strong extreme UV (EUV) emission in the corona. On much smaller scales (on the order of tens of Mm), there are bipolar and multipolar regions that can be associated with evenly sized coronal bright points (CBPs). Aims. Our aim was to study the properties of CBPs in a statistical sense and to use continuous data from the SDO spacecraft, which makes it possible to track CBPs over their whole lifetime. Furthermore, we tested various rotation-speed profiles for CBPs in order to find out if the lower corona is co-rotating with the photosphere. Then we compiled a database with about 346 CBPs together with information of their sizes, shapes, appearance and disappearance, and their visibility in the EUV channels of the AIA instrument. We want to verify our methods with similar previous studies. Methods. We used the high-cadence data of the largest continuous SDO observation interval in 2015 to employ an automated tracking algorithm for CBPs. Some of the information (e.g., the total lifetime, the characteristic shape, and the magnetic polarities below the CBPs) still requires human interaction. Results. In this work we present statistics on fundamental properties of CBPs along with some comparison tables that relate, for example, the CBP lifetime with their shape. CBPs that are visible in all AIA channels simultaneously seem to be brighter in total and also have a stronger heating, and hence a higher total radiation flux. We compared the EUV emission visibility in different AIA channels with the CBP's shape and lifetime. ... (full version see pdf)


title: A Coreset-based, Tempered Variational Posterior for Accurate and Scalable Stochastic Gaussian Process Inference

abstract: We present a novel stochastic variational Gaussian process ($\mathcal{GP}$) inference method, based on a posterior over a learnable set of weighted pseudo input-output points (coresets). Instead of a free-form variational family, the proposed coreset-based, variational tempered family for $\mathcal{GP}$s (CVTGP) is defined in terms of the $\mathcal{GP}$ prior and the data-likelihood; hence, accommodating the modeling inductive biases. We derive CVTGP's lower bound for the log-marginal likelihood via marginalization of the proposed posterior over latent $\mathcal{GP}$ coreset variables, and show it is amenable to stochastic optimization. CVTGP reduces the learnable parameter size to $\mathcal{O}(M)$, enjoys numerical stability, and maintains $\mathcal{O}(M^3)$ time- and $\mathcal{O}(M^2)$ space-complexity, by leveraging a coreset-based tempered posterior that, in turn, provides sparse and explainable representations of the data. Results on simulated and real-world regression problems with Gaussian observation noise validate that CVTGP provides better evidence lower-bound estimates and predictive root mean squared error than alternative stochastic $\mathcal{GP}$ inference methods.


title: The Blessing of Randomness: SDE Beats ODE in General Diffusion-based Image Editing

abstract: We present a unified probabilistic formulation for diffusion-based image editing, where a latent variable is edited in a task-specific manner and generally deviates from the corresponding marginal distribution induced by the original stochastic or ordinary differential equation (SDE or ODE). Instead, it defines a corresponding SDE or ODE for editing. In the formulation, we prove that the Kullback-Leibler divergence between the marginal distributions of the two SDEs gradually decreases while that for the ODEs remains as the time approaches zero, which shows the promise of SDE in image editing. Inspired by it, we provide the SDE counterparts for widely used ODE baselines in various tasks including inpainting and image-to-image translation, where SDE shows a consistent and substantial improvement. Moreover, we propose SDE-Drag -- a simple yet effective method built upon the SDE formulation for point-based content dragging. We build a challenging benchmark (termed DragBench) with open-set natural, art, and AI-generated images for evaluation. A user study on DragBench indicates that SDE-Drag significantly outperforms our ODE baseline, existing diffusion-based methods, and the renowned DragGAN. Our results demonstrate the superiority and versatility of SDE in image editing and push the boundary of diffusion-based editing methods.


title: Elongated particles discharged with a conveyor belt in a two-dimensional silo

abstract: The flow of elliptical particles out of a 2-dimensional silo when extracted with a conveyor belt is analyzed experimentally. The conveyor belt - placed directly below the silo outlet - reduces the flow rate, increases the size of the stagnant zone, and it has a very strong influence on the relative velocity fluctuations as they strongly increase everywhere in the silo with decreasing belt speed. In other words, instead of slower but smooth flow, flow reduction by belt leads to intermittent flow. Interestingly, we show that this intermittency correlates with a strong reduction of the orientational order of the particles at the orifice region. Moreover, we observe that the average orientation of the grains passing through the outlet is modified when they are extracted with the belt, a feature that becomes more evident for large orifices.


title: Causal Temporal Regime Structure Learning

abstract: We address the challenge of structure learning from multivariate time series that are characterized by a sequence of different, unknown regimes. We introduce a new optimization-based method (CASTOR), that concurrently learns the Directed Acyclic Graph (DAG) for each regime and determine the number of regimes along with their sequential arrangement. Through the optimization of a score function via an expectation maximization (EM) algorithm, CASTOR alternates between learning the regime indices (Expectation step) and inferring causal relationships in each regime (Maximization step). We further prove the identifiability of regimes and DAGs within the CASTOR framework. We conduct extensive experiments and show that our method consistently outperforms causal discovery models across various settings (linear and nonlinear causal relationships) and datasets (synthetic and real data).


title: Plasmon dispersion in bilayer cuprate superconductors

abstract: The essential building blocks of cuprate superconductors are two-dimensional CuO$_2$ sheets interspersed with charge reservoir layers. In bilayer cuprates, two closely spaced CuO$_2$ sheets are separated by a larger distance from the subsequent pair in the next unit cell. In contrast to single-layer cuprates, prior theoretical work on bilayer systems has predicted two distinct acoustic plasmon bands for a given out-of-plane momentum transfer. Here we report random phase approximation (RPA) calculations for bilayer systems which corroborate the existence of two distinct plasmons bands. We find that the intensity of the lower-energy band is negligibly small, whereas the higher-energy band carries significant spectral weight. We also present resonant inelastic x-ray scattering (RIXS) experiments at the O $K$-edge on the bilayer cuprate Y$_{0.85}$Ca$_{0.15}$Ba$_2$Cu$_3$O$_7$ (Ca-YBCO), which show only one dispersive plasmon branch, in agreement with the RPA calculations. In addition, the RPA results indicate that the dispersion of the higher-energy plasmon band in Ca-YBCO is not strictly acoustic, but exhibits a substantial energy gap of approximately 250 meV at the two-dimensional Brillouin zone center.


title: A Dynamic Temporal Logic for Quality of Service in Choreographic Models

abstract: We propose a framework for expressing and analyzing the Quality of Service (QoS) of message-passing systems using a choreographic model that consists of g-choreographies and Communicating Finite State machines (CFSMs). The following are our three main contributions: (I) an extension of CFSMs with non-functional contracts to specify quantitative constraints of local computations, (II) a dynamic temporal logic capable of expressing QoS, properties of systems relative to the g-choreography that specifies the communication protocol, (III) the semi-decidability of our logic which enables a bounded model-checking approach to verify QoS property of communicating systems.


title: MoCheQoS: Automated Analysis of Quality of Service Properties of Communicating Systems

abstract: We present MoCheQoS, a tool to analyse quality of service (QoS) properties of message-passing systems. Building on the logic and the choreographic model we defined in recently published work, MoCheQoS implements a bounded model checking algorithm. We discuss strengths and weaknesses of MoCheQoS through some case studies.


title: Homogeneous structures in subset sums and non-averaging sets

abstract: We show that for every positive integer $k$ there are positive constants $C$ and $c$ such that if $A$ is a subset of $\{1, 2, \dots, n\}$ of size at least $C n^{1/k}$, then, for some $d \leq k-1$, the set of subset sums of $A$ contains a homogeneous $d$-dimensional generalized arithmetic progression of size at least $c|A|^{d+1}$. This strengthens a result of Szemer\'edi and Vu, who proved a similar statement without the homogeneity condition. As an application, we make progress on the Erd\H{o}s--Straus non-averaging sets problem, showing that every subset $A$ of $\{1, 2, \dots, n\}$ of size at least $n^{\sqrt{2} - 1 + o(1)}$ contains an element which is the average of two or more other elements of $A$. This gives the first polynomial improvement on a result of Erd\H{o}s and S\'ark\"ozy from 1990.


title: Multi-axis fields boost SABRE hyperpolarization via new strategies

abstract: The inherently low signal-to-noise ratio of NMR and MRI is now being addressed by hyperpolarization methods. For example, iridium-based catalysts that reversibly bind both parahydrogen and ligands in solution can hyperpolarize protons (SABRE) or heteronuclei (X-SABRE) on a wide variety of ligands, using a complex interplay of spin dynamics and chemical exchange processes, with common signal enhancements between $10^3-10^4$. This does not approach obvious theoretical limits, and further enhancement would be valuable in many applications (such as imaging mM concentration species in vivo). Most SABRE/X-SABRE implementations require far lower fields (${\mu}T-mT$) than standard magnetic resonance (>1T), and this gives an additional degree of freedom: the ability to fully modulate fields in three dimensions. However, this has been underexplored because the standard simplifying theoretical assumptions in magnetic resonance need to be revisited. Here we take a different approach, an evolutionary strategy algorithm for numerical optimization, Multi-Axis Computer-aided HEteronuclear Transfer Enhancement for SABRE (MACHETE-SABRE). We find nonintuitive but highly efficient multi-axial pulse sequences which experimentally can produce a 10-fold improvement in polarization over continuous excitation. This approach optimizes polarization differently than traditional methods, thus gaining extra efficiency.


title: Torsion energy with boundary mean zero condition

abstract: Motivated by establishing Neumann Talenti type comparison results, we concern the minimization of the following shape functional under volume constraint: \begin{align*} T(\Omega):=\inf\left\{\frac12 \int_{\Omega} |\nabla u|^2\,dx -\int_\Omega u\,dx: u\in H^1(\Omega),\ \int_{\partial \Omega}ud\sigma=0 \right\}. \end{align*} We prove that ball is a local minimizer to $T(\cdot)$ under smooth perturbation, but quite surprisingly, ball is not locally minimal to $T(\cdot)$ under Lipschitz perturbation. In fact, let $P_N$ be the regular polygon in $\mathbb{R}^2$ with $N$ sides and area $\pi$, then we prove that $T(P_N)$ is a strictly increasing function with respect to $N$ and $\lim_{N\rightarrow \infty}T(P_N)=T(B)$ where $B$ is the unit disk. As another side result, we prove that in dimension bigger than or equal to three, rigidity results of Serrin's seminal overdetermined system is not stable under Dirichlet perturbations, in contrast to the stability of rigidity under Neumann perturbation.


title: Constrained-Context Conditional Diffusion Models for Imitation Learning

abstract: Offline Imitation Learning (IL) is a powerful paradigm to learn visuomotor skills, especially for high-precision manipulation tasks. However, IL methods are prone to spurious correlation - expressive models may focus on distractors that are irrelevant to action prediction - and are thus fragile in real-world deployment. Prior methods have addressed this challenge by exploring different model architectures and action representations. However, none were able to balance between sample efficiency, robustness against distractors, and solving high-precision manipulation tasks with complex action space. To this end, we present $\textbf{C}$onstrained-$\textbf{C}$ontext $\textbf{C}$onditional $\textbf{D}$iffusion $\textbf{M}$odel (C3DM), a diffusion model policy for solving 6-DoF robotic manipulation tasks with high precision and ability to ignore distractions. A key component of C3DM is a fixation step that helps the action denoiser to focus on task-relevant regions around the predicted action while ignoring distractors in the context. We empirically show that C3DM is able to consistently achieve high success rate on a wide array of tasks, ranging from table top manipulation to industrial kitting, that require varying levels of precision and robustness to distractors. For details, please visit this https://sites.google.com/view/c3dm-imitation-learning


title: Holistic Transfer: Towards Non-Disruptive Fine-Tuning with Partial Target Data

abstract: We propose a learning problem involving adapting a pre-trained source model to the target domain for classifying all classes that appeared in the source data, using target data that covers only a partial label space. This problem is practical, as it is unrealistic for the target end-users to collect data for all classes prior to adaptation. However, it has received limited attention in the literature. To shed light on this issue, we construct benchmark datasets and conduct extensive experiments to uncover the inherent challenges. We found a dilemma -- on the one hand, adapting to the new target domain is important to claim better performance; on the other hand, we observe that preserving the classification accuracy of classes missing in the target adaptation data is highly challenging, let alone improving them. To tackle this, we identify two key directions: 1) disentangling domain gradients from classification gradients, and 2) preserving class relationships. We present several effective solutions that maintain the accuracy of the missing classes and enhance the overall performance, establishing solid baselines for holistic transfer of pre-trained models with partial target data.


title: High-Spectral Resolution Dark Holes: Concept, Results, and Promise

abstract: Next generation high contrast imaging instruments face a challenging trade off: they will be required to deliver data with high spectral resolution at a relatively fast cadence (minutes) and across a wide field of view (arcseconds). For instruments that employ focal plane wavefront sensing and therefore require super-Nyquist sampling, these requirements cannot simultaneously be met with a traditional lenslet integral field spectrograph (IFU). For the SPIDERS pathfinder instrument, we are demonstrating an imaging Fourier transform spectrograph (IFTS) that offers a different set of tradeoffs than a lenslet IFU, delivering up to R20,000 spectral resolution across a dark hole. We present preliminary results from the SPIDERS IFTS including a chromaticity analysis of its dark hole and demonstrate a spectral differential imaging (SDI) improvement of up to 40 $\times$, and a first application of spectro-coherent differential imaging, combining both coherent differential imaging (CDI) and SDI.


title: Spectral Redundancy for Calibrating Interferometers and Suppressing the Foreground Wedge in 21cm Cosmology

abstract: Observations of 21cm line from neutral hydrogen promise to be an exciting new probe of astrophysics and cosmology during the Cosmic Dawn and through the Epoch of Reionization (EoR) to when dark energy accelerates the expansion of the Universe. At each of these epochs, separating bright foregrounds from the cosmological signal is a primary challenge that requires exquisite calibration. In this paper, we present a new calibration method called nucal that extends redundant-baseline calibration, allowing spectral variation in antenna responses to be solved for by using correlations between visibilities measuring the same angular Fourier modes at different frequencies. By modeling the chromaticity of the beam-weighted sky with a tunable set of discrete prolate spheroidal sequences (DPSS), we develop a calibration loop that optimizes for spectrally smooth calibrated visibilities. Crucially, this technique does not require explicit models of the sky or the primary beam. With simulations that incorporate realistic source and beam chromaticity, we show that this method solves for unsmooth bandpass features, exposes narrowband interference systematics, and suppresses smooth-spectrum foregrounds below the level of 21cm reionization models, even within much of the so-called "wedge" region where current foreground mitigation techniques struggle. We show that this foreground subtraction can be performed with minimal cosmological signal loss for certain well-sampled angular Fourier modes, making spectral-redundant calibration a promising technique for current and next-generation 21cm intensity mapping experiments.


title: CenterRadarNet: Joint 3D Object Detection and Tracking Framework using 4D FMCW Radar

abstract: Robust perception is a vital component for ensuring safe autonomous and assisted driving. Automotive radar (77 to 81 GHz), which offers weather-resilient sensing, provides a complementary capability to the vision- or LiDAR-based autonomous driving systems. Raw radio-frequency (RF) radar tensors contain rich spatiotemporal semantics besides 3D location information. The majority of previous methods take in 3D (Doppler-range-azimuth) RF radar tensors, allowing prediction of an object's location, heading angle, and size in bird's-eye-view (BEV). However, they lack the ability to at the same time infer objects' size, orientation, and identity in the 3D space. To overcome this limitation, we propose an efficient joint architecture called CenterRadarNet, designed to facilitate high-resolution representation learning from 4D (Doppler-range-azimuth-elevation) radar data for 3D object detection and re-identification (re-ID) tasks. As a single-stage 3D object detector, CenterRadarNet directly infers the BEV object distribution confidence maps, corresponding 3D bounding box attributes, and appearance embedding for each pixel. Moreover, we build an online tracker utilizing the learned appearance embedding for re-ID. CenterRadarNet achieves the state-of-the-art result on the K-Radar 3D object detection benchmark. In addition, we present the first 3D object-tracking result using radar on the K-Radar dataset V2. In diverse driving scenarios, CenterRadarNet shows consistent, robust performance, emphasizing its wide applicability.


title: The Hamiltonian constraint in the symmetric teleparallel equivalent of general relativity

abstract: General relativity (GR) admits two alternative formulations with the same dynamics attributing the gravitational phenomena to torsion or nonmetricity of the manifold's connection. They lead, respectively, to the teleparallel equivalent of general relativity (TEGR) and the symmetric teleparallel equivalent of general relativity (STEGR). In this work, we focus on STEGR and present its differences with the conventional, curvature-based GR. We exhibit the 3+1 decomposition of the STEGR Lagrangian in the coincident gauge and present the Hamiltonian, and the Hamiltonian and momenta constraints. For a particular case of spherical symmetry, we explicitly show the differences in the Hamiltonian between GR and STEGR, one of the few genuinely different features of both formulations of gravity, and the repercussions it might encompass to numerical relativity.


title: Exploring Deep Learning Techniques for Glaucoma Detection: A Comprehensive Review

abstract: Glaucoma is one of the primary causes of vision loss around the world, necessitating accurate and efficient detection methods. Traditional manual detection approaches have limitations in terms of cost, time, and subjectivity. Recent developments in deep learning approaches demonstrate potential in automating glaucoma detection by detecting relevant features from retinal fundus images. This article provides a comprehensive overview of cutting-edge deep learning methods used for the segmentation, classification, and detection of glaucoma. By analyzing recent studies, the effectiveness and limitations of these techniques are evaluated, key findings are highlighted, and potential areas for further research are identified. The use of deep learning algorithms may significantly improve the efficacy, usefulness, and accuracy of glaucoma detection. The findings from this research contribute to the ongoing advancements in automated glaucoma detection and have implications for improving patient outcomes and reducing the global burden of glaucoma.


title: Going for Gold(-Standard): Attaining Coupled Cluster Accuracy in Oxide-Supported Nanoclusters

abstract: The structure of oxide-supported metal nanoclusters plays an essential role in their sharply enhanced catalytic activity over bulk metals. Simulations provide the atomic-scale resolution needed to understand these systems. However, the sensitive mix of metal-metal and metal-support interactions which govern their structure puts stringent requirements on the method used, requiring going beyond standard density functional theory (DFT). The method of choice is coupled cluster theory [specifically CCSD(T)], but its computational cost has so far prevented applications. In this work, we showcase two approaches to make CCSD(T) accuracy readily achievable in oxide-supported nanoclusters. First, we leverage the SKZCAM protocol to provide the first benchmarks of oxide-supported nanoclusters, revealing that it is specifically metal-metal interactions that are challenging to capture with DFT. Second, we propose a CCSD(T) correction ($\Delta$CC) to the metal-metal interaction errors in DFT, reaching comparable accuracy to the SKZCAM protocol at significantly lower cost. This forges a path towards studying larger systems at reliable accuracy, which we highlight by identifying a ground state structure in agreement with experiments for Au$_{20}$ on MgO; a challenging system where DFT models have yielded conflicting predictions.


title: Developing a Drift Rate Distribution for Technosignature Searches of Exoplanets

abstract: A stable-frequency transmitter with relative radial acceleration to a receiver will show a change in received frequency over time, known as a "drift rate''. For a transmission from an exoplanet, we must account for multiple components of drift rate: the exoplanet's orbit and rotation, the Earth's orbit and rotation, and other contributions. Understanding the drift rate distribution produced by exoplanets relative to Earth, can a) help us constrain the range of drift rates to check in a Search for Extraterrestrial Intelligence (SETI) project to detect radio technosignatures and b) help us decide validity of signals-of-interest, as we can compare drifting signals with expected drift rates from the target star. In this paper, we modeled the drift rate distribution for $\sim$5300 confirmed exoplanets, using parameters from the NASA Exoplanet Archive (NEA). We find that confirmed exoplanets have drift rates such that 99\% of them fall within the $\pm$53 nHz range. This implies a distribution-informed maximum drift rate $\sim$4 times lower than previous work. To mitigate the observational biases inherent in the NEA, we also simulated an exoplanet population built to reduce these biases. The results suggest that, for a Kepler-like target star without known exoplanets, $\pm$0.44 nHz would be sufficient to account for 99\% of signals. This reduction in recommended maximum drift rate is partially due to inclination effects and bias towards short orbital periods in the NEA. These narrowed drift rate maxima will increase the efficiency of searches and save significant computational effort in future radio technosignature searches.


title: Identifying Alzheimer Disease Dementia Levels Using Machine Learning Methods

abstract: Dementia, a prevalent neurodegenerative condition, is a major manifestation of Alzheimer's disease (AD). As the condition progresses from mild to severe, it significantly impairs the individual's ability to perform daily tasks independently, necessitating the need for timely and accurate AD classification. Machine learning or deep learning models have emerged as effective tools for this purpose. In this study, we suggested an approach for classifying the four stages of dementia using RF, SVM, and CNN algorithms, augmented with watershed segmentation for feature extraction from MRI images. Our results reveal that SVM with watershed features achieves an impressive accuracy of 96.25%, surpassing other classification methods. The ADNI dataset is utilized to evaluate the effectiveness of our method, and we observed that the inclusion of watershed segmentation contributes to the enhanced performance of the models.


title: Efficient Vision Transformer for Accurate Traffic Sign Detection

abstract: This research paper addresses the challenges associated with traffic sign detection in self-driving vehicles and driver assistance systems. The development of reliable and highly accurate algorithms is crucial for the widespread adoption of traffic sign recognition and detection (TSRD) in diverse real-life scenarios. However, this task is complicated by suboptimal traffic images affected by factors such as camera movement, adverse weather conditions, and inadequate lighting. This study specifically focuses on traffic sign detection methods and introduces the application of the Transformer model, particularly the Vision Transformer variants, to tackle this task. The Transformer's attention mechanism, originally designed for natural language processing, offers improved parallel efficiency. Vision Transformers have demonstrated success in various domains, including autonomous driving, object detection, healthcare, and defense-related applications. To enhance the efficiency of the Transformer model, the research proposes a novel strategy that integrates a locality inductive bias and a transformer module. This includes the introduction of the Efficient Convolution Block and the Local Transformer Block, which effectively capture short-term and long-term dependency information, thereby improving both detection speed and accuracy. Experimental evaluations demonstrate the significant advancements achieved by this approach, particularly when applied to the GTSDB dataset.


title: Scattering of spinning compact objects from a worldline EFT

abstract: We study the EFT of a spinning compact object and show that with appropriate gauge fixing, computations become amenable to worldline quantum field theory techniques. We use the resulting action to compute Compton and one-loop scattering amplitudes at fourth order in spin. By matching these amplitdes to solutions of the Teukolsky equations, we fix the values of Wilson coefficients appearing in the EFT such that it reproduces Kerr black hole scattering. We keep track of the spin supplementary condition throughout our computations and discuss alternative ways to ensure its preservation.


title: Empirical Lossless Compression Bound of a Data Sequence

abstract: We consider the lossless compression bound of any individual data sequence. If we fit the data by a parametric model, the entropy quantity $nH({\hat \theta}_n)$ obtained by plugging in the maximum likelihood estimate is an underestimate of the bound, where $n$ is the number of words. Shtarkov showed that the normalized maximum likelihood (NML) distribution or code length is optimal in a minimax sense for any parametric family. We show by the local asymptotic normality that the NML code length for the exponential families is $nH(\hat \theta_n) +\frac{d}{2}\log \, \frac{n}{2\pi} +\log \int_{\Theta} |I(\theta)|^{1/2}\, d\theta+o(1)$, where $d$ is the model dimension or dictionary size, and $|I(\theta)|$ is the determinant of the Fisher information matrix. We also demonstrate that sequentially predicting the optimal code length for the next word via a Bayesian mechanism leads to the mixture code, whose pathwise length is given by $nH({\hat \theta}_n) +\frac{d}{2}\log \, \frac{n}{2\pi} +\log \frac{|\, I({\hat \theta}_n)|^{1/2}}{w({\hat \theta}_n)}+o(1) $, where $w(\theta)$ is a prior. The asymptotics apply to not only discrete symbols but also continuous data if the code length for the former is replaced by the description length for the latter. The analytical result is exemplified by calculating compression bounds of protein-encoding DNA sequences under different parsing models. Typically, the highest compression is achieved when the parsing is in phase of the amino acid codons. On the other hand, the compression rates of pseudo-random sequences are larger than 1 regardless parsing models. These model-based results are in consistency with that random sequences are incompressible as asserted by the Kolmogorov complexity theory. The empirical lossless compression bound is particularly more accurate when dictionary size is relatively large.


title: Transformation Decoupling Strategy based on Screw Theory for Deterministic Point Cloud Registration with Gravity Prior

abstract: Point cloud registration is challenging in the presence of heavy outlier correspondences. This paper focuses on addressing the robust correspondence-based registration problem with gravity prior that often arises in practice. The gravity directions are typically obtained by inertial measurement units (IMUs) and can reduce the degree of freedom (DOF) of rotation from 3 to 1. We propose a novel transformation decoupling strategy by leveraging screw theory. This strategy decomposes the original 4-DOF problem into three sub-problems with 1-DOF, 2-DOF, and 1-DOF, respectively, thereby enhancing the computation efficiency. Specifically, the first 1-DOF represents the translation along the rotation axis and we propose an interval stabbing-based method to solve it. The second 2-DOF represents the pole which is an auxiliary variable in screw theory and we utilize a branch-and-bound method to solve it. The last 1-DOF represents the rotation angle and we propose a global voting method for its estimation. The proposed method sequentially solves three consensus maximization sub-problems, leading to efficient and deterministic registration. In particular, it can even handle the correspondence-free registration problem due to its significant robustness. Extensive experiments on both synthetic and real-world datasets demonstrate that our method is more efficient and robust than state-of-the-art methods, even when dealing with outlier rates exceeding 99%.


title: A Comprehensive Study of Governance Issues in Decentralized Finance Applications

abstract: Decentralized Finance (DeFi) is a prominent application of smart contracts, representing a novel financial paradigm in contrast to centralized finance. While DeFi applications are rapidly emerging on mainstream blockchain platforms, their quality varies greatly, presenting numerous challenges, particularly in terms of their governance mechanisms. In this paper, we present a comprehensive study of governance issues in DeFi applications. Drawing upon insights from industry reports and academic research articles, we develop a taxonomy to categorize these governance issues. We collect and build a dataset of 4,446 audit reports from 17 Web3 security companies, categorizing their governance issues according to our constructed taxonomy. We conducted a thorough analysis of governance issues and identified vulnerabilities in governance design and implementation, e.g., voting sybil attack and proposal front-running. Our findings highlight a significant observation: the disparity between smart contract code and DeFi whitepapers plays a central role in these governance issues. As an initial step to address the challenges of code-whitepaper consistency checks for DeFi applications, we built a machine-learning-based prototype, and validated its performance on eight widely used DeFi projects, achieving a 56.14% F1 score and a 80% recall. Our study culminates in providing several key practical implications for various DeFi stakeholders, including developers, users, researchers, and regulators, aiming to deepen the understanding of DeFi governance issues and contribute to the robust growth of DeFi systems.


title: Tailoring Mixup to Data for Calibration

abstract: Among all data augmentation techniques proposed so far, linear interpolation of training samples, also called Mixup, has found to be effective for a large panel of applications. Along with improved performance, Mixup is also a good technique for improving calibration and predictive uncertainty. However, mixing data carelessly can lead to manifold intrusion, i.e., conflicts between the synthetic labels assigned and the true label distributions, which can deteriorate calibration. In this work, we argue that the likelihood of manifold intrusion increases with the distance between data to mix. To this end, we propose to dynamically change the underlying distributions of interpolation coefficients depending on the similarity between samples to mix, and define a flexible framework to do so without losing in diversity. We provide extensive experiments for classification and regression tasks, showing that our proposed method improves performance and calibration of models, while being much more efficient. The code for our work is available at https://github.com/qbouniot/sim_kernel_mixup.


title: Contrastive Moments: Unsupervised Halfspace Learning in Polynomial Time

abstract: We give a polynomial-time algorithm for learning high-dimensional halfspaces with margins in $d$-dimensional space to within desired TV distance when the ambient distribution is an unknown affine transformation of the $d$-fold product of an (unknown) symmetric one-dimensional logconcave distribution, and the halfspace is introduced by deleting at least an $\epsilon$ fraction of the data in one of the component distributions. Notably, our algorithm does not need labels and establishes the unique (and efficient) identifiability of the hidden halfspace under this distributional assumption. The sample and time complexity of the algorithm are polynomial in the dimension and $1/\epsilon$. The algorithm uses only the first two moments of suitable re-weightings of the empirical distribution, which we call contrastive moments; its analysis uses classical facts about generalized Dirichlet polynomials and relies crucially on a new monotonicity property of the moment ratio of truncations of logconcave distributions. Such algorithms, based only on first and second moments were suggested in earlier work, but hitherto eluded rigorous guarantees. Prior work addressed the special case when the underlying distribution is Gaussian via Non-Gaussian Component Analysis. We improve on this by providing polytime guarantees based on Total Variation (TV) distance, in place of existing moment-bound guarantees that can be super-polynomial. Our work is also the first to go beyond Gaussians in this setting.


title: Strongly Kreiss Bounded Operators in UMD Banach Spaces

abstract: In this paper we give growth estimates for $\|T^n\|$ for $n\to \infty$ in the case $T$ is a strongly Kreiss bounded operator on a UMD Banach space $X$. In several special cases we provide explicit growth rates. This includes known cases such as Hilbert and $L^p$-spaces, but also intermediate UMD spaces such as non-commutative $L^p$-spaces and variable Lebesgue spaces.


title: Checkerboard CFT

abstract: The Checkerboard conformal field theory is an interesting representative of a large class of non-unitary, logarithmic Fishnet CFTs (FCFT) in arbitrary dimension which have been intensively studied in the last years. Its planar Feynman graphs have the structure of a regular square lattice with checkerboard colouring. Such graphs are integrable since each coloured cell of the lattice is equal to an R-matrix in the principal series representations of the conformal group. We compute perturbatively and numerically the anomalous dimension of the shortest single-trace operator in two reductions of the Checkerboard CFT: the first one corresponds to the fishnet limit of the twisted ABJM theory in 3D, whereas the spectrum in the second, 2D reduction contains the energy of the BFKL Pomeron. We derive an analytic expression for the Checkerboard analogues of Basso--Dixon 4-point functions, as well as for the class of Diamond-type 4-point graphs with disc topology. The properties of the latter are studied in terms of OPE for operators with open indices. We prove that the spectrum of the theory receives corrections only at even orders in the loop expansion and we conjecture such a modification of Checkerboard CFT where quantum corrections occur only with a given periodicity in the loop order.


title: Cosmological foundations revisited with Pantheon+

abstract: We reanalyse the Pantheon+ supernova catalogue to compare a cosmology with non-FLRW evolution, the "timescape cosmology", with the standard $\Lambda$CDM cosmology. To this end, we consider the Pantheon+ supernova catalogue, which is the largest available Type Ia supernova dataset for a geometric comparison between the two models. We construct a covariance matrix to be as independent of cosmology as possible, including independence from the FLRW geometry and peculiar velocity with respect to FLRW average evolution. Within this framework, which goes far beyond most other definitions of "model independence", we introduce new statistics to refine Type Ia supernova (SneIa) light-curve analysis. In addition to conventional galaxy correlation functions used to define the scale of statistical homogeneity we introduce empirical statistics which enables a refined analysis of the distribution biases of SneIa light-curve parameters $\beta c$ and $\alpha x_1$. For lower redshifts, the Bayesian analysis highlights important features attributable to the increased number of low-redshift supernovae, the artefacts of model-dependent light-curve fitting and the cosmic structure through which we observe supernovae. This indicates the need for cosmology-independent data reduction to conduct a stronger investigation of the emergence of statistical homogeneity and to compare alternative cosmologies in light of recent challenges to the standard model. "Dark energy" is generally invoked as a place-holder for "new physics". Our from-first-principles reanalysis of the Pantheon+ catalogue supports future deeper studies of the interplay of matter and nonlinear spacetime geometry, in a data-driven setting. For the first time in 25 years, we find evidence that the Pantheon+ catalogue already contains such a wealth of data that with further reanalysis, a genuine "paradigm shift" may soon emerge. [Abridged]

categories: astro-ph.CO astro-ph.HE gr-qc hep-ph hep-th


title: Low-depth unitary quantum circuits for dualities in one-dimensional quantum lattice models

abstract: A systematic approach to dualities in symmetric (1+1)d quantum lattice models has recently been proposed in terms of module categories over the symmetry fusion categories. By characterizing the non-trivial way in which dualities intertwine closed boundary conditions and charge sectors, these can be implemented by unitary matrix product operators. In this manuscript, we explain how to turn such duality operators into unitary linear depth quantum circuits via the introduction of ancillary degrees of freedom that keep track of the various sectors. The linear depth is consistent with the fact that these dualities change the phase of the states on which they act. When supplemented with measurements, we show that dualities with respect to symmetries encoded into nilpotent fusion categories can be realised in constant depth. The resulting circuits can for instance be used to efficiently prepare short- and long-range entangled states or map between different gapped boundaries of (2+1)d topological models.

categories: quant-ph cond-mat.str-el hep-th math-ph math.MP


title: Functional inequalities for a family of infinite-dimensional diffusions with degenerate noise

abstract: For a family of infinite-dimensional diffusions with degenerate noise, we develop a modified $\Gamma$ calculus on finite-dimensional projections of the equation in order to produce explicit functional inequalities that can be scaled to infinite dimensions. The choice of our $\Gamma$ operator appears canonical in our context, as the estimates depend only on the induced control distance. We apply the general analysis to a number of examples, exploring implications for quasi-invariance and uniqueness of stationary distributions.


title: Distilling Out-of-Distribution Robustness from Vision-Language Foundation Models

abstract: We propose a conceptually simple and lightweight framework for improving the robustness of vision models through the combination of knowledge distillation and data augmentation. We address the conjecture that larger models do not make for better teachers by showing strong gains in out-of-distribution robustness when distilling from pretrained foundation models. Following this finding, we propose Discrete Adversarial Distillation (DAD), which leverages a robust teacher to generate adversarial examples and a VQGAN to discretize them, creating more informative samples than standard data augmentation techniques. We provide a theoretical framework for the use of a robust teacher in the knowledge distillation with data augmentation setting and demonstrate strong gains in out-of-distribution robustness and clean accuracy across different student architectures. Notably, our method adds minor computational overhead compared to similar techniques and can be easily combined with other data augmentations for further improvements.


title: Deep Double Descent for Time Series Forecasting: Avoiding Undertrained Models

abstract: Deep learning models, particularly Transformers, have achieved impressive results in various domains, including time series forecasting. While existing time series literature primarily focuses on model architecture modifications and data augmentation techniques, this paper explores the training schema of deep learning models for time series; how models are trained regardless of their architecture. We perform extensive experiments to investigate the occurrence of deep double descent in several Transformer models trained on public time series data sets. We demonstrate epoch-wise deep double descent and that overfitting can be reverted using more epochs. Leveraging these findings, we achieve state-of-the-art results for long sequence time series forecasting in nearly 70% of the 72 benchmarks tested. This suggests that many models in the literature may possess untapped potential. Additionally, we introduce a taxonomy for classifying training schema modifications, covering data augmentation, model inputs, model targets, time series per model, and computational budget.


title: Filaments of The Slime Mold Cosmic Web And How They Affect Galaxy Evolution

abstract: We present a novel method for identifying cosmic web filaments using the IllustrisTNG (TNG100) cosmological simulations and investigate the impact of filaments on galaxies. We compare the use of cosmic density field estimates from the Delaunay Tessellation Field Estimator (DTFE) and the Monte Carlo Physarum Machine (MCPM), which is inspired by the slime mold organism, in the DisPerSE structure identification framework. The MCPM-based reconstruction identifies filaments with higher fidelity, finding more low-prominence/diffuse filaments and better tracing the true underlying matter distribution than the DTFE-based reconstruction. Using our new filament catalogs, we find that most galaxies are located within 1.5-2.5 Mpc of a filamentary spine, with little change in the median specific star formation rate and the median galactic gas fraction with distance to the nearest filament. Instead, we introduce the filament line density, Sigma_fil(MCPM), as the total MCPM overdensity per unit length of a local filament segment, and find that this parameter is a superior predictor of galactic gas supply and quenching. Our results indicate that most galaxies are quenched and gas-poor near high-line density filaments at z<=1. At z=0, quenching in log(M*/Msun)>10.5 galaxies is mainly driven by mass, while lower-mass galaxies are significantly affected by the filament line density. In high-line density filaments, satellites are strongly quenched, whereas centrals have reduced star formation, but not gas fraction, at z<=0.5. We discuss the prospect of applying our new filament identification method to galaxy surveys with SDSS, DESI, Subaru PFS, etc. to elucidate the effect of large-scale structure on galaxy formation.


title: LabelFormer: Object Trajectory Refinement for Offboard Perception from LiDAR Point Clouds

abstract: A major bottleneck to scaling-up training of self-driving perception systems are the human annotations required for supervision. A promising alternative is to leverage "auto-labelling" offboard perception models that are trained to automatically generate annotations from raw LiDAR point clouds at a fraction of the cost. Auto-labels are most commonly generated via a two-stage approach -- first objects are detected and tracked over time, and then each object trajectory is passed to a learned refinement model to improve accuracy. Since existing refinement models are overly complex and lack advanced temporal reasoning capabilities, in this work we propose LabelFormer, a simple, efficient, and effective trajectory-level refinement approach. Our approach first encodes each frame's observations separately, then exploits self-attention to reason about the trajectory with full temporal context, and finally decodes the refined object size and per-frame poses. Evaluation on both urban and highway datasets demonstrates that LabelFormer outperforms existing works by a large margin. Finally, we show that training on a dataset augmented with auto-labels generated by our method leads to improved downstream detection performance compared to existing methods. Please visit the project website for details https://waabi.ai/labelformer


title: Induced Circular Polarization on Photons Due to Interaction with Axion-Like Particles in Rotating Magnetic Field of Neutron Stars

abstract: We investigate how the photon polarization is affected by the interaction with axion-like particles (ALPs) in the rotating magnetic field of a neutron star (NS). Using quantum Boltzmann equations the study demonstrates that the periodic magnetic field of millisecond NSs enhances the interaction of photons with ALPs and creates a circular polarization on them. A binary system including an NS and a companion star could serve as a probe. When the NS is in front of the companion star with respect to the earth observer, there is a circular polarization on the previously linearly polarized photons as a result of the interaction with ALPs there. After a half-binary period, the companion star passes in front of the NS, and the circular polarization of photons disappears and changes to linear. The excluded parameter space for a millisecond NS with 300~Hz rotating frequency, highlights the coupling constant of $1.7\times10^{-11}~\text{GeV}^{-1}\leq g_{a\gamma\gamma}\leq1.6\times10^{-3}~\text{GeV}^{-1}$ for the ALP masses in the range of $7\times10^{-12}~\text{eV}\leq m_a\leq1.5\times 10^{3}~\text{eV}$.


title: Adv3D: Generating Safety-Critical 3D Objects through Closed-Loop Simulation

abstract: Self-driving vehicles (SDVs) must be rigorously tested on a wide range of scenarios to ensure safe deployment. The industry typically relies on closed-loop simulation to evaluate how the SDV interacts on a corpus of synthetic and real scenarios and verify it performs properly. However, they primarily only test the system's motion planning module, and only consider behavior variations. It is key to evaluate the full autonomy system in closed-loop, and to understand how variations in sensor data based on scene appearance, such as the shape of actors, affect system performance. In this paper, we propose a framework, Adv3D, that takes real world scenarios and performs closed-loop sensor simulation to evaluate autonomy performance, and finds vehicle shapes that make the scenario more challenging, resulting in autonomy failures and uncomfortable SDV maneuvers. Unlike prior works that add contrived adversarial shapes to vehicle roof-tops or roadside to harm perception only, we optimize a low-dimensional shape representation to modify the vehicle shape itself in a realistic manner to degrade autonomy performance (e.g., perception, prediction, and motion planning). Moreover, we find that the shape variations found with Adv3D optimized in closed-loop are much more effective than those in open-loop, demonstrating the importance of finding scene appearance variations that affect autonomy in the interactive setting.


title: CADSim: Robust and Scalable in-the-wild 3D Reconstruction for Controllable Sensor Simulation

abstract: Realistic simulation is key to enabling safe and scalable development of % self-driving vehicles. A core component is simulating the sensors so that the entire autonomy system can be tested in simulation. Sensor simulation involves modeling traffic participants, such as vehicles, with high quality appearance and articulated geometry, and rendering them in real time. The self-driving industry has typically employed artists to build these assets. However, this is expensive, slow, and may not reflect reality. Instead, reconstructing assets automatically from sensor data collected in the wild would provide a better path to generating a diverse and large set with good real-world coverage. Nevertheless, current reconstruction approaches struggle on in-the-wild sensor data, due to its sparsity and noise. To tackle these issues, we present CADSim, which combines part-aware object-class priors via a small set of CAD models with differentiable rendering to automatically reconstruct vehicle geometry, including articulated wheels, with high-quality appearance. Our experiments show our method recovers more accurate shapes from sparse data compared to existing approaches. Importantly, it also trains and renders efficiently. We demonstrate our reconstructed vehicles in several applications, including accurate testing of autonomy perception systems.


title: UltraLiDAR: Learning Compact Representations for LiDAR Completion and Generation

abstract: LiDAR provides accurate geometric measurements of the 3D world. Unfortunately, dense LiDARs are very expensive and the point clouds captured by low-beam LiDAR are often sparse. To address these issues, we present UltraLiDAR, a data-driven framework for scene-level LiDAR completion, LiDAR generation, and LiDAR manipulation. The crux of UltraLiDAR is a compact, discrete representation that encodes the point cloud's geometric structure, is robust to noise, and is easy to manipulate. We show that by aligning the representation of a sparse point cloud to that of a dense point cloud, we can densify the sparse point clouds as if they were captured by a real high-density LiDAR, drastically reducing the cost. Furthermore, by learning a prior over the discrete codebook, we can generate diverse, realistic LiDAR point clouds for self-driving. We evaluate the effectiveness of UltraLiDAR on sparse-to-dense LiDAR completion and LiDAR generation. Experiments show that densifying real-world point clouds with our approach can significantly improve the performance of downstream perception systems. Compared to prior art on LiDAR generation, our approach generates much more realistic point clouds. According to A/B test, over 98.5\% of the time human participants prefer our results over those of previous methods.


title: TopicGPT: A Prompt-based Topic Modeling Framework

abstract: Topic modeling is a well-established technique for exploring text corpora. Conventional topic models (e.g., LDA) represent topics as bags of words that often require "reading the tea leaves" to interpret; additionally, they offer users minimal control over the formatting and specificity of resulting topics. To tackle these issues, we introduce TopicGPT, a prompt-based framework that uses large language models (LLMs) to uncover latent topics in a text collection. TopicGPT produces topics that align better with human categorizations compared to competing methods: it achieves a harmonic mean purity of 0.74 against human-annotated Wikipedia topics compared to 0.64 for the strongest baseline. Its topics are also interpretable, dispensing with ambiguous bags of words in favor of topics with natural language labels and associated free-form descriptions. Moreover, the framework is highly adaptable, allowing users to specify constraints and modify topics without the need for model retraining. By streamlining access to high-quality and interpretable topics, TopicGPT represents a compelling, human-centered approach to topic modeling.


title: DreamSmooth: Improving Model-based Reinforcement Learning via Reward Smoothing

abstract: Model-based reinforcement learning (MBRL) has gained much attention for its ability to learn complex behaviors in a sample-efficient way: planning actions by generating imaginary trajectories with predicted rewards. Despite its success, we found that surprisingly, reward prediction is often a bottleneck of MBRL, especially for sparse rewards that are challenging (or even ambiguous) to predict. Motivated by the intuition that humans can learn from rough reward estimates, we propose a simple yet effective reward smoothing approach, DreamSmooth, which learns to predict a temporally-smoothed reward, instead of the exact reward at the given timestep. We empirically show that DreamSmooth achieves state-of-the-art performance on long-horizon sparse-reward tasks both in sample efficiency and final performance without losing performance on common benchmarks, such as Deepmind Control Suite and Atari benchmarks.


title: Randomized Strong Recursive Skeletonization: Simultaneous compression and factorization of $\mathcal{H}$-matrices in the Black-Box Setting

abstract: The hierarchical matrix ($\mathcal{H}^{2}$-matrix) formalism provides a way to reinterpret the Fast Multipole Method and related fast summation schemes in linear algebraic terms. The idea is to tessellate a matrix into blocks in such as way that each block is either small or of numerically low rank; this enables the storage of the matrix and the application of it to a vector in linear or close to linear complexity. A key motivation for the reformulation is to extend the range of dense matrices that can be represented. Additionally, $\mathcal{H}^{2}$-matrices in principle also extend the range of operations that can be executed to include matrix inversion and factorization. While such algorithms can be highly efficient for certain specialized formats (such as HBS/HSS matrices based on ``weak admissibility''), inversion algorithms for general $\mathcal{H}^{2}$-matrices tend to be based on nested recursions and recompressions, making them challenging to implement efficiently. An exception is the \textit{strong recursive skeletonization (SRS)} algorithm by Minden, Ho, Damle, and Ying, which involves a simpler algorithmic flow. However, SRS greatly increases the number of blocks of the matrix that need to be stored explicitly, leading to high memory requirements. This manuscript presents the \textit{randomized strong recursive skeletonization (RSRS)} algorithm, which is a reformulation of SRS that incorporates the randomized SVD (RSVD) to simultaneously compress and factorize an $\mathcal{H}^{2}$-matrix. RSRS is a ``black box'' algorithm that interacts with the matrix to be compressed only via its action on vectors; this extends the range of the SRS algorithm (which relied on the ``proxy source'' compression technique) to include dense matrices that arise in sparse direct solvers.


title: Time Series Anomaly Detection using Diffusion-based Models

abstract: Diffusion models have been recently used for anomaly detection (AD) in images. In this paper we investigate whether they can also be leveraged for AD on multivariate time series (MTS). We test two diffusion-based models and compare them to several strong neural baselines. We also extend the PA%K protocol, by computing a ROCK-AUC metric, which is agnostic to both the detection threshold and the ratio K of correctly detected points. Our models outperform the baselines on synthetic datasets and are competitive on real-world datasets, illustrating the potential of diffusion-based methods for AD in multivariate time series.


title: PPI++: Efficient Prediction-Powered Inference

abstract: We present PPI++: a computationally lightweight methodology for estimation and inference based on a small labeled dataset and a typically much larger dataset of machine-learning predictions. The methods automatically adapt to the quality of available predictions, yielding easy-to-compute confidence sets -- for parameters of any dimensionality -- that always improve on classical intervals using only the labeled data. PPI++ builds on prediction-powered inference (PPI), which targets the same problem setting, improving its computational and statistical efficiency. Real and synthetic experiments demonstrate the benefits of the proposed adaptations.


title: NOIR: Neural Signal Operated Intelligent Robots for Everyday Activities

abstract: We present Neural Signal Operated Intelligent Robots (NOIR), a general-purpose, intelligent brain-robot interface system that enables humans to command robots to perform everyday activities through brain signals. Through this interface, humans communicate their intended objects of interest and actions to the robots using electroencephalography (EEG). Our novel system demonstrates success in an expansive array of 20 challenging, everyday household activities, including cooking, cleaning, personal care, and entertainment. The effectiveness of the system is improved by its synergistic integration of robot learning algorithms, allowing for NOIR to adapt to individual users and predict their intentions. Our work enhances the way humans interact with robots, replacing traditional channels of interaction with direct, neural communication. Project website: https://noir-corl.github.io/.


title: RoboGen: Towards Unleashing Infinite Data for Automated Robot Learning via Generative Simulation

abstract: We present RoboGen, a generative robotic agent that automatically learns diverse robotic skills at scale via generative simulation. RoboGen leverages the latest advancements in foundation and generative models. Instead of directly using or adapting these models to produce policies or low-level actions, we advocate for a generative scheme, which uses these models to automatically generate diversified tasks, scenes, and training supervisions, thereby scaling up robotic skill learning with minimal human supervision. Our approach equips a robotic agent with a self-guided propose-generate-learn cycle: the agent first proposes interesting tasks and skills to develop, and then generates corresponding simulation environments by populating pertinent objects and assets with proper spatial configurations. Afterwards, the agent decomposes the proposed high-level task into sub-tasks, selects the optimal learning approach (reinforcement learning, motion planning, or trajectory optimization), generates required training supervision, and then learns policies to acquire the proposed skill. Our work attempts to extract the extensive and versatile knowledge embedded in large-scale models and transfer them to the field of robotics. Our fully generative pipeline can be queried repeatedly, producing an endless stream of skill demonstrations associated with diverse tasks and environments.


title: Inflation and late-time accelerated expansion driven by $k$-essence degenerate dynamics

abstract: We consider a k-essence model in which a single scalar field can be responsible for both primordial inflation and the present observed acceleration of the cosmological background geometry, while also admitting a nonsingular de Sitter beginning of the Universe (it arises from de Sitter and ends in de Sitter). The early one is driven by a slow-roll potential, and the late one is driven by a dynamical dimensional reduction process which freezes the scalar field in a degenerate surface, turning it into a cosmological constant. This is done by proposing a realizable stable cosmic time crystal, although giving a different interpretation to the ''moving ground stat'', in which there is no motion because the system loses degrees of freedom. Furthermore, the model is free of pathologies such as propagating superluminal perturbations, negative energies, and perturbation instabilities.


title: Conformal Policy Learning for Sensorimotor Control Under Distribution Shifts

abstract: This paper focuses on the problem of detecting and reacting to changes in the distribution of a sensorimotor controller's observables. The key idea is the design of switching policies that can take conformal quantiles as input, which we define as conformal policy learning, that allows robots to detect distribution shifts with formal statistical guarantees. We show how to design such policies by using conformal quantiles to switch between base policies with different characteristics, e.g. safety or speed, or directly augmenting a policy observation with a quantile and training it with reinforcement learning. Theoretically, we show that such policies achieve the formal convergence guarantees in finite time. In addition, we thoroughly evaluate their advantages and limitations on two compelling use cases: simulated autonomous driving and active perception with a physical quadruped. Empirical results demonstrate that our approach outperforms five baselines. It is also the simplest of the baseline strategies besides one ablation. Being easy to use, flexible, and with formal guarantees, our work demonstrates how conformal prediction can be an effective tool for sensorimotor learning under uncertainty.


title: Detecting Deepfakes Without Seeing Any

abstract: Deepfake attacks, malicious manipulation of media containing people, are a serious concern for society. Conventional deepfake detection methods train supervised classifiers to distinguish real media from previously encountered deepfakes. Such techniques can only detect deepfakes similar to those previously seen, but not zero-day (previously unseen) attack types. As current deepfake generation techniques are changing at a breathtaking pace, new attack types are proposed frequently, making this a major issue. Our main observations are that: i) in many effective deepfake attacks, the fake media must be accompanied by false facts i.e. claims about the identity, speech, motion, or appearance of the person. For instance, when impersonating Obama, the attacker explicitly or implicitly claims that the fake media show Obama; ii) current generative techniques cannot perfectly synthesize the false facts claimed by the attacker. We therefore introduce the concept of "fact checking", adapted from fake news detection, for detecting zero-day deepfake attacks. Fact checking verifies that the claimed facts (e.g. identity is Obama), agree with the observed media (e.g. is the face really Obama's?), and thus can differentiate between real and fake media. Consequently, we introduce FACTOR, a practical recipe for deepfake fact checking and demonstrate its power in critical attack settings: face swapping and audio-visual synthesis. Although it is training-free, relies exclusively on off-the-shelf features, is very easy to implement, and does not see any deepfakes, it achieves better than state-of-the-art accuracy.


title: Align Your Prompts: Test-Time Prompting with Distribution Alignment for Zero-Shot Generalization

abstract: The promising zero-shot generalization of vision-language models such as CLIP has led to their adoption using prompt learning for numerous downstream tasks. Previous works have shown test-time prompt tuning using entropy minimization to adapt text prompts for unseen domains. While effective, this overlooks the key cause for performance degradation to unseen domains -- distribution shift. In this work, we explicitly handle this problem by aligning the out-of-distribution (OOD) test sample statistics to those of the source data using prompt tuning. We use a single test sample to adapt multi-modal prompts at test time by minimizing the feature distribution shift to bridge the gap in the test domain. Evaluating against the domain generalization benchmark, our method improves zero-shot top- 1 accuracy beyond existing prompt-learning techniques, with a 3.08% improvement over the baseline MaPLe. In cross-dataset generalization with unseen categories across 10 datasets, our method improves consistently across all datasets compared to the existing state-of-the-art. Our source code and models are available at https://jameelhassan.github.io/promptalign.


title: Implicit Chain of Thought Reasoning via Knowledge Distillation

abstract: To augment language models with the ability to reason, researchers usually prompt or finetune them to produce chain of thought reasoning steps before producing the final answer. However, although people use natural language to reason effectively, it may be that LMs could reason more effectively with some intermediate computation that is not in natural language. In this work, we explore an alternative reasoning approach: instead of explicitly producing the chain of thought reasoning steps, we use the language model's internal hidden states to perform implicit reasoning. The implicit reasoning steps are distilled from a teacher model trained on explicit chain-of-thought reasoning, and instead of doing reasoning "horizontally" by producing intermediate words one-by-one, we distill it such that the reasoning happens "vertically" among the hidden states in different layers. We conduct experiments on a multi-digit multiplication task and a grade school math problem dataset and find that this approach enables solving tasks previously not solvable without explicit chain-of-thought, at a speed comparable to no chain-of-thought.


title: The Property Law of Crypto Tokens

abstract: This article addresses the lack of comprehensive studies on Web3 technologies, primarily due to lawyers' reluctance to explore technical intricacies. Understanding the underlying technological foundations is crucial to enhance the credibility of legal opinions. This article aims to illuminate these foundations, debunk myths, and concentrate on determining the legal status of crypto-assets in the context of property rights within the distributed economy. In addition, this article notes that the intangible nature of crypto-assets that derive value from distributed registries, and their resistance to deletion, makes crypto-assets more akin to the autonomy of intellectual property than physical media. The article presents illustrative examples from common law (United States, United Kingdom, New Zealand) and civil law (Germany, Austria, Poland) systems. Proposing a universal solution, it advocates a comprehensive framework safeguarding digital property - data ownership - extending beyond the confines of Web3. This article presents a comprehensive, multi-layered approach to the analysis of tokens as digital content and virtual goods. The approach, universally applicable to various of such goods, scrutinizes property on three distinct layers: first, the rights to the virtual good itself; second, the rights to the assets linked to the virtual good; and third, the rights to the intellectual property intricately associated with the token. Additionally, the paper provides concise analysis of the conflict of laws rules applicable to virtual goods. It also delves into issues concerning formal requirements for the transfer of intellectual property rights, licensing, the first sale (exhaustion) doctrine, the concept of the lawful acquirer, and other crucial aspects of intellectual property in the realm of virtual goods, particularly within the emerging metaverse.


title: Idempotent Generative Network

abstract: We propose a new approach for generative modeling based on training a neural network to be idempotent. An idempotent operator is one that can be applied sequentially without changing the result beyond the initial application, namely $f(f(z))=f(z)$. The proposed model $f$ is trained to map a source distribution (e.g, Gaussian noise) to a target distribution (e.g. realistic images) using the following objectives: (1) Instances from the target distribution should map to themselves, namely $f(x)=x$. We define the target manifold as the set of all instances that $f$ maps to themselves. (2) Instances that form the source distribution should map onto the defined target manifold. This is achieved by optimizing the idempotence term, $f(f(z))=f(z)$ which encourages the range of $f(z)$ to be on the target manifold. Under ideal assumptions such a process provably converges to the target distribution. This strategy results in a model capable of generating an output in one step, maintaining a consistent latent space, while also allowing sequential applications for refinement. Additionally, we find that by processing inputs from both target and source distributions, the model adeptly projects corrupted or modified data back to the target manifold. This work is a first step towards a ``global projector'' that enables projecting any input into a target data distribution.


title: Creating Trustworthy LLMs: Dealing with Hallucinations in Healthcare AI

abstract: Large language models have proliferated across multiple domains in as short period of time. There is however hesitation in the medical and healthcare domain towards their adoption because of issues like factuality, coherence, and hallucinations. Give the high stakes nature of healthcare, many researchers have even cautioned against its usage until these issues are resolved. The key to the implementation and deployment of LLMs in healthcare is to make these models trustworthy, transparent (as much possible) and explainable. In this paper we describe the key elements in creating reliable, trustworthy, and unbiased models as a necessary condition for their adoption in healthcare. Specifically we focus on the quantification, validation, and mitigation of hallucinations in the context in healthcare. Lastly, we discuss how the future of LLMs in healthcare may look like.


title: Reduced mobility? Urban exodus? Medium-term impacts of the COVID-19 pandemic on internal population movements in Latin American countries

abstract: The COVID-19 pandemic has impacted the national systems of population movement around the world. Existing work has focused on countries of the Global North and restricted to the immediate effects of COVID-19 data during 2020. Data have represented a major limitation to monitor change in mobility patterns in countries in the Global South. Drawing on aggregate anonymised mobile phone location data from Meta-Facebook users, we aim to analyse the extent and persistence of changes in the levels (or intensity) and spatial patterns of internal population movement across the rural-urban continuum in Argentina, Chile and Mexico over a 26-month period from March 2020 to May 2022. We reveal an overall systematic decline in the level of short- and long-distance movement during the enactment of nonpharmaceutical interventions in 2020, with the largest reductions occurred in the most dense areas. We also show that these levels bounced back closer to pre-pandemic levels in 2022 following the relaxation of COVID-19 stringency measures. However, the intensity of these movements has remained below pre-pandemic levels in many areas in 2022. Additionally our findings lend some support to the idea of an urban exodus. They reveal a continuing negative net balances of short-distance movements in the most dense areas of capital cities in Argentina and Mexico, reflecting a pattern of suburbanisation. Chile displays limited changes in the net balance of short-distance movements but reports a net loss of long-distance movements. These losses were, however, temporary, moving to neutral and positive balances in 2021 and 2022.


title: Euclid preparation. XXXIX. The effect of baryons on the Halo Mass Function

abstract: The Euclid photometric survey of galaxy clusters stands as a powerful cosmological tool, with the capacity to significantly propel our understanding of the Universe. Despite being sub-dominant to dark matter and dark energy, the baryonic component in our Universe holds substantial influence over the structure and mass of galaxy clusters. This paper presents a novel model to precisely quantify the impact of baryons on galaxy cluster virial halo masses, using the baryon fraction within a cluster as proxy for their effect. Constructed on the premise of quasi-adiabaticity, the model includes two parameters calibrated using non-radiative cosmological hydrodynamical simulations and a single large-scale simulation from the Magneticum set, which includes the physical processes driving galaxy formation. As a main result of our analysis, we demonstrate that this model delivers a remarkable one percent relative accuracy in determining the virial dark matter-only equivalent mass of galaxy clusters, starting from the corresponding total cluster mass and baryon fraction measured in hydrodynamical simulations. Furthermore, we demonstrate that this result is robust against changes in cosmological parameters and against varying the numerical implementation of the sub-resolution physical processes included in the simulations. Our work substantiates previous claims about the impact of baryons on cluster cosmology studies. In particular, we show how neglecting these effects would lead to biased cosmological constraints for a Euclid-like cluster abundance analysis. Importantly, we demonstrate that uncertainties associated with our model, arising from baryonic corrections to cluster masses, are sub-dominant when compared to the precision with which mass-observable relations will be calibrated using Euclid, as well as our current understanding of the baryon fraction within galaxy clusters.


title: On Fractional Analytic QCD

abstract: We present a brief overview of fractional analytic QCD.


title: The numerical linear algebra of weights: from the spectral analysis to conditioning and preconditioning in the Laplacian case

abstract: Weights are geometrical degrees of freedom that allow to generalise Lagrangian finite elements. They are defined through integrals over specific supports, well understood in terms of differential forms and integration, and lie within the framework of finite element exterior calculus. In this work we exploit this formalism with the target of identifying supports that are appealing for finite element approximation. To do so, we study the related parametric matrix-sequences, with the matrix order tending to infinity as the mesh size tends to zero. We describe the conditioning and the spectral global behavior in terms of the standard Toeplitz machinery and GLT theory, leading to the identification of the optimal choices for weights. Moreover, we propose and test ad hoc preconditioners, in dependence of the discretization parameters and in connection with conjugate gradient method. The model problem we consider is a onedimensional Laplacian, both with constant and non constant coefficients. Numerical visualizations and experimental tests are reported and critically discussed, demonstrating the advantages of weights-induced bases over standard Lagrangian ones. Open problems and future steps are listed in the conclusive section, especially regarding the multidimensional case.


title: Remember what you did so you know what to do next

abstract: We explore using a moderately sized large language model (GPT-J 6B parameters) to create a plan for a simulated robot to achieve 30 classes of goals in ScienceWorld, a text game simulator for elementary science experiments. Previously published empirical work claimed that large language models (LLMs) are a poor fit (Wang et al., 2022) compared to reinforcement learning. Using the Markov assumption (a single previous step), the LLM outperforms the reinforcement learning-based approach by a factor of 1.4. When we fill the LLM's input buffer with as many prior steps as possible, improvement rises to 3.5x. Even when training on only 6.5% of the training data, we observe a 2.2x improvement over the reinforcement-learning-based approach. Our experiments show that performance varies widely across the 30 classes of actions, indicating that averaging over tasks can hide significant performance issues. In work contemporaneous with ours, Lin et al. (2023) demonstrated a two-part approach (SwiftSage) that uses a small LLM (T5-large) complemented by OpenAI's massive LLMs to achieve outstanding results in ScienceWorld. Our 6-B parameter, single-stage GPT-J matches the performance of SwiftSage's two-stage architecture when it incorporates GPT-3.5 turbo which has 29-times more parameters than GPT-J.


title: Leveraging Language Models to Detect Greenwashing

abstract: In recent years, climate change repercussions have increasingly captured public interest. Consequently, corporations are emphasizing their environmental efforts in sustainability reports to bolster their public image. Yet, the absence of stringent regulations in review of such reports allows potential greenwashing. In this study, we introduce a novel methodology to train a language model on generated labels for greenwashing risk. Our primary contributions encompass: developing a mathematical formulation to quantify greenwashing risk, a fine-tuned ClimateBERT model for this problem, and a comparative analysis of results. On a test set comprising of sustainability reports, our best model achieved an average accuracy score of 86.34% and F1 score of 0.67, demonstrating that our methods show a promising direction of exploration for this task.


title: Preliminary Estimators of Population Mean using Ranked Set Sampling in the Presence of Measurement Error and Non-Response Error

abstract: In order to estimate the population mean in the presence of both non-response and measurement errors that are uncorrelated, the paper presents some novel estimators employing ranked set sampling by utilizing auxiliary information.Up to the first order of approximation, the equations for the bias and mean squared error of the suggested estimators are produced, and it is found that the proposed estimators outperform the other existing estimators analysed in this study. Investigations using simulation studies and numerical examples show how well the suggested estimators perform in the presence of measurement and non-response errors. The relative efficiency of the suggested estimators compared to the existing estimators has been expressed as a percentage, and the impact of measurement errors has been expressed as a percentage computation of measurement errors.


title: Reverse Engineering the Reproduction Number: A Framework for Data-Driven Counterfactual Analysis, Strategy Evaluation, and Feedback Control of Epidemics

abstract: During the COVID-19 pandemic, different countries, regions, and communities constructed various epidemic models to evaluate spreading behaviors and assist in making mitigation policies. Model uncertainties, introduced by complex transmission behaviors, contact-tracing networks, time-varying spreading parameters, and human factors, as well as insufficient data, have posed arduous challenges for model-based approaches. To address these challenges, we propose a novel framework for data-driven counterfactual analysis, strategy evaluation, and feedback control of epidemics, which leverages statistical information from epidemic testing data instead of constructing a specific model. Through reverse engineering the reproduction number by quantifying the impact of the intervention strategy, this framework tackles three primary problems: 1) How severe would an outbreak have been without the implemented intervention strategies? 2) What impact would varying the intervention strength have had on an outbreak? 3) How can we adjust the intervention intensity based on the current state of an outbreak? Specifically, we consider the epidemic intervention policies such as the testing-for-isolation strategy as an example, which was successfully implemented by the University of Illinois Urbana-Champaign (UIUC) and Purdue University (Purdue) during the COVID-19 pandemic. By leveraging data collected by UIUC and Purdue, we validate the effectiveness of the proposed data-driven framework.


title: Relation Extraction from News Articles (RENA): A Tool for Epidemic Surveillance

abstract: Relation Extraction from News Articles (RENA) is a browser-based tool designed to extract key entities and their semantic relationships in English language news articles related to infectious diseases. Constructed using the React framework, this system presents users with an elegant and user-friendly interface. It enables users to input a news article and select from a choice of two models to generate a comprehensive list of relations within the provided text. As a result, RENA allows real-time parsing of news articles to extract key information for epidemic surveillance, contributing to EPIWATCH, an open-source intelligence-based epidemic warning system.


title: Adversarial Examples in the Physical World: A Survey

abstract: Deep neural networks (DNNs) have demonstrated high vulnerability to adversarial examples. Besides the attacks in the digital world, the practical implications of adversarial examples in the physical world present significant challenges and safety concerns. However, current research on physical adversarial examples (PAEs) lacks a comprehensive understanding of their unique characteristics, leading to limited significance and understanding. In this paper, we address this gap by thoroughly examining the characteristics of PAEs within a practical workflow encompassing training, manufacturing, and re-sampling processes. By analyzing the links between physical adversarial attacks, we identify manufacturing and re-sampling as the primary sources of distinct attributes and particularities in PAEs. Leveraging this knowledge, we develop a comprehensive analysis and classification framework for PAEs based on their specific characteristics, covering over 100 studies on physical-world adversarial examples. Furthermore, we investigate defense strategies against PAEs and identify open challenges and opportunities for future research. We aim to provide a fresh, thorough, and systematic understanding of PAEs, thereby promoting the development of robust adversarial learning and its application in open-world scenarios.


title: A new proof of Euclid's algorithm

abstract: Our main result is a new proof of correctness of Euclid's algorithm. The proof is conducted in algorithmic theory of natural numbers Th3. A formula H is constructed that expresses the halting property of the algorithm. Next, the proof of H is is presented. In the proof we make use of inference rules of calculus of programs. The only formulas accepted without the proof are axioms of program calculus or axioms of the theory Th3. We complete our result by showing that the theorem on correctness of Euclid's algorithm can not be proved in any elementary theory of natural numbers.