title: Methods for Incorporating Model Uncertainty into Exoplanet Atmospheric Analysis

abstract: A key goal of exoplanet spectroscopy is to measure atmospheric properties, such as abundances of chemical species, in order to connect them to our understanding of atmospheric physics and planet formation. In this new era of high-quality JWST data, it is paramount that these measurement methods are robust. When comparing atmospheric models to observations, multiple candidate models may produce reasonable fits to the data. Typically, conclusions are reached by selecting the best-performing model according to some metric. This ignores model uncertainty in favour of specific model assumptions, potentially leading to measured atmospheric properties that are overconfident and/or incorrect. In this paper, we compare three ensemble methods for addressing model uncertainty by combining posterior distributions from multiple analyses: Bayesian model averaging, a variant of Bayesian model averaging using leave-one-out predictive densities, and stacking of predictive distributions. We demonstrate these methods by fitting the HST+Spitzer transmission spectrum of the hot Jupiter HD 209458b using models with different cloud and haze prescriptions. All of our ensemble methods lead to uncertainties on retrieved parameters that are larger, but more realistic, and consistent with physical and chemical expectations. Since they have not typically accounted for model uncertainty, uncertainties of retrieved parameters from HST spectra have likely been underreported. We recommend stacking as the most robust model combination method. Our methods can be used to combine results from independent retrieval codes, and from different models within one code. They are also widely applicable to other exoplanet analysis processes, such as combining results from different data reductions.


title: DSPy: Compiling Declarative Language Model Calls into Self-Improving Pipelines

abstract: The ML community is rapidly exploring techniques for prompting language models (LMs) and for stacking them into pipelines that solve complex tasks. Unfortunately, existing LM pipelines are typically implemented using hard-coded "prompt templates", i.e. lengthy strings discovered via trial and error. Toward a more systematic approach for developing and optimizing LM pipelines, we introduce DSPy, a programming model that abstracts LM pipelines as text transformation graphs, i.e. imperative computational graphs where LMs are invoked through declarative modules. DSPy modules are parameterized, meaning they can learn (by creating and collecting demonstrations) how to apply compositions of prompting, finetuning, augmentation, and reasoning techniques. We design a compiler that will optimize any DSPy pipeline to maximize a given metric. We conduct two case studies, showing that succinct DSPy programs can express and optimize sophisticated LM pipelines that reason about math word problems, tackle multi-hop retrieval, answer complex questions, and control agent loops. Within minutes of compiling, a few lines of DSPy allow GPT-3.5 and llama2-13b-chat to self-bootstrap pipelines that outperform standard few-shot prompting (generally by over 25% and 65%, respectively) and pipelines with expert-created demonstrations (by up to 5-46% and 16-40%, respectively). On top of that, DSPy programs compiled to open and relatively small LMs like 770M-parameter T5 and llama2-13b-chat are competitive with approaches that rely on expert-written prompt chains for proprietary GPT-3.5. DSPy is available at https://github.com/stanfordnlp/dspy


title: Artificial Intelligence Index Report 2023

abstract: Welcome to the sixth edition of the AI Index Report. This year, the report introduces more original data than any previous edition, including a new chapter on AI public opinion, a more thorough technical performance chapter, original analysis about large language and multimodal models, detailed trends in global AI legislation records, a study of the environmental impact of AI systems, and more. The AI Index Report tracks, collates, distills, and visualizes data related to artificial intelligence. Our mission is to provide unbiased, rigorously vetted, broadly sourced data in order for policymakers, researchers, executives, journalists, and the general public to develop a more thorough and nuanced understanding of the complex field of AI. The report aims to be the world's most credible and authoritative source for data and insights about AI.


title: A Long Way to Go: Investigating Length Correlations in RLHF

abstract: Great successes have been reported using Reinforcement Learning from Human Feedback (RLHF) to align large language models. Open-source preference datasets and reward models have enabled wider experimentation beyond generic chat settings, particularly to make systems more "helpful" for tasks like web question answering, summarization, and multi-turn dialogue. When optimizing for helpfulness, RLHF has been consistently observed to drive models to produce longer outputs. This paper demonstrates that optimizing for response length is a significant factor behind RLHF's reported improvements in these settings. First, we study the relationship between reward and length for reward models trained on three open-source preference datasets for helpfulness. Here, length correlates strongly with reward, and improvements in reward score are driven in large part by shifting the distribution over output lengths. We then explore interventions during both RL and reward model learning to see if we can achieve the same downstream improvements as RLHF without increasing length. While our interventions mitigate length increases, they aren't uniformly effective across settings. Furthermore, we find that even running RLHF with a reward based solely on length can reproduce most of the downstream improvements over the initial policy model, showing that reward models in these settings have a long way to go.


title: Beyond radial profiles: Using log-normal distributions to model the multiphase circumgalactic medium

abstract: Recent observations and simulations reveal that the circumgalactic medium (CGM) surrounding galaxies is multiphase, with the gas temperatures spanning a wide range at most radii, $\sim 10^4\ {\rm K}$ to the virial temperature ($\sim 10^6$ K for Milky Way). Traditional CGM models using simple density profiles are inadequate at reproducing observations that indicate a broad temperature range. Alternatively, a model based on probability distribution functions (PDFs) with parameters motivated by simulations can better match multi-wavelength observations. In this work, we use log-normal distributions, commonly seen in the simulations of the multiphase interstellar and circumgalactic media, to model the multiphase CGM. We generalize the isothermal background model by Faerman et al. 2017 to include more general CGM profiles. We extend the existing probabilistic models from 1D-PDFs in temperature to 2D-PDFs in density-temperature phase space and constrain its parameters using a Milky Way-like {\tt Illustris TNG50-1} halo. We generate various synthetic observables such as column densities of different ions, UV/X-ray spectra, and dispersion and emission measures. X-ray and radio (Fast Radio Burst) observations mainly constrain the hot gas properties. However, interpreting cold/warm phase diagnostics is not straightforward since these phases are patchy, with inherent variability in intercepting these clouds along arbitrary lines of sight. We provide a tabulated comparison of model predictions with observations and plan to expand this into a comprehensive compilation of models and data. Our modeling provides a simple analytic framework that is useful for describing important aspects of the multiphase CGM.


title: Constraint-Conditioned Policy Optimization for Versatile Safe Reinforcement Learning

abstract: Safe reinforcement learning (RL) focuses on training reward-maximizing agents subject to pre-defined safety constraints. Yet, learning versatile safe policies that can adapt to varying safety constraint requirements during deployment without retraining remains a largely unexplored and challenging area. In this work, we formulate the versatile safe RL problem and consider two primary requirements: training efficiency and zero-shot adaptation capability. To address them, we introduce the Conditioned Constrained Policy Optimization (CCPO) framework, consisting of two key modules: (1) Versatile Value Estimation (VVE) for approximating value functions under unseen threshold conditions, and (2) Conditioned Variational Inference (CVI) for encoding arbitrary constraint thresholds during policy optimization. Our extensive experiments demonstrate that CCPO outperforms the baselines in terms of safety and task performance while preserving zero-shot adaptation capabilities to different constraint thresholds data-efficiently. This makes our approach suitable for real-world dynamic applications.


title: Atom interferometers in weakly curved spacetimes using Bragg diffraction and Bloch oscillations

abstract: We present a systematic approach to determine all relativistic phases up to $\mathcal{O}(c^{-2})$ in light-pulse atom interferometers in weakly curved spacetime that are based on elastic scattering, namely Bragg diffraction and Bloch oscillations. Our analysis is derived from first principles using the parameterized post-Newtonian formalism. In the treatment developed here, we derive algebraic expressions for relativistic phases for arbitrary interferometer geometries in an automated manner. As case studies, we consider symmetric and antisymmetric Ramsey-Bord\'e interferometers, as well as a symmetric double diffraction interferometer with baseline lengths of 10 m and 100 m. We compare our results to previous calculations conducted for a Mach-Zehnder interferometer.


title: SteP: Stacked LLM Policies for Web Actions

abstract: Performing tasks on the web presents fundamental challenges to large language models (LLMs), including combinatorially large open-world tasks and variations across web interfaces. Simply specifying a large prompt to handle all possible behaviors and states is extremely complex, and results in behavior leaks between unrelated behaviors. Decomposition to distinct policies can address this challenge, but requires carefully handing off control between policies. We propose Stacked LLM Policies for Web Actions (SteP), an approach to dynamically compose policies to solve a diverse set of web tasks. SteP defines a Markov Decision Process where the state is a stack of policies representing the control state, i.e., the chain of policy calls. Unlike traditional methods that are restricted to static hierarchies, SteP enables dynamic control that adapts to the complexity of the task. We evaluate SteP against multiple baselines and web environments including WebArena, MiniWoB++, and a CRM simulator. On WebArena, SteP improves (14.9% to 35.8%) over SOTA that use GPT-4 policies, while on MiniWob++, SteP is competitive with prior works while using significantly less data. Our code and data is available at https://asappresearch.github.io/webagents-step.


title: Singlet-doublet fermion dark matter with Dirac neutrino mass, $(g-2)_\mu$ and $\Delta N_{\rm eff}$

abstract: We study the possibility of generating light Dirac neutrino mass via scotogenic mechanism where singlet-doublet fermion dark matter (DM) plays non-trivial role in generating one-loop neutrino mass, anomalous magnetic moment of muon $(g-2)_\mu$ as well as additional relativistic degrees of freedom $\Delta{N_{\rm eff}}$ within reach of cosmic microwave background (CMB) experiments. We show that the Dirac nature of neutrinos can bring interesting correlations within the parameter space satisfying the $\left(g-2\right)_\mu$ anomaly and DM relic density and the effective relativistic degrees of freedom $\Delta{N_{\rm eff}}$. While we stick to thermal singlet doublet DM with promising detection prospects, both thermal and non-thermal origin of $\Delta{N_{\rm eff}}$ have been explored. In addition to detection prospects at DM, $(g-2)$ and other particle physics experiments, the model remains verifiable at future CMB experiments like CMB-S4, SPT-3G.


title: Anytime-valid t-tests and confidence sequences for Gaussian means with unknown variance

abstract: In 1976, Lai constructed a nontrivial confidence sequence for the mean $\mu$ of a Gaussian distribution with unknown variance $\sigma^2$. Curiously, he employed both an improper (right Haar) mixture over $\sigma$ and an improper (flat) mixture over $\mu$. Here, we elaborate carefully on the details of his construction, which use generalized nonintegrable martingales and an extended Ville's inequality. While this does yield a sequential t-test, it does not yield an "e-process" (due to the nonintegrability of his martingale). In this paper, we develop two new e-processes and confidence sequences for the same setting: one is a test martingale in a reduced filtration, while the other is an e-process in the canonical data filtration. These are respectively obtained by swapping Lai's flat mixture for a Gaussian mixture, and swapping the right Haar mixture over $\sigma$ with the maximum likelihood estimate under the null, as done in universal inference. We also analyze the width of resulting confidence sequences, which have a curious polynomial dependence on the error probability $\alpha$ that we prove to be not only unavoidable, but (for universal inference) even better than the classical fixed-sample t-test. Numerical experiments are provided along the way to compare and contrast the various approaches, including some recent suboptimal ones.


title: Quaternary borocarbides: a testbed for DFT for superconductors

abstract: Using ab-initio density functional theory for superconductors (SCDFT), we systematically study the quaternary borocarbides $RM_2$B$_2$C. Treating the retarded (frequency-dependent) interaction $W(\omega)$ within the random-phase approximation (RPA), we find good agreement with experiments for the calculated superconducting critical temperature $T_c$ in the nonmagnetic Ni- and Pd-based compounds. We argue that the problem of accurately placing the $f$-bands within DFT, and possibly the lack of an explicit magnetic pair-breaking mechanism, explain the difficulties of SCDFT in reproducing $T_c$ in members of the magnetic $R$Ni$_2$B$_2$C series ($R$ rare-earth with partially filled $4f$). While the calculated $T_c$ is overestimated, SCDFT qualitatively captures the experimentally observed trend along the rare-earth series, which indicates that the electron-phonon couplings and dynamically screened interactions have a significant effect on $T_c$.


title: Modular Speech-to-Text Translation for Zero-Shot Cross-Modal Transfer

abstract: Recent research has shown that independently trained encoders and decoders, combined through a shared fixed-size representation, can achieve competitive performance in speech-to-text translation. In this work, we show that this type of approach can be further improved with multilingual training. We observe significant improvements in zero-shot cross-modal speech translation, even outperforming a supervised approach based on XLSR for several languages.


title: Stochastic interpolants with data-dependent couplings

abstract: Generative models inspired by dynamical transport of measure -- such as flows and diffusions -- construct a continuous-time map between two probability densities. Conventionally, one of these is the target density, only accessible through samples, while the other is taken as a simple base density that is data-agnostic. In this work, using the framework of stochastic interpolants, we formalize how to \textit{couple} the base and the target densities, whereby samples from the base are computed conditionally given samples from the target in a way that is different from (but does preclude) incorporating information about class labels or continuous embeddings. This enables us to construct dynamical transport maps that serve as conditional generative models. We show that these transport maps can be learned by solving a simple square loss regression problem analogous to the standard independent setting. We demonstrate the usefulness of constructing dependent couplings in practice through experiments in super-resolution and in-painting.


title: Comparative study of light storage in antirelaxation-coated and buffer-gas-filled alkali vapor cells

abstract: We perform a comparative study of light storage in antirelaxation-coated and buffer-gas-filled alkali-vapor cells using electromagnetically induced transparency (EIT) in warm rubidium vapor. The use of a buffer-gas-filled cell resulted in $\approx$10-fold improvement in storage time and efficiency compared to antirelaxation coated cells. Our findings contribute to the development of future field-deployable high-performance quantum memories.


title: Echoes from bounded universes

abstract: We construct a general class of modified Ellis wormholes, where one asymptotic Minkowski region is replaced by a bounded 2-sphere core, characterized by asymptotic finite areal radius. We pursue an in-depth analysis of the resulting geometry, outlining that geodesic completeness is guaranteed also when the radial function asymptotically shrinks to zero. Then, we study the evolution of scalar perturbations, bringing out how these geometric configurations can in principle affect the time-domain profiles of quasinormal modes, pointing out the distinctive features with respect to other black holes or wormholes geometries.


title: Characterizing and Mitigating Timing Noise-Induced Decoherence in Single Electron Sources

abstract: Identifying and controlling decoherence in single electron sources (SES) is important for their applications in quantum information processing. The recent experiments with ultrashort electron pulses [J. D. Fletcher et al., Nat. Commun. 10, 5298 (2019)] demonstrate strong decoherence that cannot be caused by traditional mechanisms such as electron-electron or electron-phonon interactions. Here we propose timing noise as a universal model, consistent with existing experimental data, to explain strong decoherence of ultrafast SES pulses, without resorting to any specific microscopic mechanism for such decoherence. We also propose a protocol to filter out timing noise which works even in the presence of other decoherence effects, such as those present in, e.g., low-energy SESs.


title: Explicit Acyclic Models and (Co)Chain Operations

abstract: We exploit a uniform recursive procedure using preferred contractions of targets $C_*$ to construct morphisms $B_* \to C_*$ between chain complexes in a wide variety of situations. Examples include classical Alexander-Whitney and Eilenberg-Zilber maps, chain maps related to homology and cohomology operations, operad structure maps for various chain complex operads, and chain maps that define morphisms between operads. The procedure includes functorial chain maps $F_*(X_i) \to K_*(X_i)$, using models for generators of the domain and contractions of $K_*$ applied to these models. Various uniqueness theorems characterize the chain maps produced by our procedures. We give unified extended treatments of the operads known as the Barratt-Eccles operad and the surjection operads. In a subsequent paper we plan to use the results and methods of this paper to establish properties of the Steenrod algebra of mod p cohomology operations at the cochain level. Classical treatments of Steenrod operations used less explicit acyclic model methods to deduce properties of operations at the cohomology level. Our paper is comprehensive and includes many examples and specific results of a somewhat technical nature. But the main point is that a rather easily described explicit procedure clarifies aspects of chain maps defined only up to homotopy that were important in the development of cohomology operations roughly seventy years ago, as well as complicated chain maps related to operad structure maps and operad morphisms developed in a rather ad hoc manner roughly twenty five years ago. Sections 0, 1, and 2 constitute an overview and summary of the paper.


title: Role of plasticity in the universal scaling of shear thickening dense suspensions

abstract: Increase in viscosity under increasing shear stress, known as shear thickening (ST), is one of the most striking properties of dense particulate suspensions. Under appropriate conditions, they exhibit discontinuous shear thickening (DST), where the viscosity increases dramatically and can also transform into a solid-like state due to shear induced jamming (SJ). The microscopic mechanism giving rise to such interesting phenomena is still a topic of intense research. A phenomenological model proposed by Wyart and Cates shows that the proliferation of stress-activated interparticle frictional contacts can give rise to such striking flow properties. Building on this model, a recent work proposes and verifies a universal scaling relation for ST systems where two different power-law regimes with a well-defined crossover point is obtained. Nonetheless, the difference in the nature of the flow in these two scaling regimes remains unexplored. Here, using rheology in conjugation with high-speed optical imaging, we study the flow and local deformations in various ST systems. We observe that with increasing applied stress, the smooth flow changes into a spatio-temporally varying flow across the scaling-crossover. We show that such fluctuating flow is associated with intermittent dilatancy, shear band plasticity and fracture induced by system spanning frictional contacts.


title: MathCoder: Seamless Code Integration in LLMs for Enhanced Mathematical Reasoning

abstract: The recently released GPT-4 Code Interpreter has demonstrated remarkable proficiency in solving challenging math problems, primarily attributed to its ability to seamlessly reason with natural language, generate code, execute code, and continue reasoning based on the execution output. In this paper, we present a method to fine-tune open-source language models, enabling them to use code for modeling and deriving math equations and, consequently, enhancing their mathematical reasoning abilities. We propose a method of generating novel and high-quality datasets with math problems and their code-based solutions, referred to as MathCodeInstruct. Each solution interleaves natural language, code, and execution results. We also introduce a customized supervised fine-tuning and inference approach. This approach yields the MathCoder models, a family of models capable of generating code-based solutions for solving challenging math problems. Impressively, the MathCoder models achieve state-of-the-art scores among open-source LLMs on the MATH (45.2%) and GSM8K (83.9%) datasets, substantially outperforming other open-source alternatives. Notably, the MathCoder model not only surpasses ChatGPT-3.5 and PaLM-2 on GSM8K and MATH but also outperforms GPT-4 on the competition-level MATH dataset. The dataset and models will be released at https://github.com/mathllm/MathCoder.


title: Coupling of different solvable ensembles of random matrices

abstract: Explicit expressions for multimatrix models with complex and unitary matrices allows to couple these models with well-known unitary, orthogonsl and sympletic ensembles. We consider examples of such mixed ensembles which are solvable in the sense that the partition functions of such ensembles can be considered as tau functions of the classical integrable equations.


title: Bringing 2D Eclipse Mapping out of the Shadows with Leave-one-out Cross-validation

abstract: Eclipse mapping is a technique for inferring 2D brightness maps of transiting exoplanets from the shape of an eclipse light curve. With JWST's unmatched precision, eclipse mapping is now possible for a large number of exoplanets. However, eclipse mapping has only been applied to two planets and the nuances of fitting eclipse maps are not yet fully understood. Here, we use Leave-one-out Cross- Validation (LOO-CV) to investigate eclipse mapping, with application to a JWST NIRISS/SOSS observation of the ultra-hot Jupiter WASP-18b. LOO-CV is a technique that provides insight into the out-of-sample predictive power of models on a data-point-by-data-point basis. We show that constraints on planetary brightness patterns behave as expected, with large-scale variations driven by the phase-curve variation in the light curve and smaller-scale structures constrained by the eclipse ingress and egress. For WASP-18b we show that the need for higher model complexity (smaller-scale features) is driven exclusively by the shape of the eclipse ingress and egress. We use LOO-CV to investigate the relationship between planetary brightness map components when mapping under a positive-flux constraint to better understand the need for complex models. Finally, we use LOO-CV to understand the degeneracy between the competing ``hotspot'' and ``plateau'' brightness map models of WASP-18b, showing that the plateau model is driven by the ingress shape and the hotspot model is driven by the egress shape, but preference for neither model is due to outliers or unmodeled signals. Based on this analysis, we make recommendations for the use of LOO-CV in future eclipse-mapping studies.


title: Leveraging Unpaired Data for Vision-Language Generative Models via Cycle Consistency

abstract: Current vision-language generative models rely on expansive corpora of paired image-text data to attain optimal performance and generalization capabilities. However, automatically collecting such data (e.g. via large-scale web scraping) leads to low quality and poor image-text correlation, while human annotation is more accurate but requires significant manual effort and expense. We introduce $\textbf{ITIT}$ ($\textbf{I}$n$\textbf{T}$egrating $\textbf{I}$mage $\textbf{T}$ext): an innovative training paradigm grounded in the concept of cycle consistency which allows vision-language training on unpaired image and text data. ITIT is comprised of a joint image-text encoder with disjoint image and text decoders that enable bidirectional image-to-text and text-to-image generation in a single framework. During training, ITIT leverages a small set of paired image-text data to ensure its output matches the input reasonably well in both directions. Simultaneously, the model is also trained on much larger datasets containing only images or texts. This is achieved by enforcing cycle consistency between the original unpaired samples and the cycle-generated counterparts. For instance, it generates a caption for a given input image and then uses the caption to create an output image, and enforces similarity between the input and output images. Our experiments show that ITIT with unpaired datasets exhibits similar scaling behavior as using high-quality paired data. We demonstrate image generation and captioning performance on par with state-of-the-art text-to-image and image-to-text models with orders of magnitude fewer (only 3M) paired image-text data.


title: An Uncertainty Principle for the Curvelet Transform, and the Infeasibility of Quantum Algorithms for Finding Short Lattice Vectors

abstract: The curvelet transform is a special type of wavelet transform, which is useful for estimating the locations and orientations of waves propagating in Euclidean space. We prove an uncertainty principle that lower-bounds the variance of these estimates, for radial wave functions in n dimensions. As an application of this uncertainty principle, we show the infeasibility of one approach to constructing quantum algorithms for solving lattice problems, such as the approximate shortest vector problem (approximate-SVP), and bounded distance decoding (BDD). This gives insight into the computational intractability of approximate-SVP, which plays an important role in algorithms for integer programming, and in post-quantum cryptosystems. In this approach to solving lattice problems, one prepares quantum superpositions of Gaussian-like wave functions centered at lattice points. A key step in this procedure requires finding the center of each Gaussian-like wave function, using the quantum curvelet transform. We show that, for any choice of the Gaussian-like wave function, the error in this step will be above the threshold required to solve BDD and approximate-SVP.


title: Recovering Single-Crossing Preferences From Approval Ballots

abstract: An electorate with fully-ranked innate preferences casts approval votes over a finite set of alternatives. As a result, only partial information about the true preferences is revealed to the voting authorities. In an effort to understand the nature of the true preferences given only partial information, one might ask whether the unknown innate preferences could possibly be single-crossing. The existence of a polynomial time algorithm to determine this has been asked as an outstanding problem in the works of Elkind and Lackner. We hereby give a polynomial time algorithm determining a single-crossing collection of fully-ranked preferences that could have induced the elicited approval ballots, or reporting the nonexistence thereof. Moreover, we consider the problem of identifying negative instances with a set of forbidden sub-ballots, showing that any such characterization requires infinitely many forbidden configurations.


title: Topological Density Correlations in a Fermi Gas

abstract: A Fermi gas of non-interacting electrons, or ultra-cold fermionic atoms, has a quantum ground state defined by a region of occupancy in momentum space known as the Fermi sea. The Euler characteristic $\chi_F$ of the Fermi sea serves to topologically classify these gapless fermionic states. The topology of a $D$ dimensional Fermi sea is physically encoded in the $D+1$ point equal time density correlation function. In this work, we first present a simple proof of this fact by showing that the evaluation of the correlation function can be formulated in terms of a triangulation of the Fermi sea with a collection of points, links and triangles and their higher dimensional analogs. We then make use of the topological $D+1$ point density correlation to reveal universal structures of the more general $M$ point density correlation functions in a $D$ dimensional Fermi gas. Two experimental methods are proposed for observing these correlations in $D=2$. In cold atomic gases imaged by quantum gas microscopy, our analysis supports the feasibility of measuring the third order density correlation, from which $\chi_F$ can be reliably extracted in systems with as few as around 100 atoms. For solid-state electron gases, we propose measuring correlations in the speckle pattern of intensity fluctuations in nonlinear X-ray scattering experiments.


title: Stylist: Style-Driven Feature Ranking for Robust Novelty Detection

abstract: Novelty detection aims at finding samples that differ in some form from the distribution of seen samples. But not all changes are created equal. Data can suffer a multitude of distribution shifts, and we might want to detect only some types of relevant changes. Similar to works in out-of-distribution generalization, we propose to use the formalization of separating into semantic or content changes, that are relevant to our task, and style changes, that are irrelevant. Within this formalization, we define the robust novelty detection as the task of finding semantic changes while being robust to style distributional shifts. Leveraging pretrained, large-scale model representations, we introduce Stylist, a novel method that focuses on dropping environment-biased features. First, we compute a per-feature score based on the feature distribution distances between environments. Next, we show that our selection manages to remove features responsible for spurious correlations and improve novelty detection performance. For evaluation, we adapt domain generalization datasets to our task and analyze the methods behaviors. We additionally built a large synthetic dataset where we have control over the spurious correlations degree. We prove that our selection mechanism improves novelty detection algorithms across multiple datasets, containing both stylistic and content shifts.


title: Aligning Text-to-Image Diffusion Models with Reward Backpropagation

abstract: Text-to-image diffusion models have recently emerged at the forefront of image generation, powered by very large-scale unsupervised or weakly supervised text-to-image training datasets. Due to their unsupervised training, controlling their behavior in downstream tasks, such as maximizing human-perceived image quality, image-text alignment, or ethical image generation, is difficult. Recent works finetune diffusion models to downstream reward functions using vanilla reinforcement learning, notorious for the high variance of the gradient estimators. In this paper, we propose AlignProp, a method that aligns diffusion models to downstream reward functions using end-to-end backpropagation of the reward gradient through the denoising process. While naive implementation of such backpropagation would require prohibitive memory resources for storing the partial derivatives of modern text-to-image models, AlignProp finetunes low-rank adapter weight modules and uses gradient checkpointing, to render its memory usage viable. We test AlignProp in finetuning diffusion models to various objectives, such as image-text semantic alignment, aesthetics, compressibility and controllability of the number of objects present, as well as their combinations. We show AlignProp achieves higher rewards in fewer training steps than alternatives, while being conceptually simpler, making it a straightforward choice for optimizing diffusion models for differentiable reward functions of interest. Code and Visualization results are available at https://align-prop.github.io/.


title: ContactGen: Generative Contact Modeling for Grasp Generation

abstract: This paper presents a novel object-centric contact representation ContactGen for hand-object interaction. The ContactGen comprises three components: a contact map indicates the contact location, a part map represents the contact hand part, and a direction map tells the contact direction within each part. Given an input object, we propose a conditional generative model to predict ContactGen and adopt model-based optimization to predict diverse and geometrically feasible grasps. Experimental results demonstrate our method can generate high-fidelity and diverse human grasps for various objects. Project page: https://stevenlsw.github.io/contactgen/


title: EFTofLSS meets simulation-based inference: $\sigma_8$ from biased tracers

abstract: Cosmological inferences typically rely on explicit expressions for the likelihood and covariance of the data vector, which normally consists of a set of summary statistics. However, in the case of nonlinear large-scale structure, exact expressions for either likelihood or covariance are unknown, and even approximate expressions can become very cumbersome, depending on the scales and summary statistics considered. Simulation-based inference (SBI), in contrast, does not require an explicit form for the likelihood but only a prior and a simulator, thereby naturally circumventing these issues. In this paper, we explore how this technique can be used to infer $\sigma_8$ from a Lagrangian effective field theory (EFT) based forward model for biased tracers. The power spectrum and bispectrum are used as summary statistics to obtain the posterior of the cosmological, bias and noise parameters via neural density estimation. We compare full simulation-based inference with cases where the data vector is drawn from a Gaussian likelihood with sample and analytical covariances. We conclude that, for $k_{\text{max}}=0.1h\text{Mpc}^{-1}$ and $0.2h\text{Mpc}^{-1}$, the form of the covariance is more important than the non-Gaussianity of the likelihood, although this conclusion is expected to depend on the cosmological parameter inferred, the summary statistics considered and range of scales probed.


title: A High-Performance Design, Implementation, Deployment, and Evaluation of The Slim Fly Network

abstract: Novel low-diameter network topologies such as Slim Fly (SF) offer significant cost and power advantages over the established Fat Tree, Clos, or Dragonfly. To spearhead the adoption of low-diameter networks, we design, implement, deploy, and evaluate the first real-world SF installation. We focus on deployment, management, and operational aspects of our test cluster with 200 servers and carefully analyze performance. We demonstrate techniques for simple cabling and cabling validation as well as a novel high-performance routing architecture for InfiniBand-based low-diameter topologies. Our real-world benchmarks show SF's strong performance for many modern workloads such as deep neural network training, graph analytics, or linear algebra kernels. SF outperforms non-blocking Fat Trees in scalability while offering comparable or better performance and lower cost for large network sizes. Our work can facilitate deploying SF while the associated (open-source) routing architecture is fully portable and applicable to accelerate any low-diameter interconnect.


title: The Un-Kidnappable Robot: Acoustic Localization of Sneaking People

abstract: How easy is it to sneak up on a robot? We examine whether we can detect people using only the incidental sounds they produce as they move, even when they try to be quiet. We collect a robotic dataset of high-quality 4-channel audio paired with 360 degree RGB data of people moving in different indoor settings. We train models that predict if there is a moving person nearby and their location using only audio. We implement our method on a robot, allowing it to track a single person moving quietly with only passive audio sensing. For demonstration videos, see our project page: https://sites.google.com/view/unkidnappable-robot


title: Improved Baselines with Visual Instruction Tuning

abstract: Large multimodal models (LMM) have recently shown encouraging progress with visual instruction tuning. In this note, we show that the fully-connected vision-language cross-modal connector in LLaVA is surprisingly powerful and data-efficient. With simple modifications to LLaVA, namely, using CLIP-ViT-L-336px with an MLP projection and adding academic-task-oriented VQA data with simple response formatting prompts, we establish stronger baselines that achieve state-of-the-art across 11 benchmarks. Our final 13B checkpoint uses merely 1.2M publicly available data, and finishes full training in ~1 day on a single 8-A100 node. We hope this can make state-of-the-art LMM research more accessible. Code and model will be publicly available.


title: Generative Hyperelasticity with Physics-Informed Probabilistic Diffusion Fields

abstract: Many natural materials exhibit highly complex, nonlinear, anisotropic, and heterogeneous mechanical properties. Recently, it has been demonstrated that data-driven strain energy functions possess the flexibility to capture the behavior of these complex materials with high accuracy while satisfying physics-based constraints. However, most of these approaches disregard the uncertainty in the estimates and the spatial heterogeneity of these materials. In this work, we leverage recent advances in generative models to address these issues. We use as building block neural ordinary equations (NODE) that -- by construction -- create polyconvex strain energy functions, a key property of realistic hyperelastic material models. We combine this approach with probabilistic diffusion models to generate new samples of strain energy functions. This technique allows us to sample a vector of Gaussian white noise and translate it to NODE parameters thereby representing plausible strain energy functions. We extend our approach to spatially correlated diffusion resulting in heterogeneous material properties for arbitrary geometries. We extensively test our method with synthetic and experimental data on biological tissues and run finite element simulations with various degrees of spatial heterogeneity. We believe this approach is a major step forward including uncertainty in predictive, data-driven models of hyperelasticity


title: Standalone gradient measurement of matrix norm for programmable unitary converters

abstract: Programmable unitary converters are powerful tools for realizing unitary transformations, advancing fields of computing and communication. The accuracy of these unitary transformations is crucial for maintaining high fidelity in such applications. However, various physical artifacts can impair the accuracy of the synthesized transformations. A commonly employed approach uses the system's gradient to restore accuracy. Matrix norm is used to define error between matrices, and minimization of this norm using the gradient restores the accuracy. Although this gradient can indeed be physically measured using external equipment, it leads to a rather complex optical system. In this study, we propose a standalone method for measuring matrix norm gradients, where `standalone' means that no additional optical equipment is needed. This method is based on the mathematical fact that the central difference, which is generally used for the approximation of differentiation, can yield exact differentiation for any unitary converters. Furthermore, we introduce a new matrix distance that is suitable for optimizing unitary converters which use intensity detectors at the output. This distance also yields the exact differentiation with the central difference. Numerical analysis demonstrates that our method exhibits orders of magnitude higher tolerance to measurement noise than prior similar approaches.


title: A Knowledge-Driven Cross-view Contrastive Learning for EEG Representation

abstract: Due to the abundant neurophysiological information in the electroencephalogram (EEG) signal, EEG signals integrated with deep learning methods have gained substantial traction across numerous real-world tasks. However, the development of supervised learning methods based on EEG signals has been hindered by the high cost and significant label discrepancies to manually label large-scale EEG datasets. Self-supervised frameworks are adopted in vision and language fields to solve this issue, but the lack of EEG-specific theoretical foundations hampers their applicability across various tasks. To solve these challenges, this paper proposes a knowledge-driven cross-view contrastive learning framework (KDC2), which integrates neurological theory to extract effective representations from EEG with limited labels. The KDC2 method creates scalp and neural views of EEG signals, simulating the internal and external representation of brain activity. Sequentially, inter-view and cross-view contrastive learning pipelines in combination with various augmentation methods are applied to capture neural features from different views. By modeling prior neural knowledge based on homologous neural information consistency theory, the proposed method extracts invariant and complementary neural knowledge to generate combined representations. Experimental results on different downstream tasks demonstrate that our method outperforms state-of-the-art methods, highlighting the superior generalization of neural knowledge-supported EEG representations across various brain tasks.


title: Phase Synchrony Component Self-Organization in Brain Computer Interface

abstract: Phase synchrony information plays a crucial role in analyzing functional brain connectivity and identifying brain activities. A widely adopted feature extraction pipeline, composed of preprocessing, selection of EEG acquisition channels, and phase locking value (PLV) calculation, has achieved success in motor imagery classification (MI). However, this pipeline is manual and reliant on expert knowledge, limiting its convenience and adaptability to different application scenarios. Moreover, most studies have employed mediocre data-independent spatial filters to suppress noise, impeding the exploration of more significant phase synchronization phenomena. To address the issues, we propose the concept of phase synchrony component self-organization, which enables the adaptive learning of data-dependent spatial filters for automating both the preprocessing and channel selection procedures. Based on this concept, the first deep learning end-to-end network is developed, which directly extracts phase synchrony-based features from raw EEG signals and perform classification. The network learns optimal filters during training, which are obtained when the network achieves peak classification results. Extensive experiments have demonstrated that our network outperforms state-of-the-art methods. Remarkably, through the learned optimal filters, significant phase synchronization phenomena can be observed. Specifically, by calculating the PLV between a pair of signals extracted from each sample using two of the learned spatial filters, we have obtained an average PLV exceeding 0.87 across all tongue MI samples. This high PLV indicates a groundbreaking discovery in the synchrony pattern of tongue MI.


title: SCVCNet: Sliding cross-vector convolution network for cross-task and inter-individual-set EEG-based cognitive workload recognition

abstract: This paper presents a generic approach for applying the cognitive workload recognizer by exploiting common electroencephalogram (EEG) patterns across different human-machine tasks and individual sets. We propose a neural network called SCVCNet, which eliminates task- and individual-set-related interferences in EEGs by analyzing finer-grained frequency structures in the power spectral densities. The SCVCNet utilizes a sliding cross-vector convolution (SCVC) operation, where paired input layers representing the theta and alpha power are employed. By extracting the weights from a kernel matrix's central row and column, we compute the weighted sum of the two vectors around a specified scalp location. Next, we introduce an inter-frequency-point feature integration module to fuse the SCVC feature maps. Finally, we combined the two modules with the output-channel pooling and classification layers to construct the model. To train the SCVCNet, we employ the regularized least-square method with ridge regression and the extreme learning machine theory. We validate its performance using three databases, each consisting of distinct tasks performed by independent participant groups. The average accuracy (0.6813 and 0.6229) and F1 score (0.6743 and 0.6076) achieved in two different validation paradigms show partially higher performance than the previous works. All features and algorithms are available on website:https://github.com/7ohnKeats/SCVCNet.


title: Health diagnosis and recuperation of aged Li-ion batteries with data analytics and equivalent circuit modeling

abstract: Battery health assessment and recuperation play a crucial role in the utilization of second-life Li-ion batteries. However, due to ambiguous aging mechanisms and lack of correlations between the recovery effects and operational states, it is challenging to accurately estimate battery health and devise a clear strategy for cell rejuvenation. This paper presents aging and reconditioning experiments of 62 commercial high-energy type lithium iron phosphate (LFP) cells, which supplement existing datasets of high-power LFP cells. The relatively large-scale data allow us to use machine learning models to predict cycle life and identify important indicators of recoverable capacity. Considering cell-to-cell inconsistencies, an average test error of $16.84\% \pm 1.87\%$ (mean absolute percentage error) for cycle life prediction is achieved by gradient boosting regressor given information from the first 80 cycles. In addition, it is found that some of the recoverable lost capacity is attributed to the lateral lithium non-uniformity within the electrodes. An equivalent circuit model is built and experimentally validated to demonstrate how such non-uniformity can be accumulated, and how it can give rise to recoverable capacity loss. SHapley Additive exPlanations (SHAP) analysis also reveals that battery operation history significantly affects the capacity recovery.

categories: eess.SP cond-mat.mtrl-sci cs.LG physics.app-ph


title: A Simple Illustration of Interleaved Learning using Kalman Filter for Linear Least Squares

abstract: Interleaved learning in machine learning algorithms is a biologically inspired training method with promising results. In this short note, we illustrate the interleaving mechanism via a simple statistical and optimization framework based on Kalman Filter for Linear Least Squares.


title: A Deep Learning Sequential Decoder for Transient High-Density Electromyography in Hand Gesture Recognition Using Subject-Embedded Transfer Learning

abstract: Hand gesture recognition (HGR) has gained significant attention due to the increasing use of AI-powered human-computer interfaces that can interpret the deep spatiotemporal dynamics of biosignals from the peripheral nervous system, such as surface electromyography (sEMG). These interfaces have a range of applications, including the control of extended reality, agile prosthetics, and exoskeletons. However, the natural variability of sEMG among individuals has led researchers to focus on subject-specific solutions. Deep learning methods, which often have complex structures, are particularly data-hungry and can be time-consuming to train, making them less practical for subject-specific applications. In this paper, we propose and develop a generalizable, sequential decoder of transient high-density sEMG (HD-sEMG) that achieves 73% average accuracy on 65 gestures for partially-observed subjects through subject-embedded transfer learning, leveraging pre-knowledge of HGR acquired during pre-training. The use of transient HD-sEMG before gesture stabilization allows us to predict gestures with the ultimate goal of counterbalancing system control delays. The results show that the proposed generalized models significantly outperform subject-specific approaches, especially when the training data is limited, and there is a significant number of gesture classes. By building on pre-knowledge and incorporating a multiplicative subject-embedded structure, our method comparatively achieves more than 13% average accuracy across partially observed subjects with minimal data availability. This work highlights the potential of HD-sEMG and demonstrates the benefits of modeling common patterns across users to reduce the need for large amounts of data for new users, enhancing practicality.


title: ECGNet: A generative adversarial network (GAN) approach to the synthesis of 12-lead ECG signals from single lead inputs

abstract: Electrocardiography (ECG) signal generation has been heavily explored using generative adversarial networks (GAN) because the implementation of 12-lead ECGs is not always feasible. The GAN models have achieved remarkable results in reproducing ECG signals but are only designed for multiple lead inputs and the features the GAN model preserves have not been identified-limiting the generated signals use in cardiovascular disease (CVD)-predictive models. This paper presents ECGNet which is a procedure that generates a complete set of 12-lead ECG signals from any single lead input using a GAN framework with a bidirectional long short-term memory (LSTM) generator and a convolutional neural network (CNN) discriminator. Cross and auto-correlation analysis performed on the generated signals identifies features conserved during the signal generation-i.e., features that can characterize the unique-nature of each signal and thus likely indicators of CVD. Finally, by using ECG signals annotated with the CVD-indicative features detailed by the correlation analysis as inputs for a CVD-onset-predictive CNN model, we overcome challenges preventing the prediction of multiple-CVD targets. Our models are experimented on 15s 12-lead ECG dataset recorded using MyoVista's wavECG. Functional outcome data for each patient is recorded and used in the CVD-predictive model. Our best GAN model achieves state-of-the-art accuracy with Frechet Distance (FD) scores of 4.73, 4.89, 5.18, 4.77, 4.71, and 5.55 on the V1-V6 pre-cordial leads respectively and shows strength in preserving the P-Q segments and R-peaks in the generated signals. To the best of our knowledge, ECGNet is the first to predict all of the remaining eleven leads from the input of any single lead.


title: EMGTFNet: Fuzzy Vision Transformer to decode Upperlimb sEMG signals for Hand Gestures Recognition

abstract: Myoelectric control is an area of electromyography of increasing interest nowadays, particularly in applications such as Hand Gesture Recognition (HGR) for bionic prostheses. Today's focus is on pattern recognition using Machine Learning and, more recently, Deep Learning methods. Despite achieving good results on sparse sEMG signals, the latter models typically require large datasets and training times. Furthermore, due to the nature of stochastic sEMG signals, traditional models fail to generalize samples for atypical or noisy values. In this paper, we propose the design of a Vision Transformer (ViT) based architecture with a Fuzzy Neural Block (FNB) called EMGTFNet to perform Hand Gesture Recognition from surface electromyography (sEMG) signals. The proposed EMGTFNet architecture can accurately classify a variety of hand gestures without any need for data augmentation techniques, transfer learning or a significant increase in the number of parameters in the network. The accuracy of the proposed model is tested using the publicly available NinaPro database consisting of 49 different hand gestures. Experiments yield an average test accuracy of 83.57\% \& 3.5\% using a 200 ms window size and only 56,793 trainable parameters. Our results outperform the ViT without FNB, thus demonstrating that including FNB improves its performance. Our proposal framework EMGTFNet reported the significant potential for its practical application for prosthetic control.


title: Physics Informed Neural Network Code for 2D Transient Problems (PINN-2DT) Compatible with Google Colab

abstract: We present an open-source Physics Informed Neural Network environment for simulations of transient phenomena on two-dimensional rectangular domains, with the following features: (1) it is compatible with Google Colab which allows automatic execution on cloud environment; (2) it supports two dimensional time-dependent PDEs; (3) it provides simple interface for definition of the residual loss, boundary condition and initial loss, together with their weights; (4) it support Neumann and Dirichlet boundary conditions; (5) it allows for customizing the number of layers and neurons per layer, as well as for arbitrary activation function; (6) the learning rate and number of epochs are available as parameters; (7) it automatically differentiates PINN with respect to spatial and temporal variables; (8) it provides routines for plotting the convergence (with running average), initial conditions learnt, 2D and 3D snapshots from the simulation and movies (9) it includes a library of problems: (a) non-stationary heat transfer; (b) wave equation modeling a tsunami; (c) atmospheric simulations including thermal inversion; (d) tumor growth simulations.


title: A Multi-channel EEG Data Analysis for Poor Neuro-prognostication in Comatose Patients with Self and Cross-channel Attention Mechanism

abstract: This work investigates the predictive potential of bipolar electroencephalogram (EEG) recordings towards efficient prediction of poor neurological outcomes. A retrospective design using a hybrid deep learning approach is utilized to optimize an objective function aiming for high specificity, i.e., true positive rate (TPR) with reduced false positives (< 0.05). A multi-channel EEG array of 18 bipolar channel pairs from a randomly selected 5-minute segment in an hour is kept. In order to determine the outcome prediction, a combination of a feature encoder with 1-D convolutional layers, learnable position encoding, a context network with attention mechanisms, and finally, a regressor and classifier blocks are used. The feature encoder extricates local temporal and spatial features, while the following position encoding and attention mechanisms attempt to capture global temporal dependencies. Results: The proposed framework by our team, OUS IVS, when validated on the challenge hidden validation data, exhibited a score of 0.57.


title: Enhancing Healthcare with EOG: A Novel Approach to Sleep Stage Classification

abstract: We introduce an innovative approach to automated sleep stage classification using EOG signals, addressing the discomfort and impracticality associated with EEG data acquisition. In addition, it is important to note that this approach is untapped in the field, highlighting its potential for novel insights and contributions. Our proposed SE-Resnet-Transformer model provides an accurate classification of five distinct sleep stages from raw EOG signal. Extensive validation on publically available databases (SleepEDF-20, SleepEDF-78, and SHHS) reveals noteworthy performance, with macro-F1 scores of 74.72, 70.63, and 69.26, respectively. Our model excels in identifying REM sleep, a crucial aspect of sleep disorder investigations. We also provide insight into the internal mechanisms of our model using techniques such as 1D-GradCAM and t-SNE plots. Our method improves the accessibility of sleep stage classification while decreasing the need for EEG modalities. This development will have promising implications for healthcare and the incorporation of wearable technology into sleep studies, thereby advancing the field's potential for enhanced diagnostics and patient comfort.


title: A Unified Framework for Uniform Signal Recovery in Nonlinear Generative Compressed Sensing

abstract: In generative compressed sensing (GCS), we want to recover a signal $\mathbf{x}^* \in \mathbb{R}^n$ from $m$ measurements ($m\ll n$) using a generative prior $\mathbf{x}^*\in G(\mathbb{B}_2^k(r))$, where $G$ is typically an $L$-Lipschitz continuous generative model and $\mathbb{B}_2^k(r)$ represents the radius-$r$ $\ell_2$-ball in $\mathbb{R}^k$. Under nonlinear measurements, most prior results are non-uniform, i.e., they hold with high probability for a fixed $\mathbf{x}^*$ rather than for all $\mathbf{x}^*$ simultaneously. In this paper, we build a unified framework to derive uniform recovery guarantees for nonlinear GCS where the observation model is nonlinear and possibly discontinuous or unknown. Our framework accommodates GCS with 1-bit/uniformly quantized observations and single index models as canonical examples. Specifically, using a single realization of the sensing ensemble and generalized Lasso, {\em all} $\mathbf{x}^*\in G(\mathbb{B}_2^k(r))$ can be recovered up to an $\ell_2$-error at most $\epsilon$ using roughly $\tilde{O}({k}/{\epsilon^2})$ samples, with omitted logarithmic factors typically being dominated by $\log L$. Notably, this almost coincides with existing non-uniform guarantees up to logarithmic factors, hence the uniformity costs very little. As part of our technical contributions, we introduce the Lipschitz approximation to handle discontinuous observation models. We also develop a concentration inequality that produces tighter bounds for product processes whose index sets have low metric entropy. Experimental results are presented to corroborate our theory.


title: A Novel Deep Learning Technique for Morphology Preserved Fetal ECG Extraction from Mother ECG using 1D-CycleGAN

abstract: Monitoring the electrical pulse of fetal heart through a non-invasive fetal electrocardiogram (fECG) can easily detect abnormalities in the developing heart to significantly reduce the infant mortality rate and post-natal complications. Due to the overlapping of maternal and fetal R-peaks, the low amplitude of the fECG, systematic and ambient noises, typical signal extraction methods, such as adaptive filters, independent component analysis, empirical mode decomposition, etc., are unable to produce satisfactory fECG. While some techniques can produce accurate QRS waves, they often ignore other important aspects of the ECG. Our approach, which is based on 1D CycleGAN, can reconstruct the fECG signal from the mECG signal while maintaining the morphology due to extensive preprocessing and appropriate framework. The performance of our solution was evaluated by combining two available datasets from Physionet, "Abdominal and Direct Fetal ECG Database" and "Fetal electrocardiograms, direct and abdominal with reference heartbeat annotations", where it achieved an average PCC and Spectral-Correlation score of 88.4% and 89.4%, respectively. It detects the fQRS of the signal with accuracy, precision, recall and F1 score of 92.6%, 97.6%, 94.8% and 96.4%, respectively. It can also accurately produce the estimation of fetal heart rate and R-R interval with an error of 0.25% and 0.27%, respectively. The main contribution of our work is that, unlike similar studies, it can retain the morphology of the ECG signal with high fidelity. The accuracy of our solution for fetal heart rate and R-R interval length is comparable to existing state-of-the-art techniques. This makes it a highly effective tool for early diagnosis of fetal heart diseases and regular health checkups of the fetus.


title: Investigating Deep Neural Network Architecture and Feature Extraction Designs for Sensor-based Human Activity Recognition

abstract: The extensive ubiquitous availability of sensors in smart devices and the Internet of Things (IoT) has opened up the possibilities for implementing sensor-based activity recognition. As opposed to traditional sensor time-series processing and hand-engineered feature extraction, in light of deep learning's proven effectiveness across various domains, numerous deep methods have been explored to tackle the challenges in activity recognition, outperforming the traditional signal processing and traditional machine learning approaches. In this work, by performing extensive experimental studies on two human activity recognition datasets, we investigate the performance of common deep learning and machine learning approaches as well as different training mechanisms (such as contrastive learning), and various feature representations extracted from the sensor time-series data and measure their effectiveness for the human activity recognition task.


title: Timeseries on IIoT Platforms: Requirements and Survey for Digital Twins in Process Industry

abstract: In the pursue for sustainability in process industry, digital twins necessitate the communication and storage of timeseries data about Industrial Internet of Things (IIoT). Regarding timeseries, this paper first presents a set of requirements specific to process industries. Then, it surveys how existing IIoT technologies meet the requirements. The technologies include the API specifications Asset Administration Shell (AAS), Digital Twin Definition Language (DTDL), NGSI-LD and Open Platform Communications Unified Architecture (OPC UA) as well as six commercial platforms. All the technologies leave significant gaps regarding the requirements, which means that tailor-made extensions are necessary.


title: Optimizing Multicarrier Multiantenna Systems for LoS Channel Charting

abstract: Channel charting (CC) consists in learning a mapping between the space of raw channel observations, made available from pilot-based channel estimation in multicarrier multiantenna system, and a low-dimensional space where close points correspond to channels of user equipments (UEs) close spatially. Among the different methods of learning this mapping, some rely on a distance measure between channel vectors. Such a distance should reliably reflect the local spatial neighborhoods of the UEs. The recently proposed phase-insensitive (PI) distance exhibits good properties in this regards, but suffers from ambiguities due to both its periodic and oscillatory aspects, making users far away from each other appear closer in some cases. In this paper, a thorough theoretical analysis of the said distance and its limitations is provided, giving insights on how they can be mitigated. Guidelines for designing systems capable of learning quality charts are consequently derived. Experimental validation is then conducted on synthetic and realistic data in different scenarios.


title: Contrast detection is enhanced by deterministic, high-frequency transcranial alternating current stimulation with triangle and sine waveform

abstract: Stochastic Resonance (SR) describes a phenomenon where an additive noise (stochastic carrier-wave) enhances the signal transmission in a nonlinear system. In the nervous system, nonlinear properties are present from the level of single ion channels all the way to perception and appear to support the emergence of SR. For example, SR has been repeatedly demonstrated for visual detection tasks, also by adding noise directly to cortical areas via transcranial random noise stimulation (tRNS). When dealing with nonlinear physical systems, it has been suggested that resonance can be induced not only by adding stochastic signals (i.e., noise) but also by adding a large class of signals that are not stochastic in nature which cause "deterministic amplitude resonance" (DAR). Here we mathematically show that high-frequency, deterministic, periodic signals can yield resonance-like effects with linear transfer and infinite signal-to-noise ratio at the output. We tested this prediction empirically and investigated whether non-random, high-frequency, transcranial alternating current stimulation applied to visual cortex could induce resonance-like effects and enhance performance of a visual detection task. We demonstrated in 28 participants that applying 80 Hz triangular-waves or sine-waves with tACS reduced visual contrast detection threshold for optimal brain stimulation intensities. The influence of tACS on contrast sensitivity was equally effective to tRNS-induced modulation, demonstrating that both tACS and tRNS can reduce contrast detection thresholds. Our findings suggest that a resonance-like mechanism can also emerge when deterministic electrical waveforms are applied via tACS.


title: Magnetic SAW RFID Sensor Based on Love Wave for Detection of Magnetic Field and Temperature

abstract: Magnetic field measurement including a temperature compensation is essential for a magnetic field sensor. This study investigates a magnetic surface acoustic wave (MSAW) sensor in a reflective delay line configuration with two acoustic propagation paths with and without magnetic field sensitive layer. The delay in path with sensitive layer leads to magnetic field detection and the one without enable temperature measurement and thus compensation for the first path. The developed sensor is based on a ZnO/LiNbO$_3$ Ycut (X-direction) layered structure as Love wave platform. Love wave as a shear wave being more favorable for magnetic detection. Co-Fe-B is considered as sensitive layer to detect magnetic field changes and is deposited on the top of ZnO, but only on one of the two paths. We combined an original configuration of connected IDTs with a high electromechanical coupling coefficient (K$^2$) mode to improve the signal amplitude. The achieved sensor exhibits a high temperature and magnetic field sensitivity of -63 ppm/$^\circ$C and -781 ppm/mT, respectively. The temperature compensation method for magnetic field measurement is demonstrated using a differential measurement by subtracting the delay times obtained for the two paths with and without the sensitive layer. Finally, The sensor exhibited good repeatability at various temperatures. Moreover, the device developed allows in addition to the multisensor functionality, the radio frequency identification (RFID) which is necessary for the deployment of sensor networks.


title: Wireless strain and temperature monitoring in reinforced concrete using Surface Acoustic Wave (SAW) sensors

abstract: Monitoring the health of civil engineering structures using implanted deformation, temperature and corrosion sensors would further improve maintenance and extend the service life of those structures. However, sensor integration poses a number of problems, due to the presence of cables and on-board electronics. Passive, wireless SAW sensors offer a very promising solution, here. We used commercial SAW devices mounted on steel rebars to carry out an initial feasibility study. Without cables or embedded electronics, we were able to measure the deformation of a concrete beam subjected to bending load. We were also able to measure the temperature continuously over a three-week period.


title: Literature Based Discovery (LBD): Towards Hypothesis Generation and Knowledge Discovery in Biomedical Text Mining

abstract: Biomedical knowledge is growing in an astounding pace with a majority of this knowledge is represented as scientific publications. Text mining tools and methods represents automatic approaches for extracting hidden patterns and trends from this semi structured and unstructured data. In Biomedical Text mining, Literature Based Discovery (LBD) is the process of automatically discovering novel associations between medical terms otherwise mentioned in disjoint literature sets. LBD approaches proven to be successfully reducing the discovery time of potential associations that are hidden in the vast amount of scientific literature. The process focuses on creating concept profiles for medical terms such as a disease or symptom and connecting it with a drug and treatment based on the statistical significance of the shared profiles. This knowledge discovery approach introduced in 1989 still remains as a core task in text mining. Currently the ABC principle based two approaches namely open discovery and closed discovery are mostly explored in LBD process. This review starts with general introduction about text mining followed by biomedical text mining and introduces various literature resources such as MEDLINE, UMLS, MESH, and SemMedDB. This is followed by brief introduction of the core ABC principle and its associated two approaches open discovery and closed discovery in LBD process. This review also discusses the deep learning applications in LBD by reviewing the role of transformer models and neural networks based LBD models and its future aspects. Finally, reviews the key biomedical discoveries generated through LBD approaches in biomedicine and conclude with the current limitations and future directions of LBD.


title: Deep Reinforcement Learning Algorithms for Hybrid V2X Communication: A Benchmarking Study

abstract: In today's era, autonomous vehicles demand a safety level on par with aircraft. Taking a cue from the aerospace industry, which relies on redundancy to achieve high reliability, the automotive sector can also leverage this concept by building redundancy in V2X (Vehicle-to-Everything) technologies. Given the current lack of reliable V2X technologies, this idea is particularly promising. By deploying multiple RATs (Radio Access Technologies) in parallel, the ongoing debate over the standard technology for future vehicles can be put to rest. However, coordinating multiple communication technologies is a complex task due to dynamic, time-varying channels and varying traffic conditions. This paper addresses the vertical handover problem in V2X using Deep Reinforcement Learning (DRL) algorithms. The goal is to assist vehicles in selecting the most appropriate V2X technology (DSRC/V-VLC) in a serpentine environment. The results show that the benchmarked algorithms outperform the current state-of-the-art approaches in terms of redundancy and usage rate of V-VLC headlights. This result is a significant reduction in communication costs while maintaining a high level of reliability. These results provide strong evidence for integrating advanced DRL decision mechanisms into the architecture as a promising approach to solving the vertical handover problem in V2X.


title: The Fallacy in the Paradox of Achilles and the Tortoise

abstract: Zeno's ancient paradox depicts a race between swift Achilles and a slow tortoise with a head start. Zeno argued that Achilles could never overtake the tortoise, as at each step Achilles arrived at the tortoise's former position, the tortoise had already moved ahead. Though Zeno's premise is valid, his conclusion that Achilles can "never" pass the tortoise relies on equating infinite steps with an infinite amount of time. By modeling the sequence of events in terms of a converging geometric series, this paper shows that such an infinite number of events sum up to a finite distance traversed in finite time. The paradox stems from confusion between an infinite number of events, which can happen in a finite time interval, and an infinite amount of time. The fallacy is clarified by recognizing that the infinite number of events can be crammed into a finite time interval. At a given speed difference after a finite amount of time, Achilles will have completed the infinite series of gaps at the "catch-up time" and passed the tortoise. Hence this paradox of Achilles and the tortoise can be resolved by simply adding "before the catch-up time" to the concluding statement of "Achilles would never overtake the tortoise".


title: What to expect from scalar-tensor space geodesy

abstract: Scalar-tensor theories with screening mechanisms come with non-linearities that make it difficult to study setups of complex geometry without resorting to numerical simulations. In this article, we use the $\textit{femtoscope}$ code that we introduced in a previous work in order to compute the fifth force arising in the chameleon model in the Earth orbit. We go beyond published works by introducing a departure from spherical symmetry $\unicode{x2014}$ embodied by a mountain on an otherwise spherical Earth $\unicode{x2014}$ as well as by implementing several atmospheric models, and quantify their combined effect on the chameleon field. Building on the numerical results thus obtained, we address the question of the detectability of a putative chameleon fifth force by means of space geodesy techniques and, for the first time, quantitatively assess the back-reaction created by the screening of a satellite itself. We find that although the fifth force has a supposedly measurable effect on the dynamics of an orbiting spacecraft, the imprecise knowledge of the mass distribution inside the Earth greatly curtails the constraining power of such space missions. Finally, we show how this degeneracy can be lifted when several measurements are performed at different altitudes.


title: Progressive reduced order modeling: empowering data-driven modeling with selective knowledge transfer

abstract: Data-driven modeling can suffer from a constant demand for data, leading to reduced accuracy and impractical for engineering applications due to the high cost and scarcity of information. To address this challenge, we propose a progressive reduced order modeling framework that minimizes data cravings and enhances data-driven modeling's practicality. Our approach selectively transfers knowledge from previously trained models through gates, similar to how humans selectively use valuable knowledge while ignoring unuseful information. By filtering relevant information from previous models, we can create a surrogate model with minimal turnaround time and a smaller training set that can still achieve high accuracy. We have tested our framework in several cases, including transport in porous media, gravity-driven flow, and finite deformation in hyperelastic materials. Our results illustrate that retaining information from previous models and utilizing a valuable portion of that knowledge can significantly improve the accuracy of the current model. We have demonstrated the importance of progressive knowledge transfer and its impact on model accuracy with reduced training samples. For instance, our framework with four parent models outperforms the no-parent counterpart trained on data nine times larger. Our research unlocks data-driven modeling's potential for practical engineering applications by mitigating the data scarcity issue. Our proposed framework is a significant step toward more efficient and cost-effective data-driven modeling, fostering advancements across various fields.


title: A Comprehensive Indoor Environment Dataset from Single-family Houses in the US

abstract: The paper describes a dataset comprising indoor environmental factors such as temperature, humidity, air quality, and noise levels. The data was collected from 10 sensing devices installed in various locations within three single-family houses in Virginia, USA. The objective of the data collection was to study the indoor environmental conditions of the houses over time. The data were collected at a frequency of one record per minute for a year, combining over 2.5 million records. The paper provides actual floor plans with sensor placements to aid researchers and practitioners in creating reliable building performance models. The techniques used to collect and verify the data are also explained in the paper. The resulting dataset can be employed to enhance models for building energy consumption, occupant behavior, predictive maintenance, and other relevant purposes.


title: Investigating Alternative Feature Extraction Pipelines For Clinical Note Phenotyping

abstract: A common practice in the medical industry is the use of clinical notes, which consist of detailed patient observations. However, electronic health record systems frequently do not contain these observations in a structured format, rendering patient information challenging to assess and evaluate automatically. Using computational systems for the extraction of medical attributes offers many applications, including longitudinal analysis of patients, risk assessment, and hospital evaluation. Recent work has constructed successful methods for phenotyping: extracting medical attributes from clinical notes. BERT-based models can be used to transform clinical notes into a series of representations, which are then condensed into a single document representation based on their CLS embeddings and passed into an LSTM (Mulyar et al., 2020). Though this pipeline yields a considerable performance improvement over previous results, it requires extensive convergence time. This method also does not allow for predicting attributes not yet identified in clinical notes. Considering the wide variety of medical attributes that may be present in a clinical note, we propose an alternative pipeline utilizing ScispaCy (Neumann et al., 2019) for the extraction of common diseases. We then train various supervised learning models to associate the presence of these conditions with patient attributes. Finally, we replicate a ClinicalBERT (Alsentzer et al., 2019) and LSTM-based approach for purposes of comparison. We find that alternative methods moderately underperform the replicated LSTM approach. Yet, considering a complex tradeoff between accuracy and runtime, in addition to the fact that the alternative approach also allows for the detection of medical conditions that are not already present in a clinical note, its usage may be considered as a supplement to established methods.


title: Functional data learning using convolutional neural networks

abstract: In this paper, we show how convolutional neural networks (CNN) can be used in regression and classification learning problems of noisy and non-noisy functional data. The main idea is to transform the functional data into a 28 by 28 image. We use a specific but typical architecture of a convolutional neural network to perform all the regression exercises of parameter estimation and functional form classification. First, we use some functional case studies of functional data with and without random noise to showcase the strength of the new method. In particular, we use it to estimate exponential growth and decay rates, the bandwidths of sine and cosine functions, and the magnitudes and widths of curve peaks. We also use it to classify the monotonicity and curvatures of functional data, algebraic versus exponential growth, and the number of peaks of functional data. Second, we apply the same convolutional neural networks to Lyapunov exponent estimation in noisy and non-noisy chaotic data, in estimating rates of disease transmission from epidemic curves, and in detecting the similarity of drug dissolution profiles. Finally, we apply the method to real-life data to detect Parkinson's disease patients in a classification problem. The method, although simple, shows high accuracy and is promising for future use in engineering and medical applications.


title: Differential Game Strategies for Social Networks with Self-Interested Individuals

abstract: A social network population engages in collective actions as a direct result of forming a particular opinion. The strategic interactions among the individuals acting independently and selfishly naturally portray a noncooperative game. Nash equilibrium allows for self-enforcing strategic interactions between selfish and self-interested individuals. This paper presents a differential game approach to the opinion formation problem in social networks to investigate the evolution of opinions as a result of a Nash equilibrium. The opinion of each individual is described by a differential equation, which is the continuous-time Hegselmann-Krause model for opinion dynamics with a time delay in input. The objective of each individual is to seek optimal strategies for her own opinion evolution by minimizing an individual cost function. Two differential game problems emerge, one for a population that is not stubborn and another for a population that is stubborn. The open-loop Nash equilibrium actions and their associated opinion trajectories are derived for both differential games using Pontryagin's principle. Additionally, the receding horizon control scheme is used to practice feedback strategies where the information flow is restricted by fixed and complete social graphs as well as the second neighborhood concept. The game strategies were executed on the well-known Zachary's Karate Club social network. The resulting opinion trajectories associated with the game strategies showed consensus, polarization, and disagreement in final opinions.


title: Hidden Markov Models for Stock Market Prediction

abstract: The stock market presents a challenging environment for accurately predicting future stock prices due to its intricate and ever-changing nature. However, the utilization of advanced methodologies can significantly enhance the precision of stock price predictions. One such method is Hidden Markov Models (HMMs). HMMs are statistical models that can be used to model the behavior of a partially observable system, making them suitable for modeling stock prices based on historical data. Accurate stock price predictions can help traders make better investment decisions, leading to increased profits. In this article, we trained and tested a Hidden Markov Model for the purpose of predicting a stock closing price based on its opening price and the preceding day's prices. The model's performance has been evaluated using two indicators: Mean Average Prediction Error (MAPE), which specifies the average accuracy of our model, and Directional Prediction Accuracy (DPA), a newly introduced indicator that accounts for the number of fractional change predictions that are correct in sign.


title: Significance of the negative binomial distribution in multiplicity phenomena

abstract: The negative binomial distribution (NBD) has been theorized to express a scale-invariant property of many-body systems and has been consistently shown to outperform other statistical models in both describing the multiplicity of quantum-scale events in particle collision experiments and predicting the prevalence of cosmological observables, such as the number of galaxies in a region of space. Despite its widespread applicability and empirical success in these contexts, a theoretical justification for the NBD from first principles has remained elusive for fifty years. The accuracy of the NBD in modeling hadronic, leptonic, and semileptonic processes is suggestive of a highly general principle, which is yet to be understood. This study demonstrates that a statistical event of the NBD can in fact be derived in a general context via the dynamical equations of a canonical ensemble of particles in Minkowski space. These results describe a fundamental feature of many-body systems that is consistent with data from the ALICE and ATLAS experiments and provides an explanation for the emergence of the NBD in these multiplicity observations. Two methods are used to derive this correspondence: the Feynman path integral and a hypersurface parametrization of a propagating ensemble.


title: PrIeD-KIE: Towards Privacy Preserved Document Key Information Extraction

abstract: In this paper, we introduce strategies for developing private Key Information Extraction (KIE) systems by leveraging large pretrained document foundation models in conjunction with differential privacy (DP), federated learning (FL), and Differentially Private Federated Learning (DP-FL). Through extensive experimentation on six benchmark datasets (FUNSD, CORD, SROIE, WildReceipts, XFUND, and DOCILE), we demonstrate that large document foundation models can be effectively fine-tuned for the KIE task under private settings to achieve adequate performance while maintaining strong privacy guarantees. Moreover, by thoroughly analyzing the impact of various training and model parameters on model performance, we propose simple yet effective guidelines for achieving an optimal privacy-utility trade-off for the KIE task under global DP. Finally, we introduce FeAm-DP, a novel DP-FL algorithm that enables efficiently upscaling global DP from a standalone context to a multi-client federated environment. We conduct a comprehensive evaluation of the algorithm across various client and privacy settings, and demonstrate its capability to achieve comparable performance and privacy guarantees to standalone DP, even when accommodating an increasing number of participating clients. Overall, our study offers valuable insights into the development of private KIE systems, and highlights the potential of document foundation models for privacy-preserved Document AI applications. To the best of authors' knowledge, this is the first work that explores privacy preserved document KIE using document foundation models.


title: Lightweight Boosting Models for User Response Prediction Using Adversarial Validation

abstract: The ACM RecSys Challenge 2023, organized by ShareChat, aims to predict the probability of the app being installed. This paper describes the lightweight solution to this challenge. We formulate the task as a user response prediction task. For rapid prototyping for the task, we propose a lightweight solution including the following steps: 1) using adversarial validation, we effectively eliminate uninformative features from a dataset; 2) to address noisy continuous features and categorical features with a large number of unique values, we employ feature engineering techniques.; 3) we leverage Gradient Boosted Decision Trees (GBDT) for their exceptional performance and scalability. The experiments show that a single LightGBM model, without additional ensembling, performs quite well. Our team achieved ninth place in the challenge with the final leaderboard score of 6.059065. Code for our approach can be found here: https://github.com/choco9966/recsys-challenge-2023.


title: HandMeThat: Human-Robot Communication in Physical and Social Environments

abstract: We introduce HandMeThat, a benchmark for a holistic evaluation of instruction understanding and following in physical and social environments. While previous datasets primarily focused on language grounding and planning, HandMeThat considers the resolution of human instructions with ambiguities based on the physical (object states and relations) and social (human actions and goals) information. HandMeThat contains 10,000 episodes of human-robot interactions. In each episode, the robot first observes a trajectory of human actions towards her internal goal. Next, the robot receives a human instruction and should take actions to accomplish the subgoal set through the instruction. In this paper, we present a textual interface for our benchmark, where the robot interacts with a virtual environment through textual commands. We evaluate several baseline models on HandMeThat, and show that both offline and online reinforcement learning algorithms perform poorly on HandMeThat, suggesting significant room for future work on physical and social human-robot communications and interactions.


title: Automating Human Tutor-Style Programming Feedback: Leveraging GPT-4 Tutor Model for Hint Generation and GPT-3.5 Student Model for Hint Validation

abstract: Generative AI and large language models hold great promise in enhancing programming education by automatically generating individualized feedback for students. We investigate the role of generative AI models in providing human tutor-style programming hints to help students resolve errors in their buggy programs. Recent works have benchmarked state-of-the-art models for various feedback generation scenarios; however, their overall quality is still inferior to human tutors and not yet ready for real-world deployment. In this paper, we seek to push the limits of generative AI models toward providing high-quality programming hints and develop a novel technique, GPT4Hints-GPT3.5Val. As a first step, our technique leverages GPT-4 as a ``tutor'' model to generate hints -- it boosts the generative quality by using symbolic information of failing test cases and fixes in prompts. As a next step, our technique leverages GPT-3.5, a weaker model, as a ``student'' model to further validate the hint quality -- it performs an automatic quality validation by simulating the potential utility of providing this feedback. We show the efficacy of our technique via extensive evaluation using three real-world datasets of Python programs covering a variety of concepts ranging from basic algorithms to regular expressions and data analysis using pandas library.


title: Intervalley coherence and intrinsic spin-orbit coupling in rhombohedral trilayer graphene

abstract: Rhombohedral graphene multilayers provide a clean and highly reproducible platform to explore the emergence of superconductivity and magnetism in a strongly interacting electron system. Here, we use electronic compressibility and local magnetometry to explore the phase diagram of this material class in unprecedented detail. We focus on rhombohedral trilayer in the quarter metal regime, where the electronic ground state is characterized by the occupation of a single spin and valley isospin flavor. Our measurements reveal a subtle competition between valley imbalanced (VI) orbital ferromagnets and intervalley coherent (IVC) states in which electron wave functions in the two momentum space valleys develop a macroscopically coherent relative phase. Contrasting the in-plane spin susceptibility of the IVC and VI phases reveals the influence of graphene's intrinsic spin-orbit coupling, which drives the emergence of a distinct correlated phase with hybrid VI and IVC character. Spin-orbit also suppresses the in-plane magnetic susceptibility of the VI phase, which allows us to extract the spin-orbit coupling strength of $\lambda \approx 50\mu$eV for our hexagonal boron nitride-encapsulated graphene system. We discuss the implications of finite spin-orbit coupling on the spin-triplet superconductors observed in both rhombohedral and twisted graphene multilayers.


title: The first systematically identified repeating partial tidal disruption event

abstract: Tidal disruption events (TDEs) occur when a star enters the tidal radius of a supermassive black hole (SMBH). If the star only grazes the tidal radius, a fraction of the stellar mass will be accreted in a partial TDE (pTDE). The remainder can continue orbiting and may re-disrupted at pericenter, causing a repeating pTDE. pTDEs may be as or more common than full TDEs (fTDEs), yet few are known. In this work, we present the discovery of the first repeating pTDE from a systematically-selected sample, AT\,2020vdq. AT\,2020vdq was originally identified as an optically- and radio-flaring TDE. Around $3$ years after its discovery, it rebrightened dramatically and rapidly in the optical. The optical flare was remarkably fast and luminous compared to previous TDEs. It was accompanied by extremely broad (${\sim}0.1c$) optical/UV spectral features and faint X-ray emission ($L_X \sim 3\times10^{41}$\,erg\,s$^{-1}$), but no new radio-emitting component. Based on the transient optical/UV spectral features and the broadband light curve, we show that AT\,2020vdq is a repeating pTDE. We then use it to constrain TDE models; in particular, we favor a star originally in a very tight binary system that is tidally broken apart by the Hills mechanism. We also constrain the repeating pTDE rate to be $10^{-6}$ to $10^{-5}$ yr$^{-1}$ galaxy$^{-1}$, with uncertainties dominated by the unknown distribution of pTDE repeat timescales. In the Hills framework, this means the binary fraction in the galactic nucleus is of the order few percent.


title: The THESAN project: connecting ionized bubble sizes to their local environments during the Epoch of Reionization

abstract: An important characteristic of cosmic hydrogen reionization is the growth of ionized gas bubbles surrounding early luminous objects. Ionized bubble sizes are beginning to be probed using Lyman-$\alpha$ emission from high-redshift galaxies, and will also be probed by upcoming 21-cm maps. We present results from a study of bubble sizes using the state-of-the-art THESAN radiation-hydrodynamics simulation suite, which self-consistently models radiation transport and realistic galaxy formation. We employ the mean-free path method, and track the evolution of the effective ionized bubble size at each point ($R_{\rm eff}$) throughout the Epoch of Reionization. We show there is a slow growth period for regions ionized early, but a rapid "flash ionization" process for regions ionized later as they immediately enter a large, pre-existing bubble. We also find that bright sources are preferentially in larger bubbles, and find consistency with recent observational constraints at $z \gtrsim 9$, but tension with idealized Lyman-$\alpha$ damping-wing models at $z \approx 7$. We find that high overdensity regions have larger characteristic bubble sizes, but the correlation decreases as reionization progresses, likely due to runaway formation of large percolated bubbles. Finally, we compare the redshift at which a region transitions from neutral to ionized ($z_{\rm reion}$) with the time it takes to reach a given bubble size and conclude that $z_{\rm reion}$ is a reasonable local probe of small-scale bubble size statistics ($R_\text{eff} \lesssim 1\,\rm{cMpc}$). However, for larger bubbles, the correspondence between $z_{\rm reion}$ and size statistics weakens due to the time delay between the onset of reionization and the expansion of large bubbles, particularly at high redshifts.


title: Gapped Phases with Non-Invertible Symmetries: (1+1)d

abstract: We propose a general framework to characterize gapped infra-red (IR) phases of theories with non-invertible (or categorical) symmetries. In this paper we focus on (1+1)d gapped phases with fusion category symmetries. The approach that we propose uses the Symmetry Topological Field Theory (SymTFT) as a key input: associated to a field theory in d spacetime dimensions, the SymTFT lives in one dimension higher and admits a gapped boundary, which realizes the categorical symmetries. It also admits a second, physical, boundary, which is generically not gapped. Upon interval compactification of the SymTFT by colliding the gapped and physical boundaries, we regain the original theory. In this paper, we realize gapped symmetric phases by choosing the physical boundary to be a gapped boundary condition as well. This set-up provides computational power to determine the number of vacua, the symmetry breaking pattern, and the action of the symmetry on the vacua. The SymTFT also manifestly encodes the order parameters for these gapped phases, thus providing a generalized, categorical Landau paradigm for (1+1)d gapped phases. We find that for non-invertible symmetries the order parameters involve multiplets containing both untwisted and twisted sector local operators, and hence can be interpreted as mixtures of conventional and string order parameters. We also observe that spontaneous breaking of non-invertible symmetries can lead to vacua that are physically distinguishable: unlike the standard symmetries described by groups, non-invertible symmetries can have different actions on different vacua of an irreducible gapped phase. This leads to the presence of relative Euler terms between physically distinct vacua. We also provide a mathematical description of symmetric gapped phases as 2-functors from delooping of fusion category characterizing the symmetry to Euler completion of 2-vector spaces.


title: Electromagnetic fields in compact binaries: post-Newtonian wave generation and application to double white dwarfs systems

abstract: The aim of this work is twofold: (i) to properly define a wave-generation formalism for compact-supported sources embedded in Einstein-Maxwell theory, relying on matched post-Newtonian and multipolar-post-Minkowskian expansions; (ii) to apply this formalism (which is valid for any type of post-Newtonian sources) to the case of two stars with constant and aligned magnetic dipoles, by computing the fluxes of energy and angular momentum to the next-to-leading order, as well as the gravitational amplitude modes. Assuming eccentric orbits, we derive the evolution of orbital parameters, as well as the observables of the system, notably the gravitational phase for quasi-circular orbits. Finally, we give some numerical estimates for the contribution of the magnetic dipoles for some realistic systems.


title: Categorical Landau Paradigm for Gapped Phases

abstract: We propose a unified framework to classify gapped infra-red (IR) phases with categorical symmetries, leading to a generalized, categorical Landau paradigm. This is applicable in any dimension and gives a succinct, comprehensive, and computationally powerful approach to classifying gapped symmetric phases. The key tool is the symmetry topological field theory (SymTFT), which is a one dimension higher TFT with two boundaries, which we choose both to be topological. We illustrate the general idea for (1+1)d gapped phases with categorical symmetries and suggest higher-dimensional extensions.