title: OpenIllumination: A Multi-Illumination Dataset for Inverse Rendering Evaluation on Real Objects

abstract: We introduce OpenIllumination, a real-world dataset containing over 108K images of 64 objects with diverse materials, captured under 72 camera views and a large number of different illuminations. For each image in the dataset, we provide accurate camera parameters, illumination ground truth, and foreground segmentation masks. Our dataset enables the quantitative evaluation of most inverse rendering and material decomposition methods for real objects. We examine several state-of-the-art inverse rendering methods on our dataset and compare their performances. The dataset and code can be found on the project page: https://oppo-us-research.github.io/OpenIllumination.


title: Planetary Scale Information Transmission in the Biosphere and Technosphere: Limits and Evolution

abstract: Information transmission via communication between agents is ubiquitous on Earth, and is a vital facet of living systems. In this paper, we aim to quantify this rate of information transmission associated with Earth's biosphere and technosphere (i.e., a measure of global information flow) by means of a heuristic order-of-magnitude model. By adopting ostensibly conservative values for the salient parameters, we estimate that the global information transmission rate for the biosphere might be $\sim 10^{24}$ bits/s, and that it may perhaps exceed the corresponding rate for the current technosphere by $\sim 9$ orders of magnitude. However, under the equivocal assumption of sustained exponential growth, we find that information transmission in the technosphere can potentially surpass that of the biosphere $\sim 90$ years in the future, reflecting its increasing dominance.

categories: physics.soc-ph astro-ph.EP physics.bio-ph q-bio.MN q-bio.PE


title: An Automated and Efficient Aerodynamic Design and Analysis Framework Integrated to PANAIR

abstract: Aircraft design is an iterative process that requires an estimation of aerodynamic characteristics including drag and lift coefficients, stall behavior, velocity, and pressure profiles repeatedly, especially in the conceptual design phase. PanAir is a high-order aerodynamic panel method-based algorithm developed as a part of the Public Domain Aeronautical Software program mostly with NASA sponsorship. It is based upon potential flow theory and is used to numerically compute lift, induced drag, and moment coefficients of the aircraft in both subsonic and supersonic flight regimes. Quoting from developers it is the most versatile and accurate of all the linear theory panel codes. PanAir is a classical software that requires geometric data as an input in the form of a PanAir-compatible format; however, commonly used Computer-Aided Design Software packages no longer conform to the PanAir input format. Likewise, PanAir produces its output in a PanAir-specific output file which is not compatible with commonly used visualization software. The input geometry required by PanAir and its output, therefore, involves significant manual preand post-processing using intermediary software. The work proposed here is an automated pre and post-processor to be used together with PanAir. With the environment proposed in this work, manipulation of input and output data using several intermediary software to and from PanAir is bypassed successfully. The proposed environment is validated over a Cessna 210 aircraft geometry with a modified NLF (1)-0414 airfoil. The aircraft is numerically analyzed using PanAir together


title: Solving the Problem of Induction

abstract: This article solves the Hume's problem of induction using a probabilistic approach. From the probabilistic perspective, the core task of induction is to estimate the probability of an event and judge the accuracy of the estimation. Following this principle, the article provides a method for calculating the confidence on a given confidence interval, and furthermore, degree of confirmation. The law of large numbers shows that as the number of experiments tends to infinity, for any small confidence interval, the confidence approaches 100\% in a probabilistic sense, thus the Hume's problem of induction is solved. The foundation of this method is the existence of probability, or in other words, the identity of physical laws. The article points out that it cannot be guaranteed that all things possess identity, but humans only concern themselves with things that possess identity, and identity is built on the foundation of pragmatism. After solving the Hum's problem, a novel demarcation of science are proposed, providing science with the legitimacy of being referred to as truth.


title: Hierarchical Audio-Visual Information Fusion with Multi-label Joint Decoding for MER 2023

abstract: In this paper, we propose a novel framework for recognizing both discrete and dimensional emotions. In our framework, deep features extracted from foundation models are used as robust acoustic and visual representations of raw video. Three different structures based on attention-guided feature gathering (AFG) are designed for deep feature fusion. Then, we introduce a joint decoding structure for emotion classification and valence regression in the decoding stage. A multi-task loss based on uncertainty is also designed to optimize the whole process. Finally, by combining three different structures on the posterior probability level, we obtain the final predictions of discrete and dimensional emotions. When tested on the dataset of multimodal emotion recognition challenge (MER 2023), the proposed framework yields consistent improvements in both emotion classification and valence regression. Our final system achieves state-of-the-art performance and ranks third on the leaderboard on MER-MULTI sub-challenge.


title: COMPASS: High-Efficiency Deep Image Compression with Arbitrary-scale Spatial Scalability

abstract: Recently, neural network (NN)-based image compression studies have actively been made and has shown impressive performance in comparison to traditional methods. However, most of the works have focused on non-scalable image compression (single-layer coding) while spatially scalable image compression has drawn less attention although it has many applications. In this paper, we propose a novel NN-based spatially scalable image compression method, called COMPASS, which supports arbitrary-scale spatial scalability. Our proposed COMPASS has a very flexible structure where the number of layers and their respective scale factors can be arbitrarily determined during inference. To reduce the spatial redundancy between adjacent layers for arbitrary scale factors, our COMPASS adopts an inter-layer arbitrary scale prediction method, called LIFF, based on implicit neural representation. We propose a combined RD loss function to effectively train multiple layers. Experimental results show that our COMPASS achieves BD-rate gain of -58.33% and -47.17% at maximum compared to SHVC and the state-of-the-art NN-based spatially scalable image compression method, respectively, for various combinations of scale factors. Our COMPASS also shows comparable or even better coding efficiency than the single-layer coding for various scale factors.


title: Kid-Whisper: Towards Bridging the Performance Gap in Automatic Speech Recognition for Children VS. Adults

abstract: Recent advancements in Automatic Speech Recognition (ASR) systems, exemplified by Whisper, have demonstrated the potential of these systems to approach human-level performance given sufficient data. However, this progress doesn't readily extend to ASR for children due to the limited availability of suitable child-specific databases and the distinct characteristics of children's speech. A recent study investigated leveraging the My Science Tutor (MyST) children's speech corpus to enhance Whisper's performance in recognizing children's speech. They were able to demonstrate some improvement on a limited testset. This paper builds on these findings by enhancing the utility of the MyST dataset through more efficient data preprocessing. We reduce the Word Error Rate (WER) on the MyST testset 13.93% to 9.11% with Whisper-Small and from 13.23% to 8.61% with Whisper-Medium and show that this improvement can be generalized to unseen datasets. We also highlight important challenges towards improving children's ASR performance. The results showcase the viable and efficient integration of Whisper for effective children's speech recognition.


title: Deciphering the Enigma of Cu-Doped Lead Apatite (LK-99): Structural Insights, Electronic Properties, and Implications for Ambient-Pressure Superconductivity

abstract: The most recent discovery, the Cu-doped lead apatite LK-99, is a proposed room-temperature superconductor operating under ambient pressure. However, this discovery has brought a slew of conflicting results from different scientific groups. While some observed the absence of electrical resistance, others could not confirm any signs of superconductivity in LK-99. Here, we investigate the structural and electronic properties of LK-99 and its antecedent compounds through quantum mechanics (QM) and QM-based molecular dynamics (QM-MD) simulations. Our study elucidates the insulating nature of base compounds, Pb$_{10}$(PO$_4$)$_6$O and Pb$_{10}$(PO$_4$)$_6$(OH)$_2$, spotlighting their large band gaps. Notably, Cu doping in LK-99 disrupts its symmetry, yielding a distorted ground-state crystal structure with a triclinic P1 symmetry and CuO$_4$ square coordination. Such alterations predispose LK-99 to exhibit semiconducting behaviors, characterized by a flat band above the Fermi energy, arising from Cu-3d and O-2p orbitals. In addition, the S doping sustains the triclinic P1 symmetry but leads to a significantly reduced band gap, with a band emerging primarily from Cu-3d and S-3p orbitals. These findings are important in understanding LK-99's structural and electronic properties and provide a strategic compass for the development of high-T$_C$ superconductors.


title: Prompting Segmentation with Sound Is Generalizable Audio-Visual Source Localizer

abstract: Never having seen an object and heard its sound simultaneously, can the model still accurately localize its visual position from the input audio? In this work, we concentrate on the Audio-Visual Localization and Segmentation tasks but under the demanding zero-shot and few-shot scenarios. To achieve this goal, different from existing approaches that mostly employ the encoder-fusion-decoder paradigm to decode localization information from the fused audio-visual feature, we introduce the encoder-prompt-decoder paradigm, aiming to better fit the data scarcity and varying data distribution dilemmas with the help of abundant knowledge from pre-trained models. Specifically, we first propose to construct Semantic-aware Audio Prompt (SAP) to help the visual foundation model focus on sounding objects, meanwhile, the semantic gap between the visual and audio modalities is also encouraged to shrink. Then, we develop a Correlation Adapter (ColA) to keep minimal training efforts as well as maintain adequate knowledge of the visual foundation model. By equipping with these means, extensive experiments demonstrate that this new paradigm outperforms other fusion-based methods in both the unseen class and cross-dataset settings. We hope that our work can further promote the generalization study of Audio-Visual Localization and Segmentation in practical application scenarios.


title: Generative AI

abstract: The term "generative AI" refers to computational techniques that are capable of generating seemingly new, meaningful content such as text, images, or audio from training data. The widespread diffusion of this technology with examples such as Dall-E 2, GPT-4, and Copilot is currently revolutionizing the way we work and communicate with each other. In this article, we provide a conceptualization of generative AI as an entity in socio-technical systems and provide examples of models, systems, and applications. Based on that, we introduce limitations of current generative AI and provide an agenda for Business & Information Systems Engineering (BISE) research. Different from previous works, we focus on generative AI in the context of information systems, and, to this end, we discuss several opportunities and challenges that are unique to the BISE community and make suggestions for impactful directions for BISE research.


title: Comments on "A clarification on prevailing misconceptions in unimodular gravity"

abstract: In this comment on arXiv:2308.07360 it is pointed out that though the authors raise an important question on the prevailing presentations of the unimodular gravity their own presentation is incomplete as well as confusing equating assumptions to misconceptions. We focus on the notion of diffeomorphism invariance, general covariance and the conservation/nonconservation of the energy-momentum tensor in this short note to delineate the fundamental issues in unimodular gravity. The present discussion is intended to offer a wider and deeper perspective on the objective set by the authors in their paper.


title: Flat origami is Turing Complete

abstract: Flat origami refers to the folding of flat, zero-curvature paper such that the finished object lies in a plane. Mathematically, flat origami consists of a continuous, piecewise isometric map $f:P\subseteq\mathbb{R}^2\to\mathbb{R}^2$ along with a layer ordering $\lambda_f:P\times P\to \{-1,1\}$ that tracks which points of $P$ are above/below others when folded. The set of crease lines that a flat origami makes (i.e., the set on which the mapping $f$ is non-differentiable) is called its \textit{crease pattern}. Flat origami mappings and their layer orderings can possess surprisingly intricate structure. For instance, determining whether or not a given straight-line planar graph drawn on $P$ is the crease pattern for some flat origami has been shown to be an NP-complete problem, and this result from 1996 led to numerous explorations in computational aspects of flat origami. In this paper we prove that flat origami, when viewed as a computational device, is Turing complete. We do this by showing that flat origami crease patterns with \textit{optional creases} (creases that might be folded or remain unfolded depending on constraints imposed by other creases or inputs) can be constructed to simulate Rule 110, a one-dimensional cellular automaton that was proven to be Turing complete by Matthew Cook in 2004.


title: A Lean-Congruence Format for EP-Bisimilarity

abstract: Enabling preserving bisimilarity is a refinement of strong bisimilarity that preserves safety as well as liveness properties. To define it properly, labelled transition systems needed to be upgraded with a successor relation, capturing concurrency between transitions enabled in the same state. We enrich the well-known De Simone format to handle inductive definitions of this successor relation. We then establish that ep-bisimilarity is a congruence for the operators, as well as lean congruence for recursion, for all (enriched) De Simone languages.


title: Racing Control Variable Genetic Programming for Symbolic Regression

abstract: Symbolic regression, as one of the most crucial tasks in AI for science, discovers governing equations from experimental data. Popular approaches based on genetic programming, Monte Carlo tree search, or deep reinforcement learning learn symbolic regression from a fixed dataset. They require massive datasets and long training time especially when learning complex equations involving many variables. Recently, Control Variable Genetic Programming (CVGP) has been introduced which accelerates the regression process by discovering equations from designed control variable experiments. However, the set of experiments is fixed a-priori in CVGP and we observe that sub-optimal selection of experiment schedules delay the discovery process significantly. To overcome this limitation, we propose Racing Control Variable Genetic Programming (Racing-CVGP), which carries out multiple experiment schedules simultaneously. A selection scheme similar to that used in selecting good symbolic equations in the genetic programming process is implemented to ensure that promising experiment schedules eventually win over the average ones. The unfavorable schedules are terminated early to save time for the promising ones. We evaluate Racing-CVGP on several synthetic and real-world datasets corresponding to true physics laws. We demonstrate that Racing-CVGP outperforms CVGP and a series of symbolic regressors which discover equations from fixed datasets.


title: Deterministic Creation of Strained Color Centers in Nanostructures via High-Stress Thin Films

abstract: Color centers have emerged as a leading qubit candidate for realizing hybrid spin-photon quantum information technology. One major limitation of the platform, however, is that the characteristics of individual color-centers are often strain dependent. As an illustrative case, the silicon-vacancy center in diamond typically requires millikelvin temperatures in order to achieve long coherence properties, but strained silicon vacancy centers have been shown to operate at temperatures beyond 1K without phonon-mediated decoherence. In this work we combine high-stress silicon nitride thin films with diamond nanostructures in order to reproducibly create statically strained silicon-vacancy color centers (mean ground state splitting of 608 GHz) with strain magnitudes of $\sim 4 \times 10^{-4}$. Based on modeling, this strain should be sufficient to allow for operation of a majority silicon-vacancy centers within the measured sample at elevated temperatures (1.5K) without any degradation of their spin properties. This method offers a scalable approach to fabricate high-temperature operation quantum memories. Beyond silicon-vacancy centers, this method is sufficiently general that it can be easily extended to other platforms as well.


title: Landscape-Sketch-Step: An AI/ML-Based Metaheuristic for Surrogate Optimization Problems

abstract: In this paper, we introduce a new heuristics for global optimization in scenarios where extensive evaluations of the cost function are expensive, inaccessible, or even prohibitive. The method, which we call Landscape-Sketch-and-Step (LSS), combines Machine Learning, Stochastic Optimization, and Reinforcement Learning techniques, relying on historical information from previously sampled points to make judicious choices of parameter values where the cost function should be evaluated at. Unlike optimization by Replica Exchange Monte Carlo methods, the number of evaluations of the cost function required in this approach is comparable to that used by Simulated Annealing, quality that is especially important in contexts like high-throughput computing or high-performance computing tasks, where evaluations are either computationally expensive or take a long time to be performed. The method also differs from standard Surrogate Optimization techniques, for it does not construct a surrogate model that aims at approximating or reconstructing the objective function. We illustrate our method by applying it to low dimensional optimization problems (dimensions 1, 2, 4, and 8) that mimick known difficulties of minimization on rugged energy landscapes often seen in Condensed Matter Physics, where cost functions are rugged and plagued with local minima. When compared to classical Simulated Annealing, the LSS shows an effective acceleration of the optimization process.

categories: cs.LG cond-mat.mtrl-sci cs.AI math.OC math.PR


title: Voxtlm: unified decoder-only models for consolidating speech recognition/synthesis and speech/text continuation tasks

abstract: We propose a decoder-only language model, VoxtLM, that can perform four tasks: speech recognition, speech synthesis, text generation, and speech continuation. VoxtLM integrates text vocabulary with discrete speech tokens from self-supervised speech features and uses special tokens to enable multitask learning. Compared to a single-task model, VoxtLM exhibits a significant improvement in speech synthesis, with improvements in both speech intelligibility from 28.9 to 5.6 and objective quality from 2.68 to 3.90. VoxtLM also improves speech generation and speech recognition performance over the single-task counterpart. Further, VoxtLM is trained with publicly available data and training recipes and model checkpoints are open-sourced to make fully reproducible work.


title: An Assessment of ChatGPT on Log Data

abstract: Recent development of large language models (LLMs), such as ChatGPT has been widely applied to a wide range of software engineering tasks. Many papers have reported their analysis on the potential advantages and limitations of ChatGPT for writing code, summarization, text generation, etc. However, the analysis of the current state of ChatGPT for log processing has received little attention. Logs generated by large-scale software systems are complex and hard to understand. Despite their complexity, they provide crucial information for subject matter experts to understand the system status and diagnose problems of the systems. In this paper, we investigate the current capabilities of ChatGPT to perform several interesting tasks on log data, while also trying to identify its main shortcomings. Our findings show that the performance of the current version of ChatGPT for log processing is limited, with a lack of consistency in responses and scalability issues. We also outline our views on how we perceive the role of LLMs in the log processing discipline and possible next steps to improve the current capabilities of ChatGPT and the future LLMs in this area. We believe our work can contribute to future academic research to address the identified issues.


title: Discovery of a novel 1,3,4-oxadiazol-2-one-based NLRP3 inhibitor as a pharmacological agent to mitigate cardiac and metabolic complications in an experimental model of diet-induced metaflammation

abstract: Inspired by the recent advancements in understanding the binding mode of sulfonylurea-based NLRP3 inhibitors to the NLRP3 sensor protein, we developed new NLRP3 inhibitors by replacing the central sulfonylurea moiety with different heterocycles. Computational studies evidenced that some of the designed compounds were able to maintain important interaction within the NACHT domain of the target protein similarly to the most active sulfonylurea-based NLRP3 inhibitors. Among the studied compounds, the 1,3,4-oxadiazol-2-one derivative 5 (INF200) showed the most promising results being able to prevent NLRP3-dependent pyroptosis triggered by LPS/ATP and LPS/MSU by 66.3 +/- 6.6% and 61.6 +/- 11.5% and to reduce IL-1\b{eta} release (35.5 +/- 8.8 % {\mu}M) at 10 {\mu}M in human macrophages. The selected compound INF200 (20 mg/kg/day) was then tested in an in vivo rat model of high-fat diet (HFD)-induced metaflammation to evaluate its beneficial cardiometabolic effects. INF200 significantly counteracted HFD-dependent "anthropometric" changes, improved glucose and lipid profiles, and attenuated systemic inflammation and biomarkers of cardiac dysfunction (particularly BNP). Hemodynamic evaluation on Langendorff model indicate that INF200 limited myocardial damage-dependent ischemia/reperfusion injury (IRI) by improving post-ischemic systolic recovery and attenuating cardiac contracture, infarct size, and LDH release, thus reversing the exacerbation of obesity-associated damage. Mechanistically, in post-ischemic hearts, IFN200 reduced IRI-dependent NLRP3 activation, inflammation, and oxidative stress. These results highlight the potential of the novel NLRP3 inhibitor, INF200, and its ability to reverse the unfavorable cardio-metabolic dysfunction associated with obesity.


title: CvFormer: Cross-view transFormers with Pre-training for fMRI Analysis of Human Brain

abstract: In recent years, functional magnetic resonance imaging (fMRI) has been widely utilized to diagnose neurological disease, by exploiting the region of interest (RoI) nodes as well as their connectivities in human brain. However, most of existing works only rely on either RoIs or connectivities, neglecting the potential for complementary information between them. To address this issue, we study how to discover the rich cross-view information in fMRI data of human brain. This paper presents a novel method for cross-view analysis of fMRI data of the human brain, called Cross-view transFormers (CvFormer). CvFormer employs RoI and connectivity encoder modules to generate two separate views of the human brain, represented as RoI and sub-connectivity tokens. Then, basic transformer modules can be used to process the RoI and sub-connectivity tokens, and cross-view modules integrate the complement information across two views. Furthermore, CvFormer uses a global token for each branch as a query to exchange information with other branches in cross-view modules, which only requires linear time for both computational and memory complexity instead of quadratic time. To enhance the robustness of the proposed CvFormer, we propose a two-stage strategy to train its parameters. To be specific, RoI and connectivity views can be firstly utilized as self-supervised information to pre-train the CvFormer by combining it with contrastive learning and then fused to finetune the CvFormer using label information. Experiment results on two public ABIDE and ADNI datasets can show clear improvements by the proposed CvFormer, which can validate its effectiveness and superiority.


title: MDP Abstractions from Data: Large-Scale Stochastic Networks

abstract: This work proposes a compositional data-driven technique for the construction of finite Markov decision processes (MDPs) for large-scale stochastic networks with unknown mathematical models. Our proposed framework leverages dissipativity properties of subsystems and their finite MDPs using a notion of stochastic storage functions (SStF). In our data-driven scheme, we first build an SStF between each unknown subsystem and its data-driven finite MDP with a certified probabilistic confidence. We then derive dissipativity-type compositional conditions to construct a stochastic bisimulation function (SBF) between an interconnected network and its finite MDP using data-driven SStF of subsystems. Accordingly, we formally quantify the probabilistic distance between trajectories of an unknown large-scale stochastic network and those of its finite MDP with a guaranteed confidence. We illustrate the efficacy of our data-driven results over a room temperature network composing 100 rooms with unknown models.


title: Phase transition of the long range Ising model in lower dimensions, for $d < \alpha \leq d + 1$, with a Peierls argument

abstract: We extend previous results due to Ding and Zhuang in order to prove that a phase transition occurs for the long range Ising model in lower dimensions. By making use of a recent argument due to Affonso, Bissacot and Maia from 2022 which establishes that a phase transition occurs for the long range, random-field Ising model, from a suggestion of the authors we demonstrate that a phase transition also occurs for the long range Ising model, from a set of appropriately defined contours for the long range system, and a Peierls' argument.


title: Eigenvalue attraction in open quantum systems, biophysical systems, and Parity-Time symmetric materials

abstract: We investigate eigenvalue attraction for open quantum systems, biophysical systems, and for Parity-Time symmetric materials. To determine whether an eigenvalue and its complex conjugate of a real matrix attract, we derive expressions for the second derivative of eigenvalues, which is dependent upon contributions from inertial forces, attraction between an eigenvalue and its complex conjugate, as well as the force of the remaining eigenvalues in the spectrum.

categories: quant-ph cond-mat.stat-mech math-ph math.MP


title: Text-to-Image Models for Counterfactual Explanations: a Black-Box Approach

abstract: This paper addresses the challenge of generating Counterfactual Explanations (CEs), involving the identification and modification of the fewest necessary features to alter a classifier's prediction for a given image. Our proposed method, Text-to-Image Models for Counterfactual Explanations (TIME), is a black-box counterfactual technique based on distillation. Unlike previous methods, this approach requires solely the image and its prediction, omitting the need for the classifier's structure, parameters, or gradients. Before generating the counterfactuals, TIME introduces two distinct biases into Stable Diffusion in the form of textual embeddings: the context bias, associated with the image's structure, and the class bias, linked to class-specific features learned by the target classifier. After learning these biases, we find the optimal latent code applying the classifier's predicted class token and regenerate the image using the target embedding as conditioning, producing the counterfactual explanation. Extensive empirical studies validate that TIME can generate explanations of comparable effectiveness even when operating within a black-box setting.


title: Masked Generative Modeling with Enhanced Sampling Scheme

abstract: This paper presents a novel sampling scheme for masked non-autoregressive generative modeling. We identify the limitations of TimeVQVAE, MaskGIT, and Token-Critic in their sampling processes, and propose Enhanced Sampling Scheme (ESS) to overcome these limitations. ESS explicitly ensures both sample diversity and fidelity, and consists of three stages: Naive Iterative Decoding, Critical Reverse Sampling, and Critical Resampling. ESS starts by sampling a token set using the naive iterative decoding as proposed in MaskGIT, ensuring sample diversity. Then, the token set undergoes the critical reverse sampling, masking tokens leading to unrealistic samples. After that, critical resampling reconstructs masked tokens until the final sampling step is reached to ensure high fidelity. Critical resampling uses confidence scores obtained from a self-Token-Critic to better measure the realism of sampled tokens, while critical reverse sampling uses the structure of the quantized latent vector space to discover unrealistic sample paths. We demonstrate significant performance gains of ESS in both unconditional sampling and class-conditional sampling using all the 128 datasets in the UCR Time Series archive.


title: Slow Invariant Manifolds of Singularly Perturbed Systems via Physics-Informed Machine Learning

abstract: We present a physics-informed machine-learning (PIML) approach for the approximation of slow invariant manifolds (SIMs) of singularly perturbed systems, providing functionals in an explicit form that facilitate the construction and numerical integration of reduced order models (ROMs). The proposed scheme solves a partial differential equation corresponding to the invariance equation (IE) within the Geometric Singular Perturbation Theory (GSPT) framework. For the solution of the IE, we used two neural network structures, namely feedforward neural networks (FNNs), and random projection neural networks (RPNNs), with symbolic differentiation for the computation of the gradients required for the learning process. The efficiency of our PIML method is assessed via three benchmark problems, namely the Michaelis-Menten, the target mediated drug disposition reaction mechanism, and the 3D Sel'kov model. We show that the proposed PIML scheme provides approximations, of equivalent or even higher accuracy, than those provided by other traditional GSPT-based methods, and importantly, for any practical purposes, it is not affected by the magnitude of the perturbation parameter. This is of particular importance, as there are many systems for which the gap between the fast and slow timescales is not that big, but still ROMs can be constructed. A comparison of the computational costs between symbolic, automatic and numerical approximation of the required derivatives in the learning process is also provided.


title: TiBGL: Template-induced Brain Graph Learning for Functional Neuroimaging Analysis

abstract: In recent years, functional magnetic resonance imaging has emerged as a powerful tool for investigating the human brain's functional connectivity networks. Related studies demonstrate that functional connectivity networks in the human brain can help to improve the efficiency of diagnosing neurological disorders. However, there still exist two challenges that limit the progress of functional neuroimaging. Firstly, there exists an abundance of noise and redundant information in functional connectivity data, resulting in poor performance. Secondly, existing brain network models have tended to prioritize either classification performance or the interpretation of neuroscience findings behind the learned models. To deal with these challenges, this paper proposes a novel brain graph learning framework called Template-induced Brain Graph Learning (TiBGL), which has both discriminative and interpretable abilities. Motivated by the related medical findings on functional connectivites, TiBGL proposes template-induced brain graph learning to extract template brain graphs for all groups. The template graph can be regarded as an augmentation process on brain networks that removes noise information and highlights important connectivity patterns. To simultaneously support the tasks of discrimination and interpretation, TiBGL further develops template-induced convolutional neural network and template-induced brain interpretation analysis. Especially, the former fuses rich information from brain graphs and template brain graphs for brain disorder tasks, and the latter can provide insightful connectivity patterns related to brain disorders based on template brain graphs. Experimental results on three real-world datasets show that the proposed TiBGL can achieve superior performance compared with nine state-of-the-art methods and keep coherent with neuroscience findings in recent literatures.


title: Complex-Valued Neural Networks for Data-Driven Signal Processing and Signal Understanding

abstract: Complex-valued neural networks have emerged boasting superior modeling performance for many tasks across the signal processing, sensing, and communications arenas. However, developing complex-valued models currently demands development of basic deep learning operations, such as linear or convolution layers, as modern deep learning frameworks like PyTorch and Tensor flow do not adequately support complex-valued neural networks. This paper overviews a package built on PyTorch with the intention of implementing light-weight interfaces for common complex-valued neural network operations and architectures. Similar to natural language understanding (NLU), which as recently made tremendous leaps towards text-based intelligence, RF Signal Understanding (RFSU) is a promising field extending conventional signal processing algorithms using a hybrid approach of signal mechanics-based insight with data-driven modeling power. Notably, we include efficient implementations for linear, convolution, and attention modules in addition to activation functions and normalization layers such as batchnorm and layernorm. Additionally, we include efficient implementations of manifold-based complex-valued neural network layers that have shown tremendous promise but remain relatively unexplored in many research contexts. Although there is an emphasis on 1-D data tensors, due to a focus on signal processing, communications, and radar data, many of the routines are implemented for 2-D and 3-D data as well. Specifically, the proposed approach offers a useful set of tools and documentation for data-driven signal processing research and practical implementation.


title: Compositional metrics of fast and slow Alfvenic solar wind emerging from coronal holes and their boundaries

abstract: We seek to understand the composition and variability of fast (FSW) and slow Alfvenic solar wind (SASW) emerging from coronal holes (CH). We leverage an opportune conjunction between Solar Orbiter and Parker Solar Probe (PSP) during PSP Encounter 11 to include compositional diagnostics from the Solar Orbiter heavy ion sensor (HIS) as these variations provide crucial insights into the origin and nature of the solar wind. We use Potential Field Source Surface (PFSS) and Magnetohydrodynamic (MHD) models to connect the observed plasma at PSP and Solar Orbiter to its origin footpoint in the photosphere, and compare these results with the in situ measurements. A very clear signature of a heliospheric current sheet (HCS) crossing as evidenced by enhancements in low FIP elements, ion charge state ratios, proton density, low-Alfvenicity, and polarity estimates validates the combination of modeling, data, and mapping. We identify two FSW streams emerging from small equatorial coronal holes (CH) with low ion charge state ratios, low FIP bias, high-Alfvenicity, and low footpoint brightness, yet anomalously low alpha particle abundance for both streams. We identify high-Alfvenicity slow solar wind emerging from the over-expanded boundary of a CH having intermediate alpha abundance, high-Alfvenicity, and dips in ion charge state ratios corresponding to CH boundaries. Through this comprehensive analysis, we highlight the power of multi-instrument conjunction studies in assessing the sources of the solar wind.


title: Topological and geometric analysis of cell states in single-cell transcriptomic data

abstract: Single-cell RNA sequencing (scRNA-seq) enables dissecting cellular heterogeneity in tissues, resulting in numerous biological discoveries. Various computational methods have been devised to delineate cell types by clustering scRNA-seq data where the clusters are often annotated using prior knowledge of marker genes. In addition to identifying pure cell types, several methods have been developed to identify cells undergoing state transitions which often rely on prior clustering results. Present computational approaches predominantly investigate the local and first-order structures of scRNA-seq data using graph representations, while scRNA-seq data frequently displays complex high-dimensional structures. Here, we present a tool, scGeom for exploiting the multiscale and multidimensional structures in scRNA-seq data by inspecting the geometry via graph curvature and topology via persistent homology of both cell networks and gene networks. We demonstrate the utility of these structural features for reflecting biological properties and functions in several applications where we show that curvatures and topological signatures of cell and gene networks can help indicate transition cells and developmental potency of cells. We additionally illustrate that the structural characteristics can improve the classification of cell types.


title: Non-standard axion electrodynamics and the dual Witten effect

abstract: Standard axion electrodynamics has two closely related features. First, the coupling of a massless axion field to photons is quantized, in units proportional to the electric gauge coupling squared. Second, the equations of motion tell us that a time-dependent axion field in a background magnetic field sources an effective electric current, but a time-dependent axion field in a background electric field has no effect. These properties, which manifestly violate electric-magnetic duality, play a crucial role in experimental searches for axions. Recently, electric-magnetic duality has been used to motivate the possible existence of non-standard axion couplings, which can both violate the usual quantization rule and exchange the roles of electric and magnetic fields in axion electrodynamics. We show that these non-standard couplings can be derived from SL(2,Z) duality, but that they come at a substantial cost: in non-standard axion electrodynamics, all electrically charged particles become dyons when the axion traverses its field range, in a dual form of the standard Witten effect monodromy. This implies that there are dyons near the weak scale, leads to a large axion mass induced by Standard Model fermion loops, and dramatically alters Higgs physics. We conclude that non-standard axion electrodynamics, although interesting to consider in abstract quantum field theory, is not phenomenologically viable.


title: Gravitational Wave Measurement in the Mid-Band with Atom Interferometers

abstract: Gravitational Waves (GWs) have been detected in the $\sim$100 Hz and nHz bands, but most of the gravitational spectrum remains unobserved. A variety of detector concepts have been proposed to expand the range of observable frequencies. In this work, we study the capability of GW detectors in the ``mid-band'', the $\sim$30 mHz -- 10 Hz range between LISA and LIGO, to measure the signals from and constrain the properties of ${\sim}$1 -- 100 $M_\odot$ compact binaries. We focus on atom-interferometer-based detectors. We describe a Fisher matrix code, AIMforGW, which we created to evaluate their capabilities, and present numerical results for two benchmarks: terrestrial km-scale detectors, and satellite-borne detectors in medium Earth orbit. Mid-band GW detectors are particularly well-suited to pinpointing the location of GW sources on the sky. We demonstrate that a satellite-borne detector could achieve sub-degree sky localization for any detectable source with chirp mass $\mathcal{M}_c \lesssim 50 M_\odot$. We also compare different detector configurations, including different locations of terrestrial detectors and various choices of the orbit of a satellite-borne detector. As we show, a network of only two terrestrial single-baseline detectors or one single-baseline satellite-borne detector would each provide close-to-uniform sky-coverage, with signal-to-noise ratios varying by less than a factor of two across the entire sky. We hope that this work contributes to the efforts of the GW community to assess the merits of different detector proposals.

categories: gr-qc astro-ph.CO astro-ph.IM hep-ph physics.atom-ph


title: Magnetic field evolution in high and low $\beta$ disks with initially-toroidal fields

abstract: We present results from a pair of high resolution, long timescale ($\sim10^5 GM/c^3$), global, three dimensional magnetohydrodynamical accretion disk simulations with differing initial magnetic plasma $\beta$ in order to study the effects of initial toroidal field strength on production of large-scale poloidal field. We initialize our disks in approximate equilibrium with purely toroidal magnetic fields of strength $\beta_0=5$ and $\beta_0=200$. We also perform a limited resolution study. We find that simulations of differing field strength diverge early in their evolution and remain distinct over the time studied, indicating that initial magnetic conditions leave a persistent imprint in our simulations. Neither simulation enters the Magnetically Arrested Disk (MAD) regime. Both simulations are able to produce poloidal fields from initially-toroidal fields, with the $\beta_0=5$ simulation evolving clear signs of a large-scale poloidal field. We make a cautionary note that computational artifacts in the form of large-scale vortices may be introduced in the combination of initially-weak field and disk-internal mesh refinement boundaries, as evidenced by the production of an $m=1$ mode overdensity in the weak field simulation. Our results demonstrate that the initial toroidal field strength plays a vital role in simulated disk evolution for the models studied.


title: Simulation-based inference for stochastic gravitational wave background data analysis

abstract: The next generation of space- and ground-based facilities promise to reveal an entirely new picture of the gravitational wave sky: thousands of galactic and extragalactic binary signals, as well as stochastic gravitational wave backgrounds (SGWBs) of unresolved astrophysical and possibly cosmological signals. These will need to be disentangled to achieve the scientific goals of experiments such as LISA, Einstein Telescope, or Cosmic Explorer. We focus on one particular aspect of this challenge: reconstructing an SGWB from (mock) LISA data. We demonstrate that simulation-based inference (SBI) - specifically truncated marginal neural ratio estimation (TMNRE) - is a promising avenue to overcome some of the technical difficulties and compromises necessary when applying more traditional methods such as Monte Carlo Markov Chains (MCMC). To highlight this, we show that we can reproduce results from traditional methods both for a template-based and agnostic search for an SGWB. Moreover, as a demonstration of the rich potential of SBI, we consider the injection of a population of low signal-to-noise ratio supermassive black hole transient signals into the data. TMNRE can implicitly marginalize over this complicated parameter space, enabling us to directly and accurately reconstruct the stochastic (and instrumental noise) contributions. We publicly release our TMNRE implementation in the form of the code saqqara.


title: Quokka-based Understanding of Outflows (QED) I. Metal loading, phase structure, and convergence testing for Solar neighbourhood conditions

abstract: Multiphase galactic outflows, generated by supernova feedback, are likely to be more metal-rich than the interstellar media from which they are driven due to incomplete mixing between supernova ejecta and the ambient ISM. This enrichment is important for shaping galactic metallicities and metallicity gradients, but measuring it quantitatively from simulations requires resolution high enough to resolve mass, momentum and energy exchanges between the different phases of the outflows. In this context, we present simulations of outflows, driven by SN feedback, conducted using \textsc{Quokka}, a new GPU-optimised AMR radiation-hydrodynamics code. This code allows us to reach combinations of resolution, simulation volume, and simulation duration larger than those that have previously been possible, and to resolve all gas phases from cold neutral medium, $T \sim 100$ K, to hot ionised gas, $T \gtrsim 10^7$ K. In this, a first of a series of papers exploring generation and evolution of multiphase outflows from a wide range of galactic environments and star formation rates, we quantify the extent of selective metal loading in Solar neighbourhood-like environments. We explain the selective metal loading we find as a result of the transport of metals within and between phases, a phenomenon we can study owing to the parsec-scale resolution that our simulations achieve. We also quantify the sensitivity of metal loading studies to numerical resolution, and present convergence criteria for future studies.


title: Classifying fermionic states via many-body correlation measures

abstract: Understanding the structure of quantum correlations in a many-body system is key to its computational treatment. For fermionic systems, correlations can be defined as deviations from Slater determinant states. The link between fermionic correlations and efficient computational physics methods is actively studied but remains ambiguous. We make progress in establishing this connection mathematically. In particular, we find a rigorous classification of states relative to $k$-fermion correlations, which admits a computational physics interpretation. Correlations are captured by a measure $\omega_k$, a function of $k$-fermion reduced density matrix that we call twisted purity. Vanishing of $\omega_k$ for a given $k$ puts the state in a class $G_k$ of correlated states. Sets $G_k$ are nested in $k$, Slater determinants correspond to $k = 1$. Various physically relevant states are in or close to $G_{k=O(1)}$, including truncated configuration-interaction states, perturbation series around Slater determinants, and some nonperturbative eigenstates of the 1D Hubbard model. For each $k = O(1)$, we give an explicit ansatz with a polynomial number of parameters that covers all states in $G_k$. Potential applications of this ansatz and its connections to the coupled-cluster wavefunction are discussed.

categories: quant-ph cond-mat.str-el math-ph math.MP physics.chem-ph


title: Spatially resolved Kennicutt-Schmidt relation at z~7 and its connection with the interstellar medium properties

abstract: We exploit moderately resolved [OIII], [CII] and dust continuum ALMA observations to derive the gas density ($n$), the gas-phase metallicity ($Z$) and the deviation from the Kennicutt-Schmidt (KS) relation ($\kappa_s$) on ~sub-kpc scales in the interstellar medium (ISM) of five bright Lyman Break Galaxies at the Epoch of Reionization ($z\approx 7$). To do so, we use GLAM, a state-of-art, physically motivated Bayesian model that links the [CII] and [OIII] surface brightness ($\Sigma_{\rm [CII]}$, $\Sigma_{\rm [OIII]}$) and the SFR surface density ($\Sigma_{\rm SFR}$) to $n$, $\kappa_s$, and $Z$. All five sources are characterized by a central starbursting region, where the $\Sigma_{\rm gas}$ vs $\Sigma_{\rm SFR}$ align ~10x above the KS relation ($\kappa_s\approx10$). This translates into gas depletion times in the range $t_{\rm dep}\approx 80-250$ Myr. The inner starbursting centers are characterized by higher gas density ($\log (n/{\rm cm^{-3}}) \approx 2.5-3.0$) and higher metallicity ($\log (Z/Z_{\odot}) \approx -0.5$) than the galaxy outskirts. We derive marginally negative radial metallicity gradients ($\nabla \log Z \approx -0.03 \pm 0.07$dex/kpc), and a dust temperature ($T_d\approx$32-38 K) that anticorrelates with the gas depletion time.


title: Characterising the true descendants of the first stars

abstract: The metal-poor stars in the Galactic halo are thought to show the imprints of the first (PopIII) stars, and thus provide a glance at the first episodes of star formation. In this work, we aim at understanding whether all very metal-poor stars formed in environments polluted by PopIII supernovae (SNe) and at what level. With a general parametric model for early metal enrichment, we study the chemical abundances (from C to Zn) of an environment imprinted by a single PopIII SN. We investigate how these abundances depend on the initial mass and internal mixing of PopIII stars, as well as on their SN explosion energy. We then study how subsequent generations of normal (PopII) SNe affect the PopIII chemical signatures. By comparing the observed chemical abundances with our model predictions, we show that stars with [C/Fe]$>+2.5$ form in environments polluted purely by low-energy PopIII SNe ($E_{\rm SN}<2\times 10^{51}$erg). At lower [C/Fe], stars can be imprinted either by PopIII only, or also by normal PopII SNe. The probability of being enriched by PopII SNe increases as [C/Fe] decreases. When PopII stars contribute more to the pollution, they wash out the diverse chemical peculiarities left by the different PopIII SNe, and the chemical dispersion between their descendants decreases. We conclude that C-normal stars ($\rm [C/Fe] \leq +0.7$) have likely been enriched by PopII SNe at a $\geq 50\%$ level and we identify in the abundance scatter a key diagnostic to pinpoint the signature of PopIII SNe.


title: The FLAMINGO project: revisiting the $S_8$ tension and the role of baryonic physics

abstract: A number of recent studies have found evidence for a tension between observations of large-scale structure (LSS) and the predictions of the standard model of cosmology with the cosmological parameters fit to the cosmic microwave background (CMB). The origin of this '$S_8$ tension' remains unclear, but possibilities include new physics beyond the standard model, unaccounted for systematic errors in the observational measurements and/or uncertainties in the role that baryons play. Here we carefully examine the latter possibility using the new FLAMINGO suite of large-volume cosmological hydrodynamical simulations. We project the simulations onto observable harmonic space and compare with observational measurements of the power and cross-power spectra of cosmic shear, CMB lensing, and the thermal Sunyaev-Zel'dovich (tSZ) effect. We explore the dependence of the predictions on box size and resolution, cosmological parameters including the neutrino mass, and the efficiency and nature of baryonic 'feedback'. Despite the wide range of astrophysical behaviours simulated, we find that baryonic effects are not sufficiently large to remove the $S_8$ tension. Consistent with recent studies, we find the CMB lensing power spectrum is in excellent agreement with the standard model, whilst the cosmic shear power spectrum, tSZ effect power spectrum, and the cross-spectra between shear, CMB lensing, and the tSZ effect are all in varying degrees of tension with the CMB-specified standard model. These results suggest that some mechanism is required to slow the growth of fluctuations at late times and/or on non-linear scales, but that it is unlikely that baryon physics is driving this modification.


title: Energy balance SED modelling can be effective at high redshifts regardless of UV-FIR offsets

abstract: Recent works have suggested that energy balance spectral energy distribution (SED) fitting codes may be of limited use for studying high-redshift galaxies for which the observed ultraviolet and far-infrared emission are offset (spatially `decoupled'). It has been proposed that such offsets could lead energy balance codes to miscalculate the overall energetics, preventing them from recovering such galaxies' true properties. In this work, we test how well the SED fitting code Magphys can recover the stellar mass, star formation rate (SFR), specific SFR, dust mass and luminosity by fitting 6,706 synthetic SEDs generated from four zoom-in simulations of dusty, high-redshift galaxies from the FIRE project via dust continuum radiative transfer. Comparing our panchromatic results (using wavelengths 0.4-500$\mu$m, and spanning $1<z<8$) with fits based on either the starlight ($\lambda_\mathrm{eff} \le 2.2\,\mu$m) or dust ($\ge 100\,\mu$m) alone, we highlight the power of considering the full range of multi-wavelength data alongside an energy balance criterion. Overall, we obtain acceptable fits for 83 per cent of the synthetic SEDs, though the success rate falls rapidly beyond $z \approx 4$, in part due to the sparser sampling of the priors at earlier times since SFHs must be physically plausible (i.e. shorter than the age of the Universe). We use the ground truth from the simulations to show that when the quality of fit is acceptable, the fidelity of Magphys estimates is independent of the degree of UV\FIR offset, with performance very similar to that previously reported for local galaxies.


title: Geometrically Taming Dynamical Entanglement Growth in Purified Quantum States

abstract: Entanglement properties of purified quantum states are of key interest for two reasons. First, in quantum information theory, minimally entangled purified states define the Entanglement of Purification as a fundamental measure for the complexity of the corresponding physical mixed state. Second, dynamical entanglement growth in purified states represents the main bottleneck for calculating dynamical physical properties on classical computers in the framework of tensor network states. Here, we demonstrate how geometric methods including parallel transport may be harnessed to reduce such dynamical entanglement growth, and to obtain a general prescription for maintaining (locally) optimal entanglement entropy when time-evolving a purified state. Adapting and extending by higher order skew corrections the notion of Uhlmann geometric phases, we reveal the relation between dynamical entanglement growth and the geometry of the Hilbert-Schmidt bundle as the mathematical foundation of purified states. With benchmarks on a non-integrable spin chain model, we compare the computational performance of matrix product state algorithms based on our present geometric disentangling method to previous approaches for taming entanglement growth in purified states. Our findings provide numerical evidence that geometric disentanglers are a powerful approach, superior in various aspects to known methods for disentangling purified states in a range of physically relevant computational scenarios. To exclude the effect of algorithmic imperfections, we also provide a numerically exact analysis for systems of moderate size.


title: Beck modules and alternative algebras

abstract: We set out the general theory of ``Beck modules'' in a variety of algebras and describe them as modules over suitable ``universal enveloping'' unital associative algebras. We develop a theory of ``noncommutative partial differentiation'' to pass from the equations of the variety to relations in a universal enveloping algebra. We pay particular attention to the case of alternative algebras, defined by a restricted associative law, and determine the Poincar\'e polynomial of the universal enveloping algebra in the homogeneous case.


title: Synchrotron polarization signatures of surface waves in supermassive black hole jets

abstract: Supermassive black holes in active galactic nuclei (AGN) are known to launch relativistic jets, which are observed across the entire electromagnetic spectrum and are thought to be efficient particle accelerators. Their primary radiation mechanism for radio emission is polarized synchrotron emission produced by a population of non-thermal electrons. In this Letter, we present a global general relativistic magnetohydrodynamical (GRMHD) simulation of a magnetically arrested disk (MAD). After the simulation reaches the MAD state, we show that waves are continuously launched from the vicinity of the black hole and propagate along the interface between the jet and the wind. At this interface, a steep gradient in velocity is present between the mildly relativistic wind and the highly relativistic jet. The interface is, therefore, a shear layer, and due to the shear, the waves generate roll-ups that alter the magnetic field configuration and the shear layer geometry. We then perform polarized radiation transfer calculations of our GRMHD simulation and find signatures of the waves in both total intensity and linear polarization, effectively lowering the fully resolved polarization fraction. The tell-tale polarization signatures of the waves could be observable by future Very Long Baseline Interferometric observations, e.g., by the next-generation Event Horizon Telescope.


title: Improved Shortest Path Restoration Lemmas for Multiple Edge Failures: Trade-offs Between Fault-tolerance and Subpaths

abstract: The restoration lemma is a classic result by Afek, Bremler-Barr, Kaplan, Cohen, and Merritt [PODC '01], which relates the structure of shortest paths in a graph $G$ before and after some edges in the graph fail. Their work shows that, after one edge failure, any replacement shortest path avoiding this failing edge can be partitioned into two pre-failure shortest paths. More generally, this implies an additive tradeoff between fault tolerance and subpath count: for any $f, k$, we can partition any $f$-edge-failure replacement shortest path into $k+1$ subpaths which are each an $(f-k)$-edge-failure replacement shortest path. This generalized result has found applications in routing, graph algorithms, fault tolerant network design, and more. Our main result improves this to a multiplicative tradeoff between fault tolerance and subpath count. We show that for all $f, k$, any $f$-edge-failure replacement path can be partitioned into $O(k)$ subpaths that are each an $(f/k)$-edge-failure replacement path. We also show an asymptotically matching lower bound. In particular, our results imply that the original restoration lemma is exactly tight in the case $k=1$, but can be significantly improved for larger $k$. We also show an extension of this result to weighted input graphs, and we give efficient algorithms that compute path decompositions satisfying our improved restoration lemmas.


title: A survey on relative Lipschitz saturation of algebras and its relation with radicial algebras

abstract: In this work, we introduce the concept of relative Lipschitz saturation, along with its key categorical and algebraic properties, and demonstrate how such a structure always gives rise to a radicial algebra.


title: Emergent nucleosynthesis from a 1.2 second long simulation of a black-hole accretion disk

abstract: We simulate a black-hole accretion disk system with full-transport general relativistic neutrino radiation magnetohydrodynamics (GR$\nu$RMHD) for 1.2 seconds. This system is likely to form after the merger of two compact objects and is thought to be a robust site of $r$-process nucleosynthesis. We consider the case of a black-hole accretion disk arising from the merger of two neutron stars. Our simulation time coincides with the nucleosynthesis timescale of the $r$ process ($\sim$ 1 second). Because these simulations are time consuming, it is common practice to run for `short' duration of approximately 0.1 to 0.3 seconds. We analyze the nucleosynthetic outflow from this system and compare the results between stopping at 0.12 and 1.2 seconds respectively. We find that the addition of mass ejected in the longer simulation as well as more favorable thermodynamic conditions from emergent viscous ejecta greatly impacts the nucleosynthetic outcome. We quantify the error in nucleosynthetic outcomes between short and long cuts.


title: iHAS: Instance-wise Hierarchical Architecture Search for Deep Learning Recommendation Models

abstract: Current recommender systems employ large-sized embedding tables with uniform dimensions for all features, leading to overfitting, high computational cost, and suboptimal generalizing performance. Many techniques aim to solve this issue by feature selection or embedding dimension search. However, these techniques typically select a fixed subset of features or embedding dimensions for all instances and feed all instances into one recommender model without considering heterogeneity between items or users. This paper proposes a novel instance-wise Hierarchical Architecture Search framework, iHAS, which automates neural architecture search at the instance level. Specifically, iHAS incorporates three stages: searching, clustering, and retraining. The searching stage identifies optimal instance-wise embedding dimensions across different field features via carefully designed Bernoulli gates with stochastic selection and regularizers. After obtaining these dimensions, the clustering stage divides samples into distinct groups via a deterministic selection approach of Bernoulli gates. The retraining stage then constructs different recommender models, each one designed with optimal dimensions for the corresponding group. We conduct extensive experiments to evaluate the proposed iHAS on two public benchmark datasets from a real-world recommender system. The experimental results demonstrate the effectiveness of iHAS and its outstanding transferability to widely-used deep recommendation models.


title: Distributed formation control of end-effector of mixed planar fully- and under-actuated manipulators

abstract: This paper addresses the problem of end-effector formation control for a mixed group of two-link manipulators moving in a horizontal plane that comprises of fully-actuated manipulators and underactuated manipulators with only the second joint being actuated (referred to as the passive-active (PA) manipulators). The problem is solved by extending the distributed end-effector formation controller for the fully-actuated manipulator to the PA manipulator moving in a horizontal plane by using its integrability. This paper presents stability analysis of the closed-loop systems under a given necessary condition, and we prove that the manipulators' end-effector converge to the desired formation shape. The proposed method is validated by simulations.


title: A massive compact quiescent galaxy at z=2 with a complete Einstein ring in JWST imaging

abstract: One of the surprising results from HST was the discovery that many of the most massive galaxies at z~2 are very compact, having half-light radii of only 1-2 kpc. The interpretation is that massive galaxies formed inside-out, with their cores largely in place by z~2 and approximately half of their present-day mass added later through minor mergers. Here we present a compact, massive, quiescent galaxy at $z_{\rm phot}=1.94^{+0.13}_{-0.17}$ with a complete Einstein ring. The ring was found in the JWST COSMOS-Web survey and is produced by a background galaxy at $z_{\rm phot}=2.98^{+0.42}_{-0.47}$. Its 1.54" diameter provides a direct measurement of the mass of the "pristine" core of a massive galaxy, observed before mixing and dilution of its stellar population during the 10 Gyr of galaxy evolution between z=2 and z=0. We find a mass of $M_{\rm lens}=6.5^{+3.7}_{-1.5} \times 10^{11}$ Msun within a radius of 6.6 kpc. The stellar mass within the same radius is $M_{\rm stars}= 1.1^{+0.2}_{-0.3} \times 10^{11}$ Msun for a Chabrier initial mass function (IMF), and the fiducial dark matter mass is $M_{\rm dm} = 2.6^{+1.6}_{-0.7} \times 10^{11}$ Msun. Additional mass is needed to explain the lensing results, either in the form of a higher-than-expected dark matter density or a bottom-heavy IMF.


title: Language Embedded Radiance Fields for Zero-Shot Task-Oriented Grasping

abstract: Grasping objects by a specific part is often crucial for safety and for executing downstream tasks. Yet, learning-based grasp planners lack this behavior unless they are trained on specific object part data, making it a significant challenge to scale object diversity. Instead, we propose LERF-TOGO, Language Embedded Radiance Fields for Task-Oriented Grasping of Objects, which uses vision-language models zero-shot to output a grasp distribution over an object given a natural language query. To accomplish this, we first reconstruct a LERF of the scene, which distills CLIP embeddings into a multi-scale 3D language field queryable with text. However, LERF has no sense of objectness, meaning its relevancy outputs often return incomplete activations over an object which are insufficient for subsequent part queries. LERF-TOGO mitigates this lack of spatial grouping by extracting a 3D object mask via DINO features and then conditionally querying LERF on this mask to obtain a semantic distribution over the object with which to rank grasps from an off-the-shelf grasp planner. We evaluate LERF-TOGO's ability to grasp task-oriented object parts on 31 different physical objects, and find it selects grasps on the correct part in 81% of all trials and grasps successfully in 69%. See the project website at: lerftogo.github.io


title: Dark I-Love-Q

abstract: For neutron stars, there exist universal relations insensitive to the equation of states, the so called I-Love-Q relations, which show the connections among the moment of inertia, tidal Love number and quadrupole moment. In this paper, we show that these relations also applies to dark stars, bosonic or fermionic. The relations can be extended to a higher range of the variables, as those curves all approximate the ones generated by a polytropic equation of state, when taking the low density (pressure) limit.


title: Witt invariants of Weyl groups

abstract: We describe the Witt invariants of a Weyl group over a field $k_0$ by giving generators for the $W(k_0)$-module of Witt invariants, under certain assumptions on $k_0$ (which hold for any field of finite $2$-cohomological dimension). For the Weyl groups of types $B_n$, $C_n$, $D_n$, and $G_2$, we show that the Witt invariants are generated as a $W(k_0)$-algebra by trace forms and their exterior powers, extending a result due to Serre in type $A_n$. Many of our computational methods are applicable to computing Witt invariants of any smooth linear algebraic group over $k_0$, including a technique for lifting module generators from cohomological invariants to Witt invariants.


title: M3Dsynth: A dataset of medical 3D images with AI-generated local manipulations

abstract: The ability to detect manipulated visual content is becoming increasingly important in many application fields, given the rapid advances in image synthesis methods. Of particular concern is the possibility of modifying the content of medical images, altering the resulting diagnoses. Despite its relevance, this issue has received limited attention from the research community. One reason is the lack of large and curated datasets to use for development and benchmarking purposes. Here, we investigate this issue and propose M3Dsynth, a large dataset of manipulated Computed Tomography (CT) lung images. We create manipulated images by injecting or removing lung cancer nodules in real CT scans, using three different methods based on Generative Adversarial Networks (GAN) or Diffusion Models (DM), for a total of 8,577 manipulated samples. Experiments show that these images easily fool automated diagnostic tools. We also tested several state-of-the-art forensic detectors and demonstrated that, once trained on the proposed dataset, they are able to accurately detect and localize manipulated synthetic content, even when training and test sets are not aligned, showing good generalization ability. Dataset and code are publicly available at https://grip-unina.github.io/M3Dsynth/.


title: A Data Source for Reasoning Embodied Agents

abstract: Recent progress in using machine learning models for reasoning tasks has been driven by novel model architectures, large-scale pre-training protocols, and dedicated reasoning datasets for fine-tuning. In this work, to further pursue these advances, we introduce a new data generator for machine reasoning that integrates with an embodied agent. The generated data consists of templated text queries and answers, matched with world-states encoded into a database. The world-states are a result of both world dynamics and the actions of the agent. We show the results of several baseline models on instantiations of train sets. These include pre-trained language models fine-tuned on a text-formatted representation of the database, and graph-structured Transformers operating on a knowledge-graph representation of the database. We find that these models can answer some questions about the world-state, but struggle with others. These results hint at new research directions in designing neural reasoning models and database representations. Code to generate the data will be released at github.com/facebookresearch/neuralmemory


title: Smart Helper-Aided F-RANs: Improving Delay and Reducing Fronthaul Load

abstract: In traditional Fog-Radio Access Networks (F-RANs), enhanced remote radio heads (eRRHs) are connected to a macro base station (MBS) through fronthaul links. Deploying a massive number of eRRHs is not always feasible due to site constraints and the cost of fronthaul links. This paper introduces an innovative concept of using smart helpers (SHs) in F-RANs. These SHs do not require fronthaul links and listen to the nearby eRRHs' communications. Then, they smartly select and cache popular content. This capability enables SHs to serve users with frequent on-demand service requests potentially. As such, network operators have the flexibility to easily deploy SHs in various scenarios, such as dense urban areas and temporary public events, to expand their F-RANs and improve the quality of service (QoS). To study the performance of the proposed SH-aided F-RAN, we formulate an optimization problem of minimizing the average transmission delay that jointly optimizes cache resources and user scheduling. To tackle the formulated problem, we develop an innovative multi-stage algorithm that uses a reinforcement learning (RL) framework. Various performance measures, e.g., the average transmission delay, fronthaul load, and cache hit rate of the proposed SH-aided F-RAN are evaluated numerically and compared with those of traditional F-RANs.


title: Crystallization and refluidization in very-narrow fluidized beds

abstract: Fluidization of solid particles by an ascending fluid is frequent in industry because of the high rates of mass and heat transfers achieved. However, in some cases blockages occur and hinder the correct functioning of the fluidized bed. In this paper, we investigate the crystallization (defluidization) and refluidization that take place in very-narrow solid-liquid fluidized beds under steady flow conditions. For that, we carried out experiments where either monodisperse or bidisperse beds were immersed in water flows whose velocities were above those necessary for fluidization, and the ratio between the tube and grain diameters was smaller than 6. For monodisperse beds consisting of regular spheres, we observed that crystallization and refluidization alternate successively along time, which we quantify in terms of macroscopic structures and agitation of individual grains. We found the characteristic times for crystallization, and propose a new macroscopic parameter quantifying the degree of bed agitation. The bidisperse beds consisted of less-regular spheres placed on the bottom of a layer of regular spheres (the latter was identical to the monodisperse beds tested). We measured the changes that macroscopic structures and agitation of grains undergo, and show that the higher agitation in the bottom layer hinders crystallization of the top layer. Our results bring new insights into the dynamics of very-narrow beds, in addition to proposing a way of mitigating defluidization.


title: A Schiffer-type problem for annuli with applications to stationary planar Euler flows

abstract: If on a smooth bounded domain $\Omega\subset\mathbb{R}^2$ there is a nonconstant Neumann eigenfunction $u$ that is locally constant on the boundary, must $\Omega$ be a disk or an annulus? This question can be understood as a weaker analog of the well known Schiffer conjecture, in that the function $u$ is allowed to take a different constant value on each connected component of $\partial \Omega$ yet many of the known rigidity properties of the original problem are essentially preserved. Our main result provides a negative answer by constructing a family of nontrivial doubly connected domains $\Omega$ with the above property. As a consequence, a certain linear combination of the indicator functions of the domains $\Omega$ and of the bounded component of the complement $\mathbb{R}^2\backslash\overline{\Omega}$ fails to have the Pompeiu property. Furthermore, our construction implies the existence of continuous, compactly supported stationary weak solutions to the 2D incompressible Euler equations which are not locally radial.


title: Photo-induced reversible modification of the Curie-Weiss temperature in paramagnetic gadolinium compounds

abstract: Gadolinium oxyhydride GdHO is a photochromic material that darkens under illumination and bleaches back by thermal relaxation. As an inorganic photochromic material that can be easily deposited by magnetron sputtering, GdHO has very interesting potential applications as a functional material, specially for smart glazing applications. However, the underlying reasons behind the photochromic mechanism-which can be instrumental for the correct optimisation of GdOH for different applications-are not completely understood. In this paper, we rely on the well-stablished magnetic properties of Gd$^{3+}$ to shed light on this matter. GdOH thin films present paramagnetic behaviour similar to other Gd$^{3+}$ compounds such as Gd$_2$O$_3$. Illumination of the films result in a reversible increase of the Curie-Weiss temperature pointing to RKKY interactions, which is consistent with the resistivity decrease observed in the photo-darkened films.


title: Fast Safe Rectangular Corridor-based Online AGV Trajectory Optimization with Obstacle Avoidance

abstract: Automated Guided Vehicles (AGVs) are essential in various industries for their efficiency and adaptability. However, planning trajectories for AGVs in obstacle-dense, unstructured environments presents significant challenges due to the nonholonomic kinematics, abundant obstacles, and the scenario's nonconvex and constrained nature. To address this, we propose an efficient trajectory planning framework for AGVs by formulating the problem as an optimal control problem. Our framework utilizes the fast safe rectangular corridor (FSRC) algorithm to construct rectangular convex corridors, representing avoidance constraints as box constraints. This eliminates redundant obstacle influences and accelerates the solution speed. Additionally, we employ the Modified Visibility Graph algorithm to speed up path planning and a boundary discretization strategy to expedite FSRC construction. Experimental results demonstrate the effectiveness and superiority of our framework, particularly in computational efficiency. Compared to advanced frameworks, our framework achieves computational efficiency gains of 1 to 2 orders of magnitude. Notably, FSRC significantly outperforms other safe convex corridor-based methods regarding computational efficiency.


title: Identifying Concerns When Specifying Machine Learning-Enabled Systems: A Perspective-Based Approach

abstract: Engineering successful machine learning (ML)-enabled systems poses various challenges from both a theoretical and a practical side. Among those challenges are how to effectively address unrealistic expectations of ML capabilities from customers, managers and even other team members, and how to connect business value to engineering and data science activities composed by interdisciplinary teams. In this paper, we present PerSpecML, a perspective-based approach for specifying ML-enabled systems that helps practitioners identify which attributes, including ML and non-ML components, are important to contribute to the overall system's quality. The approach involves analyzing 59 concerns related to typical tasks that practitioners face in ML projects, grouping them into five perspectives: system objectives, user experience, infrastructure, model, and data. Together, these perspectives serve to mediate the communication between business owners, domain experts, designers, software and ML engineers, and data scientists. The creation of PerSpecML involved a series of validations conducted in different contexts: (i) in academia, (ii) with industry representatives, and (iii) in two real industrial case studies. As a result of the diverse validations and continuous improvements, PerSpecML stands as a promising approach, poised to positively impact the specification of ML-enabled systems, particularly helping to reveal key components that would have been otherwise missed without using PerSpecML.


title: Efficiently Identifying Hotspots in a Spatially Varying Field with Multiple Robots

abstract: In this paper, we present algorithms to identify environmental hotspots using mobile sensors. We examine two approaches: one involving a single robot and another using multiple robots coordinated through a decentralized robot system. We introduce an adaptive algorithm that does not require precise knowledge of Gaussian Processes (GPs) hyperparameters, making the modeling process more flexible. The robots operate for a pre-defined time in the environment. The multi-robot system uses Voronoi partitioning to divide tasks and a Monte Carlo Tree Search for optimal path planning. Our tests on synthetic and a real-world dataset of Chlorophyll density from a Pacific Ocean sub-region suggest that accurate estimation of GP hyperparameters may not be essential for hotspot detection, potentially simplifying environmental monitoring tasks.


title: Uncertainty quantification for learned ISTA

abstract: Model-based deep learning solutions to inverse problems have attracted increasing attention in recent years as they bridge state-of-the-art numerical performance with interpretability. In addition, the incorporated prior domain knowledge can make the training more efficient as the smaller number of parameters allows the training step to be executed with smaller datasets. Algorithm unrolling schemes stand out among these model-based learning techniques. Despite their rapid advancement and their close connection to traditional high-dimensional statistical methods, they lack certainty estimates and a theory for uncertainty quantification is still elusive. This work provides a step towards closing this gap proposing a rigorous way to obtain confidence intervals for the LISTA estimator.

categories: stat.ML cs.IT cs.LG eess.IV eess.SP math.IT


title: SLMIA-SR: Speaker-Level Membership Inference Attacks against Speaker Recognition Systems

abstract: Membership inference attacks allow adversaries to determine whether a particular example was contained in the model's training dataset. While previous works have confirmed the feasibility of such attacks in various applications, none has focused on speaker recognition (SR), a promising voice-based biometric recognition technique. In this work, we propose SLMIA-SR, the first membership inference attack tailored to SR. In contrast to conventional example-level attack, our attack features speaker-level membership inference, i.e., determining if any voices of a given speaker, either the same as or different from the given inference voices, have been involved in the training of a model. It is particularly useful and practical since the training and inference voices are usually distinct, and it is also meaningful considering the open-set nature of SR, namely, the recognition speakers were often not present in the training data. We utilize intra-similarity and inter-dissimilarity, two training objectives of SR, to characterize the differences between training and non-training speakers and quantify them with two groups of features driven by carefully-established feature engineering to mount the attack. To improve the generalizability of our attack, we propose a novel mixing ratio training strategy to train attack models. To enhance the attack performance, we introduce voice chunk splitting to cope with the limited number of inference voices and propose to train attack models dependent on the number of inference voices. Our attack is versatile and can work in both white-box and black-box scenarios. Additionally, we propose two novel techniques to reduce the number of black-box queries while maintaining the attack performance. Extensive experiments demonstrate the effectiveness of SLMIA-SR.


title: Inclusive-PIM: Hardware-Software Co-design for Broad Acceleration on Commercial PIM Architectures

abstract: Continual demand for memory bandwidth has made it worthwhile for memory vendors to reassess processing in memory (PIM), which enables higher bandwidth by placing compute units in/near-memory. As such, memory vendors have recently proposed commercially viable PIM designs. However, these proposals are largely driven by the needs of (a narrow set of) machine learning (ML) primitives. While such proposals are reasonable given the the growing importance of ML, as memory is a pervasive component, %in this work, we make there is a case for a more inclusive PIM design that can accelerate primitives across domains. In this work, we ascertain the capabilities of commercial PIM proposals to accelerate various primitives across domains. We first begin with outlining a set of characteristics, termed PIM-amenability-test, which aid in assessing if a given primitive is likely to be accelerated by PIM. Next, we apply this test to primitives under study to ascertain efficient data-placement and orchestration to map the primitives to underlying PIM architecture. We observe here that, even though primitives under study are largely PIM-amenable, existing commercial PIM proposals do not realize their performance potential for these primitives. To address this, we identify bottlenecks that arise in PIM execution and propose hardware and software optimizations which stand to broaden the acceleration reach of commercial PIM designs (improving average PIM speedups from 1.12x to 2.49x relative to a GPU baseline). Overall, while we believe emerging commercial PIM proposals add a necessary and complementary design point in the application acceleration space, hardware-software co-design is necessary to deliver their benefits broadly.


title: Estimates of Proton and Electron Heating Rates Extended to the Near-Sun Environment

abstract: A central problem of space plasma physics is how protons and electrons are heated in a turbulent, magnetized plasma. The differential heating of charged species due to dissipation of turbulent fluctuations plays a key role in solar wind evolution. Measurements from previous heliophysics missions have provided estimates of proton and electron heating rates beyond 0.27 au. Using Parker Solar Probe (PSP) data accumulated during the first ten encounters, we extend the evaluation of the individual rates of heat deposition for protons and electrons in to a distance of 0.063 au (13.5 solar radii), in the newly formed solar wind. The PSP data in the near-Sun environment show different behavior of the electron heat conduction flux from what was predicted from previous fits to Helios and Ulysses data. Consequently, the empirically derived proton and electron heating rates exhibit significantly different behavior than previous reports, with the proton heating becoming increasingly dominant over electron heating at decreasing heliocentric distances. We find that the protons receive about 80% of the total plasma heating at ~ 13 solar radii, slightly higher than the near-Earth values. This empirically derived heating partition between protons and electrons will help to constrain theoretical models of solar wind heating.


title: Viewpoint Textual Inversion: Unleashing Novel View Synthesis with Pretrained 2D Diffusion Models

abstract: Text-to-image diffusion models understand spatial relationship between objects, but do they represent the true 3D structure of the world from only 2D supervision? We demonstrate that yes, 3D knowledge is encoded in 2D image diffusion models like Stable Diffusion, and we show that this structure can be exploited for 3D vision tasks. Our method, Viewpoint Neural Textual Inversion (ViewNeTI), controls the 3D viewpoint of objects in generated images from frozen diffusion models. We train a small neural mapper to take camera viewpoint parameters and predict text encoder latents; the latents then condition the diffusion generation process to produce images with the desired camera viewpoint. ViewNeTI naturally addresses Novel View Synthesis (NVS). By leveraging the frozen diffusion model as a prior, we can solve NVS with very few input views; we can even do single-view novel view synthesis. Our single-view NVS predictions have good semantic details and photorealism compared to prior methods. Our approach is well suited for modeling the uncertainty inherent in sparse 3D vision problems because it can efficiently generate diverse samples. Our view-control mechanism is general, and can even change the camera view in images generated by user-defined prompts.


title: Fiber Loop Quantum Buffer for Photonic Qubits

abstract: We report a fiber loop quantum buffer based on a low-loss 2$\times$2 switch and a unit delay made of a fiber delay line. We characterize the device by using a two-photon polarization entangled state in which one photon of the entangled photon pair is stored and retrieved at a repetition rate up to 78$\,\rm{kHz}$. The device, which enables integer multiples of a unit delay, can store the qubit state in a unit of fiber delay line up to 5.4$\,\rm{km}$ and the number of loop round-trips up to 3. Furthermore, we configure the device with other active elements to realize integer multiplies and divider of a unit delay of a qubit. The quantum state tomography is performed on the retrieved photon and its entangled photon. We obtain a state fidelity $>94\%$ with a maximum storage time of 52$\,\mu\rm{sec}$. To further characterize the storing and retrieving processes of the device, we perform entanglement-assisted quantum process tomography on the buffered qubit state. The process fidelity of the device is $>$ 0.98. Our result implies that the device preserves the superposition and entanglement of a qubit state from a two-photon polarization-entangled state. This is a significant step towards facilitating applications in optical asynchronous transfer mode (ATM) based quantum networks.


title: Folding Attention: Memory and Power Optimization for On-Device Transformer-based Streaming Speech Recognition

abstract: Transformer-based models excel in speech recognition. Existing efforts to optimize Transformer inference, typically for long-context applications, center on simplifying attention score calculations. However, streaming speech recognition models usually process a limited number of tokens each time, making attention score calculation less of a bottleneck. Instead, the bottleneck lies in the linear projection layers of multi-head attention and feedforward networks, constituting a substantial portion of the model size and contributing significantly to computation, memory, and power usage. To address this bottleneck, we propose folding attention, a technique targeting these linear layers, significantly reducing model size and improving memory and power efficiency. Experiments on on-device Transformer-based streaming speech recognition models show that folding attention reduces model size (and corresponding memory consumption) by up to 24% and power consumption by up to 23%, all without compromising model accuracy or computation overhead.


title: Asteroseismology of double-mode radial $\delta$ Scuti stars: AE Ursae Majoris and RV Arietis

abstract: We construct complex seismic models of two high-amplitude delta Sct stars, AE UMa and RV Ari, each pulsating in two radial modes: fundamental and first overtone. The models reproduce, besides the frequencies of two radial modes, also the amplitude of bolometric flux variations (the parameter f) for the dominant mode. Applying the Monte Carlo-based Bayesian analysis, we derive strong constraints, on the parameters of the model as well as on the free parameters of the theory. A vast majority of seismic models of the two stars are just at the beginning of hydrogen-shell burning and a small fraction is at the very end of an overall contraction. The stars have a similar age of about 1.6 Gyr for the hydrogen-shell burning phase. Both stars have unusual low overshooting from the convective core; about 0.02 and 0.004 of the pressure scale height for AE UMa and RV Ari, respectively. This result presumably indicates that overshooting should vary with time and scale with a decreasing convective core. The efficiency of convection in the envelope of both stars is rather low and described by the mixing length parameter alphaMLT of about 0.3-0.6. The third frequency of RV Ari, confirmed by us in the TESS photometry, can only be associated with mixed nonradial modes l=1, g4-g8 or l=2, g10-g12. We include the dipole mode into our Bayesian modelling and demonstrate its huge asteroseismic potential.


title: Leveraging Contextual Information for Effective Entity Salience Detection

abstract: In text documents such as news articles, the content and key events usually revolve around a subset of all the entities mentioned in a document. These entities, often deemed as salient entities, provide useful cues of the aboutness of a document to a reader. Identifying the salience of entities was found helpful in several downstream applications such as search, ranking, and entity-centric summarization, among others. Prior work on salient entity detection mainly focused on machine learning models that require heavy feature engineering. We show that fine-tuning medium-sized language models with a cross-encoder style architecture yields substantial performance gains over feature engineering approaches. To this end, we conduct a comprehensive benchmarking of four publicly available datasets using models representative of the medium-sized pre-trained language model family. Additionally, we show that zero-shot prompting of instruction-tuned language models yields inferior results, indicating the task's uniqueness and complexity.


title: Franks' dichotomy for toric manifolds, Hofer-Zehnder conjecture, and gauged linear sigma model

abstract: We prove that for any compact toric symplectic manifold, if a Hamiltonian diffeomorphism admits more fixed points, counted homologically, than the total Betti number, then it has infinitely many simple periodic points. This provides a vast generalization of Franks' famous two or infinity dichotomy for periodic orbits of area-preserving diffeomorphisms on the two-sphere, and establishes a conjecture attributed to Hofer-Zehnder in the case of toric manifolds. The key novelty is the application of gauged linear sigma model and its bulk deformations to the study of Hamiltonian dynamics of symplectic quotients.


title: An Automated Machine Learning Approach for Detecting Anomalous Peak Patterns in Time Series Data from a Research Watershed in the Northeastern United States Critical Zone

abstract: This paper presents an automated machine learning framework designed to assist hydrologists in detecting anomalies in time series data generated by sensors in a research watershed in the northeastern United States critical zone. The framework specifically focuses on identifying peak-pattern anomalies, which may arise from sensor malfunctions or natural phenomena. However, the use of classification methods for anomaly detection poses challenges, such as the requirement for labeled data as ground truth and the selection of the most suitable deep learning model for the given task and dataset. To address these challenges, our framework generates labeled datasets by injecting synthetic peak patterns into synthetically generated time series data and incorporates an automated hyperparameter optimization mechanism. This mechanism generates an optimized model instance with the best architectural and training parameters from a pool of five selected models, namely Temporal Convolutional Network (TCN), InceptionTime, MiniRocket, Residual Networks (ResNet), and Long Short-Term Memory (LSTM). The selection is based on the user's preferences regarding anomaly detection accuracy and computational cost. The framework employs Time-series Generative Adversarial Networks (TimeGAN) as the synthetic dataset generator. The generated model instances are evaluated using a combination of accuracy and computational cost metrics, including training time and memory, during the anomaly detection process. Performance evaluation of the framework was conducted using a dataset from a watershed, demonstrating consistent selection of the most fitting model instance that satisfies the user's preferences.


title: Bipedal Walking on Constrained Footholds with MPC Footstep Control

abstract: Bipedal robots promise the ability to traverse rough terrain quickly and efficiently, and indeed, humanoid robots can now use strong ankles and careful foot placement to traverse discontinuous terrain. However, more agile underactuated bipeds have small feet and weak ankles, and must constantly adjust their planned footstep position to maintain balance. We introduce a new model-predictive footstep controller which jointly optimizes over the robot's discrete choice of stepping surface, impending footstep position sequence, ankle torque in the sagittal plane, and center of mass trajectory, to track a velocity command. The controller is formulated as a single Mixed Integer Quadratic Program (MIQP) which is solved at 50-200 Hz, depending on terrain complexity. We implement a state of the art real-time elevation mapping and convex terrain decomposition framework to inform the controller of its surroundings in the form on convex polygons representing steppable terrain. We investigate the capabilities and challenges of our approach through hardware experiments on the underactuated biped Cassie.


title: Test Case Generation and Test Oracle Support for Testing CPSs using Hybrid Models

abstract: Cyber-Physical Systems (CPSs) play a central role in the behavior of a wide range of autonomous physical systems such as medical devices, autonomous vehicles, and smart homes, many of which are safety-critical. CPSs are often specified iteratively as a sequence of models at different levels that can be tested via simulation systems at early stages of their development cycle. One such model is a hybrid automaton; these are used frequently for CPS applications and have the advantage of encapsulating both continuous and discrete CPS behaviors. When testing CPSs, engineers can take advantage of these models to generate test cases that target both types of these behaviors. Moreover, since these models are constructed early in the development process for CPSs, they allow test cases to be generated early in that process for those CPSs, even before simulation models of the CPSs have been designed. One challenge when testing CPSs is that these systems may operate differently even under an identically applied test scenario. In such cases, we cannot employ test oracles that use predetermined deterministic behaviors; instead, test oracles should consider sets of desired behaviors in order to determine whether the CPS has behaved appropriately. In this paper we present a test case generation technique, HYTEST, that generates test cases based on hybrid models, accompanied by appropriate test oracles, for use in testing CPSs early in their development cycle. To evaluate the effectiveness and efficiency of HYTEST, we conducted an empirical study in which we applied the technique to several CPSs and measured its ability to detect faults in those CPSs and the amount of time required to perform the testing process. The results of the study show that HYTEST was able to detect faults more effectively and efficiently than the baseline techniques we compare it to.