title: A spectral element solution of the Poisson equation with shifted boundary polynomial corrections: influence of the surrogate to true boundary mapping and an asymptotically preserving Robin formulation

abstract: We present a new high-order accurate spectral element solution to the two-dimensional scalar Poisson equation subject to a general Robin boundary condition. The solution is based on a simplified version of the shifted boundary method employing a continuous arbitrary order $hp$-Galerkin spectral element method as the numerical discretization procedure. The simplification relies on a polynomial correction to avoid explicitly evaluating high-order partial derivatives from the Taylor series expansion, which traditionally have been used within the shifted boundary method. In this setting, we apply an extrapolation and novel interpolation approach to project the basis functions from the true domain onto the approximate surrogate domain. The resulting solution provides a method that naturally incorporates curved geometrical features of the domain, overcomes complex and cumbersome mesh generation, and avoids problems with small-cut-cells. Dirichlet, Neumann, and general Robin boundary conditions are enforced weakly through: i) a generalized Nitsche's method and ii) a generalized Aubin's method. For this, a consistent asymptotic preserving formulation of the embedded Robin formulations is presented. We present several numerical experiments and analysis of the algorithmic properties of the different weak formulations. With this, we include convergence studies under polynomial, $p$, increase of the basis functions, mesh, $h$, refinement, and matrix conditioning to highlight the spectral and algebraic convergence features, respectively. This is done to assess the influence of errors across variational formulations, polynomial order, mesh size, and mappings between the true and surrogate boundaries.


title: Combating Representation Learning Disparity with Geometric Harmonization

abstract: Self-supervised learning (SSL) as an effective paradigm of representation learning has achieved tremendous success on various curated datasets in diverse scenarios. Nevertheless, when facing the long-tailed distribution in real-world applications, it is still hard for existing methods to capture transferable and robust representation. Conventional SSL methods, pursuing sample-level uniformity, easily leads to representation learning disparity where head classes dominate the feature regime but tail classes passively collapse. To address this problem, we propose a novel Geometric Harmonization (GH) method to encourage category-level uniformity in representation learning, which is more benign to the minority and almost does not hurt the majority under long-tailed distribution. Specially, GH measures the population statistics of the embedding space on top of self-supervised learning, and then infer an fine-grained instance-wise calibration to constrain the space expansion of head classes and avoid the passive collapse of tail classes. Our proposal does not alter the setting of SSL and can be easily integrated into existing methods in a low-cost manner. Extensive results on a range of benchmark datasets show the effectiveness of GH with high tolerance to the distribution skewness. Our code is available at https://github.com/MediaBrain-SJTU/Geometric-Harmonization.


title: Proving Test Set Contamination in Black Box Language Models

abstract: Large language models are trained on vast amounts of internet data, prompting concerns and speculation that they have memorized public benchmarks. Going from speculation to proof of contamination is challenging, as the pretraining data used by proprietary models are often not publicly accessible. We show that it is possible to provide provable guarantees of test set contamination in language models without access to pretraining data or model weights. Our approach leverages the fact that when there is no data contamination, all orderings of an exchangeable benchmark should be equally likely. In contrast, the tendency for language models to memorize example order means that a contaminated language model will find certain canonical orderings to be much more likely than others. Our test flags potential contamination whenever the likelihood of a canonically ordered benchmark dataset is significantly higher than the likelihood after shuffling the examples. We demonstrate that our procedure is sensitive enough to reliably prove test set contamination in challenging situations, including models as small as 1.4 billion parameters, on small test sets of only 1000 examples, and datasets that appear only a few times in the pretraining corpus. Using our test, we audit five popular publicly accessible language models for test set contamination and find little evidence for pervasive contamination.


title: The six blinds and the elephant or an interdisciplinary selection of measurement features

abstract: We propose here selected actual features of measurement problems based on our concerns in our respective fields of research. Their technical similarity in apparently disconnected fields motivate this common communication. Problems of coherence and consistency, correlation, randomness and uncertainty are exposed in various fields including physics, decision theory and game theory, while the underlying mathematical structures are very similar.

categories: math-ph math.MP math.PR math.ST quant-ph stat.TH


title: The metallicity dependence and evolutionary times of merging binary black holes: Combined constraints from individual gravitational-wave detections and the stochastic background

abstract: The advent of gravitational-wave astronomy is now allowing for the study of compact binary merger demographics throughout the Universe. This information can be leveraged as tools for understanding massive stars, their environments, and their evolution. One active question is the nature of compact binary formation: the environmental and chemical conditions required for black hole birth and the time delays experienced by binaries before they merge. Gravitational-wave events detected today, however, primarily occur at low or moderate redshifts due to current interferometer sensitivity, therefore limiting our ability to probe the high redshift behavior of these quantities. In this work, we circumvent this limitation by using an additional source of information: observational limits on the gravitational-wave background from unresolved binaries in the distant Universe. Using current gravitational-wave data from the first three observing runs of LIGO-Virgo-KAGRA, we combine catalogs of directly detected binaries and limits on the stochastic background to constrain the time-delay distribution and metallicity dependence of binary black hole evolution. Looking to the future, we also explore how these constraints will be improved at the Advanced LIGO A+ sensitivity. We conclude that, although binary black hole formation cannot be strongly constrained with today's data, the future detection (or a non-detection) of the gravitational-wave background with Advanced LIGO A+ will carry strong implications for the evolution of binary black holes.


title: A Survey on Transferability of Adversarial Examples across Deep Neural Networks

abstract: The emergence of Deep Neural Networks (DNNs) has revolutionized various domains by enabling the resolution of complex tasks spanning image recognition, natural language processing, and scientific problem-solving. However, this progress has also brought to light a concerning vulnerability: adversarial examples. These crafted inputs, imperceptible to humans, can manipulate machine learning models into making erroneous predictions, raising concerns for safety-critical applications. An intriguing property of this phenomenon is the transferability of adversarial examples, where perturbations crafted for one model can deceive another, often with a different architecture. This intriguing property enables black-box attacks which circumvents the need for detailed knowledge of the target model. This survey explores the landscape of the adversarial transferability of adversarial examples. We categorize existing methodologies to enhance adversarial transferability and discuss the fundamental principles guiding each approach. While the predominant body of research primarily concentrates on image classification, we also extend our discussion to encompass other vision tasks and beyond. Challenges and opportunities are discussed, highlighting the importance of fortifying DNNs against adversarial vulnerabilities in an evolving landscape.


title: ixFLIM: Interferometric Excitation Fluorescence Lifetime Imaging Microscopy

abstract: Fluorescence lifetime imaging microscopy (FLIM) is a well-established technique with numerous imaging applications. Yet, one of the limitations of FLIM is that it provides information about the emitting state only. Here, we present an extension of FLIM by interferometric measurement of fluorescence excitation spectra. Interferometric Excitation Fluorescence Lifetime Imaging Microscopy (ixFLIM) reports on the correlation of the excitation spectra and emission lifetime, providing the correlation between the ground-state absorption and excited-state emission. As such, it extends the applicability of FLIM and removes some of its limitations. We introduce ixFLIM on progressively more complex systems and apply it to quantitative resonance energy transfer imaging from a single measurement.


title: Skew Products on the Berkovich Projective Line

abstract: In this article, we develop a dynamical theory for what shall be called a skew product on the Berkovich projective line, $\phi_*: \mathbb{P}^1_{\text{an}}(K) \to \mathbb{P}^1_{\text{an}}(K)$ over a non-Archimedean field $K$. These functions are defined algebraically yet strictly generalise the notion of a rational map on $\mathbb{P}^1_{\text{an}}$. We describe the analytical, algebraic, and dynamical properties of skew products, including a study of periodic points, and a Fatou/Julia dichotomy. The article culminates with the classification of the connected components of the Fatou set.


title: Approximate Leave-one-out Cross Validation for Regression with $\ell_1$ Regularizers (extended version)

abstract: The out-of-sample error (OO) is the main quantity of interest in risk estimation and model selection. Leave-one-out cross validation (LO) offers a (nearly) distribution-free yet computationally demanding approach to estimate OO. Recent theoretical work showed that approximate leave-one-out cross validation (ALO) is a computationally efficient and statistically reliable estimate of LO (and OO) for generalized linear models with differentiable regularizers. For problems involving non-differentiable regularizers, despite significant empirical evidence, the theoretical understanding of ALO's error remains unknown. In this paper, we present a novel theory for a wide class of problems in the generalized linear model family with non-differentiable regularizers. We bound the error |ALO - LO| in terms of intuitive metrics such as the size of leave-i-out perturbations in active sets, sample size n, number of features p and regularization parameters. As a consequence, for the $\ell_1$-regularized problems, we show that |ALO - LO| goes to zero as p goes to infinity while n/p and SNR are fixed and bounded.


title: InstOptima: Evolutionary Multi-objective Instruction Optimization via Large Language Model-based Instruction Operators

abstract: Instruction-based language modeling has received significant attention in pretrained language models. However, the efficiency of instruction engineering remains low and hinders the development of instruction studies. Recent studies have focused on automating instruction generation, but they primarily aim to improve performance without considering other crucial objectives that impact instruction quality, such as instruction length and perplexity. Therefore, we propose a novel approach (i.e., InstOptima) that treats instruction generation as an evolutionary multi-objective optimization problem. In contrast to text edition-based methods, our approach utilizes a large language model (LLM) to simulate instruction operators, including mutation and crossover. Furthermore, we introduce an objective-guided mechanism for these operators, allowing the LLM to comprehend the objectives and enhance the quality of the generated instructions. Experimental results demonstrate improved fine-tuning performance and the generation of a diverse set of high-quality instructions.


title: JudgeLM: Fine-tuned Large Language Models are Scalable Judges

abstract: Evaluating Large Language Models (LLMs) in open-ended scenarios is challenging because existing benchmarks and metrics can not measure them comprehensively. To address this problem, we propose to fine-tune LLMs as scalable judges (JudgeLM) to evaluate LLMs efficiently and effectively in open-ended benchmarks. We first propose a comprehensive, large-scale, high-quality dataset containing task seeds, LLMs-generated answers, and GPT-4-generated judgments for fine-tuning high-performance judges, as well as a new benchmark for evaluating the judges. We train JudgeLM at different scales from 7B, 13B, to 33B parameters, and conduct a systematic analysis of its capabilities and behaviors. We then analyze the key biases in fine-tuning LLM as a judge and consider them as position bias, knowledge bias, and format bias. To address these issues, JudgeLM introduces a bag of techniques including swap augmentation, reference support, and reference drop, which clearly enhance the judge's performance. JudgeLM obtains the state-of-the-art judge performance on both the existing PandaLM benchmark and our proposed new benchmark. Our JudgeLM is efficient and the JudgeLM-7B only needs 3 minutes to judge 5K samples with 8 A100 GPUs. JudgeLM obtains high agreement with the teacher judge, achieving an agreement exceeding 90% that even surpasses human-to-human agreement. JudgeLM also demonstrates extended capabilities in being judges of the single answer, multimodal models, multiple answers, and multi-turn chat.


title: DeepShaRM: Multi-View Shape and Reflectance Map Recovery Under Unknown Lighting

abstract: Geometry reconstruction of textureless, non-Lambertian objects under unknown natural illumination (i.e., in the wild) remains challenging as correspondences cannot be established and the reflectance cannot be expressed in simple analytical forms. We derive a novel multi-view method, DeepShaRM, that achieves state-of-the-art accuracy on this challenging task. Unlike past methods that formulate this as inverse-rendering, i.e., estimation of reflectance, illumination, and geometry from images, our key idea is to realize that reflectance and illumination need not be disentangled and instead estimated as a compound reflectance map. We introduce a novel deep reflectance map estimation network that recovers the camera-view reflectance maps from the surface normals of the current geometry estimate and the input multi-view images. The network also explicitly estimates per-pixel confidence scores to handle global light transport effects. A deep shape-from-shading network then updates the geometry estimate expressed with a signed distance function using the recovered reflectance maps. By alternating between these two, and, most important, by bypassing the ill-posed problem of reflectance and illumination decomposition, the method accurately recovers object geometry in these challenging settings. Extensive experiments on both synthetic and real-world data clearly demonstrate its state-of-the-art accuracy.


title: Growth of cancer stem cell driven tumors: staged invasion, linear determinacy, and the tumor invasion paradox

abstract: We study growth of solid tumors in a partial differential equation model introduced by Hillen et al for the interaction between tumor cells (TCs) and cancer stem cells (CSCs). We find that invasion into the cancer-free state may be separated into two regimes, depending on the death rate of tumor cells. In the first, staged invasion regime, invasion into the cancer-free state is lead by tumor cells, which are then subsequently invaded at a slower speed by cancer stem cells. In the second, TC extinction regime, cancer stem cells directly invade the cancer-free state. Relying on recent results establishing front selection propagation under marginal stability assumptions, we use geometric singular perturbation theory to establish existence and selection properties of front solutions which describe both the primary and secondary invasion processes. With rigorous predictions for the invasion speeds, we are then able to heuristically predict how the total cancer mass as a function of time depends on the TC death rate, finding in some situations a tumor invasion paradox, in which increasing the TC death rate leads to an increase in the total cancer mass. Our methods give a general approach for verifying linear determinacy of spreading speeds of invasion fronts in systems with fast-slow structure.


title: Grow Your Limits: Continuous Improvement with Real-World RL for Robotic Locomotion

abstract: Deep reinforcement learning (RL) can enable robots to autonomously acquire complex behaviors, such as legged locomotion. However, RL in the real world is complicated by constraints on efficiency, safety, and overall training stability, which limits its practical applicability. We present APRL, a policy regularization framework that modulates the robot's exploration over the course of training, striking a balance between flexible improvement potential and focused, efficient exploration. APRL enables a quadrupedal robot to efficiently learn to walk entirely in the real world within minutes and continue to improve with more training where prior work saturates in performance. We demonstrate that continued training with APRL results in a policy that is substantially more capable of navigating challenging situations and is able to adapt to changes in dynamics with continued training.


title: The limiting spectral law for sparse iid matrices

abstract: Let $A$ be an $n\times n$ matrix with iid entries where $A_{ij} \sim \mathrm{Ber}(p)$ is a Bernoulli random variable with parameter $p = d/n$. We show that the empirical measure of the eigenvalues converges, in probability, to a deterministic distribution as $n \rightarrow \infty$. This essentially resolves a long line of work to determine the spectral laws of iid matrices and is the first known example for non-Hermitian random matrices at this level of sparsity.


title: Magnetic microcalorimeters for primary activity standardization within the EMPIR project PrimA-LTD

abstract: The precision of existing decay data of radionuclides for activity determination is often a limitation for actual applications in science, society, and industry. For this reason, the EMPIR project PrimA-LTD aims to introduce an advanced primary activity standardization technique that is based on magnetic microcalorimeters (MMCs) and that will offer very low energy threshold of few eV and a decay scheme independent detection efficiency close to 100%. As a proof of concept, we developed two MMC-based detector types in order to standardize an $\alpha$-decaying, a $\beta$-decaying and an electron capture decaying isotope. One detector type aims to introduce a reusable detector setup, while the other aims to provide highly accurate decay spectra by high resolution measurements with high statistics. We present the designs, fabrication status and first characterization measurements of both detectors types and outline next steps.


title: Positivity-preserving and entropy-bounded discontinuous Galerkin method for the chemically reacting, compressible Navier-Stokes equations

abstract: This article concerns the development of a fully conservative, positivity-preserving, and entropy-bounded discontinuous Galerkin scheme for simulating the multicomponent, chemically reacting, compressible Navier-Stokes equations with complex thermodynamics. In particular, we extend to viscous flows the fully conservative, positivity-preserving, and entropy-bounded discontinuous Galerkin method for the chemically reacting Euler equations that we previously introduced. An important component of the formulation is the positivity-preserving Lax-Friedrichs-type viscous flux function devised by Zhang [J. Comput. Phys., 328 (2017), pp. 301-343], which was adapted to multicomponent flows by Du and Yang [J. Comput. Phys., 469 (2022), pp. 111548] in a manner that treats the inviscid and viscous fluxes as a single flux. Here, we similarly extend the aforementioned flux function to multicomponent flows but separate the inviscid and viscous fluxes. This separation of the fluxes allows for use of other inviscid flux functions, as well as enforcement of entropy boundedness on only the convective contribution to the evolved state, as motivated by physical and mathematical principles. We also discuss in detail how to account for boundary conditions and incorporate previously developed pressure-equilibrium-preserving techniques into the positivity-preserving framework. Comparisons between the Lax-Friedrichs-type viscous flux function and more conventional flux functions are provided, the results of which motivate an adaptive solution procedure that employs the former only when the element-local solution average has negative species concentrations, nonpositive density, or nonpositive pressure. A variety of multicomponent, viscous flows is computed, ranging from a one-dimensional shock tube problem to multidimensional detonation waves and shock/mixing-layer interaction.


title: Generative Fractional Diffusion Models

abstract: We introduce the first continuous-time score-based generative model that leverages fractional diffusion processes for its underlying dynamics. Although diffusion models have excelled at capturing data distributions, they still suffer from various limitations such as slow convergence, mode-collapse on imbalanced data, and lack of diversity. These issues are partially linked to the use of light-tailed Brownian motion (BM) with independent increments. In this paper, we replace BM with an approximation of its non-Markovian counterpart, fractional Brownian motion (fBM), characterized by correlated increments and Hurst index $H \in (0,1)$, where $H=1/2$ recovers the classical BM. To ensure tractable inference and learning, we employ a recently popularized Markov approximation of fBM (MA-fBM) and derive its reverse time model, resulting in generative fractional diffusion models (GFDMs). We characterize the forward dynamics using a continuous reparameterization trick and propose an augmented score matching loss to efficiently learn the score-function, which is partly known in closed form, at minimal added cost. The ability to drive our diffusion model via fBM provides flexibility and control. $H \leq 1/2$ enters the regime of rough paths whereas $H>1/2$ regularizes diffusion paths and invokes long-term memory as well as a heavy-tailed behaviour (super-diffusion). The Markov approximation allows added control by varying the number of Markov processes linearly combined to approximate fBM. Our evaluations on real image datasets demonstrate that GFDM achieves greater pixel-wise diversity and enhanced image quality, as indicated by a lower FID, offering a promising alternative to traditional diffusion models.


title: In-Context Learning Dynamics with Random Binary Sequences

abstract: Large language models (LLMs) trained on huge corpora of text datasets demonstrate intriguing capabilities, achieving state-of-the-art performance on tasks they were not explicitly trained for. The precise nature of LLM capabilities is often mysterious, and different prompts can elicit different capabilities through in-context learning. We propose a framework that enables us to analyze in-context learning dynamics to understand latent concepts underlying LLMs' behavioral patterns. This provides a more nuanced understanding than success-or-failure evaluation benchmarks, but does not require observing internal activations as a mechanistic interpretation of circuits would. Inspired by the cognitive science of human randomness perception, we use random binary sequences as context and study dynamics of in-context learning by manipulating properties of context data, such as sequence length. In the latest GPT-3.5+ models, we find emergent abilities to generate seemingly random numbers and learn basic formal languages, with striking in-context learning dynamics where model outputs transition sharply from seemingly random behaviors to deterministic repetition.


title: Heavy quark fragmentation function in 't Hooft Model

abstract: We carry out a comprehensive study of the quark-to-meson fragmentation function in the 't Hooft model, i.e., the two-dimensional Quantum Chromodynamics (QCD) in $N_c\to \infty$ limit, following the operator definition pioneered by Collins and Soper. We apply the Hamiltonian approach as well as the diagrammatic approach to construct the functional form of the quark-to-meson fragmentation function in terms of the meson's light-cone wave function. For the sake of comparison, we also investigate the heavy quark fragmentation into quarkonium in two-dimensional QCD within the framework of the nonrelativistic QCD (NRQCD) factorization, at the lowest order in quark velocity. In the heavy quark limit, the quark fragmentation function obtained from the {\it ab initio} method agrees well, both analytically and numerically, with that obtained from the NRQCD approach. This agreement might be regarded as a nontrivial justification for the validity of both field-theoretical approaches to compute the heavy quark fragmentation function.


title: Criteria for Davies Irreducibility of Markovian Quantum Dynamics

abstract: The dynamics of Markovian open quantum systems are described by Lindblad master equations, generating a quantum dynamical semigroup. An important concept for such systems is (Davies) irreducibility, i.e., the question whether there exist non-trivial invariant subspaces. Steady states of irreducible systems are unique and faithful, i.e., they have full rank. In the 1970s, Frigerio showed that a system is irreducible if the Lindblad operators span a self-adjoint set with trivial commutant. We discuss a more general and powerful algebraic criterion, showing that a system is irreducible if and only if the multiplicative algebra generated by the Lindblad operators $L_a$ and the operator $K=iH+\sum_a L^\dagger_aL_a$, involving the Hamiltonian $H$, is the entire operator space. Examples for two-level systems, show that a change of Hamiltonian terms as well as the addition or removal of dissipators can render a reducible system irreducible and vice versa. Examples for many-body systems show that a large class of spin chains can be rendered irreducible by dissipators on just one or two sites. Additionally, we discuss the decisive differences between (Davies) reducibility and Evans reducibility for quantum channels and dynamical semigroups which has lead to some confusion in the recent physics literature, especially, in the context of boundary-driven systems. We give a criterion for quantum reducibility in terms of associated classical Markov processes and, lastly, discuss the relation of the main result to the stabilization of pure states and argue that systems with local Lindblad operators cannot stabilize pure Fermi-sea states.

categories: quant-ph cond-mat.stat-mech math-ph math.MP


title: Drive Anywhere: Generalizable End-to-end Autonomous Driving with Multi-modal Foundation Models

abstract: As autonomous driving technology matures, end-to-end methodologies have emerged as a leading strategy, promising seamless integration from perception to control via deep learning. However, existing systems grapple with challenges such as unexpected open set environments and the complexity of black-box models. At the same time, the evolution of deep learning introduces larger, multimodal foundational models, offering multi-modal visual and textual understanding. In this paper, we harness these multimodal foundation models to enhance the robustness and adaptability of autonomous driving systems, enabling out-of-distribution, end-to-end, multimodal, and more explainable autonomy. Specifically, we present an approach to apply end-to-end open-set (any environment/scene) autonomous driving that is capable of providing driving decisions from representations queryable by image and text. To do so, we introduce a method to extract nuanced spatial (pixel/patch-aligned) features from transformers to enable the encapsulation of both spatial and semantic features. Our approach (i) demonstrates unparalleled results in diverse tests while achieving significantly greater robustness in out-of-distribution situations, and (ii) allows the incorporation of latent space simulation (via text) for improved training (data augmentation via text) and policy debugging. We encourage the reader to check our explainer video at https://www.youtube.com/watch?v=4n-DJf8vXxo&feature=youtu.be and to view the code and demos on our project webpage at https://drive-anywhere.github.io/.


title: Where you go is who you are -- A study on machine learning based semantic privacy attacks

abstract: Concerns about data privacy are omnipresent, given the increasing usage of digital applications and their underlying business model that includes selling user data. Location data is particularly sensitive since they allow us to infer activity patterns and interests of users, e.g., by categorizing visited locations based on nearby points of interest (POI). On top of that, machine learning methods provide new powerful tools to interpret big data. In light of these considerations, we raise the following question: What is the actual risk that realistic, machine learning based privacy attacks can obtain meaningful semantic information from raw location data, subject to inaccuracies in the data? In response, we present a systematic analysis of two attack scenarios, namely location categorization and user profiling. Experiments on the Foursquare dataset and tracking data demonstrate the potential for abuse of high-quality spatial information, leading to a significant privacy loss even with location inaccuracy of up to 200m. With location obfuscation of more than 1 km, spatial information hardly adds any value, but a high privacy risk solely from temporal information remains. The availability of public context data such as POIs plays a key role in inference based on spatial information. Our findings point out the risks of ever-growing databases of tracking data and spatial context data, which policymakers should consider for privacy regulations, and which could guide individuals in their personal location protection measures.


title: torchdistill Meets Hugging Face Libraries for Reproducible, Coding-Free Deep Learning Studies: A Case Study on NLP

abstract: Reproducibility in scientific work has been becoming increasingly important in research communities such as machine learning, natural language processing, and computer vision communities due to the rapid development of the research domains supported by recent advances in deep learning. In this work, we present a significantly upgraded version of torchdistill, a modular-driven coding-free deep learning framework significantly upgraded from the initial release, which supports only image classification and object detection tasks for reproducible knowledge distillation experiments. To demonstrate that the upgraded framework can support more tasks with third-party libraries, we reproduce the GLUE benchmark results of BERT models using a script based on the upgraded torchdistill, harmonizing with various Hugging Face libraries. All the 27 fine-tuned BERT models and configurations to reproduce the results are published at Hugging Face, and the model weights have already been widely used in research communities. We also reimplement popular small-sized models and new knowledge distillation methods and perform additional experiments for computer vision tasks.


title: PubDef: Defending Against Transfer Attacks From Public Models

abstract: Adversarial attacks have been a looming and unaddressed threat in the industry. However, through a decade-long history of the robustness evaluation literature, we have learned that mounting a strong or optimal attack is challenging. It requires both machine learning and domain expertise. In other words, the white-box threat model, religiously assumed by a large majority of the past literature, is unrealistic. In this paper, we propose a new practical threat model where the adversary relies on transfer attacks through publicly available surrogate models. We argue that this setting will become the most prevalent for security-sensitive applications in the future. We evaluate the transfer attacks in this setting and propose a specialized defense method based on a game-theoretic perspective. The defenses are evaluated under 24 public models and 11 attack algorithms across three datasets (CIFAR-10, CIFAR-100, and ImageNet). Under this threat model, our defense, PubDef, outperforms the state-of-the-art white-box adversarial training by a large margin with almost no loss in the normal accuracy. For instance, on ImageNet, our defense achieves 62% accuracy under the strongest transfer attack vs only 36% of the best adversarially trained model. Its accuracy when not under attack is only 2% lower than that of an undefended model (78% vs 80%). We release our code at https://github.com/wagner-group/pubdef.


title: Learning the dynamics of a one-dimensional plasma model with graph neural networks

abstract: We explore the possibility of fully replacing a plasma physics kinetic simulator with a graph neural network-based simulator. We focus on this class of surrogate models given the similarity between their message-passing update mechanism and the traditional physics solver update, and the possibility of enforcing known physical priors into the graph construction and update. We show that our model learns the kinetic plasma dynamics of the one-dimensional plasma model, a predecessor of contemporary kinetic plasma simulation codes, and recovers a wide range of well-known kinetic plasma processes, including plasma thermalization, electrostatic fluctuations about thermal equilibrium, and the drag on a fast sheet and Landau damping. We compare the performance against the original plasma model in terms of run-time, conservation laws, and temporal evolution of key physical quantities. The limitations of the model are presented and possible directions for higher-dimensional surrogate models for kinetic plasmas are discussed.


title: Black hole formation in gravitational collapse and their astrophysical implications

abstract: In this work, we have investigated a novel aspect of black hole (BH) formation during the collapse of a self-gravitating configuration. The exact solution of the Einstein field equations is obtained in a model-independent way by considering a parametrization of the expansion scalar ($\Theta$) in the background of spherically symmetric space-time geometry governed by the FLRW metric. Smooth matching of the interior solution with the Schwarzschild exterior metric across the boundary hypersurface of the star, together with the condition that the mass function $m(t,r)$ is equal to Schwarzschild mass $M$, is used to obtain all the physical and geometrical parameters in terms of the stellar mass. The four known massive stars namely $R136a3$, $Melnick$, $R136c$, and $R136b$ with their known astrophysical data (mass, radius, and present age) are used to study the physics of the model both numerically and graphically. We demonstrate that the formation of the apparent horizon occurs earlier than the singular state that is, the model of massive stars would inevitably lead to the formation of a BH as their end state. We have conducted an analysis indicating that the lifespans of massive stars are closely related to their respective masses. Our findings demonstrate that more massive stars exhibit considerably shorter lifespans in comparison to their lighter counterparts. Thus, the presented model corresponds to the evolutionary stages of astrophysical stellar objects and theoretically predicts their possible lifespan. We have also shown that our model satisfies the energy conditions and stability requirements via Herrera's cracking method.


title: Chip-to-chip ODDM network with optically enabled equalization

abstract: We propose and model an optical communication scheme for short distance datacom links based on the distribution of information across a wide comb spectrum. This modulation format, orthogonal delay division multiplexing, allows the multiplexing of data streams from multiple modulators, as well as the deserialization and equalization of the data in the optical domain. A concrete communication system, that allows the transport of 400 Gb/s across a single CWDM channel with a single 80 GHz cutoff lithium niobate on insulator modulator, is modeled under consideration of all noise sources present in the system and its sensitivity to group velocity dispersion is analyzed. Data is deserialized and equalized at the receiver with a 5-tap optical equalizer. This communication architecture may provide a path forward to implement high-baud-rate signaling in short-reach optical links without requiring high-speed ADCs and electronic deserializers at the receiver, thus maintaining the in-package power consumption at manageable levels.


title: 6-DoF Stability Field via Diffusion Models

abstract: A core capability for robot manipulation is reasoning over where and how to stably place objects in cluttered environments. Traditionally, robots have relied on object-specific, hand-crafted heuristics in order to perform such reasoning, with limited generalizability beyond a small number of object instances and object interaction patterns. Recent approaches instead learn notions of physical interaction, namely motion prediction, but require supervision in the form of labeled object information or come at the cost of high sample complexity, and do not directly reason over stability or object placement. We present 6-DoFusion, a generative model capable of generating 3D poses of an object that produces a stable configuration of a given scene. Underlying 6-DoFusion is a diffusion model that incrementally refines a randomly initialized SE(3) pose to generate a sample from a learned, context-dependent distribution over stable poses. We evaluate our model on different object placement and stacking tasks, demonstrating its ability to construct stable scenes that involve novel object classes as well as to improve the accuracy of state-of-the-art 3D pose estimation methods.


title: A Coarse-to-Fine Pseudo-Labeling (C2FPL) Framework for Unsupervised Video Anomaly Detection

abstract: Detection of anomalous events in videos is an important problem in applications such as surveillance. Video anomaly detection (VAD) is well-studied in the one-class classification (OCC) and weakly supervised (WS) settings. However, fully unsupervised (US) video anomaly detection methods, which learn a complete system without any annotation or human supervision, have not been explored in depth. This is because the lack of any ground truth annotations significantly increases the magnitude of the VAD challenge. To address this challenge, we propose a simple-but-effective two-stage pseudo-label generation framework that produces segment-level (normal/anomaly) pseudo-labels, which can be further used to train a segment-level anomaly detector in a supervised manner. The proposed coarse-to-fine pseudo-label (C2FPL) generator employs carefully-designed hierarchical divisive clustering and statistical hypothesis testing to identify anomalous video segments from a set of completely unlabeled videos. The trained anomaly detector can be directly applied on segments of an unseen test video to obtain segment-level, and subsequently, frame-level anomaly predictions. Extensive studies on two large-scale public-domain datasets, UCF-Crime and XD-Violence, demonstrate that the proposed unsupervised approach achieves superior performance compared to all existing OCC and US methods , while yielding comparable performance to the state-of-the-art WS methods.


title: High-Dimensional Prediction for Sequential Decision Making

abstract: We study the problem of making predictions of an adversarially chosen high-dimensional state that are unbiased subject to an arbitrary collection of conditioning events, with the goal of tailoring these events to downstream decision makers. We give efficient algorithms for solving this problem, as well as a number of applications that stem from choosing an appropriate set of conditioning events. For example, we can efficiently make predictions targeted at polynomially many decision makers, giving each of them optimal swap regret if they best-respond to our predictions. We generalize this to online combinatorial optimization, where the decision makers have a very large action space, to give the first algorithms offering polynomially many decision makers no regret on polynomially many subsequences that may depend on their actions and the context. We apply these results to get efficient no-subsequence-regret algorithms in extensive-form games (EFGs), yielding a new family of regret guarantees for EFGs that generalizes some existing EFG regret notions, e.g. regret to informed causal deviations, and is generally incomparable to other known such notions. Next, we develop a novel transparent alternative to conformal prediction for building valid online adversarial multiclass prediction sets. We produce class scores that downstream algorithms can use for producing valid-coverage prediction sets, as if these scores were the true conditional class probabilities. We show this implies strong conditional validity guarantees including set-size-conditional and multigroup-fair coverage for polynomially many downstream prediction sets. Moreover, our class scores can be guaranteed to have improved $L_2$ loss, cross-entropy loss, and generally any Bregman loss, compared to any collection of benchmark models, yielding a high-dimensional real-valued version of omniprediction.


title: The Not-So-Secret Fourth Parameter of Quantum Codes

abstract: The group of transversal gates is an invariant of quantum codes. With respect to this parameter, we demonstrate that non-additive codes can strictly outperform stabilizer codes, and often by large margins. We do this by constructing spin codes that corresponds to permutationally invariant multiqubit codes implementing generalized phase gates transversally. Of particular note, we construct codes that implement a transversal $ T $ gate using fewer qubits and with a better minimum distance than is possible with any stabilizer code.


title: Fantastic Gains and Where to Find Them: On the Existence and Prospect of General Knowledge Transfer between Any Pretrained Model

abstract: Training deep networks requires various design decisions regarding for instance their architecture, data augmentation, or optimization. In this work, we find these training variations to result in networks learning unique feature sets from the data. Using public model libraries comprising thousands of models trained on canonical datasets like ImageNet, we observe that for arbitrary pairings of pretrained models, one model extracts significant data context unavailable in the other -- independent of overall performance. Given any arbitrary pairing of pretrained models and no external rankings (such as separate test sets, e.g. due to data privacy), we investigate if it is possible to transfer such "complementary" knowledge from one model to another without performance degradation -- a task made particularly difficult as additional knowledge can be contained in stronger, equiperformant or weaker models. Yet facilitating robust transfer in scenarios agnostic to pretrained model pairings would unlock auxiliary gains and knowledge fusion from any model repository without restrictions on model and problem specifics - including from weaker, lower-performance models. This work therefore provides an initial, in-depth exploration on the viability of such general-purpose knowledge transfer. Across large-scale experiments, we first reveal the shortcomings of standard knowledge distillation techniques, and then propose a much more general extension through data partitioning for successful transfer between nearly all pretrained models, which we show can also be done unsupervised. Finally, we assess both the scalability and impact of fundamental model properties on successful model-agnostic knowledge transfer.


title: ACWA: An AI-driven Cyber-Physical Testbed for Intelligent Water Systems

abstract: This manuscript presents a novel state-of-the-art cyber-physical water testbed, namely: The AI and Cyber for Water and Agriculture testbed (ACWA). ACWA is motivated by the need to advance water supply management using AI and Cybersecurity experimentation. The main goal of ACWA is to address pressing challenges in the water and agricultural domains by utilising cutting-edge AI and data-driven technologies. These challenges include Cyberbiosecurity, resources management, access to water, sustainability, and data-driven decision-making, among others. To address such issues, ACWA consists of multiple topologies, sensors, computational nodes, pumps, tanks, smart water devices, as well as databases and AI models that control the system. Moreover, we present ACWA simulator, which is a software-based water digital twin. The simulator runs on fluid and constituent transport principles that produce theoretical time series of a water distribution system. This creates a good validation point for comparing the theoretical approach with real-life results via the physical ACWA testbed. ACWA data are available to AI and water domain researchers and are hosted in an online public repository. In this paper, the system is introduced in detail and compared with existing water testbeds; additionally, example use-cases are described along with novel outcomes such as datasets, software, and AI-related scenarios.


title: Music Recommendation Based on Audio Fingerprint

abstract: This work combined different audio features to obtain a more robust fingerprint to be used in a music recommendation process. The combination of these methods resulted in a high-dimensional vector. To reduce the number of values, PCA was applied to the set of resulting fingerprints, selecting the number of principal components that corresponded to an explained variance of $95\%$. Finally, with these PCA-fingerprints, the similarity matrix of each fingerprint with the entire data set was calculated. The process was applied to 200 songs from a personal music library; the songs were tagged with the artists' corresponding genres. The recommendations (fingerprints of songs with the closest similarity) were rated successful if the recommended songs' genre matched the target songs' genre. With this procedure, it was possible to obtain an accuracy of $89\%$ (successful recommendations out of total recommendation requests).


title: Particles in a pocket

abstract: Communicating science through mobile smartphone and tablet applications is one of the most efficient ways to reach general public of diverse background and age coverage. The Higgsy project was created in 2022 to celebrate the 10th anniversary of the discovery of the Higgs boson at CERN. This project introduces a mobile game to search for the Higgs boson production in a generic particle detector. The MatterBricks is an augmented-reality project that was created for a major national event in Belgium, held in 2023. The main features of the two mobile applications and further prospects for reaching general public through mobile application development process are discussed.


title: Deep Learning Algorithm for Advanced Level-3 Inverse-Modeling of Silicon-Carbide Power MOSFET Devices

abstract: Inverse modelling with deep learning algorithms involves training deep architecture to predict device's parameters from its static behaviour. Inverse device modelling is suitable to reconstruct drifted physical parameters of devices temporally degraded or to retrieve physical configuration. There are many variables that can influence the performance of an inverse modelling method. In this work the authors propose a deep learning method trained for retrieving physical parameters of Level-3 model of Power Silicon-Carbide MOSFET (SiC Power MOS). The SiC devices are used in applications where classical silicon devices failed due to high-temperature or high switching capability. The key application of SiC power devices is in the automotive field (i.e. in the field of electrical vehicles). Due to physiological degradation or high-stressing environment, SiC Power MOS shows a significant drift of physical parameters which can be monitored by using inverse modelling. The aim of this work is to provide a possible deep learning-based solution for retrieving physical parameters of the SiC Power MOSFET. Preliminary results based on the retrieving of channel length of the device are reported. Channel length of power MOSFET is a key parameter involved in the static and dynamic behaviour of the device. The experimental results reported in this work confirmed the effectiveness of a multi-layer perceptron designed to retrieve this parameter.


title: Is Channel Independent strategy optimal for Time Series Forecasting?

abstract: There has been an emergence of various models for long-term time series forecasting. Recent studies have demonstrated that a single linear layer, using Channel Dependent (CD) or Channel Independent (CI) modeling, can even outperform a large number of sophisticated models. However, current research primarily considers CD and CI as two complementary yet mutually exclusive approaches, unable to harness these two extremes simultaneously. And it is also a challenging issue that both CD and CI are static strategies that cannot be determined to be optimal for a specific dataset without extensive experiments. In this paper, we reconsider whether the current CI strategy is the best solution for time series forecasting. First, we propose a simple yet effective strategy called CSC, which stands for $\mathbf{C}$hannel $\mathbf{S}$elf-$\mathbf{C}$lustering strategy, for linear models. Our Channel Self-Clustering (CSC) enhances CI strategy's performance improvements while reducing parameter size, for exmpale by over 10 times on electricity dataset, and significantly cutting training time. Second, we further propose Channel Rearrangement (CR), a method for deep models inspired by the self-clustering. CR attains competitive performance against baselines. Finally, we also discuss whether it is best to forecast the future values using the historical values of the same channel as inputs. We hope our findings and methods could inspire new solutions beyond CD/CI.


title: RTNH+: Enhanced 4D Radar Object Detection Network using Combined CFAR-based Two-level Preprocessing and Vertical Encoding

abstract: Four-dimensional (4D) Radar is a useful sensor for 3D object detection and the relative radial speed estimation of surrounding objects under various weather conditions. However, since Radar measurements are corrupted with invalid components such as noise, interference, and clutter, it is necessary to employ a preprocessing algorithm before the 3D object detection with neural networks. In this paper, we propose RTNH+ that is an enhanced version of RTNH, a 4D Radar object detection network, by two novel algorithms. The first algorithm is the combined constant false alarm rate (CFAR)-based two-level preprocessing (CCTP) algorithm that generates two filtered measurements of different characteristics using the same 4D Radar measurements, which can enrich the information of the input to the 4D Radar object detection network. The second is the vertical encoding (VE) algorithm that effectively encodes vertical features of the road objects from the CCTP outputs. We provide details of the RTNH+, and demonstrate that RTNH+ achieves significant performance improvement of 10.14\% in ${{AP}_{3D}^{IoU=0.3}}$ and 16.12\% in ${{AP}_{3D}^{IoU=0.5}}$ over RTNH.


title: An Invitation to Hypercomplex Phase Retrieval: Theory and Applications

abstract: Hypercomplex signal processing (HSP) provides state-of-the-art tools to handle multidimensional signals by harnessing intrinsic correlation of the signal dimensions through Clifford algebra. Recently, the hypercomplex representation of the phase retrieval (PR) problem, wherein a complex-valued signal is estimated through its intensity-only projections, has attracted significant interest. The hypercomplex PR (HPR) arises in many optical imaging and computational sensing applications that usually comprise quaternion and octonion-valued signals. Analogous to the traditional PR, measurements in HPR may involve complex, hypercomplex, Fourier, and other sensing matrices. This set of problems opens opportunities for developing novel HSP tools and algorithms. This article provides a synopsis of the emerging areas and applications of HPR with a focus on optical imaging.


title: An Overview on IEEE 802.11bf: WLAN Sensing

abstract: With recent advancements, the wireless local area network (WLAN) or wireless fidelity (Wi-Fi) technology has been successfully utilized to realize sensing functionalities such as detection, localization, and recognition. However, the WLANs standards are developed mainly for the purpose of communication, and thus may not be able to meet the stringent requirements for emerging sensing applications. To resolve this issue, a new Task Group (TG), namely IEEE 802.11bf, has been established by the IEEE 802.11 working group, with the objective of creating a new amendment to the WLAN standard to meet advanced sensing requirements while minimizing the effect on communications. This paper provides a comprehensive overview on the up-to-date efforts in the IEEE 802.11bf TG. First, we introduce the definition of the 802.11bf amendment and its formation and standardization timeline. Next, we discuss the WLAN sensing use cases with the corresponding key performance indicator (KPI) requirements. After reviewing previous WLAN sensing research based on communication-oriented WLAN standards, we identify their limitations and underscore the practical need for the new sensing-oriented amendment in 802.11bf. Furthermore, we discuss the WLAN sensing framework and procedure used for measurement acquisition, by considering both sensing at sub-7GHz and directional multi-gigabit (DMG) sensing at 60 GHz, respectively, and address their shared features, similarities, and differences. In addition, we present various candidate technical features for IEEE 802.11bf, including waveform/sequence design, feedback types, as well as quantization and compression techniques. We also describe the methodologies and the channel modeling used by the IEEE 802.11bf TG for evaluation. Finally, we discuss the challenges and future research directions to motivate more research endeavors towards this field in details.


title: Non-sliced Optical Arbitrary Waveform Measurement (OAWM) Using a Silicon Photonic Receiver Chip

abstract: Comb-based optical arbitrary waveform measurement (OAWM) techniques can overcome the bandwidth limitations of conventional coherent detection schemes and may have disruptive impact on a wide range of scientific and industrial applications. Over the previous years, different OAWM schemes have been demonstrated, showing the performance and the application potential of the concept in laboratory experiments. However, these demonstrations still relied on discrete fiber-optic components or on combinations of discrete coherent receivers with integrated optical slicing filters that require complex tuning procedures to achieve the desired performance. In this paper, we demonstrate the first wavelength-agnostic OAWM front-end that is integrated on a compact silicon photonic chip and that neither requires slicing filters nor active controls. Our OAWM system comprises four IQ receivers, which are accurately calibrated using a femtosecond mode-locked laser and which offer a total acquisition bandwidth of 170 GHz. Using sinusoidal test signals, we measure a signal-to-noise-and-distortion ratio (SINAD) of 30 dB for the reconstructed signal, which corresponds to an effective number of bits (ENOB) of 4.7 bit, where the underlying electronic analog-to-digital converters (ADC) turn out to be the main limitation. The performance of the OAWM system is further demonstrated by receiving 64QAM data signals at symbol rates of up to 100 GBd, achieving constellation signal-to-noise ratios (CSNR) that are on par with those obtained for conventional coherent receivers. In a theoretical scalability analysis, we show that increasing the channel count of non-sliced OAWM systems can improve both the acquisition bandwidth and the signal quality. We believe that our work represents a key step towards out-of-lab use of highly compact OAWM systems that rely on chip-scale integrated optical front-ends.


title: Locally Self-Adjustive Smoothing for Measurement Noise Reduction with Application to Automated Peak Detection

abstract: Smoothing is widely used approach for measurement noise reduction in spectral analysis. However, it suffers from signal distortion caused by peak suppression. A locally self-adjustive smoothing method is developed that retains sharp peaks and less distort signals. The proposed method uses only one parameter that determines global smoothness, while balancing the local smoothness using data itself. Simulation and real experiments in comparison with existing convolution-based smoothing methods indicate both qualitatively and quantitatively improved noise reduction performance in practical scenarios. We also discuss parameter selection and demonstrate an application for the automated smoothing and detection of a given number of peaks from noisy measurement data.


title: Cascaded Multi-task Adaptive Learning Based on Neural Architecture Search

abstract: Cascading multiple pre-trained models is an effective way to compose an end-to-end system. However, fine-tuning the full cascaded model is parameter and memory inefficient and our observations reveal that only applying adapter modules on cascaded model can not achieve considerable performance as fine-tuning. We propose an automatic and effective adaptive learning method to optimize end-to-end cascaded multi-task models based on Neural Architecture Search (NAS) framework. The candidate adaptive operations on each specific module consist of frozen, inserting an adapter and fine-tuning. We further add a penalty item on the loss to limit the learned structure which takes the amount of trainable parameters into account. The penalty item successfully restrict the searched architecture and the proposed approach is able to search similar tuning scheme with hand-craft, compressing the optimizing parameters to 8.7% corresponding to full fine-tuning on SLURP with an even better performance.


title: Thermostatistics, information, subjectivity, why is this association so disturbing?

abstract: Although information theory resolves inconsistencies (known under the form of famous enigmas) of the traditional approach of thermostatistics, its place in the corresponding literature is not what it deserves. This article supports the idea that this is mainly due to epistemological rather than scientific reasons: the subjectivity introduced into physics is perceived as a problem. Here is an attempt to expose and clarify where exactly this subjectivity lies: in the representation of the reality and in probabilistic inference. Two aspects which have been integrated into the practice of science for a long time and which should no longer frighten anyone, but which become explicit with information theory.


title: Second Born electrons, born again seamen

abstract: The multiple puns in the title play on a curiosity, that the rescue of a person overboard at sea and the dominance of the second Born term in charge transfer in atomic collisions share common elements of physics. Essentials and commonality in the two are explained.


title: Understanding the Hamiltonian Function through the Geometry of Partial Legendre Transforms

abstract: The relationship between the Hamiltonian and Lagrangean functions in analytical mechanics is a type of duality. The two functions, while distinct, are both descriptive functions encoding the behavior of the same dynamical system. One difference is that the Lagrangean naturally appears as one investigates the fundamental equation of classical dynamics. It is not that way for the Hamiltonian. The Hamiltonian comes after Lagrange's equations have been fully formed, most commonly through a Legendre transform of the Lagrangean function. We revisit the Legendre transform approach and offer a more refined geometrical interpretation than what is commonly shown.


title: Fine tuning Pre trained Models for Robustness Under Noisy Labels

abstract: The presence of noisy labels in a training dataset can significantly impact the performance of machine learning models. To tackle this issue, researchers have explored methods for Learning with Noisy Labels to identify clean samples and reduce the influence of noisy labels. However, constraining the influence of a certain portion of the training dataset can result in a reduction in overall generalization performance. To alleviate this, recent studies have considered the careful utilization of noisy labels by leveraging huge computational resources. Therefore, the increasing training cost necessitates a reevaluation of efficiency. In other areas of research, there has been a focus on developing fine-tuning techniques for large pre-trained models that aim to achieve both high generalization performance and efficiency. However, these methods have mainly concentrated on clean datasets, and there has been limited exploration of the noisy label scenario. In this research, our aim is to find an appropriate way to fine-tune pre-trained models for noisy labeled datasets. To achieve this goal, we investigate the characteristics of pre-trained models when they encounter noisy datasets. Through empirical analysis, we introduce a novel algorithm called TURN, which robustly and efficiently transfers the prior knowledge of pre-trained models. The algorithm consists of two main steps: (1) independently tuning the linear classifier to protect the feature extractor from being distorted by noisy labels, and (2) reducing the noisy label ratio and fine-tuning the entire model based on the noise-reduced dataset to adapt it to the target dataset. The proposed algorithm has been extensively tested and demonstrates efficient yet improved denoising performance on various benchmarks compared to previous methods.


title: An Approach for Efficient Neural Architecture Search Space Definition

abstract: As we advance in the fast-growing era of Machine Learning, various new and more complex neural architectures are arising to tackle problem more efficiently. On the one hand their efficient usage requires advanced knowledge and expertise, which is most of the time difficult to find on the labor market. On the other hand, searching for an optimized neural architecture is a time-consuming task when it is performed manually using a trial and error approach. Hence, a method and a tool support is needed to assist users of neural architectures, leading to an eagerness in the field of Automatic Machine Learning (AutoML). When it comes to Deep Learning, an important part of AutoML is the Neural Architecture Search (NAS). In this paper, we propose a novel cell-based hierarchical search space, easy to comprehend and manipulate. The objectives of the proposed approach are to optimize the search-time and to be general enough to handle most of state of the art Convolutional Neural Networks (CNN) architectures.


title: Unknown Health States Recognition With Collective Decision Based Deep Learning Networks In Predictive Maintenance Applications

abstract: At present, decision making solutions developed based on deep learning (DL) models have received extensive attention in predictive maintenance (PM) applications along with the rapid improvement of computing power. Relying on the superior properties of shared weights and spatial pooling, Convolutional Neural Network (CNN) can learn effective representations of health states from industrial data. Many developed CNN-based schemes, such as advanced CNNs that introduce residual learning and multi-scale learning, have shown good performance in health state recognition tasks under the assumption that all the classes are known. However, these schemes have no ability to deal with new abnormal samples that belong to state classes not part of the training set. In this paper, a collective decision framework for different CNNs is proposed. It is based on a One-vs-Rest network (OVRN) to simultaneously achieve classification of known and unknown health states. OVRN learn state-specific discriminative features and enhance the ability to reject new abnormal samples incorporated to different CNNs. According to the validation results on the public dataset of Tennessee Eastman Process (TEP), the proposed CNN-based decision schemes incorporating OVRN have outstanding recognition ability for samples of unknown heath states, while maintaining satisfactory accuracy on known states. The results show that the new DL framework outperforms conventional CNNs, and the one based on residual and multi-scale learning has the best overall performance.


title: Transfer of Reinforcement Learning-Based Controllers from Model- to Hardware-in-the-Loop

abstract: The process of developing control functions for embedded systems is resource-, time-, and data-intensive, often resulting in sub-optimal cost and solutions approaches. Reinforcement Learning (RL) has great potential for autonomously training agents to perform complex control tasks with minimal human intervention. Due to costly data generation and safety constraints, however, its application is mostly limited to purely simulated domains. To use RL effectively in embedded system function development, the generated agents must be able to handle real-world applications. In this context, this work focuses on accelerating the training process of RL agents by combining Transfer Learning (TL) and X-in-the-Loop (XiL) simulation. For the use case of transient exhaust gas re-circulation control for an internal combustion engine, use of a computationally cheap Model-in-the-Loop (MiL) simulation is made to select a suitable algorithm, fine-tune hyperparameters, and finally train candidate agents for the transfer. These pre-trained RL agents are then fine-tuned in a Hardware-in-the-Loop (HiL) system via TL. The transfer revealed the need for adjusting the reward parameters when advancing to real hardware. Further, the comparison between a purely HiL-trained and a transferred agent showed a reduction of training time by a factor of 5.9. The results emphasize the necessity to train RL agents with real hardware, and demonstrate that the maturity of the transferred policies affects both training time and performance, highlighting the strong synergies between TL and XiL simulation.


title: Volume computation for Meissner polyhedra and applications

abstract: The volume of a Meissner polyhedron is computed in terms of the lengths of its dual edges. This allows to reformulate the Meissner conjecture regarding constant width bodies with minimal volume as a series of explicit finite dimensional problems. A direct consequence is the minimality of the volume of Meissner tetrahedras among Meissner pyramids.


title: A Force-Free Magnetic Field Solution in Cyclidal Coordinates

abstract: There are no known analytic solutions to the force-free magnetic field equations in coordinates representing Dupin cyclides. The fact that the curvature lines of Dupin cyclides are all circles is used here to derive a force-free magnetic field on the surface of an elliptic Dupin cyclide.


title: Hierarchical Text Spotter for Joint Text Spotting and Layout Analysis

abstract: We propose Hierarchical Text Spotter (HTS), a novel method for the joint task of word-level text spotting and geometric layout analysis. HTS can recognize text in an image and identify its 4-level hierarchical structure: characters, words, lines, and paragraphs. The proposed HTS is characterized by two novel components: (1) a Unified-Detector-Polygon (UDP) that produces Bezier Curve polygons of text lines and an affinity matrix for paragraph grouping between detected lines; (2) a Line-to-Character-to-Word (L2C2W) recognizer that splits lines into characters and further merges them back into words. HTS achieves state-of-the-art results on multiple word-level text spotting benchmark datasets as well as geometric layout analysis tasks.


title: Early Detection of Tuberculosis with Machine Learning Cough Audio Analysis: Towards More Accessible Global Triaging Usage

abstract: Tuberculosis (TB), a bacterial disease mainly affecting the lungs, is one of the leading infectious causes of mortality worldwide. To prevent TB from spreading within the body, which causes life-threatening complications, timely and effective anti-TB treatment is crucial. Cough, an objective biomarker for TB, is a triage tool that monitors treatment response and regresses with successful therapy. Current gold standards for TB diagnosis are slow or inaccessible, especially in rural areas where TB is most prevalent. In addition, current machine learning (ML) diagnosis research, like utilizing chest radiographs, is ineffective and does not monitor treatment progression. To enable effective diagnosis, an ensemble model was developed that analyzes, using a novel ML architecture, coughs' acoustic epidemiologies from smartphones' microphones to detect TB. The architecture includes a 2D-CNN and XGBoost that was trained on 724,964 cough audio samples and demographics from 7 countries. After feature extraction (Mel-spectrograms) and data augmentation (IR-convolution), the model achieved AUROC (area under the receiving operator characteristic) of 88%, surpassing WHO's requirements for screening tests. The results are available within 15 seconds and can easily be accessible via a mobile app. This research helps to improve TB diagnosis through a promising accurate, quick, and accessible triaging tool.


title: Reducing the impact of non-ideal PRBS on microwave photonic random demodulators by low biasing the optical modulator via PRBS amplitude compression

abstract: A novel method for reducing the impact of non-ideal pseudo-random binary sequence (PRBS) on microwave photonic random demodulators (RDs) in a photonics-assisted compressed sensing (CS) system is proposed. Different from the commonly used method that switches the bias point of the optical modulator in the RD between two quadrature transmission points to mix the signal to be sampled and the PRBS, this method employs a PRBS with lower amplitude to low bias the optical modulator so that the impact of non-ideal PRBS on microwave photonic RDs can be greatly reduced by compressing the amplitude of non-ideal parts of the PRBS. An experiment is performed to verify the concept. The optical modulator is properly low-biased via PRBS amplitude compression. The data rate and occupied bandwidth of the PRBS are 500 Mb/s and 1 GHz, while the multi-tone signals with a maximum frequency of 100 MHz are sampled at an equivalent sampling rate of only 50 MSa/s. The results show that the reconstruction error can be reduced by up to 85%. The proposed method can significantly reduce the requirements for PRBS in RD-based photonics-assisted CS systems, providing a feasible solution for reducing the complexity and cost of system implementation.


title: Validation of Spherical Fourier-Bessel power spectrum analysis with lognormal simulations and eBOSS DR16 LRG EZmocks

abstract: Tuning into the bass notes of the large-scale structure requires careful attention to geometrical effects arising from wide angles. The spherical Fourier-Bessel (SFB) basis provides a harmonic-space coordinate system that fully accounts for all wide-angle effects. To demonstrate the feasibility of the SFB power spectrum, in this paper we validate our SFB pipeline by applying it to lognormal, and both complete and realistic EZmock simulations that were generated for eBOSS DR16 LRG sample. We include redshift space distortions and the local average effect (aka integral constraint). The covariance matrix is obtained from 1000 EZmock simulations, and inverted using eigenvalue decomposition.


title: Spatio-Temporal Meta Contrastive Learning

abstract: Spatio-temporal prediction is crucial in numerous real-world applications, including traffic forecasting and crime prediction, which aim to improve public transportation and safety management. Many state-of-the-art models demonstrate the strong capability of spatio-temporal graph neural networks (STGNN) to capture complex spatio-temporal correlations. However, despite their effectiveness, existing approaches do not adequately address several key challenges. Data quality issues, such as data scarcity and sparsity, lead to data noise and a lack of supervised signals, which significantly limit the performance of STGNN. Although recent STGNN models with contrastive learning aim to address these challenges, most of them use pre-defined augmentation strategies that heavily depend on manual design and cannot be customized for different Spatio-Temporal Graph (STG) scenarios. To tackle these challenges, we propose a new spatio-temporal contrastive learning (CL4ST) framework to encode robust and generalizable STG representations via the STG augmentation paradigm. Specifically, we design the meta view generator to automatically construct node and edge augmentation views for each disentangled spatial and temporal graph in a data-driven manner. The meta view generator employs meta networks with parameterized generative model to customize the augmentations for each input. This personalizes the augmentation strategies for every STG and endows the learning framework with spatio-temporal-aware information. Additionally, we integrate a unified spatio-temporal graph attention network with the proposed meta view generator and two-branch graph contrastive learning paradigms. Extensive experiments demonstrate that our CL4ST significantly improves performance over various state-of-the-art baselines in traffic and crime prediction.


title: Fast Scalable and Accurate Discovery of DAGs Using the Best Order Score Search and Grow-Shrink Trees

abstract: Learning graphical conditional independence structures is an important machine learning problem and a cornerstone of causal discovery. However, the accuracy and execution time of learning algorithms generally struggle to scale to problems with hundreds of highly connected variables -- for instance, recovering brain networks from fMRI data. We introduce the best order score search (BOSS) and grow-shrink trees (GSTs) for learning directed acyclic graphs (DAGs) in this paradigm. BOSS greedily searches over permutations of variables, using GSTs to construct and score DAGs from permutations. GSTs efficiently cache scores to eliminate redundant calculations. BOSS achieves state-of-the-art performance in accuracy and execution time, comparing favorably to a variety of combinatorial and gradient-based learning algorithms under a broad range of conditions. To demonstrate its practicality, we apply BOSS to two sets of resting-state fMRI data: simulated data with pseudo-empirical noise distributions derived from randomized empirical fMRI cortical signals and clinical data from 3T fMRI scans processed into cortical parcels. BOSS is available for use within the TETRAD project which includes Python and R wrappers.


title: CodeFusion: A Pre-trained Diffusion Model for Code Generation

abstract: Imagine a developer who can only change their last line of code, how often would they have to start writing a function from scratch before it is correct? Auto-regressive models for code generation from natural language have a similar limitation: they do not easily allow reconsidering earlier tokens generated. We introduce CodeFusion, a pre-trained diffusion code generation model that addresses this limitation by iteratively denoising a complete program conditioned on the encoded natural language. We evaluate CodeFusion on the task of natural language to code generation for Bash, Python, and Microsoft Excel conditional formatting (CF) rules. Experiments show that CodeFusion (75M parameters) performs on par with state-of-the-art auto-regressive systems (350M-175B parameters) in top-1 accuracy and outperforms them in top-3 and top-5 accuracy due to its better balance in diversity versus quality.


title: Feature Extraction and Classification from Planetary Science Datasets enabled by Machine Learning

abstract: In this paper we present two examples of recent investigations that we have undertaken, applying Machine Learning (ML) neural networks (NN) to image datasets from outer planet missions to achieve feature recognition. Our first investigation was to recognize ice blocks (also known as rafts, plates, polygons) in the chaos regions of fractured ice on Europa. We used a transfer learning approach, adding and training new layers to an industry-standard Mask R-CNN (Region-based Convolutional Neural Network) to recognize labeled blocks in a training dataset. Subsequently, the updated model was tested against a new dataset, achieving 68% precision. In a different application, we applied the Mask R-CNN to recognize clouds on Titan, again through updated training followed by testing against new data, with a precision of 95% over 369 images. We evaluate the relative successes of our techniques and suggest how training and recognition could be further improved. The new approaches we have used for planetary datasets can further be applied to similar recognition tasks on other planets, including Earth. For imagery of outer planets in particular, the technique holds the possibility of greatly reducing the volume of returned data, via onboard identification of the most interesting image subsets, or by returning only differential data (images where changes have occurred) greatly enhancing the information content of the final data stream.


title: Scale-invariant phase transition of disordered bosons in one dimension

abstract: The disorder-induced quantum phase transition between superfluid and non-superfluid states of bosonic particles in one dimension is generally expected to be of the Berezinskii-Kosterlitz-Thouless (BKT) type. Here, we show that hard-core lattice bosons with integrable power-law hopping decaying with distance as $1/r^\alpha$ - corresponding in spin language to a $XY$ model with power-law couplings - undergo a non-BKT continuous phase transition instead. We use exact quantum Monte-Carlo methods to determine the phase diagram for different values of the exponent $\alpha$, focusing on the regime $\alpha > 2$. We find that the scaling of the superfluid stiffness with the system size is scale-invariant at the transition point for any $\alpha\leq 3$ - a behavior incompatible with the BKT scenario and typical of continuous phase transitions in higher dimension. By scaling analysis near the transition point, we find that our data are consistent with a correlation length exponent satisfying the Harris bound $\nu \geq 2$ and demonstrate a new universal behavior of disordered bosons in one dimension. For $\alpha>3$ our data are consistent with a BKT scenario where the liquid is pinned by infinitesimal disorder.


title: Sliceformer: Make Multi-head Attention as Simple as Sorting in Discriminative Tasks

abstract: As one of the most popular neural network modules, Transformer plays a central role in many fundamental deep learning models, e.g., the ViT in computer vision and the BERT and GPT in natural language processing. The effectiveness of the Transformer is often attributed to its multi-head attention (MHA) mechanism. In this study, we discuss the limitations of MHA, including the high computational complexity due to its ``query-key-value'' architecture and the numerical issue caused by its softmax operation. Considering the above problems and the recent development tendency of the attention layer, we propose an effective and efficient surrogate of the Transformer, called Sliceformer. Our Sliceformer replaces the classic MHA mechanism with an extremely simple ``slicing-sorting'' operation, i.e., projecting inputs linearly to a latent space and sorting them along different feature dimensions (or equivalently, called channels). For each feature dimension, the sorting operation implicitly generates an implicit attention map with sparse, full-rank, and doubly-stochastic structures. We consider different implementations of the slicing-sorting operation and analyze their impacts on the Sliceformer. We test the Sliceformer in the Long-Range Arena benchmark, image classification, text classification, and molecular property prediction, demonstrating its advantage in computational complexity and universal effectiveness in discriminative tasks. Our Sliceformer achieves comparable or better performance with lower memory cost and faster speed than the Transformer and its variants. Moreover, the experimental results reveal that applying our Sliceformer can empirically suppress the risk of mode collapse when representing data. The code is available at \url{https://github.com/SDS-Lab/sliceformer}.


title: LEI: Livestock Event Information Schema for Enabling Data Sharing

abstract: Data-driven advances have resulted in significant improvements in dairy production. However, the meat industry has lagged behind in adopting data-driven approaches, underscoring the crucial need for data standardisation to facilitate seamless data transmission to maximise productivity, save costs, and increase market access. To address this gap, we propose a novel data schema, Livestock Event Information (LEI) schema, designed to accurately and uniformly record livestock events. LEI complies with the International Committee for Animal Recording (ICAR) and Integrity System Company (ISC) schemas to deliver this data standardisation and enable data sharing between producers and consumers. To validate the superiority of LEI, we conducted a structural metrics analysis and a comprehensive case study. The analysis demonstrated that LEI outperforms the ICAR and ISC schemas in terms of design, while the case study confirmed its superior ability to capture livestock event information. Our findings lay the foundation for the implementation of the LEI schema, unlocking the potential for data-driven advances in livestock management. Moreover, LEI's versatility opens avenues for future expansion into other agricultural domains, encompassing poultry, fisheries, and crops. The adoption of LEI promises substantial benefits, including improved data accuracy, reduced costs, and increased productivity, heralding a new era of sustainability in the meat industry.


title: Neutrino Oscillations and Mass Models

abstract: These notes provide a review of various neutrino mass model and their implications for particle physics and the Standard Model. We discuss how mass terms are incorporated into the Standard Model, including the Dirac mass term and the Majorana mechanism. We explore experimental evidence supporting the existence of non-zero neutrino mass and develop the formalism of neutrino oscillations. Additionally, we provide a brief overview of some famous radiative neutrino mass models. This notes draws heavily from the references given below and can serve as a valuable resource for students and new researchers interested in the field of neutrino physics.


title: Submandibular Sialolithiasis in a 9-year-old child: case report

abstract: Sialolithiasis rarely occurs in children; it is observed more commonly in adults. Various treatment modalities for sialolithiasis have been reported in literature; we report the case of 9 years old child, with no particular pathological history. For 4 years, he had a tumefaction of the left submandibular region, associated with painful blocking episodes of salivation and an increase in the size of the tumefaction (accentuated during meals). clinical examination found a slight painless tumefaction of the left sub-mandibular region, with no pus or blood outflow, no endobuccal expression and no palpable calculi ultrasound examination shows a heterogeneous left submandibular gland, discreetly vascularized by Doppler, with multiple calculi. the patient was operated by cervical approach, a submandibularectomy was performed after detachment of the musculocutaneous flaps, preservation of the artery and the facial vein and the lingual nerve, and dissection of the submandibular canal. Anatomo-pathological study was performed and it showed macroscopically a yellowish enclosed calculus of 3mm of great axis. Microscopically, it shows a salivary glandular tissue with no signs of malignity, in this article, clinical findings, etiologies and different treatment approaches were reviewed


title: Counterfactual Fairness for Predictions using Generative Adversarial Networks

abstract: Fairness in predictions is of direct importance in practice due to legal, ethical, and societal reasons. It is often achieved through counterfactual fairness, which ensures that the prediction for an individual is the same as that in a counterfactual world under a different sensitive attribute. However, achieving counterfactual fairness is challenging as counterfactuals are unobservable. In this paper, we develop a novel deep neural network called Generative Counterfactual Fairness Network (GCFN) for making predictions under counterfactual fairness. Specifically, we leverage a tailored generative adversarial network to directly learn the counterfactual distribution of the descendants of the sensitive attribute, which we then use to enforce fair predictions through a novel counterfactual mediator regularization. If the counterfactual distribution is learned sufficiently well, our method is mathematically guaranteed to ensure the notion of counterfactual fairness. Thereby, our GCFN addresses key shortcomings of existing baselines that are based on inferring latent variables, yet which (a) are potentially correlated with the sensitive attributes and thus lead to bias, and (b) have weak capability in constructing latent representations and thus low prediction performance. Across various experiments, our method achieves state-of-the-art performance. Using a real-world case study from recidivism prediction, we further demonstrate that our method makes meaningful predictions in practice.


title: Managing extreme AI risks amid rapid progress

abstract: Artificial Intelligence (AI) is progressing rapidly, and companies are shifting their focus to developing generalist AI systems that can autonomously act and pursue goals. Increases in capabilities and autonomy may soon massively amplify AI's impact, with risks that include large-scale social harms, malicious uses, and an irreversible loss of human control over autonomous AI systems. Although researchers have warned of extreme risks from AI, there is a lack of consensus about how exactly such risks arise, and how to manage them. Society's response, despite promising first steps, is incommensurate with the possibility of rapid, transformative progress that is expected by many experts. AI safety research is lagging. Present governance initiatives lack the mechanisms and institutions to prevent misuse and recklessness, and barely address autonomous systems. In this short consensus paper, we describe extreme risks from upcoming, advanced AI systems. Drawing on lessons learned from other safety-critical technologies, we then outline a comprehensive plan combining technical research and development with proactive, adaptive governance mechanisms for a more commensurate preparation.


title: Improved Standard-Model prediction for ${K_L\to \ell^+\ell^-}$

abstract: We present a comprehensive calculation of the $K_L\to\gamma^*\gamma^*$ form factor in dispersion theory, using input from the leptonic decays $K_L\to\ell^+\ell^-\gamma$, $K_L\to \ell_1^+\ell_1^-\ell_2^+\ell_2^-$, the hadronic mode $K_L\to \pi^+\pi^-\gamma$, the normalization $K_L\to\gamma\gamma$, and the matching to asymptotic constraints. As key result we obtain an improved determination of the long-distance contribution to $K_L\to\ell^+\ell^-$, leading to the Standard-Model predictions $\text{Br}[K_L\to\mu^+\mu^-]=7.44^{+0.41}_{-0.34}\times 10^{-9}$, $\text{Br}[K_L\to e^+e^-]=8.46(37)\times 10^{-12}$, and more stringent limits on physics beyond the Standard Model. We provide a detailed breakdown of the current uncertainty, and delineate how future experiments and the interplay with lattice QCD could help further improve the precision.


title: Non-contrastive sentence representations via self-supervision

abstract: Sample contrastive methods, typically referred to simply as contrastive are the foundation of most unsupervised methods to learn text and sentence embeddings. On the other hand, a different class of self-supervised loss functions and methods have been considered in the computer vision community and referred to as dimension contrastive. In this paper, we thoroughly compare this class of methods with the standard baseline for contrastive sentence embeddings, SimCSE. We find that self-supervised embeddings trained using dimension contrastive objectives can outperform SimCSE on downstream tasks without needing auxiliary loss functions.


title: Pair-density-wave and $s\pm \mathrm{i}d$ superconductivity in a strongly coupled, lightly doped Kondo insulator

abstract: We investigate the large Kondo coupling limit of the Kondo-Heisenberg model on one- and two-dimensional lattices. Focusing on the possible superconducting states when slightly doping the Kondo insulator state, we identify different pairing modes to be most stable in different parameter regimes. Possibilities include uniform $s$-wave, pair-density-wave with momentum $\pi$ (in both one and two dimensions) and uniform $s\pm \mathrm{i}d_{x^2-y^2}$-wave (in two dimensions). We attribute these exotic pairing states to the presence of various pair-hopping terms with a ``wrong'' sign in the effective model, a mechanism that is likely universal for inducing pairing states with spatially modulated pair wavefunctions.


title: Unraveling Jet Quenching Criteria Across L* Galaxies and Massive Cluster Ellipticals

abstract: In the absence of supplementary heat, the radiative cooling of halo gas around massive galaxies (Milky Way mass and above) leads to an excess of cold gas or stars beyond observed levels. AGN jet-induced heating is likely essential, but the specific properties of the jets remain unclear. Our previous work (Su et al. 2021) concludes from simulations of a halo with $10^{14} M_\odot$ that a successful jet model should have an energy flux comparable to the free-fall energy flux at the cooling radius and should inflate a sufficiently wide cocoon with a long enough cooling time. In this paper, we investigate three jet modes with constant fluxes satisfying the criteria, including high-temperature thermal jets, cosmic ray (CR)-dominant jets, and widely precessing kinetic jets in $10^{12}-10^{15}\,{\rm M}_{\odot}$ halos using high-resolution, non-cosmological MHD simulations with the FIRE-2 (Feedback In Realistic Environments) stellar feedback model, conduction, and viscosity. We find that scaling the jet energy according to the free-fall energy at the cooling radius can successfully suppress the cooling flows and quench galaxies without obviously violating observational constraints. We investigate an alternative scaling method in which we adjust the energy flux based on the total cooling rate within the cooling radius. However, we observe that the strong interstellar medium (ISM) cooling dominates the total cooling rate in this scaling approach, resulting in a jet flux that exceeds the amount needed to suppress the cooling flows. With the same energy flux, the CR-dominant jet is most effective in suppressing the cooling flow across all the surveyed halo masses due to the enhanced CR pressure support. We confirm that the criteria for a successful jet model, which we proposed in Su et al. (2021), work across a much wider range, encompassing halo masses of $10^{12}-10^{15} {\rm M_\odot}$.


title: An infrared FWHM-$K_2$ correlation to uncover highly reddened quiescent black holes

abstract: Among the sample of Galactic transient X-ray binaries (SXTs) discovered to date, about 70 have been proposed as likely candidates to host a black hole. Yet, only 19 have been dynamically confirmed. Such a reliable confirmation requires phase-resolved spectroscopy of their companion stars, which is generally feasible when the system is in a quiescent state. However, since most of the SXT population lies in the galactic plane, which is strongly affected by interstellar extinction, their optical brightness during quiescence usually falls beyond the capabilities of the current instrumentation ($R\gtrsim22$). To overcome these limitations and thereby increase the number of confirmed Galactic black holes, a correlation between the full-width at half maximum (FWHM) of the H$\alpha$ line and the semi-amplitude of the donor's radial velocity curve ($K_2$) was presented in the past. Here, we extend the FWHM-$K_2$ correlation to the near-infrared (NIR), exploiting disc lines such as He I $\lambda$10830, Pa$\gamma$, and Br$\gamma$, in a sample of dynamically confirmed black-hole SXTs. We obtain $K_2 = 0.22(3) ~\textrm{FWHM}$, in good agreement with the optical correlation derived using H$\alpha$. The similarity of the two correlations seems to imply that the widths of H$\alpha$ and the NIR lines are consistent in quiescence. When combined with information on orbital periods, the NIR correlation allows us to constrain the mass of the compact object of systems in quiescence by using single-epoch spectroscopy. We anticipate that this new correlation will give access to highly reddened black-hole SXTs, which cannot be otherwise studied at optical wavelengths.


title: Where do stars explode in the ISM? -- The distribution of dense gas around massive stars and supernova remnants in M33

abstract: Star formation in galaxies is regulated by turbulence, outflows, gas heating and cloud dispersal -- processes which depend sensitively on the properties of the interstellar medium (ISM) into which supernovae (SNe) explode. Unfortunately, direct measurements of ISM environments around SNe remain scarce, as SNe are rare and often distant. Here we demonstrate a new approach: mapping the ISM around the massive stars that are soon to explode. This provides a much larger census of explosion sites than possible with only SNe, and allows comparison with sensitive, high-resolution maps of the atomic and molecular gas from the Jansky VLA and ALMA. In the well-resolved Local Group spiral M33, we specifically observe the environments of red supergiants (RSGs, progenitors of Type II SNe), Wolf-Rayet stars (WRs, tracing stars $>$30 M$_{\odot}$, and possibly future stripped-envelope SNe), and supernova remnants (SNRs, locations where SNe have exploded). We find that massive stars evolve not only in dense, molecular-dominated gas (with younger stars in denser gas), but also a substantial fraction ($\sim$45\% of WRs; higher for RSGs) evolve in lower-density, atomic-gas-dominated, inter-cloud media. We show that these measurements are consistent with expectations from different stellar-age tracer maps, and can be useful for validating SN feedback models in numerical simulations of galaxies. Along with the discovery of a 20-pc diameter molecular gas cavity around a WR, these findings re-emphasize the importance of pre-SN/correlated-SN feedback evacuating the dense gas around massive stars before explosion, and the need for high-resolution (down to pc-scale) surveys of the multi-phase ISM in nearby galaxies.


title: A note on O6 intersections in AdS flux vacua

abstract: The DGKT-CFI construction of AdS flux vacua in type IIA string theory has interesting features such as classical moduli stabilization and a parametric scale separation between the Hubble scale and the Kaluza-Klein scale. A possible worry regarding the consistency of these vacua is that pathologies could arise due to intersections of the O6-planes, which are not well understood in the 10D solution. In this note, we show in explicit examples that such intersections are absent if one compactifies on smooth Calabi-Yau manifolds instead of toroidal orbifolds. In particular, we show that the blow-up of the $T^6/\mathbb{Z}_3$ orbifold yields a single O6-plane which wraps a smooth submanifold without any (self-)intersections. On the other hand, blowing up the $T^6/\mathbb{Z}_3^2$ orbifold seems to yield an O6-plane which self-intersects. However, we show that this is due to an inconsistent orientifold involution in the original DGKT model. Imposing a consistent involution again yields a single smooth O6-plane without self-intersections on the blown-up manifold.