title: Simulating the efficacy of the implicit-electric-field-conjugation algorithm for the Roman Coronagraph with noise

abstract: The Roman Coronagraph is expected to perform its high-order wavefront sensing and control (HOWFSC) with a ground-in-the-loop scheme due to the computational complexity of the Electric-Field-Conjugation (EFC) algorithm. This scheme provides the flexibility to alter the HOWFSC algorithm for given science objectives. A new alternative implicit-EFC algorithm is of particular interest as it requires no optical model to create a dark-hole, making the final contrast independent of the model accuracy. The intended HOWFSC scheme involves running EFC while observing a bright star such as $\zeta$ Puppis to create the initial dark-hole, then slew to the science target while maintaining the contrast with low-order WFSC over the given observation. Given a similar scheme, the efficacy of iEFC is simulated for two coronagraph modes, namely the Hybrid Lyot Coronagraph (HLC) and the wide-field-of-view Shaped-Pupil-Coronagraph (SPC-WFOV). End-to-end physical optics models for each mode serve as the tool for the simulations. Initial monochromatic simulations are presented and compared with monochromatic EFC results obtained with the FALCO software. Various sets of calibration modes are tested to understand the optimal modes to use when generating an iEFC response matrix. Further iEFC simulations are performed using broadband images with the assumption that $\zeta$ Puppis is the stellar object being observed. Shot noise, read noise, and dark current are included in the broadband simulations to determine if iEFC could be a suitable alternative to EFC for the Roman Coronagraph.


title: Learning Task Skills and Goals Simultaneously from Physical Interaction

abstract: In real-world human-robot systems, it is essential for a robot to comprehend human objectives and respond accordingly while performing an extended series of motor actions. Although human objective alignment has recently emerged as a promising paradigm in the realm of physical human-robot interaction, its application is typically confined to generating simple motions due to inherent theoretical limitations. In this work, our goal is to develop a general formulation to learn manipulation functional modules and long-term task goals simultaneously from physical human-robot interaction. We show the feasibility of our framework in enabling robots to align their behaviors with the long-term task objectives inferred from human interactions.


title: Existence of solution to a new class of coupled variational-hemivariational inequalities

abstract: The objective of this paper is to introduce and study a complicated nonlinear system, called coupled variational-hemivariational inequalities, which is described by a highly nonlinear coupled system of inequalities on Banach spaces. We establish the nonemptiness and compactness of the solution set to the system. We apply a new method of proof based on a multivalued version of the Tychonoff fixed point principle in a Banach space combined with the generalized monotonicity arguments, and elements of the nonsmooth analysis. Our results improve and generalize some earlier theorems obtained for a very particular form of the system.


title: Unruh phenomena and thermalization for qudit detectors

abstract: We study Unruh phenomena for a qudit detector coupled to a quantized scalar field, comparing its response to that of a standard qubit-based Unruh-DeWitt detector. We show that there are limitations to the utility of the detailed balance condition as an indicator for Unruh thermality of higher-dimensional qudit detector models. This can be traced to the fact that a qudit has multiple possible transition channels between its energy levels, in contrast to the 2-level qubit model. We illustrate these limitations using two types of qutrit detector models based on the spin-1 representations of $SU(2)$ and the non-Hermitian generalization of the Pauli observables (the Heisenberg-Weyl operators).


title: A new class of history-dependent quasi variational-hemivariational inequalities with constraints

abstract: In this paper we consider an abstract class of time-dependent quasi variational-hemivariational inequalities which involves history-dependent operators and a set of unilateral constraints. First, we establish the existence and uniqueness of solution by using a recent result for elliptic variational-hemivariational inequalities in reflexive Banach spaces combined with a fixed-point principle for history-dependent operators. Then, we apply the abstract result to show the unique weak solvability to a quasistatic viscoelastic frictional contact problem. The contact law involves a unilateral Signorini-type condition for the normal velocity and the nonmonotone normal damped response condition while the friction condition is a version of the Coulomb law of dry friction in which the friction bound depends on the accumulated slip.


title: Electrical Control of Two-Dimensional Electron-Hole Fluids in the Quantum Hall Regime

abstract: We study the influence of quantizing perpendicular magnetic fields on the ground state of a bilayer with electron and hole fluids separated by an opaque tunnel barrier. In the absence of a field, the ground state at low carrier densities is a condensate of s-wave excitons that has spontaneous interlayer phase coherence. We find that a series of phase transitions emerge at strong perpendicular fields between condensed states and incompressible incoherent states with full electron and hole Landau levels. When the electron and hole densities are unequal, condensation can occur in higher angular momentum electron-hole pair states and, at weak fields, break rotational symmetry. We explain how this physics is expressed in dual-gate phase diagrams, and predict transport and capacitively-probed thermodynamic signatures that distinguish different states.


title: Dyadic linear programming and extensions

abstract: A rational number is dyadic if it has a finite binary representation $p/2^k$, where $p$ is an integer and $k$ is a nonnegative integer. Dyadic rationals are important for numerical computations because they have an exact representation in floating-point arithmetic on a computer. A vector is dyadic if all its entries are dyadic rationals. We study the problem of finding a dyadic optimal solution to a linear program, if one exists. We show how to solve dyadic linear programs in polynomial time. We give bounds on the size of the support of a solution as well as on the size of the denominators. We identify properties that make the solution of dyadic linear programs possible: closure under addition and negation, and density, and we extend the algorithmic framework beyond the dyadic case.


title: ORMIR_XCT: A Python package for high resolution peripheral quantitative computed tomography image processing

abstract: High resolution peripheral quantitative computed tomography (HR-pQCT) is an imaging technique capable of imaging trabecular bone in-vivo. HR-pQCT has a wide range of applications, primarily focused on bone to improve our understanding of musculoskeletal diseases, assess epidemiological associations, and evaluate the effects of pharmaceutical interventions. Processing HR-pQCT images has largely been supported using the scanner manufacturer scripting language (Image Processing Language, IPL, Scanco Medical). However, by expanding image processing workflows outside of the scanner manufacturer software environment, users have the flexibility to apply more advanced mathematical techniques and leverage modern software packages to improve image processing. The ORMIR_XCT Python package was developed to reimplement some existing IPL workflows and provide an open and reproducible package allowing for the development of advanced HR-pQCT data processing workflows.


title: Note on polychromatic coloring of hereditary hypergraph families

abstract: We exhibit a 5-uniform hypergraph that has no polychromatic 3-coloring, but all its restricted subhypergraphs with edges of size at least 3 are 2-colorable. This disproves a bold conjecture of Keszegh and the author, and can be considered as the first step to understand polychromatic colorings of hereditary hypergraph families better since the seminal work of Berge. We also show that our method cannot give hypergraphs of arbitrary high uniformity, and mention some connections to panchromatic colorings.


title: Microfabricated pinholes for high contrast imaging testbeds

abstract: In order to reach contrast ratios of $10^{-8}$ and beyond, coronagraph testbeds need source optics that reliably emulate nearly-point-like starlight, with microfabricated pinholes being a compelling solution. To verify, a physical optics model of the Space Coronagraph Optical Bench (SCoOB) source optics, including a finite-difference time-domain (FDTD) pinhole simulation, was created. The results of the FDTD simulation show waveguide-like behavior of pinholes. We designed and fabricated microfabricated pinholes for SCoOB made from an aluminum overcoated silicon nitride film overhanging a silicon wafer substrate, and report characterization of the completed pinholes.


title: Evaluating Total Environmental Impact for a Computing Infrastructure

abstract: In this paper we outline the results of a project to evaluate the total climate/carbon impact of a digital research infrastructure for a defined snapshot period. We outline the carbon model used to calculate the impact and the data collected to quantify that impact for a defined set of resources. We discuss the variation in potential impact across both the active and embodied carbon for computing hardware and produce a range of estimates on the amount of carbon equivalent climate impact for the snapshot period.


title: Compact Pulse Schedules for High-Fidelity Single-Flux Quantum Qubit Control

abstract: In the traditional approach to controlling superconducting qubits using microwave pulses, the field of pulse shaping has emerged in order to assist in the removal of leakage and increase gate fidelity. However, the challenge of scaling microwave control electronics has created an opportunity to explore alternative methods such as single-flux quantum (SFQ) pulses. For qubits controlled by SFQ pulses, high fidelity gates can be achieved by optimizing the binary control sequence. We extend the notion of the derivative removal by adiabatic gate (DRAG) framework a transmon qubit controlled by SFQ drivers and propose pulse sequences that can be stored in 22 bits or fewer, with gate fidelities exceeding 99.99%. This modest memory requirement could help reduce the footprint of the SFQ coprocessors and power dissipation while preserving their inherent advantages of scalability and cost-effectiveness.


title: Linking Symptom Inventories using Semantic Textual Similarity

abstract: An extensive library of symptom inventories has been developed over time to measure clinical symptoms, but this variety has led to several long standing issues. Most notably, results drawn from different settings and studies are not comparable, which limits reproducibility. Here, we present an artificial intelligence (AI) approach using semantic textual similarity (STS) to link symptoms and scores across previously incongruous symptom inventories. We tested the ability of four pre-trained STS models to screen thousands of symptom description pairs for related content - a challenging task typically requiring expert panels. Models were tasked to predict symptom severity across four different inventories for 6,607 participants drawn from 16 international data sources. The STS approach achieved 74.8% accuracy across five tasks, outperforming other models tested. This work suggests that incorporating contextual, semantic information can assist expert decision-making processes, yielding gains for both general and disease-specific clinical assessment.


title: Style Generation: Image Synthesis based on Coarsely Matched Texts

abstract: Previous text-to-image synthesis algorithms typically use explicit textual instructions to generate/manipulate images accurately, but they have difficulty adapting to guidance in the form of coarsely matched texts. In this work, we attempt to stylize an input image using such coarsely matched text as guidance. To tackle this new problem, we introduce a novel task called text-based style generation and propose a two-stage generative adversarial network: the first stage generates the overall image style with a sentence feature, and the second stage refines the generated style with a synthetic feature, which is produced by a multi-modality style synthesis module. We re-filter one existing dataset and collect a new dataset for the task. Extensive experiments and ablation studies are conducted to validate our framework. The practical potential of our work is demonstrated by various applications such as text-image alignment and story visualization. Our datasets are published at https://www.kaggle.com/datasets/mengyaocui/style-generation.


title: A class of elliptic quasi-variational-hemivariational inequalities with applications

abstract: In this paper we study a class of quasi--variational--hemi\-va\-ria\-tio\-nal inequalities in reflexive Banach spaces. The inequalities contain a convex potential, a locally Lipschitz superpotential, and a solution-dependent set of constraints. Solution existence and compactness of the solution set to the inequality problem are established based on the Kakutani--Ky Fan--Glicksberg fixed point theorem. Two examples of the interior and boundary semipermeability models illustrate the applicability of our results.


title: Regular Functions on the Scaled Hypercomplex Numbers

abstract: In this paper, we study the regularity of $\mathbb{R}$-differentiable functions on open connected subsets of the scaled hypercomplex numbers $\left\{ \mathbb{H}_{t}\right\} _{t\in\mathbb{R}}$ by studying the kernels of suitable differential operators $\left\{ \nabla_{t}\right\} _{t\in\mathbb{R}}$, up to scales in the real field $\mathbb{R}$.


title: Memory of Ivan Kupka (1937-2023)

abstract: This brief text is in memory of Professor Ivan Kupka. It presents his vision, scientific life, his interest in mathematics and our join collaboration.


title: Self-optimizing Feature Generation via Categorical Hashing Representation and Hierarchical Reinforcement Crossing

abstract: Feature generation aims to generate new and meaningful features to create a discriminative representation space.A generated feature is meaningful when the generated feature is from a feature pair with inherent feature interaction. In the real world, experienced data scientists can identify potentially useful feature-feature interactions, and generate meaningful dimensions from an exponentially large search space, in an optimal crossing form over an optimal generation path. But, machines have limited human-like abilities.We generalize such learning tasks as self-optimizing feature generation. Self-optimizing feature generation imposes several under-addressed challenges on existing systems: meaningful, robust, and efficient generation. To tackle these challenges, we propose a principled and generic representation-crossing framework to solve self-optimizing feature generation.To achieve hashing representation, we propose a three-step approach: feature discretization, feature hashing, and descriptive summarization. To achieve reinforcement crossing, we develop a hierarchical reinforcement feature crossing approach.We present extensive experimental results to demonstrate the effectiveness and efficiency of the proposed method. The code is available at https://github.com/yingwangyang/HRC_feature_cross.git.


title: Modeling Nuclear Quantum Effects on Long Range Electrostatics in Nonuniform Fluids

abstract: Nuclear quantum effects play critical roles in a variety of molecular processes, especially in systems that contain hydrogen and other light nuclei, such as water. For water at ambient conditions, nuclear quantum effects are often interpreted as local effects resulting from a smearing of the hydrogen atom distribution. However, the orientational structure of water at interfaces determines long range effects like electrostatics through the O-H bond ordering that is impacted by nuclear quantum effects. In this work, I examine nuclear quantum effects on long range electrostatics of water confined between hydrophobic walls using path integral simulations. To do so, I combine concepts from local molecular field (LMF) theory with path integral methods at varying levels of approximation to develop an efficient and physically intuitive approaches for describing long range electrostatics in nonuniform quantum systems. Using these approaches, I show that quantum water requires larger electrostatic forces to achieve the same level of interfacial screening as the corresponding classical system. This work highlights subtleties of electrostatics in nonuniform classical and quantum molecular systems, and the methods presented here are expected to be of use to efficiently model nuclear quantum effects in large systems.


title: EIGER V. Characterizing the Host Galaxies of Luminous Quasars at $z\gtrsim6$

abstract: We report {\em JWST}/NIRCam measurements of quasar host galaxy emissions and supermassive black hole (SMBH) masses for six quasars at $5.9<z<7.1$ in the \textit{Emission-line galaxies and Intergalactic Gas in the Epoch of Reionization} (EIGER) project. We obtain deep NIRCam imaging in the F115W, F200W, and F356W bands, as well as F356W grism spectroscopy of the quasars. We use bright unsaturated stars to construct models of the point spread function (PSF) and estimate the errors of these PSFs. We then measure or constrain the fluxes and morphology of the quasar host galaxies by fitting the quasar images as a point source plus an exponential disk. We successfully detect the host galaxy of three quasars, which have host-to-quasar flux ratios of $\sim1\%-5\%$. Spectral Energy Distribution (SED) fitting suggests that these quasar host galaxies have stellar masses of $M_*\gtrsim10^{10}M_\odot$. For quasars with host galaxy non-detections, we estimate the upper limits of their stellar masses. We use the grism spectra to measure the {\hb} line profile and the continuum luminosity, then estimate the SMBH masses for the quasars. Our results indicate that the positive relation between SMBH masses and host galaxy stellar masses already exists at redshift $z\gtrsim6$. The quasars in our sample show a high black hole to stellar mass ratio of $M_\text{BH}/M_*\sim0.15$, which is about $\sim2$ dex higher than local relations. We find that selection effects only contribute partially to the high $M_\text{BH}/M_*$ ratios of high-redshift quasars. This result hints at a possible redshift evolution of the $M_\text{BH}-M_*$ relation.


title: Leveraging World Model Disentanglement in Value-Based Multi-Agent Reinforcement Learning

abstract: In this paper, we propose a novel model-based multi-agent reinforcement learning approach named Value Decomposition Framework with Disentangled World Model to address the challenge of achieving a common goal of multiple agents interacting in the same environment with reduced sample complexity. Due to scalability and non-stationarity problems posed by multi-agent systems, model-free methods rely on a considerable number of samples for training. In contrast, we use a modularized world model, composed of action-conditioned, action-free, and static branches, to unravel the environment dynamics and produce imagined outcomes based on past experience, without sampling directly from the real environment. We employ variational auto-encoders and variational graph auto-encoders to learn the latent representations for the world model, which is merged with a value-based framework to predict the joint action-value function and optimize the overall training objective. We present experimental results in Easy, Hard, and Super-Hard StarCraft II micro-management challenges to demonstrate that our method achieves high sample efficiency and exhibits superior performance in defeating the enemy armies compared to other baselines.


title: Knowledge Distillation-Empowered Digital Twin for Anomaly Detection

abstract: Cyber-physical systems (CPSs), like train control and management systems (TCMS), are becoming ubiquitous in critical infrastructures. As safety-critical systems, ensuring their dependability during operation is crucial. Digital twins (DTs) have been increasingly studied for this purpose owing to their capability of runtime monitoring and warning, prediction and detection of anomalies, etc. However, constructing a DT for anomaly detection in TCMS necessitates sufficient training data and extracting both chronological and context features with high quality. Hence, in this paper, we propose a novel method named KDDT for TCMS anomaly detection. KDDT harnesses a language model (LM) and a long short-term memory (LSTM) network to extract contexts and chronological features, respectively. To enrich data volume, KDDT benefits from out-of-domain data with knowledge distillation (KD). We evaluated KDDT with two datasets from our industry partner Alstom and obtained the F1 scores of 0.931 and 0.915, respectively, demonstrating the effectiveness of KDDT. We also explored individual contributions of the DT model, LM, and KD to the overall performance of KDDT, via a comprehensive empirical study, and observed average F1 score improvements of 12.4%, 3%, and 6.05%, respectively.


title: Scalable resolvent analysis for three-dimensional flows

abstract: Resolvent analysis is a powerful tool for studying coherent structures in turbulent flows. However, its application beyond canonical flows with symmetries that can be used to simplify the problem to inherently three-dimensional flows and other large systems has been hindered by the computational cost of computing resolvent modes. In particular, the CPU and memory requirements of state-of-the-art algorithms scale poorly with the problem dimension, i.e., the number of discrete degrees of freedom. In this paper, we present RSVD-$\Delta t$, a novel approach that overcomes these limitations by combining randomized singular value decomposition with an optimized time-stepping method for computing the action of the resolvent operator. Critically, the CPU cost and memory requirements of the algorithm scale linearly with the problem dimension, and we develop additional strategies to minimize these costs and control errors. We validate the algorithm using a Ginzburg-Landau test problem and demonstrate its low cost and improved scaling using a three-dimensional discretization of a turbulent jet. Lastly, we use it to study the impact of low-speed streaks on the development of Kelvin-Helmholtz wavepackets in the jet via secondary stability analysis, a problem that would have been intractable using previous algorithms.


title: Simulation-driven engineering for the management of harmful algal and cyanobacterial blooms

abstract: Harmful Algal and Cyanobacterial Blooms (HABs), occurring in inland and maritime waters, pose threats to natural environments by producing toxins that affect human and animal health. In the past, HABs have been assessed mainly by the manual collection and subsequent analysis of water samples and occasionally by automatic instruments that acquire information from fixed locations. These procedures do not provide data with the desirable spatial and temporal resolution to anticipate the formation of HABs. Hence, new tools and technologies are needed to efficiently detect, characterize and respond to HABs that threaten water quality. It is essential nowadays when the world's water supply is under tremendous pressure because of climate change, overexploitation, and pollution. This paper introduces DEVS-BLOOM, a novel framework for real-time monitoring and management of HABs. Its purpose is to support high-performance hazard detection with Model Based Systems Engineering (MBSE) and Cyber-Physical Systems (CPS) infrastructure for dynamic environments.


title: High-entropy effect at rare-earth site in DyNi

abstract: We report the structural and magnetic properties of RNi (R=Dy, Tb$_{1/3}$Dy$_{1/3}$Ho$_{1/3}$, and Gd$_{1/5}$Tb$_{1/5}$Dy$_{1/5}$Ho$_{1/5}$Er$_{1/5}$) to investigate the high-entropy effect at the rare-earth site. The lattice parameters are almost unchanged by the increase of configurational entropy, which is due to the successive partial substitution of Dy by pair of rare earth elements located on both sides of Dy in the periodic table. All compounds exhibit ferromagnetic ground states. The replacement of Dy with Tb+Ho, which does not have magnetic interactions in competition with Dy, does not affect the magnetic ordering temperature. Although (Gd$_{1/5}$Tb$_{1/5}$Dy$_{1/5}$Ho$_{1/5}$Er$_{1/5}$)Ni shows the Curie temperature close to that of DyNi, an additional magnetic anomaly, which would be a spin reorientation, is observed probably due to the introduction of competing magnetic interactions between R=Gd and Er compounds and R=Tb, Dy, and Ho ones. We have also assessed the magnetocaloric effect, and the configurational entropy dependence of the magnetic entropy change reflects that of the temperature derivative of the magnetic susceptibility. Our analysis suggests the possibility of enhancing magnetocaloric properties by designing the anisotropy of rare-earth magnetic moments in the high-entropy state.


title: Fermionic construction of the $\frac{\mathbb{Z}}{2}$-graded meromorphic open-string vertex algebra and its $\mathbb{Z}_2$-twisted module, I

abstract: We define the $\frac{\mathbb{Z}}{2}$-graded meromorphic open-string vertex algebra that is an appropriate noncommutative generalization of the vertex operator superalgebra. We also illustrate an example that can be viewed as a noncommutative generalization of the free fermion vertex operator superalgebra. The example is bulit upon a universal half-integer-graded non-anti-commutative Fock space where a creation operator and an annihilation operator satisfy the fermionic anti-commutativity relation, while no relations exist among the creation operators. The former feature allows us to define the normal ordering, while the latter feature allows us to describe interactions among the fermions. With respect to the normal ordering, Wick's theorem holds and leads to a proof of weak associativity and a closed formula of correlation functions.


title: A, B, C of Three-Qubit Entanglement: Three Vectors to Control It All

abstract: In this paper we are focusing on entanglement control problem in a three-qubit system. We demonstrate that vector representation of entanglement, associated with SO(6) representation of SU(4) two-qubit group, can be used to solve various control problems analytically including (i) the transformation between a W-type states and GHZ state, and (ii) manipulating bipartite concurrences and three-tangle under a restricted access to only two qubits, and (iii) designing USp(4)-type quaternionic operations and quantum states.


title: The Last Three Seconds: Packed Message delivered by Tides in Binary Neutron Star Mergers

abstract: It is known that the leading-order tidal effects in gravitational waveforms can be quantified by tidal deformability, while higher order terms, e.g., harmonic overtones of Love number and dynamical tides, have not been well-investigated yet. The concept of a ``form factor'', which is different from while resembles the effective tidal deformability, for the tidal interactions between neutron stars in coalescing binaries is illustrated here. The form factor effectively incorporates the contribution of dynamical tides. The dependence of tidal form factor on tidal deformability, spins, and inclination angles is modeled and expressed in a closed form.


title: NMF-based GPU accelerated coronagraphy pipeline

abstract: We present a generalized Non-negative factorization (NMF)-based data reduction pipeline for circumstellar disk and exoplanet detection. By using an adaptable pre-processing routine that applies algorithmic masks and corrections to improper data, we are able to easily offload the computationally-intensive NMF algorithm to a graphics processing unit (GPU), significantly increasing computational efficiency. NMF has been shown to better preserve disk structural features compared to other post-processing approaches and has demonstrated improvements in the analysis of archival data. The adaptive pre-processing routine of this pipeline, which automatically aligns and applies image corrections to the raw data, is shown to significantly improve chromatic halo suppression. Utilizing HST-STIS and JWST-MIRI coronagraphic datasets, we demonstrate a factor of five increase in real-time computational efficiency by using GPUs to perform NMF compared to using CPUs. Additionally, we demonstrate the usefulness of higher numbers of NMF components with SNR and contrast improvements, which necessitates the use of a more computationally efficient approach for data reduction.


title: A General Probabilistic Framework in IMALL: A Concrete Categorical Perspective

abstract: We consider the linear lambda-calculus extended with the sup type constructor, which provides an additive conjunction along with a non-deterministic destructor. The sup type constructor has been introduced in the context of quantum computing. In this paper, we study this type constructor within a simple linear logic categorical model, employing the category of semimodules over a commutative semiring. We demonstrate that the non-deterministic destructor, either weighted or not, finds a suitable model in a weighted codiagonal map. Our approach offers a valid and insightful alternative to interpreting non-determinism and probability calculi, in instances where the conventional Moggi's Powerset Monad interpretation does not align with the category's structure, as is the case with the category of semimodules. The validity of this alternative relies on the presence of biproducts within the category.


title: Democracy from topology

abstract: Chiral form fields in $d$ dimensions can be effectively described as edge modes of topological Chern-Simons theories in $d+1$ dimensions. At the same time, manifestly Lorentz-invariant Lagrangian description of such fields directly in terms of a $d$-dimensional field theory is challenging and requires introducing nontrivial auxiliary gauge fields eliminated on-shell with extra gauge symmetries. A recent work by Arvanitakis et al.\ demonstrates (emphasizing the case of 2d chiral bosons) that the two approaches are related, and a peculiar reduction on the $(d+1)$-dimensional topological Lagrangian automatically leads to $d$-dimensional Lagrangians with appropriate sets of auxiliary fields. We develop this setup in three distinct directions. First, we demonstrate how arbitrary Abelian self-interactions for chiral forms can be included using nonlinear boundary terms in the Chern-Simons theory. Second, by generalizing the Chern-Simons theory to the BF theory, we obtain an analogous democratic description of non-chiral form fields, where electric and magnetic potentials appear as explicit dynamical variables. Third, we discuss the effects of introducing topological interactions in the higher-dimensional bulk, which produce extra interaction terms in the boundary theory. When applied to a topological 4-form field in 12 dimensions, this construction results in a democratic description of the 3-form gauge field of the 11-dimensional supergravity.


title: Perceptual adjustment queries and an inverted measurement paradigm for low-rank metric learning

abstract: We introduce a new type of query mechanism for collecting human feedback, called the perceptual adjustment query ( PAQ). Being both informative and cognitively lightweight, the PAQ adopts an inverted measurement scheme, and combines advantages from both cardinal and ordinal queries. We showcase the PAQ in the metric learning problem, where we collect PAQ measurements to learn an unknown Mahalanobis distance. This gives rise to a high-dimensional, low-rank matrix estimation problem to which standard matrix estimators cannot be applied. Consequently, we develop a two-stage estimator for metric learning from PAQs, and provide sample complexity guarantees for this estimator. We present numerical simulations demonstrating the performance of the estimator and its notable properties.


title: Probabilistic Safety Regions Via Finite Families of Scalable Classifiers

abstract: Supervised classification recognizes patterns in the data to separate classes of behaviours. Canonical solutions contain misclassification errors that are intrinsic to the numerical approximating nature of machine learning. The data analyst may minimize the classification error on a class at the expense of increasing the error of the other classes. The error control of such a design phase is often done in a heuristic manner. In this context, it is key to develop theoretical foundations capable of providing probabilistic certifications to the obtained classifiers. In this perspective, we introduce the concept of probabilistic safety region to describe a subset of the input space in which the number of misclassified instances is probabilistically controlled. The notion of scalable classifiers is then exploited to link the tuning of machine learning with error control. Several tests corroborate the approach. They are provided through synthetic data in order to highlight all the steps involved, as well as through a smart mobility application.


title: Leveraging Pretrained Image-text Models for Improving Audio-Visual Learning

abstract: Visually grounded speech systems learn from paired images and their spoken captions. Recently, there have been attempts to utilize the visually grounded models trained from images and their corresponding text captions, such as CLIP, to improve speech-based visually grounded models' performance. However, the majority of these models only utilize the pretrained image encoder. Cascaded SpeechCLIP attempted to generate localized word-level information and utilize both the pretrained image and text encoders. Despite using both, they noticed a substantial drop in retrieval performance. We proposed Segmental SpeechCLIP which used a hierarchical segmental speech encoder to generate sequences of word-like units. We used the pretrained CLIP text encoder on top of these word-like unit representations and showed significant improvements over the cascaded variant of SpeechCLIP. Segmental SpeechCLIP directly learns the word embeddings as input to the CLIP text encoder bypassing the vocabulary embeddings. Here, we explore mapping audio to CLIP vocabulary embeddings via regularization and quantization. As our objective is to distill semantic information into the speech encoders, we explore the usage of large unimodal pretrained language models as the text encoders. Our method enables us to bridge image and text encoders e.g. DINO and RoBERTa trained with uni-modal data. Finally, we extend our framework in audio-only settings where only pairs of semantically related audio are available. Experiments show that audio-only systems perform close to the audio-visual system.


title: Suppression of the multiplicity fluctuations in particle correlations

abstract: Multiplicity fluctuations play a crucial role in relativistic heavy-ion collisions. In this work, we explore how the multiplicity fluctuations can be effectively suppressed in the measurement of particle correlations. In particular, through proper normalization, particle correlations can be evaluated in a manner irrelevant to multiplicity. When the multiplicity fluctuations are adequately extracted, Monte Carlo simulations show that the remaining correlations possess distinct features buried in the otherwise overwhelming fluctuations. Moreover, we argue that such a normalization scheme naturally agrees with the multi-particle correlator, which can be evaluated using the Q-vectors. The implications of the present study in the data analysis are also addressed.


title: Enhancing Missing Data Imputation of Non-stationary Signals with Harmonic Decomposition

abstract: Dealing with time series with missing values, including those afflicted by low quality or over-saturation, presents a significant signal processing challenge. The task of recovering these missing values, known as imputation, has led to the development of several algorithms. However, we have observed that the efficacy of these algorithms tends to diminish when the time series exhibit non-stationary oscillatory behavior. In this paper, we introduce a novel algorithm, coined Harmonic Level Interpolation (HaLI), which enhances the performance of existing imputation algorithms for oscillatory time series. After running any chosen imputation algorithm, HaLI leverages the harmonic decomposition based on the adaptive nonharmonic model of the initial imputation to improve the imputation accuracy for oscillatory time series. Experimental assessments conducted on synthetic and real signals consistently highlight that HaLI enhances the performance of existing imputation algorithms. The algorithm is made publicly available as a readily employable Matlab code for other researchers to use.


title: Open and reusable deep learning for pathology with WSInfer and QuPath

abstract: The field of digital pathology has seen a proliferation of deep learning models in recent years. Despite substantial progress, it remains rare for other researchers and pathologists to be able to access models published in the literature and apply them to their own images. This is due to difficulties in both sharing and running models. To address these concerns, we introduce WSInfer: a new, open-source software ecosystem designed to make deep learning for pathology more streamlined and accessible. WSInfer comprises three main elements: 1) a Python package and command line tool to efficiently apply patch-based deep learning inference to whole slide images; 2) a QuPath extension that provides an alternative inference engine through user-friendly and interactive software, and 3) a model zoo, which enables pathology models and metadata to be easily shared in a standardized form. Together, these contributions aim to encourage wider reuse, exploration, and interrogation of deep learning models for research purposes, by putting them into the hands of pathologists and eliminating a need for coding experience when accessed through QuPath. The WSInfer source code is hosted on GitHub and documentation is available at https://wsinfer.readthedocs.io.


title: Limits of economy and fidelity for programmable assembly of size-controlled triply-periodic polyhedra

abstract: We propose and investigate an extension of the Caspar-Klug symmetry principles for viral capsid assembly to the programmable assembly of size-controlled triply-periodic polyhedra, discrete variants of the Primitive, Diamond, and Gyroid cubic minimal surfaces. Inspired by a recent class of programmable DNA origami colloids, we demonstrate that the economy of design in these crystalline assemblies -- in terms of the growth of the number of distinct particle species required with the increased size-scale (e.g. periodicity) -- is comparable to viral shells. We further test the role of geometric specificity in these assemblies via dynamical assembly simulations, which show that conditions for simultaneously efficient and high-fidelity assembly require an intermediate degree of flexibility of local angles and lengths in programmed assembly. Off-target misassembly occurs via incorporation of a variant of disclination defects, generalized to the case of hyperbolic crystals. The possibility of these topological defects is a direct consequence of the very same symmetry principles that underlie the economical design, exposing a basic tradeoff between design economy and fidelity of programmable, size controlled assembly.


title: Measurement of the magnetic octupole susceptibility of PrV2Al20

abstract: In the electromagnetic multipole expansion, magnetic octupoles are the subsequent order of magnetic multipoles allowed in centrosymmetric systems, following the more commonly observed magnetic dipoles. As order parameters in condensed matter systems, magnetic octupoles have been experimentally elusive. In particular, the lack of simple external fields that directly couple to them makes their experimental detection challenging. Here, we demonstrate a methodology for probing the magnetic octupole susceptibility using a product of magnetic field $H_i$ and shear strain $\epsilon_{jk}$ to couple to the octupolar fluctuations, while using an adiabatic elastocaloric effect to probe the response to this composite effective field. We observe a Curie-Weiss behavior in the obtained octupolar susceptibility of \ce{PrV2Al20} up to temperatures approximately forty times the putative octupole ordering temperature. Our results demonstrate the presence of magnetic octupole fluctuations in the particular material system, and more broadly highlight how anisotropic strain can be combined with magnetic fields to formulate a versatile probe to observe otherwise elusive emergent `hidden' electronic orders.


title: Enhanced extra mixing in low-mass stars approaching the RGB tip and the problem of Li-rich red-clump stars

abstract: A few percent of red giants are enriched in Lithium with $A(\mathrm{Li}) > 1.5$. The evolutionary phase of the Li-rich red giants has remained uncertain because they could be placed both on the red-giant branch (RGB) near the bump luminosity and in the red clump (RC) region. However, thanks to asteroseismology, it has been found that most of them are actually RC stars. Starting at the bump luminosity, RGB progenitors of the RC stars experience extra mixing in the radiative zone separating the H-burning shell from the convective envelope followed by a series of convective He-shell flashes at the RGB tip, known as the He-core flash. Therefore, the He-core flash was proposed to cause fast extra mixing in the stars at the RGB tip that is needed for the Cameron-Fowler mechanism to produce Li. Alternatively, we propose that the RGB stars are getting enriched in Li by the same extra mixing that starts at the bump luminosity and initially leads to a decrease of the surface Li abundance but that is getting enhanced and begins to produce Li when the stars are approaching the RGB tip. We discuss five mechanisms of the RGB extra mixing, namely, the joint operation of rotation-driven meridional circulation and turbulent diffusion, the Azimuthal Magneto-Rotational Instability (AMRI), thermohaline convection, buoyancy of magnetic flux tubes, and internal gravity waves, and, based on results of (magneto-) hydrodynamics simulations, come to the conclusion that it is the mechanism of the AMRI that is most likely to support our hypothesis.


title: Can NLP Models 'Identify', 'Distinguish', and 'Justify' Questions that Don't have a Definitive Answer?

abstract: Though state-of-the-art (SOTA) NLP systems have achieved remarkable performance on a variety of language understanding tasks, they primarily focus on questions that have a correct and a definitive answer. However, in real-world applications, users often ask questions that don't have a definitive answer. Incorrectly answering such questions certainly hampers a system's reliability and trustworthiness. Can SOTA models accurately identify such questions and provide a reasonable response? To investigate the above question, we introduce QnotA, a dataset consisting of five different categories of questions that don't have definitive answers. Furthermore, for each QnotA instance, we also provide a corresponding QA instance i.e. an alternate question that ''can be'' answered. With this data, we formulate three evaluation tasks that test a system's ability to 'identify', 'distinguish', and 'justify' QnotA questions. Through comprehensive experiments, we show that even SOTA models including GPT-3 and Flan T5 do not fare well on these tasks and lack considerably behind the human performance baseline. We conduct a thorough analysis which further leads to several interesting findings. Overall, we believe our work and findings will encourage and facilitate further research in this important area and help develop more robust models.


title: A general Schwarz lemma for Hermitian manifolds

abstract: The Schwarz lemma for holomorphic maps between Hermitian manifolds is improved. New curvature constraints on the source and target manifolds are introduced and shown to be weaker than the Ricci and real bisectional curvature, respectively. The novel target curvature condition is intrinsic to the Hermitian structure and is controlled by the holomorphic sectional curvature if the metric is pluriclosed. This leads to significant improvements on the Wu--Yau theorem. Further, it is shown that the Schwarz lemma is largely invariant under a change of Hermitian connection, and the precise geometric quantity that varies with the connection is determined. This enables us to establish the Schwarz lemma for the Gauduchon connections.


title: Network analysis of graduate program support structures through experiences of various demographic groups

abstract: Physics graduate studies are substantial efforts, on the part of individual students, departments, and institutions of higher education. Understanding the factors that lead to student success and attrition is crucial for improving these programs. Students' broadly defined experiences related to support structures are one such factor that has recently begun being investigated. The aspects of student experience scale (ASES), a Likert-style survey, was developed by researchers to do just that. Previously, we have used the ASES data set to develop and demonstrate the network approach for Likert-style surveys (NALS) methodology. We found that NALS can identify thematic clusters within the resulting network that help to define different large-scale patterns for individually linked experiences. In this study, we leverage NALS to provide a unique interpretation of responses to the ASES instrument for well-defined demographic groups and showcase how this approach can be applied to other Likert-style data sets. We confirm the validity of the resulting themes by studying their stability and investigating how they are expressed within demographic-based networks.


title: On the effective dynamics of Bose-Fermi mixtures

abstract: In this work, we describe the dynamics of a Bose-Einstein condensate interacting with a degenerate Fermi gas, at zero temperature. First, we analyze the mean-field approximation of the many-body Schr\"odinger dynamics and prove emergence of a coupled Hartree-type system of equations. We obtain rigorous error control that yields a non-trivial scaling window in which the approximation is meaningful. Second, starting from this Hartree system, we identify a novel scaling regime in which the fermion distribution behaves semi-clasically, but the boson field remains quantum-mechanical; this is one of the main contributions of the present article. In this regime, the bosons are much lighter and more numerous than the fermions. We then prove convergence to a coupled Vlasov-Hartee system of equations with an explicit convergence rate.


title: Differentiable Simulation of a Liquid Argon Time Projection Chamber

abstract: Liquid argon time projection chambers (LArTPCs) are widely used in particle detection for their tracking and calorimetric capabilities. The particle physics community actively builds and improves high-quality simulators for such detectors in order to develop physics analyses in a realistic setting. The fidelity of these simulators relative to real, measured data is limited by the modeling of the physical detectors used for data collection. This modeling can be improved by performing dedicated calibration measurements. Conventional approaches calibrate individual detector parameters or processes one at a time. However, the impact of detector processes is entangled, making this a poor description of the underlying physics. We introduce a differentiable simulator that enables a gradient-based optimization, allowing for the first time a simultaneous calibration of all detector parameters. We describe the procedure of making a differentiable simulator, highlighting the challenges of retaining the physics quality of the standard, non-differentiable version while providing meaningful gradient information. We further discuss the advantages and drawbacks of using our differentiable simulator for calibration. Finally, we provide a starting point for extensions to our approach, including applications of the differentiable simulator to physics analysis pipelines.


title: Few-Shot Learning of Force-Based Motions From Demonstration Through Pre-training of Haptic Representation

abstract: In many contact-rich tasks, force sensing plays an essential role in adapting the motion to the physical properties of the manipulated object. To enable robots to capture the underlying distribution of object properties necessary for generalising learnt manipulation tasks to unseen objects, existing Learning from Demonstration (LfD) approaches require a large number of costly human demonstrations. Our proposed semi-supervised LfD approach decouples the learnt model into an haptic representation encoder and a motion generation decoder. This enables us to pre-train the first using large amount of unsupervised data, easily accessible, while using few-shot LfD to train the second, leveraging the benefits of learning skills from humans. We validate the approach on the wiping task using sponges with different stiffness and surface friction. Our results demonstrate that pre-training significantly improves the ability of the LfD model to recognise physical properties and generate desired wiping motions for unseen sponges, outperforming the LfD method without pre-training. We validate the motion generated by our semi-supervised LfD model on the physical robot hardware using the KUKA iiwa robot arm. We also validate that the haptic representation encoder, pre-trained in simulation, captures the properties of real objects, explaining its contribution to improving the generalisation of the downstream task.


title: Exploring Domain-Specific Enhancements for a Neural Foley Synthesizer

abstract: Foley sound synthesis refers to the creation of authentic, diegetic sound effects for media, such as film or radio. In this study, we construct a neural Foley synthesizer capable of generating mono-audio clips across seven predefined categories. Our approach introduces multiple enhancements to existing models in the text-to-audio domain, with the goal of enriching the diversity and acoustic characteristics of the generated foleys. Notably, we utilize a pre-trained encoder that retains acoustical and musical attributes in intermediate embeddings, implement class-conditioning to enhance differentiability among foley classes in their intermediate representations, and devise an innovative transformer-based architecture for optimizing self-attention computations on very large inputs without compromising valuable information. Subsequent to implementation, we present intermediate outcomes that surpass the baseline, discuss practical challenges encountered in achieving optimal results, and outline potential pathways for further research.


title: The Complexity of Verifying Boolean Programs as Differentially Private

abstract: We study the complexity of the problem of verifying differential privacy for while-like programs working over boolean values and making probabilistic choices. Programs in this class can be interpreted into finite-state discrete-time Markov Chains (DTMC). We show that the problem of deciding whether a program is differentially private for specific values of the privacy parameters is PSPACE-complete. To show that this problem is in PSPACE, we adapt classical results about computing hitting probabilities for DTMC. To show PSPACE-hardness we use a reduction from the problem of checking whether a program almost surely terminates or not. We also show that the problem of approximating the privacy parameters that a program provides is PSPACE-hard. Moreover, we investigate the complexity of similar problems also for several relaxations of differential privacy: R\'enyi differential privacy, concentrated differential privacy, and truncated concentrated differential privacy. For these notions, we consider gap-versions of the problem of deciding whether a program is private or not and we show that all of them are PSPACE-complete.


title: Parallel Submodular Function Minimization

abstract: We consider the parallel complexity of submodular function minimization (SFM). We provide a pair of methods which obtain two new query versus depth trade-offs a submodular function defined on subsets of $n$ elements that has integer values between $-M$ and $M$. The first method has depth $2$ and query complexity $n^{O(M)}$ and the second method has depth $\widetilde{O}(n^{1/3} M^{2/3})$ and query complexity $O(\mathrm{poly}(n, M))$. Despite a line of work on improved parallel lower bounds for SFM, prior to our work the only known algorithms for parallel SFM either followed from more general methods for sequential SFM or highly-parallel minimization of convex $\ell_2$-Lipschitz functions. Interestingly, to obtain our second result we provide the first highly-parallel algorithm for minimizing $\ell_\infty$-Lipschitz function over the hypercube which obtains near-optimal depth for obtaining constant accuracy.


title: Towards Understanding Neural Collapse: The Effects of Batch Normalization and Weight Decay

abstract: Neural Collapse (NC) is a geometric structure recently observed in the final layer of neural network classifiers. In this paper, we investigate the interrelationships between batch normalization (BN), weight decay, and proximity to the NC structure. Our work introduces the geometrically intuitive intra-class and inter-class cosine similarity measure, which encapsulates multiple core aspects of NC. Leveraging this measure, we establish theoretical guarantees for the emergence of NC under the influence of last-layer BN and weight decay, specifically in scenarios where the regularized cross-entropy loss is near-optimal. Experimental evidence substantiates our theoretical findings, revealing a pronounced occurrence of NC in models incorporating BN and appropriate weight-decay values. This combination of theoretical and empirical insights suggests a greatly influential role of BN and weight decay in the emergence of NC.


title: Universal Pl\"ucker coordinates for the Wronski map and positivity in real Schubert calculus

abstract: Given a $d$-dimensional vector space $V \subset \mathbb{C}[u]$ of polynomials, its Wronskian is the polynomial $(u + z_1) \cdots (u + z_n)$ whose zeros $-z_i$ are the points of $\mathbb{C}$ such that $V$ contains a nonzero polynomial with a zero of order at least $d$ at $-z_i$. Equivalently, $V$ is a solution to the Schubert problem defined by osculating planes to the moment curve at $z_1, \dots, z_n$. The inverse Wronski problem involves finding all $V$ with a given Wronskian $(u + z_1) \cdots (u + z_n)$. We solve this problem by providing explicit formulas for the Grassmann-Pl\"ucker coordinates of the general solution $V$, as commuting operators in the group algebra $\mathbb{C}[\mathfrak{S}_n]$ of the symmetric group. The Pl\"ucker coordinates of individual solutions over $\mathbb{C}$ are obtained by restricting to an eigenspace and replacing each operator by its eigenvalue. This generalizes work of Mukhin, Tarasov, and Varchenko (2013) and of Purbhoo (2022), which give formulas in $\mathbb{C}[\mathfrak{S}_n]$ for the differential equation satisfied by $V$. Moreover, if $z_1, \dots, z_n$ are real and nonnegative, then our operators are positive semidefinite, implying that the Pl\"ucker coordinates of $V$ are all real and nonnegative. This verifies several outstanding conjectures in real Schubert calculus, including the positivity conjectures of Mukhin and Tarasov (2017) and of Karp (2021), the disconjugacy conjecture of Eremenko (2015), and the divisor form of the secant conjecture of Sottile (2003). The proofs involve the representation theory of $\mathfrak{S}_n$, symmetric functions, and $\tau$-functions of the KP hierarchy.


title: Efficient Finetuning Large Language Models For Vietnamese Chatbot

abstract: Large language models (LLMs), such as GPT-4, PaLM, and LLaMa, have been shown to achieve remarkable performance across a variety of natural language tasks. Recent advancements in instruction tuning bring LLMs with ability in following user's instructions and producing human-like responses. However, the high costs associated with training and implementing LLMs pose challenges to academic research. Furthermore, the availability of pretrained LLMs and instruction-tune datasets for Vietnamese language is limited. To tackle these concerns, we leverage large-scale instruction-following datasets from open-source projects, namely Alpaca, GPT4All, and Chat-Doctor, which cover general domain and specific medical domain. To the best of our knowledge, these are the first instructional dataset for Vietnamese. Subsequently, we utilize parameter-efficient tuning through Low-Rank Adaptation (LoRA) on two open LLMs: Bloomz (Multilingual) and GPTJ-6B (Vietnamese), resulting four models: Bloomz-Chat, Bloomz-Doctor, GPTJ-Chat, GPTJ-Doctor.Finally, we assess the effectiveness of our methodology on a per-sample basis, taking into consideration the helpfulness, relevance, accuracy, level of detail in their responses. This evaluation process entails the utilization of GPT-4 as an automated scoring mechanism. Despite utilizing a low-cost setup, our method demonstrates about 20-30\% improvement over the original models in our evaluation tasks.


title: Stochastic Differential Mean-Field Games in a Weak Formulation

abstract: We study a Mean Field Game system in a weak formulation through its associated McKean-Vlasov Forward-Backward Stochastic Differential Equation (FBSDE). Our main goal is to obtain existence and regularity results of this FBSDE using the techniques of Malliavin calculus, in particular, classical and Malliavin differentiability. Using these results, we characterize the decoupling (master) field.


title: Discovery of Charge Order in the Transition Metal Dichalcogenide Fe$_{x}$NbS$_2$

abstract: The Fe intercalated transition metal dichalcogenide (TMD), Fe$_{1/3}$NbS$_2$, exhibits remarkable resistance switching properties and highly tunable spin ordering phases due to magnetic defects. We conduct synchrotron X-ray scattering measurements on both under-intercalated ($x$ = 0.32) and over-intercalated ($x$ = 0.35) samples. We discover a new charge order phase in the over-intercalated sample, where the excess Fe atoms lead to a zigzag antiferromagnetic order. The agreement between the charge and magnetic ordering temperatures, as well as their intensity relationship, suggests a strong magnetoelastic coupling as the mechanism for the charge ordering. Our results reveal the first example of a charge order phase among the intercalated TMD family and demonstrate the ability to stabilize charge modulation by introducing electronic correlations, where the charge order is absent in bulk 2H-NbS$_2$ compared to other pristine TMDs.


title: Poke: An open-source ray-based physical optics platform

abstract: Integrated optical models allow for accurate prediction of the as-built performance of an optical instrument. Optical models are typically composed of a separate ray trace and diffraction model to capture both the geometrical and physical regimes of light. These models are typically separated across both open-source and commercial software that don't interface with each other directly. To bridge the gap between ray trace models and diffraction models, we have built an open-source optical analysis platform in Python called Poke that uses commercial ray tracing APIs and open-source physical optics engines to simultaneously model scalar wavefront error, diffraction, and polarization. Poke operates by storing ray data from a commercial ray tracing engine into a Python object, from which physical optics calculations can be made. We present an introduction to using Poke, and highlight the capabilities of two new propagation physics modules that add to the utility of existing scalar diffraction models. Gaussian Beamlet Decomposition is a ray-based approach to diffraction modeling that allows us to integrate physical optics models with ray trace models to directly capture the influence of ray aberrations in diffraction simulations. Polarization Ray Tracing is a ray-based method of vector field propagation that can diagnose the polarization aberrations in optical systems. Poke has been recently used to study the next generation of astronomical observatories, including the ground-based Extremely Large Telescopes and a 6 meter space telescope early concept for NASA's Habitable Worlds Observatory.


title: Exploring Robust Features for Improving Adversarial Robustness

abstract: While deep neural networks (DNNs) have revolutionized many fields, their fragility to carefully designed adversarial attacks impedes the usage of DNNs in safety-critical applications. In this paper, we strive to explore the robust features which are not affected by the adversarial perturbations, i.e., invariant to the clean image and its adversarial examples, to improve the model's adversarial robustness. Specifically, we propose a feature disentanglement model to segregate the robust features from non-robust features and domain specific features. The extensive experiments on four widely used datasets with different attacks demonstrate that robust features obtained from our model improve the model's adversarial robustness compared to the state-of-the-art approaches. Moreover, the trained domain discriminator is able to identify the domain specific features from the clean images and adversarial examples almost perfectly. This enables adversarial example detection without incurring additional computational costs. With that, we can also specify different classifiers for clean images and adversarial examples, thereby avoiding any drop in clean image accuracy.


title: Video and Synthetic MRI Pre-training of 3D Vision Architectures for Neuroimage Analysis

abstract: Transfer learning represents a recent paradigm shift in the way we build artificial intelligence (AI) systems. In contrast to training task-specific models, transfer learning involves pre-training deep learning models on a large corpus of data and minimally fine-tuning them for adaptation to specific tasks. Even so, for 3D medical imaging tasks, we do not know if it is best to pre-train models on natural images, medical images, or even synthetically generated MRI scans or video data. To evaluate these alternatives, here we benchmarked vision transformers (ViTs) and convolutional neural networks (CNNs), initialized with varied upstream pre-training approaches. These methods were then adapted to three unique downstream neuroimaging tasks with a range of difficulty: Alzheimer's disease (AD) and Parkinson's disease (PD) classification, "brain age" prediction. Experimental tests led to the following key observations: 1. Pre-training improved performance across all tasks including a boost of 7.4% for AD classification and 4.6% for PD classification for the ViT and 19.1% for PD classification and reduction in brain age prediction error by 1.26 years for CNNs, 2. Pre-training on large-scale video or synthetic MRI data boosted performance of ViTs, 3. CNNs were robust in limited-data settings, and in-domain pretraining enhanced their performances, 4. Pre-training improved generalization to out-of-distribution datasets and sites. Overall, we benchmarked different vision architectures, revealing the value of pre-training them with emerging datasets for model initialization. The resulting pre-trained models can be adapted to a range of downstream neuroimaging tasks, even when training data for the target task is limited.


title: A Further Study of Linux Kernel Hugepages on A64FX with FLASH, an Astrophysical Simulation Code

abstract: We present an expanded study of the performance of FLASH when using Linux Kernel Hugepages on Ookami, an HPE Apollo 80 A64FX platform. FLASH is a multi-scale, multi-physics simulation code written principally in modern Fortran and makes use of the PARAMESH library to manage a block-structured adaptive mesh. Our initial study used only the Fujitsu compiler to utilize standard hugepages (hp), but further investigation allowed us to utilize hp for multiple compilers by linking to the Fujitsu library libmpg and transparent hugepages (thp) by enabling it at the node level. By comparing the results of hardware counters and in-code timers, we found that hp and thp do not significantly impact the runtime performance of FLASH. Interestingly, there is a significant reduction in the TLB misses, differences in cache and memory access counters, and strange behavior is observed when using thp.


title: Relative representations for cognitive graphs

abstract: Although the latent spaces learned by distinct neural networks are not generally directly comparable, recent work in machine learning has shown that it is possible to use the similarities and differences among latent space vectors to derive "relative representations" with comparable representational power to their "absolute" counterparts, and which are nearly identical across models trained on similar data distributions. Apart from their intrinsic interest in revealing the underlying structure of learned latent spaces, relative representations are useful to compare representations across networks as a generic proxy for convergence, and for zero-shot model stitching. In this work we examine an extension of relative representations to discrete state-space models, using Clone-Structured Cognitive Graphs (CSCGs) for 2D spatial localization and navigation as a test case. Our work shows that the probability vectors computed during message passing can be used to define relative representations on CSCGs, enabling effective communication across agents trained using different random initializations and training sequences, and on only partially similar spaces. We introduce a technique for zero-shot model stitching that can be applied post hoc, without the need for using relative representations during training. This exploratory work is intended as a proof-of-concept for the application of relative representations to the study of cognitive maps in neuroscience and AI.


title: Mask-CTC-based Encoder Pre-training for Streaming End-to-End Speech Recognition

abstract: Achieving high accuracy with low latency has always been a challenge in streaming end-to-end automatic speech recognition (ASR) systems. By attending to more future contexts, a streaming ASR model achieves higher accuracy but results in larger latency, which hurts the streaming performance. In the Mask-CTC framework, an encoder network is trained to learn the feature representation that anticipates long-term contexts, which is desirable for streaming ASR. Mask-CTC-based encoder pre-training has been shown beneficial in achieving low latency and high accuracy for triggered attention-based ASR. However, the effectiveness of this method has not been demonstrated for various model architectures, nor has it been verified that the encoder has the expected look-ahead capability to reduce latency. This study, therefore, examines the effectiveness of Mask-CTCbased pre-training for models with different architectures, such as Transformer-Transducer and contextual block streaming ASR. We also discuss the effect of the proposed pre-training method on obtaining accurate output spike timing.


title: Intelligent upper-limb exoskeleton integrated with soft wearable bioelectronics and deep-learning for human intention-driven strength augmentation based on sensory feedback

abstract: The age and stroke-associated decline in musculoskeletal strength degrades the ability to perform daily human tasks using the upper extremities. Although there are a few examples of exoskeletons, they need manual operations due to the absence of sensor feedback and no intention prediction of movements. Here, we introduce an intelligent upper-limb exoskeleton system that uses cloud-based deep learning to predict human intention for strength augmentation. The embedded soft wearable sensors provide sensory feedback by collecting real-time muscle signals, which are simultaneously computed to determine the user's intended movement. The cloud-based deep-learning predicts four upper-limb joint motions with an average accuracy of 96.2% at a 200-250 millisecond response rate, suggesting that the exoskeleton operates just by human intention. In addition, an array of soft pneumatics assists the intended movements by providing 897 newton of force and 78.7 millimeter of displacement at maximum. Collectively, the intent-driven exoskeleton can augment human strength by 5.15 times on average compared to the unassisted exoskeleton. This report demonstrates an exoskeleton robot that augments the upper-limb joint movements by human intention based on a machine-learning cloud computing and sensory feedback.


title: A constant factor approximation for Nash social welfare with subadditive valuations

abstract: We present a constant-factor approximation algorithm for the Nash social welfare maximization problem with subadditive valuations accessible via demand queries. More generally, we propose a template for NSW optimization by solving a configuration-type LP and using a rounding procedure for (utilitarian) social welfare as a blackbox, which could be applicable to other variants of the problem.


title: Generation and Recombination for Multifocus Image Fusion with Free Number of Inputs

abstract: Multifocus image fusion is an effective way to overcome the limitation of optical lenses. Many existing methods obtain fused results by generating decision maps. However, such methods often assume that the focused areas of the two source images are complementary, making it impossible to achieve simultaneous fusion of multiple images. Additionally, the existing methods ignore the impact of hard pixels on fusion performance, limiting the visual quality improvement of fusion image. To address these issues, a combining generation and recombination model, termed as GRFusion, is proposed. In GRFusion, focus property detection of each source image can be implemented independently, enabling simultaneous fusion of multiple source images and avoiding information loss caused by alternating fusion. This makes GRFusion free from the number of inputs. To distinguish the hard pixels from the source images, we achieve the determination of hard pixels by considering the inconsistency among the detection results of focus areas in source images. Furthermore, a multi-directional gradient embedding method for generating full focus images is proposed. Subsequently, a hard-pixel-guided recombination mechanism for constructing fused result is devised, effectively integrating the complementary advantages of feature reconstruction-based method and focused pixel recombination-based method. Extensive experimental results demonstrate the effectiveness and the superiority of the proposed method.The source code will be released on https://github.com/xxx/xxx.


title: Exploring Large Language Models for Communication Games: An Empirical Study on Werewolf

abstract: Communication games, which we refer to as incomplete information games that heavily depend on natural language communication, hold significant research value in fields such as economics, social science, and artificial intelligence. In this work, we explore the problem of how to engage large language models (LLMs) in communication games, and in response, propose a tuning-free framework. Our approach keeps LLMs frozen, and relies on the retrieval and reflection on past communications and experiences for improvement. An empirical study on the representative and widely-studied communication game, ``Werewolf'', demonstrates that our framework can effectively play Werewolf game without tuning the parameters of the LLMs. More importantly, strategic behaviors begin to emerge in our experiments, suggesting that it will be a fruitful journey to engage LLMs in communication games and associated domains.


title: Progressive Feature Adjustment for Semi-supervised Learning from Pretrained Models

abstract: As an effective way to alleviate the burden of data annotation, semi-supervised learning (SSL) provides an attractive solution due to its ability to leverage both labeled and unlabeled data to build a predictive model. While significant progress has been made recently, SSL algorithms are often evaluated and developed under the assumption that the network is randomly initialized. This is in sharp contrast to most vision recognition systems that are built from fine-tuning a pretrained network for better performance. While the marriage of SSL and a pretrained model seems to be straightforward, recent literature suggests that naively applying state-of-the-art SSL with a pretrained model fails to unleash the full potential of training data. In this paper, we postulate the underlying reason is that the pretrained feature representation could bring a bias inherited from the source data, and the bias tends to be magnified through the self-training process in a typical SSL algorithm. To overcome this issue, we propose to use pseudo-labels from the unlabelled data to update the feature extractor that is less sensitive to incorrect labels and only allow the classifier to be trained from the labeled data. More specifically, we progressively adjust the feature extractor to ensure its induced feature distribution maintains a good class separability even under strong input perturbation. Through extensive experimental studies, we show that the proposed approach achieves superior performance over existing solutions.


title: Compiling Recurrences over Dense and Sparse Arrays

abstract: Recurrence equations lie at the heart of many computational paradigms including dynamic programming, graph analysis, and linear solvers. These equations are often expensive to compute and much work has gone into optimizing them for different situations. The set of recurrence implementations is a large design space across the set of all recurrences (e.g., the Viterbi and Floyd-Warshall algorithms), the choice of data structures (e.g., dense and sparse matrices), and the set of different loop orders. Optimized library implementations do not exist for most points in this design space, and developers must therefore often manually implement and optimize recurrences. We present a general framework for compiling recurrence equations into native code corresponding to any valid point in this general design space. In this framework, users specify a system of recurrences, the type of data structures for storing the input and outputs, and a set of scheduling primitives for optimization. A greedy algorithm then takes this specification and lowers it into a native program that respects the dependencies inherent to the recurrence equation. We describe the compiler transformations necessary to lower this high-level specification into native parallel code for either sparse and dense data structures and provide an algorithm for determining whether the recurrence system is solvable with the provided scheduling primitives. We evaluate the performance and correctness of the generated code on various computational tasks from domains including dense and sparse matrix solvers, dynamic programming, graph problems, and sparse tensor algebra. We demonstrate that generated code has competitive performance to handwritten implementations in libraries.


title: Evaluating the quantum optimal biased bound in a unitary evolution process

abstract: Seeking the available precision limit of unknown parameters is a significant task in quantum parameter estimation. One often resorts to the widely utilized quantum Cramer-Rao bound (QCRB) based on unbiased estimators to finish this task. Nevertheless, most actual estimators are usually biased in the limited number of trials. For this reason, we introduce two effective error bounds for biased estimators based on a unitary evolution process in the framework of the quantum optimal biased bound. Furthermore, we show their estimation performance by two specific examples of the unitary evolution process, including the phase encoding and the SU(2) interferometer process. Our findings will provide an useful guidance for finding the precision limit of unknown parameters.


title: MADLAD-400: A Multilingual And Document-Level Large Audited Dataset

abstract: We introduce MADLAD-400, a manually audited, general domain 3T token monolingual dataset based on CommonCrawl, spanning 419 languages. We discuss the limitations revealed by self-auditing MADLAD-400, and the role data auditing had in the dataset creation process. We then train and release a 10.7B-parameter multilingual machine translation model on 250 billion tokens covering over 450 languages using publicly available data, and find that it is competitive with models that are significantly larger, and report the results on different domains. In addition, we train a 8B-parameter language model, and assess the results on few-shot translation. We make the baseline models available to the research community.


title: FIAT: Fusing learning paradigms with Instruction-Accelerated Tuning

abstract: Learning paradigms for large language models (LLMs) currently tend to fall within either in-context learning (ICL) or full fine-tuning. Each of these comes with their own trade-offs based on available data, model size, compute cost, ease-of-use, and final quality with neither solution performing well across-the-board. In this article, we first describe ICL and fine-tuning paradigms in a way that highlights their natural connections. Based on these connections, we propose a new learning paradigm called FIAT that fuses the best of these paradigms together, enabling prompt-engineered instructions and chain-of-thought reasoning with the very largest models while also using similar methods to perform parameter updates on a modestly-sized LLM with parameter-efficient tuning. We evaluate FIAT's effectiveness on a variety of multilingual tasks and observe that FIAT performs better than both ICL and fine-tuning at scales ranging from 100-10,000 training examples. We hope that FIAT provides a practical way of harnessing the full potential of LLMs without needing to make a hard choice between learning paradigms.


title: Compact: Approximating Complex Activation Functions for Secure Computation

abstract: Secure multi-party computation (MPC) techniques can be used to provide data privacy when users query deep neural network (DNN) models hosted on a public cloud. State-of-the-art MPC techniques can be directly leveraged for DNN models that use simple activation functions such as ReLU. However, these techniques are ineffective and/or inefficient for the complex and highly non-linear activation functions used in cutting-edge DNN models. We present Compact, which produces piece-wise polynomial approximations of complex AFs to enable their efficient use with state-of-the-art MPC techniques. Compact neither requires nor imposes any restriction on model training and results in near-identical model accuracy. To achieve this, we design Compact with input density awareness and use an application-specific simulated annealing type optimization to generate computationally more efficient approximations of complex AFs. We extensively evaluate Compact on four different machine-learning tasks with DNN architectures that use popular complex AFs silu, gelu, and mish. Our experimental results show that Compact incurs negligible accuracy loss while being 2x-5x computationally more efficient than state-of-the-art approaches for DNN models with large number of hidden layers. Our work accelerates easy adoption of MPC techniques to provide user data privacy even when the queried DNN models consist of a number of hidden layers and trained over complex AFs.


title: Bridging two quantum quench problems -- local joining quantum quench and M\"obius quench -- and their holographic dual descriptions

abstract: We establish an equivalence between two different quantum quench problems, the joining local quantum quench and the M\"obius quench, in the context of $(1+1)$-dimensional conformal field theory (CFT). Here, in the former, two initially decoupled systems (CFTs) on finite intervals are joined at $t=0$. In the latter, we consider the system that is initially prepared in the ground state of the regular homogeneous Hamiltonian on a finite interval and, after $t=0$, let it time-evolve by the so-called M\"obius Hamiltonian that is spatially inhomogeneous. The equivalence allows us to relate the time-dependent physical observables in one of these problems to those in the other. As an application of the equivalence, we construct a holographic dual of the M\"obius quench from that of the local quantum quench. The holographic geometry involves an end-of-the-world brane whose profile exhibits non-trivial dynamics.


title: Derivation of Instrument Requirements for Polarimetry using Mg, Fe, and Mn lines between 250 and 290 nm

abstract: Judge et al. (2021) recently argued that a region of the solar spectrum in the near-UV between about 250 and 290 nm is optimal for studying magnetism in the solar chromosphere due to an abundance of Mg II, Fe II, and Fe I lines that sample various heights in the solar atmosphere. In this paper we derive requirements for spectropolarimetric instruments to observe these lines. We derive a relationship between the desired sensitivity to magnetic field and the signal-to-noise of the measurement from the weak-field approximation of the Zeeman effect. We find that many lines will exhibit observable polarization signals for both longitudinal and transverse magnetic field with reasonable amplitudes.


title: Nontrivial upper bound for chemical distance on the planar random cluster model

abstract: We extend the upper bounds derived for the horizontal and radial chemical distance for 2d Bernoulli percolation in [DHS21, SR20] to the planar random cluster model with cluster weight $1 \le q \le 4$. Along the way, we provide a complete proof of the strong arm separation lemma for the random cluster model.


title: Influence Maximization in Social Networks: A Survey

abstract: Online social networks have become an important platform for people to communicate, share knowledge and disseminate information. Given the widespread usage of social media, individuals' ideas, preferences and behavior are often influenced by their peers or friends in the social networks that they participate in. Since the last decade, influence maximization (IM) problem has been extensively adopted to model the diffusion of innovations and ideas. The purpose of IM is to select a set of k seed nodes who can influence the most individuals in the network. In this survey, we present a systematical study over the researches and future directions with respect to IM problem. We review the information diffusion models and analyze a variety of algorithms for the classic IM algorithms. We propose a taxonomy for potential readers to understand the key techniques and challenges. We also organize the milestone works in time order such that the readers of this survey can experience the research roadmap in this field. Moreover, we also categorize other application-oriented IM studies and correspondingly study each of them. What's more, we list a series of open questions as the future directions for IM-related researches, where a potential reader of this survey can easily observe what should be done next in this field.


title: Unified Language-Vision Pretraining in LLM with Dynamic Discrete Visual Tokenization

abstract: Recently, the remarkable advance of the Large Language Model (LLM) has inspired researchers to transfer its extraordinary reasoning capability to both vision and language data. However, the prevailing approaches primarily regard the visual input as a prompt and focus exclusively on optimizing the text generation process conditioned upon vision content by a frozen LLM. Such an inequitable treatment of vision and language heavily constrains the model's potential. In this paper, we break through this limitation by representing both vision and language in a unified form. Specifically, we introduce a well-designed visual tokenizer to translate the non-linguistic image into a sequence of discrete tokens like a foreign language that LLM can read. The resulting visual tokens encompass high-level semantics worthy of a word and also support dynamic sequence length varying from the image. Coped with this tokenizer, the presented foundation model called LaVIT can handle both image and text indiscriminately under the same generative learning paradigm. This unification empowers LaVIT to serve as an impressive generalist interface to understand and generate multi-modal content simultaneously. Extensive experiments further showcase that it outperforms the existing models by a large margin on massive vision-language tasks. Our code and models are available at https://github.com/jy0205/LaVIT.


title: Generalized Minimum Error with Fiducial Points Criterion for Robust Learning

abstract: The conventional Minimum Error Entropy criterion (MEE) has its limitations, showing reduced sensitivity to error mean values and uncertainty regarding error probability density function locations. To overcome this, a MEE with fiducial points criterion (MEEF), was presented. However, the efficacy of the MEEF is not consistent due to its reliance on a fixed Gaussian kernel. In this paper, a generalized minimum error with fiducial points criterion (GMEEF) is presented by adopting the Generalized Gaussian Density (GGD) function as kernel. The GGD extends the Gaussian distribution by introducing a shape parameter that provides more control over the tail behavior and peakedness. In addition, due to the high computational complexity of GMEEF criterion, the quantized idea is introduced to notably lower the computational load of the GMEEF-type algorithm. Finally, the proposed criterions are introduced to the domains of adaptive filter, kernel recursive algorithm, and multilayer perceptron. Several numerical simulations, which contain system identification, acoustic echo cancellation, times series prediction, and supervised classification, indicate that the novel algorithms' performance performs excellently.

categories: eess.SP cs.SD cs.SY eess.AS eess.IV eess.SY


title: Towards Accelerating High-Order Stencils on Modern GPUs and Emerging Architectures with a Portable Framework

abstract: PDE discretization schemes yielding stencil-like computing patterns are commonly used for seismic modeling, weather forecast, and other scientific applications. Achieving HPC-level stencil computations on one architecture is challenging, porting to other architectures without sacrificing performance requires significant effort, especially in this golden age of many distinctive architectures. To help developers achieve performance, portability, and productivity with stencil computations, we developed StencilPy. With StencilPy, developers write stencil computations in a high-level domain-specific language, which promotes productivity, while its backends generate efficient code for existing and emerging architectures, including NVIDIA, AMD, and Intel GPUs, A64FX, and STX. StencilPy demonstrates promising performance results on par with hand-written code, maintains cross-architectural performance portability, and enhances productivity. Its modular design enables easy configuration, customization, and extension. A 25-point star-shaped stencil written in StencilPy is one-quarter of the length of a hand-crafted CUDA code and achieves similar performance on an NVIDIA H100 GPU.


title: SSHNN: Semi-Supervised Hybrid NAS Network for Echocardiographic Image Segmentation

abstract: Accurate medical image segmentation especially for echocardiographic images with unmissable noise requires elaborate network design. Compared with manual design, Neural Architecture Search (NAS) realizes better segmentation results due to larger search space and automatic optimization, but most of the existing methods are weak in layer-wise feature aggregation and adopt a ``strong encoder, weak decoder" structure, insufficient to handle global relationships and local details. To resolve these issues, we propose a novel semi-supervised hybrid NAS network for accurate medical image segmentation termed SSHNN. In SSHNN, we creatively use convolution operation in layer-wise feature fusion instead of normalized scalars to avoid losing details, making NAS a stronger encoder. Moreover, Transformers are introduced for the compensation of global context and U-shaped decoder is designed to efficiently connect global context with local features. Specifically, we implement a semi-supervised algorithm Mean-Teacher to overcome the limited volume problem of labeled medical image dataset. Extensive experiments on CAMUS echocardiography dataset demonstrate that SSHNN outperforms state-of-the-art approaches and realizes accurate segmentation. Code will be made publicly available.


title: On the relative Morrison-Kawamata cone conjecture (II)

abstract: Assuming the Morrison-Kawamata cone conjecture for the generic fiber of a Calabi-Yau fibration and the abundance conjecture, we show (1) the finiteness of minimal models, (2) the existence of a weak rational polyhedral fundamental domain under the action of birational automorphism groups, and (3) the finiteness of varieties as targets of contractions. As an application, the finiteness of minimal models and the weak Morrison-Kawamata cone conjecture in relative dimensions $\leq 2$ are established.


title: Wasserstein Convergence Rate for Empirical Measures of Markov Processes

abstract: The convergence rate in Wasserstein distance is estimated for empirical measures of ergodic Markov processes, and the estimate can be sharp in some specific situations. The main result is applied to subordinations of typical models excluded by existing results, which include: stochastic Hamiltonian systems on $\mathbb R^{n}\times \mathbb R^{m}$, spherical velocity Langevin processes on $\mathbb R^n\times\mathbb S^{n-1},$ multi-dimensional Wright-Fisher type diffusion processes, and stable type jump processes.


title: BiLMa: Bidirectional Local-Matching for Text-based Person Re-identification

abstract: Text-based person re-identification (TBPReID) aims to retrieve person images represented by a given textual query. In this task, how to effectively align images and texts globally and locally is a crucial challenge. Recent works have obtained high performances by solving Masked Language Modeling (MLM) to align image/text parts. However, they only performed uni-directional (i.e., from image to text) local-matching, leaving room for improvement by introducing opposite-directional (i.e., from text to image) local-matching. In this work, we introduce Bidirectional Local-Matching (BiLMa) framework that jointly optimize MLM and Masked Image Modeling (MIM) in TBPReID model training. With this framework, our model is trained so as the labels of randomly masked both image and text tokens are predicted by unmasked tokens. In addition, to narrow the semantic gap between image and text in MIM, we propose Semantic MIM (SemMIM), in which the labels of masked image tokens are automatically given by a state-of-the-art human parser. Experimental results demonstrate that our BiLMa framework with SemMIM achieves state-of-the-art Rank@1 and mAP scores on three benchmarks.


title: Flexible and Robust Counterfactual Explanations with Minimal Satisfiable Perturbations

abstract: Counterfactual explanations (CFEs) exemplify how to minimally modify a feature vector to achieve a different prediction for an instance. CFEs can enhance informational fairness and trustworthiness, and provide suggestions for users who receive adverse predictions. However, recent research has shown that multiple CFEs can be offered for the same instance or instances with slight differences. Multiple CFEs provide flexible choices and cover diverse desiderata for user selection. However, individual fairness and model reliability will be damaged if unstable CFEs with different costs are returned. Existing methods fail to exploit flexibility and address the concerns of non-robustness simultaneously. To address these issues, we propose a conceptually simple yet effective solution named Counterfactual Explanations with Minimal Satisfiable Perturbations (CEMSP). Specifically, CEMSP constrains changing values of abnormal features with the help of their semantically meaningful normal ranges. For efficiency, we model the problem as a Boolean satisfiability problem to modify as few features as possible. Additionally, CEMSP is a general framework and can easily accommodate more practical requirements, e.g., casualty and actionability. Compared to existing methods, we conduct comprehensive experiments on both synthetic and real-world datasets to demonstrate that our method provides more robust explanations while preserving flexibility.


title: Tracing the Energetic Outflows from Galactic Nuclei: Observational Evidence for a Large-Scale Bipolar Radio and X-ray-emitting Bubble-like Structure in M106

abstract: The role of energetic outflows from galactic nuclei in shaping galaxy formation and evolution is still shrouded in uncertainty. In this study, we shed light on this complex phenomenon by presenting evidence for a large-scale bipolar radio/X-ray-emitting bubble-like structure emanating from the central region of the nearby disk galaxy M106 (NGC 4258). Our findings, based on Low-Frequency Array survey data and Chandra observations, provide a glimpse into the underlying physical processes driving this enigmatic structure. Similar to the eROSITA/Fermi bubbles in our own Galaxy, the M106 bubbles enclose diffuse hot plasma and are partially bounded by prominent radio/X-ray-emitting edges. We constrain the magnetic field and cosmic-ray properties of the structure. The analysis of the X-ray data gives an estimate of the thermal energy of the bubbles as ~8 x 10^56 erg. This energy can be supplied by the jets and perhaps by the wind from the accretion flow of the galaxy's low-luminosity AGN, which most likely has been much more powerful in the recent past, with an average mechanical energy release rate of ~4 x 10^42 erg/s over the last ~ 8 x 10^6 yr -- the estimated age of the structure. We also show evidence for diffuse X-ray emission on larger scales, indicating the presence of a hot galactic corona. Our results provide a clear manifestation of galactic nuclear feedback regulating the gas content and energetics of the circumgalactic medium of disk galaxies similar to our own.


title: Data-driven Bayesian Control of Port-Hamiltonian Systems

abstract: Port-Hamiltonian theory is an established way to describe nonlinear physical systems widely used in various fields such as robotics, energy management, and mechanical engineering. This has led to considerable research interest in the control of Port-Hamiltonian systems, resulting in numerous model-based control techniques. However, the performance and stability of the closed-loop typically depend on the quality of the PH model, which is often difficult to obtain using first principles. We propose a Gaussian Processes (GP) based control approach for Port-Hamiltonian systems (GPC-PHS) by leveraging gathered data. The Bayesian characteristics of GPs enable the creation of a distribution encompassing all potential Hamiltonians instead of providing a singular point estimate. Using this uncertainty quantification, the proposed approach takes advantage of passivity-based robust control with interconnection and damping assignment to establish probabilistic stability guarantees.


title: Embedding structure matters: Comparing methods to adapt multilingual vocabularies to new languages

abstract: Pre-trained multilingual language models underpin a large portion of modern NLP tools outside of English. A strong baseline for specializing these models for specific languages is Language-Adaptive Pre-Training (LAPT). However, retaining a large cross-lingual vocabulary and embedding matrix comes at considerable excess computational cost during adaptation. In this study, we propose several simple techniques to replace a cross-lingual vocabulary with a compact, language-specific one. Namely, we address strategies for re-initializing the token embedding matrix after vocabulary specialization. We then provide a systematic experimental comparison of our techniques, in addition to the recently-proposed Focus method. We demonstrate that: 1) Embedding-replacement techniques in the monolingual transfer literature are inadequate for adapting multilingual models. 2) Replacing cross-lingual vocabularies with smaller specialized ones provides an efficient method to improve performance in low-resource languages. 3) Simple embedding re-initialization techniques based on script-wise sub-distributions rival techniques such as Focus, which rely on similarity scores obtained from an auxiliary model.


title: Focus diverse phase retrieval testbed development of continuous wavefront sensing for space telescope applications

abstract: Continuous wavefront sensing on future space telescopes allows relaxation of stability requirements while still allowing on-orbit diffraction-limited optical performance. We consider the suitability of phase retrieval to continuously reconstruct the phase of a wavefront from on-orbit irradiance measurements or point spread function (PSF) images. As phase retrieval algorithms do not require reference optics or complicated calibrations, it is a preferable technique for space observatories, such as the Hubble Space Telescope or the James Webb Space Telescope. To increase the robustness and dynamic range of the phase retrieval algorithm, multiple PSF images with known amount of defocus can be utilized. In this study, we describe a recently constructed testbed including a 97 actuator deformable mirror, changeable entrance pupil stops, and a light source. The aligned system wavefront error is below ~30nm. We applied various methods to generate a known wavefront error, such as defocus and/or other aberrations, and found the accuracy and precision of the root mean squared error of the reconstructed wavefronts to be less than ~10nm and ~2nm, respectively. Further, we discuss the signal-to-noise ratios required for continuous dynamic wavefront sensing. We also simulate the case of spacecraft drifting and verify the performance of the phase retrieval algorithm for continuous wavefront sensing in the presence of realistic disturbances.