title: An Algorithm to Train Unrestricted Sequential Discrete Morphological Neural Networks

abstract: There have been attempts to insert mathematical morphology (MM) operators into convolutional neural networks (CNN), and the most successful endeavor to date has been the morphological neural networks (MNN). Although MNN have performed better than CNN in solving some problems, they inherit their black-box nature. Furthermore, in the case of binary images, they are approximations that loose the Boolean lattice structure of MM operators and, thus, it is not possible to represent a specific class of W-operators with desired properties. In a recent work, we proposed the Discrete Morphological Neural Networks (DMNN) for binary image transformation to represent specific classes of W-operators and estimate them via machine learning. We also proposed a stochastic lattice descent algorithm (SLDA) to learn the parameters of Canonical Discrete Morphological Neural Networks (CDMNN), whose architecture is composed only of operators that can be decomposed as the supremum, infimum, and complement of erosions and dilations. In this paper, we propose an algorithm to learn unrestricted sequential DMNN, whose architecture is given by the composition of general W-operators. We illustrate the algorithm in a practical example.


title: Interventions Against Machine-Assisted Statistical Discrimination

abstract: This article studies how to intervene against statistical discrimination, when it is based on beliefs generated by machine learning, rather than by humans. Unlike beliefs formed by a human mind, machine learning-generated beliefs are verifiable. This allows interventions to move beyond simple, belief-free designs like affirmative action, to more sophisticated ones, that constrain decision makers in ways that depend on what they are thinking. Such mind reading interventions can perform well where affirmative action does not, even when the beliefs being conditioned on are possibly incorrect and biased.


title: TrialView: An AI-powered Visual Analytics System for Temporal Event Data in Clinical Trials

abstract: Randomized controlled trials (RCT) are the gold standards for evaluating the efficacy and safety of therapeutic interventions in human subjects. In addition to the pre-specified endpoints, trial participants' experience reveals the time course of the intervention. Few analytical tools exist to summarize and visualize the individual experience of trial participants. Visual analytics allows integrative examination of temporal event patterns of patient experience, thus generating insights for better care decisions. Towards this end, we introduce TrialView, an information system that combines graph artificial intelligence (AI) and visual analytics to enhance the dissemination of trial data. TrialView offers four distinct yet interconnected views: Individual, Cohort, Progression, and Statistics, enabling an interactive exploration of individual and group-level data. The TrialView system is a general-purpose analytical tool for a broad class of clinical trials. The system is powered by graph AI, knowledge-guided clustering, explanatory modeling, and graph-based agglomeration algorithms. We demonstrate the system's effectiveness in analyzing temporal event data through a case study.


title: Strongly finitary monads and multi-sorted varieties enriched in cartesian closed concrete categories

abstract: It is a classical result of categorical algebra, due to Lawvere and Linton, that finitary varieties of algebras (in the sense of Birkhoff) are dually equivalent to finitary monads on $Set$. Recent work of Ad\'amek, Dost\'al, and Velebil has established that analogous results also hold in certain enriched contexts. Specifically, taking $V$ to be one of the cartesian closed categories $\mathsf{Pos}$, $\mathsf{UltMet}$, $\omega$-$\mathsf{CPO}$, or $\mathsf{DCPO}$ of respectively posets, (extended) ultrametric spaces, $\omega$-cpos, or dcpos, Ad\'amek, Dost\'al, and Velebil have shown that a suitable category of $V$-enriched varieties of algebras is dually equivalent to the category of strongly finitary $V$-monads on $V$. In this paper, we extend and generalize these results in two ways: by allowing $V$ to be an arbitrary complete and cocomplete cartesian closed category that is concrete over $Set$, and by also considering the multi-sorted case. Given a set $S$ of sorts, we define a suitable notion of (finitary) $V$-enriched $S$-sorted variety, and we say that a $V$-monad on the product $V$-category $V^S$ is strongly finitary if its underlying $V$-endofunctor is the left Kan extension of its restriction to a suitable full sub-$V$-category of $V^S$. Our main result is that the category of $V$-enriched $S$-sorted varieties is dually equivalent to the category of strongly finitary $V$-monads on $V^S$. By taking $S$ to be a singleton and $V$ to be $\mathsf{Pos}$, $\mathsf{UltMet}$, $\omega$-$\mathsf{CPO}$, or $\mathsf{DCPO}$, we thus recover the aforementioned results of Ad\'amek, Dost\'al, and Velebil. We provide several classes of examples of $V$-enriched $S$-sorted varieties, many of which admit very concrete, syntactic formulations.


title: Tidal migration of exoplanets around M-dwarfs: frequency-dependent tidal dissipation

abstract: The orbital architectures of short-period exoplanet systems are shaped by tidal dissipation in their host stars. For low-mass M-dwarfs whose dynamical tidal response comprises a dense spectrum of inertial modes at low frequencies, resolving the frequency dependence of tidal dissipation is crucial to capturing the effect of tides on planetary orbits throughout the evolutionary stages of the host star. We use non-perturbative spectral methods to calculate the normal mode oscillations of a fully-convective M-dwarf modeled using realistic stellar profiles from MESA. We compute the dissipative tidal response composed of contributions from each mode as well as non-adiabatic coupling between the modes, which we find to be an essential component of the dissipative calculations. Using our results for dissipation, we then compute of the evolution of circular, coplanar planetary orbits under the influence of tides in the host star. We find that orbital migration driven by resonance locking affects the orbits of Earth-mass planets at orbital periods $P_{\rm orb} \lesssim 1.5$ day and of Jupiter-mass planets at $P_{\rm orb} \lesssim 2.5$ day. Due to resonantly-driven orbital decay and outward migration, we predict a dearth of small planets closer than $P_{\rm orb} \sim 1$ day and similarly sparse numbers of more massive planets out to $P_{\rm orb} \sim 3$ day.


title: Shufflecake: Plausible Deniability for Multiple Hidden Filesystems on Linux

abstract: We present Shufflecake, a new plausible deniability design to hide the existence of encrypted data on a storage medium making it very difficult for an adversary to prove the existence of such data. Shufflecake can be considered a ``spiritual successor'' of tools such as TrueCrypt and VeraCrypt, but vastly improved: it works natively on Linux, it supports any filesystem of choice, and can manage multiple volumes per device, so to make deniability of the existence of hidden partitions really plausible. Compared to ORAM-based solutions, Shufflecake is extremely fast and simpler but does not offer native protection against multi-snapshot adversaries. However, we discuss security extensions that are made possible by its architecture, and we show evidence why these extensions might be enough to thwart more powerful adversaries. We implemented Shufflecake as an in-kernel tool for Linux, adding useful features, and we benchmarked its performance showing only a minor slowdown compared to a base encrypted system. We believe Shufflecake represents a useful tool for people whose freedom of expression is threatened by repressive authorities or dangerous criminal organizations, in particular: whistleblowers, investigative journalists, and activists for human rights in oppressive regimes.


title: Deep Model Predictive Optimization

abstract: A major challenge in robotics is to design robust policies which enable complex and agile behaviors in the real world. On one end of the spectrum, we have model-free reinforcement learning (MFRL), which is incredibly flexible and general but often results in brittle policies. In contrast, model predictive control (MPC) continually re-plans at each time step to remain robust to perturbations and model inaccuracies. However, despite its real-world successes, MPC often under-performs the optimal strategy. This is due to model quality, myopic behavior from short planning horizons, and approximations due to computational constraints. And even with a perfect model and enough compute, MPC can get stuck in bad local optima, depending heavily on the quality of the optimization algorithm. To this end, we propose Deep Model Predictive Optimization (DMPO), which learns the inner-loop of an MPC optimization algorithm directly via experience, specifically tailored to the needs of the control problem. We evaluate DMPO on a real quadrotor agile trajectory tracking task, on which it improves performance over a baseline MPC algorithm for a given computational budget. It can outperform the best MPC algorithm by up to 27% with fewer samples and an end-to-end policy trained with MFRL by 19%. Moreover, because DMPO requires fewer samples, it can also achieve these benefits with 4.3X less memory. When we subject the quadrotor to turbulent wind fields with an attached drag plate, DMPO can adapt zero-shot while still outperforming all baselines. Additional results can be found at https://tinyurl.com/mr2ywmnw.


title: KAPPA: A Package for Synthesis of Optically Thin Spectra for the Non-Maxwellian Kappa-Distributions. III. Improvements to Ionization Equilibrium and Extension to Kappa < 2

abstract: The KAPPA package is designed for calculations of optically thin spectra for the non-Maxwellian \k{appa}-distributions. This paper presents extension of the database to allow calculations of the spectra for extreme values of \k{appa} < 2, which are important for accurate diagnostics of the \k{appa}-distributions in the outer solar atmosphere. In addition, two improvements were made to the ionization equilibrium calculations within the database. First, the ionization equilibrium calculations now include the effect of electron impact multi-ionization (EIMI). Although relatively unimportant for Maxwellian distribution, the EIMI becomes important for some elements such as Fe and low values of \k{appa}, where it modifies the ionization equilibrium significantly. Second, the KAPPA database now includes the suppression of dielectronic recombination at high electron densities, evaluated via the suppression factors. We find that at the same temperature, the suppression of dielectronic recombination is almost independent of \k{appa}. The ionization equilibrium calculations for the \k{appa}-distributions are now provided for a range of electron densities.


title: From Nuisance to News Sense: Augmenting the News with Cross-Document Evidence and Context

abstract: Reading and understanding the stories in the news is increasingly difficult. Reporting on stories evolves rapidly, politicized news venues offer different perspectives (and sometimes different facts), and misinformation is rampant. However, existing solutions merely aggregate an overwhelming amount of information from heterogenous sources, such as different news outlets, social media, and news bias rating agencies. We present NEWSSENSE, a novel sensemaking tool and reading interface designed to collect and integrate information from multiple news articles on a central topic, using a form of reference-free fact verification. NEWSSENSE augments a central, grounding article of the user's choice by linking it to related articles from different sources, providing inline highlights on how specific claims in the chosen article are either supported or contradicted by information from other articles. Using NEWSSENSE, users can seamlessly digest and cross-check multiple information sources without disturbing their natural reading flow. Our pilot study shows that NEWSSENSE has the potential to help users identify key information, verify the credibility of news articles, and explore different perspectives.


title: Unbounded Markov Dynamic Programming with Weighted Supremum Norm Perov Contractions

abstract: This paper shows the usefulness of the Perov contraction theorem, which is a generalization of the classical Banach contraction theorem, for solving Markov dynamic programming problems. When the reward function is unbounded, combining an appropriate weighted supremum norm with the Perov contraction theorem yields a unique fixed point of the Bellman operator under weaker conditions than existing approaches. An application to the optimal savings problem shows that the average growth rate condition derived from the spectral radius of a certain nonnegative matrix is sufficient and almost necessary for obtaining a solution.


title: Probing cosmic homogeneity in the Local Universe

abstract: We investigate the transition scale to homogeneity, $R_H$, using as cosmic tracer the spectroscopic sample of blue galaxies from the Sloan Digital Sky Survey (SDSS). Considering the spatial distribution of the galaxy sample we compute the two point correlation function $\xi(r)$, the scaled counts in spheres $\mathcal{N}(<r)$, and the fractal dimension $\mathcal{D}_2(r)$ to quantify the homogeneity scale in the Local Universe ($0.04 < z < 0.20$). The sample in analysis is compared with {\it random} and {\it mock} catalogues with the same geometry, and the same number of synthetic cosmic objects as the dataset, to calculate the covariance matrix for the errors determination. The criteria adopted for the transition-to-homogeneity follows the literature, it is attained when $\mathcal{D}_2(r)$ reaches the $1$ per cent level of the limit value $3$ (i.e., where it reaches $2.97$) as the scale increases. We obtain $R_H = 70.33 \pm 10.74$ Mpc$/h$, at the effective redshift $z_{\text{eff}}=0.128$, for a sample containing $150\,302$ SDSS blue galaxies with $0.04 < z < 0.20$. Additionally, we perform robustness tests by analysing the homogeneity scale in sub-volumes of the original one, obtaining coherent results; we also check for a possible artefact in our procedure examining a homogeneous synthetic dataset as a pseudo-data, verifying that such systematic is absent. Because our analyses concentrate in data at low redshifts, $z < 0.20$, we find interesting to use cosmography to calculate the radial comoving distances; therefore in this subject our analyses do not use fiducial cosmological model. For completeness, we evaluate the difference of the comoving distances estimation using cosmography and fiducial cosmology.


title: Segmented Harmonic Loss: Handling Class-Imbalanced Multi-Label Clinical Data for Medical Coding with Large Language Models

abstract: The precipitous rise and adoption of Large Language Models (LLMs) have shattered expectations with the fastest adoption rate of any consumer-facing technology in history. Healthcare, a field that traditionally uses NLP techniques, was bound to be affected by this meteoric rise. In this paper, we gauge the extent of the impact by evaluating the performance of LLMs for the task of medical coding on real-life noisy data. We conducted several experiments on MIMIC III and IV datasets with encoder-based LLMs, such as BERT. Furthermore, we developed Segmented Harmonic Loss, a new loss function to address the extreme class imbalance that we found to prevail in most medical data in a multi-label scenario by segmenting and decoupling co-occurring classes of the dataset with a new segmentation algorithm. We also devised a technique based on embedding similarity to tackle noisy data. Our experimental results show that when trained with the proposed loss, the LLMs achieve significant performance gains even on noisy long-tailed datasets, outperforming the F1 score of the state-of-the-art by over ten percentage points.


title: Synaptic delay induced macroscopic dynamics of the large-scale network of Izhikevich neurons

abstract: We consider a large network of Izhikevich neurons. Each neuron has a quadratic integrate-and-fire type model with a recovery variable modelling spike frequency adaptation (SFA). We introduce a biologically motivated synaptic current expression and a delay in the synaptic transmission. Following the Ott-Antonsen theory, we reduce the network model to a mean-field system of delayed differential equations. Numerical bifurcation analysis allows us to locate higher-codimension bifurcations and to identify the regions in the parameter space where the network exhibits changes in the macroscopic dynamics, including transitions between states where the individual neurons exhibit asynchronous tonic firing and different types of synchronous bursting. We investigate the impact of the heterogeneity of the quenched input current, the SFA mechanism and the synaptic delay on macroscopic dynamics. In the limit that the heterogeneity goes to zero, our perturbation and bifurcation analysis shows that the behaviour of the mean-field model remains consistent, although this limit breaks an assumption of the model reduction. For a single population of neurons with SFA, the synaptic delay has little effect on the generation of COs for weak coupling, but favours their emergence beyond that, and even induces new macroscopic dynamics. In particular, Torus bifurcations may occur, and these are a crucial mechanism for the emergence of population bursting with two nested frequencies. We discuss how these solutions may relate to cross-frequency coupling which is potentially relevant for understanding healthy and pathological brain functions.


title: Challenges for extensions of the process matrix formalism to quantum field theory

abstract: We discuss the issues with tentative generalisations of the process matrix formalism from finite-dimensional mechanical systems all the way to quantum field theory. We present a detailed overview of possible open problems that arise when one attempts to move from particle ontology into the realm of field ontology, i.e., when one transitions from mechanics to field theory framework. These issues need to be addressed, and problems solved, if one aims to expand the scope of applicability of the process matrix formalism, and therefore its usefulness. This is far from a trivial and straightforward endeavour, but rather a task for a whole future research programme.


title: A Neuro-Symbolic Framework for Answering Graph Pattern Queries in Knowledge Graphs

abstract: The challenge of answering graph queries over incomplete knowledge graphs is gaining significant attention in the machine learning community. Neuro-symbolic models have emerged as a promising approach, combining good performance with high interpretability. These models utilize trained architectures to execute atomic queries and integrate modules that mimic symbolic query operators. However, most neuro-symbolic query processors are constrained to tree-like graph pattern queries. These queries admit a bottom-up execution with constant values or anchors at the leaves and the target variable at the root. While expressive, tree-like queries fail to capture critical properties in knowledge graphs, such as the existence of multiple edges between entities or the presence of triangles. We introduce a framework for answering arbitrary graph pattern queries over incomplete knowledge graphs, encompassing both cyclic queries and tree-like queries with existentially quantified leaves. These classes of queries are vital for practical applications but are beyond the scope of most current neuro-symbolic models. Our approach employs an approximation scheme that facilitates acyclic traversals for cyclic patterns, thereby embedding additional symbolic bias into the query execution process. Our experimental evaluation demonstrates that our framework performs competitively on three datasets, effectively handling cyclic queries through our approximation strategy. Additionally, it maintains the performance of existing neuro-symbolic models on anchored tree-like queries and extends their capabilities to queries with existentially quantified variables.


title: Exponential Selection and Feedback Stabilization of Invariant Subspaces of Quantum Trajectories

abstract: We show that quantum trajectories become exponentially fast supported by one of their minimal invariant subspaces. Exponential convergence is shown in expectation using Lyapunov techniques. The proof is based on an in-depth study of the identifiability of the probability distributions generated in the different subspaces. We furthermore introduce a feedback control strategy that allows for the targeted convergence towards a desired subspace. This convergence is also achieved at exponential speed.


title: Black hole interior quantization: a minimal uncertainty approach

abstract: In a previous work we studied the interior of the Schwarzschild black hole implementing an effective minimal length, by applying a modification to the Poisson brackets of the theory. In this work we perform a proper quantization of such a system. Specifically, we quantize the interior of the Schwarzschild black hole in two ways: once by using the standard quantum theory, and once by following a minimal uncertainty approach. Then, we compare the obtained results from the two approaches. We show that, as expected, the wave function in the standard approach diverges in the region where classical singularity is located and the expectation value of the Kretschmann scalar also blows up on this state in that region. On the other hand, by following a minimal uncertainty quantization approach, we obtain 5 new and important results as follows. 1) All the interior states remain well-defined and square-integrable. 2) The expectation value of the Kretschmann scalar on the states remains finite over the whole interior region, particularly where used to be the classical singularity, therefore signaling the resolution of the black hole singularity. 3) A new quantum number is found which plays a crucial role in determining the convergence of the norm of states, as well as the convergence and finiteness of the expectation value of the Kretschmann scalar. 4) A minimum for the radius of the (2-spheres in the) black holes is found 5) By demanding square-integrability of states in the whole interior region, an exact relation between the Barbero-Immirzi parameter and the minimal uncertainty scale is found.


title: Eight Transaction Papers by Jim Gray

abstract: This article is a summary of eight of Jim Gray's transaction papers. It was written at the invitation of Pat Helland to be a chapter of a forthcoming book in the ACM Turing Award winners' series, "Curiosity, Clarity, and Caring: How Jim Gray's Passion for Learning, Teaching, and People Changed Computing."


title: Discrete energy balance equation via a symplectic second-order method for two-phase flow in porous media

abstract: We propose and analyze a second-order partitioned time-stepping method for a two-phase flow problem in porous media. The algorithm is based on a refactorization of Cauchy's one-leg $\theta$-method. The main part consists of the implicit backward Euler method on $[t^n, t^{n+\theta}]$, while part two uses a linear extrapolation on $[t^{n+\theta},t^{n+1}]$ to obtain the solution at $t^{n+1}$, equivalent to the forward Euler method. In the backward Euler step, the decoupled equations are solved iteratively. We prove that the iterations converge linearly to the solution of the coupled problem, under some conditions on the data. When $\theta = 1/2$, the algorithm is equivalent to the symplectic midpoint method. In the absence of the chain rule for time-discrete setting, we approximate the change in the free energy by the product of a second-order accurate discrete gradient (chemical potential) and the one-step increment of the state variables. Similar to the continuous case, we also prove a discrete Gibbs free energy balance equation, without numerical dissipation. In the numerical tests we compare this implicit midpoint method with the classic backward Euler method, and two implicit-explicit time-lagging schemes. The midpoint method outperforms the other schemes in terms of rates of convergence, long-time behavior and energy approximation, for small and large values of the time step.


title: Phoretic swimming with bulk absorption

abstract: We consider phoretic self-propulsion of a chemically active colloid where solute is consumed at both the colloid boundary and within the bulk solution. Assuming first-order kinetics, the dimensionless transport problem is governed by the surface Damk\"ohler number ${\mathcal{S}}$ and the bulk Damk\"ohler number ${\mathcal B}$. The dimensionless colloid velocity $U$, normalized by a self-phoretic scale, is a nonlinear function of these two parameters. We identify two scenarios where these numbers are linked. When the controlling physical parameter is colloid size, ${\mathcal{S}}$ is proportional to ${\mathcal B}^{1/2}$; when the controlling parameter is solute diffusivity, ${\mathcal{S}}$ is proportional to ${\mathcal B}$. In the limit of small Damk\"ohler numbers, $U$ adopts the same asymptotic limit in both scenarios, proportional to ${\mathcal{S}}$. In the limit of large Damk\"ohler numbers, the deviations of solute concentration from the equilibrium value are restricted to a narrow layer about the active portion of the colloid boundary. The asymptotic predictions of the associated boundary-layer problem are corroborated by an eigenfunction solution of the exact problem. The boundary-layer structure breaks down near the transition between the active and inactive portions of the boundary. The transport problem in that local region partially resembles the classical Sommerfeld problem of wave diffraction from an edge.


title: PriViT: Vision Transformers for Fast Private Inference

abstract: The Vision Transformer (ViT) architecture has emerged as the backbone of choice for state-of-the-art deep models for computer vision applications. However, ViTs are ill-suited for private inference using secure multi-party computation (MPC) protocols, due to the large number of non-polynomial operations (self-attention, feed-forward rectifiers, layer normalization). We propose PriViT, a gradient based algorithm to selectively "Taylorize" nonlinearities in ViTs while maintaining their prediction accuracy. Our algorithm is conceptually simple, easy to implement, and achieves improved performance over existing approaches for designing MPC-friendly transformer architectures in terms of achieving the Pareto frontier in latency-accuracy. We confirm these improvements via experiments on several standard image classification tasks. Public code is available at https://github.com/NYU-DICE-Lab/privit.


title: Learning Optimal Power Flow Value Functions with Input-Convex Neural Networks

abstract: The Optimal Power Flow (OPF) problem is integral to the functioning of power systems, aiming to optimize generation dispatch while adhering to technical and operational constraints. These constraints are far from straightforward; they involve intricate, non-convex considerations related to Alternating Current (AC) power flow, which are essential for the safety and practicality of electrical grids. However, solving the OPF problem for varying conditions within stringent time frames poses practical challenges. To address this, operators resort to model simplifications of varying accuracy. Unfortunately, better approximations (tight convex relaxations) are often computationally intractable. This research explores machine learning (ML) to learn convex approximate solutions for faster analysis in the online setting while still allowing for coupling into other convex dependent decision problems. By trading off a small amount of accuracy for substantial gains in speed, they enable the efficient exploration of vast solution spaces in these complex problems.


title: Robust Transfer Learning with Unreliable Source Data

abstract: This paper addresses challenges in robust transfer learning stemming from ambiguity in Bayes classifiers and weak transferable signals between the target and source distribution. We introduce a novel quantity called the ''ambiguity level'' that measures the discrepancy between the target and source regression functions, propose a simple transfer learning procedure, and establish a general theorem that shows how this new quantity is related to the transferability of learning in terms of risk improvements. Our proposed ''Transfer Around Boundary'' (TAB) model, with a threshold balancing the performance of target and source data, is shown to be both efficient and robust, improving classification while avoiding negative transfer. Moreover, we demonstrate the effectiveness of the TAB model on non-parametric classification and logistic regression tasks, achieving upper bounds which are optimal up to logarithmic factors. Simulation studies lend further support to the effectiveness of TAB. We also provide simple approaches to bound the excess misclassification error without the need for specialized knowledge in transfer learning.


title: A Comprehensive Performance Study of Large Language Models on Novel AI Accelerators

abstract: Artificial intelligence (AI) methods have become critical in scientific applications to help accelerate scientific discovery. Large language models (LLMs) are being considered as a promising approach to address some of the challenging problems because of their superior generalization capabilities across domains. The effectiveness of the models and the accuracy of the applications is contingent upon their efficient execution on the underlying hardware infrastructure. Specialized AI accelerator hardware systems have recently become available for accelerating AI applications. However, the comparative performance of these AI accelerators on large language models has not been previously studied. In this paper, we systematically study LLMs on multiple AI accelerators and GPUs and evaluate their performance characteristics for these models. We evaluate these systems with (i) a micro-benchmark using a core transformer block, (ii) a GPT- 2 model, and (iii) an LLM-driven science use case, GenSLM. We present our findings and analyses of the models' performance to better understand the intrinsic capabilities of AI accelerators. Furthermore, our analysis takes into account key factors such as sequence lengths, scaling behavior, sparsity, and sensitivity to gradient accumulation steps.


title: Volume electron microscopy in injured rat brain validates white matter microstructure metrics from diffusion MRI

abstract: Biophysical modeling of diffusion MRI (dMRI) offers the exciting potential of bridging the gap between the macroscopic MRI resolution and microscopic cellular features, effectively turning the MRI scanner into a noninvasive in vivo microscope. In brain white matter, the Standard Model (SM) interprets the dMRI signal in terms of axon dispersion, intra- and extra-axonal water fractions and diffusivities. However, for SM to be fully applicable and correctly interpreted, it needs to be carefully evaluated using histology. Here, we perform a comprehensive histological validation of the SM parameters, by characterizing WM microstructure in sham and injured rat brains using volume (3d) electron microscopy (EM) and ex vivo dMRI. Sensitivity is evaluated by how close each SM metric is to its histological counterpart, and specificity by how independent it is from other, non-corresponding histological features. This comparison reveals that SM is sensitive and specific to microscopic properties, clearing the way for the clinical adoption of in vivo dMRI derived SM parameters as biomarkers for neurological disorders.


title: Kawasaki dynamics beyond the uniqueness threshold

abstract: Glauber dynamics of the Ising model on a random regular graph is known to mix fast below the tree uniqueness threshold and exponentially slowly above it. We show that Kawasaki dynamics of the canonical ferromagnetic Ising model on a random $d$-regular graph mixes fast beyond the tree uniqueness threshold when $d$ is large enough (and conjecture that it mixes fast up to the tree reconstruction threshold for all $d\geq 3$). This result follows from a more general spectral condition for (modified) log-Sobolev inequalities for conservative dynamics of Ising models. The proof of this condition in fact extends to perturbations of distributions with log-concave generating polynomial.


title: DeepSpeed4Science Initiative: Enabling Large-Scale Scientific Discovery through Sophisticated AI System Technologies

abstract: In the upcoming decade, deep learning may revolutionize the natural sciences, enhancing our capacity to model and predict natural occurrences. This could herald a new era of scientific exploration, bringing significant advancements across sectors from drug development to renewable energy. To answer this call, we present DeepSpeed4Science initiative (deepspeed4science.ai) which aims to build unique capabilities through AI system technology innovations to help domain experts to unlock today's biggest science mysteries. By leveraging DeepSpeed's current technology pillars (training, inference and compression) as base technology enablers, DeepSpeed4Science will create a new set of AI system technologies tailored for accelerating scientific discoveries by addressing their unique complexity beyond the common technical approaches used for accelerating generic large language models (LLMs). In this paper, we showcase the early progress we made with DeepSpeed4Science in addressing two of the critical system challenges in structural biology research.


title: Rapid Dust Growth During Hydrodynamic Clumping Due to Streaming Instability

abstract: Streaming instability is considered to be one of the dominant processes to promote planetesimal formation by gravitational collapse of dust clumps. The development of streaming instability is expected to form dust clumps in which the local dust density is strongly enhanced and even greater than the Roche density. The resulting clumps can collapse to form planetesimals. Recent simulations conducted long-term simulations and showed that such strong clumping occurs in a wider parameter space than previously expected. However, the indicated timescale for strong clumping can be on the order of tens to hundreds Keplerian periods. In this paper, we estimate the growth time of dust grains during the pre-clumping phase. We find that the dust growth considerably proceeds before the strong clumping because even the moderate clumping due to streaming instability increases the local dust-to-gas ratio $\gtrsim10$. Depending on the gas sound speed, the dust collision velocity can be kept below $\sim 1\;\mathrm{m/s}$ once sufficiently strong dust clumping occurs. Thus, even silicate grains might have the potential to grow safely toward the size whose Stokes number is unity during the clumping. Our results demonstrate the importance of local dust coagulation during the dust clumping due to streaming instability.


title: A Topological Perspective on Demystifying GNN-Based Link Prediction Performance

abstract: Graph Neural Networks (GNNs) have shown great promise in learning node embeddings for link prediction (LP). While numerous studies aim to improve the overall LP performance of GNNs, none have explored its varying performance across different nodes and its underlying reasons. To this end, we aim to demystify which nodes will perform better from the perspective of their local topology. Despite the widespread belief that low-degree nodes exhibit poorer LP performance, our empirical findings provide nuances to this viewpoint and prompt us to propose a better metric, Topological Concentration (TC), based on the intersection of the local subgraph of each node with the ones of its neighbors. We empirically demonstrate that TC has a higher correlation with LP performance than other node-level topological metrics like degree and subgraph density, offering a better way to identify low-performing nodes than using cold-start. With TC, we discover a novel topological distribution shift issue in which newly joined neighbors of a node tend to become less interactive with that node's existing neighbors, compromising the generalizability of node embeddings for LP at testing time. To make the computation of TC scalable, We further propose Approximated Topological Concentration (ATC) and theoretically/empirically justify its efficacy in approximating TC and reducing the computation complexity. Given the positive correlation between node TC and its LP performance, we explore the potential of boosting LP performance via enhancing TC by re-weighting edges in the message-passing and discuss its effectiveness with limitations. Our code is publicly available at https://github.com/YuWVandy/Topo_LP_GNN.


title: ComDMFT v.2.0: Fully Self-Consistent ab initio GW+EDMFT for the Electronic Structure of Correlated Quantum Materials

abstract: ComDMFT is a parallel computational package designed to study the electronic structure of correlated quantum materials from first principles. Our approach is based on the combination of first-principles methods and dynamical mean field theories. In version 2.0, we implemented fully-diagrammatic GW+EDMFT from first-principles. In this approach, correlated electrons are treated within full GW+EDMFT and the rest are treated within full-GW, seamlessly. This implementation enables the electronic structure calculation of quantum materials with weak, intermediate, and strong electron correlation without prior knowledge of the degree of electron correlation.


title: Variance Reduced Distributed Non-Convex Optimization Using Matrix Stepsizes

abstract: Matrix-stepsized gradient descent algorithms have been shown to have superior performance in non-convex optimization problems compared to their scalar counterparts. The det-CGD algorithm, as introduced by Li et al. (2023), leverages matrix stepsizes to perform compressed gradient descent for non-convex objectives and matrix-smooth problems in a federated manner. The authors establish the algorithm's convergence to a neighborhood of a weighted stationarity point under a convex condition for the symmetric and positive-definite matrix stepsize. In this paper, we propose two variance-reduced versions of the det-CGD algorithm, incorporating MARINA and DASHA methods. Notably, we establish theoretically and empirically, that det-MARINA and det-DASHA outperform MARINA, DASHA and the distributed det-CGD algorithms in terms of iteration and communication complexities.


title: Giant Modulation of Refractive Index from Picoscale Atomic Displacements

abstract: Structural disorder has been shown to enhance and modulate magnetic, electrical, dipolar, electrochemical, and mechanical properties of materials. However, the possibility of obtaining novel optical and optoelectronic properties from structural disorder remains an open question. Here, we show unambiguous evidence of disorder in the form of anisotropic, picoscale atomic displacements modulating the refractive index tensor and resulting in the giant optical anisotropy observed in BaTiS$_3$, a quasi-one-dimensional hexagonal chalcogenide. Single crystal X-ray diffraction studies reveal the presence of antipolar displacements of Ti atoms within adjacent TiS$_6$ chains along the c-axis, and three-fold degenerate Ti displacements in the a-b plane. $^{47/49}$Ti solid-state NMR provides additional evidence for those Ti displacements in the form of a three-horned NMR lineshape resulting from a low symmetry local environment around Ti atoms. We used scanning transmission electron microscopy to directly observe the globally disordered Ti a-b plane displacements and find them to be ordered locally over a few unit cells. First-principles calculations show that the Ti a-b plane displacements selectively reduce the refractive index along the ab-plane, while having minimal impact on the refractive index along the chain direction, thus resulting in a giant enhancement in the optical anisotropy. By showing a strong connection between structural disorder with picoscale displacements and the optical response in BaTiS$_3$, this study opens a pathway for designing optical materials with high refractive index and functionalities such as large optical anisotropy and nonlinearity.


title: On the closed generalized Drazin-Riesz invertible operators and $C_{0}$-semigroups

abstract: This paper is a continuation of our paper [Med. J. Math 19, Article number: 31 (2022)] in which we extended the notion of generalized Drazin-Riesz invertible operators to closed operators. We establish here, results relating the notion of closed generalized Drazin-Riesz invertibility with the theory of $C_{0}$-semigroups. Firstly, we generalize results obtained in the bounded case [1] to the context of closed operators. Secondly, we investigate when an infinitesimal generator $A$ of a given $C_{0}$-semigroup is closed generalized Drazin-Riesz invertible. An application to $C_{0}$-groups and abstract second order differential equations is proposed, and an example of a $C_{0}$-group with closed generalized Drazin-Riesz invertible infinitesimal generator is given.


title: SlotGNN: Unsupervised Discovery of Multi-Object Representations and Visual Dynamics

abstract: Learning multi-object dynamics from visual data using unsupervised techniques is challenging due to the need for robust, object representations that can be learned through robot interactions. This paper presents a novel framework with two new architectures: SlotTransport for discovering object representations from RGB images and SlotGNN for predicting their collective dynamics from RGB images and robot interactions. Our SlotTransport architecture is based on slot attention for unsupervised object discovery and uses a feature transport mechanism to maintain temporal alignment in object-centric representations. This enables the discovery of slots that consistently reflect the composition of multi-object scenes. These slots robustly bind to distinct objects, even under heavy occlusion or absence. Our SlotGNN, a novel unsupervised graph-based dynamics model, predicts the future state of multi-object scenes. SlotGNN learns a graph representation of the scene using the discovered slots from SlotTransport and performs relational and spatial reasoning to predict the future appearance of each slot conditioned on robot actions. We demonstrate the effectiveness of SlotTransport in learning object-centric features that accurately encode both visual and positional information. Further, we highlight the accuracy of SlotGNN in downstream robotic tasks, including challenging multi-object rearrangement and long-horizon prediction. Finally, our unsupervised approach proves effective in the real world. With only minimal additional data, our framework robustly predicts slots and their corresponding dynamics in real-world control tasks.


title: KyberMat: Efficient Accelerator for Matrix-Vector Polynomial Multiplication in CRYSTALS-Kyber Scheme via NTT and Polyphase Decomposition

abstract: CRYSTAL-Kyber (Kyber) is one of the post-quantum cryptography (PQC) key-encapsulation mechanism (KEM) schemes selected during the standardization process. This paper addresses optimization for Kyber architecture with respect to latency and throughput constraints. Specifically, matrix-vector multiplication and number theoretic transform (NTT)-based polynomial multiplication are critical operations and bottlenecks that require optimization. To address this challenge, we propose an algorithm and hardware co-design approach to systematically optimize matrix-vector multiplication and NTT-based polynomial multiplication by employing a novel sub-structure sharing technique in order to reduce computational complexity, i.e., the number of modular multiplications and modular additions/subtractions consumed. The sub-structure sharing approach is inspired by prior fast parallel approaches based on polyphase decomposition. The proposed efficient feed-forward architecture achieves high speed, low latency, and full utilization of all hardware components, which can significantly enhance the overall efficiency of the Kyber scheme. The FPGA implementation results show that our proposed design, using the fast two-parallel structure, leads to an approximate reduction of 90% in execution time, along with a 66 times improvement in throughput performance.


title: Nature of Nonlocality in a triangle network based on EJM

abstract: Defining nonlocality in a no-input closed quantum network scenario is a new area of interest nowadays. Gisin, in[Entropy 21, 325 (2019)], proposed a possible condition for non-tri-locality of the trivial no-input closed network scenario, triangle network, by introducing a new kind of joint measurement bases and a probability bound. In[npj Quantum Information (2020) 6:70] they found a shred of numerical evidence in support of Gisin's probability bound. Now based on that probability bound, we find the nature of the correlation in a triangle network scenario. We here observe how far the probability lies from that Gisin's bound with every possible combination of entangled and local pure states distributed from three independent quantum sources. Here we use the generalized Elegant Joint Measurements bases for each party and find that there is a dependency of non-locality on the entanglement of these joint measurement bases. We also check the probability bound for the polygon structure.


title: Variance-Reduced Stochastic Optimization for Efficient Inference of Hidden Markov Models

abstract: Hidden Markov models (HMMs) are popular models to identify a finite number of latent states from sequential data. However, fitting them to large data sets can be computationally demanding because most likelihood maximization techniques require iterating through the entire underlying data set for every parameter update. We propose a novel optimization algorithm that updates the parameters of an HMM without iterating through the entire data set. Namely, we combine a partial E step with variance-reduced stochastic optimization within the M step. We prove the algorithm converges under certain regularity conditions. We test our algorithm empirically using a simulation study as well as a case study of kinematic data collected using suction-cup attached biologgers from eight northern resident killer whales (Orcinus orca) off the western coast of Canada. In both, our algorithm converges in fewer epochs and to regions of higher likelihood compared to standard numerical optimization techniques. Our algorithm allows practitioners to fit complicated HMMs to large time-series data sets more efficiently than existing baselines.


title: Model Compression in Practice: Lessons Learned from Practitioners Creating On-device Machine Learning Experiences

abstract: On-device machine learning (ML) promises to improve the privacy, responsiveness, and proliferation of new, intelligent user experiences by moving ML computation onto everyday personal devices. However, today's large ML models must be drastically compressed to run efficiently on-device, a hurtle that requires deep, yet currently niche expertise. To engage the broader human-centered ML community in on-device ML experiences, we present the results from an interview study with 30 experts at Apple that specialize in producing efficient models. We compile tacit knowledge that experts have developed through practical experience with model compression across different hardware platforms. Our findings offer pragmatic considerations missing from prior work, covering the design process, trade-offs, and technical strategies that go into creating efficient models. Finally, we distill design recommendations for tooling to help ease the difficulty of this work and bring on-device ML into to more widespread practice.


title: FluxGAN: A Physics-Aware Generative Adversarial Network Model for Generating Microstructures That Maintain Target Heat Flux

abstract: We propose a physics-aware generative adversarial network model, FluxGAN, capable of simultaneously generating high-quality images of large microstructures and description of their thermal properties. During the training phase, the model learns about the relationship between the local structural features and the physical processes, such as the heat flux in the microstructures, due to external temperature gradients. Once trained, the model generates new structural and associated heat flux environments, bypassing the computationally expensive modeling. Our model provides a cost effective and efficient approach over conventional modeling techniques, such as the finite element method (FEM), for describing the thermal properties of microstructures. The conventional approach requires computational modeling that scales with the size of the microstructure model, therefore limiting the simulation to a given size, resolution, and complexity of the model. In contrast, the FluxGAN model uses synthesis-by-part approach and generates arbitrary large size images at low computational cost. We demonstrate that the model can be utilized to generate designs of thermal sprayed coatings that satisfies target thermal properties. Furthermore, the model is capable of generating coating microstructures and physical processes in three-dimensional (3D) domain after being trained on two-dimensional (2D) examples. Our approach has the potential to transform the design and optimization of thermal sprayed coatings for various applications, including high-temperature and long-duration operation of gas turbines for aircraft or ground-based power generators.


title: Deconstructing Cooperation and Ostracism via Multi-Agent Reinforcement Learning

abstract: Cooperation is challenging in biological systems, human societies, and multi-agent systems in general. While a group can benefit when everyone cooperates, it is tempting for each agent to act selfishly instead. Prior human studies show that people can overcome such social dilemmas while choosing interaction partners, i.e., strategic network rewiring. However, little is known about how agents, including humans, can learn about cooperation from strategic rewiring and vice versa. Here, we perform multi-agent reinforcement learning simulations in which two agents play the Prisoner's Dilemma game iteratively. Each agent has two policies: one controls whether to cooperate or defect; the other controls whether to rewire connections with another agent. This setting enables us to disentangle complex causal dynamics between cooperation and network rewiring. We find that network rewiring facilitates mutual cooperation even when one agent always offers cooperation, which is vulnerable to free-riding. We then confirm that the network-rewiring effect is exerted through agents' learning of ostracism, that is, connecting to cooperators and disconnecting from defectors. However, we also find that ostracism alone is not sufficient to make cooperation emerge. Instead, ostracism emerges from the learning of cooperation, and existing cooperation is subsequently reinforced due to the presence of ostracism. Our findings provide insights into the conditions and mechanisms necessary for the emergence of cooperation with network rewiring.


title: Transport Study of Charge Carrier Scattering in Monolayer WSe$_2$

abstract: Employing flux-grown single crystal WSe$_2$, we report charge carrier scattering behaviors measured in $h$-BN encapsulated monolayer field effect transistors. We perform quantum transport measurements across various hole densities and temperatures and observe a non-monotonic change of transport mobility $\mu$ as a function of hole density in the degenerately doped sample. This unusual behavior can be explained by energy dependent scattering amplitude of strong defects calculated using the T-matrix approximation. Utilizing long mean-free path ($>$500 nm), we demonstrate the high quality of our electronic devices by showing quantized conductance steps from an electrostatically-defined quantum point contact. Our results show the potential for creating ultra-high quality quantum optoelectronic devices based on atomically thin semiconductors.


title: Copy Suppression: Comprehensively Understanding an Attention Head

abstract: We present a single attention head in GPT-2 Small that has one main role across the entire training distribution. If components in earlier layers predict a certain token, and this token appears earlier in the context, the head suppresses it: we call this copy suppression. Attention Head 10.7 (L10H7) suppresses naive copying behavior which improves overall model calibration. This explains why multiple prior works studying certain narrow tasks found negative heads that systematically favored the wrong answer. We uncover the mechanism that the Negative Heads use for copy suppression with weights-based evidence and are able to explain 76.9% of the impact of L10H7 in GPT-2 Small. To the best of our knowledge, this is the most comprehensive description of the complete role of a component in a language model to date. One major effect of copy suppression is its role in self-repair. Self-repair refers to how ablating crucial model components results in downstream neural network parts compensating for this ablation. Copy suppression leads to self-repair: if an initial overconfident copier is ablated, then there is nothing to suppress. We show that self-repair is implemented by several mechanisms, one of which is copy suppression, which explains 39% of the behavior in a narrow task. Interactive visualisations of the copy suppression phenomena may be seen at our web app https://copy-suppression.streamlit.app/


title: Induced phase transformation in ionizable colloidal nanoparticles

abstract: Acid-base equilibria directly influence the functionality and behavior of particles in a system. Due to the ionizing effects of acid-base functional groups, particles will undergo charge exchange. The degree of ionization and their intermolecular and electrostatic interactions are controlled by varying the pH and salt concentration of the solution in a system. Although the pH can be tuned in experiments, it is hard to model this effect using simulations or theoretical approaches. This is due to the difficulty in treating charge regulation and capturing the cooperative effects in a colloidal suspension with Coulombic interaction. In this work, we analyze a suspension of ionizable colloidal particles via Brownian simulations and derive a phase diagram of the system as a function of pH. It is observed that as pH increases, particles functionalized with acid groups change their arrangement from face-centered cubic (FCC) packing to a disordered state. We attribute these transitions to an increase in the degree of charge polydispersity arising from an increase in pH. Our work shows that charge regulation leads to amorphous solids in colloids when the mean nanoparticle charge is sufficiently high.


title: Profit: Benchmarking Personalization and Robustness Trade-off in Federated Prompt Tuning

abstract: In many applications of federated learning (FL), clients desire models that are personalized using their local data, yet are also robust in the sense that they retain general global knowledge. However, the presence of data heterogeneity across clients induces a fundamental trade-off between personalization (i.e., adaptation to a local distribution) and robustness (i.e., not forgetting previously learned general knowledge). It is critical to understand how to navigate this personalization vs robustness trade-off when designing federated systems, which are increasingly moving towards a paradigm of fine-tuning large foundation models. Due to limited computational and communication capabilities in most federated settings, this foundation model fine-tuning must be done using parameter-efficient fine-tuning (PEFT) approaches. While some recent work has studied federated approaches to PEFT, the personalization vs robustness trade-off of federated PEFT has been largely unexplored. In this work, we take a step towards bridging this gap by benchmarking fundamental FL algorithms -- FedAvg and FedSGD plus personalization (via client local fine-tuning) -- applied to one of the most ubiquitous PEFT approaches to large language models (LLMs) -- prompt tuning -- in a multitude of hyperparameter settings under varying levels of data heterogeneity. Our results show that federated-trained prompts can be surprisingly robust when using a small learning rate with many local epochs for personalization, especially when using an adaptive optimizer as the client optimizer during federated training. We also demonstrate that simple approaches such as adding regularization and interpolating two prompts are effective in improving the personalization vs robustness trade-off in computation-limited settings with few local updates allowed for personalization.


title: (Re)framing Built Heritage through the Machinic Gaze

abstract: Built heritage has been both subject and product of a gaze that has been sustained through moments of colonial fixation on ruins and monuments, technocratic examination and representation, and fetishisation by aglobal tourist industry. We argue that the recent proliferation of machine learning and vision technologies create new scopic regimes for heritage: storing and retrieving existing images from vast digital archives, and further imparting their own distortions upon its visual representation. We introduce the term `machinic gaze' to conceptualise the reconfiguration of heritage representation via AI models. To explore how this gaze reframes heritage, we deploy an image-text-image pipeline that reads, interprets, and resynthesizes images of several UNESCO World Heritage Sites. Employing two concepts from media studies -- heteroscopia and anamorphosis -- we describe the reoriented perspective that machine vision systems introduce. We propose that the machinic gaze highlights the artifice of the human gaze and its underlying assumptions and practices that combine to form established notions of heritage.


title: The composition and thermal properties of a cool core lacking a brightest cluster galaxy

abstract: We present a multiwavelength observation of a cool core that does not appear to be associated with any galaxy, in a nearby cluster, Abell~1142. Its X-ray surface brightness peak of $\lesssim2$ keV is cooler than the ambient intracluster gas of $\gtrsim3$ keV, and is offset from its brightest cluster galaxy (BCG) by 80 kpc in projection, representing the largest known cool core -- BCG separation. This BCG-less cool core allows us to measure the metallicity of a cluster center with a much-reduced contribution from the interstellar medium (ISM) of the BCG. XMM-Newton observation reveals a prominent Fe abundance peak of $1.07^{+0.16}_{-0.15}$ Z$_{\odot}$ and an $\alpha/$Fe abundance ratio close to the solar ratio, fully consistent with those found at the centers of typical cool core clusters. This finding hints that BCGs play a limited role in enriching the cluster centers. However, the discussion remains open, given that the $\alpha/$Fe abundance ratios of the orphan cool core and the BCG ISM are not significantly different. Abell~1142 may have experienced a major merger more than 100 Myr ago, which has dissociated its cool core from the BCG. This implies that the Fe abundance peak in cool core clusters can be resilient to cluster mergers. Our recent IRAM 30-m observation did not detect any CO emission at its X-ray peak and we find no evidence for massive runaway cooling in the absence of recent AGN feedback. The lack of a galaxy may contribute to an inefficient conversion of the ionized warm gas to the cold molecular gas.


title: Metadata-Conditioned Generative Models to Synthesize Anatomically-Plausible 3D Brain MRIs

abstract: Generative AI models hold great potential in creating synthetic brain MRIs that advance neuroimaging studies by, for example, enriching data diversity. However, the mainstay of AI research only focuses on optimizing the visual quality (such as signal-to-noise ratio) of the synthetic MRIs while lacking insights into their relevance to neuroscience. To gain these insights with respect to T1-weighted MRIs, we first propose a new generative model, BrainSynth, to synthesize metadata-conditioned (e.g., age- and sex-specific) MRIs that achieve state-of-the-art visual quality. We then extend our evaluation with a novel procedure to quantify anatomical plausibility, i.e., how well the synthetic MRIs capture macrostructural properties of brain regions, and how accurately they encode the effects of age and sex. Results indicate that more than half of the brain regions in our synthetic MRIs are anatomically accurate, i.e., with a small effect size between real and synthetic MRIs. Moreover, the anatomical plausibility varies across cortical regions according to their geometric complexity. As is, our synthetic MRIs can significantly improve the training of a Convolutional Neural Network to identify accelerated aging effects in an independent study. These results highlight the opportunities of using generative AI to aid neuroimaging research and point to areas for further improvement.


title: Trust in Generative AI among students: An Exploratory Study

abstract: Generative artificial systems (GenAI) have experienced exponential growth in the past couple of years. These systems offer exciting capabilities, such as generating programs, that students can well utilize for their learning. Among many dimensions that might affect the effective adoption of GenAI, in this paper, we investigate students' \textit{trust}. Trust in GenAI influences the extent to which students adopt GenAI, in turn affecting their learning. In this study, we surveyed 253 students at two large universities to understand how much they trust \genai tools and their feedback on how GenAI impacts their performance in CS courses. Our results show that students have different levels of trust in GenAI. We also observe different levels of confidence and motivation, highlighting the need for further understanding of factors impacting trust.


title: Automatic Anonymization of Swiss Federal Supreme Court Rulings

abstract: Releasing court decisions to the public relies on proper anonymization to protect all involved parties, where necessary. The Swiss Federal Supreme Court relies on an existing system that combines different traditional computational methods with human experts. In this work, we enhance the existing anonymization software using a large dataset annotated with entities to be anonymized. We compared BERT-based models with models pre-trained on in-domain data. Our results show that using in-domain data to pre-train the models further improves the F1-score by more than 5\% compared to existing models. Our work demonstrates that combining existing anonymization methods, such as regular expressions, with machine learning can further reduce manual labor and enhance automatic suggestions.


title: Unbiased and Robust: External Attention-enhanced Graph Contrastive Learning for Cross-domain Sequential Recommendation

abstract: Cross-domain sequential recommenders (CSRs) are gaining considerable research attention as they can capture user sequential preference by leveraging side information from multiple domains. However, these works typically follow an ideal setup, i.e., different domains obey similar data distribution, which ignores the bias brought by asymmetric interaction densities (a.k.a. the inter-domain density bias). Besides, the frequently adopted mechanism (e.g., the self-attention network) in sequence encoder only focuses on the interactions within a local view, which overlooks the global correlations between different training batches. To this end, we propose an External Attention-enhanced Graph Contrastive Learning framework, namely EA-GCL. Specifically, to remove the impact of the inter-domain density bias, an auxiliary Self-Supervised Learning (SSL) task is attached to the traditional graph encoder under a multi-task learning manner. To robustly capture users' behavioral patterns, we develop an external attention-based sequence encoder that contains an MLP-based memory-sharing structure. Unlike the self-attention mechanism, such a structure can effectively alleviate the bias interference from the batch-based training scheme. Extensive experiments on two real-world datasets demonstrate that EA-GCL outperforms several state-of-the-art baselines on CSR tasks. The source codes and relevant datasets are available at https://github.com/HoupingY/EA-GCL.


title: A Polynomial Upper Bound for Poset Saturation

abstract: Given a finite poset $\mathcal P$, we say that a family $\mathcal F$ of subsets of $[n]$ is $\mathcal P$-saturated if $\mathcal F$ does not contain an induced copy of $\mathcal P$, but adding any other set to $\mathcal F$ creates an induced copy of $\mathcal P$. The induced saturation number of $\mathcal P$, denoted by $\text{sat}^*(n,\mathcal P)$, is the size of the smallest $\mathcal P$-saturated family with ground set $[n]$. In this paper we prove that the saturation number for any given poset grows at worst polynomially. More precisely, we show that $\text{sat}^*(n, \mathcal P)=O(n^c)$, where $c\leq|\mathcal{P}|^2/4+1$ is a constant depending on $\mathcal P$ only. We obtain this result by bounding the VC-dimension of our family.


title: Normalizing Flows for Bayesian Posteriors: Reproducibility and Deployment

abstract: We present a computational framework for efficient learning, sampling, and distribution of general Bayesian posterior distributions. The framework leverages a machine learning approach for the construction of normalizing flows for the general probability distributions typically encountered in Bayesian uncertainty quantification studies. This normalizing flow can map a trivial distribution to a more complicated one and can be stored more efficiently than the empirical distribution samples themselves. Once the normalized flow is trained, it further enables parallelized and uncorrelated sampling of the learned distribution. We demonstrate our framework with three test distributions with strong non-linear correlations, multi-modality, and heavy tails, as well as with a realistic posterior distribution obtained from a Bayesian calibration of a nuclear relativistic mean-field model. The performance of the framework, as well as its relatively simple implementation, positions it as one fundamental cornerstone in the development and deployment of continuous calibration pipelines of physical models and as a key component of future reproducible science workflows.


title: An exact method for bosonizing the Fermi surface in arbitrary dimensions

abstract: Inspired by the recent work by Delacretaz et. al., we rigorously derive an exact and simple method to bosonize a non-interacting fermionic system with a Fermi surface starting from a microscopic Hamiltonian. In the long-wavelength limit, we show that the derived bosonized action is exactly equivalent to the action obtained by Delacretaz et. al. In addition, we propose diagrammatic rules to evaluate correlation functions using our bosonized theory and demonstrate these rules by calculating the three- and four-point density correlation functions. We also consider a general density-density interaction and show that the simplest approximation in our bosonic theory is identical to RPA results.


title: Efficient State Estimation with Constrained Rao-Blackwellized Particle Filter

abstract: Due to the limitations of the robotic sensors, during a robotic manipulation task, the acquisition of the object's state can be unreliable and noisy. Combining an accurate model of multi-body dynamic system with Bayesian filtering methods has been shown to be able to filter out noise from the object's observed states. However, efficiency of these filtering methods suffers from samples that violate the physical constraints, e.g., no penetration constraint. In this paper, we propose a Rao-Blackwellized Particle Filter (RBPF) that samples the contact states and updates the object's poses using Kalman filters. This RBPF also enforces the physical constraints on the samples by solving a quadratic programming problem. By comparing our method with methods that does not consider physical constraints, we show that our proposed RBPF is not only able to estimate the object's states, e.g., poses, more accurately but also able to infer unobserved states, e.g., velocities, with higher precision.


title: Direct Method of Scaling Spheres for the Laplacian and Fractional Laplacian Equations with Hardy-Henon Type Nonlinearity

abstract: In this paper, we focus on the partial differential equation \begin{equation*} (-\Delta)^\frac{\alpha}{2} u(x)=f(x,u(x))\;\;\;\;\text{ in }\mathbb{R}^n, \end{equation*} where $0<\alpha\leq 2$. By the direct method of scaling spheres investigated by Dai and Qin (\cite{dai2023liouville}, \textit{International Mathematics Research Notices, 2023}), we derive a Liouville-type theorem. This mildly extends the previous researches on Liouville-type theorem for the semi-linear equation $ (-\Delta)^\frac{\alpha}{2} u(x)=f(u(x))$ where the nonlinearity $f$ depends solely on the solution $u(x)$, and covers the Liouville-type theorem for Hardy-H\'enon equations $(-\Delta)^\frac{\alpha}{2} u(x)=|x|^au^p(x)$.


title: X-Transfer: A Transfer Learning-Based Framework for GAN-Generated Fake Image Detection

abstract: Generative adversarial networks (GANs) have remarkably advanced in diverse domains, especially image generation and editing. However, the misuse of GANs for generating deceptive images, such as face replacement, raises significant security concerns, which have gained widespread attention. Therefore, it is urgent to develop effective detection methods to distinguish between real and fake images. Current research centers around the application of transfer learning. Nevertheless, it encounters challenges such as knowledge forgetting from the original dataset and inadequate performance when dealing with imbalanced data during training. To alleviate this issue, this paper introduces a novel GAN-generated image detection algorithm called X-Transfer, which enhances transfer learning by utilizing two neural networks that employ interleaved parallel gradient transmission. In addition, we combine AUC loss and cross-entropy loss to improve the model's performance. We carry out comprehensive experiments on multiple facial image datasets. The results show that our model outperforms the general transferring approach, and the best metric achieves 99.04%, which is increased by approximately 10%. Furthermore, we demonstrate excellent performance on non-face datasets, validating its generality and broader application prospects.


title: The Nonlocal Stefan Problem via a Martingale Transport

abstract: We study the nonlocal Stefan problem, where the phase transition is described by a nonlocal diffusion as well as the change of enthalpy functions. By using a stochastic optimization approach introduced for the local case, we construct global-time weak solutions and give a probabilistic interpretation for the solutions. An important ingredient in our analysis is a probabilistic interpretation of the enthalpy and temperature variables in terms of a particle system. Our approach in particular establishes the connection between the parabolic obstacle problem and the Stefan Problem for the nonlocal diffusions. For the melting problem, we show that our solution coincides with those studied in the literature.


title: Towards Equitable Peering: A Proposal for a Fair Peering Fee Between ISPs and Content Providers

abstract: Disagreements over peering fees have risen to the level of potential government regulation. ISPs assert that content providers should pay them based on the volume of downstream traffic. Transit providers and content providers assert that consumers have already paid ISPs to transmit the content they request and that peering agreements should be settlement-free. Our goal is to determine the fair payment between an ISP and an interconnecting network. We consider fair cost sharing between two Tier-1 ISPs, and derive the peering fee that equalizes their net backbone transportation costs. We then consider fair cost sharing between an ISP and a transit provider. We derive the peering fee that equalizes their net backbone transportation costs, and illustrate how it depends on the traffic ratio and the amount of localization of that content. Finally, we consider the fair peering fee between an ISP and a content provider. We derive the peering fee that results in the same net cost to the ISP, and illustrate how the peering fee depends on the number of interconnection points and the amount of localization of that content. We dispense with the ISP argument that it should be paid regardless of the amount of localization of content.


title: On two conjectural series involving Riemann zeta function

abstract: Riemann zeta function is important in a lot of branches of number theory. With the help of the operator method and several transformation formulas for hypergeometric series, we prove four series involving Riemann zeta function. Two of them are series expansions for $\zeta(7)$ and $\zeta(3)^2$ recently conjectured by Z.-W. Sun.


title: Semi-implicit method of high-index saddle dynamics and application to construct solution landscape

abstract: We analyze the semi-implicit scheme of high-index saddle dynamics, which provides a powerful numerical method for finding the any-index saddle points and constructing the solution landscape. Compared with the explicit schemes of saddle dynamics, the semi-implicit discretization relaxes the step size and accelerates the convergence, but the corresponding numerical analysis encounters new difficulties compared to the explicit scheme. Specifically, the orthonormal property of the eigenvectors at each time step could not be fully employed due to the semi-implicit treatment, and computations of the eigenvectors are coupled with the orthonormalization procedure, which further complicates the numerical analysis. We address these issues to prove error estimates of the semi-implicit scheme via, e.g. technical splittings and multi-variable circulating induction procedure. We further analyze the convergence rate of the generalized minimum residual solver for solving the semi-implicit system. Extensive numerical experiments are carried out to substantiate the efficiency and accuracy of the semi-implicit scheme in constructing solution landscapes of complex systems.


title: Neural2Speech: A Transfer Learning Framework for Neural-Driven Speech Reconstruction

abstract: Reconstructing natural speech from neural activity is vital for enabling direct communication via brain-computer interfaces. Previous efforts have explored the conversion of neural recordings into speech using complex deep neural network (DNN) models trained on extensive neural recording data, which is resource-intensive under regular clinical constraints. However, achieving satisfactory performance in reconstructing speech from limited-scale neural recordings has been challenging, mainly due to the complexity of speech representations and the neural data constraints. To overcome these challenges, we propose a novel transfer learning framework for neural-driven speech reconstruction, called Neural2Speech, which consists of two distinct training phases. First, a speech autoencoder is pre-trained on readily available speech corpora to decode speech waveforms from the encoded speech representations. Second, a lightweight adaptor is trained on the small-scale neural recordings to align the neural activity and the speech representation for decoding. Remarkably, our proposed Neural2Speech demonstrates the feasibility of neural-driven speech reconstruction even with only 20 minutes of intracranial data, which significantly outperforms existing baseline methods in terms of speech fidelity and intelligibility.


title: Do self-supervised speech and language models extract similar representations as human brain?

abstract: Speech and language models trained through self-supervised learning (SSL) demonstrate strong alignment with brain activity during speech and language perception. However, given their distinct training modalities, it remains unclear whether they correlate with the same neural aspects. We directly address this question by evaluating the brain prediction performance of two representative SSL models, Wav2Vec2.0 and GPT-2, designed for speech and language tasks. Our findings reveal that both models accurately predict speech responses in the auditory cortex, with a significant correlation between their brain predictions. Notably, shared speech contextual information between Wav2Vec2.0 and GPT-2 accounts for the majority of explained variance in brain activity, surpassing static semantic and lower-level acoustic-phonetic information. These results underscore the convergence of speech contextual representations in SSL models and their alignment with the neural network underlying speech perception, offering valuable insights into both SSL models and the neural basis of speech and language processing.


title: An Experimental Comparison of Methods for Computing the Numerical Radius

abstract: We make an experimental comparison of methods for computing the numerical radius of an $n\times n$ complex matrix, based on two well-known characterizations, the first a nonconvex optimization problem in one real variable and the second a convex optimization problem in $n^{2}+1$ real variables. We make comparisons with respect to both accuracy and computation time using publicly available software.


title: Theoretical study on bubble dynamics under hybrid-boundary and multi-bubble conditions using the unified equation

abstract: This paper aims to use the unified bubble dynamics equation to investigate bubble behavior in complex scenarios involving hybrid free surface/wall boundaries and interactions between multiple bubbles. The effect of singularity movement on the unified equation's form is analyzed after deriving the bubble pulsation equation using a moving point source and a dipole, followed by discussions on the effect of migration compressibility-related terms on the bubble dynamics. In addition, the present study accounts for the impact of hybrid boundaries, including crossed and parallel boundaries, by introducing a finite number of mirror bubbles for the former and an infinite number of mirror bubbles for the latter. Spark bubble experiments and numerical simulation are conducted to validate the present theory. The application of the unified equation in multi-bubble interactions is exemplified by computing a spherical bubble array containing more than 100 uniformly distributed cavitation bubbles under different boundary conditions. The bubble cluster-induced pressure peak can reach nearly two times or even higher than that of an individual bubble, highlighting the damage potential caused by cavitation bubble clusters.


title: DxPU: Large Scale Disaggregated GPU Pools in the Datacenter

abstract: The rapid adoption of AI and convenience offered by cloud services have resulted in the growing demands for GPUs in the cloud. Generally, GPUs are physically attached to host servers as PCIe devices. However, the fixed assembly combination of host servers and GPUs is extremely inefficient in resource utilization, upgrade, and maintenance. Due to these issues, the GPU disaggregation technique has been proposed to decouple GPUs from host servers. It aggregates GPUs into a pool, and allocates GPU node(s) according to user demands. However, existing GPU disaggregation systems have flaws in software-hardware compatibility, disaggregation scope, and capacity. In this paper, we present a new implementation of datacenter-scale GPU disaggregation, named DxPU. DxPU efficiently solves the above problems and can flexibly allocate as many GPU node(s) as users demand. In order to understand the performance overhead incurred by DxPU, we build up a performance model for AI specific workloads. With the guidance of modeling results, we develop a prototype system, which has been deployed into the datacenter of a leading cloud provider for a test run. We also conduct detailed experiments to evaluate the performance overhead caused by our system. The results show that the overhead of DxPU is less than 10%, compared with native GPU servers, in most of user scenarios.


title: NPEFF: Non-Negative Per-Example Fisher Factorization

abstract: As deep learning models are deployed in more and more settings, it becomes increasingly important to be able to understand why they produce a given prediction, but interpretation of these models remains a challenge. In this paper, we introduce a novel interpretability method called NPEFF that is readily applicable to any end-to-end differentiable model. It operates on the principle that processing of a characteristic shared across different examples involves a specific subset of model parameters. We perform NPEFF by decomposing each example's Fisher information matrix as a non-negative sum of components. These components take the form of either non-negative vectors or rank-1 positive semi-definite matrices depending on whether we are using diagonal or low-rank Fisher representations, respectively. For the latter form, we introduce a novel and highly scalable algorithm. We demonstrate that components recovered by NPEFF have interpretable tunings through experiments on language and vision models. Using unique properties of NPEFF's parameter-space representations, we ran extensive experiments to verify that the connections between directions in parameters space and examples recovered by NPEFF actually reflect the model's processing. We further demonstrate NPEFF's ability to uncover the actual processing strategies used by a TRACR-compiled model. We further explore a potential application of NPEFF in uncovering and correcting flawed heuristics used by a model. We release our code to facilitate research using NPEFF.


title: Gravity-induced entanglement between two massive microscopic particles in curved spacetime: II.Friedmann- Lema\^itre-Robertson-Walker universe

abstract: In our previous work, we have explored quantum gravity induced entanglement of mass (QGEM) in curved spacetime, observing entanglement formation between particles moving along geodesics in a Schwarzschild spacetime background. We find that long interaction time induces entanglement, even for particles with microscopic mass, addressing decoherence concerns. In this work, we build upon our previous work by extending our investigation to a time-dependent spacetime. Specifically, we explore the entanglement induced by the mutual gravitation of massive particles in the Friedmann-Lema\^itre-Robertson-Walker(FLRW) universe. Through calculations of the phase variation and the QGEM spectrum, our proposed scheme offers a potential method for observing the formation of entanglement caused by the quantum gravity of massive particles as they propagate in the FLRW universe. Consequently, our research provides fresh insights into the field of entanglement in cosmology.


title: Peering Costs and Fees

abstract: Internet users have suffered collateral damage in tussles over paid peering between large ISPs and large content providers. In order to qualify for settlement-free peering, large Internet Service Providers (ISPs) require that peers meet certain requirements. However, the academic literature has not yet shown the relationship between these settlement-free peering requirements and the value to each interconnecting network. We first consider the effect of paid peering on broadband prices. We adopt a two-sided market model in which an ISP maximizes profit by setting broadband prices and a paid peering price. Our result shows that paid peering fees reduce the premium plan price, and increase the video streaming price and the total price for premium tier customers who subscribe to video streaming services. We next consider the effect of paid peering on consumer surplus. We find that consumer surplus is a uni-modal function of the paid peering fee. The peering price depends critically on the incremental ISP cost per video streaming subscriber; at different costs, it can be negative, zero, or positive. Last, we construct a network cost model. We show that the traffic-sensitive network cost decreases as the number of interconnection points increases, but with decreasing returns. Interconnecting at 6 to 8 interconnection points is rational, and requiring interconnection at more than 8 points is of little value. We show that if the content delivery network (CDN) delivers traffic to the ISP locally, then a requirement to interconnect at a minimum number of interconnection points is rational. We also show that if the CDN delivers traffic using hot potato routing, the ISP is unlikely to perceive sufficient value to offer settlement-free peering.


title: Oracle Efficient Algorithms for Groupwise Regret

abstract: We study the problem of online prediction, in which at each time step $t$, an individual $x_t$ arrives, whose label we must predict. Each individual is associated with various groups, defined based on their features such as age, sex, race etc., which may intersect. Our goal is to make predictions that have regret guarantees not just overall but also simultaneously on each sub-sequence comprised of the members of any single group. Previous work such as [Blum & Lykouris] and [Lee et al] provide attractive regret guarantees for these problems; however, these are computationally intractable on large model classes. We show that a simple modification of the sleeping experts technique of [Blum & Lykouris] yields an efficient reduction to the well-understood problem of obtaining diminishing external regret absent group considerations. Our approach gives similar regret guarantees compared to [Blum & Lykouris]; however, we run in time linear in the number of groups, and are oracle-efficient in the hypothesis class. This in particular implies that our algorithm is efficient whenever the number of groups is polynomially bounded and the external-regret problem can be solved efficiently, an improvement on [Blum & Lykouris]'s stronger condition that the model class must be small. Our approach can handle online linear regression and online combinatorial optimization problems like online shortest paths. Beyond providing theoretical regret bounds, we evaluate this algorithm with an extensive set of experiments on synthetic data and on two real data sets -- Medical costs and the Adult income dataset, both instantiated with intersecting groups defined in terms of race, sex, and other demographic characteristics. We find that uniformly across groups, our algorithm gives substantial error improvements compared to running a standard online linear regression algorithm with no groupwise regret guarantees.


title: Space Observation by the Australia Telescope Compact Array: Performance Characterization using GPS Satellite Observation

abstract: In order to operationalize the Australia Telescope Compact Array (ATCA) for space situational awareness (SSA) applications, we develop a system model for range and direction of arrival (DOA) estimation based on the interferometric data. We employ the observational data collected from global positioning system (GPS) satellites to evaluate the developed model and demonstrate that, compared to a priori location propagated from the most recent two-line element (TLE), both range and direction information are improved significantly.


title: Estimating the Uncertainty of Cosmological First Order Phase Transitions with Numerical Simulations

abstract: In order to study the validity of analytical formulas used in the calculation of characteristic physical quantities related to vacuum bubbles, we conduct several numerical simulations of bubble kinematics in the context of cosmological first-order phase transitions to determine potentially existing systematic uncertainties. By comparing with the analytical results, we obtain the following observations: (1) For the total number of bubbles, there is a 10% discrepancy between the values from simulations and from analytical prediction; (2) For the false vacuum fraction, the difference between the results from simulations and from analytical prediction is small, which, however, plays a crucial role in explaining the discrepancy observed in the total number of bubbles; (3) The bubble lifetime distribution obtained from the simulations deviates from the exponential distribution and is not obviously influenced by different nucleation rates; (4) These differences propagate into the final gravitational waves spectra, which we calculate with the sound shell model for the usually dominant contribution from sound waves, and find that the bubble number deviation enhances the peak value in the gravitational wave spectra, while the deviation in the lifetime distribution suppresses the peak value.


title: VLATTACK: Multimodal Adversarial Attacks on Vision-Language Tasks via Pre-trained Models

abstract: Vision-Language (VL) pre-trained models have shown their superiority on many multimodal tasks. However, the adversarial robustness of such models has not been fully explored. Existing approaches mainly focus on exploring the adversarial robustness under the white-box setting, which is unrealistic. In this paper, we aim to investigate a new yet practical task to craft image and text perturbations using pre-trained VL models to attack black-box fine-tuned models on different downstream tasks. Towards this end, we propose VLATTACK to generate adversarial samples by fusing perturbations of images and texts from both single-modal and multimodal levels. At the single-modal level, we propose a new block-wise similarity attack (BSA) strategy to learn image perturbations for disrupting universal representations. Besides, we adopt an existing text attack strategy to generate text perturbations independent of the image-modal attack. At the multimodal level, we design a novel iterative cross-search attack (ICSA) method to update adversarial image-text pairs periodically, starting with the outputs from the single-modal level. We conduct extensive experiments to attack five widely-used VL pre-trained models for six tasks. Experimental results show that VLATTACK achieves the highest attack success rates on all tasks compared with state-of-the-art baselines, which reveals a blind spot in the deployment of pre-trained VL models. Source codes can be found at https://github.com/ericyinyzy/VLAttack.


title: Accelerated high-index saddle dynamics method for searching high-index saddle points

abstract: The high-index saddle dynamics (HiSD) method [J. Yin, L. Zhang, and P. Zhang, {\it SIAM J. Sci. Comput., }41 (2019), pp.A3576-A3595] serves as an efficient tool for computing index-$k$ saddle points and constructing solution landscapes. Nevertheless, the conventional HiSD method often encounters slow convergence rates on ill-conditioned problems. To address this challenge, we propose an accelerated high-index saddle dynamics (A-HiSD) by incorporating the heavy ball method. We prove the linear stability theory of the continuous A-HiSD, and subsequently estimate the local convergence rate for the discrete A-HiSD. Our analysis demonstrates that the A-HiSD method exhibits a faster convergence rate compared to the conventional HiSD method, especially when dealing with ill-conditioned problems. We also perform various numerical experiments including the loss function of neural network to substantiate the effectiveness and acceleration of the A-HiSD method.


title: Spike-Triggered Contextual Biasing for End-to-End Mandarin Speech Recognition

abstract: The attention-based deep contextual biasing method has been demonstrated to effectively improve the recognition performance of end-to-end automatic speech recognition (ASR) systems on given contextual phrases. However, unlike shallow fusion methods that directly bias the posterior of the ASR model, deep biasing methods implicitly integrate contextual information, making it challenging to control the degree of bias. In this study, we introduce a spike-triggered deep biasing method that simultaneously supports both explicit and implicit bias. Moreover, both bias approaches exhibit significant improvements and can be cascaded with shallow fusion methods for better results. Furthermore, we propose a context sampling enhancement strategy and improve the contextual phrase filtering algorithm. Experiments on the public WenetSpeech Mandarin biased-word dataset show a 32.0% relative CER reduction compared to the baseline model, with an impressively 68.6% relative CER reduction on contextual phrases.


title: Single-shot recognition of orbital angular momentum from speckles with spatially multiplexed point detection (SMPD)

abstract: The widely adopted optical information detection strategies nowadays can be roughly classified into spatial-resolve-based and time-sequence-based methods. The former is highly reliant on detectors with spatial resolution that works in a limited spectrum range to capture the intensity distribution of the object, whereas the latter employs single-pixel detectors (SPDs) with improved reliability and stability in detection at the expense of time consumption due to sequential intensity recording. However, there is a scarcity of research on using high-performance SPDs for single-shot object information detection. To capture and extract features of objects efficiently and economically, in this work, we propose a single-shot optical information-detecting method, tentatively named spatially multiplexed point detection (SMPD) technology, in which some SPDs are randomly distributed at different locations to acquire the information of the object. To validate the validity of the proposed method, we demonstrate high-fidelity recognition of orbital angular momentum (OAM) modes from speckle patterns generated by the transmission of two orthogonally polarized vortex beams through a multimode fiber. It is feasible to apply this approach in wide applications, such as image transmission based on multiplexed-OAM decoding and recognizing hand-written digits. Compared with traditional image recognition methods, the new approach yields a recognition accuracy of over 98% with an effective detection area that is only 0.02% of its counterparts. With further engineering, the proposed method may spur many exciting developments in OAM-based optical communication systems, image classification, object detections, and other optical information detections.


title: Convolution formulas for multivariate arithmetic Tutte polynomials

abstract: The multivariate arithmetic Tutte polynomial of arithmetic matroids is a generalization of the multivariate Tutte polynomial of matroids. In this note, we give the convolution formulas for the multivariate arithmetic Tutte polynomial of the product of two arithmetic matroids. In particular, the convolution formulas for the multivariate arithmetic Tutte polynomial of an arithmetic matroid are obtained. Applying our results, several known convolution formulas including [5, Theorem 10.9 and Corollary 10.10] and [1, Theorems 1 and 4] are proved by a purely combinatorial proof. The proofs presented here are significantly shorter than the previous ones. In addition, we obtain a convolution formula for the characteristic polynomial of an arithmetic matroid.


title: Balancing Weights for Causal Inference in Observational Factorial Studies

abstract: Many scientific questions in biomedical, environmental, and psychological research involve understanding the impact of multiple factors on outcomes. While randomized factorial experiments are ideal for this purpose, randomization is infeasible in many empirical studies. Therefore, investigators often rely on observational data, where drawing reliable causal inferences for multiple factors remains challenging. As the number of treatment combinations grows exponentially with the number of factors, some treatment combinations can be rare or even missing by chance in observed data, further complicating factorial effects estimation. To address these challenges, we propose a novel weighting method tailored to observational studies with multiple factors. Our approach uses weighted observational data to emulate a randomized factorial experiment, enabling simultaneous estimation of the effects of multiple factors and their interactions. Our investigations reveal a crucial nuance: achieving balance among covariates, as in single-factor scenarios, is necessary but insufficient for unbiasedly estimating factorial effects. Our findings suggest that balancing the factors is also essential in multi-factor settings. Moreover, we extend our weighting method to handle missing treatment combinations in observed data. Finally, we study the asymptotic behavior of the new weighting estimators and propose a consistent variance estimator, providing reliable inferences on factorial effects in observational studies.


title: Integrable systems on rectangular $\mathcal{W}$-superalgebras via super Adler-type operators

abstract: In this paper, we introduce a class of super Adler-type operators associated with the Lie superalgebra $\mathfrak{gl}(m|n)$. We show that these operators generate Poisson vertex superalgebras which are isomorphic to the classical $\mathcal{W}$-superalgebras associated with $\mathfrak{gl}(m|n)$ and some rectangular nilpotent elements. We use this isomorphism to construct integrable hierarchies on these rectangular $\mathcal{W}$-superalgebras.