title: Mechanism of Local Lattice Distortion Effects on Vacancy Migration Barriers in FCC Alloys

abstract: Accurate prediction of vacancy migration energy barriers, $\Delta E_a$, in multi-component alloys is extremely challenging yet critical for the development of diffusional transformation kinetics needed to model alloy behavior in many technological applications. Here, results from $\Delta E_a$ and the energy driving force $\Delta E$ of many (>1000) vacancy migration events calculated using density functional theory and nudged elastic band method show large changes (~1eV) of $\Delta E_a$ in different local chemical environments of the model face-centered cubic Al-Mg-Zn alloys. Due to local lattice distortion effects induced by solute atoms (such as Mg) with different sizes than the matrix element (Al), the changes of $\Delta E_a$ for one type of migrating atoms originate primarily from fluctuations of $\Delta e_a\equiv \Delta E_a - \frac{1}{2}\Delta E$. To understand the fluctuations, a quartic function is shown to accurately describe the energy landscape of the minimum energy path (MEP) for each vacancy migration event. Analyses of the quartic function show that $\Delta e_a$ can be approximated with $\Delta e_a \approx \alpha k_fD^2$, where $\alpha\sim 0.022$ is a constant of all types of migrating atoms. Here $D$ is the distance of a migrating atom between two adjacent equilibrium positions and $k_f$ is the average vibration spring constant of this atom at these two equilibrium positions. $k_f$ and $D$ quantitatively describe the lattice distortion effects on the curvatures and locations of the MEP at its initial and final states in different local chemical environments. We also used the local lattice occupations as inputs to train surrogate models to predict coefficients of the quartic function, which accurately and efficiently output both $\Delta E_a$ and $\Delta E$ as the necessary inputs for the mesoscale studies of diffusional transformation in Al-Mg-Zn alloys.


title: A Learning- and Scenario-based MPC Design for Nonlinear Systems in LPV Framework with Safety and Stability Guarantees

abstract: This paper presents a learning- and scenario-based model predictive control (MPC) design approach for systems modeled in linear parameter-varying (LPV) framework. Using input-output data collected from the system, a state-space LPV model with uncertainty quantification is first learned through the variational Bayesian inference Neural Network (BNN) approach. The learned probabilistic model is assumed to contain the true dynamics of the system with a high probability and used to generate scenarios which ensure safety for a scenario-based MPC. Moreover, to guarantee stability and enhance performance of the closed-loop system, a parameter-dependent terminal cost and controller, as well as a terminal robust positive invariant set are designed. Numerical examples will be used to demonstrate that the proposed control design approach can ensure safety and achieve desired control performance.


title: Mesh-based Dynamics with Occlusion Reasoning for Cloth Manipulation

abstract: Self-occlusion is challenging for cloth manipulation, as it makes it difficult to estimate the full state of the cloth. Ideally, a robot trying to unfold a crumpled or folded cloth should be able to reason about the cloth's occluded regions. We leverage recent advances in pose estimation for cloth to build a system that uses explicit occlusion reasoning to unfold a crumpled cloth. Specifically, we first learn a model to reconstruct the mesh of the cloth. However, the model will likely have errors due to the complexities of the cloth configurations and due to ambiguities from occlusions. Our main insight is that we can further refine the predicted reconstruction by performing test-time finetuning with self-supervised losses. The obtained reconstructed mesh allows us to use a mesh-based dynamics model for planning while reasoning about occlusions. We evaluate our system both on cloth flattening as well as on cloth canonicalization, in which the objective is to manipulate the cloth into a canonical pose. Our experiments show that our method significantly outperforms prior methods that do not explicitly account for occlusions or perform test-time optimization. Videos and visualizations can be found on our $\href{https://sites.google.com/view/occlusion-reason/home}{\text{project website}}.$


title: Length preserving numerical schemes for Landau-Lifshitz equation based on Lagrange multiplier approaches

abstract: We develop in this paper two classes of length preserving schemes for the Landau-Lifshitz equation based on two different Lagrange multiplier approaches. In the first approach, the Lagrange multiplier $\lambda(\bx,t)$ equals to $|\nabla m(\bx,t)|^2$ at the continuous level, while in the second approach, the Lagrange multiplier $\lambda(\bx,t)$ is introduced to enforce the length constraint at the discrete level and is identically zero at the continuous level. By using a predictor-corrector approach, we construct efficient and robust length preserving higher-order schemes for the Landau-Lifshitz equation, with the computational cost dominated by the predictor step which is simply a semi-implicit scheme. Furthermore, by introducing another space-independent Lagrange multiplier, we construct energy dissipative, in addition to length preserving, schemes for the Landau-Lifshitz equation, at the expense of solving one nonlinear algebraic equation. We present ample numerical experiments to validate the stability and accuracy for the proposed schemes, and also provide a performance comparison with some existing schemes.


title: Lane-Level Route Planning for Autonomous Vehicles

abstract: We present an algorithm that, given a representation of a road network in lane-level detail, computes a route that minimizes the expected cost to reach a given destination. In doing so, our algorithm allows us to solve for the complex trade-offs encountered when trying to decide not just which roads to follow, but also when to change between the lanes making up these roads, in order to -- for example -- reduce the likelihood of missing a left exit while not unnecessarily driving in the leftmost lane. This routing problem can naturally be formulated as a Markov Decision Process (MDP), in which lane change actions have stochastic outcomes. However, MDPs are known to be time-consuming to solve in general. In this paper, we show that -- under reasonable assumptions -- we can use a Dijkstra-like approach to solve this stochastic problem, and benefit from its efficient $O(n \log n)$ running time. This enables an autonomous vehicle to exhibit lane-selection behavior as it efficiently plans an optimal route to its destination.


title: Thermovoltage and heat dissipation in a triangle quantum dot junction

abstract: We numerically investigate the thermoelectric properties of a triangle quantum dot connected to metallic electrodes using the non-equilibrium Green's function method in the Anderson model. Exploiting the equation of motion method in the Coulomb-blockade regime, the thermovoltage, thermocurrent and heat dissipation are calculated. Results show that the thermovoltage and thermocurrent have nonlinear behavior, and the magnitude and sign of them can be controlled with site energy and coupling strength of quantum dots. Moreover, we find that the heat current is nonlinear and asymmetric respect to the sign of bias voltage for all of the site energies of quantum dots. Analyses show that the heat current can be positive or negative for all of the site energies and becomes zero for the nonzero voltages. These results can be useful to determine the performance of the nanoscale electronic devices to control the heat dissipations.


title: Norm Participation Grounds Language

abstract: The striking recent advances in eliciting seemingly meaningful language behaviour from language-only machine learning models have only made more apparent, through the surfacing of clear limitations, the need to go beyond the language-only mode and to ground these models "in the world". Proposals for doing so vary in the details, but what unites them is that the solution is sought in the addition of non-linguistic data types such as images or video streams, while largely keeping the mode of learning constant. I propose a different, and more wide-ranging conception of how grounding should be understood: What grounds language is its normative nature. There are standards for doing things right, these standards are public and authoritative, while at the same time acceptance of authority can and must be disputed and negotiated, in interactions in which only bearers of normative status can rightfully participate. What grounds language, then, is the determined use that language users make of it, and what it is grounded in is the community of language users. I sketch this idea, and draw some conclusions for work on computational modelling of meaningful language use.


title: Graph Rationalization with Environment-based Augmentations

abstract: Rationale is defined as a subset of input features that best explains or supports the prediction by machine learning models. Rationale identification has improved the generalizability and interpretability of neural networks on vision and language data. In graph applications such as molecule and polymer property prediction, identifying representative subgraph structures named as graph rationales plays an essential role in the performance of graph neural networks. Existing graph pooling and/or distribution intervention methods suffer from lack of examples to learn to identify optimal graph rationales. In this work, we introduce a new augmentation operation called environment replacement that automatically creates virtual data examples to improve rationale identification. We propose an efficient framework that performs rationale-environment separation and representation learning on the real and augmented examples in latent spaces to avoid the high complexity of explicit graph decoding and encoding. Comparing against recent techniques, experiments on seven molecular and four polymer real datasets demonstrate the effectiveness and efficiency of the proposed augmentation-based graph rationalization framework.


title: Sample Complexity of Nonparametric Off-Policy Evaluation on Low-Dimensional Manifolds using Deep Networks

abstract: We consider the off-policy evaluation problem of reinforcement learning using deep convolutional neural networks. We analyze the deep fitted Q-evaluation method for estimating the expected cumulative reward of a target policy, when the data are generated from an unknown behavior policy. We show that, by choosing network size appropriately, one can leverage any low-dimensional manifold structure in the Markov decision process and obtain a sample-efficient estimator without suffering from the curse of high data ambient dimensionality. Specifically, we establish a sharp error bound for fitted Q-evaluation, which depends on the intrinsic dimension of the state-action space, the smoothness of Bellman operator, and a function class-restricted $\chi^2$-divergence. It is noteworthy that the restricted $\chi^2$-divergence measures the behavior and target policies' {\it mismatch in the function space}, which can be small even if the two policies are not close to each other in their tabular forms. We also develop a novel approximation result for convolutional neural networks in Q-function estimation. Numerical experiments are provided to support our theoretical analysis.


title: The Emerton--Gee stack of rank one $(\varphi,\Gamma)$-modules

abstract: We give a classification of rank one $(\varphi,\Gamma)$-modules with coefficients in a $p$-adically complete $\mathbf{Z}_p$-algebra. As a consequence, we obtain a new proof of Proposition 7.2.17 in {arXiv:1908.07185}, which gives an explicit description of the Emerton--Gee stack of $(\varphi,\Gamma)$-modules in the rank one case. In fact, our method also applies in the context of rank one \' etale $\varphi$-modules (i.e. in the absence of a $\Gamma$-action), generalizing another result of Emerton--Gee.


title: Conditional Seq2Seq model for the time-dependent two-level system

abstract: We apply the deep learning neural network architecture to the two-level system in quantum optics to solve the time-dependent Schrodinger equation. By carefully designing the network structure and tuning parameters, above 90 percent accuracy in super long-term predictions can be achieved in the case of random electric fields, which indicates a promising new method to solve the time-dependent equation for two-level systems. By slightly modifying this network, we think that this method can solve the two- or three-dimensional time-dependent Schrodinger equation more efficiently than traditional approaches.


title: A Cryogenic Torsion Balance Using a Liquid-Cryogen Free, Ultra-Low Vibration Cryostat

abstract: We describe a liquid-cryogen free cryostat with ultra-low vibration levels which allows for continuous operation of a torsion balance at cryogenic temperatures. The apparatus uses a commercially available two-stage pulse-tube cooler and passive vibration isolation. The torsion balance exhibits torque noise levels lower than room temperature thermal noise by a factor of about four in the frequency range of 3-10mHz, limited by residual seismic motion and by radiative heating of the pendulum body. In addition to lowering thermal noise below room-temperature limits, the low-temperature environment enables novel torsion balance experiments. Currently, the maximum duration of a continuous measurement run is limited by accumulation of cryogenic surface contamination on the optical elements inside the cryostat.


title: A Justice-Based Framework for the Analysis of Algorithmic Fairness-Utility Trade-Offs

abstract: In prediction-based decision-making systems, different perspectives can be at odds: The short-term business goals of the decision makers are often in conflict with the decision subjects' wish to be treated fairly. Balancing these two perspectives is a question of values. However, these values are often hidden in the technicalities of the implementation of the decision-making system. In this paper, we propose a framework to make these value-laden choices clearly visible. We focus on a setting in which we want to find decision rules that balance the perspective of the decision maker and of the decision subjects. We provide an approach to formalize both perspectives, i.e., to assess the utility of the decision maker and the fairness towards the decision subjects. In both cases, the idea is to elicit values from decision makers and decision subjects that are then turned into something measurable. For the fairness evaluation, we build on well-known theories of distributive justice and on the algorithmic literature to ask what a fair distribution of utility (or welfare) looks like. This allows us to derive a fairness score that we then compare to the decision maker's utility. As we focus on a setting in which we are given a trained model and have to choose a decision rule, we use the concept of Pareto efficiency to compare decision rules. Our proposed framework can both guide the implementation of a decision-making system and help with audits, as it allows us to resurface the values implemented in a decision-making system.


title: Discriminative Models Can Still Outperform Generative Models in Aspect Based Sentiment Analysis

abstract: Aspect-based Sentiment Analysis (ABSA) helps to explain customers' opinions towards products and services. In the past, ABSA models were discriminative, but more recently generative models have been used to generate aspects and polarities directly from text. In contrast, discriminative models commonly first select aspects from the text, and then classify the aspect's polarity. Previous results showed that generative models outperform discriminative models on several English ABSA datasets. Here, we evaluate and contrast two state-of-the-art discriminative and generative models in several settings: cross-lingual, cross-domain, and cross-lingual and domain, to understand generalizability in settings other than English mono-lingual in-domain. Our more thorough evaluation shows that, contrary to previous studies, discriminative models can still outperform generative models in almost all settings.


title: From Free-Energy Profiles to Activation Free Energies

abstract: Given a chemical reaction going from reactant (R) to the product (P) on a potential energy surface (PES) and a collective variable (CV) that discriminates between R and P, one can define a free-energy profile (FEP) as the logarithm of the marginal Boltzmann distribution of the CV. The FEP is not a true free energy, however, it is common to treat the FEP as the free-energy analog of the minimum energy path on the PES and to take the activation free energy, $\Delta F^\ddagger_\mathrm{RP}$, as the difference between the maximum of the FEP at the transition state and the minimum at R. We show that this approximation can result in large errors. Since the FEP depends on the CV, it is therefore not unique, and different, discriminating CVs can yield different activation free energies for the same reaction. We derive an exact expression for the activation free energy that avoids this ambiguity with respect to the choice of CV. We find $\Delta F^\ddagger_\mathrm{RP}$ to be a combination of the probability of the system being in the reactant state, the probability density at the transition state surface, and the thermal de~Broglie wavelength associated with the transition from R to P. We then evaluate the activation free energies based on our formalism for simple analytic models and realistic chemical systems. The analytic models show that the widespread FEP-based approximation applies only at low temperatures for CVs for which the effective mass of the associated pseudo-particle is small. Most chemical reactions of practical interest involve polyatomic molecules with complex, high-dimensional PES that cannot be treated analytically and pose the added challenge of choosing a good CV, typically through heuristics. We study the influence of the choice of CV and find that, while the reaction free energy is largely unaffected, $\Delta F^\ddagger_\mathrm{RP}$ is quite sensitive.


title: ASAP: Reconciling Asynchronous Real-Time Operations and Proofs of Execution in Simple Embedded Systems

abstract: Embedded devices are increasingly ubiquitous and their importance is hard to overestimate. While they often support safety-critical functions (e.g., in medical devices and sensor-alarm combinations), they are usually implemented under strict cost/energy budgets, using low-end microcontroller units (MCUs) that lack sophisticated security mechanisms. Motivated by this issue, recent work developed architectures capable of generating Proofs of Execution (PoX) for the correct/expected software in potentially compromised low-end MCUs. In practice, this capability can be leveraged to provide "integrity from birth" to sensor data, by binding the sensed results/outputs to an unforgeable cryptographic proof of execution of the expected sensing process. Despite this significant progress, current PoX schemes for low-end MCUs ignore the real-time needs of many applications. In particular, security of current PoX schemes precludes any interrupts during the execution being proved. We argue that lack of asynchronous capabilities (i.e., interrupts within PoX) can obscure PoX usefulness, as several applications require processing real-time and asynchronous events. To bridge this gap, we propose, implement, and evaluate an Architecture for Secure Asynchronous Processing in PoX (ASAP). ASAP is secure under full software compromise, enables asynchronous PoX, and incurs less hardware overhead than prior work.


title: An effective fluid description of scalar-vector-tensor theories under the sub-horizon and quasi-static approximations

abstract: We consider scalar-vector-tensor (SVT) theories with second-order equations of motion and tensor propagation speed equivalent to the speed of light. Under the sub-horizon and the quasi-static approximations we find analytical formulae for an effective dark energy fluid, i.e., sound speed, anisotropic stress as well as energy density and pressure. We took advantage of our general, analytical fluid description and showed that it is possible to design SVT cosmological models which are degenerate with $\Lambda$CDM at the background level while having gravity strength $G_{\rm eff}<G_{\rm N}$ at late-times as well as non-vanishing dark energy perturbations. We implemented SVT designer models in the widely used Boltzmann solver CLASS thus making it possible to test SVT models against astrophysical observations. Our effective fluid approach to SVT models reveals non trivial behaviour in the sound speed and the anisotropic stress well worth an investigation in light of current discrepancies in cosmological parameters such as $H_0$ and $\sigma_8$.


title: Thermal spin injection from a ferromagnet into graphene by transverse and longitudinal current

abstract: Graphene is a very promising material in spintronics due to both its high electric mobility and low intrinsic spin-obit coupling. Electronic spins can be injected from a ferromagnetic material through a tunnel contact into graphene owing to a spin relaxation length as high as 5{\mu}m. In recent years, a new approach creating spin current employed thermal effects and heat flow. Here, by applying transverse and longitudinal current to a grahene spin valve device, the interplay between the heat spin current and the charge spin current is investigated. The non-local spin voltage is enhanced by the thermal spin injection and the thermal spin voltage reaches a maximum close to the Dirac point which makes graphene a promising material for a future thermoelectric spin device due to its long spin lifetime and spin diffusion length.


title: Distributive Justice as the Foundational Premise of Fair ML: Unification, Extension, and Interpretation of Group Fairness Metrics

abstract: Group fairness metrics are an established way of assessing the fairness of prediction-based decision-making systems. However, these metrics are still insufficiently linked to philosophical theories, and their moral meaning is often unclear. In this paper, we propose a comprehensive framework for group fairness metrics, which links them to more theories of distributive justice. The different group fairness metrics differ in their choices about how to measure the benefit or harm of a decision for the affected individuals, and what moral claims to benefits are assumed. Our unifying framework reveals the normative choices associated with standard group fairness metrics and allows an interpretation of their moral substance. In addition, this broader view provides a structure for the expansion of standard fairness metrics that we find in the literature. This expansion allows addressing several criticisms of standard group fairness metrics, specifically: (1) they are parity-based, i.e., they demand some form of equality between groups, which may sometimes be detrimental to marginalized groups; (2) they only compare decisions across groups but not the resulting consequences for these groups; and (3) the full breadth of the distributive justice literature is not sufficiently represented.


title: Stability of mKdV breathers on the half-line

abstract: In this paper we study the stability problem for mKdV breathers on the left half-line. We are able to show that leftwards moving breathers, initially located far away from the origin, are strongly stable for the problem posed on the left half-line, when assuming homogeneous boundary conditions. The proof involves a Lyapunov functional which is almost conserved by the mKdV flow once we control some boundary terms which naturally arise.


title: Machine Learning Prediction for Phase-less Millimeter-Wave Beam Tracking

abstract: Future wireless networks may operate at millimeter-wave (mmW) and sub-terahertz (sub-THz) frequencies to enable high data rate requirements. While large antenna arrays are critical for reliable communications at mmW and sub-THz bands, these antenna arrays would also mandate efficient and scalable initial beam alignment and link maintenance algorithms for mobile devices. Low-power phased-array architectures and phase-less power measurements due to high frequency oscillator phase noise pose additional challenges for practical beam tracking algorithms. Traditional beam tracking protocols require exhaustive sweeps of all possible beam directions and scale poorly with high mobility and large arrays. Compressive sensing and machine learning designs have been proposed to improve measurement scaling with array size but commonly degrade under hardware impairments or require raw samples respectively. In this work, we introduce a novel long short-term memory (LSTM) network assisted beam tracking and prediction algorithm utilizing only phase-less measurements from fixed compressive codebooks. We demonstrate comparable beam alignment accuracy to state-of-the-art phase-less beam alignment algorithms, while reducing the average number of required measurements over time.


title: Nonexistence of global solutions for an inhomogeneous pseudo-parabolic equation

abstract: In the present paper, we study an inhomogeneous pseudo-parabolic equation with nonlocal nonlinearity $$u_t-k\Delta u_t-\Delta u=I^\gamma_{0+}(|u|^{p})+\omega(x),\,\ (t,x)\in(0,\infty)\times\mathbb{R}^N,$$ where $p>1,\,k\geq 0$, $\omega(x)\neq0$ and $I^\gamma_{0+}$ is the left Riemann-Liouville fractional integral of order $\gamma\in(0,1).$ Based on the test function method, we have proved the blow-up result for the critical case $\gamma=0,\,p=p_c$ for $N\geq3$, which answers an {\bf open question} posed in \cite{Zhou}, and in particular when $k=0$ it improves the result obtained in \cite{Bandle}. An interesting fact is that in the case $\gamma>0$, the problem does not admit global solutions for any $p>1$ and $\int_{\mathbb{R}^N}\omega(x) dx>0.$


title: The Gaia-ESO Public Spectroscopic Survey: Implementation, data products, open cluster survey, science, and legacy

abstract: In the last 15 years different ground-based spectroscopic surveys have been started (and completed) with the general aim of delivering stellar parameters and elemental abundances for large samples of Galactic stars, complementing Gaia astrometry. Among those surveys, the Gaia-ESO Public Spectroscopic Survey (GES), the only one performed on a 8m class telescope, was designed to target 100,000 stars using FLAMES on the ESO VLT (both Giraffe and UVES spectrographs), covering all the Milky Way populations, with a special focus on open star clusters. This article provides an overview of the survey implementation (observations, data quality, analysis and its success, data products, and releases), of the open cluster survey, of the science results and potential, and of the survey legacy. A companion article (Gilmore et al.) reviews the overall survey motivation, strategy, Giraffe pipeline data reduction, organisation, and workflow. The GES has determined homogeneous good-quality radial velocities and stellar parameters for a large fraction of its more than 110,000 unique target stars. Elemental abundances were derived for up to 31 elements for targets observed with UVES. Lithium abundances are delivered for about 1/3 of the sample. The analysis and homogenisation strategies have proven to be successful; several science topics have been addressed by the Gaia-ESO consortium and the community, with many highlight results achieved. The final catalogue has been released through the ESO archive at the end of May 2022, including the complete set of advanced data products. In addition to these results, the Gaia-ESO Survey will leave a very important legacy, for several aspects and for many years to come.


title: Goal-Space Planning with Subgoal Models

abstract: This paper investigates a new approach to model-based reinforcement learning using background planning: mixing (approximate) dynamic programming updates and model-free updates, similar to the Dyna architecture. Background planning with learned models is often worse than model-free alternatives, such as Double DQN, even though the former uses significantly more memory and computation. The fundamental problem is that learned models can be inaccurate and often generate invalid states, especially when iterated many steps. In this paper, we avoid this limitation by constraining background planning to a set of (abstract) subgoals and learning only local, subgoal-conditioned models. This goal-space planning (GSP) approach is more computationally efficient, naturally incorporates temporal abstraction for faster long-horizon planning and avoids learning the transition dynamics entirely. We show that our GSP algorithm can propagate value from an abstract space in a manner that helps a variety of base learners learn significantly faster in different domains.


title: Polymorphic-GAN: Generating Aligned Samples across Multiple Domains with Learned Morph Maps

abstract: Modern image generative models show remarkable sample quality when trained on a single domain or class of objects. In this work, we introduce a generative adversarial network that can simultaneously generate aligned image samples from multiple related domains. We leverage the fact that a variety of object classes share common attributes, with certain geometric differences. We propose Polymorphic-GAN which learns shared features across all domains and a per-domain morph layer to morph shared features according to each domain. In contrast to previous works, our framework allows simultaneous modelling of images with highly varying geometries, such as images of human faces, painted and artistic faces, as well as multiple different animal faces. We demonstrate that our model produces aligned samples for all domains and show how it can be used for applications such as segmentation transfer and cross-domain image editing, as well as training in low-data regimes. Additionally, we apply our Polymorphic-GAN on image-to-image translation tasks and show that we can greatly surpass previous approaches in cases where the geometric differences between domains are large.


title: The Creativity of Text-to-Image Generation

abstract: Text-guided synthesis of images has made a giant leap towards becoming a mainstream phenomenon. With text-to-image generation systems, anybody can create digital images and artworks. This provokes the question of whether text-to-image generation is creative. This paper expounds on the nature of human creativity involved in text-to-image art (so-called "AI art") with a specific focus on the practice of prompt engineering. The paper argues that the current product-centered view of creativity falls short in the context of text-to-image generation. A case exemplifying this shortcoming is provided and the importance of online communities for the creative ecosystem of text-to-image art is highlighted. The paper provides a high-level summary of this online ecosystem drawing on Rhodes' conceptual four P model of creativity. Challenges for evaluating the creativity of text-to-image generation and opportunities for research on text-to-image generation in the field of Human-Computer Interaction (HCI) are discussed.


title: Adjoint-based Adaptive Multi-Level Monte Carlo for Differential Equations

abstract: We present a multi-level Monte Carlo (MLMC) algorithm with adaptively refined meshes and accurately computed stopping-criteria utilizing adjoint-based a posteriori error analysis for differential equations. This is in contrast to classical MLMC algorithms that use either a hierarchy of uniform meshes or adaptively refined meshes based on Richardson extrapolation, and employ a stopping criteria that relies on assumptions on the convergence rate of the MLMC levels. This work develops two adaptive refinement strategies for the MLMC algorithm. These strategies are based on a decomposition of an error estimate of the MLMC bias and utilize variational analysis, adjoint problems and computable residuals.


title: Managing Bufferbloat in Cloud Storage Systems

abstract: Today, companies and data centers are moving towards cloud and serverless storage systems instead of traditional file systems. As a result of such a transition, allocating sufficient resources to users and parties to satisfy their service level demands has become crucial in cloud storage. In cloud storage, the schedulability of system components and requests is of great importance to achieving QoS goals. However, the bufferbloat phenomenon in storage backends impacts the schedulability of the system. In a storage server, bufferbloat happens when the server submits all requests immediately to the storage backend due to a large buffer in the backend. In recent decades, many studies have focused on the bufferbloat as a latency problem. Nevertheless, none of these works investigate the impact of bufferbloat on the schedulability of the system. In this paper, we demonstrate that the bufferbloat impacts scheduling and performance isolation and identify utilizing admission control in the storage backend as an easy-to-adopt solution to mitigate bufferbloat. Moreover, we show that traditional static admission controls are inadequate in the face of dynamic workloads in cloud environments. Finally, we propose SlowFast CoDel, an adaptive admission control, as a starting point for developing adaptive admission control mechanisms to mitigate bufferbloat in cloud storage.


title: Pin(2)-equivariance of the Rarita-Schwinger-Seiberg-Witten Equations

abstract: We define a variant of the Seiberg-Witten equations using the Rarita-Schwinger operators for closed simply connected spin smooth 4-manifold X. The moduli space of solutions to the system of non-linear differential equations consist of harmonic 3/2-spinors and connections satisfying certain curvature condition. Beside having an obvious U(1)-symmetry, these equations also have a symmetry by Pin(2). We exploit this additional symmetry to perform finite dimensional approximations for the eigenvalue problem of the 3/2-monopole map and show that under a certain topological assumption, the moduli space of solutions is always non-compact, and thus non-empty.


title: A non-convex variational model for joint polyenergetic CT reconstruction, sensor denoising and material decomposition

abstract: Computed Tomography (CT) is widely used in engineering and medicine for imaging the interior of objects, patients, or animals. If the employed X-ray source is monoenergetic, image reconstruction essentially means the inversion of a ray transform. Typical X-ray sources are however polyenergetic (i.e. emit multiple wavelengths, each with different attenuation behaviour), and ignoring this fact may lead to artefacts such as beam hardening. An additional difficulty in some settings represents the occurrence of two different types of noise, the photon counting effect on the detector and the electronic noise generated e.g. by CCD cameras. We propose a novel variational image reconstruction model that takes both noise types and the polyenergetic source into account and moreover decomposes the reconstruction into different materials based on their different attenuation behaviour. In addition to a detailed mathematical analysis of the model we put forward a corresponding iterative algorithm including its convergence analysis. Numerical reconstructions of phantom data illustrate the feasibility of the approach.


title: Self-supervised Learning for Human Activity Recognition Using 700,000 Person-days of Wearable Data

abstract: Advances in deep learning for human activity recognition have been relatively limited due to the lack of large labelled datasets. In this study, we leverage self-supervised learning techniques on the UK-Biobank activity tracker dataset--the largest of its kind to date--containing more than 700,000 person-days of unlabelled wearable sensor data. Our resulting activity recognition model consistently outperformed strong baselines across seven benchmark datasets, with an F1 relative improvement of 2.5%-100% (median 18.4%), the largest improvements occurring in the smaller datasets. In contrast to previous studies, our results generalise across external datasets, devices, and environments. Our open-source model will help researchers and developers to build customisable and generalisable activity classifiers with high performance.


title: Regional Constellation Reconfiguration Problem: Integer Linear Programming Formulation and Lagrangian Heuristic Method

abstract: A group of satellites, with either homogeneous or heterogeneous orbital characteristics and/or hardware specifications, can undertake a reconfiguration process due to variations in operations pertaining to Earth observation missions. This paper investigates the problem of optimizing a satellite constellation reconfiguration process against two competing mission objectives: (i) the maximization of the total coverage reward and (ii) the minimization of the total cost of the transfer. The decision variables for the reconfiguration process include the design of the new configuration and the assignment of satellites from one configuration to another. We present a novel bi-objective integer linear programming formulation that combines constellation design and transfer problems. The formulation lends itself to the use of generic mixed-integer linear programming (MILP) methods such as the branch-and-bound algorithm for the computation of provably-optimal solutions; however, these approaches become computationally prohibitive even for moderately-sized instances. In response to this challenge, this paper proposes a Lagrangian relaxation-based heuristic method that leverages the assignment problem structure embedded in the problem. The results from the computational experiments attest to the near-optimality of the Lagrangian heuristic solutions and a significant improvement in the computational runtime compared to a commercial MILP solver.


title: Inverse Boundary Value and Optimal Control Problems on Graphs: A Neural and Numerical Synthesis

abstract: A general setup for deterministic system identification problems on graphs with Dirichlet and Neumann boundary conditions is introduced. When control nodes are available along the boundary, we apply a discretize-then-optimize method to estimate an optimal control. A key piece in the present architecture is our boundary injected message passing neural network. This will produce more accurate predictions that are considerably more stable in proximity of the boundary. Also, a regularization technique based on graphical distance is introduced that helps with stabilizing the predictions at nodes far from the boundary.


title: Learning Image Representations for Content Based Image Retrieval of Radiotherapy Treatment Plans

abstract: Objective: Knowledge based planning (KBP) typically involves training an end-to-end deep learning model to predict dose distributions. However, training end-to-end methods may be associated with practical limitations due to the limited size of medical datasets that are often used. To address these limitations, we propose a content based image retrieval (CBIR) method for retrieving dose distributions of previously planned patients based on anatomical similarity. Approach: Our proposed CBIR method trains a representation model that produces latent space embeddings of a patient's anatomical information. The latent space embeddings of new patients are then compared against those of previous patients in a database for image retrieval of dose distributions. All source code for this project is available on github. Main Results: The retrieval performance of various CBIR methods is evaluated on a dataset consisting of both publicly available plans and clinical plans from our institution. This study compares various encoding methods, ranging from simple autoencoders to more recent Siamese networks like SimSiam, and the best performance was observed for the multitask Siamese network. Significance: Applying CBIR to inform subsequent treatment planning potentially addresses many limitations associated with end-to-end KBP. Our current results demonstrate that excellent image retrieval performance can be obtained through slight changes to previously developed Siamese networks. We hope to integrate CBIR into automated planning workflow in future works, potentially through methods like the MetaPlanner framework.


title: Combinatorially minimal Mori dream surfaces of general type

abstract: In this paper, we suggest a new approach to study minimal surfaces of general type with $p_g=0$ via their Cox rings, especially using the notion of combinatorially minimal Mori dream space introduced by Hausen. First, we study general properties of combinatorially minimal Mori dream surfaces. Then we discuss how to apply these ideas to the study of minimal surfaces of general type with $p_g=0$ which are very important but still mysterious objects. In our previous paper, we provided several examples of Mori dream surfaces of general type with $p_g=0$ and computed their effective cones explicitly. In this paper, we study their fibrations, explicit combinatorially minimal models and discuss singularities of the combinatorially minimal models. We also show that many minimal surfaces of general type with $p_g=0$ arise from the minimal resolutions of combinatorially minimal Mori dream surfaces.


title: Training Subset Selection for Weak Supervision

abstract: Existing weak supervision approaches use all the data covered by weak signals to train a classifier. We show both theoretically and empirically that this is not always optimal. Intuitively, there is a tradeoff between the amount of weakly-labeled data and the precision of the weak labels. We explore this tradeoff by combining pretrained data representations with the cut statistic (Muhlenbach et al., 2004) to select (hopefully) high-quality subsets of the weakly-labeled training data. Subset selection applies to any label model and classifier and is very simple to plug in to existing weak supervision pipelines, requiring just a few lines of code. We show our subset selection method improves the performance of weak supervision for a wide range of label models, classifiers, and datasets. Using less weakly-labeled data improves the accuracy of weak supervision pipelines by up to 19% (absolute) on benchmark tasks.


title: 8-bit Numerical Formats for Deep Neural Networks

abstract: Given the current trend of increasing size and complexity of machine learning architectures, it has become of critical importance to identify new approaches to improve the computational efficiency of model training. In this context, we address the advantages of floating-point over fixed-point representation, and present an in-depth study on the use of 8-bit floating-point number formats for activations, weights, and gradients for both training and inference. We explore the effect of different bit-widths for exponents and significands and different exponent biases. The experimental results demonstrate that a suitable choice of these low-precision formats enables faster training and reduced power consumption without any degradation in accuracy for a range of deep learning models for image classification and language processing.


title: Remember the Past: Distilling Datasets into Addressable Memories for Neural Networks

abstract: We propose an algorithm that compresses the critical information of a large dataset into compact addressable memories. These memories can then be recalled to quickly re-train a neural network and recover the performance (instead of storing and re-training on the full original dataset). Building upon the dataset distillation framework, we make a key observation that a shared common representation allows for more efficient and effective distillation. Concretely, we learn a set of bases (aka ``memories'') which are shared between classes and combined through learned flexible addressing functions to generate a diverse set of training examples. This leads to several benefits: 1) the size of compressed data does not necessarily grow linearly with the number of classes; 2) an overall higher compression rate with more effective distillation is achieved; and 3) more generalized queries are allowed beyond recalling the original classes. We demonstrate state-of-the-art results on the dataset distillation task across six benchmarks, including up to 16.5% and 9.7% in retained accuracy improvement when distilling CIFAR10 and CIFAR100 respectively. We then leverage our framework to perform continual learning, achieving state-of-the-art results on four benchmarks, with 23.2% accuracy improvement on MANY. The code is released on our project webpage https://github.com/princetonvisualai/RememberThePast-DatasetDistillation.


title: Quantifying the accuracy of steady states obtained from the Universal Lindblad Equation

abstract: We show that steady-state expectation values predicted by the universal Lindblad equation (ULE) are accurate up to bounded corrections that scale linearly with the effective system-bath coupling, $\Gamma$ (second order in the microscopic coupling). We also identify a near-identity, quasilocal "memory-dressing" transformation, used during the derivation of the ULE, whose inverse can be applied to achieve relative deviations of observables that generically scale to zero with $\Gamma$, even for nonequilibrium currents whose steady-state values themselves scale to zero with $\Gamma$. This result provides a solution to recently identified limitations on the accuracy of Lindblad equations, which highlighted a potential for significant relative errors in currents of conserved quantities. The transformation we identify allows for high-fidelity computation of currents in the weak-coupling regime, ensuring thermodynamic consistency and local conservation laws, while retaining the stability and physicality of a Lindblad-form master equation.


title: Nonequilibrium dynamical structure of a dilute suspension of active particles in a viscoelastic fluid

abstract: In this work, we investigate the dynamics of the number density fluctuations of a dilute suspension of active particles in a linear viscoelastic fluid. We propose a model for the frequency-dependent diffusion coefficient of the active particles, which captures the effect of rotational diffusion on the persistence of their self-propelled motion and the viscoelasticity of the medium. Using fluctuating hydrodynamics, the linearized equations for the active suspension are derived, from which we calculate its dynamic structure factor and the corresponding intermediate scattering function. For a Maxwell-type rheological model, we find an intricate dependence of these functions on the parameters that characterize the viscoelasticity of the solvent and the activity of the particles, which can significantly deviate from those of an inert suspension of passive particles and of an active suspension in a Newtonian solvent. In particular, in some regions of the parameter space we uncover the emergence of oscillations in the intermediate scattering function at certain wave numbers, which represent the hallmark of the non-equilibrium particle activity in the dynamical structure of the suspension and also encode the viscoelastic properties of the medium.


title: Two Loop Ghost free Quantisation of Wilson Loops in $\mathcal{N}=4$ supersymmetric Yang-Mills

abstract: We report a perturbative calculation of the expectation value of the infinite straight line Maldacena-Wilson loop in $\mathcal{N}=4$ supersymmetric Yang-Mills theory to order $g^6$. Thus, we extend the previous perturbative result by one order. The vacuum expectation value is reformulated in terms of a non-linear and non-local transformation, the Nicolai map, mapping the full functional measure of the interacting theory to that of a free bosonic theory. The results are twofold. The perturbative cancellations of the different contributions to the Maldacena-Wilson loop are by no means trivial and seem to resemble those of the circular Maldacena-Wilson loop at order $g^4$. Furthermore, we argue that our approach to computing quantum correlation functions is competitive with more standard diagrammatic techniques.


title: Quantum Network Tomography with Multi-party State Distribution

abstract: The fragile nature of quantum information makes it practically impossible to completely isolate a quantum state from noise under quantum channel transmissions. Quantum networks are complex systems formed by the interconnection of quantum processing devices through quantum channels. In this context, characterizing how channels introduce noise in transmitted quantum states is of paramount importance. Precise descriptions of the error distributions introduced by non-unitary quantum channels can inform quantum error correction protocols to tailor operations for the particular error model. In addition, characterizing such errors by monitoring the network with end-to-end measurements enables end-nodes to infer the status of network links. In this work, we address the end-to-end characterization of quantum channels in a quantum network by introducing the problem of Quantum Network Tomography. The solution for this problem is an estimator for the probabilities that define a Kraus decomposition for all quantum channels in the network, using measurements performed exclusively in the end-nodes. We study this problem in detail for the case of arbitrary star quantum networks with quantum channels described by a single Pauli operator, like bit-flip quantum channels. We provide solutions for such networks with polynomial sample complexity. Our solutions provide evidence that pre-shared entanglement brings advantages for estimation in terms of the identifiability of parameters.


title: Schema-Guided Event Graph Completion

abstract: We tackle a new task, event graph completion, which aims to predict missing event nodes for event graphs. Existing link prediction or graph completion methods have difficulty dealing with event graphs because they are usually designed for a single large graph such as a social network or a knowledge graph, rather than multiple small dynamic event graphs. Moreover, they can only predict missing edges rather than missing nodes. In this work, we propose to utilize event schema, a template that describes the stereotypical structure of event graphs, to address the above issues. Our schema-guided event graph completion approach first maps an instance event graph to a subgraph of the schema graph by a heuristic subgraph matching algorithm. Then it predicts whether a candidate event node in the schema graph should be added to the instantiated schema subgraph by characterizing two types of local topology of the schema graph: neighbors of the candidate node and the subgraph, and paths that connect the candidate node and the subgraph. These two modules are later combined together for the final prediction. We also propose a self-supervised strategy to construct training samples, as well as an inference algorithm that is specifically designed to complete event graphs. Extensive experimental results on four datasets demonstrate that our proposed method achieves state-of-the-art performance, with 4.3% to 19.4% absolute F1 gains over the best baseline method on the four datasets.


title: Robust quantum boomerang effect in non-Hermitian systems

abstract: Anderson localization is a general phenomenon that applies to a variety of disordered physical systems. Recently, a novel manifestation of Anderson localization for wave packets launched with a finite average velocity was proposed, the Quantum boomerang effect (QBE). This phenomenon predicts that the disorder-averaged center of mass of a particle initially moves ballistically, then makes a U-turn, and finally slowly returns to its initial position. The QBE has been predicted to take place in several Hermitian models with Anderson localization and has been experimentally observed in the paradigmatic quantum kicked rotor model. In this work, we investigate the emergence of the QBE in non-Hermitian systems and clarify the importance of symmetries of the Hamiltonian and the initial state. We generalize the analytical arguments available in the literature and show that even in the case of complex spectrum a boomerang-like behavior can appear in a non-Hermitian system. We confirm our analytical results through a careful numerical investigation of the dynamics for several non-Hermitian models. We find that non-Hermiticity leads to the breakdown of the dynamical relation, though the QBE is preserved. This work opens up new avenues for future investigations in Anderson localized systems. The models studied here may be implemented using cold atoms in optical lattices.


title: Understanding Machine Learning Practitioners' Data Documentation Perceptions, Needs, Challenges, and Desiderata

abstract: Data is central to the development and evaluation of machine learning (ML) models. However, the use of problematic or inappropriate datasets can result in harms when the resulting models are deployed. To encourage responsible AI practice through more deliberate reflection on datasets and transparency around the processes by which they are created, researchers and practitioners have begun to advocate for increased data documentation and have proposed several data documentation frameworks. However, there is little research on whether these data documentation frameworks meet the needs of ML practitioners, who both create and consume datasets. To address this gap, we set out to understand ML practitioners' data documentation perceptions, needs, challenges, and desiderata, with the goal of deriving design requirements that can inform future data documentation frameworks. We conducted a series of semi-structured interviews with 14 ML practitioners at a single large, international technology company. We had them answer a list of questions taken from datasheets for datasets (Gebru, 2021). Our findings show that current approaches to data documentation are largely ad hoc and myopic in nature. Participants expressed needs for data documentation frameworks to be adaptable to their contexts, integrated into their existing tools and workflows, and automated wherever possible. Despite the fact that data documentation frameworks are often motivated from the perspective of responsible AI, participants did not make the connection between the questions that they were asked to answer and their responsible AI implications. In addition, participants often had difficulties prioritizing the needs of dataset consumers and providing information that someone unfamiliar with their datasets might need to know. Based on these findings, we derive seven design requirements for future data documentation frameworks.


title: Anisotropic magnetic property of single crystals $R$V$_6$Sn$_6$ ($R$ = Y, Gd - Tm, Lu)

abstract: $R$V${_6}$Sn${_6}$ ($R$ = Y, Gd - Tm, Lu) single crystals are synthesized by Sn-flux method and their physical properties are characterized by magnetization, resistivity, and specific heat measurements. Powder X-ray diffraction patterns of all samples can be well indexed with the hexagonal HfFe$_6$Ge$_6$-type structure, where rare-earth atoms form hexagonal layers and vanadium atoms form Kagome layers. At high temperatures, magnetic susceptibility measurements of moment bearing rare-earths ($R$ = Gd - Tm) follow Curie-Weiss behavior. Effective moments estimated from the polycrystalline average of magnetic susceptibility curves are consistent with the values for free $R^{3+}$ ion. Strong magnetic anisotropy due to crystalline electric field effects is observed for moment bearing rare-earths, except GdV$_6$Sn$_6$. The easy magnetization direction is determined to be $c$-axis for $R$ = Tb - Ho and $ab$-plane for $R$ = Er, and Tm. The vanadium ions in $R$V${_6}$Sn${_6}$ possess no magnetic moment. The compounds for $R$ = Y and Lu exhibit typical characteristics of paramagnetic metals. At low temperatures, the magnetic ordering is confirmed from magnetization, specific heat, and resistivity: the highest $T_{N} = 4.9$~K for GdV$_6$Sn$_6$ and the lowest $T_{N} = 2.3$~K for HoV$_6$Sn$_6$. No magnetic ordering is observed down to 1.8~K for $R$ = Er and Tm. A slight deviation of the magnetic ordering temperature from the de Gennes scaling suggests the dominant Ruderman-Kittel-Kasuya-Yosida (RKKY) exchange interaction between rare-earth moments in metallic $R$V${_6}$Sn${_6}$ compounds.


title: Tight basis cycle representatives for persistent homology of large data sets

abstract: Persistent homology (PH) is a popular tool for topological data analysis that has found applications across diverse areas of research. It provides a rigorous method to compute robust topological features in discrete experimental observations that often contain various sources of uncertainties. Although powerful in theory, PH suffers from high computation cost that precludes its application to large data sets. Additionally, most analyses using PH are limited to computing the existence of nontrivial features. Precise localization of these features is not generally attempted because, by definition, localized representations are not unique and because of even higher computation cost. For scientific applications, such a precise location is a sine qua non for determining functional significance. Here, we provide a strategy and algorithms to compute tight representative boundaries around nontrivial robust features in large data sets. To showcase the efficiency of our algorithms and the precision of computed boundaries, we analyze three data sets from different scientific fields. In the human genome, we found an unexpected effect on loops through chromosome 13 and the sex chromosomes, upon impairment of chromatin loop formation. In a distribution of galaxies in the universe, we found statistically significant voids. In protein homologs with significantly different topology, we found voids attributable to ligand-interaction, mutation, and differences between species.


title: A theory of composites perspective on matrix valued Stieltjes functions

abstract: A series of physically motivated operations appearing in the study of composite materials are interpreted in terms of elementary continued fraction transforms of matrix valued, rational Stieltjes functions.


title: Spectral Bias Outside the Training Set for Deep Networks in the Kernel Regime

abstract: We provide quantitative bounds measuring the $L^2$ difference in function space between the trajectory of a finite-width network trained on finitely many samples from the idealized kernel dynamics of infinite width and infinite data. An implication of the bounds is that the network is biased to learn the top eigenfunctions of the Neural Tangent Kernel not just on the training set but over the entire input space. This bias depends on the model architecture and input distribution alone and thus does not depend on the target function which does not need to be in the RKHS of the kernel. The result is valid for deep architectures with fully connected, convolutional, and residual layers. Furthermore the width does not need to grow polynomially with the number of samples in order to obtain high probability bounds up to a stopping time. The proof exploits the low-effective-rank property of the Fisher Information Matrix at initialization, which implies a low effective dimension of the model (far smaller than the number of parameters). We conclude that local capacity control from the low effective rank of the Fisher Information Matrix is still underexplored theoretically.


title: Neuro-Symbolic Procedural Planning with Commonsense Prompting

abstract: Procedural planning aims to implement complex high-level goals by decomposition into sequential simpler low-level steps. Although procedural planning is a basic skill set for humans in daily life, it remains a challenge for large language models (LLMs) that lack a deep understanding of the cause-effect relations in procedures. Previous methods require manual exemplars to acquire procedural planning knowledge from LLMs in the zero-shot setting. However, such elicited pre-trained knowledge in LLMs induces spurious correlations between goals and steps, which impair the model generalization to unseen tasks. In contrast, this paper proposes a neuro-symbolic procedural PLANner (PLAN) that elicits procedural planning knowledge from the LLMs with commonsense-infused prompting. To mitigate spurious goal-step correlations, we use symbolic program executors on the latent procedural representations to formalize prompts from commonsense knowledge bases as a causal intervention toward the Structural Causal Model. Both automatic and human evaluations on WikiHow and RobotHow show the superiority of PLAN on procedural planning without further training or manual exemplars.


title: $\mathcal{L}_2$-optimal Reduced-order Modeling Using Parameter-separable Forms

abstract: We provide a unifying framework for $\mathcal{L}_2$-optimal reduced-order modeling for linear time-invariant dynamical systems and stationary parametric problems. Using parameter-separable forms of the reduced-model quantities, we derive the gradients of the $\mathcal{L}_2$ cost function with respect to the reduced matrices, which then allows a non-intrusive, data-driven, gradient-based descent algorithm to construct the optimal approximant using only output samples. By choosing an appropriate measure, the framework covers both continuous (Lebesgue) and discrete cost functions. We show the efficacy of the proposed algorithm via various numerical examples. Furthermore, we analyze under what conditions the data-driven approximant can be obtained via projection.

categories: math.NA cs.CE cs.NA cs.SY eess.SY math.OC


title: Predicting Electricity Infrastructure Induced Wildfire Risk in California

abstract: This paper examines the use of risk models to predict the timing and location of wildfires caused by electricity infrastructure. Our data include historical ignition and wire-down points triggered by grid infrastructure collected between 2015 to 2019 in Pacific Gas & Electricity territory along with various weather, vegetation, and very high resolution data on grid infrastructure including location, age, materials. With these data we explore a range of machine learning methods and strategies to manage training data imbalance. The best area under the receiver operating characteristic we obtain is 0.776 for distribution feeder ignitions and 0.824 for transmission line wire-down events, both using the histogram-based gradient boosting tree algorithm (HGB) with under-sampling. We then use these models to identify which information provides the most predictive value. After line length, we find that weather and vegetation features dominate the list of top important features for ignition or wire-down risk. Distribution ignition models show more dependence on slow-varying vegetation variables such as burn index, energy release content, and tree height, whereas transmission wire-down models rely more on primary weather variables such as wind speed and precipitation. These results point to the importance of improved vegetation modeling for feeder ignition risk models, and improved weather forecasting for transmission wire-down models. We observe that infrastructure features make small but meaningful improvements to risk model predictive power.


title: On the motion of a nearly incompressible viscous fluid containing a small rigid body

abstract: We consider the motion of a compressible viscous fluid containing a moving rigid body confined to a planar domain $\Omega \subset R^2$. The main result states that the influence of the body on the fluid is negligible if (i) the diameter of the body is small and (ii) the fluid is nearly incompressible (the low Mach number regime). The specific shape of the body as well as the boundary conditions on the fluid--body interface are irrelevant and collisions with the boundary $\partial \Omega$ are allowed. The rigid body motion may be enforced externally or governed solely by its interaction with the fluid.


title: Symbolic Knowledge Structures and Intuitive Knowledge Structures

abstract: This paper proposes that two distinct types of structures are present in the brain: Symbolic Knowledge Structures (SKSs), used for formal symbolic reasoning, and Intuitive Knowledge Structures (IKSs), used for drawing informal associations. The paper contains ideas for modeling and analyzing these structures in an algorithmic style based on Spiking Neural Networks, following the paradigm used in earlier work by Lynch, Musco, Parter, and co-workers. The paper also contains two examples of use of these structures, involving counting through a memorized sequence, and understanding simple stylized sentences. The ideas presented here are preliminary and speculative, and do not (yet) comprise a complete, coherent, algorithmic theory. I hope that posting this preliminary version will help the ideas to evolve into such a theory.


title: Apodizer Design to Efficiently Couple Light into a Fiber Bragg Grating

abstract: We provide an optimal control framework for efficiently coupling light in a bare fiber into Bragg gratings with a cubic nonlinearity. The light-grating interaction excites gap solitons, a type of localized nonlinear coherent state which propagates with a central frequency in the forbidden band gap, resulting in a dramatically slower group velocity. Due to the nature of the band gap, a substantial amount of light is back-reflected by the grating's strong reflective properties. We optimize, via a projected gradient descent method, the transmission efficiency of previously designed nonuniform grating structures in order to couple more slow light into the grating. We further explore the space of possible grating designs, using genetic algorithms, along with a previously unexplored design parameter: the grating chirp. Through these methods, we find structures that couple a greater fraction of light into the grating with the added bonus of creating slower pulses.


title: Quantum information spreading in random spin chains

abstract: We study the spreading of quantum correlations and information in a one-dimensional quantum spin chain with critical disorder as encoded in an infinite randomness fixed point. Specifically, we focus on the dynamics after a quantum quench of the R\'enyi entropies, of the mutual information and of the entanglement negativity in the prototypical XXZ spin chain with random bonds and anisotropy parameters. We provide analytic predictions in the scaling regime based on real-space renormalization group methods. We support these findings through numerical simulations in the non-interacting limit, where we can access the scaling regime.

categories: cond-mat.stat-mech cond-mat.dis-nn cond-mat.str-el quant-ph


title: Delta baryons in neutron stars

abstract: By applying a relativistic mean-field description of neutron star matter with density dependent couplings, we analyse the properties of two different matter compositions: nucleonic matter with delta baryons and nucleonic matter with hyperons and delta baryons. The delta-meson couplings are allowed to vary within a wide range of values obtained by experimental data, while the hyperon-meson couplings are fitted to hypernuclear properties. Neutron star properties with no deconfinement phase transition are studied. It is verified that many models are excluded because the effective nucleon mass becomes zero before the maximum mass configuration is attained. Hyperon-free with delta-dominated composition compact stars are possible, the deltic stars. It is found that with a convenient choice of parameters the existence of deltic stars with 80% of delta baryons at the center of the star is possible. However, the presence of hyperons lowers the delta baryon fraction to values below 20% at the center and below 30% at 2-3 saturation densities. It is discussed that in the presence of delta baryons, the hyperon softening is not so drastic because deltas couple more strongly to the $\omega$-meson, and the stiffness of the equation of state is determined by the $\omega$-dominance at high densities. The speed of sound reflects very well this behavior. The compactness of the pulsar RX J0720.4-3125 imposes $x_{\sigma\Delta}>x_{\omega\Delta}>1$ and favors $x_{\rho\Delta}>1$.


title: Bounds for Kirby-Thompson invariants of knotted surfaces

abstract: We provide sharp lower bounds for two versions of the Kirby-Thompson invariants for knotted surfaces, one of which was originally defined by Blair, Campisi, Taylor, and Tomova. The second version introduced in this paper measures distances in the dual curve complex instead of the pants complex. We compute the exact values of both KT-invariants for infinitely many knotted surfaces with bridge number at most six.


title: Machine Learning-based models in particle-in-cell codes for advanced physics extensions

abstract: In this paper we propose a methodology for the efficient implementation of Machine Learning (ML)-based methods in particle-in-cell (PIC) codes, with a focus on Monte-Carlo or statistical extensions to the PIC algorithm. The presented approach allows for neural networks to be developed in a Python environment, where advanced ML tools are readily available to proficiently train and test them. Those models are then efficiently deployed within highly-scalable and fully parallelized PIC simulations during runtime. We demonstrate this methodology with a proof-of-concept implementation within the PIC code OSIRIS, where a fully-connected neural network is used to replace a section of a Compton scattering module. We demonstrate that the ML-based method reproduces the results obtained with the conventional method and achieves better computational performance. These results offer a promising avenue for future applications of ML-based methods in PIC, particularly for physics extensions where an ML-based approach can provide a higher performance increase.


title: Unstable minimal surfaces in $\mathbb{R}^n$ and in products of hyperbolic surfaces

abstract: We prove that every unstable equivariant minimal surface in $\mathbb{R}^n$ produces a maximal representation of a surface group into $\prod_{i=1}^n\textrm{PSL}(2,\mathbb{R})$ together with an unstable minimal surface in the corresponding product of closed hyperbolic surfaces. To do so, we lift the surface in $\mathbb{R}^n$ to a surface in a product of $\mathbb{R}$-trees, then deform to a surface in a product of closed hyperbolic surfaces. We show that instability in one context implies instability in the other two.


title: A Centraliser Analogue to the Farahat-Higman Algebra

abstract: We define a family of algebras \mathsf{FH}_{m} which generalise the Farahat-Higman algebra introduced in [FH59] by replacing the role of the center of the group algebra of the symmetric groups with centraliser algebras of symmetric groups. These algebras have a basis indexed by marked cycle shapes, combinatorial objects which generalise proper integer partitions. We analyse properties of marked cycle shapes and of the algebras \mathsf{FH}_{m}, demonstrating that some of the former govern the latter. The main theorem of the paper proves that the algebra \mathsf{FH}_{m} is isomorphic to the tensor product of the degenerate affine Hecke algebra with the algebra of symmetric functions.


title: On the Running Time of Hypergraph Bootstrap Percolation

abstract: Given $r\geq2$ and an $r$-uniform hypergraph $F$, the $F$-bootstrap process starts with an $r$-uniform hypergraph $H$ and, in each time step, every hyperedge which "completes" a copy of $F$ is added to $H$. The maximum running time of this process has been recently studied in the case that $r=2$ and $F$ is a complete graph by Bollob\'as, Przykucki, Riordan and Sahasrabudhe [Electron. J. Combin. 24(2) (2017), Paper No. 2.16], Matzke [arXiv:1510.06156v2] and Balogh, Kronenberg, Pokrovskiy and Szab\'o [arXiv:1907.04559v1]. We consider the case that $r\geq3$ and $F$ is the complete $r$-uniform hypergraph on $k$ vertices. Our main results are that the maximum running time is $\Theta\left(n^r\right)$ if $k\geq r+2$ and $\Omega\left(n^{r-1}\right)$ if $k=r+1$. For the case $k=r+1$, we conjecture that our lower bound is optimal up to a constant factor when $r=3$, but suspect that it can be improved by more than a constant factor for large $r$.


title: Gravitational corrections to a non-Abelian gauge theory

abstract: This paper is part of a series of papers exploring the renormalization of field theories coupled to gravity using the effective field theory framework. In previous works we studied the universality of the electric charge and the two-loops beta function in the Einstein-QED system. Now, we use this framework to study the non-Abelian gauge theory with fermions coupled to gravity. We show that even though some of the counterterms are dependent on the gravitational coupling, the renormalized coupling constant, and therefore the beta function, do not receive any gravitational correction at one-loop order. Also, we explicitly show that, at this order, the Slavnov-Taylor identities are respected. Finally, we end the paper putting into perspective the results of the present and the past papers.


title: Study of three-flavored heavy dibaryons using lattice QCD

abstract: We present results of the first lattice QCD calculation of three-flavored heavy dibaryons both in the flavor-symmetric and antisymmetric channels. These dibaryons have spin zero, and are constructed using various possible combinations of quark flavors with at least one of them as the charm or the bottom quark, i.e., namely, $H_c(cudcud), H_b(budbud), H_{bcs}(bcsbcs)$, $H_{csl}(cslcsl), H_{bsl}(bslbsl)$ and $H_{bcl}(bclbcl)$; $l\in u,d$. We compute the ground state masses of these dibaryons and the calculations are performed on three $N_f=2+1+1$ HISQ gauge ensembles of the MILC collaboration, with lattice spacings $a =$ 0.1207, 0.0888 and 0.0582 fm. A relativistic overlap action is employed for the valence light to charm quarks while a non-relativistic-QCD Hamiltonian with improved coefficients is used for the bottom quarks. Unlike the doubly heavy tetraquarks, one and two-flavored heavy dibaryons, for which lattice QCD calculations have predicted deeply bound strong-interactions-stable states, for these $H_c, H_b, H_{csl},H_{bsl}$ dibaryons we do not find any such deeply bound state. However, for $H_{bcs}$, our results indicate the presence of an energy level $29\pm 24$ MeV below the lowest two-baryon threshold, which could be relevant for its future experimental searches. Moreover, we find that the energy difference between the ground state of $H_{bcl}$ and its lowest threshold increases when $m_l>m_s$. Taken together, our findings indicate the possibility of the existence of the $H_{bcs}$ dibaryon while all other physical three-flavored dibaryons are much closer to their thresholds suggesting either they are weakly bound or unbound, resolving which requires further detail study. Our results also point that the binding of a dibaryon configuration becomes stronger with the increase of its valence quark masses which suggests an interesting aspect of strong interactions at multiple scales.


title: Anomalous Transport Properties of Re$_3$Ge$_7$

abstract: Single crystals of intermetallic Re$_3$Ge$_7$ were grown and characterized by measuring magnetization, electrical resistivity, Hall coefficient, and specific heat. Magnetization measurements show the material is weakly diamagnetic. A phase transition is indicated by a kink in magnetic susceptibility at $T_{c} = 58.5$K and is confirmed by a $\lambda$-like anomaly in specific heat. In zero-field, the temperature dependence of electrical resistivity $\rho(T)$ follows a typical metallic behavior above $T_c$ and sharply increases below $T_c$, showing a metal-to-insulator-like transition. When a magnetic field is applied, strong effects on the transport properties are observed. The temperature dependence of magnetoresistivity $\Delta\rho$ = $\rho (T, H)$ - $\rho (T, H=0)$ develops a maximum around 30 K, deviating from ordinary metallic behavior. Analysis of the Hall coefficient measurements indicates that the carrier density is 0.04 per formula unit at 300 K and drops by two orders of magnitude below $T_c$. The effective mass of charge carriers is inferred from the analysis of the Shubnikov-de Haas quantum oscillations to be close to the bare electron mass.


title: Maximal ideals of generalized summing linear operators

abstract: We prove when a Banach ideal of linear operators defined, or characterized, by the transformation of vector-valued sequences is maximal. Known results are recovered as particular cases and new information is obtained. To accomplish this task we study a tensor quasi-norm determined by the underlying sequence classes. The duality theory for these tensor quasi-norms is also developed.


title: Entanglement and the Path Integral

abstract: The path integral is not typically utilized for analyzing entanglement experiments, in part because there is no standard toolbox for converting an arbitrary experiment into a form allowing a simple sum-over-history calculation. After completing the last portion of this toolbox (a technique for implementing multi-particle measurements in an entangled basis), some interesting 4- and 6-particle experiments are analyzed with this alternate technique. While the joint probabilities of measurement outcomes are always equivalent to conventional quantum mechanics, differences in the calculations motivate a number of foundational insights, concerning nonlocality, retrocausality, and the objectivity of entanglement itself.


title: On the Convergence of Optimizing Persistent-Homology-Based Losses

abstract: Topological loss based on persistent homology has shown promise in various applications. A topological loss enforces the model to achieve certain desired topological property. Despite its empirical success, less is known about the optimization behavior of the loss. In fact, the topological loss involves combinatorial configurations that may oscillate during optimization. In this paper, we introduce a general purpose regularized topology-aware loss. We propose a novel regularization term and also modify existing topological loss. These contributions lead to a new loss function that not only enforces the model to have desired topological behavior, but also achieves satisfying convergence behavior. Our main theoretical result guarantees that the loss can be optimized efficiently, under mild assumptions.


title: Discovery of three new near-pristine absorption clouds at $z=2.6$-4.4

abstract: We report the discovery of three new "near-pristine" Lyman Limit Systems (LLSs), with metallicities ~1/1000 solar, at redshifts 2.6, 3.8 and 4.0, with a targeted survey at the Keck Observatory. High resolution echelle spectra of eight candidates yielded precise column densities of hydrogen and weak, but clearly detected, metal lines in seven LLSs; we previously reported the one remaining, apparently metal-free LLS, to have metallicity <1/10000 solar. Robust photoionisation modelling provides metallicities [Si/H] = -3.05 to -2.94, with 0.26 dex uncertainties (95% confidence) for three LLSs, and [Si/H] >~ -2.5 for the remaining four. Previous simulations suggest that near-pristine LLSs could be the remnants of PopIII supernovae, so comparing their detailed metal abundances with nucleosynthetic yields from supernovae models is an important goal. Unfortunately, at most two different metals were detected in each new system, despite their neutral hydrogen column densities (10^{19.2-19.4} cm^{-2}) being two orders of magnitude larger than the two previous, serendipitously discovered near-pristine LLSs. Nevertheless, the success of this first targeted survey for near-pristine systems demonstrates the prospect that a much larger, future survey could identify clear observational signatures of PopIII stars. With a well-understood selection function, such a survey would also yield the number density of near-pristine absorbers which, via comparison to future simulations, could reveal the origin(s) of these rare systems.


title: Simple Mechanisms for Welfare Maximization in Rich Advertising Auctions

abstract: Internet ad auctions have evolved from a few lines of text to richer informational layouts that include images, sitelinks, videos, etc. Ads in these new formats occupy varying amounts of space, and an advertiser can provide multiple formats, only one of which can be shown. The seller is now faced with a multi-parameter mechanism design problem. Computing an efficient allocation is computationally intractable, and therefore the standard Vickrey-Clarke-Groves (VCG) auction, while truthful and welfare-optimal, is impractical. In this paper, we tackle a fundamental problem in the design of modern ad auctions. We adopt a ``Myersonian'' approach and study allocation rules that are monotone both in the bid and set of rich ads. We show that such rules can be paired with a payment function to give a truthful auction. Our main technical challenge is designing a monotone rule that yields a good approximation to the optimal welfare. Monotonicity doesn't hold for standard algorithms, e.g. the incremental bang-per-buck order, that give good approximations to ``knapsack-like'' problems such as ours. In fact, we show that no deterministic monotone rule can approximate the optimal welfare within a factor better than $2$ (while there is a non-monotone FPTAS). Our main result is a new, simple, greedy and monotone allocation rule that guarantees a $3$ approximation. In ad auctions in practice, monotone allocation rules are often paired with the so-called Generalized Second Price (GSP) payment rule, which charges the minimum threshold price below which the allocation changes. We prove that, even though our monotone allocation rule paired with GSP is not truthful, its Price of Anarchy (PoA) is bounded. Under standard no overbidding assumption, we prove a pure PoA bound of $6$ and a Bayes-Nash PoA bound of $\frac{6}{(1 - \frac{1}{e})}$. Finally, we experimentally test our algorithms on real-world data.


title: Revealing the Nature of a Lyman-$\alpha$ Halo in a Strongly Lensed Interacting System at $z=2.92$

abstract: Spatially extended halos of H I Ly$\alpha$ emission are now ubiquitously found around high-redshift star-forming galaxies. But our understanding of the nature and powering mechanisms of these halos is still hampered by the complex radiative transfer effects of the Ly$\alpha$ line and limited angular resolution. In this paper, we present resolved Multi Unit Spectroscopic Explorer (MUSE) observations of SGAS J122651.3+215220, a strongly-lensed pair of $L^{*}$ galaxies at $z=2.92$ embedded in a Ly$\alpha$ halo of $L_{Ly\alpha}=(6.2\pm1.3)\times10^{42}$ erg s$^{-1}$. Globally, the system shows a line profile that is markedly asymmetric and redshifted, but its width and peak shift vary significantly across the halo. By fitting the spatially binned Ly$\alpha$ spectra with a collection of radiative transfer galactic wind models, we infer a mean outflow expansion velocity of $\approx 211$ km s$^{-1}$, with higher values preferentially found on both sides of the system's major axis. The velocity of the outflow is validated with the blueshift of low-ionization metal absorption lines in the spectra of the central galaxies. We also identify a faint ($M_{1500} \approx -16.7$) companion detected in both Ly$\alpha$ and the continuum, whose properties are in agreement with a predicted population of satellite galaxies that contribute to the extended Ly$\alpha$ emission. Finally, we briefly discuss the impact of the interaction between the central galaxies on the properties of the halo and the possibility of in situ fluorescent Ly$\alpha$ production.


title: A Continuum Approach for Collaborative Task Processing in UAV MEC Networks

abstract: Unmanned aerial vehicles (UAVs) are becoming a viable platform for sensing and estimation in a wide variety of applications including disaster response, search and rescue, and security monitoring. These sensing UAVs have limited battery and computational capabilities, and thus must offload their data so it can be processed to provide actionable intelligence. We consider a compute platform consisting of a limited number of highly-resourced UAVs that act as mobile edge computing (MEC) servers to process the workload on premises. We propose a novel distributed solution to the collaborative processing problem that adaptively positions the MEC UAVs in response to the changing workload that arises both from the sensing UAVs' mobility and the task generation. Our solution consists of two key building blocks: (1) an efficient workload estimation process by which the UAVs estimate the task field - a continuous approximation of the number of tasks to be processed at each location in the airspace, and (2) a distributed optimization method by which the UAVs partition the task field so as to maximize the system throughput. We evaluate our proposed solution using realistic models of surveillance UAV mobility and show that our method achieves up to 28% improvement in throughput over a non-adaptive baseline approach.


title: A semi-conjugate gradient method for solving unsymmetric positive definite linear systems

abstract: The conjugate gradient (CG) method is a classic Krylov subspace method for solving symmetric positive definite linear systems. We introduce an analogous semi-conjugate gradient (SCG) method for unsymmetric positive definite linear systems. Unlike CG, SCG requires the solution of a lower triangular linear system to produce each semi-conjugate direction. We prove that SCG is theoretically equivalent to the full orthogonalization method (FOM), which is based on the Arnoldi process and converges in a finite number of steps. Because SCG's triangular system increases in size each iteration, we study a sliding window implementation (SWI) to improve efficiency, and show that the directions produced are still locally semi-conjugate. A counterexample illustrates that SWI is different from the direct incomplete orthogonalization method (DIOM), which is FOM with a sliding window. Numerical experiments from the convection-diffusion equation and other applications show that SCG is robust and that the sliding window implementation SWI allows SCG to solve large systems efficiently.


title: Beyond The Fermi's Golden Rule: Discrete-Time Decoherence Of Quantum Mesoscopic Devices Due To Bandlimited Quantum Noise

abstract: We are at the midst of second quantum revolution where the mesoscopic quantum devies are actively employed for technological purposes. Despite this fact, the description of their real-time dynamics beyond the Fermi's golden rule remains a formiddable theoretical problem. This is due to the rapid spread of entanglement within the degrees of freedom of the surrounding environment. This is accompanied with a quantum noise (QN) acting on the mesoscopic device. In this work we propose a possible way out: to exploit the fact that this QN is usually bandlimited. This is because its spectral density is often contained in peaks of localized modes and resonances, and may be constrained by bandgaps. Inspired by the Kotelnikov sampling theorem from the theory of classical bandlimited signals, we put forward and explore the idea that when the QN spectral density has effective bandwidth $B$, the quantum noise becomes a discrete-time process, with an elementary time step $\tau\propto B^{-1}$. After each time step $\tau$, one new QN degree of freedom (DoF) gets coupled to the device for the first time, and one new QN DoF get irreversibly decoupled. Only a bounded number of QN DoFs are significantly coupled at any time moment. We call these DoFs the \textit{Kotelnikov modes}. As a result, the real-time dissipative quantum motion has a natural structure of a discrete-time matrix product state, with a bounded bond dimension. This yields a microscopically derived collision model. The temporal entanglement entropy appears to be bounded (area-law scaling) in the frame of Kotelnikov modes. The irreversibly decoupled modes can be traced out as soon as they occur during the real-time evolution. This leads to a novel\textit{bandlimited} input-output formalism and to quantum jump Monte Carlo simulation techniques for real-time motion of open quantum systems. We illustrate this idea on a spin-boson model.


title: Sampling without Replacement Leads to Faster Rates in Finite-Sum Minimax Optimization

abstract: We analyze the convergence rates of stochastic gradient algorithms for smooth finite-sum minimax optimization and show that, for many such algorithms, sampling the data points without replacement leads to faster convergence compared to sampling with replacement. For the smooth and strongly convex-strongly concave setting, we consider gradient descent ascent and the proximal point method, and present a unified analysis of two popular without-replacement sampling strategies, namely Random Reshuffling (RR), which shuffles the data every epoch, and Single Shuffling or Shuffle Once (SO), which shuffles only at the beginning. We obtain tight convergence rates for RR and SO and demonstrate that these strategies lead to faster convergence than uniform sampling. Moving beyond convexity, we obtain similar results for smooth nonconvex-nonconcave objectives satisfying a two-sided Polyak-{\L}ojasiewicz inequality. Finally, we demonstrate that our techniques are general enough to analyze the effect of data-ordering attacks, where an adversary manipulates the order in which data points are supplied to the optimizer. Our analysis also recovers tight rates for the incremental gradient method, where the data points are not shuffled at all.


title: Median Regularity and Honest Inference

abstract: We introduce a new notion of regularity of an estimator called median regularity. We prove that uniformly valid (honest) inference for a functional is possible if and only if there exists a median regular estimator of that functional. To our knowledge, such a notion of regularity that is necessary for uniformly valid inference is unavailable in the literature.


title: Effects of spatial nonlocality versus nonlocal causality for bound electrons in external fields

abstract: Using numerically exact solution of the time-dependent Schroedinger equation together with time-dependent quantum Monte Carlo (TDQMC) calculations we compare the effects of spatial nonlocality versus nonlocal causality for the ground state and for real-time evolution of two entangled electrons in parabolic potential in one spatial dimension. It was found that the spatial entanglement quantified by the linear quantum entropy is predicted with good accuracy using the spatial nonlocality, parameterized naturally within the TDQMC approach. At the same time, the nonlocal causality predicted by the exact solution leads to only small oscillations in the quantum trajectories which belong to the idler electron as the driven electron is subjected to a strong high frequency electric field, without interaction between the electrons.


title: Robust Time Series Dissimilarity Measure for Outlier Detection and Periodicity Detection

abstract: Dynamic time warping (DTW) is an effective dissimilarity measure in many time series applications. Despite its popularity, it is prone to noises and outliers, which leads to singularity problem and bias in the measurement. The time complexity of DTW is quadratic to the length of time series, making it inapplicable in real-time applications. In this paper, we propose a novel time series dissimilarity measure named RobustDTW to reduce the effects of noises and outliers. Specifically, the RobustDTW estimates the trend and optimizes the time warp in an alternating manner by utilizing our designed temporal graph trend filtering. To improve efficiency, we propose a multi-level framework that estimates the trend and the warp function at a lower resolution, and then repeatedly refines them at a higher resolution. Based on the proposed RobustDTW, we further extend it to periodicity detection and outlier time series detection. Experiments on real-world datasets demonstrate the superior performance of RobustDTW compared to DTW variants in both outlier time series detection and periodicity detection.


title: GRETEL: A unified framework for Graph Counterfactual Explanation Evaluation

abstract: Machine Learning (ML) systems are a building part of the modern tools which impact our daily life in several application domains. Due to their black-box nature, those systems are hardly adopted in application domains (e.g. health, finance) where understanding the decision process is of paramount importance. Explanation methods were developed to explain how the ML model has taken a specific decision for a given case/instance. Graph Counterfactual Explanations (GCE) is one of the explanation techniques adopted in the Graph Learning domain. The existing works of Graph Counterfactual Explanations diverge mostly in the problem definition, application domain, test data, and evaluation metrics, and most existing works do not compare exhaustively against other counterfactual explanation techniques present in the literature. We present GRETEL, a unified framework to develop and test GCE methods in several settings. GRETEL is a highly extensible evaluation framework which promotes the Open Science and the evaluations reproducibility by providing a set of well-defined mechanisms to integrate and manage easily: both real and synthetic datasets, ML models, state-of-the-art explanation techniques, and evaluation measures. To present GRETEL, we show the experiments conducted to integrate and test several synthetic and real datasets with several existing explanation techniques and base ML models.


title: Saliency Cards: A Framework to Characterize and Compare Saliency Methods

abstract: Saliency methods are a common class of machine learning interpretability techniques that calculate how important each input feature is to a model's output. We find that, with the rapid pace of development, users struggle to stay informed of the strengths and limitations of new methods and, thus, choose methods for unprincipled reasons (e.g., popularity). Moreover, despite a corresponding rise in evaluation metrics, existing approaches assume universal desiderata for saliency methods (e.g., faithfulness) that do not account for diverse user needs. In response, we introduce saliency cards: structured documentation of how saliency methods operate and their performance across a battery of evaluative metrics. Through a review of 25 saliency method papers and 33 method evaluations, we identify 10 attributes that users should account for when choosing a method. We group these attributes into three categories that span the process of computing and interpreting saliency: methodology, or how the saliency is calculated; sensitivity, or the relationship between the saliency and the underlying model and data; and, perceptibility, or how an end user ultimately interprets the result. By collating this information, saliency cards allow users to more holistically assess and compare the implications of different methods. Through nine semi-structured interviews with users from various backgrounds, including researchers, radiologists, and computational biologists, we find that saliency cards provide a detailed vocabulary for discussing individual methods and allow for a more systematic selection of task-appropriate methods. Moreover, with saliency cards, we are able to analyze the research landscape in a more structured fashion to identify opportunities for new methods and evaluation metrics for unmet user needs.


title: HMRNet: High and Multi-Resolution Network with Bidirectional Feature Calibration for Brain Structure Segmentation in Radiotherapy

abstract: Accurate segmentation of Anatomical brain Barriers to Cancer spread (ABCs) plays an important role for automatic delineation of Clinical Target Volume (CTV) of brain tumors in radiotherapy. Despite that variants of U-Net are state-of-the-art segmentation models, they have limited performance when dealing with ABCs structures with various shapes and sizes, especially thin structures (e.g., the falx cerebri) that span only few slices. To deal with this problem, we propose a High and Multi-Resolution Network (HMRNet) that consists of a multi-scale feature learning branch and a high-resolution branch, which can maintain the high-resolution contextual information and extract more robust representations of anatomical structures with various scales. We further design a Bidirectional Feature Calibration (BFC) block to enable the two branches to generate spatial attention maps for mutual feature calibration. Considering the different sizes and positions of ABCs structures, our network was applied after a rough localization of each structure to obtain fine segmentation results. Experiments on the MICCAI 2020 ABCs challenge dataset showed that: 1) Our proposed two-stage segmentation strategy largely outperformed methods segmenting all the structures in just one stage; 2) The proposed HMRNet with two branches can maintain high-resolution representations and is effective to improve the performance on thin structures; 3) The proposed BFC block outperformed existing attention methods using monodirectional feature calibration. Our method won the second place of ABCs 2020 challenge and has a potential for more accurate and reasonable delineation of CTV of brain tumors.