title: Learning the Space of Deep Models

abstract: Embedding of large but redundant data, such as images or text, in a hierarchy of lower-dimensional spaces is one of the key features of representation learning approaches, which nowadays provide state-of-the-art solutions to problems once believed hard or impossible to solve. In this work, in a plot twist with a strong meta aftertaste, we show how trained deep models are as redundant as the data they are optimized to process, and how it is therefore possible to use deep learning models to embed deep learning models. In particular, we show that it is possible to use representation learning to learn a fixed-size, low-dimensional embedding space of trained deep models and that such space can be explored by interpolation or optimization to attain ready-to-use models. We find that it is possible to learn an embedding space of multiple instances of the same architecture and of multiple architectures. We address image classification and neural representation of signals, showing how our embedding space can be learnt so as to capture the notions of performance and 3D shape, respectively. In the Multi-Architecture setting we also show how an embedding trained only on a subset of architectures can learn to generate already-trained instances of architectures it never sees instantiated at training time.


title: Nominal Metaphor Generation with Multitask Learning

abstract: Metaphor generation is a challenging task which can impact many downstream tasks such as improving user satisfaction with dialogue systems and story generation. This paper tackles the problem of Chinese nominal metaphor generation by introducing a multitask metaphor generation framework with self-training and metaphor identification mechanisms. Self-training addresses the data scarcity issue of metaphor datasets. That is, instead of solely relying on labelled metaphor datasets which are usually small in size, self-training helps identify potential metaphors from a large-scale unlabelled corpus for metaphor generation. The metaphor weighting mechanism enables our model to focus on the metaphor-related parts of the input (e.g., the comparison of the metaphor and comparator) during model learning and thus improves the metaphoricity of the generated metaphors. Our model is trained on an annotated corpus consisting of 6.3k sentences that contain diverse metaphorical expressions. Experimental results show that our model is able to generate metaphors with better readability and creativity compared to the baseline models, even in the situation where training data is insufficient.


title: Magnetic moments of the vector hidden-charmed tetraquark states

abstract: The magnetic moments of the vector hidden-charmed tetraquark states that have been observed and can be expected to be observed experimentally have been determined using the light-cone sum rules taking into account the diquark-antidiquark structure with the quantum numbers $ J^{PC} = 1^{--}$ and $ J^{PC} = 1^{-+}$. Since these states are considered to have different flavors of light quarks, they have nonzero magnetic moments. The results obtained in this study can be checked for consistency by various methods. The magnetic moments of hadrons encompass useful knowledge about the distribution of charge and magnetization inside hadrons, which helps us to understand their geometrical shapes.


title: Amplification of wave groups in the forced nonlinear Schr\"odinger equation

abstract: In many physical contexts, notably including deep water waves, modulation instability in one space dimension is often studied using the nonlinear Schr\"odinger equation. The principal solutions of interest are solitons and breathers which are adopted as models of wave packets. The Peregrine breather in particular is often invoked as a model of a rogue wave. In this paper we add a linear growth term to the nonlinear Schr\"odinger equation to model the amplification of propagating wave groups. This is motivated by an application to wind-generated water waves, but this forced nonlinear Schr\"odinger equation has potentially much wider applicability. We describe a series of numerical simulations which in the absence of the forcing term would generate solitons and/or breathers. We find that overall the effect of the forcing term is to favour the generation of solitons with amplitudes growing at twice the linear growth rate over the generation of breathers.


title: Stochastic formulation of incompressible fluid flows in wall bounded regions

abstract: In this paper we establish a mathematical framework which may be used to design Monte-Carlo simulations for a class of time irreversible dynamic systems, such as incompressible fluid flows, including turbulent flows in wall-bounded regions, and some other (non-linear) dynamic systems. Path integral representations for solutions of forward parabolic equations are obtained, and, in combining with the vorticity transport equations, probabilistic formulations for solutions of the Navier-Stokes equations are therefore derived in terms of (forward) McKean-Vlasov stochastic differential equations (SDEs), which provides us with the mathematical framework for Monte-Carlo simulations of wall-bounded turbulent flows.


title: Bayesian Estimation of Differential Privacy

abstract: Algorithms such as Differentially Private SGD enable training machine learning models with formal privacy guarantees. However, there is a discrepancy between the protection that such algorithms guarantee in theory and the protection they afford in practice. An emerging strand of work empirically estimates the protection afforded by differentially private training as a confidence interval for the privacy budget $\varepsilon$ spent on training a model. Existing approaches derive confidence intervals for $\varepsilon$ from confidence intervals for the false positive and false negative rates of membership inference attacks. Unfortunately, obtaining narrow high-confidence intervals for $\epsilon$ using this method requires an impractically large sample size and training as many models as samples. We propose a novel Bayesian method that greatly reduces sample size, and adapt and validate a heuristic to draw more than one sample per trained model. Our Bayesian method exploits the hypothesis testing interpretation of differential privacy to obtain a posterior for $\varepsilon$ (not just a confidence interval) from the joint posterior of the false positive and false negative rates of membership inference attacks. For the same sample size and confidence, we derive confidence intervals for $\varepsilon$ around 40% narrower than prior work. The heuristic, which we adapt from label-only DP, can be used to further reduce the number of trained models needed to get enough samples by up to 2 orders of magnitude.


title: Dynamic mean field programming

abstract: A dynamic mean field theory is developed for finite state and action Bayesian reinforcement learning in the large state space limit. In an analogy with statistical physics, the Bellman equation is studied as a disordered dynamical system; the Markov decision process transition probabilities are interpreted as couplings and the value functions as deterministic spins that evolve dynamically. Thus, the mean-rewards and transition probabilities are considered to be quenched random variables. The theory reveals that, under certain assumptions, the state-action values are statistically independent across state-action pairs in the asymptotic state space limit, and provides the form of the distribution exactly. The results hold in the finite and discounted infinite horizon settings, for both value iteration and policy evaluation. The state-action value statistics can be computed from a set of mean field equations, which we call dynamic mean field programming (DMFP). For policy evaluation the equations are exact. For value iteration, approximate equations are obtained by appealing to extreme value theory or bounds. The result provides analytic insight into the statistical structure of tabular reinforcement learning, for example revealing the conditions under which reinforcement learning is equivalent to a set of independent multi-armed bandit problems.


title: Combining sensors and surveys to study social contexts: Case of scientific conferences

abstract: In this paper, we present a unique collection of four data sets to study social behaviour. The data were collected at four international scientific conferences, during which we measured face-to-face contacts along with additional information about individuals. Building on innovative methods developed in the last decade to study human social behaviour, interactions between participants were monitored using the SocioPatterns platform, which allows collecting face-to-face physical proximity events every 20 seconds in a well-defined social context. Through accompanying surveys, we gathered extensive information about the participants, including sociodemographic characteristics, Big Five personality traits, DIAMONDS situational perceptions, measure of scientific attractiveness, motivations for attending the conferences, and perceptions of the crowd (e.g., in terms of gender distribution). Linking the sensor and survey data provides a rich window into social behaviour: At the individual level, the data sets allow personality scientists to investigate individual differences in social behaviour and pinpoint which individual characteristics (e.g., social roles, personality traits, situational perceptions) drive these individual differences. At the group level, the data also allow studying the mechanisms responsible for interacting patterns within a scientific crowd during a social, networking and idea-sharing event. The data are available for secondary analysis.


title: Bidirectional Communication Control for Human-Robot Collaboration

abstract: A fruitful collaboration is based on the mutual knowledge of each other skills and on the possibility of communicating their own limits and proposing alternatives to adapt the execution of a task to the capabilities of the collaborators. This paper aims at reproducing such a scenario in a human-robot collaboration setting by proposing a novel communication control architecture. Exploiting control barrier functions, the robot is made aware of its (dynamic) skills and limits and, thanks to a local predictor, it is able to assess if it is possible to execute a requested task and, if not, to propose alternative by relaxing some constraints. The controller is interfaced with a communication infrastructure that enables human and robot to set up a bidirectional communication about the task to execute and the human to take an informed decision on the behavior of the robot. A comparative experimental validation is proposed.


title: Anomalies, CPT and Leptogenesis

abstract: We bring together different puzzles in physics beyond the Standard Model of particle physics. Within our model baryogenesis, neutrino mass, strong CP and dark matter puzzles are related. The common ingredient in connecting these puzzles is the Kalb-Ramond field, a two form present in the gravitational multiplet in the theory of closed strings. Leptons are fermions which we need to couple to gravitational degrees of freedom using a vierbein formalism. The presence of torsion provided by a Kalb-Ramond background leads us to firstly an effective model involving the Einstein-Cartan formulation of gravity, a gauge theory, in which coupling to fermions is via a covariant derivative and secondly to a mechanism for CPT violation. This picture emerges from a low energy string effective action obtained from a closed bosonic string theory after compactification to four dimensions. The Kalb-Ramond field in four dimensions can be identified with a pseudoscalar gravitational axion. Because of the presence of an axial anomaly this axion can couple with the gluon field, and in this way allows a connection with the strong CP problem and axionic dark matter.


title: Empirical Likelihood Based Bayesian Variable Selection

abstract: Empirical likelihood is a popular nonparametric statistical tool that does not require any distributional assumptions. In this paper, we explore the possibility of conducting variable selection via Bayesian empirical likelihood. We show theoretically that when the prior distribution satisfies certain mild conditions, the corresponding Bayesian empirical likelihood estimators are posteriorly consistent and variable selection consistent. As special cases, we show the prior of Bayesian empirical likelihood LASSO and SCAD satisfies such conditions and thus can identify the non-zero elements of the parameters with probability tending to 1. In addition, it is easy to verify that those conditions are met for other widely used priors such as ridge, elastic net and adaptive LASSO. Empirical likelihood depends on a parameter that needs to be obtained by numerically solving a non-linear equation. Thus, there exists no conjugate prior for the posterior distribution, which causes the slow convergence of the MCMC sampling algorithm in some cases. To solve this problem, we propose a novel approach, which uses an approximation distribution as the proposal. The computational results demonstrate quick convergence for the examples used in the paper. We use both simulation and real data analyses to illustrate the advantages of the proposed methods.


title: Poincar\'e gauge gravity primer

abstract: We give an introductory overview of the classical Poincar\'e gauge theory of gravity formulated on the spacetime manifold that carries the Riemann-Cartan geometry with nontrivial curvature and torsion. After discussing the basic mathematical structures at an elementary level in the framework of the standard tensor analysis, we formulate the general dynamical scheme of Poincar\'e gauge gravity for the class of Yang-Mills type models, and consider a selected number of physically interesting consequences of this theory.


title: Radial bound states in the continuum for polarization-invariant nanophotonics

abstract: All-dielectric nanophotonics underpinned by the physics of bound states in the continuum (BICs) have demonstrated breakthrough applications in nanoscale light manipulation, frequency conversion and optical sensing. Leading BIC implementations range from isolated nanoantennas with localized electromagnetic fields to symmetry-protected metasurfaces with controllable resonance quality (Q) factors. However, they either require structured light illumination with complex beam-shaping optics or large, fabrication-intense arrays of polarization-sensitive unit cells, hindering tailored nanophotonic applications and on-chip integration. Here, we introduce radial quasi bound states in the continuum (radial BICs) as a new class of radially distributed electromagnetic modes controlled by structural asymmetry in a ring of dielectric rod pair resonators. The radial BIC platform provides polarization-invariant and tunable high-Q resonances with strongly enhanced near fields in an ultracompact footprint as low as 2 $\mu$m$^2$. We demonstrate radial BIC realizations in the visible for sensitive biomolecular detection and enhanced second-harmonic generation from monolayers of transition metal dichalcogenides, opening new perspectives for compact, spectrally selective, and polarization-invariant metadevices for multi-functional light-matter coupling, multiplexed sensing, and high-density on-chip photonics.


title: Proton hot spots and exclusive vector meson production

abstract: We explore consequences of the existence of gluonic hot spots inside the proton for coherent and incoherent exclusive vector meson production cross sections in deep inelastic scattering. By working in the dilute limit of the Color Glass Condensate framework to compute the cross sections for Gaussian hot spots of fluctuating color charges and employing a non-relativistic vector meson wave function, we are able to perform large parts of the calculation analytically. We find that the coherent cross section is sensitive to both the size of the target and the structure of the probe. The incoherent cross section is dominated by color fluctuations at small transverse momentum transfer ($t$), by proton and hot spot sizes as well as the structure of the probe at medium $t$ and again by color fluctuations at large $t$. While the $t$-dependence of the cross section is well reproduced in our model, the relative normalization between the coherent and the incoherent cross sections points to the need for additional fluctuations in the proton.


title: Reducing the local alphabet size in tiling systems by means of 2D comma-free codes

abstract: A recognizable picture language is defined as the projection of a local picture language defined by a set of two-by-two tiles, i.e. by a strictly-locally-testable (SLT) language of order 2. The family of recognizable picture languages is also defined, using larger $k$ by $k$ tiles, $k>2$, by the projection of the corresponding SLT language. A basic measure of the descriptive complexity of a picture language is given by the size of the SLT alphabet using two-by-two tiles, more precisely by the so-called alphabetic ratio of sizes: SLT-alphabet / picture-alphabet. We study how the alphabetic ratio changes moving from tiles of size two to tiles of larger size, and we obtain the following result: any recognizable picture language over an alphabet of size $n$ is the projection of an SLT language over an alphabet of size $2n$. Moreover, two is the minimal alphabetic ratio possible in general. The proof relies on a new family of comma-free picture codes, for which a lower bound on numerosity is established; and on the relation of languages of encoded pictures with SLT languages. Our result reproduces in two dimensions a similar property (known as Extended Medvedev's theorem) of the regular word languages, concerning the minimal alphabetic ratio needed to define a language by means of a projection of an SLT word language.


title: Hierarchical Federated Learning with Privacy

abstract: Federated learning (FL), where data remains at the federated clients, and where only gradient updates are shared with a central aggregator, was assumed to be private. Recent work demonstrates that adversaries with gradient-level access can mount successful inference and reconstruction attacks. In such settings, differentially private (DP) learning is known to provide resilience. However, approaches used in the status quo (\ie central and local DP) introduce disparate utility vs. privacy trade-offs. In this work, we take the first step towards mitigating such trade-offs through {\em hierarchical FL (HFL)}. We demonstrate that by the introduction of a new intermediary level where calibrated DP noise can be added, better privacy vs. utility trade-offs can be obtained; we term this {\em hierarchical DP (HDP)}. Our experiments with 3 different datasets (commonly used as benchmarks for FL) suggest that HDP produces models as accurate as those obtained using central DP, where noise is added at a central aggregator. Such an approach also provides comparable benefit against inference adversaries as in the local DP case, where noise is added at the federated clients.


title: On the safe use of prior densities for Bayesian model selection

abstract: The application of Bayesian inference for the purpose of model selection is very popular nowadays. In this framework, models are compared through their marginal likelihoods, or their quotients, called Bayes factors. However, marginal likelihoods depends on the prior choice. For model selection, even diffuse priors can be actually very informative, unlike for the parameter estimation problem. Furthermore, when the prior is improper, the marginal likelihood of the corresponding model is undetermined. In this work, we discuss the issue of prior sensitivity of the marginal likelihood and its role in model selection. We also comment on the use of uninformative priors, which are very common choices in practice. Several practical suggestions are discussed and many possible solutions, proposed in the literature, to design objective priors for model selection are described. Some of them also allow the use of improper priors. The connection between the marginal likelihood approach and the well-known information criteria is also presented. We describe the main issues and possible solutions by illustrative numerical examples, providing also some related code. One of them involving a real-world application on exoplanet detection.


title: The vertex corrections due to the triangle singularity mechanism in the light axial vector meson couplings to $K^*\bar{K}+c.c.$

abstract: The light axial vector mesons can couple to $K^*\bar{K}+c.c.$ in an $S$ wave at the tree level. Due to the near-threshold $S$-wave interactions the couplings can be affected by the final state interactions. It is of peculiar interest that the pion exchange between $K^*\bar{K}+c.c.$ can go through a triangle diagram which is within the kinematics of the triangle singularity (TS). This mechanism will introduce energy dependence and a $D$-wave amplitude to the vertex couplings. Hence, it should be necessary to investigate the role played by the $K^*\bar{K}+c.c.$ threshold in order to have a better understanding of the light axial vector spectrum.


title: Computation of High Frequency Magnetoelastic Waves in Layered Materials

abstract: The direct calculation of magnetoelastic wave dispersion in layered media is presented using an efficient, accurate computational technique. The governing, coupled equations for elasticity and magnetism, the Navier and Landau-Lifshitz equations, respectively, are linearized to form a quadratic eigenvalue problem that determines a complex web of wavenumber-frequency dispersion branches and their corresponding mode profiles. Numerical discretization of the eigenvalue problem via a spectral collocation method (SCM) is employed to determine the complete dispersion maps for both a single, finite-thickness magnetic layer and a finite magnetic-nonmagnetic double-layer. The SCM, previously used to study elastic waves in non-magnetic media, is fast, accurate, and adaptable to a variety of sample configurations and geometries. Emphasis is placed on the extremely high frequency regimes being accessed in ultrafast magnetism experiments. The dispersion maps and modes provide insight into how energy propagates through the coupled system, including how energy can be transferred between elastic- and magnetic-dominated waves as well as between different layers. The numerical computations for a single layer are further understood by a simplified analytical calculation in the high-frequency, exchange-dominated regime where the resonance condition required for energy exchange (an anticrossing) between quasi-elastic and quasi-magnetic dispersion branches is determined. Nonresonant interactions are shown to be well approximated by the dispersion of uncoupled elastic and magnetic waves. The methods and results provide fundamental theoretical tools to model and understand current and future magnetic devices powering spintronic innovation.


title: Rates of Convergence for Chains of Expansive Markov Operators

abstract: We provide conditions that guarantee local rates of convergence in distribution of iterated random functions that are not nonexpansive mappings in locally compact Hadamard spaces. Our results are applied to stochastic instances of common algorithms in optimization, stochastic tomography for X-FEL imaging, and a stochastic algorithm for the computation of Fr\'echet means in model spaces for phylogenetic trees.


title: Using Car-Parrinello simulations and microscopic order descriptors to reveal two locally favored structures with distinct molecular dipole moments and dynamics in ambient liquid water

abstract: Water is essential for life and technological applications, mainly for its unique thermodynamic and dynamic properties, often anomalous or counterintuitive. These anomalies result from the hydrogen-bonds fluctuations, as evidenced by studies for supercooled water. However, it is difficult to characterize these fluctuations under ambient conditions. Here, we fill this knowledge gap thanks to the Car-Parrinello ab initio molecular dynamics (MD) simulation technique. We calculate the local structural order parameter {\zeta}, quantifying the coordination shells separation, and find two locally-favored structures or states: High-{\zeta} and Low-{\zeta}. On average, High-{\zeta} molecules have a tetrahedral arrangement, with four hydrogen bonds, and the first and the second coordination shell well separated. The Low-{\zeta} molecules are less connected, partially merging the first and the second shells. The appearance of isosbestic points in the radial distribution functions and the collective density fluctuations at different length scales and timescales reveal that the two-state model, consistent with available experimental data for supercooled water, also holds under ambient conditions, as we confirm by analyzing the vibrational spectrum of both types of water molecules. Significant consequences of the structural differences between the two states are that High-{\zeta} molecules have a dipole moment 6 % higher than Low-{\zeta}. At the same time, Low-{\zeta} structures are more disordered and with more significant angular fluctuations. These differences are also reflected in the dynamics under ambient conditions. The Low-{\zeta} molecules decorrelate their reorientation faster than High-{\zeta} and merge their coordination shells within 0.2 ps, while the High-{\zeta} preserve the shell separation for longer times.


title: A new distance measurement and its application in K-Means Algorithm

abstract: K-Means clustering algorithm is one of the most commonly used clustering algorithms because of its simplicity and efficiency. K-Means clustering algorithm based on Euclidean distance only pays attention to the linear distance between samples, but ignores the overall distribution structure of the dataset (i.e. the fluid structure of dataset). Since it is difficult to describe the internal structure of two data points by Euclidean distance in high-dimensional data space, we propose a new distance measurement, namely, view-distance, and apply it to the K-Means algorithm. On the classical manifold learning datasets, S-curve and Swiss roll datasets, not only this new distance can cluster the data according to the structure of the data itself, but also the boundaries between categories are neat dividing lines. Moreover, we also tested the classification accuracy and clustering effect of the K-Means algorithm based on view-distance on some real-world datasets. The experimental results show that, on most datasets, the K-Means algorithm based on view-distance has a certain degree of improvement in classification accuracy and clustering effect.


title: Quantification of follow-up time in oncology clinical trials with a time-to-event endpoint: Asking the right questions

abstract: For the analysis of a time-to-event endpoint in a single-arm or randomized clinical trial it is generally perceived that interpretation of a given estimate of the survival function, or the comparison between two groups, hinges on some quantification of the amount of follow-up. Typically, a median of some loosely defined quantity is reported. However, whatever median is reported, is typically not answering the question(s) trialists actually have in terms of follow-up quantification. In this paper, inspired by the estimand framework, we formulate a comprehensive list of relevant scientific questions that trialists have when reporting time-to-event data. We illustrate how these questions should be answered, and that reference to an unclearly defined follow-up quantity is not needed at all. In drug development, key decisions are made based on randomized controlled trials, and we therefore also discuss relevant scientific questions not only when looking at a time-to-event endpoint in one group, but also for comparisons. We find that different thinking about some of the relevant scientific questions around follow-up is required depending on whether a proportional hazards assumption can be made or other patterns of survival functions are anticipated, e.g. delayed separation, crossing survival functions, or the potential for cure. We conclude the paper with practical recommendations.


title: Bulge formation inside quiescent lopsided stellar disks: connecting accretion, star formation and morphological transformation in a z ~ 3 galaxy group

abstract: We present well-resolved near-IR and sub-mm analysis of the three highly star-forming massive ($>10^{11}\,\rm M_{\odot}$) galaxies within the core of the RO-1001 galaxy group at $\rm z=2.91$. Each of them displays kpc-scale compact star-bursting cores with properties consistent with forming galaxy bulges, embedded at the center of extended, massive stellar disks. Surprisingly, the stellar disks are unambiguously both quiescent, and severely lopsided. Therefore, `outside-in' quenching is ongoing in the three group galaxies. We propose an overall scenario in which the strong mass lopsidedness in the disks (ranging from factors of 1.6 to $>$3), likely generated under the effects of accreted gas and clumps, is responsible for their star-formation suppression, while funnelling gas into the nuclei and thus creating the central starbursts. The lopsided side of the disks marks the location of accretion streams impact, with additional matter components (dust and stars) detected in their close proximity directly tracing the inflow direction. The interaction with the accreted clumps, which can be regarded as minor-mergers, leads the major axes of the three galaxies to be closely aligned with the outer Lyman-$\alpha$-emitting feeding filaments. These results provide the first observational evidence of the impact of cold accretion streams on the formation and evolution of the galaxies they feed. In the current phase, this is taking the form of the rapid buildup of bulges under the effects of accretion, while still preserving massive quiescent and lopsided stellar disks at least until encountering a violent major-merger.


title: The scalar garlands in the boson star

abstract: In the paper, we introduce the formalism to examine the impact of the hidden scalar sector to the conformal and the electroweak symmetries breaking. The novel approach to the scalar boson star (BS) naturalness is considered. The BS is presented by the local scalar field containing the Higgs boson field and the garland-like scalar dilaton fields of the conformal field theory. We show that taking into account the repulsive self-interactions and the flatness degree in the dark scalar sector prevents instability of the BS related to the black hole formation. We study in details how electroweak symmetry breaking affects the hidden sector by breaking its conformal symmetry and generating a mass gap to avoid the infra-red divergence. We apply our formalism to determine the modification of the Higgs quartic coupling away from its standard model (SM) value within the influence of the hidden sector. We have estimated the rate of the deviation from the SM with production of leptonic pairs due to decay of the dilaton and the dark photon. The latter is the subject of the dilaton decay first. The effect of new physics should be visible at the maximal energies of the LHC and the FCC.


title: Testing the Reliability of X-rays as a Tool for Constraining Mass-loss Rates of Hot Stars

abstract: We fit a new line shape model to \textit{Chandra} X-ray spectra of the O supergiant $\zeta$ Puppis to test the robustness of mass-loss rates derived from X-ray wind line profiles against different assumed heating models. Our goal is to track the hot gas by replacing the common assumption that it is proportional to the cool gas emission measure. Instead of assuming a turn-on radius for the hot gas (as appropriate for the line-deshadowing instability internal to the wind), we parametrize the hot gas in terms of a mean-free path for accelerated low-density gas to encounter slower high-density material. This alternative model is equally successful as previous approaches at fitting X-ray spectral lines in the 5 -- 17 \AA\ wavelength range. We find that the characteristic radii where the hottest gas appears is inversely proportional to line formation temperature, suggesting that stronger shocks appear generally closer to the surface. This picture is more consistent with pockets of low-density, rapid acceleration at the lower boundary than with an internally generated wind instability. We also infer an overall wind mass-loss rate from the profile shapes with a technique used previously in the literature. In doing so, we find evidence that the mass-loss rate derived from X-ray wind line profiles is not robust with respect to changes in the specific heating picture used.


title: Scalable Computations for Nonstationary Gaussian Processes

abstract: Nonstationary Gaussian process models can capture complex spatially varying dependence structures in spatial datasets. However, the large number of observations in modern datasets makes fitting such models computationally intractable with conventional dense linear algebra. In addition, derivative-free or even first-order optimization methods can be slow to converge when estimating many spatially varying parameters. We present here a computational framework that couples an algebraic block-diagonal plus low-rank covariance matrix approximation with stochastic trace estimation to facilitate the efficient use of second-order solvers for maximum likelihood estimation of Gaussian process models with many parameters. We demonstrate the effectiveness of these methods by simultaneously fitting 192 parameters in the popular nonstationary model of Paciorek and Schervish using 107,600 sea surface temperature anomaly measurements.


title: Combinatorial proof of Maslov index formula in Heegaard Floer Theory

abstract: We prove Lipshitz's Maslov index formula in Heegaard Floer homology via the combinatorics of Heegaard diagrams.


title: Nonterminating transformations and summations associated with some q-Mellin--Barnes integrals

abstract: In many cases one may encounter an integral which is of $q$-Mellin--Barnes type. These integrals are easily evaluated using theorems which have a long history dating back to Slater, Askey, Gasper, Rahman and others. We derive some interesting $q$-Mellin--Barnes integrals and using them we derive transformation and summation formulas for nonterminating basic hypergeometric functions. The cases which we treat include ratios of theta functions, the Askey--Wilson moments, nonterminating well-poised ${}_3\phi_2$, nonterminating very-well-poised ${}_5W_4$, ${}_8W_7$, products of two nonterminating ${}_2\phi_1$'s, square of a nonterminating well-poised ${}_2\phi_1$, and nonterminating ${}_{12}W_{11}$ and ${}_{10}W_9$.


title: J = 0 nonmagnetic insulating state in K$_2$Os$X_6$ (X = F, Cl and Br)

abstract: In $4d/5d$ transition-metal systems, many interesting physical properties arise from the interplay of bandwidth, electronic correlations, and spin-orbit interactions. Here, using {\it ab initio} density functional theory, we systematically study the double-perovskite-like system K$_2$Os$X_6$ (X = F, Cl, and Br) with a $5d^4$ electronic configuration. Our main result is that the $J = 0$ nonmagnetic insulating state develops in this system, induced by strong spin-orbital coupling. Specifically, the well-separated Os$X_6$ octahedra lead to the cubic crystal-field limit and result in dramatically decreasing hoppings in nearest neighbor Os-Os sites. In this case, the three degenerate $t_{2g}$ orbitals are reconstructed into two ``effective'' $j_{\rm eff}$ ($j_{\rm eff} = 1/2$ and $j_{\rm eff} = 3/2$ states) states separated by the strong SOC, opening a gap with four electrons occupying the $j_{\rm eff} = 3/2$ orbitals. Furthermore, the hybridization between the Os $5d$ orbitals and the $X$ ($X$ = F, Cl, and Br) $p$ orbitals increases from F to Br, leading the electrons in K$_2$OsF$_6$ to be more localized than in K$_2$OsCl$_6$ and K$_2$OsBr$_6$, resulting in a smaller bandwidth for K$_2$OsF$_6$ than in the Cl- or Br- cases. Our results provide guidance to experimentalists and theorists working on this interesting family of osmium halides.


title: A Multi-Task Benchmark for Korean Legal Language Understanding and Judgement Prediction

abstract: The recent advances of deep learning have dramatically changed how machine learning, especially in the domain of natural language processing, can be applied to legal domain. However, this shift to the data-driven approaches calls for larger and more diverse datasets, which are nevertheless still small in number, especially in non-English languages. Here we present the first large-scale benchmark of Korean legal AI datasets, LBOX OPEN, that consists of one legal corpus, two classification tasks, two legal judgement prediction (LJP) tasks, and one summarization task. The legal corpus consists of 147k Korean precedents (259M tokens), of which 63k are sentenced in last 4 years and 96k are from the first and the second level courts in which factual issues are reviewed. The two classification tasks are case names (11.3k) and statutes (2.8k) prediction from the factual description of individual cases. The LJP tasks consist of (1) 10.5k criminal examples where the model is asked to predict fine amount, imprisonment with labor, and imprisonment without labor ranges for the given facts, and (2) 4.7k civil examples where the inputs are facts and claim for relief and outputs are the degrees of claim acceptance. The summarization task consists of the Supreme Court precedents and the corresponding summaries (20k). We also release realistic variants of the datasets by extending the domain (1) to infrequent case categories in case name (31k examples) and statute (17.7k) classification tasks, and (2) to long input sequences in the summarization task (51k). Finally, we release LCUBE, the first Korean legal language model trained on the legal corpus from this study. Given the uniqueness of the Law of South Korea and the diversity of the legal tasks covered in this work, we believe that LBOX OPEN contributes to the multilinguality of global legal research. LBOX OPEN and LCUBE will be publicly available.


title: ClamNet: Using contrastive learning with variable depth Unets for medical image segmentation

abstract: Unets have become the standard method for semantic segmentation of medical images, along with fully convolutional networks (FCN). Unet++ was introduced as a variant of Unet, in order to solve some of the problems facing Unet and FCNs. Unet++ provided networks with an ensemble of variable depth Unets, hence eliminating the need for professionals estimating the best suitable depth for a task. While Unet and all its variants, including Unet++ aimed at providing networks that were able to train well without requiring large quantities of annotated data, none of them attempted to eliminate the need for pixel-wise annotated data altogether. Obtaining such data for each disease to be diagnosed comes at a high cost. Hence such data is scarce. In this paper we use contrastive learning to train Unet++ for semantic segmentation of medical images using medical images from various sources including magnetic resonance imaging (MRI) and computed tomography (CT), without the need for pixel-wise annotations. Here we describe the architecture of the proposed model and the training method used. This is still a work in progress and so we abstain from including results in this paper. The results and the trained model would be made available upon publication or in subsequent versions of this paper on arxiv.


title: On the generalizability of machine-learning-assisted anisotropy mappings for predictive turbulence modelling

abstract: Several machine learning frameworks for augmenting turbulence closure models have been recently proposed. However, the generalizability of an augmented turbulence model remains an open question. We investigate this question by systematically varying the training and test sets of several models. An optimal three-term tensor basis expansion is used to develop a model-agnostic data-driven turbulence closure approximation. Then, hyperparameter optimization was performed for a random forest, a neural network, and an eXtreme Gradient Boosting (XGBoost) model. We recommend XGBoost for data-driven turbulence closure modelling owing to its low-tuning cost and good performance. We also find that machine learning models generalize well to new parametric variations of flows seen in the training dataset, but lack generalizability to new flow types. This generalizability gap suggests that machine learning methods are most suited for developing specialized models for a given flow type, a problem often encountered in industrial applications.


title: Log-concave density estimation in undirected graphical models

abstract: We study the problem of maximum likelihood estimation of densities that are log-concave and lie in the graphical model corresponding to a given undirected graph $G$. We show that the maximum likelihood estimate (MLE) is the product of the exponentials of several tent functions, one for each maximal clique of $G$. While the set of log-concave densities in a graphical model is infinite-dimensional, our results imply that the MLE can be found by solving a finite-dimensional convex optimization problem. We provide an implementation and a few examples. Furthermore, we show that the MLE exists and is unique with probability 1 as long as the number of sample points is larger than the size of the largest clique of $G$ when $G$ is chordal. We show that the MLE is consistent when the graph $G$ is a disjoint union of cliques. Finally, we discuss the conditions under which a log-concave density in the graphical model of $G$ has a log-concave factorization according to $G$.


title: Dynamics of sparse Boolean networks with multi-node and self-interactions

abstract: We analyse the equilibrium behaviour and non-equilibrium dynamics of sparse Boolean networks with self-interactions that evolve according to synchronous Glauber dynamics. Equilibrium analysis is achieved via a novel application of the cavity method to the temperature-dependent pseudo-Hamiltonian that characterises the equilibrium state of systems with parallel dynamics. Similarly, the non-equilibrium dynamics can be analysed by using the dynamical version of the cavity method. It is well known, however, that when self-interactions are present, direct application of the dynamical cavity method is cumbersome, due to the presence of strong memory effects, which prevent explicit analysis of the dynamics beyond a few time steps. To overcome this difficulty, we show that it is possible to map a system of $N$ variables to an equivalent bipartite system of $2N$ variables, for which the dynamical cavity method can be used under the usual one time approximation scheme. This substantial technical advancement allows for the study of transient and long-time behaviour of systems with self-interactions. Finally, we study the dynamics of systems with multi-node interactions, recently used to model gene regulatory networks, by mapping this to a bipartite system of Boolean variables with 2-body interactions. We show that when interactions have a degree of bidirectionality such systems are able to support a multiplicity of diverse attractors, an important requirement for a gene-regulatory network to sustain multi-cellular life.


title: Measuring the Carbon Intensity of AI in Cloud Instances

abstract: By providing unprecedented access to computational resources, cloud computing has enabled rapid growth in technologies such as machine learning, the computational demands of which incur a high energy cost and a commensurate carbon footprint. As a result, recent scholarship has called for better estimates of the greenhouse gas impact of AI: data scientists today do not have easy or reliable access to measurements of this information, precluding development of actionable tactics. Cloud providers presenting information about software carbon intensity to users is a fundamental stepping stone towards minimizing emissions. In this paper, we provide a framework for measuring software carbon intensity, and propose to measure operational carbon emissions by using location-based and time-specific marginal emissions data per energy unit. We provide measurements of operational software carbon intensity for a set of modern models for natural language processing and computer vision, and a wide range of model sizes, including pretraining of a 6.1 billion parameter language model. We then evaluate a suite of approaches for reducing emissions on the Microsoft Azure cloud compute platform: using cloud instances in different geographic regions, using cloud instances at different times of day, and dynamically pausing cloud instances when the marginal carbon intensity is above a certain threshold. We confirm previous results that the geographic region of the data center plays a significant role in the carbon intensity for a given cloud instance, and find that choosing an appropriate region can have the largest operational emissions reduction impact. We also show that the time of day has notable impact on operational software carbon intensity. Finally, we conclude with recommendations for how machine learning practitioners can use software carbon intensity information to reduce environmental impact.


title: Two-dimensional contiguous relations for linearization coefficients of orthogonal polynomials in the Askey-scheme

abstract: We produce two-dimensional contiguous relations for generalized hypergeometric functions by starting with linearization coefficients for some continuous generalized hypergeometric orthogonal polynomials in the Askey-scheme.


title: Scales

abstract: We introduce the notion of scale to generalize and compare different invariants of metric spaces and their measures. Several versions of scales are introduced such as Hausdorff, packing, box, local and quantization. They moreover are defined for different growth, allowing in particular a refined study of infinite dimensional spaces. We prove general theorems comparing the different versions of scales. They are applied to describe geometries of ergodic decompositions, of the Wiener measure and of functional spaces. The first application solves a problem of Berger on the notions of emergence (2020); the second lies in the geometry of the Wiener measure and extends the work of Dereich-Lifshits (2005); the last refines Kolmogorov-Tikhomirov (1958) study on functional spaces.


title: On the probabilistic quantum error correction

abstract: Probabilistic quantum error correction is an error-correcting procedure which uses postselection to determine if the encoded information was successfully restored. In this work, we deeply analyze probabilistic version of the error-correcting procedure for general noise. We generalized the Knill-Laflamme conditions for probabilistically correctable errors. We show that for some noise channels, we should encode the information into a mixed state to maximize the probability of successful error correction. Finally, we investigate an advantage of the probabilistic error-correcting procedure over the deterministic one. Reducing the probability of successful error correction allows for correcting errors generated by a broader class of noise channels. Significantly, if the errors are caused by a unitary interaction with an auxiliary qubit system, we can probabilistically restore a qubit state by using only one additional physical qubit.


title: Characterizing and Mitigating Telluric Absorption in Precise Radial Velocities II: A Study of an M2 Type Star

abstract: Telluric absorption lines impact measuring precise radial velocities (RVs) from ground-based, high-resolution spectrographs. In this paper, we simulate the dependence of this impact on stellar spectral type and extend the work of the first paper in this series, which studied a G type star, to a synthetic M dwarf star. We quantify the bias in precise RV measurements in the visible and near-infrared (NIR) from the presence of tellurics in a simulated set of observations. We find that M dwarf RVs are more impacted by tellurics compared to G type stars. Specifically, for an M dwarf star, tellurics can induce RV errors of up to 16 cm/s in the red-optical and in excess of 220 cm/s in the NIR. For a G dwarf, comparable RV systematics are 3 cm/s in the red optical and 240 cm/s in the NIR. We attribute this relative increase for M dwarfs stars to the increased concordance in wavelength between telluric lines and stellar Doppler information content. We compare the results of our simulation to data collected on Barnard's star from the iSHELL spectrograph at the NASA Infrared Telescope Facility (IRTF). This study was conducted as a follow-up to the NASA probe mission concept study EarthFinder.


title: Probing electron-hole weights of an Andreev bound state by transient currents

abstract: Andreev bound states (ABSs) are localized quantum states that contain both electron and hole components. They ubiquitously reside in inhomogeneous superconducting systems. Following theoretical analysis, we propose to probe the electron-hole weights of an ABS via a local tunneling measurement that detects the transient current under a steplike pulse bias. With our protocol, the ABS energy level can also be obtained from peaks of the Fourier spectrum of the transient current. Our protocol can be applied to detect robust zero-energy Majorana bound states (MBSs), which have equal electron-hole weights, in candidate platforms where local tunneling spectroscopy measurement is possible. In the 1D Majorana nanowire model, we numerically calculate the electron-hole weights for different types of low-energy bound states, including ABSs, quasi-MBSs, and MBSs.


title: Machine Learning Inference on Inequality of Opportunity

abstract: Equality of opportunity has emerged as an important ideal of distributive justice. Empirically, Inequality of Opportunity (IOp) is measured in two steps: first, an outcome (e.g., income) is predicted given individual circumstances; and second, an inequality index (e.g., Gini) of the predictions is computed. Machine Learning (ML) methods are tremendously useful in the first step. However, they can cause sizable biases in IOp since the bias-variance trade-off allows the bias to creep in the second step. We propose a simple debiased IOp estimator robust to such ML biases and provide the first valid inferential theory for IOp. We demonstrate improved performance in simulations and report the first unbiased measures of income IOp in Europe. Mother's education and father's occupation are the circumstances that explain the most. Plug-in estimators are very sensitive to the ML algorithm, while debiased IOp estimators are robust. These results are extended to a general U-statistics setting.


title: Optical Diffraction Tomography based on 3D Physics-Inspired Neural Network (PINN)

abstract: Optical diffraction tomography (ODT) is an emerging 3D imaging technique that is used for the 3D reconstruction of the refractive index (RI) for semi-transparent samples. Various inverse models have been proposed to reconstruct the 3D RI based on the holographic detection of different samples such as the Born and the Rytov approximations. However, such approximations usually suffer from the so-called missing-cone problem that results in an elongation of the final reconstruction along the optical axis. Different iterative schemes have been proposed to solve the missing cone problem relying on physical forward models and an error function that aims at filling in the k-space and thus eliminating the missing-cone problem and reaching better reconstruction accuracy. In this paper, we propose a different approach where a 3D neural network (NN) is employed. The NN is trained with a cost function derived from a physical model based on the physics of optical wave propagation. The 3D NN starts with an initial guess for the 3D RI reconstruction (i.e. Born, or Rytov) and aims at reconstructing better 3D reconstruction based on an error function. With this technique, the NN can be trained without any examples of the relation between the ill-posed reconstruction (Born or Rytov) and the ground truth (true shape).


title: Broadband spectral analysis of Mrk 926 using multi-epoch X-ray observations

abstract: The X-ray spectra of some active galactic nuclei (AGN) show a soft X-ray excess, emission in excess to the extrapolated primary X-ray continuum below 2 keV. Recent studies have shown that this soft excess can be described well as originating from either a relativistic ionized reflection, the extreme blurring of the reprocessed emission from the innermost region of the accretion disk, or Comptonization from an optically thick and warm region called the 'warm corona', in which electron scattering is the dominant source of opacity. To constrain the origin of the soft excess in the Seyfert 1 galaxy Mrk 926, we carry out an multi-epoch X-ray spectral study using observations from Suzaku (2009), XMM-Newton and NuSTAR (2016), and NuSTAR and Swift-XRT (2021). The broadband X-ray spectra of Mrk 926 contains: a thermally Comptonized primary continuum, a variable soft excess, and distant reflection. We find that in Mrk 926 as in so many sources, it is difficult to make a definite statement as to what is causing the observed soft excess. A warm coronal-like component is slightly preferred by the data but a reflection origin is also possible. Using archival radio data, we detect an optically-thin radio component in our broadband study of Mrk 926. While this component is consistent with an optically-thin radio jet, future multi-wavelength observations including high spatial resolution radio observations at multiple frequencies are required to probe the origin of the radio emission in more detail.


title: Dimensional Modeling of Emotions in Text with Appraisal Theories: Corpus Creation, Annotation Reliability, and Prediction

abstract: The most prominent tasks in emotion analysis are to assign emotions to texts and to understand how emotions manifest in language. An observation for NLP is that emotions can be communicated implicitly by referring to events, appealing to an empathetic, intersubjective understanding of events, even without explicitly mentioning an emotion name. In psychology, the class of emotion theories known as appraisal theories aims at explaining the link between events and emotions. Appraisals can be formalized as variables that measure a cognitive evaluation by people living through an event that they consider relevant. They include the assessment if an event is novel, if the person considers themselves to be responsible, if it is in line with the own goals, and many others. Such appraisals explain which emotions are developed based on an event, e.g., that a novel situation can induce surprise or one with uncertain consequences could evoke fear. We analyze the suitability of appraisal theories for emotion analysis in text with the goal of understanding if appraisal concepts can reliably be reconstructed by annotators, if they can be predicted by text classifiers, and if appraisal concepts help to identify emotion categories. To achieve that, we compile a corpus by asking people to textually describe events that triggered particular emotions and to disclose their appraisals. Then, we ask readers to reconstruct emotions and appraisals from the text. This setup allows us to measure if emotions and appraisals can be recovered purely from text and provides a human baseline. Our comparison of text classification methods to human annotators shows that both can reliably detect emotions and appraisals with similar performance. Therefore, appraisals constitute an alternative computational emotion analysis paradigm and further improve the categorization of emotions in text with joint models.


title: StructCoder: Structure-Aware Transformer for Code Generation

abstract: There has been a recent surge of interest in automating software engineering tasks using deep learning. This paper addresses the problem of code generation, where the goal is to generate target code given source code in a different language or a natural language description. Most state-of-the-art deep learning models for code generation use training strategies primarily designed for natural language. However, understanding and generating code requires a more rigorous comprehension of the code syntax and semantics. With this motivation, we develop an encoder-decoder Transformer model where both the encoder and decoder are explicitly trained to recognize the syntax and data flow in the source and target codes, respectively. We not only make the encoder structure-aware by leveraging the source code's syntax tree and data flow graph, but we also support the decoder in preserving the syntax and data flow of the target code by introducing two novel auxiliary tasks: AST (Abstract Syntax Tree) paths prediction and data flow prediction. To the best of our knowledge, this is the first work to introduce a structure-aware Transformer decoder that models both syntax and data flow to enhance the quality of generated code. The proposed StructCoder model achieves state-of-the-art performance on code translation and text-to-code generation tasks in the CodeXGLUE benchmark, and improves over baselines of similar size on the APPS code generation benchmark. Our code is publicly available at https://github.com/reddy-lab-code-research/StructCoder/.


title: ROI-Constrained Bidding via Curriculum-Guided Bayesian Reinforcement Learning

abstract: Real-Time Bidding (RTB) is an important mechanism in modern online advertising systems. Advertisers employ bidding strategies in RTB to optimize their advertising effects subject to various financial requirements, especially the return-on-investment (ROI) constraint. ROIs change non-monotonically during the sequential bidding process, and often induce a see-saw effect between constraint satisfaction and objective optimization. While some existing approaches show promising results in static or mildly changing ad markets, they fail to generalize to highly dynamic ad markets with ROI constraints, due to their inability to adaptively balance constraints and objectives amidst non-stationarity and partial observability. In this work, we specialize in ROI-Constrained Bidding in non-stationary markets. Based on a Partially Observable Constrained Markov Decision Process, our method exploits an indicator-augmented reward function free of extra trade-off parameters and develops a Curriculum-Guided Bayesian Reinforcement Learning (CBRL) framework to adaptively control the constraint-objective trade-off in non-stationary ad markets. Extensive experiments on a large-scale industrial dataset with two problem settings reveal that CBRL generalizes well in both in-distribution and out-of-distribution data regimes, and enjoys superior learning efficiency and stability.


title: Credible equilibrium

abstract: Credible equilibrium is a solution concept that imposes a stronger credibility notion than subgame perfect equilibrium. A credible equilibrium is a refinement of subgame perfect equilibrium such that if a threat in a subgame g is "credible," then it must also be credible in every subgame g' that is "equivalent" to g. I show that (i) a credible equilibrium exists in multi-stage games, and (ii) if every stage game has a unique Nash equilibrium, then the credible equilibrium is unique even in infinite horizon multi-stage games. Moreover, in perfect information games, credible equilibrium is equivalent to subgame perfect equilibrium.


title: Demonstrating backflow in classical two beams' interference

abstract: The well-known interference pattern of bright and dark fringes was first observed for light beams back in 1801 by Thomas Young. The maximum visibility fringes occur when the irradiance of the two beams is equal, and as the ratio of the beam intensities deviates from unity, fringe visibility decreases. An interesting outcome that might not be entirely intuitive, however, is that the wavefront of such unequal amplitude beams' superposition will exhibit a wavy behavior. In this work, we experimentally observe the backflow phenomenon within this wavy wavefront. Backflow appears in both optics (retro-propagating light) and in quantum mechanics where a local phase gradient is not present within the spectrum of the system. It has become an interesting subject for applications as it is closely related to superoscillations whose features are used in super resolution imaging and in a particle's path manipulations. The first successful attempt to observe backflow was made only recently in an assembly of optical fields, by synthesizing their wavefront in a complex manner. Yet, backflow is perceived as hard to detect. Here, by utilizing interference in its most basic form, we reveal that backflow in optical fields is robust and surprisingly common, more than it was previously thought to be.


title: Quantum space, ground space traversal, and how to embed multi-prover interactive proofs into unentanglement

abstract: Savitch's theorem states that NPSPACE computations can be simulated in PSPACE. We initiate the study of a quantum analogue of NPSPACE, denoted Streaming-QCMASPACE (SQCMASPACE), where an exponentially long classical proof is streamed to a poly-space quantum verifier. Besides two main results, we also show that a quantum analogue of Savitch's theorem is unlikely to hold, as SQCMASPACE=NEXP. For completeness, we introduce Streaming-QMASPACE (SQMASPACE) with an exponentially long streamed quantum proof, and show SQMASPACE=QMA_EXP (quantum analogue of NEXP). Our first main result shows, in contrast to the classical setting, the solution space of a quantum constraint satisfaction problem (i.e. a local Hamiltonian) is always connected when exponentially long proofs are permitted. For this, we show how to simulate any Lipschitz continuous path on the unit hypersphere via a sequence of local unitary gates, at the expense of blowing up the circuit size. This shows quantum error-correcting codes can be unable to detect one codeword erroneously evolving to another if the evolution happens sufficiently slowly, and answers an open question of [Gharibian, Sikora, ICALP 2015] regarding the Ground State Connectivity problem. Our second main result is that any SQCMASPACE computation can be embedded into "unentanglement", i.e. into a quantum constraint satisfaction problem with unentangled provers. Formally, we show how to embed SQCMASPACE into the Sparse Separable Hamiltonian problem of [Chailloux, Sattath, CCC 2012] (QMA(2)-complete for 1/poly promise gap), at the expense of scaling the promise gap with the streamed proof size. As a corollary, we obtain the first systematic construction for obtaining QMA(2)-type upper bounds on arbitrary multi-prover interactive proof systems, where the QMA(2) promise gap scales exponentially with the number of bits of communication in the interactive proof.


title: The viability of ultralight bosonic dark matter in dwarf galaxies

abstract: The dark matter distribution in dwarf galaxies holds a wealth of information on the fundamental properties and interactions of the dark matter particle. In this paper, we study whether ultralight bosonic dark matter is consistent with the gravitational potential extracted from stellar kinematics. We use velocity dispersion measurements to constrain models for halo mass and particle mass. The posterior likelihood is multimodal. Particle masses of order $m\sim 10^{-22} {\rm{eV}}$ require halos of mass in excess of $\sim 10^{10} M_\odot$, while particle mass of order $m \gtrsim 10^{-20}{\rm{eV}}$ are favored by halos of mass $\sim [10^{8} - 10^{9}] M_\odot$, with a similar behavior to cold dark matter. Regardless of particle mass, the lower halo masses are allowed if stellar dynamics are influenced by the presence of a central black hole of mass at most $\sim 10^{-2}$ the host halo mass. We find no preference for models that contain a black hole over models that do not contain a black hole. Our main conclusion is that either the fuzzy dark matter particle mass must be $m \gtrsim 10^{-20}$ eV, or the Milky Way dwarfs must be unusually heavy given the expected hierarchical assembly of the Milky Way, or the Milky Way dwarfs must contain a central black hole. We find no evidence for either of the last two possibilities and consider them unlikely.


title: List-Decodable Sparse Mean Estimation via Difference-of-Pairs Filtering

abstract: We study the problem of list-decodable sparse mean estimation. Specifically, for a parameter $\alpha \in (0, 1/2)$, we are given $m$ points in $\mathbb{R}^n$, $\lfloor \alpha m \rfloor$ of which are i.i.d. samples from a distribution $D$ with unknown $k$-sparse mean $\mu$. No assumptions are made on the remaining points, which form the majority of the dataset. The goal is to return a small list of candidates containing a vector $\widehat \mu$ such that $\| \widehat \mu - \mu \|_2$ is small. Prior work had studied the problem of list-decodable mean estimation in the dense setting. In this work, we develop a novel, conceptually simpler technique for list-decodable mean estimation. As the main application of our approach, we provide the first sample and computationally efficient algorithm for list-decodable sparse mean estimation. In particular, for distributions with ``certifiably bounded'' $t$-th moments in $k$-sparse directions and sufficiently light tails, our algorithm achieves error of $(1/\alpha)^{O(1/t)}$ with sample complexity $m = (k\log(n))^{O(t)}/\alpha$ and running time $\mathrm{poly}(mn^t)$. For the special case of Gaussian inliers, our algorithm achieves the optimal error guarantee of $\Theta (\sqrt{\log(1/\alpha)})$ with quasi-polynomial sample and computational complexity. We complement our upper bounds with nearly-matching statistical query and low-degree polynomial testing lower bounds.


title: Spatial-mode-demultiplexing for enhanced intensity and distance measurement

abstract: Spatial-mode demultiplexing (SPADE) has recently been adopted to measure the separation in the transverse plane between two incoherent point-like sources. It has been argued that this approach may yield extraordinary performances in the photon-counting regime. Here, we explore SPADE as a tool for precision measurements in the regime of bright, incoherent sources. First we analyse the general problem of estimating the second moments of the source's intensity distribution, for an extended incoherent source of any shape. Second, we present an experimental application of SPADE to the case of two point-like, bright sources. We demonstrate the use of this setup for the estimation of the transverse separation and for the estimation of their relative intensity.


title: Quantum networks boosted by entanglement with a control system

abstract: Networks of quantum devices with coherent control over their configuration offer promising advantages in quantum information processing. So far, the investigation of these advantages assumed that the control system was initially uncorrelated with the data processed by the network. Here, we explore the power of quantum correlations between data and control, showing two communication tasks that can be accomplished with information-erasing channels if and only if the sender shares prior entanglement with a third party (the ``controller'') controlling the network configuration. The first task is to transmit classical messages without leaking information to the controller. The second task is to establish bipartite entanglement with a receiver, or, more generally, to establish multipartite entanglement with a number of spatially separated receivers.


title: Accelerated Algorithms for Constrained Nonconvex-Nonconcave Min-Max Optimization and Comonotone Inclusion

abstract: We study constrained comonotone min-max optimization, a structured class of nonconvex-nonconcave min-max optimization problems, and their generalization to comonotone inclusion. In our first contribution, we extend the Extra Anchored Gradient (EAG) algorithm, originally proposed by Yoon and Ryu (2021) for unconstrained min-max optimization, to constrained comonotone min-max optimization and comonotone inclusion, achieving an optimal convergence rate of $O\left(\frac{1}{T}\right)$ among all first-order methods. Additionally, we prove that the algorithm's iterations converge to a point in the solution set. In our second contribution, we extend the Fast Extra Gradient (FEG) algorithm, as developed by Lee and Kim (2021), to constrained comonotone min-max optimization and comonotone inclusion, achieving the same $O\left(\frac{1}{T}\right)$ convergence rate. This rate is applicable to the broadest set of comonotone inclusion problems yet studied in the literature. Our analyses are based on simple potential function arguments, which might be useful for analyzing other accelerated algorithms.


title: Applications of a perturbation-aware local correlation method to coupled cluster linear response properties

abstract: We have investigated the efficacy of two recently proposed variations of the pair-natural-orbital approach to reducing the scaling of coupled cluster property calculations. In particular, we have extended our implementations of the PNO++ and combined PNO++ methods, which make use of field-aware pair-densities to define the virtual-orbital spaces used to describe electron correlation effects, in order to test their accuracy, efficiency, and robustness on larger molecular systems than previously investigated. For fluoroalkane chains up to 1-fluoroheptane we find that the PNO++ and combined PNO++ methods yield smaller localization errors in response properties than PNO for similarly compact virtual spaces, and, while the PNO method performs better than the PNO++ method for correlation energies, the combined PNO++ method recovers similar accuracy for correlation energies to the PNO method. For more three-dimensional molecular structures such as $\alpha$- and $\beta-$pinenes, the PNO, PNO++, and combined PNO++ methods all yield similar errors for response properties, whereas for ($S$)-1-phenylethanol, the PNO method performs slightly better than the other two approaches. We also investigate the use of a product density to define the virtual space, as well as two candidates for defining weak-pair contributions.


title: Quantum Go: Designing a Proof-of-Concept on Quantum Computer

abstract: The strategic Go game, known for the tedious mathematical complexities, has been used as a theme in many fiction, movies, and books. Here, we introduce the Go game and provide a new version of quantum Go in which the boxes are initially in a superposition of quantum states |0> and |1> and the players have two kinds of moves (classical and quantum) to mark each box. The mark on each box depends on the state to which the qubit collapses after the measurement. All other rules remain the same, except for here, we capture only one stone and not chains. Due to the enormous power and exponential speed-up of quantum computers as compared to classical computers, we may think of quantum computing as the future. So, here we provide a tangible introduction to superposition, collapse, and entanglement via our version of quantum Go. Finally, we compare the classical complexity with the quantum complexity involved in playing the Go game.


title: Binarity and beyond in A stars I. Survey description and first results of VLTI/GRAVITY observations of VAST targets with high Gaia-Hipparcos accelerations

abstract: A-stars are the progenitors of about half of the white dwarfs (WDs) that currently exist. The connection between the multiplicity of A-stars and that of WDs is not known and the observational mapping of both multiplicities are far from complete. Possible companions at separations of tens of AU are particularly poorly explored. We are conducting a near-infrared interferometric survey with VLTI/GRAVITY of twenty out of 108 southern A stars within the VAST sample which show large Gaia-Hipparcos proper motion changes suggestive of a $M \sim 1 M_{\odot}$ companion at separations of $1-20$ AU. In this paper, we detail our sample selection and report on the interferometric detection of $8_{-0}^{+2}$ new stars (including four high multiplicity (3+) systems) in a partial sample of 13 targets. Moreover, we also conduct a common proper motion search for the 108 A stars using Gaia eDR3 and which resulted in 10 new detections and confirmation of several previous Adaptive Optics companions as physical. We discuss our preliminary results in the context of the separation distribution of A stars and implications for the multiplicity of WDs. In particular, we find that (i) the apparent suppression of companions to A stars below about 30-50 AU is very likely due to an observational bias, (ii) the fact that 4 of the 6 closest WDs have a companion within a few tens of AU is a statistical fluke but 10-20 such binaries are likely still missing within 20 pc, (iii) a large fraction of such systems likely had high multiplicity (3+) progenitors with very close ($< 1$ AU) companions to the primary A star, and must therefore have undergone non-trivial evolution.


title: Lost in Transmission: On the Impact of Networking Corruptions on Video Machine Learning Models

abstract: We study how networking corruptions--data corruptions caused by networking errors--affect video machine learning (ML) models. We discover apparent networking corruptions in Kinetics-400, a benchmark video ML dataset. In a simulation study, we investigate (1) what artifacts networking corruptions cause, (2) how such artifacts affect ML models, and (3) whether standard robustness methods can mitigate their negative effects. We find that networking corruptions cause visual and temporal artifacts (i.e., smeared colors or frame drops). These networking corruptions degrade performance on a variety of video ML tasks, but effects vary by task and dataset, depending on how much temporal context the tasks require. Lastly, we evaluate data augmentation--a standard defense for data corruptions--but find that it does not recover performance.


title: Rethinking Spatial Invariance of Convolutional Networks for Object Counting

abstract: Previous work generally believes that improving the spatial invariance of convolutional networks is the key to object counting. However, after verifying several mainstream counting networks, we surprisingly found too strict pixel-level spatial invariance would cause overfit noise in the density map generation. In this paper, we try to use locally connected Gaussian kernels to replace the original convolution filter to estimate the spatial position in the density map. The purpose of this is to allow the feature extraction process to potentially stimulate the density map generation process to overcome the annotation noise. Inspired by previous work, we propose a low-rank approximation accompanied with translation invariance to favorably implement the approximation of massive Gaussian convolution. Our work points a new direction for follow-up research, which should investigate how to properly relax the overly strict pixel-level spatial invariance for object counting. We evaluate our methods on 4 mainstream object counting networks (i.e., MCNN, CSRNet, SANet, and ResNet-50). Extensive experiments were conducted on 7 popular benchmarks for 3 applications (i.e., crowd, vehicle, and plant counting). Experimental results show that our methods significantly outperform other state-of-the-art methods and achieve promising learning of the spatial position of objects.


title: Formation of robust bound states of interacting microwave photons

abstract: Systems of correlated particles appear in many fields of science and represent some of the most intractable puzzles in nature. The computational challenge in these systems arises when interactions become comparable to other energy scales, which makes the state of each particle depend on all other particles. The lack of general solutions for the 3-body problem and acceptable theory for strongly correlated electrons shows that our understanding of correlated systems fades when the particle number or the interaction strength increases. One of the hallmarks of interacting systems is the formation of multi-particle bound states. In a ring of 24 superconducting qubits, we develop a high fidelity parameterizable fSim gate that we use to implement the periodic quantum circuit of the spin-1/2 XXZ model, an archetypal model of interaction. By placing microwave photons in adjacent qubit sites, we study the propagation of these excitations and observe their bound nature for up to 5 photons. We devise a phase sensitive method for constructing the few-body spectrum of the bound states and extract their pseudo-charge by introducing a synthetic flux. By introducing interactions between the ring and additional qubits, we observe an unexpected resilience of the bound states to integrability breaking. This finding goes against the common wisdom that bound states in non-integrable systems are unstable when their energies overlap with the continuum spectrum. Our work provides experimental evidence for bound states of interacting photons and discovers their stability beyond the integrability limit.


title: Interactively Learning Preference Constraints in Linear Bandits

abstract: We study sequential decision-making with known rewards and unknown constraints, motivated by situations where the constraints represent expensive-to-evaluate human preferences, such as safe and comfortable driving behavior. We formalize the challenge of interactively learning about these constraints as a novel linear bandit problem which we call constrained linear best-arm identification. To solve this problem, we propose the Adaptive Constraint Learning (ACOL) algorithm. We provide an instance-dependent lower bound for constrained linear best-arm identification and show that ACOL's sample complexity matches the lower bound in the worst-case. In the average case, ACOL's sample complexity bound is still significantly tighter than bounds of simpler approaches. In synthetic experiments, ACOL performs on par with an oracle solution and outperforms a range of baselines. As an application, we consider learning constraints to represent human preferences in a driving simulation. ACOL is significantly more sample efficient than alternatives for this application. Further, we find that learning preferences as constraints is more robust to changes in the driving scenario than encoding the preferences directly in the reward function.


title: Generic Reed-Solomon codes achieve list-decoding capacity

abstract: In a recent paper, Brakensiek, Gopi and Makam introduced higher order MDS codes as a generalization of MDS codes. An order-$\ell$ MDS code, denoted by $\operatorname{MDS}(\ell)$, has the property that any $\ell$ subspaces formed from columns of its generator matrix intersect as minimally as possible. An independent work by Roth defined a different notion of higher order MDS codes as those achieving a generalized singleton bound for list-decoding. In this work, we show that these two notions of higher order MDS codes are (nearly) equivalent. We also show that generic Reed-Solomon codes are $\operatorname{MDS}(\ell)$ for all $\ell$, relying crucially on the GM-MDS theorem which shows that generator matrices of generic Reed-Solomon codes achieve any possible zero pattern. As a corollary, this implies that generic Reed-Solomon codes achieve list decoding capacity. More concretely, we show that, with high probability, a random Reed-Solomon code of rate $R$ over an exponentially large field is list decodable from radius $1-R-\epsilon$ with list size at most $\frac{1-R-\epsilon}{\epsilon}$, resolving a conjecture of Shangguan and Tamo.


title: Explaining Image Classifiers Using Contrastive Counterfactuals in Generative Latent Spaces

abstract: Despite their high accuracies, modern complex image classifiers cannot be trusted for sensitive tasks due to their unknown decision-making process and potential biases. Counterfactual explanations are very effective in providing transparency for these black-box algorithms. Nevertheless, generating counterfactuals that can have a consistent impact on classifier outputs and yet expose interpretable feature changes is a very challenging task. We introduce a novel method to generate causal and yet interpretable counterfactual explanations for image classifiers using pretrained generative models without any re-training or conditioning. The generative models in this technique are not bound to be trained on the same data as the target classifier. We use this framework to obtain contrastive and causal sufficiency and necessity scores as global explanations for black-box classifiers. On the task of face attribute classification, we show how different attributes influence the classifier output by providing both causal and contrastive feature attributions, and the corresponding counterfactual images.


title: Spectral analysis of ultra-cool white dwarfs polluted by planetary debris

abstract: We identify two ultra-cool ($T_\mathrm{eff} < 4000$ K) metal-polluted (DZ) white dwarfs WDJ2147$-$4035 and WDJ1922$+$0233 as the coolest and second coolest DZ stars known to date with $T_\mathrm{eff} \approx 3050$ K and $T_\mathrm{eff} \approx 3340$ K, respectively. Strong atmospheric collision-induced absorption (CIA) causes the suppression of red optical and infra-red flux in WDJ1922$+$0233, resulting in an unusually blue colour given its low temperature. WDJ2147$-$4035 has moderate infra-red CIA yet has the reddest optical colours known for a DZ white dwarf. Microphysics improvements to the non-ideal effects and CIA opacities in our model atmosphere code yields reasonable solutions to observations of these ultra-cool stars. WDJ2147$-$4035 has a cooling age of over 10 Gyr which is the largest known for a DZ white dwarf, whereas WDJ1922$+$0233 is slightly younger with a cooling age of 9 Gyr. Galactic kinematics calculations from precise Gaia EDR3 astrometry reveal these ultra-cool DZ stars as likely members of the Galactic disc thus they could be pivotal objects in future studies constraining an upper age limit for the disc of the Milky Way. We present intermediate-resolution spectroscopy for both objects, which provides the first spectroscopic observations of WDJ2147$-$4035. Detections of sodium and potassium are made in both white dwarfs, in addition to calcium in WDJ1922$+$0233 and lithium in WDJ2147$-$4035. We identify the magnetic nature of WDJ2147$-$4035 from Zeeman splitting in the lithium line and also make a tentative detection of carbon, so we classify this star as DZQH. WDJ1922$+$0233 likely accreted planetary crust debris, while the debris composition that polluted WDJ2147$-$4035 remains unconstrained.


title: Is Self-Supervised Learning More Robust Than Supervised Learning?

abstract: Self-supervised contrastive learning is a powerful tool to learn visual representation without labels. Prior work has primarily focused on evaluating the recognition accuracy of various pre-training algorithms, but has overlooked other behavioral aspects. In addition to accuracy, distributional robustness plays a critical role in the reliability of machine learning models. We design and conduct a series of robustness tests to quantify the behavioral differences between contrastive learning and supervised learning to downstream or pre-training data distribution changes. These tests leverage data corruptions at multiple levels, ranging from pixel-level gamma distortion to patch-level shuffling and to dataset-level distribution shift. Our tests unveil intriguing robustness behaviors of contrastive and supervised learning. On the one hand, under downstream corruptions, we generally observe that contrastive learning is surprisingly more robust than supervised learning. On the other hand, under pre-training corruptions, we find contrastive learning vulnerable to patch shuffling and pixel intensity change, yet less sensitive to dataset-level distribution change. We attempt to explain these results through the role of data augmentation and feature space properties. Our insight has implications in improving the downstream robustness of supervised learning.


title: Balanced Product of Calibrated Experts for Long-Tailed Recognition

abstract: Many real-world recognition problems are characterized by long-tailed label distributions. These distributions make representation learning highly challenging due to limited generalization over the tail classes. If the test distribution differs from the training distribution, e.g. uniform versus long-tailed, the problem of the distribution shift needs to be addressed. A recent line of work proposes learning multiple diverse experts to tackle this issue. Ensemble diversity is encouraged by various techniques, e.g. by specializing different experts in the head and the tail classes. In this work, we take an analytical approach and extend the notion of logit adjustment to ensembles to form a Balanced Product of Experts (BalPoE). BalPoE combines a family of experts with different test-time target distributions, generalizing several previous approaches. We show how to properly define these distributions and combine the experts in order to achieve unbiased predictions, by proving that the ensemble is Fisher-consistent for minimizing the balanced error. Our theoretical analysis shows that our balanced ensemble requires calibrated experts, which we achieve in practice using mixup. We conduct extensive experiments and our method obtains new state-of-the-art results on three long-tailed datasets: CIFAR-100-LT, ImageNet-LT, and iNaturalist-2018. Our code is available at https://github.com/emasa/BalPoE-CalibratedLT.


title: Controllable Floquet edge modes in a multi-frequency driving system

abstract: A driven quantum system has been recently studied in the context of nonequilibrium phase transitions and their responses. In particular, for a periodically driven system, its dynamics are described in terms of the multi-dimensional Floquet lattice with a lattice size depending on number of driving frequencies and their rational or irrational ratio. So far, for a multi-frequency driving system, the energy pumping between the sources of frequencies has been widely discussed as a signature of topologically nontrivial Floquet bands. However, the unique edge modes emerging in the Floquet lattice has not been explored yet. Here, we discuss how the edge modes in the Floquet lattice are controlled and result in the localization at particular frequencies, when multiple frequencies are present and their magnitudes are commensurate values. First, we construct the minimal model to exemplify our argument, focusing on a two-level system with two driving frequencies. For strong frequency limit, one can describe the system as a quasi-one dimensional Floquet lattice where the effective hopping between the neighboring sites depends on the relative magnitudes of potential for two frequency modes. With multiple driving modes, there always exist the non-trivial Floquet lattice boundaries via controlling the frequencies and this gives rise to the states that are mostly localized at such Floquet lattice boundaries, i.e. particular frequencies. We suggest the time-dependent Creutz ladder model as a realization of our theoretical Hamiltonian and show the emergence of controllable Floquet edge modes.


title: Meta Optimal Transport

abstract: We study the use of amortized optimization to predict optimal transport (OT) maps from the input measures, which we call Meta OT. This helps repeatedly solve similar OT problems between different measures by leveraging the knowledge and information present from past problems to rapidly predict and solve new problems. Otherwise, standard methods ignore the knowledge of the past solutions and suboptimally re-solve each problem from scratch. We instantiate Meta OT models in discrete and continuous settings between grayscale images, spherical data, classification labels, and color palettes and use them to improve the computational time of standard OT solvers. Our source code is available at http://github.com/facebookresearch/meta-ot


title: Causal Balancing for Domain Generalization

abstract: While machine learning models rapidly advance the state-of-the-art on various real-world tasks, out-of-domain (OOD) generalization remains a challenging problem given the vulnerability of these models to spurious correlations. We propose a balanced mini-batch sampling strategy to transform a biased data distribution into a spurious-free balanced distribution, based on the invariance of the underlying causal mechanisms for the data generation process. We argue that the Bayes optimal classifiers trained on such balanced distribution are minimax optimal across a diverse enough environment space. We also provide an identifiability guarantee of the latent variable model of the proposed data generation process, when utilizing enough train environments. Experiments are conducted on DomainBed, demonstrating empirically that our method obtains the best performance across 20 baselines reported on the benchmark.


title: Theory of Moire Magnets and Topological Magnons: Applications to Twisted Bilayer CrI3

abstract: We develop a comprehensive theory of twisted bilayer magnetism. Starting from the first-principles calculations of two-dimensional honeycomb magnet CrI3, we construct the generic spin models that represent a broad class of twisted bilayer magnetic systems. Using Monte-Carlo method, we discover a variety of non-collinear magnetic orders and topological magnons that have been overlooked in the previous theoretical and experimental studies. As a function of the twist angle, the collinear magnetic order undergoes the phase transitions to the non-collinear order and the magnetic domain phase. In the magnetic domain phase, we find that the spatially varying interlayer coupling produces the magnetic skyrmions even in the absence of the Dzyaloshinskii-Moriya interactions. In addition, we describe the critical phenomena of the magnetic phase transitions by constructing the field theoretical model of the moire magnet. Our continuum model well-explains the nature of the phase transitions observed in the numerical simulations. Finally, we classify the topological properties of the magnon excitations. The magnons in each phases are characterized by the distinct mass gaps with different physical origins. In the collinear ferromagnetic order, the higher-order topological magnonic insulator phase occurs. It serves as a unique example of the higher-order topological phase in magnonic system, since it does not require non-collinear order or asymmetric form of the interactions. In the magnetic domain phases, the magnons are localized along the domain wall and form one-dimensional topological edge mode. As the closed domain walls deform to a open network, the confined edge mode extends to form a network model of the topological magnons.


title: When Does Adaptivity Help for Quantum State Learning?

abstract: We consider the classic question of state tomography: given copies of an unknown quantum state $\rho\in\mathbb{C}^{d\times d}$, output $\widehat{\rho}$ which is close to $\rho$ in some sense, e.g. trace distance or fidelity. When one is allowed to make coherent measurements entangled across all copies, $\Theta(d^2/\epsilon^2)$ copies are necessary and sufficient to get trace distance $\epsilon$. Unfortunately, the protocols achieving this rate incur large quantum memory overheads that preclude implementation on near-term devices. On the other hand, the best known protocol using incoherent (single-copy) measurements uses $O(d^3/\epsilon^2)$ copies, and multiple papers have posed it as an open question to understand whether or not this rate is tight. In this work, we fully resolve this question, by showing that any protocol using incoherent measurements, even if they are chosen adaptively, requires $\Omega(d^3/\epsilon^2)$ copies, matching the best known upper bound. We do so by a new proof technique which directly bounds the ``tilt'' of the posterior distribution after measurements, which yields a surprisingly short proof of our lower bound, and which we believe may be of independent interest. While this implies that adaptivity does not help for tomography with respect to trace distance, we show that it actually does help for tomography with respect to infidelity. We give an adaptive algorithm that outputs a state which is $\gamma$-close in infidelity to $\rho$ using only $\tilde{O}(d^3/\gamma)$ copies, which is optimal for incoherent measurements. In contrast, it is known that any nonadaptive algorithm requires $\Omega(d^3/\gamma^2)$ copies. While it is folklore that in $2$ dimensions, one can achieve a scaling of $O(1/\gamma)$, to the best of our knowledge, our algorithm is the first to achieve the optimal rate in all dimensions.


title: Does Self-supervised Learning Really Improve Reinforcement Learning from Pixels?

abstract: We investigate whether self-supervised learning (SSL) can improve online reinforcement learning (RL) from pixels. We extend the contrastive reinforcement learning framework (e.g., CURL) that jointly optimizes SSL and RL losses and conduct an extensive amount of experiments with various self-supervised losses. Our observations suggest that the existing SSL framework for RL fails to bring meaningful improvement over the baselines only taking advantage of image augmentation when the same amount of data and augmentation is used. We further perform evolutionary searches to find the optimal combination of multiple self-supervised losses for RL, but find that even such a loss combination fails to meaningfully outperform the methods that only utilize carefully designed image augmentations. After evaluating these approaches together in multiple different environments including a real-world robot environment, we confirm that no single self-supervised loss or image augmentation method can dominate all environments and that the current framework for joint optimization of SSL and RL is limited. Finally, we conduct the ablation study on multiple factors and demonstrate the properties of representations learned with different approaches.


title: CONTINUER: Maintaining Distributed DNN Services During Edge Failures

abstract: Partitioning and deploying Deep Neural Networks (DNNs) across edge nodes may be used to meet performance objectives of applications. However, the failure of a single node may result in cascading failures that will adversely impact the delivery of the service and will result in failure to meet specific objectives. The impact of these failures needs to be minimised at runtime. Three techniques are explored in this paper, namely repartitioning, early-exit and skip-connection. When an edge node fails, the repartitioning technique will repartition and redeploy the DNN thus avoiding the failed nodes. The early-exit technique makes provision for a request to exit (early) before the failed node. The skip connection technique dynamically routes the request by skipping the failed nodes. This paper will leverage trade-offs in accuracy, end-to-end latency and downtime for selecting the best technique given user-defined objectives (accuracy, latency and downtime thresholds) when an edge node fails. To this end, CONTINUER is developed. Two key activities of the framework are estimating the accuracy and latency when using the techniques for distributed DNNs and selecting the best technique. It is demonstrated on a lab-based experimental testbed that CONTINUER estimates accuracy and latency when using the techniques with no more than an average error of 0.28% and 13.06%, respectively and selects the suitable technique with a low overhead of no more than 16.82 milliseconds and an accuracy of up to 99.86%.


title: A heuristic method for data allocation and task scheduling on heterogeneous multiprocessor systems under memory constraints

abstract: Computing workflows in heterogeneous multiprocessor systems are frequently modeled as directed acyclic graphs of tasks and data blocks, which represent computational modules and their dependencies in the form of data produced by a task and used by others. However, for some workflows, such as the task schedule in a digital signal processor may run out of memory by exposing too much parallelism. This paper focuses on the data allocation and task scheduling problem under memory constraints, and concentrates on shared memory platforms. We first propose an integer linear programming model to formulate the problem. Then we consider the problem as an extended flexible job shop scheduling problem, while trying to minimize the critical path of the graph. To solve this problem, we propose a tabu search algorithm (TS) which combines several distinguished features such as a greedy initial solution construction method and a mixed neighborhood evaluation strategy based on exact evaluation and approximate evaluation methods. Experimental results on randomly generated instances show that the the proposed TS algorithm can obtain relatively high-quality solutions in a reasonable computational time. In specific, the tabu search method averagely improves the makespan by 5-25\% compared to the classical load balancing algorithm that are widely used in the literature. Besides, some key features of TS are also analyzed to identify its success factors.