title: Early- and in-season crop type mapping without current-year ground truth: generating labels from historical information via a topology-based approach

abstract: Land cover classification in remote sensing is often faced with the challenge of limited ground truth. Incorporating historical information has the potential to significantly lower the expensive cost associated with collecting ground truth and, more importantly, enable early- and in-season mapping that is helpful to many pre-harvest decisions. In this study, we propose a new approach that can effectively transfer knowledge about the topology (i.e. relative position) of different crop types in the spectral feature space (e.g. the histogram of SWIR1 vs RDEG1 bands) to generate labels, thereby support crop classification in a different year. Importantly, our approach does not attempt to transfer classification decision boundaries that are susceptible to inter-annual variations of weather and management, but relies on the more robust and shift-invariant topology information. We tested this approach for mapping corn/soybeans in the US Midwest and paddy rice/corn/soybeans in Northeast China using Landsat-8 and Sentinel-2 data. Results show that our approach automatically generates high-quality labels for crops in the target year immediately after each image becomes available. Based on these generated labels from our approach, the subsequent crop type mapping using a random forest classifier reach the F1 score as high as 0.887 for corn as early as the silking stage and 0.851 for soybean as early as the flowering stage and the overall accuracy of 0.873 in Iowa. In Northeast China, F1 scores of paddy rice, corn and soybeans and the overall accuracy can exceed 0.85 two and half months ahead of harvest. Overall, these results highlight unique advantages of our approach in transferring historical knowledge and maximizing the timeliness of crop maps. Our approach supports a general paradigm shift towards learning transferrable and generalizable knowledge to facilitate land cover classification.


title: CIMTx: An R package for causal inference with multiple treatments using observational data

abstract: CIMTx provides efficient and unified functions to implement modern methods for causal inferences with multiple treatments using observational data with a focus on binary outcomes. The methods include regression adjustment, inverse probability of treatment weighting, Bayesian additive regression trees, regression adjustment with multivariate spline of the generalized propensity score, vector matching and targeted maximum likelihood estimation. In addition, CIMTx illustrates ways in which users can simulate data adhering to the complex data structures in the multiple treatment setting. Furthermore, the CIMTx package offers a unique set of features to address the key causal assumptions: positivity and ignorability. For the positivity assumption, CIMTx demonstrates techniques to identify the common support region for retaining inferential units using inverse probability of treatment weighting, Bayesian additive regression trees and vector matching}. To handle the ignorability assumption, CIMTx provides a flexible Monte Carlo sensitivity analysis approach to evaluate how causal conclusions would be altered in response to different magnitude of departure from ignorable treatment assignment.


title: A Deep Generative Approach to Conditional Sampling

abstract: We propose a deep generative approach to sampling from a conditional distribution based on a unified formulation of conditional distribution and generalized nonparametric regression function using the noise-outsourcing lemma. The proposed approach aims at learning a conditional generator so that a random sample from the target conditional distribution can be obtained by the action of the conditional generator on a sample drawn from a reference distribution. The conditional generator is estimated nonparametrically with neural networks by matching appropriate joint distributions using the Kullback-Liebler divergence. An appealing aspect of our method is that it allows either of or both the predictor and the response to be high-dimensional and can handle both continuous and discrete type predictors and responses. We show that the proposed method is consistent in the sense that the conditional generator converges in distribution to the underlying conditional distribution under mild conditions. Our numerical experiments with simulated and benchmark image data validate the proposed method and demonstrate that it outperforms several existing conditional density estimation methods.


title: Fine-Grained Control of Artistic Styles in Image Generation

abstract: Recent advances in generative models and adversarial training have enabled artificially generating artworks in various artistic styles. It is highly desirable to gain more control over the generated style in practice. However, artistic styles are unlike object categories -- there are a continuous spectrum of styles distinguished by subtle differences. Few works have been explored to capture the continuous spectrum of styles and apply it to a style generation task. In this paper, we propose to achieve this by embedding original artwork examples into a continuous style space. The style vectors are fed to the generator and discriminator to achieve fine-grained control. Our method can be used with common generative adversarial networks (such as StyleGAN). Experiments show that our method not only precisely controls the fine-grained artistic style but also improves image quality over vanilla StyleGAN as measured by FID.


title: Factorization Approach for Low-complexity Matrix Completion Problems: Exponential Number of Spurious Solutions and Failure of Gradient Methods

abstract: It is well-known that the Burer-Monteiro (B-M) factorization approach can efficiently solve low-rank matrix optimization problems under the RIP condition. It is natural to ask whether B-M factorization-based methods can succeed on any low-rank matrix optimization problems with a low information-theoretic complexity, i.e., polynomial-time solvable problems that have a unique solution. In this work, we provide a negative answer to the above question. We investigate the landscape of B-M factorized polynomial-time solvable matrix completion (MC) problems, which are the most popular subclass of low-rank matrix optimization problems without the RIP condition. We construct an instance of polynomial-time solvable MC problems with exponentially many spurious local minima, which leads to the failure of most gradient-based methods. Based on those results, we define a new complexity metric that potentially measures the solvability of low-rank matrix optimization problems based on the B-M factorization approach. In addition, we show that more measurements of the ground truth matrix can deteriorate the landscape, which further reveals the unfavorable behavior of the B-M factorization on general low-rank matrix optimization problems.


title: Logical fermions for fault-tolerant quantum simulation

abstract: We show how to absorb fermionic quantum simulation's expensive fermion-to-qubit mapping overhead into the overhead already incurred by surface-code-based fault-tolerant quantum computing. The key idea is to process information in surface-code twist defects, which behave like logical Majorana fermions. Our approach encodes Dirac fermions, a key data type for simulation applications, directly into logical Majorana fermions rather than atop a logical qubit layer in the architecture. Using quantum simulation of the $N$-fermion 2D Fermi-Hubbard model as an exemplar, we demonstrate two immediate algorithmic improvements. First, by preserving the model's locality at the logical level, we reduce the asymptotic Trotter-Suzuki quantum circuit depth from $\mathcal{O}(\sqrt{N})$ in a typical Jordan-Wigner encoding to $\mathcal{O}(1)$ in our encoding. Second, by exploiting optimizations manifest for logical fermions but less obvious for logical qubits, we reduce the $T$-count of the block-encoding \textsc{select} oracle by 20\% over standard implementations, even when realized by logical qubits and not logical fermions.


title: Joint Gaussian Graphical Model Estimation: A Survey

abstract: Graphs from complex systems often share a partial underlying structure across domains while retaining individual features. Thus, identifying common structures can shed light on the underlying signal, for instance, when applied to scientific discoveries or clinical diagnoses. Furthermore, growing evidence shows that the shared structure across domains boosts the estimation power of graphs, particularly for high-dimensional data. However, building a joint estimator to extract the common structure may be more complicated than it seems, most often due to data heterogeneity across sources. This manuscript surveys recent work on statistical inference of joint Gaussian graphical models, identifying model structures that fit various data generation processes. Simulations under different data generation processes are implemented with detailed discussions on the choice of models.


title: Moderately misaligned orbit of the warm sub-Saturn HD 332231 b

abstract: Measurements of exoplanetary orbital obliquity angles for different classes of planets are an essential tool in testing various planet formation theories. Measurements for those transiting planets on relatively large orbital periods ($P$\,$>$\,10\,d) present a rather difficult observational challenge. Here we present the obliquity measurement for the warm sub-Saturn planet HD\,332231\,b, which was discovered through Transiting Exoplanet Survey Satellite (TESS) photometry of sectors 14 and 15, on a relatively large orbital period (18.7\,d). Through a joint analysis of previously obtained spectroscopic data and our newly obtained CARMENES transit observations, we estimated the spin-orbit misalignment angle, \textlambda, to be $-42.0^{+11.3}_{-10.6}$\,$\deg$, which challenges Laplacian ideals of planet formation. Through the addition of these new radial velocity (RV) data points obtained with CARMENES, we also derived marginal improvements on other orbital and bulk parameters for the planet, as compared to previously published values. We showed the robustness of the obliquity measurement through model comparison with an aligned orbit. Finally, we demonstrated the inability of the obtained data to probe any possible extended atmosphere of the planet, due to a lack of precision, and place the atmosphere in the context of a parameter detection space.


title: Fine-Grained Complexity Theory: Conditional Lower Bounds for Computational Geometry

abstract: Fine-grained complexity theory is the area of theoretical computer science that proves conditional lower bounds based on the Strong Exponential Time Hypothesis and similar conjectures. This area has been thriving in the last decade, leading to conditionally best-possible algorithms for a wide variety of problems on graphs, strings, numbers etc. This article is an introduction to fine-grained lower bounds in computational geometry, with a focus on lower bounds for polynomial-time problems based on the Orthogonal Vectors Hypothesis. Specifically, we discuss conditional lower bounds for nearest neighbor search under the Euclidean distance and Fr\'echet distance.


title: flip-hoisting: Exploiting Repeated Parameters in Discrete Probabilistic Programs

abstract: Many of today's probabilistic programming languages (PPLs) have brittle inference performance: the performance of the underlying inference algorithm is very sensitive to the precise way in which the probabilistic program is written. A standard way of addressing this challenge in traditional programming languages is via program optimizations, which seek to unburden the programmer from writing low-level performant code, freeing them to work at a higher-level of abstraction. The arsenal of applicable program optimizations for PPLs to choose from is scarce in comparison to traditional programs; few of today's PPLs offer significant forms of automated program optimization. In this work we develop a new family of program optimizations specific to discrete-valued knowledge compilation based PPLs. We identify a particular form of program structure unique to these PPLs that tangibly affects exact inference performance in these programs: redundant random variables -- variables with repeated parameters and inconsistent path conditions. We develop a new program analysis and associated optimization called flip-hoisting that identifies these redundancies and optimizes them into a single random variable. We show that flip-hoisting yields inference speedups of up to 60% on applications of probabilistic programs such as Bayesian networks and probabilistic verification.


title: CUI @ Auto-UI: Exploring the Fortunate and Unfortunate Futures of Conversational Automotive User Interfaces

abstract: This work aims to connect the Automotive User Interfaces (Auto-UI) and Conversational User Interfaces (CUI) communities through discussion of their shared view of the future of automotive conversational user interfaces. The workshop aims to encourage creative consideration of optimistic and pessimistic futures, encouraging attendees to explore the opportunities and barriers that lie ahead through a game. Considerations of the future will be mapped out in greater detail through the drafting of research agendas, by which attendees will get to know each other's expertise and networks of resources. The two day workshop, consisting of two 90-minute sessions, will facilitate greater communication and collaboration between these communities, connecting researchers to work together to influence the futures they imagine in the workshop.


title: Robust Semi-Supervised Classification using GANs with Self-Organizing Maps

abstract: Generative adversarial networks (GANs) have shown tremendous promise in learning to generate data and effective at aiding semi-supervised classification. However, to this point, semi-supervised GAN methods make the assumption that the unlabeled data set contains only samples of the joint distribution of the classes of interest, referred to as inliers. Consequently, when presented with a sample from other distributions, referred to as outliers, GANs perform poorly at determining that it is not qualified to make a decision on the sample. The problem of discriminating outliers from inliers while maintaining classification accuracy is referred to here as the DOIC problem. In this work, we describe an architecture that combines self-organizing maps (SOMs) with SS-GANS with the goal of mitigating the DOIC problem and experimental results indicating that the architecture achieves the goal. Multiple experiments were conducted on hyperspectral image data sets. The SS-GANS performed slightly better than supervised GANS on classification problems with and without the SOM. Incorporating the SOMs into the SS-GANs and the supervised GANS led to substantially mitigation of the DOIC problem when compared to SS-GANS and GANs without the SOMs. Furthermore, the SS-GANS performed much better than GANS on the DOIC problem, even without the SOMs.


title: Multi-concept adversarial attacks

abstract: As machine learning (ML) techniques are being increasingly used in many applications, their vulnerability to adversarial attacks becomes well-known. Test time attacks, usually launched by adding adversarial noise to test instances, have been shown effective against the deployed ML models. In practice, one test input may be leveraged by different ML models. Test time attacks targeting a single ML model often neglect their impact on other ML models. In this work, we empirically demonstrate that naively attacking the classifier learning one concept may negatively impact classifiers trained to learn other concepts. For example, for the online image classification scenario, when the Gender classifier is under attack, the (wearing) Glasses classifier is simultaneously attacked with the accuracy dropped from 98.69 to 88.42. This raises an interesting question: is it possible to attack one set of classifiers without impacting the other set that uses the same test instance? Answers to the above research question have interesting implications for protecting privacy against ML model misuse. Attacking ML models that pose unnecessary risks of privacy invasion can be an important tool for protecting individuals from harmful privacy exploitation. In this paper, we address the above research question by developing novel attack techniques that can simultaneously attack one set of ML models while preserving the accuracy of the other. In the case of linear classifiers, we provide a theoretical framework for finding an optimal solution to generate such adversarial examples. Using this theoretical framework, we develop a multi-concept attack strategy in the context of deep learning. Our results demonstrate that our techniques can successfully attack the target classes while protecting the protected classes in many different settings, which is not possible with the existing test-time attack-single strategies.


title: Discriminating quantum gravity models by gravitational decoherence

abstract: Several phenomenological approaches to quantum gravity predict the existence of a minimal measurable length and/or a maximum measurable momentum near the Planck scale. When embedded into the framework of quantum mechanics, such constraints induce a modification of the canonical commutation relations and thus a generalization of the Heisenberg uncertainty relations, commonly referred to as generalized uncertainty principle (GUP). Different models of quantum gravity imply different forms of the GUP. For instance, in the framework of string theory the GUP is quadratic in the momentum operator, while in the context of doubly special relativity it includes an additional linear dependence. Among the possible physical consequences, it was recently shown that the quadratic GUP induces a universal decoherence mechanism, provided one assumes a foamy structure of quantum spacetime close to the Planck length. Along this line, in the present work we investigate the gravitational decoherence associated to the linear-quadratic GUP and we compare it with the one associated to the quadratic GUP. We find that, despite their similarities, the two generalizations of the Heisenberg uncertainty principle yield decoherence times that are completely uncorrelated and significantly distinct. Motivated by this result, we introduce a theoretical and experimental scheme based on cavity optomechanics to measure the different time evolution of nonlocal quantum correlations corresponding to the two aforementioned decoherence mechanisms. We find that the deviation between the two predictions occurs on time scales that are macroscopic and thus potentially amenable to experimental verification. This scenario provides a possible setting to discriminate between different forms of the GUP and therefore different models of quantum gravity.


title: On Coordinate Decoding for Keypoint Estimation Tasks

abstract: A series of 2D (and 3D) keypoint estimation tasks are built upon heatmap coordinate representation, i.e. a probability map that allows for learnable and spatially aware encoding and decoding of keypoint coordinates on grids, even allowing for sub-pixel coordinate accuracy. In this report, we aim to reproduce the findings of DARK that investigated the 2D heatmap representation by highlighting the importance of the encoding of the ground truth heatmap and the decoding of the predicted heatmap to keypoint coordinates. The authors claim that a) a more principled distribution-aware coordinate decoding method overcomes the limitations of the standard techniques widely used in the literature, and b), that the reconstruction of heatmaps from ground-truth coordinates by generating accurate and continuous heatmap distributions lead to unbiased model training, contrary to the standard coordinate encoding process that quantizes the keypoint coordinates on the resolution of the input image grid.


title: Positron Acceleration in an Elongated Bubble Regime

abstract: A new concept is proposed for accelerating positrons in a nonlinear plasma wakefield accelerator. By loading the wakefield (back of the plasma bubble) with a short electron bunch, an extended area of excessive plasma electron accumulation is created after the first bubble, resulting in a favorable region with simultaneous focusing and accelerating fields for positrons. Scaling laws for optimized loading parameters are obtained through extensive parameters scans. Owing to the good quality of the focusing field, positron acceleration with emittance preservation can be achieved in this new regime and it has been demonstrated in the three-dimensional particle-in-cell simulations.


title: A Deeper Look into RowHammer`s Sensitivities: Experimental Analysis of Real DRAM Chips and Implications on Future Attacks and Defenses

abstract: RowHammer is a circuit-level DRAM vulnerability where repeatedly accessing (i.e., hammering) a DRAM row can cause bit flips in physically nearby rows. The RowHammer vulnerability worsens as DRAM cell size and cell-to-cell spacing shrink. Recent studies demonstrate that modern DRAM chips, including chips previously marketed as RowHammer-safe, are even more vulnerable to RowHammer than older chips such that the required hammer count to cause a bit flip has reduced by more than 10X in the last decade. Therefore, it is essential to develop a better understanding and in-depth insights into the RowHammer vulnerability of modern DRAM chips to more effectively secure current and future systems. Our goal in this paper is to provide insights into fundamental properties of the RowHammer vulnerability that are not yet rigorously studied by prior works, but can potentially be $i$) exploited to develop more effective RowHammer attacks or $ii$) leveraged to design more effective and efficient defense mechanisms. To this end, we present an experimental characterization using 248~DDR4 and 24~DDR3 modern DRAM chips from four major DRAM manufacturers demonstrating how the RowHammer effects vary with three fundamental properties: 1)~DRAM chip temperature, 2)~aggressor row active time, and 3)~victim DRAM cell's physical location. Among our 16 new observations, we highlight that a RowHammer bit flip 1)~is very likely to occur in a bounded range, specific to each DRAM cell (e.g., 5.4% of the vulnerable DRAM cells exhibit errors in the range 70C to 90C), 2)~is more likely to occur if the aggressor row is active for longer time (e.g., RowHammer vulnerability increases by 36% if we keep a DRAM row active for 15 column accesses), and 3)~is more likely to occur in certain physical regions of the DRAM module under attack (e.g., 5% of the rows are 2x more vulnerable than the remaining 95% of the rows).


title: T-count and T-depth of any multi-qubit unitary

abstract: While implementing a quantum algorithm it is crucial to reduce the quantum resources, in order to obtain the desired computational advantage. For most fault-tolerant quantum error-correcting codes the cost of implementing the non-Clifford gate is the highest among all the gates in a universal fault-tolerant gate set. In this paper we design provable algorithm to determine T-count of any $n$-qubit ($n\geq 1$) unitary $W$ of size $2^n\times 2^n$, over the Clifford+T gate set. The space and time complexity of our algorithm are $O\left(2^{2n}\right)$ and $O\left(2^{2n\mathcal{T}_{\epsilon}(W)+4n}\right)$ respectively. $\mathcal{T}_{\epsilon}(W)$ ($\epsilon$-T-count) is the (minimum possible) T-count of an exactly implementable unitary $U$ i.e. $\mathcal{T}(U)$, such that $d(U,W)\leq\epsilon$ and $\mathcal{T}(U)\leq\mathcal{T}(U')$ where $U'$ is any exactly implementable unitary with $d(U',W)\leq\epsilon$. $d(.,.)$ is the global phase invariant distance. Our algorithm can also be used to determine the (minimum possible) T-depth of any multi-qubit unitary and the complexity has exponential dependence on $n$ and $\epsilon$-T-depth. This is the first algorithm that gives T-count or T-depth of any multi-qubit ($n\geq 1$) unitary. For small enough $\epsilon$, we can synthesize the T-count and T-depth-optimal circuits. Our results can be used to determine the minimum count (or depth) of non-Clifford gates required to implement any multi-qubit unitary with a universal gate set consisting of Clifford and non-Clifford gates like Clifford+CS, Clifford+V, etc. To the best of our knowledge, there were no such optimal-synthesis algorithm for arbitrary multi-qubit unitaries in any universal gate set.


title: Learning Rich Nearest Neighbor Representations from Self-supervised Ensembles

abstract: Pretraining convolutional neural networks via self-supervision, and applying them in transfer learning, is an incredibly fast-growing field that is rapidly and iteratively improving performance across practically all image domains. Meanwhile, model ensembling is one of the most universally applicable techniques in supervised learning literature and practice, offering a simple solution to reliably improve performance. But how to optimally combine self-supervised models to maximize representation quality has largely remained unaddressed. In this work, we provide a framework to perform self-supervised model ensembling via a novel method of learning representations directly through gradient descent at inference time. This technique improves representation quality, as measured by k-nearest neighbors, both on the in-domain dataset and in the transfer setting, with models transferable from the former setting to the latter. Additionally, this direct learning of feature through backpropagation improves representations from even a single model, echoing the improvements found in self-distillation.


title: Existence of stationary ballistic deposition on the infinite lattice

abstract: Ballistic deposition is one of the many models of interface growth that are believed to be in the KPZ universality class, but have so far proved to be largely intractable mathematically. In this model, blocks of size one fall independently as Poisson processes at each site on the $d$-dimensional lattice, and either attach themselves to the column growing at that site, or to the side of an adjacent column, whichever comes first. It is not hard to see that if we subtract off the height of the column at the origin from the heights of the other columns, the resulting interface process is Markovian. The main result of this article is that this Markov process has at least one invariant probability measure. We conjecture that the invariant measure is not unique, and provide some partial evidence.

categories: math.PR cond-mat.stat-mech math-ph math.MP


title: Expressivity of Neural Networks via Chaotic Itineraries beyond Sharkovsky's Theorem

abstract: Given a target function $f$, how large must a neural network be in order to approximate $f$? Recent works examine this basic question on neural network \textit{expressivity} from the lens of dynamical systems and provide novel ``depth-vs-width'' tradeoffs for a large family of functions $f$. They suggest that such tradeoffs are governed by the existence of \textit{periodic} points or \emph{cycles} in $f$. Our work, by further deploying dynamical systems concepts, illuminates a more subtle connection between periodicity and expressivity: we prove that periodic points alone lead to suboptimal depth-width tradeoffs and we improve upon them by demonstrating that certain ``chaotic itineraries'' give stronger exponential tradeoffs, even in regimes where previous analyses only imply polynomial gaps. Contrary to prior works, our bounds are nearly-optimal, tighten as the period increases, and handle strong notions of inapproximability (e.g., constant $L_1$ error). More broadly, we identify a phase transition to the \textit{chaotic regime} that exactly coincides with an abrupt shift in other notions of function complexity, including VC-dimension and topological entropy.


title: A Bayesian Approach for the Variance of Fine Stratification

abstract: Fine stratification is a popular design as it permits the stratification to be carried out to the fullest possible extent. Some examples include the Current Population Survey and National Crime Victimization Survey both conducted by the U.S. Census Bureau, and the National Survey of Family Growth conducted by the University of Michigan's Institute for Social Research. Clearly, the fine stratification survey has proved useful in many applications as its point estimator is unbiased and efficient. A common practice to estimate the variance in this context is collapsing the adjacent strata to create pseudo-strata and then estimating the variance, but the attained estimator of variance is not design-unbiased, and the bias increases as the population means of the pseudo-strata become more variant. Additionally, the estimator may suffer from a large mean squared error (MSE). In this paper, we propose a hierarchical Bayesian estimator for the variance of collapsed strata and compare the results with a nonparametric Bayes variance estimator. Additionally, we make comparisons with a kernel-based variance estimator recently proposed by Breidt et al. (2016). We show our proposed estimator is superior compared to the alternatives given in the literature such that it has a smaller frequentist MSE and bias. We verify this throughout multiple simulation studies and data analysis from the 2007-8 National Health and Nutrition Examination Survey and the 1998 Survey of Mental Health Organizations.


title: On a boundary property of Blaschke products

abstract: A Blaschke product has no radial limits on a subset $E$ of the unit circle $T$ but has unrestricted limit at each point of $T \setminus E$ if and only if $E$ is a closed set of measure zero.


title: Incorporating Rich Social Interactions Into MDPs

abstract: Much of what we do as humans is engage socially with other agents, a skill that robots must also eventually possess. We demonstrate that a rich theory of social interactions originating from microsociology and economics can be formalized by extending a nested MDP where agents reason about arbitrary functions of each other's hidden rewards. This extended Social MDP allows us to encode the five basic interactions that underlie microsociology: cooperation, conflict, coercion, competition, and exchange. The result is a robotic agent capable of executing social interactions zero-shot in new environments; like humans it can engage socially in novel ways even without a single example of that social interaction. Moreover, the judgments of these Social MDPs align closely with those of humans when considering which social interaction is taking place in an environment. This method both sheds light on the nature of social interactions, by providing concrete mathematical definitions, and brings rich social interactions into a mathematical framework that has proven to be natural for robotics, MDPs.


title: Archimedean Zeta Functions and Oscillatory Integrals

abstract: This note is a short survey of two topics: Archimedean zeta functions and Archimedean oscillatory integrals. We have tried to portray some of the history of the subject and some of its connections with similar devices in mathematics. We present some of the main results of the theory and at the end we discuss some generalizations of the classical objects.


title: On the convergence of statistics in simulations of stationary turbulent flows

abstract: When reporting statistics from simulations of statistically stationary chaotic phenomenon, it is important to verify that the simulations are time-converged. This condition is connected with the statistical error or number of digits with which statistics can be reliably reported. In this work we consider homogeneous and isotropic turbulence as a model problem to investigate statistical convergence over finite simulation times. Specifically, we investigate the time integration requirements that allow meaningful reporting of the statistical error associated with finiteness of the temporal domain. We address two key questions: 1) What is the appropriate range of sampling frequency in large eddy time units? and 2) How long should a simulation be performed in terms of large eddy time so that the statistical error could be reliably reported. Our results indicate that proper sampling frequency is on the order of 10 large eddy time scale. More importantly, we find that reliable reporting of statistical errors requires simulation durations orders of magnitude longer than typically performed. Our observations of sampling frequency for homogeneous isotropic turbulence are also shown to hold in turbulent channel flow.


title: Purely Radiative Higgs Mass in Scale invariant models

abstract: In this work, we investigate the possibility of having scale invariant (SI) standard model (SM) extensions, where the light CP-even scalar matches the SM-like Higgs instead of being a light dilaton. After deriving the required conditions for this scenario, we show that the radiative corrections that give rise to the Higgs mass can trigger the scalar mixing to the experimentally allowed values. In addition, we discuss the constraints on the parameters space that makes the CP-even scalars properties in a good agreement with all the recent ATLAS and CMS measurements. We illustrate this scenario by considering the SI-scotogenic model as an example, while imposing all the theoretical and experimental constraints. We show that the model is viable and leads to possible modifications of the di-Higgs signatures at current/future with respect to the SM.


title: Layer-wise Adaptive Model Aggregation for Scalable Federated Learning

abstract: In Federated Learning, a common approach for aggregating local models across clients is periodic averaging of the full model parameters. It is, however, known that different layers of neural networks can have a different degree of model discrepancy across the clients. The conventional full aggregation scheme does not consider such a difference and synchronizes the whole model parameters at once, resulting in inefficient network bandwidth consumption. Aggregating the parameters that are similar across the clients does not make meaningful training progress while increasing the communication cost. We propose FedLAMA, a layer-wise model aggregation scheme for scalable Federated Learning. FedLAMA adaptively adjusts the aggregation interval in a layer-wise manner, jointly considering the model discrepancy and the communication cost. The layer-wise aggregation method enables to finely control the aggregation interval to relax the aggregation frequency without a significant impact on the model accuracy. Our empirical study shows that FedLAMA reduces the communication cost by up to 60% for IID data and 70% for non-IID data while achieving a comparable accuracy to FedAvg.


title: Momentum Contrastive Autoencoder: Using Contrastive Learning for Latent Space Distribution Matching in WAE

abstract: Wasserstein autoencoder (WAE) shows that matching two distributions is equivalent to minimizing a simple autoencoder (AE) loss under the constraint that the latent space of this AE matches a pre-specified prior distribution. This latent space distribution matching is a core component of WAE, and a challenging task. In this paper, we propose to use the contrastive learning framework that has been shown to be effective for self-supervised representation learning, as a means to resolve this problem. We do so by exploiting the fact that contrastive learning objectives optimize the latent space distribution to be uniform over the unit hyper-sphere, which can be easily sampled from. We show that using the contrastive learning framework to optimize the WAE loss achieves faster convergence and more stable optimization compared with existing popular algorithms for WAE. This is also reflected in the FID scores on CelebA and CIFAR-10 datasets, and the realistic generated image quality on the CelebA-HQ dataset.


title: Operators which preserve a positive definite inner product

abstract: Let ${\cal H}$ be a Hilbert space, $A$ a positive definite operator in ${\cal H}$ and $\langle f,g\rangle_A=\langle Af,g\rangle$, $f,g\in {\cal H}$, the $A$-inner product. This paper studies the geometry of the set $$ {\cal I}_A^a:=\{\hbox{ adjointable isometries for } \langle \ , \ \rangle_A\}. $$ It is proved that ${\cal I}_A^a$ is a submanifold of the Banach algebra of adjointable operators, and a homogeneous space of the group of invertible operators in ${\cal H}$, which are unitaries for the $A$-inner product. Smooth curves in ${\cal I}_A^a$ with given initial conditions, which are minimal for the metric induced by $\langle \ , \ \rangle_A$, are presented. This result depends on an adaptation of M.G. Krein's extension method of symmetric contractions, in order that it works also for symmetrizable transformations (i.e., operators which are selfadjoint for the $A$-inner product).


title: When in Doubt, Summon the Titans: Efficient Inference with Large Models

abstract: Scaling neural networks to "large" sizes, with billions of parameters, has been shown to yield impressive results on many challenging problems. However, the inference cost incurred by such large models often prevents their application in most real-world settings. In this paper, we propose a two-stage framework based on distillation that realizes the modelling benefits of the large models, while largely preserving the computational benefits of inference with more lightweight models. In a nutshell, we use the large teacher models to guide the lightweight student models to only make correct predictions on a subset of "easy" examples; for the "hard" examples, we fall-back to the teacher. Such an approach allows us to efficiently employ large models in practical scenarios where easy examples are much more frequent than rare hard examples. Our proposed use of distillation to only handle easy instances allows for a more aggressive trade-off in the student size, thereby reducing the amortized cost of inference and achieving better accuracy than standard distillation. Empirically, we demonstrate the benefits of our approach on both image classification and natural language processing benchmarks.


title: A new rate of convergence estimate for homogeneous discrete-time nonlinear Markov chains

abstract: In the paper, we study a new rate of convergence estimate for homogeneous discrete-time nonlinear Markov chains based on the Markov-Dobrushin condition. This result generalizes the convergence estimates for any positive number of transition steps. An example of a class such a process provided indicates that such types of estimates considering several transition steps may be applicable when one transition can not guarantee any convergence. Moreover, a better estimate can be obtained for a higher number of transitions steps. A law of large numbers is presented for a class of ergodic nonlinear Markov chains with finite state space that may serve as a basis for nonparametric estimation and other statistics.


title: Distributed Secret Sharing over a Public Channel from Correlated Random Variables

abstract: We consider a secret-sharing model where a dealer distributes the shares of a secret among a set of participants with the constraint that only predetermined subsets of participants must be able to reconstruct the secret by pooling their shares. Our study generalizes Shamir's secret-sharing model in three directions. First, we allow a joint design of the protocols for the creation of the shares and the distribution of the shares, instead of constraining the model to independent designs. Second, instead of assuming that the participants and the dealer have access to information-theoretically secure channels at no cost, we assume that they have access to a public channel and correlated randomness. Third, motivated by a wireless network setting where the correlated randomness is obtained from channel gain measurements, we explore a setting where the dealer is an entity made of multiple sub-dealers. Our main results are inner and outer regions for the achievable secret rates that the dealer and the participants can obtain in this model. To this end, we develop two new achievability techniques, a first one to successively handle reliability and security constraints in a distributed setting, and a second one to reduce a multi-dealer setting to multiple single-user dealer settings. Our results yield the capacity region for threshold access structures when the correlated randomness corresponds to pairwise secret keys shared between each sub-dealer and each participant, and the capacity for the all-or-nothing access structure in the presence of a single dealer and arbitrarily correlated randomness.


title: Geometry of weighted Lorentz-Finsler manifolds II: A splitting theorem

abstract: We show an analogue of the Lorentzian splitting theorem for weighted Lorentz-Finsler manifolds: If a weighted Berwald spacetime of nonnegative weighted Ricci curvature satisfies certain completeness and metrizability conditions and includes a timelike straight line, then it necessarily admits a one-dimensional family of isometric translations generated by the gradient vector field of a Busemann function. Moreover, our formulation in terms of the $\epsilon$-range introduced in our previous work enables us to unify the previously known splitting theorems for weighted Lorentzian manifolds by Case and Woolgar-Wylie into a single framework.


title: Constrained Mean Shift for Representation Learning

abstract: We are interested in representation learning from labeled or unlabeled data. Inspired by recent success of self-supervised learning (SSL), we develop a non-contrastive representation learning method that can exploit additional knowledge. This additional knowledge may come from annotated labels in the supervised setting or an SSL model from another modality in the SSL setting. Our main idea is to generalize the mean-shift algorithm by constraining the search space of nearest neighbors, resulting in semantically purer representations. Our method simply pulls the embedding of an instance closer to its nearest neighbors in a search space that is constrained using the additional knowledge. By leveraging this non-contrastive loss, we show that the supervised ImageNet-1k pretraining with our method results in better transfer performance as compared to the baselines. Further, we demonstrate that our method is relatively robust to label noise. Finally, we show that it is possible to use the noisy constraint across modalities to train self-supervised video models.


title: Quandary: An open-source C++ package for high-performance optimal control of open quantum systems

abstract: Quantum optimal control can be used to shape the control pulses for realizing unitary and non-unitary transformations of quantum states. These control pulses provide the fundamental interface between the quantum compiler and the quantum hardware. Most current software for quantum optimal control (e.g. Qutip or Krotov) is restricted to run on shared memory platforms, limiting their applicability to smaller quantum systems, in particular if interactions with the environment are taken into account. This paper gives an overview of the open-source code Quandary, which is designed to solve quantum control problems in larger open quantum systems modelled by Lindblad's master equation. Implemented in C++, Quandary uses the message passing paradigm for distributed memory computers that enables scalability to large numbers of compute cores. Accompanied by numerical examples, this paper presents an overview on existing theoretical developments for open optimal quantum control realizing state-to-state transfer, unitary gate optimization as well as state-preparation, and presents the numerical tools and implementation aspect as realized in Quandary, for deployment on modern high-performance computing platforms.


title: EMF-Aware Cellular Networks in RIS-Assisted Environments

abstract: The deployment of the 5th-generation cellular networks (5G) and beyond has triggered health concerns due to the electric and magnetic fields (EMF) exposure. In this paper, we propose a novel architecture to minimize the population exposure to EMF by considering a smart radio environment with a reconfigurable intelligent surface (RIS). Then, we optimize the RIS phases to minimize the exposure in terms of the exposure index (EI) while maintaining a minimum target quality of service. The proposed scheme achieves up to 20% reduction in EI compared to schemes without RISs.


title: Phase-Averaged Dynamics of a Periodically Surging Wind Turbine

abstract: The unsteady power generation of a wind turbine translating in the streamwise direction is relevant to floating offshore wind turbines, kite-mounted airborne wind turbines, and other non-traditional wind-energy systems. To study this problem experimentally, measurements of torque, rotor speed, and power were acquired for a horizontal-axis wind turbine actuated in periodic surge motions in a fan-array wind tunnel at the Caltech Center for Autonomous Systems and Technologies (CAST). Experiments were conducted at a diameter-based Reynolds number of $Re_D=6.1\times10^5$ and at tip-speed ratios between 5.2 and 8.8. Sinusoidal and trapezoidal surge-velocity waveforms with maximum surge velocities up to 23% of the free-stream velocity were tested. A model in the form of a linear ordinary differential equation (first-order in time) was derived to capture the time-resolved dynamics of the surging turbine. Its coefficients were obtained using torque measurements from a stationary turbine, without the need for unsteady calibrations. Its predictions compared favorably with the measured amplitude- and phase-response data. Furthermore, increases in the period-averaged power of up to 6.4% above the steady reference case were observed in the experiments at high tip-speed ratios and surge velocities, potentially due to unsteady or nonlinear aerodynamic effects. Conversely, decreases in mean power with increased surge velocity at low tip-speed ratios were likely a result of the onset of stall on the turbine blades. These results inform the development of strategies to optimize and control the unsteady power generation of periodically surging wind turbines, and motivate further investigations into the unsteady aerodynamics of wind-energy systems.


title: Certified Hermite Matrices from Approximate Roots

abstract: Let I=<f_1, ..., f_m> be a zero dimensional radical ideal Q[x_1,...,x_n]. Assume that we are given approximations {z_1,...,z_k} in C^n for the common roots V(I)={xi_1,...,xi_k}. In this paper we show how to construct and certify the rational entries of Hermite matrices for I from the approximate roots {z_1, ...,z_k}. When I is non-radical, we give methods to construct and certify Hermite matrices for the radical of I from approximate roots. Furthermore, we use signatures of these Hermite matrices to give rational certificates of non-negativity of a given polynomial over a (possibly positive dimensional) real variety, as well as certificates that there is a real root within an epsilon distance from a given point z in Q^n.


title: Global dynamics of the Euler-alignment system with weakly singular kernel

abstract: This letter studies the Euler-alignment system with weakly singular influence functions by introducing a novel technique to bound the density. Instead of resorting to a nonlinear maximum principle used in [C. Tan, Nonlinearity, 33: 1907--1924, 2020] to bound the interaction term $\psi\ast\rho$ by $\rho^s$ with $s\in (0, 1)$ for $\psi$ with an algebraic singularity at origin, we bound $\psi*\rho$ by a relaxed constant for any $\psi \in L^1$. We thus establish the global-in-time existence results with weaker assumptions on $\psi$ and refined solution bounds, characterized by the structure of $\psi$.


title: Continuously Increasing Subsequences of Random Multiset Permutations

abstract: For a word $\pi$ and integer $i$, we define $L^i(\pi)$ to be the length of the longest subsequence of the form $i(i+1)\cdots j$, and we let $L(\pi):=\max_i L^i(\pi)$. In this paper we estimate the expected values of $L^1(\pi)$ and $L(\pi)$ when $\pi$ is chosen uniformly at random from all words which use each of the first $n$ integers exactly $m$ times. We show that $\mathbb{E}[L^1(\pi)]\sim m$ if $n$ is sufficiently larger in terms of $m$ as $m$ tends towards infinity, confirming a conjecture of Diaconis, Graham, He, and Spiro. We also show that $\mathbb{E}[L(\pi)]$ is asymptotic to the inverse gamma function $\Gamma^{-1}(n)$ if $n$ is sufficiently large in terms of $m$ as $m$ tends towards infinity.


title: Beamforming Design for Intelligent Reflecting Surface-Enhanced Symbiotic Radio Systems

abstract: This paper investigates multiuser multi-input single-output downlink symbiotic radio communication systems assisted by an intelligent reflecting surface (IRS). Different from existing methods ideally assuming the secondary user (SU) can jointly decode information symbols from both the access point (AP) and the IRS via multiuser detection, we consider a more practical SU that only non-coherent detection is available. To characterize the non-coherent decoding performance, a practical upper bound of the average symbol error rate (SER) is derived. Subsequently, we jointly optimize the beamformer at the AP and the phase shifts at the IRS to maximize the average sum-rate of the primary system taking into account the maximum tolerable SER constraint for the SU. To circumvent the couplings of variables, we exploit the Schur complement that facilitates the design of a suboptimal beamforming algorithm based on successive convex approximation. Our simulation results show that compared with various benchmark algorithms, the proposed scheme significantly improves the average sum-rate of the primary system, while guaranteeing the decoding performance of the secondary system.


title: On $t$-intersecting Hypergraphs with Minimum Positive Codegrees

abstract: For a hypergraph $\mathcal{H}$, define the minimum positive codegree $\delta_i^+(\mathcal{H})$ to be the largest integer $k$ such that every $i$-set which is contained in at least one edge of $\mathcal{H}$ is contained in at least $k$ edges. For $1\le s\le k,t$ and $t\le r$, we prove that for $n$-vertex $t$-intersecting $r$-graphs $\mathcal{H}$ with $\delta_{r-s}^+(\mathcal{H})>{k-1\choose s}$, the unique hypergraph with the maximum number of edges is the hypergraph $\mathcal{H}$ consisting of every edge which intersects a set of size $2k-2s+t$ in at least $k-s+t$ vertices provided $n$ is sufficiently large. This generalizes work of Balogh, Lemons, and Palmer who proved this for $s=t=1$, as well as the Erd\H{o}s-Ko-Rado theorem when $k=s$.


title: Improved Multilingual Language Model Pretraining for Social Media Text via Translation Pair Prediction

abstract: We evaluate a simple approach to improving zero-shot multilingual transfer of mBERT on social media corpus by adding a pretraining task called translation pair prediction (TPP), which predicts whether a pair of cross-lingual texts are a valid translation. Our approach assumes access to translations (exact or approximate) between source-target language pairs, where we fine-tune a model on source language task data and evaluate the model in the target language. In particular, we focus on language pairs where transfer learning is difficult for mBERT: those where source and target languages are different in script, vocabulary, and linguistic typology. We show improvements from TPP pretraining over mBERT alone in zero-shot transfer from English to Hindi, Arabic, and Japanese on two social media tasks: NER (a 37% average relative improvement in F1 across target languages) and sentiment classification (12% relative improvement in F1) on social media text, while also benchmarking on a non-social media task of Universal Dependency POS tagging (6.7% relative improvement in accuracy). Our results are promising given the lack of social media bitext corpus. Our code can be found at: https://github.com/twitter-research/multilingual-alignment-tpp.


title: LMSOC: An Approach for Socially Sensitive Pretraining

abstract: While large-scale pretrained language models have been shown to learn effective linguistic representations for many NLP tasks, there remain many real-world contextual aspects of language that current approaches do not capture. For instance, consider a cloze-test "I enjoyed the ____ game this weekend": the correct answer depends heavily on where the speaker is from, when the utterance occurred, and the speaker's broader social milieu and preferences. Although language depends heavily on the geographical, temporal, and other social contexts of the speaker, these elements have not been incorporated into modern transformer-based language models. We propose a simple but effective approach to incorporate speaker social context into the learned representations of large-scale language models. Our method first learns dense representations of social contexts using graph representation learning algorithms and then primes language model pretraining with these social context representations. We evaluate our approach on geographically-sensitive language-modeling tasks and show a substantial improvement (more than 100% relative lift on MRR) compared to baselines.


title: Frontiers in Evolutionary Computation: A Workshop Report

abstract: In July of 2021, the Santa Fe Institute hosted a workshop on evolutionary computation as part of its Foundations of Intelligence in Natural and Artificial Systems project. This project seeks to advance the field of artificial intelligence by promoting interdisciplinary research on the nature of intelligence. The workshop brought together computer scientists and biologists to share their insights about the nature of evolution and the future of evolutionary computation. In this report, we summarize each of the talks and the subsequent discussions. We also draw out a number of key themes and identify important frontiers for future research.


title: On the nature of embedded precursors in long outbursts of SS Cyg stars as inferred from observations of the IW And star ST Cha

abstract: We observed the IW And-type dwarf nova ST Cha and found that standstills were terminated by brightening at a constant brightness level during standstills. This finding is not consistent with a model of IW And-type dwarf novae assuming repeated enhancements of the mass-transfer rate from the secondary. We found that one outburst in ST Cha had a shoulder during the rising branch at the same level in which standstills were terminated by brightening. This phenomenon is very similar to what are called "embedded precursors" in SS Cyg stars. We propose that these embedded precursors in both SS Cyg stars and the IW And star ST Cha occur when the disk reaches the tidal truncation radius. If this is the case, precursors in SS Cyg stars and SU UMa stars are different in origin on the contrary to the idea suggested by Cannizzo (2012).


title: Nuclear data evaluation with Bayesian networks

abstract: Bayesian networks are graphical models to represent the probabilistic relationships between variables in the Bayesian framework. The knowledge of all variables can be updated using new information about some of the variables. We show that relying on the Bayesian network interpretation enables large scale inference and gives flexibility in incorporating prior assumptions and constraints into the nuclear data evaluation process, such as sum rules and the non-negativity of cross sections. The latter constraint is accounted for by a non-linear transformation and therefore we also discuss inference in Bayesian networks with non-linear relationships. Using Bayesian networks, the evaluation process yields detailed information, such as posterior estimates and uncertainties of all statistical and systematic errors. We also elaborate on a sparse Gaussian process construction compatible with the Bayesian network framework that can for instance be used as prior on energy-dependent model parameters, model deficiencies and energy-dependent systematic errors of experiments. We present three proof-of-concept examples that emerged in the context of the neutron data standards project and in the ongoing international evaluation efforts of $^{56}$Fe. In the first example we demonstrate the modelization and explicit estimation of relative energy-dependent error components of experimental datasets. Then we show an example evaluation using the outlined Gaussian process construction in an evaluation of $^{56}$Fe in the energy range between one and two MeV, where R-Matrix and nuclear model fits are difficult. Finally, we present a model-based evaluation of $^{56}$Fe between 5 MeV and 30 MeV with a sound treatment of model deficiencies. The R scripts to reproduce the Bayesian network examples and the nucdataBaynet package for Bayesian network modeling and inference have been made publicly available.


title: Computational Graph Completion

abstract: We introduce a framework for generating, organizing, and reasoning with computational knowledge. It is motivated by the observation that most problems in Computational Sciences and Engineering (CSE) can be formulated as that of completing (from data) a computational graph (or hypergraph) representing dependencies between functions and variables. Nodes represent variables, and edges represent functions. Functions and variables may be known, unknown, or random. Data comes in the form of observations of distinct values of a finite number of subsets of the variables of the graph (satisfying its functional dependencies). The underlying problem combines a regression problem (approximating unknown functions) with a matrix completion problem (recovering unobserved variables in the data). Replacing unknown functions by Gaussian Processes (GPs) and conditioning on observed data provides a simple but efficient approach to completing such graphs. Since this completion process can be reduced to an algorithm, as one solves $\sqrt{2}$ on a pocket calculator without thinking about it, one could, with the automation of the proposed framework, solve a complex CSE problem by drawing a diagram. Compared to traditional kriging, the proposed framework can be used to recover unknown functions with much scarcer data by exploiting interdependencies between multiple functions and variables. The underlying problem could therefore also be interpreted as a generalization of that of solving linear systems of equations to that of approximating unknown variables and functions with noisy, incomplete, and nonlinear dependencies. Numerous examples illustrate the flexibility, scope, efficacy, and robustness of the proposed framework and show how it can be used as a pathway to identifying simple solutions to classical CSE problems (digital twin modeling, dimension reduction, mode decomposition, etc.).


title: HARPS: An Online POMDP Framework for Human-Assisted Robotic Planning and Sensing

abstract: Autonomous robots can benefit greatly from human-provided semantic characterizations of uncertain task environments and states. However, the development of integrated strategies which let robots model, communicate, and act on such 'soft data' remains challenging. Here, the Human Assisted Robotic Planning and Sensing (HARPS) framework is presented for active semantic sensing and planning in human-robot teams to address these gaps by formally combining the benefits of online sampling-based POMDP policies, multimodal semantic interaction, and Bayesian data fusion. This approach lets humans opportunistically impose model structure and extend the range of semantic soft data in uncertain environments by sketching and labeling arbitrary landmarks across the environment. Dynamic updating of the environment model while during search allows robotic agents to actively query humans for novel and relevant semantic data, thereby improving beliefs of unknown environments and states for improved online planning. Simulations of a UAV-enabled target search application in a large-scale partially structured environment show significant improvements in time and belief state estimates required for interception versus conventional planning based solely on robotic sensing. Human subject studies in the same environment (n = 36) demonstrate an average doubling in dynamic target capture rate compared to the lone robot case, and highlight the robustness of active probabilistic reasoning and semantic sensing over a range of user characteristics and interaction modalities.


title: One-Step Abductive Multi-Target Learning with Diverse Noisy Samples and Its Application to Tumour Segmentation for Breast Cancer

abstract: Recent studies have demonstrated the effectiveness of the combination of machine learning and logical reasoning, including data-driven logical reasoning, knowledge driven machine learning and abductive learning, in inventing advanced technologies for different artificial intelligence applications. One-step abductive multi-target learning (OSAMTL), an approach inspired by abductive learning, via simply combining machine learning and logical reasoning in a one-step balanced multi-target learning way, has as well shown its effectiveness in handling complex noisy labels of a single noisy sample in medical histopathology whole slide image analysis (MHWSIA). However, OSAMTL is not suitable for the situation where diverse noisy samples (DiNS) are provided for a learning task. In this paper, giving definition of DiNS, we propose one-step abductive multi-target learning with DiNS (OSAMTL-DiNS) to expand the original OSAMTL to handle complex noisy labels of DiNS. Applying OSAMTL-DiNS to tumour segmentation for breast cancer in MHWSIA, we show that OSAMTL-DiNS is able to enable various state-of-the-art approaches for learning from noisy labels to achieve more rational predictions. We released a model pre-trained with OSAMTL-DiNS for tumour segmentation in HE-stained pre-treatment biopsy images in breast cancer, which has been successfully applied as a pre-processing tool to extract tumour-associated stroma compartment for predicting the pathological complete response to neoadjuvant chemotherapy in breast cancer.


title: Disentanglement of Emotional Style and Speaker Identity for Expressive Voice Conversion

abstract: Expressive voice conversion performs identity conversion for emotional speakers by jointly converting speaker identity and emotional style. Due to the hierarchical structure of speech emotion, it is challenging to disentangle the emotional style for different speakers. Inspired by the recent success of speaker disentanglement with variational autoencoder (VAE), we propose an any-to-any expressive voice conversion framework, that is called StyleVC. StyleVC is designed to disentangle linguistic content, speaker identity, pitch, and emotional style information. We study the use of style encoder to model emotional style explicitly. At run-time, StyleVC converts both speaker identity and emotional style for arbitrary speakers. Experiments validate the effectiveness of our proposed framework in both objective and subjective evaluations.


title: BLEMAB European project: muon imaging technique applied to blast furnaces

abstract: The BLEMAB European project (BLast furnace stack density Estimation through online Muon ABsorption measurements), evolution of the previous MuBlast European project, is designed to investigate in detail the capability of muon radiography techniques applied to the imaging of a blast furnace's inner zone. In particular, the geometry and size of the so called cohesive zone, i.e. the spatial zone where the slowly downward moving material begins to soften and melt, that plays an important role in the performance of the blast furnace itself. Thanks to the high penetration power of the natural cosmic ray muon radiation, muon transmission radiography represents an appropriate non-invasive methodology for imaging large high-density structures such as blast furnaces, whose linear size can be up to a few tens of meters. A state-of-the-art muon tracking system, whose design profits from the long experience of our collaboration in this field, is currently under development and will be installed in 2022 at a blast furnace on the ArcelorMittal site in Bremen (Germany) for many months. Collected data will be exploited to monitor temporal variations of the average density distribution inside the furnace. Muon radiography results will also be compared with measurements obtained through an enhanced multipoint probe and standard blast furnace models.


title: R$^3$Net:Relation-embedded Representation Reconstruction Network for Change Captioning

abstract: Change captioning is to use a natural language sentence to describe the fine-grained disagreement between two similar images. Viewpoint change is the most typical distractor in this task, because it changes the scale and location of the objects and overwhelms the representation of real change. In this paper, we propose a Relation-embedded Representation Reconstruction Network (R$^3$Net) to explicitly distinguish the real change from the large amount of clutter and irrelevant changes. Specifically, a relation-embedded module is first devised to explore potential changed objects in the large amount of clutter. Then, based on the semantic similarities of corresponding locations in the two images, a representation reconstruction module (RRM) is designed to learn the reconstruction representation and further model the difference representation. Besides, we introduce a syntactic skeleton predictor (SSP) to enhance the semantic interaction between change localization and caption generation. Extensive experiments show that the proposed method achieves the state-of-the-art results on two public datasets.


title: SLAM: A Unified Encoder for Speech and Language Modeling via Speech-Text Joint Pre-Training

abstract: Unsupervised pre-training is now the predominant approach for both text and speech understanding. Self-attention models pre-trained on large amounts of unannotated data have been hugely successful when fine-tuned on downstream tasks from a variety of domains and languages. This paper takes the universality of unsupervised language pre-training one step further, by unifying speech and text pre-training within a single model. We build a single encoder with the BERT objective on unlabeled text together with the w2v-BERT objective on unlabeled speech. To further align our model representations across modalities, we leverage alignment losses, specifically Translation Language Modeling (TLM) and Speech Text Matching (STM) that make use of supervised speech-text recognition data. We demonstrate that incorporating both speech and text data during pre-training can significantly improve downstream quality on CoVoST~2 speech translation, by around 1 BLEU compared to single-modality pre-trained models, while retaining close to SotA performance on LibriSpeech and SpeechStew ASR tasks. On four GLUE tasks and text-normalization, we observe evidence of capacity limitations and interference between the two modalities, leading to degraded performance compared to an equivalent text-only model, while still being competitive with BERT. Through extensive empirical analysis we also demonstrate the importance of the choice of objective function for speech pre-training, and the beneficial effect of adding additional supervised signals on the quality of the learned representations.


title: One model to enhance them all: array geometry agnostic multi-channel personalized speech enhancement

abstract: With the recent surge of video conferencing tools usage, providing high-quality speech signals and accurate captions have become essential to conduct day-to-day business or connect with friends and families. Single-channel personalized speech enhancement (PSE) methods show promising results compared with the unconditional speech enhancement (SE) methods in these scenarios due to their ability to remove interfering speech in addition to the environmental noise. In this work, we leverage spatial information afforded by microphone arrays to improve such systems' performance further. We investigate the relative importance of speaker embeddings and spatial features. Moreover, we propose a new causal array-geometry-agnostic multi-channel PSE model, which can generate a high-quality enhanced signal from arbitrary microphone geometry. Experimental results show that the proposed geometry agnostic model outperforms the model trained on a specific microphone array geometry in both speech quality and automatic speech recognition accuracy. We also demonstrate the effectiveness of the proposed approach for unseen array geometries.


title: Comment on Proposed model for calculating the standard formation enthalpy of binary transition-metal systems

abstract: In the paper Proposed model for calculating the standard formation enthalpy of binary transition-metal systems, Zhang and Liu proposed to modify the standard Miedema model. This, to include atomic size effects by a prefactor S(c). After applying formulae proposed by Zhang and Liu, it was not possible to reproduce their results. So, their equations were analyzed, and it was found that the results can be reproduced if the equation for the prefactor S(C) is modified.It is shown that the equation of S(C) can be expressed in an alternative way, in which the difference of surface area is eliminated. Then, the difference in size of the atoms, expressed as a difference in surface area, the justification stated by Zhang and Liu for the introduction of S(c), is no longer present after the analysis.


title: AI-Based Detection, Classification and Prediction/Prognosis in Medical Imaging: Towards Radiophenomics

abstract: Artificial intelligence (AI) techniques have significant potential to enable effective, robust and automated image phenotyping including identification of subtle patterns. AI-based detection searches the image space to find the regions of interest based on patterns and features. There is a spectrum of tumor histologies from benign to malignant that can be identified by AI-based classification approaches using image features. The extraction of minable information from images gives way to the field of radiomics and can be explored via explicit (handcrafted/engineered) and deep radiomics frameworks. Radiomics analysis has the potential to be utilized as a noninvasive technique for the accurate characterization of tumors to improve diagnosis and treatment monitoring. This work reviews AI-based techniques, with a special focus on oncological PET and PET/CT imaging, for different detection, classification, and prediction/prognosis tasks. We also discuss needed efforts to enable the translation of AI techniques to routine clinical workflows, and potential improvements and complementary techniques such as the use of natural language processing on electronic health records and neuro-symbolic AI techniques.


title: Computationally Efficient Safe Reinforcement Learning for Power Systems

abstract: We propose a computationally efficient approach to safe reinforcement learning (RL) for frequency regulation in power systems with high levels of variable renewable energy resources. The approach draws on set-theoretic control techniques to craft a neural network-based control policy that is guaranteed to satisfy safety-critical state constraints, without needing to solve a model predictive control or projection problem in real time. By exploiting the properties of robust controlled-invariant polytopes, we construct a novel, closed-form "safety-filter" that enables end-to-end safe learning using any policy gradient-based RL algorithm. We then apply the safety filter in conjunction with the deep deterministic policy gradient (DDPG) algorithm to regulate frequency in a modified 9-bus power system, and show that the learned policy is more cost-effective than robust linear feedback control techniques while maintaining the same safety guarantee. We also show that the proposed paradigm outperforms DDPG augmented with constraint violation penalties.


title: Toward Accurate and Reliable Iris Segmentation Using Uncertainty Learning

abstract: Iris segmentation is a deterministic part of the iris recognition system. Unreliable segmentation of iris regions especially the limbic area is still the bottleneck problem, which impedes more accurate recognition. To make further efforts on accurate and reliable iris segmentation, we propose a bilateral self-attention module and design Bilateral Transformer (BiTrans) with hierarchical architecture by exploring spatial and visual relationships. The bilateral self-attention module adopts a spatial branch to capture spatial contextual information without resolution reduction and a visual branch with a large receptive field to extract the visual contextual features. BiTrans actively applies convolutional projections and cross-attention to improve spatial perception and hierarchical feature fusion. Besides, Iris Segmentation Uncertainty Learning is developed to learn the uncertainty map according to prediction discrepancy. With the estimated uncertainty, a weighting scheme and a regularization term are designed to reduce predictive uncertainty. More importantly, the uncertainty estimate reflects the reliability of the segmentation predictions. Experimental results on three publicly available databases demonstrate that the proposed approach achieves better segmentation performance using 20% FLOPs of the SOTA IrisParseNet.


title: Simpler Does It: Generating Semantic Labels with Objectness Guidance

abstract: Existing weakly or semi-supervised semantic segmentation methods utilize image or box-level supervision to generate pseudo-labels for weakly labeled images. However, due to the lack of strong supervision, the generated pseudo-labels are often noisy near the object boundaries, which severely impacts the network's ability to learn strong representations. To address this problem, we present a novel framework that generates pseudo-labels for training images, which are then used to train a segmentation model. To generate pseudo-labels, we combine information from: (i) a class agnostic objectness network that learns to recognize object-like regions, and (ii) either image-level or bounding box annotations. We show the efficacy of our approach by demonstrating how the objectness network can naturally be leveraged to generate object-like regions for unseen categories. We then propose an end-to-end multi-task learning strategy, that jointly learns to segment semantics and objectness using the generated pseudo-labels. Extensive experiments demonstrate the high quality of our generated pseudo-labels and effectiveness of the proposed framework in a variety of domains. Our approach achieves better or competitive performance compared to existing weakly-supervised and semi-supervised methods.


title: Modularity of Bershadsky-Polyakov minimal models

abstract: The Bershadsky-Polyakov algebras are the original examples of nonregular W-algebras, obtained from the affine vertex operator algebras associated with $\mathfrak{sl}_3$ by quantum hamiltonian reduction. In [arXiv:2007.03917], we explored the representation theories of the simple quotients of these algebras when the level $\mathsf{k}$ is nondegenerate-admissible. Here, we combine these explorations with Adamovi\'{c}'s inverse quantum hamiltonian reduction functors to study the modular properties of Bershadsky-Polyakov characters and deduce the associated Grothendieck fusion rules. The results are not dissimilar to those already known for the affine vertex operator algebras associated with $\mathfrak{sl}_2$, except that the role of the Virasoro minimal models in the latter is here played by the minimal models of Zamolodchikov's $\mathsf{W}_3$ algebras.


title: The Neumann problem for fully nonlinear SPDE

abstract: We generalize the notion of pathwise viscosity solutions, put forward by Lions and Souganidis to study fully nonlinear stochastic partial differential equations, to equations set on a sub-domain with Neumann boundary conditions. Under a convexity assumption on the domain, we obtain a comparison theorem which yields existence and uniqueness of solutions as well as continuity with respect to the driving noise. As an application, we study the long time behaviour of a stochastically perturbed mean-curvature flow in a cylinder-like domain with right angle contact boundary condition.


title: KAM theorem with large twist and finite smooth large perturbation

abstract: In the present paper, we will discuss the following non-degenerate Hamiltonian system \begin{equation*} H(\theta,t,I)=\frac{H_0(I)}{\varepsilon^{a}}+\frac{P(\theta,t,I)}{\varepsilon^{b}}, \end{equation*} where $(\theta,t,I)\in\mathbf{{T}}^{d+1}\times[1,2]^d$ ($\mathbf{{T}}:=\mathbf{{R}}/{2\pi \mathbf{Z}}$), $a,b$ are given positive constants with $a>b$, $H_0: [1,2]^d\rightarrow \mathbf R$ is real analytic and $P: \mathbf T^{d+1}\times [1,2]^d\rightarrow \mathbf R$ is $C^{\ell}$ with $\ell=\frac{2(d+1)(5a-b+2ad)}{a-b}+\mu$, $0<\mu\ll1$. We prove that if $\varepsilon$ is sufficiently small, there is an invariant torus with given Diophantine frequency vector for the above Hamiltonian system. As for application, we prove that a finite network of Duffing oscillators with periodic exterior forces possesses Lagrangian stability for almost all initial data.


title: Effects of Incipient Pairing on Non-equilibrium Quasiparticle Transport in Fermi Liquids

abstract: The low temperature properties of a wide range of many-fermion systems are well understood within the framework of Landau's theory of Fermi liquids. The low-energy physics of these systems is governed by interacting fermionic quasiparticles with momenta and energies near a Fermi surface in momentum space. Nonequilibrium properties are described by a kinetic equation for the distribution function for quasiparticles proposed by Landau. Quasiparticle interactions with other quasiparticles, phonons or impurities lead to internal forces acting on a distribution of nonequilibrium quasiparticles, as well as collision processes that ultimately limit the transport of mass, heat, charge and magnetization, as well as limit the coherence times of quasiparticles. For Fermi liquids that are close to a second order phase transition, e.g. Fermi liquids that undergo a superfluid transition, \emph{incipient} Cooper pairs - long-lived fluctuations of the ordered phase - provide a new channel for scattering quasiparticles, as well as corrections to internal forces acting on the distribution of nonequilibrium quasiparticles. We develop the theory of quasiparticle transport for Fermi liquids in the vicinity of a BCS-type superfluid transition starting from Keldysh's field theory for non-equilibrium, strongly interacting fermions. The leading corrections to Fermi liquid theory for non-equilibrium quasiparticle transport near a Cooper instability arise from the virtual emission and absorption of incipient Cooper pairs. Our theory is applicable to quasiparticle transport in superconductors, nuclear matter and the low temperature phases of liquid $^3$He. As an implementation of the theory we calculate the pairing fluctuation corrections to the attenuation of zero sound in liquid $^3$He near the superfluid transition and demonstrate quantitative agreement with experimental results.


title: News-based Business Sentiment and its Properties as an Economic Index

abstract: This paper presents an approach to measuring business sentiment based on textual data. Business sentiment has been measured by traditional surveys, which are costly and time-consuming to conduct. To address the issues, we take advantage of daily newspaper articles and adopt a self-attention-based model to define a business sentiment index, named S-APIR, where outlier detection models are investigated to properly handle various genres of news articles. Moreover, we propose a simple approach to temporally analyzing how much any given event contributed to the predicted business sentiment index. To demonstrate the validity of the proposed approach, an extensive analysis is carried out on 12 years' worth of newspaper articles. The analysis shows that the S-APIR index is strongly and positively correlated with established survey-based index (up to correlation coefficient r=0.937) and that the outlier detection is effective especially for a general newspaper. Also, S-APIR is compared with a variety of economic indices, revealing the properties of S-APIR that it reflects the trend of the macroeconomy as well as the economic outlook and sentiment of economic agents. Moreover, to illustrate how S-APIR could benefit economists and policymakers, several events are analyzed with respect to their impacts on business sentiment over time.


title: Quadrotor Trajectory Tracking with Learned Dynamics: Joint Koopman-based Learning of System Models and Function Dictionaries

abstract: Nonlinear dynamical effects are crucial to the operation of many agile robotic systems. Koopman-based model learning methods can capture these nonlinear dynamical system effects in higher dimensional lifted bilinear models that are amenable to optimal control. However, standard methods that lift the system state using a fixed function dictionary before model learning result in high dimensional models that are intractable for real time control. This paper presents a novel method that jointly learns a function dictionary and lifted bilinear model purely from data by incorporating the Koopman model in a neural network architecture. Nonlinear MPC design utilizing the learned model can be performed readily. We experimentally realized this method on a multirotor drone for agile trajectory tracking at low altitudes where the aerodynamic ground effect influences the system's behavior. Experimental results demonstrate that the learning-based controller achieves similar performance as a nonlinear MPC based on a nominal dynamics model in medium altitude. However, our learning-based system can reliably track trajectories in near-ground flight regimes while the nominal controller crashes due to unmodeled dynamical effects that are captured by our method.


title: Minibatch vs Local SGD with Shuffling: Tight Convergence Bounds and Beyond

abstract: In distributed learning, local SGD (also known as federated averaging) and its simple baseline minibatch SGD are widely studied optimization methods. Most existing analyses of these methods assume independent and unbiased gradient estimates obtained via with-replacement sampling. In contrast, we study shuffling-based variants: minibatch and local Random Reshuffling, which draw stochastic gradients without replacement and are thus closer to practice. For smooth functions satisfying the Polyak-{\L}ojasiewicz condition, we obtain convergence bounds (in the large epoch regime) which show that these shuffling-based variants converge faster than their with-replacement counterparts. Moreover, we prove matching lower bounds showing that our convergence analysis is tight. Finally, we propose an algorithmic modification called synchronized shuffling that leads to convergence rates faster than our lower bounds in near-homogeneous settings.


title: EBJR: Energy-Based Joint Reasoning for Adaptive Inference

abstract: State-of-the-art deep learning models have achieved significant performance levels on various benchmarks. However, the excellent performance comes at a cost of inefficient computational cost. Light-weight architectures, on the other hand, achieve moderate accuracies, but at a much more desirable latency. This paper presents a new method of jointly using the large accurate models together with the small fast ones. To this end, we propose an Energy-Based Joint Reasoning (EBJR) framework that adaptively distributes the samples between shallow and deep models to achieve an accuracy close to the deep model, but latency close to the shallow one. Our method is applicable to out-of-the-box pre-trained models as it does not require an architecture change nor re-training. Moreover, it is easy to use and deploy, especially for cloud services. Through a comprehensive set of experiments on different down-stream tasks, we show that our method outperforms strong state-of-the-art approaches with a considerable margin. In addition, we propose specialized EBJR, an extension of our method where we create a smaller specialized side model that performs the target task only partially, but yields an even higher accuracy and faster inference. We verify the strengths of our methods with both theoretical and experimental evaluations.


title: Analytical bounds on the heat transport in internally heated convection

abstract: We obtain an analytical bound on the mean vertical convective heat flux $\langle w T \rangle$ between two parallel boundaries driven by uniform internal heating. We consider two configurations, one with both boundaries held at the same constant temperature, and the other one with a top boundary held at constant temperature and a perfectly insulating bottom boundary. For the first configuration, Arslan et al. (J. Fluid Mech. 919:A15, 2021) recently provided numerical evidence that Rayleigh-number-dependent corrections to the only known rigorous bound $\langle w T \rangle \leq 1/2$ may be provable if the classical background method is augmented with a minimum principle stating that the fluid's temperature is no smaller than that of the top boundary. Here, we confirm this fact rigorously for both configurations by proving bounds on $\langle wT \rangle$ that approach $1/2$ exponentially from below as the Rayleigh number is increased. The key to obtaining these bounds are inner boundary layers in the background fields with a particular inverse-power scaling, which can be controlled in the spectral constraint using Hardy and Rellich inequalities. These allow for qualitative improvements in the analysis not available to standard constructions.


title: Selective crystal growth of indium selenide compounds from saturated solutions grown in a selenium vapor

abstract: Indium selenide compounds are promising materials for energy conversion, spintronic applications, and chemical sensing. However, it is difficult to grow stoichiometric indium selenide crystals due to the high equilibrium selenium vapor pressure and the complicated phase equilibrium system of indium selenide compounds. In this paper, we apply a novel and convenient crystal growth method, in which the saturated solution is grown by the application of a selenium vapor. In this method, selenium vapor at a pressure higher than the saturated vapor pressure is applied to molten indium, such that the selenium continuously dissolves into the indium solution until the solubility at the growth temperature is reached; then a slow cooling process results in crystallization. The selenium dose is matched to its solubility so that indium selenide compounds can be selectively grown just by controlling the temperature without the need to consider the chemical ratio in the solution. The pressure of the vapor is controlled during the whole growth process so that any deviation from a stoichiometric composition in the crystal can be controlled. Both InSe and In2Se3 were successfully grown using this method, and we have investigated the growth mechanism and found the growth window for each compound. This study presents a novel and convenient approach to fabricating transitional metal chalcogenides without deficiencies in the chalcogen element.


title: A gauge-compatible Hamiltonian splitting algorithm for particle-in-cell simulations using finite element exterior calculus

abstract: A particle-in-cell algorithm is derived with a canonical Poisson structure in the formalism of finite element exterior calculus. The resulting method belongs to the class of gauge-compatible splitting algorithms, which exactly preserve gauge symmetries and their associated conservation laws via the momentum map. We numerically demonstrate this time invariance of the momentum map and its usefulness in establishing precise initial conditions with a desired initial electric field and fixed background charge. The restriction of this canonical, finite element Poisson structure to the 1X2P phase space is also considered and simulated numerically.


title: Multi-Stage Network Embedding for Exploring Heterogeneous Edges

abstract: The relationships between objects in a network are typically diverse and complex, leading to the heterogeneous edges with different semantic information. In this paper, we focus on exploring the heterogeneous edges for network representation learning. By considering each relationship as a view that depicts a specific type of proximity between nodes, we propose a multi-stage non-negative matrix factorization (MNMF) model, committed to utilizing abundant information in multiple views to learn robust network representations. In fact, most existing network embedding methods are closely related to implicitly factorizing the complex proximity matrix. However, the approximation error is usually quite large, since a single low-rank matrix is insufficient to capture the original information. Through a multi-stage matrix factorization process motivated by gradient boosting, our MNMF model achieves lower approximation error. Meanwhile, the multi-stage structure of MNMF gives the feasibility of designing two kinds of non-negative matrix factorization (NMF) manners to preserve network information better. The united NMF aims to preserve the consensus information between different views, and the independent NMF aims to preserve unique information of each view. Concrete experimental results on realistic datasets indicate that our model outperforms three types of baselines in practical applications.


title: GTM: Gray Temporal Model for Video Recognition

abstract: Data input modality plays an important role in video action recognition. Normally, there are three types of input: RGB, flow stream and compressed data. In this paper, we proposed a new input modality: gray stream. Specifically, taken the stacked consecutive 3 gray images as input, which is the same size of RGB, can not only skip the conversion process from video decoding data to RGB, but also improve the spatio-temporal modeling ability at zero computation and zero parameters. Meanwhile, we proposed a 1D Identity Channel-wise Spatio-temporal Convolution(1D-ICSC) which captures the temporal relationship at channel-feature level within a controllable computation budget(by parameters G & R). Finally, we confirm its effectiveness and efficiency on several action recognition benchmarks, such as Kinetics, Something-Something, HMDB-51 and UCF-101, and achieve impressive results.


title: Distributed Reinforcement Learning for Privacy-Preserving Dynamic Edge Caching

abstract: Mobile edge computing (MEC) is a prominent computing paradigm which expands the application fields of wireless communication. Due to the limitation of the capacities of user equipments and MEC servers, edge caching (EC) optimization is crucial to the effective utilization of the caching resources in MEC-enabled wireless networks. However, the dynamics and complexities of content popularities over space and time as well as the privacy preservation of users pose significant challenges to EC optimization. In this paper, a privacy-preserving distributed deep deterministic policy gradient (P2D3PG) algorithm is proposed to maximize the cache hit rates of devices in the MEC networks. Specifically, we consider the fact that content popularities are dynamic, complicated and unobservable, and formulate the maximization of cache hit rates on devices as distributed problems under the constraints of privacy preservation. In particular, we convert the distributed optimizations into distributed model-free Markov decision process problems and then introduce a privacy-preserving federated learning method for popularity prediction. Subsequently, a P2D3PG algorithm is developed based on distributed reinforcement learning to solve the distributed problems. Simulation results demonstrate the superiority of the proposed approach in improving EC hit rate over the baseline methods while preserving user privacy.


title: S=T for Shimura Varieties and Moduli Spaces of p-adic Shtukas

abstract: We prove the $S=T$ conjecture proposed by Xiao-Zhu in \cite{2017arXiv170705700X}, making use of Scholze's theory of diamonds and v-stacks and Fargues-Scholze's geometric Satake equivalence. We deduce the Eichler-Shimura relation for Shimura varieties of Hodge type.


title: Faster Algorithm and Sharper Analysis for Constrained Markov Decision Process

abstract: The problem of constrained Markov decision process (CMDP) is investigated, where an agent aims to maximize the expected accumulated discounted reward subject to multiple constraints on its utilities/costs. A new primal-dual approach is proposed with a novel integration of three ingredients: entropy regularized policy optimizer, dual variable regularizer, and Nesterov's accelerated gradient descent dual optimizer, all of which are critical to achieve a faster convergence. The finite-time error bound of the proposed approach is characterized. Despite the challenge of the nonconcave objective subject to nonconcave constraints, the proposed approach is shown to converge to the global optimum with a complexity of $\tilde{\mathcal O}(1/\epsilon)$ in terms of the optimality gap and the constraint violation, which improves the complexity of the existing primal-dual approach by a factor of $\mathcal O(1/\epsilon)$ \citep{ding2020natural,paternain2019constrained}. This is the first demonstration that nonconcave CMDP problems can attain the complexity lower bound of $\mathcal O(1/\epsilon)$ for convex optimization subject to convex constraints. Our primal-dual approach and non-asymptotic analysis are agnostic to the RL optimizer used, and thus are more flexible for practical applications. More generally, our approach also serves as the first algorithm that provably accelerates constrained nonconvex optimization with zero duality gap by exploiting the geometries such as the gradient dominance condition, for which the existing acceleration methods for constrained convex optimization are not applicable.


title: Axion Homeopathy: Screening Dilaton Interactions

abstract: Cosmologically active Brans-Dicke (or dilaton) scalar fields are generically ruled out by solar system tests of gravity unless their couplings to ordinary matter are much suppressed relative to gravitational strength, and this is a major hindrance when building realistic models of light dilatons coupled to matter. We propose a new mechanism for evading such bounds if matter also couples to a light axion, that exploits nonlinear target-space curvature interactions to qualitatively change how the fields respond to a gravitating source. We find that dilaton-matter couplings that would be excluded in the absence of an axion can become acceptable given an additional small axion-matter coupling, and this is possible because the axion-dilaton interactions end up converting the would-be dilaton profile into an axion profile. The trajectories of matter test bodies are then controlled by the much weaker axion-matter couplings and can easily be small enough to escape detection. We call this mechanism Axion Homeopathy because the evasion of the dilaton-coupling bounds persists for extremely small axion couplings provided only that they are nonzero. We explore the mechanism using axio-dilaton equations that are SL(2,R) invariant (as often appear in string compactifications), since for these the general solutions exterior to a spherically symmetric source can be found analytically. We use this solution to compute the relevant PPN parameters, $\beta$ and $\gamma$, and verify that their difference from unity can be much smaller than would have been true in the absence of axion-matter couplings and so can therefore evade the experimental bounds.


title: Contextual Gradient Scaling for Few-Shot Learning

abstract: Model-agnostic meta-learning (MAML) is a well-known optimization-based meta-learning algorithm that works well in various computer vision tasks, e.g., few-shot classification. MAML is to learn an initialization so that a model can adapt to a new task in a few steps. However, since the gradient norm of a classifier (head) is much bigger than those of backbone layers, the model focuses on learning the decision boundary of the classifier with similar representations. Furthermore, gradient norms of high-level layers are small than those of the other layers. So, the backbone of MAML usually learns task-generic features, which results in deteriorated adaptation performance in the inner-loop. To resolve or mitigate this problem, we propose contextual gradient scaling (CxGrad), which scales gradient norms of the backbone to facilitate learning task-specific knowledge in the inner-loop. Since the scaling factors are generated from task-conditioned parameters, gradient norms of the backbone can be scaled in a task-wise fashion. Experimental results show that CxGrad effectively encourages the backbone to learn task-specific knowledge in the inner-loop and improves the performance of MAML up to a significant margin in both same- and cross-domain few-shot classification.


title: Detecting Backdoor Attacks Against Point Cloud Classifiers

abstract: Backdoor attacks (BA) are an emerging threat to deep neural network classifiers. A classifier being attacked will predict to the attacker's target class when a test sample from a source class is embedded with the backdoor pattern (BP). Recently, the first BA against point cloud (PC) classifiers was proposed, creating new threats to many important applications including autonomous driving. Such PC BAs are not detectable by existing BA defenses due to their special BP embedding mechanism. In this paper, we propose a reverse-engineering defense that infers whether a PC classifier is backdoor attacked, without access to its training set or to any clean classifiers for reference. The effectiveness of our defense is demonstrated on the benchmark ModeNet40 dataset for PCs.