title: Text-to-Audio Grounding Based Novel Metric for Evaluating Audio Caption Similarity

abstract: Automatic Audio Captioning (AAC) refers to the task of translating an audio sample into a natural language (NL) text that describes the audio events, source of the events and their relationships. Unlike NL text generation tasks, which rely on metrics like BLEU, ROUGE, METEOR based on lexical semantics for evaluation, the AAC evaluation metric requires an ability to map NL text (phrases) that correspond to similar sounds in addition lexical semantics. Current metrics used for evaluation of AAC tasks lack an understanding of the perceived properties of sound represented by text. In this paper, wepropose a novel metric based on Text-to-Audio Grounding (TAG), which is, useful for evaluating cross modal tasks like AAC. Experiments on publicly available AAC data-set shows our evaluation metric to perform better compared to existing metrics used in NL text and image captioning literature.


title: Fractional calculus within the optical model used in nuclear and particle physics

abstract: The optical model is a fundamental tool to describe scattering processes in nuclear physics. The basic input is an optical model potential, which describes the refraction and absorption processes more or less schematically. Of special interest is the form of the absorption potential. With increasing energy of the incident projectile, a derivation of this potential must take into account the observed energy dependent transition from surface to volume type. The classic approach has weaknesses in this regard. We will discuss these deficiencies and will propose an alternative method based on concepts developed within the framework of fractional calculus, which allows to describe a smooth transition from surface to volume absorption in an appropriate way.


title: Extractive Question Answering on Queries in Hindi and Tamil

abstract: Indic languages like Hindi and Tamil are underrepresented in the natural language processing (NLP) field compared to languages like English. Due to this underrepresentation, performance on NLP tasks (such as search algorithms) in Indic languages are inferior to their English counterparts. This difference disproportionately affects those who come from lower socioeconomic statuses because they consume the most Internet content in local languages. The goal of this project is to build an NLP model that performs better than pre-existing models for the task of extractive question-answering (QA) on a public dataset in Hindi and Tamil. Extractive QA is an NLP task where answers to questions are extracted from a corresponding body of text. To build the best solution, we used three different models. The first model is an unmodified cross-lingual version of the NLP model RoBERTa, known as XLM-RoBERTa, that is pretrained on 100 languages. The second model is based on the pretrained RoBERTa model with an extra classification head for the question answering, but we used a custom Indic tokenizer, then optimized hyperparameters and fine tuned on the Indic dataset. The third model is based on XLM-RoBERTa, but with extra finetuning and training on the Indic dataset. We hypothesize the third model will perform best because of the variety of languages the XLM-RoBERTa model has been pretrained on and the additional finetuning on the Indic dataset. This hypothesis was proven wrong because the paired RoBERTa models performed the best as the training data used was most specific to the task performed as opposed to the XLM-RoBERTa models which had much data that was not in either Hindi or Tamil.


title: Recoil Velocity of Binary Neutron Star Merger Remnants

abstract: The LIGO-Virgo gravitational wave detectors have confidently observed 4 events involving neutron stars: two binary neutron star (BNS) mergers (GW170817 and GW190425), and two neutron star-black hole mergers (GW200105 and GW200115). However, our theoretical understanding of the remnant properties of such systems is incomplete due to the complexities related to the modeling of matter effects and the very high computational cost of corresponding numerical relativity simulations. An important such property is the recoil velocity, which is imparted onto the remnant due to the anisotropic emission of gravitational radiation and the dynamical ejection of matter in the kilonova. In this work, we combine gravitational radiation as well as dynamical ejecta distributions, computed by the Computational Relativity numerical simulations, to get accurate estimates for BNS remnant recoil velocities. We find that recoils due to ejection of matter dominate those caused by gravitational wave emission. Knowledge of BNS remnant recoil velocities is important in determining if the remnant is retained by its environment for future hierarchical mergers which, in turn, can form binaries with black holes in the so-called lower mass gap of 3 to 5 solar masses.


title: On Dirac structure of infinite-dimensional stochastic port-Hamiltonian systems

abstract: Stochastic infinite-dimensional port-Hamiltonian systems (SPHSs) with multiplicative Gaussian white noise are considered. In this article we extend the notion of Dirac structure for deterministic distributed parameter port-Hamiltonian systems to a stochastic ones by adding some additional stochastic ports. Using the Stratonovich formalism of the stochastic integral, the proposed extended interconnection of ports for SPHSs is proved to still form a Dirac structure. This constitutes our main contribution. We then deduce that the interconnection between (stochastic) Dirac structures is again a (stochastic) Dirac structure under some assumptions. These interconnection results are applied on a system composed of a stochastic vibrating string actuated at the boundary by a mass-spring system with external input and output. This work is motivated by the problem of boundary control of SPHSs and will serve as a foundation to the development of stabilizing methods.


title: Spin-phonon coupling driven Charge density wave in a Kagome Magnet

abstract: The intertwining between spin, charge, and lattice degrees of freedom can give rise to unusual macroscopic quantum states, including high-temperature superconductivity and quantum anomalous Hall effects. Recently, a charge density wave (CDW) is observed in the kagome antiferromagnet FeGe, indicative of possible intertwining physics. An outstanding question is that whether magnetic correlation is fundamental for the spontaneous spatial symmetry breaking orders. Here, utilizing elastic and high-resolution inelastic x-ray scattering, we discover a charge dimerization superlattice that coexists with the 2$\times$2$\times$1 CDW in the kagome sublattice. Most interestingly, between the magnetic and CDW transition temperature, the phonon dynamical structure factor shows a giant phonon-energy hardening and a substantial phonon linewidth broadening near the charge-dimerization wavevectors, both signaling the spin-phonon coupling. By first principles calculations, we show that both the static and dynamic spin excitations intertwine with the phonon to drive the spatial symmetry breaking.


title: Perturbed eigenvalues of polyharmonic operators in domains with small holes

abstract: We study singular perturbations of eigenvalues of the polyharmonic operator on bounded domains under removal of small interior compact sets. We consider both homogeneous Dirichlet and Navier conditions on the external boundary, while we impose homogeneous Dirichlet conditions on the boundary of the removed set. To this aim, we develop a notion of capacity which is suitable for our higher-order context, and which permits to obtain a description of the asymptotic behaviour of perturbed simple eigenvalues in terms of a capacity of the removed set, in dependence of the respective normalized eigenfunction. Then, in the particular case of a subset which is scaling to a point, we apply a blow-up analysis to detect the precise convergence rate, which turns out to depend on the order of vanishing of the eigenfunction. In this respect, an important role is played by Hardy-Rellich inequalities in order to identify the appropriate functional space containing the limiting profile. Remarkably, for the biharmonic operator this turns out to be the same, regardless of the boundary conditions prescribed on the exterior boundary.


title: MFFN: Multi-view Feature Fusion Network for Camouflaged Object Detection

abstract: Recent research about camouflaged object detection (COD) aims to segment highly concealed objects hidden in complex surroundings. The tiny, fuzzy camouflaged objects result in visually indistinguishable properties. However, current single-view COD detectors are sensitive to background distractors. Therefore, blurred boundaries and variable shapes of the camouflaged objects are challenging to be fully captured with a single-view detector. To overcome these obstacles, we propose a behavior-inspired framework, called Multi-view Feature Fusion Network (MFFN), which mimics the human behaviors of finding indistinct objects in images, i.e., observing from multiple angles, distances, perspectives. Specifically, the key idea behind it is to generate multiple ways of observation (multi-view) by data augmentation and apply them as inputs. MFFN captures critical boundary and semantic information by comparing and fusing extracted multi-view features. In addition, our MFFN exploits the dependence and interaction between views and channels. Specifically, our methods leverage the complementary information between different views through a two-stage attention module called Co-attention of Multi-view (CAMV). And we design a local-overall module called Channel Fusion Unit (CFU) to explore the channel-wise contextual clues of diverse feature maps in an iterative manner. The experiment results show that our method performs favorably against existing state-of-the-art methods via training with the same data. The code will be available at https://github.com/dwardzheng/MFFN_COD.


title: A Comparative Study on 1.5T-3T MRI Conversion through Deep Neural Network Models

abstract: In this paper, we explore the capabilities of a number of deep neural network models in generating whole-brain 3T-like MR images from clinical 1.5T MRIs. The models include a fully convolutional network (FCN) method and three state-of-the-art super-resolution solutions, ESPCN [26], SRGAN [17] and PRSR [7]. The FCN solution, U-Convert-Net, carries out mapping of 1.5T-to-3T slices through a U-Net-like architecture, with 3D neighborhood information integrated through a multi-view ensemble. The pros and cons of the models, as well the associated evaluation metrics, are measured with experiments and discussed in depth. To the best of our knowledge, this study is the first work to evaluate multiple deep learning solutions for whole-brain MRI conversion, as well as the first attempt to utilize FCN/U-Net-like structure for this purpose.


title: On Extremal Rates of Storage over Graphs

abstract: A storage code over a graph maps $K$ independent source symbols, each of $L_w$ bits, to $N$ coded symbols, each of $L_v$ bits, such that each coded symbol is stored in a node of the graph and each edge of the graph is associated with one source symbol. From a pair of nodes connected by an edge, the source symbol that is associated with the edge can be decoded. The ratio $L_w/L_v$ is called the symbol rate of a storage code and the highest symbol rate is called the capacity. We show that the three highest capacity values of storage codes over graphs are $2, 3/2, 4/3$. We characterize all graphs over which the storage code capacity is $2$ and $3/2$, and for capacity value of $4/3$, necessary condition and sufficient condition (that do not match) on the graphs are given.


title: AdaNorm: Adaptive Gradient Norm Correction based Optimizer for CNNs

abstract: The stochastic gradient descent (SGD) optimizers are generally used to train the convolutional neural networks (CNNs). In recent years, several adaptive momentum based SGD optimizers have been introduced, such as Adam, diffGrad, Radam and AdaBelief. However, the existing SGD optimizers do not exploit the gradient norm of past iterations and lead to poor convergence and performance. In this paper, we propose a novel AdaNorm based SGD optimizers by correcting the norm of gradient in each iteration based on the adaptive training history of gradient norm. By doing so, the proposed optimizers are able to maintain high and representive gradient throughout the training and solves the low and atypical gradient problems. The proposed concept is generic and can be used with any existing SGD optimizer. We show the efficacy of the proposed AdaNorm with four state-of-the-art optimizers, including Adam, diffGrad, Radam and AdaBelief. We depict the performance improvement due to the proposed optimizers using three CNN models, including VGG16, ResNet18 and ResNet50, on three benchmark object recognition datasets, including CIFAR10, CIFAR100 and TinyImageNet. Code: https://github.com/shivram1987/AdaNorm.


title: Wavefunction extreme value statistics in Anderson localization

abstract: We consider a disordered one-dimensional tight-binding model with power-law decaying hopping amplitudes to disclose wavefunction maximum distributions related to the Anderson localization phenomenon. Deeply in the regime of extended states, the wavefunction intensities follow the Porter-Thomas distribution while their maxima assume the Gumbel distribution. At the critical point, distinct scaling laws govern the regimes of small and large wavefunction intensities with a multifractal singularity spectrum. The distribution of maxima deviates from the usual Gumbel form and some characteristic finite-size scaling exponents are reported. Well within the localization regime, the wavefunction intensity distribution is shown to develop a sequence of pre-power-law, power-law, exponential and anomalous localized regimes. Their values are strongly correlated, which significantly affects the emerging extreme values distribution.


title: A Generalist Framework for Panoptic Segmentation of Images and Videos

abstract: Panoptic segmentation assigns semantic and instance ID labels to every pixel of an image. As permutations of instance IDs are also valid solutions, the task requires learning of high-dimensional one-to-many mapping. As a result, state-of-the-art approaches use customized architectures and task-specific loss functions. We formulate panoptic segmentation as a discrete data generation problem, without relying on inductive bias of the task. A diffusion model is proposed to model panoptic masks, with a simple architecture and generic loss function. By simply adding past predictions as a conditioning signal, our method is capable of modeling video (in a streaming setting) and thereby learns to track object instances automatically. With extensive experiments, we demonstrate that our simple approach can perform competitively to state-of-the-art specialist methods in similar settings.


title: Quadratic minimization: from conjugate gradient to an adaptive Heavy-ball method with Polyak step-sizes

abstract: In this work, we propose an adaptive variation on the classical Heavy-ball method for convex quadratic minimization. The adaptivity crucially relies on so-called "Polyak step-sizes", which consists in using the knowledge of the optimal value of the optimization problem at hand instead of problem parameters such as a few eigenvalues of the Hessian of the problem. This method happens to also be equivalent to a variation of the classical conjugate gradient method, and thereby inherits many of its attractive features, including its finite-time convergence, instance optimality, and its worst-case convergence rates. The classical gradient method with Polyak step-sizes is known to behave very well in situations in which it can be used, and the question of whether incorporating momentum in this method is possible and can improve the method itself appeared to be open. We provide a definitive answer to this question for minimizing convex quadratic functions, a arguably necessary first step for developing such methods in more general setups.


title: Individualized Conditioning and Negative Distances for Speaker Separation

abstract: Speaker separation aims to extract multiple voices from a mixed signal. In this paper, we propose two speaker-aware designs to improve the existing speaker separation solutions. The first model is a speaker conditioning network that integrates speech samples to generate individualized speaker conditions, which then provide informed guidance for a separation module to produce well-separated outputs. The second design aims to reduce non-target voices in the separated speech. To this end, we propose negative distances to penalize the appearance of any non-target voice in the channel outputs, and positive distances to drive the separated voices closer to the clean targets. We explore two different setups, weighted-sum and triplet-like, to integrate these two distances to form a combined auxiliary loss for the separation networks. Experiments conducted on LibriMix demonstrate the effectiveness of our proposed models.


title: The Tits Alternative for two-dimensional Artin groups and Wise's Power Alternative

abstract: We show that two-dimensional Artin groups satisfy a strengthening of the Tits alternative: their subgroups either contain a non-abelian free group or are virtually free abelian of rank at most $2$. When in addition the associated Coxeter group is hyperbolic, we answer in the affirmative a question of Wise on the subgroups generated by large powers of two elements: given any two elements $a, b$ of a two-dimensional Artin group of hyperbolic type, there exists an integer $n\geq 1$ such that $a^n$ and $b^n$ either commute or generate a non-abelian free subgroup.


title: Can we use Common Voice to train a Multi-Speaker TTS system?

abstract: Training of multi-speaker text-to-speech (TTS) systems relies on curated datasets based on high-quality recordings or audiobooks. Such datasets often lack speaker diversity and are expensive to collect. As an alternative, recent studies have leveraged the availability of large, crowdsourced automatic speech recognition (ASR) datasets. A major problem with such datasets is the presence of noisy and/or distorted samples, which degrade TTS quality. In this paper, we propose to automatically select high-quality training samples using a non-intrusive mean opinion score (MOS) estimator, WV-MOS. We show the viability of this approach for training a multi-speaker GlowTTS model on the Common Voice English dataset. Our approach improves the overall quality of generated utterances by 1.26 MOS point with respect to training on all the samples and by 0.35 MOS point with respect to training on the LibriTTS dataset. This opens the door to automatic TTS dataset curation for a wider range of languages.


title: (La,Th)H$_{10}$: the potential high-$T_{c}$ superconductors stabilized thermodynamically below 200 GPa

abstract: The recent high-pressure experimental discovery of superconductivity in (La,Y)H$_{10}$, (La,Ce)H$_{9}$, (La,Ce)H$_{10}$, (Y,Ce)H$_{9}$, and (La,Nd)H$_{10}$ shows that the ternary rare-earth clathrate hydride can be promising candidate for high-temperature superconductor. In this work, we theoretically demonstrate that the combination of actinide-metal thorium (Th) and rare-earth-metal lanthanum (La) with hydrogen can also form some ternary hydrides with cage-like structures to be stable at 200 GPa. Using the evolutionary algorithms combined with the first-principles calculations, we have predicted the pressure-dependent ternary phase diagram of La$_{x}$Th$_{y}$H$_{z}$, particularly including the case of (La$_{1-x}$Th$_{x}$)H$_{n}$ [or designated as (La,Th)H$_{n}$ for simplicity]. Our calculations show that the hydrogen-rich phases such as (La,Th)H$_{9}$ (only including $P\bar{6}m2$-LaThH$_{18}$) and (La,Th)H$_{10}$ (including $I4/mmm$-La$_{3}$ThH$_{40}$, $R\bar{3}m$-LaThH$_{20}$, and $I4/mmm$-LaTh$_{3}$H$_{40}$) with H$_{29}$ and H$_{32}$ cages can be thermodynamically stable below 200 GPa. However, the phase decomposition can happen to only (La,Th)H$_{9}$ when the pressure is above 150 GPa. More importantly, the electron-phonon coupling (EPC) calculations show that the (La,Th)H$_{10}$ series could the potential superconductors, of which $I4/mmm$-La$_{3}$ThH$_{40}$ at 200 GPa exhibits the large EPC constant $\lambda$ = 2.46 with a highest transition temperature ($T_\mathrm{c}$) of 210 K. Since there are few previous studies on ternary hydrides composed of actinide metals, the present work would greatly stimulate the further discovery of this type of ternary hydrides and provide useful guidance for the high-pressure experimental studies on them.


title: Stacking-induced magnetic frustration and spiral spin liquid

abstract: Like the twisting control in magic angle twisted bilayer graphenes, the stacking control is another mechanical approach to manipulate the fundamental properties of solids, especially the van der Waals materials. We explore the stacking-induced magnetic frustration and the spiral spin liquid on a multilayer triangular lattice antiferromagnet where the system is built from ABC stacking with competing intralayer and interlayers couplings. By combining the nematic bond theory and the self-consistent Gaussian approximation, we establish the phase diagram for this ABC-stacked multilayer magnet. It is shown that, the system supports a wide regime of spiral spin liquid with multiple degenerate spiral lines in the reciprocal space, separating the low-temperature spiral order and the high-temperature featureless paramagnet. The transition to the spiral order from the spiral spin liquid regime is first order. We further show that the spiral-spin-liquid behavior persists even with small perturbations such as further neighbor intralayer exchanges. The connection to the ABC-stacked magnets, the effects of Ising or planar spin anisotropy, and the outlook on the stacking-engineered quantum magnets are discussed.


title: Learning Multi-resolution Functional Maps with Spectral Attention for Robust Shape Matching

abstract: In this work, we present a novel non-rigid shape matching framework based on multi-resolution functional maps with spectral attention. Existing functional map learning methods all rely on the critical choice of the spectral resolution hyperparameter, which can severely affect the overall accuracy or lead to overfitting, if not chosen carefully. In this paper, we show that spectral resolution tuning can be alleviated by introducing spectral attention. Our framework is applicable in both supervised and unsupervised settings, and we show that it is possible to train the network so that it can adapt the spectral resolution, depending on the given shape input. More specifically, we propose to compute multi-resolution functional maps that characterize correspondence across a range of spectral resolutions, and introduce a spectral attention network that helps to combine this representation into a single coherent final correspondence. Our approach is not only accurate with near-isometric input, for which a high spectral resolution is typically preferred, but also robust and able to produce reasonable matching even in the presence of significant non-isometric distortion, which poses great challenges to existing methods. We demonstrate the superior performance of our approach through experiments on a suite of challenging near-isometric and non-isometric shape matching benchmarks.


title: The set of destabilizing curves for deformed Hermitian Yang-Mills and Z-critical equations on surfaces

abstract: We show that on any compact K\"ahler surface existence of solutions to the Z-critical equation can be characterized using a finite number of effective conditions, where the number of conditions is bounded above by the Picard number of the surface.This leads to a first PDE analogue of the locally finite wall-chamber decomposition in Bridgeland stability. As an application we characterize optimally destabilizing curves for Donaldson's J-equation and the deformed Hermitian Yang-Mills equation, prove a non-existence result for optimally destabilizing test configurations for uniform J-stability, and remark on improvements to convergence results for certain geometric flows.


title: Superpolynomial Lower Bounds for Decision Tree Learning and Testing

abstract: We establish new hardness results for decision tree optimization problems, adding to a line of work that dates back to Hyafil and Rivest in 1976. We prove, under randomized ETH, superpolynomial lower bounds for two basic problems: given an explicit representation of a function $f$ and a generator for a distribution $\mathcal{D}$, construct a small decision tree approximator for $f$ under $\mathcal{D}$, and decide if there is a small decision tree approximator for $f$ under $\mathcal{D}$. Our results imply new lower bounds for distribution-free PAC learning and testing of decision trees, settings in which the algorithm only has restricted access to $f$ and $\mathcal{D}$. Specifically, we show: $n$-variable size-$s$ decision trees cannot be properly PAC learned in time $n^{\tilde{O}(\log\log s)}$, and depth-$d$ decision trees cannot be tested in time $\exp(d^{\,O(1)})$. For learning, the previous best lower bound only ruled out $\text{poly}(n)$-time algorithms (Alekhnovich, Braverman, Feldman, Klivans, and Pitassi, 2009). For testing, recent work gives similar though incomparable bounds in the setting where $f$ is random and $\mathcal{D}$ is nonexplicit (Blais, Ferreira Pinto Jr., and Harms, 2021). Assuming a plausible conjecture on the hardness of Set-Cover, we show our lower bound for learning decision trees can be improved to $n^{\Omega(\log s)}$, matching the best known upper bound of $n^{O(\log s)}$ due to Ehrenfeucht and Haussler (1989). We obtain our results within a unified framework that leverages recent progress in two lines of work: the inapproximability of Set-Cover and XOR lemmas for query complexity. Our framework is versatile and yields results for related concept classes such as juntas and DNF formulas.


title: Probing Commonsense Knowledge in Pre-trained Language Models with Sense-level Precision and Expanded Vocabulary

abstract: Progress on commonsense reasoning is usually measured from performance improvements on Question Answering tasks designed to require commonsense knowledge. However, fine-tuning large Language Models (LMs) on these specific tasks does not directly evaluate commonsense learned during pre-training. The most direct assessments of commonsense knowledge in pre-trained LMs are arguably cloze-style tasks targeting commonsense assertions (e.g., A pen is used for [MASK].). However, this approach is restricted by the LM's vocabulary available for masked predictions, and its precision is subject to the context provided by the assertion. In this work, we present a method for enriching LMs with a grounded sense inventory (i.e., WordNet) available at the vocabulary level, without further training. This modification augments the prediction space of cloze-style prompts to the size of a large ontology while enabling finer-grained (sense-level) queries and predictions. In order to evaluate LMs with higher precision, we propose SenseLAMA, a cloze-style task featuring verbalized relations from disambiguated triples sourced from WordNet, WikiData, and ConceptNet. Applying our method to BERT, producing a WordNet-enriched version named SynBERT, we find that LMs can learn non-trivial commonsense knowledge from self-supervision, covering numerous relations, and more effectively than comparable similarity-based approaches.


title: Smooth Trajectory Collision Avoidance through Deep Reinforcement Learning

abstract: Collision avoidance is a crucial task in vision-guided autonomous navigation. Solutions based on deep reinforcement learning (DRL) has become increasingly popular. In this work, we proposed several novel agent state and reward function designs to tackle two critical issues in DRL-based navigation solutions: 1) smoothness of the trained flight trajectories; and 2) model generalization to handle unseen environments. Formulated under a DRL framework, our model relies on margin reward and smoothness constraints to ensure UAVs fly smoothly while greatly reducing the chance of collision. The proposed smoothness reward minimizes a combination of first-order and second-order derivatives of flight trajectories, which can also drive the points to be evenly distributed, leading to stable flight speed. To enhance the agent's capability of handling new unseen environments, two practical setups are proposed to improve the invariance of both the state and reward function when deploying in different scenes. Experiments demonstrate the effectiveness of our overall design and individual components.


title: Random Group Actions on $\mathrm{CAT}(0)$ Square Complexes

abstract: We generalize ideas of Jahncke from trees to square complexes. We introduce the notion of progression in $\mathrm{CAT}(0)$ square complexes. Using progression, we are able to build on the proof strategy of Dahmani-Guirardel-Przytycki to show any action of a random group with seven or more generators on a $\mathrm{CAT}(0)$ square complex has a global fixed point.


title: One does not fit all! On the Complementarity of Vision Encoders for Vision and Language Tasks

abstract: Current multimodal models, aimed at solving Vision and Language (V+L) tasks, predominantly repurpose Vision Encoders (VE) as feature extractors. While many VEs -- of different architectures, trained on different data and objectives -- are publicly available, they are not designed for the downstream V+L tasks. Nonetheless, most current work assumes that a \textit{single} pre-trained VE can serve as a general-purpose encoder. In this work, we focus on analysis and aim to understand whether the information stored within different VEs is complementary, i.e. if providing the model with features from multiple VEs can improve the performance on a target task, and how they are combined. We exhaustively experiment with three popular VEs on six downstream V+L tasks and analyze the attention and VE-dropout patterns. Our analyses suggest that diverse VEs complement each other, resulting in improved downstream V+L task performance, where the improvements are not due to simple ensemble effects (i.e. the performance does not always improve when increasing the number of encoders). We demonstrate that future VEs, which are not \textit{repurposed}, but explicitly \textit{designed} for V+L tasks, have the potential of improving performance on the target V+L tasks.


title: Near-Optimal Multi-Agent Learning for Safe Coverage Control

abstract: In multi-agent coverage control problems, agents navigate their environment to reach locations that maximize the coverage of some density. In practice, the density is rarely known $\textit{a priori}$, further complicating the original NP-hard problem. Moreover, in many applications, agents cannot visit arbitrary locations due to $\textit{a priori}$ unknown safety constraints. In this paper, we aim to efficiently learn the density to approximately solve the coverage problem while preserving the agents' safety. We first propose a conditionally linear submodular coverage function that facilitates theoretical analysis. Utilizing this structure, we develop MacOpt, a novel algorithm that efficiently trades off the exploration-exploitation dilemma due to partial observability, and show that it achieves sublinear regret. Next, we extend results on single-agent safe exploration to our multi-agent setting and propose SafeMac for safe coverage and exploration. We analyze SafeMac and give first of its kind results: near optimal coverage in finite time while provably guaranteeing safety. We extensively evaluate our algorithms on synthetic and real problems, including a bio-diversity monitoring task under safety constraints, where SafeMac outperforms competing methods.


title: Good Intentions, Bad Inventions: How Employees Judge Pervasive Technologies in the Workplace

abstract: Pervasive technologies combined with powerful AI have been recently introduced to enhance work productivity. Yet, some of these technologies are judged to be invasive. To identify which ones, we should understand how employees tend to judge these technologies. We considered 16 technologies that track productivity, and conducted a study in which 131 crowd-workers judged these scenarios. We found that a technology was judged to be right depending on the following three aspects of increasing importance. That is, whether the technology: 1) was currently supported by existing tools; 2) did not interfere with work or was fit for purpose; and 3) did not cause any harm or did not infringe on any individual rights. Ubicomp research currently focuses on how to design better technologies by making them more accurate, or by increasingly blending them into the background. It might be time to design better ubiquitous technologies by unpacking AI ethics as well.


title: An Ensemble Teacher-Student Learning Approach with Poisson Sub-sampling to Differential Privacy Preserving Speech Recognition

abstract: We propose an ensemble learning framework with Poisson sub-sampling to effectively train a collection of teacher models to issue some differential privacy (DP) guarantee for training data. Through boosting under DP, a student model derived from the training data suffers little model degradation from the models trained with no privacy protection. Our proposed solution leverages upon two mechanisms, namely: (i) a privacy budget amplification via Poisson sub-sampling to train a target prediction model that requires less noise to achieve a same level of privacy budget, and (ii) a combination of the sub-sampling technique and an ensemble teacher-student learning framework that introduces DP-preserving noise at the output of the teacher models and transfers DP-preserving properties via noisy labels. Privacy-preserving student models are then trained with the noisy labels to learn the knowledge with DP-protection from the teacher model ensemble. Experimental evidences on spoken command recognition and continuous speech recognition of Mandarin speech show that our proposed framework greatly outperforms existing DP-preserving algorithms in both speech processing tasks.


title: Wellposedness for a (1+1)-dimensional wave equation with quasilinear boundary condition

abstract: We consider the linear wave equation $V(x) u_{tt}(x, t) - u_{xx}(x, t) = 0$ on $[0, \infty)\times[0, \infty)$ with initial conditions and a nonlinear Neumann boundary condition $u_x(0, t) = (f(u_t(0,t)))_t$ at $x=0$. This problem is an exact reduction of a nonlinear Maxwell problem in electrodynamics. In the case where $f\colon\mathbb{R}\to\mathbb{R}$ is an increasing homeomorphism we study global existence, uniqueness and wellposedness of the initial value problem by the method of characteristics and fixed point methods. We also prove conservation of energy and momentum and discuss why there is no wellposedness in the case where $f$ is a decreasing homeomorphism. Finally we show that previously known time-periodic, spatially localized solutions (breathers) of the wave equation with the nonlinear Neumann boundary condition at $x=0$ have enough regularity to solve the initial value problem with their own initial data.


title: GMP*: Well-Tuned Gradual Magnitude Pruning Can Outperform Most BERT-Pruning Methods

abstract: We revisit the performance of the classic gradual magnitude pruning (GMP) baseline for large language models, focusing on the classic BERT benchmark on various popular tasks. Despite existing evidence in the literature that GMP performs poorly, we show that a simple and general variant, which we call GMP*, can match and sometimes outperform more complex state-of-the-art methods. Our results provide a simple yet strong baseline for future work, highlight the importance of parameter tuning for baselines, and even improve the performance of the state-of-the-art second-order pruning method in this setting.


title: The Extreme Cardiac MRI Analysis Challenge under Respiratory Motion (CMRxMotion)

abstract: The quality of cardiac magnetic resonance (CMR) imaging is susceptible to respiratory motion artifacts. The model robustness of automated segmentation techniques in face of real-world respiratory motion artifacts is unclear. This manuscript describes the design of extreme cardiac MRI analysis challenge under respiratory motion (CMRxMotion Challenge). The challenge aims to establish a public benchmark dataset to assess the effects of respiratory motion on image quality and examine the robustness of segmentation models. The challenge recruited 40 healthy volunteers to perform different breath-hold behaviors during one imaging visit, obtaining paired cine imaging with artifacts. Radiologists assessed the image quality and annotated the level of respiratory motion artifacts. For those images with diagnostic quality, radiologists further segmented the left ventricle, left ventricle myocardium and right ventricle. The images of training set (20 volunteers) along with the annotations are released to the challenge participants, to develop an automated image quality assessment model (Task 1) and an automated segmentation model (Task 2). The images of validation set (5 volunteers) are released to the challenge participants but the annotations are withheld for online evaluation of submitted predictions. Both the images and annotations of the test set (15 volunteers) were withheld and only used for offline evaluation of submitted containerized dockers. The image quality assessment task is quantitatively evaluated by the Cohen's kappa statistics and the segmentation task is evaluated by the Dice scores and Hausdorff distances.


title: Multi-Level Firing with Spiking DS-ResNet: Enabling Better and Deeper Directly-Trained Spiking Neural Networks

abstract: Spiking neural networks (SNNs) are bio-inspired neural networks with asynchronous discrete and sparse characteristics, which have increasingly manifested their superiority in low energy consumption. Recent research is devoted to utilizing spatio-temporal information to directly train SNNs by backpropagation. However, the binary and non-differentiable properties of spike activities force directly trained SNNs to suffer from serious gradient vanishing and network degradation, which greatly limits the performance of directly trained SNNs and prevents them from going deeper. In this paper, we propose a multi-level firing (MLF) method based on the existing spatio-temporal back propagation (STBP) method, and spiking dormant-suppressed residual network (spiking DS-ResNet). MLF enables more efficient gradient propagation and the incremental expression ability of the neurons. Spiking DS-ResNet can efficiently perform identity mapping of discrete spikes, as well as provide a more suitable connection for gradient propagation in deep SNNs. With the proposed method, our model achieves superior performances on a non-neuromorphic dataset and two neuromorphic datasets with much fewer trainable parameters and demonstrates the great ability to combat the gradient vanishing and degradation problem in deep SNNs.


title: Intertwining of maxima of sum of translates functions with nonsingular kernels

abstract: In previous papers we investigated so-called sum of translates functions $F({\mathbf{x}},t):=J(t)+\sum_{j=1}^n \nu_j K(t-x_j)$, where $J:[0,1]\to \underline{\mathbb{R}}:={\mathbb{R}}\cup\{-\infty\}$ is a "sufficiently nondegenerate" and upper-bounded "field function", and $K:[-1,1]\to \underline{\mathbb{R}}$ is a fixed "kernel function", concave both on $(-1,0)$ and $(0,1)$, and also satisfying the singularity condition $K(0)=\lim_{t\to 0} K(t)=-\infty$. For node systems ${\mathbf{x}}:=(x_1,\ldots,x_n)$ with $x_0:=0\le x_1\le\dots\le x_n\le 1=:x_{n+1}$, we analyzed the behavior of the local maxima vector ${\mathbf{m}}:=(m_0,m_1,\ldots,m_n)$, where $m_j:=m_j({\mathbf{x}}):=\sup_{x_j\le t\le x_{j+1}} F({\mathbf{x}},t)$. Among other results we proved a strong intertwining property: if the kernels are also decreasing on $(-1,0)$ and increasing on $(0,1)$, and the field function is upper semicontinuous, then for any two different node systems there are $i,j$ such that $m_i({\mathbf{x}})<m_i({\mathbf{y}})$ and $m_j({\mathbf{x}})>m_j({\mathbf{y}})$. Here we partially succeed to extend this even to nonsingular kernels.


title: Optimal design-for-control of self-cleaning water distribution networks using a convex multi-start algorithm

abstract: The provision of self-cleaning velocities has been shown to reduce the risk of discolouration in water distribution networks (WDNs). Despite these findings, control implementations continue to be focused primarily on pressure and leakage management. This paper considers the control of diurnal flow velocities to maximize the self-cleaning capacity (SCC) of WDNs. We formulate a new optimal design-for-control problem where locations and operational settings of pressure control and automatic flushing valves are jointly optimized. The problem formulation includes a nonconvex objective function, nonconvex hydraulic conservation law constraints, and binary variables for modelling valve placement, resulting in a nonconvex mixed integer nonlinear programming (MINLP) optimization problem. Considering the challenges with solving nonconvex MINLP problems, we propose a heuristic algorithm which combines convex relaxations (with domain reduction), a randomization technique, and a multi-start strategy to compute feasible solutions. We evaluate the proposed algorithm on case study networks with varying size and degrees of complexity, including a large-scale operational network in the UK. The convex multi-start algorithm is shown to be a more robust solution method compared to an off-the-shelf genetic algorithm, finding good-quality feasible solutions to all design-for-control numerical experiments. Moreover, we demonstrate the implemented multi-start strategy to be a fast and scalable method for computing feasible solutions to the nonlinear SCC control problem. The proposed method extends the control capabilities and benefits of dynamically adaptive networks to improve water quality in WDNs.


title: A flower theorem in dimension two

abstract: We prove a two-dimensional analog of Leau-Fatou flower theorem for non-degenerate reduced tangent to the identity biholomorphisms.


title: Spectral cube extraction for the VLT/SPHERE IFS: Open-source pipeline with full forward modeling and improved sensitivity

abstract: We present a new open-source data-reduction pipeline to reconstruct spectral data cubes from raw SPHERE integral-field spectrograph (IFS) data. The pipeline is written in Python and based on the pipeline that was developed for the CHARIS IFS. It introduces several improvements to SPHERE data analysis that ultimately produce significant improvements in postprocessing sensitivity. We first used new data to measure SPHERE lenslet point spread functions (PSFs) at the four laser calibration wavelengths. These lenslet PSFs enabled us to forward-model SPHERE data, to extract spectra using a least-squares fit, and to remove spectral crosstalk using the measured lenslet PSFs. Our approach also reduces the number of required interpolations, both spectral and spatial, and can preserve the original hexagonal lenslet geometry in the SPHERE IFS. In the case of least-squares extraction, no interpolation of the data is performed. We demonstrate this new pipeline on the directly imaged exoplanet 51 Eri b and on observations of the hot white dwarf companion to HD 2133. The extracted spectrum of HD 2133B matches theoretical models, demonstrating spectrophotometric calibration that is good to a few percent. Postprocessing on two 51 Eri b data sets demonstrates a median improvement in sensitivity of 80% and 30% for the 2015 and 2017 data, respectively, compared to the use of cubes reconstructed by the SPHERE Data Center. The largest improvements are seen for poorer observing conditions. The new SPHERE pipeline takes less than three minutes to produce a data cube on a modern laptop, making it practical to reprocess all SPHERE IFS data.


title: What Makes Graph Neural Networks Miscalibrated?

abstract: Given the importance of getting calibrated predictions and reliable uncertainty estimations, various post-hoc calibration methods have been developed for neural networks on standard multi-class classification tasks. However, these methods are not well suited for calibrating graph neural networks (GNNs), which presents unique challenges such as accounting for the graph structure and the graph-induced correlations between the nodes. In this work, we conduct a systematic study on the calibration qualities of GNN node predictions. In particular, we identify five factors which influence the calibration of GNNs: general under-confident tendency, diversity of nodewise predictive distributions, distance to training nodes, relative confidence level, and neighborhood similarity. Furthermore, based on the insights from this study, we design a novel calibration method named Graph Attention Temperature Scaling (GATS), which is tailored for calibrating graph neural networks. GATS incorporates designs that address all the identified influential factors and produces nodewise temperature scaling using an attention-based architecture. GATS is accuracy-preserving, data-efficient, and expressive at the same time. Our experiments empirically verify the effectiveness of GATS, demonstrating that it can consistently achieve state-of-the-art calibration results on various graph datasets for different GNN backbones.


title: The effect of the Katz parameter on node ranking, with a medical application

abstract: Katz centrality is a popular network centrality measure. It takes a (weighted) count of all walks starting at each node, with an additional damping factor of $\alpha$ that tunes the influence of walks as lengths increase. We introduce a tool to compare different centrality measures in terms of their node rankings, which takes into account that a relative ranking of two nodes by a centrality measure is unreliable if their scores are within a margin of error of one another. We employ this tool to understand the effect of the $\alpha$-parameter on the lengths of walks that significantly affect the ranking of nodes. In particular, we find an upper bound on the lengths of the walks that determine the node ranking up to this margin of error. If an application imposes a realistic bound on possible walk lengths, this set of tools may be helpful to determine a suitable value for $\alpha$. We show the effect of $\alpha$ on rankings when applied to the Susceptibility Inference Network, which contains subject matter expert informed data that represents the probabilities of medical conditions progressing from one to another. This network is part of the Medical Extensible Dynamic Probabilistic Risk Assessment Tool, developed by NASA, an event-based risk modeling tool that assesses human health and medical risk during space exploration missions.


title: Application Scheduling with Multiplexed Sensing of Monitoring Points in Multi-purpose IoT Wireless Sensor Networks

abstract: Wireless sensor networks (WSNs) have many applications and are an essential part of IoT systems. The primary functionality of a WSN is gathering data from specific points that are covered with sensor nodes and transmitting the collected data to remote units for further processing. In IoT use cases, a WSN infrastructure may need to be shared by many applications, which requires scheduling those applications to time-share the node and network resources. In this paper, we investigate the problem of application scheduling in WSN infrastructures. We focus on the scenarios where applications request a set of monitoring points to be sensed in the region a WSN spans and propose a shared-data approach utilizing multiplexed sensing of monitoring points requested by multiple applications, which reduces sensing and communication load on the network. We also propose a genetic algorithm called GABAS, and three greedy algorithms for scheduling applications onto a WSN infrastructure considering different criteria. We performed extensive simulation experiments to evaluate our algorithms and compare them to some standard scheduling methods. The results show that our proposed methods perform much better than the standard scheduling methods in terms of makespan, turnaround time, waiting time, and successful execution rate metrics. We also observed that our genetic algorithm is very effective in scheduling applications with respect to these metrics.


title: On Text Style Transfer via Style Masked Language Models

abstract: Text Style Transfer (TST) is performable through approaches such as latent space disentanglement, cycle-consistency losses, prototype editing etc. The prototype editing approach, which is known to be quite successful in TST, involves two key phases a) Masking of source style-associated tokens and b) Reconstruction of this source-style masked sentence conditioned with the target style. We follow a similar transduction method, in which we transpose the more difficult direct source to target TST task to a simpler Style-Masked Language Model (SMLM) Task, wherein, similar to BERT \cite{bert}, the goal of our model is now to reconstruct the source sentence from its style-masked version. We arrive at the SMLM mechanism naturally by formulating prototype editing/ transduction methods in a probabilistic framework, where TST resolves into estimating a hypothetical parallel dataset from a partially observed parallel dataset, wherein each domain is assumed to have a common latent style-masked prior. To generate this style-masked prior, we use "Explainable Attention" as our choice of attribution for a more precise style-masking step and also introduce a cost-effective and accurate "Attribution-Surplus" method of determining the position of masks from any arbitrary attribution model in O(1) time. We empirically show that this non-generational approach well suites the "content preserving" criteria for a task like TST, even for a complex style like Discourse Manipulation. Our model, the Style MLM, outperforms strong TST baselines and is on par with state-of-the-art TST models, which use complex architectures and orders of more parameters.


title: Spectral actions for q-particles and their asymptotics

abstract: For spectral actions consisting of the average number of particles and arising from open systems made of general free $q$-particles (including Bose, Fermi and classical ones corresponding to $q=\pm 1$ and $0$, respectively) in thermal equilibrium, we compute the asymptotic expansion with respect to the natural cut-off. We treat both relevant situations relative to massless and non relativistic massive particles, where the natural cut-off is $1/\beta=k_{\rm B}T$ and $1/\sqrt{\beta}$, respectively. We show that the massless situation enjoys less regularity properties than the massive one. We also treat in some detail the relativistic massive case for which the natural cut-off is again $1/\beta$. We then consider the passage to the continuum describing infinitely extended open systems in thermal equilibrium, by also discussing the appearance of condensation phenomena occurring for Bose-like $q$-particles, $q\in(0,1]$. We then compare the arising results for the finite volume situation (discrete spectrum) with the corresponding infinite volume one (continuous spectrum).


title: Fifth forces and frame invariance

abstract: I discuss how one can apply the covariant formalism developed by Vilkovisky and DeWitt to obtain frame invariant fifth force calculations for scalar-tensor theories. Fifth forces are severely constrained by astrophysical measurements. It was shown previously that for scale-invariant Higgs-dilaton gravity, in a particular choice of Jordan frame, the dilaton fifth force is dramatically suppressed, evading the observational constraints. Using a geometric approach I extend this result to all frames, and show that the usual dichotomy of "Jordan frame" versus "Einstein frame" is better understood as a continuum of frames: submanifold slices of a more general field space.


title: Star Anagram Detection and Classification

abstract: A star anagram is a rearrangement of the letters of one word to produce another word where no letter retains its original neighbors. These maximally shuffled anagrams are rare, comprising only about 5.7% of anagrams in English. They can also be depicted as unicursal polygons with varying forms, including the eponymous stars. We develop automated methods for detecting stars among other anagrams and for classifying them based on their polygon's degree of both rotational and reflective symmetry. Next, we explore several properties of star anagrams including proofs for two results about the edge lengths of perfect, i.e., maximally symmetric, stars leveraging perhaps surprising connections to modular arithmetic and the celebrated Chinese Remainder Theorem. Finally, we conduct an exhaustive search of English for star anagrams and provide numerical results about their clustering into common shapes along with examples of geometrically noteworthy stars.


title: Prospects of testing late-time cosmology with weak lensing of gravitational waves and galaxy surveys

abstract: We investigate the synergy of upcoming galaxy surveys and gravitational wave (GW) experiments in constraining late-time cosmology, examining the cross-correlations between the weak lensing of gravitational waves (GW-WL) and the galaxy fields. Without focusing on any specific GW detector configuration, we benchmark the requirements for the high-precision measurement of cosmological parameters by considering several scenarios, varying the number of detected GW events and the uncertainty on the inference of the source luminosity distance and redshift. We focus on $\Lambda$CDM and scalar-tensor cosmologies, using the Effective Field Theory formalism as a unifying language. We find that, in some of the explored setups, GW-WL contributes to the galaxy signal by doubling the accuracy on non-$\Lambda$CDM parameters, allowing in the most favourable scenarios to reach even percent and sub-percent level bounds. Though the most extreme cases presented here are likely beyond the observational capabilities of currently planned individual GW detectors, we show nonetheless that - provided that enough statistics of events can be accumulated - GW-WL offers the potential to become a cosmological probe complementary to LSS surveys, particularly for those parameters that cannot be constrained by other GW probes such as standard sirens.


title: DQLAP: Deep Q-Learning Recommender Algorithm with Update Policy for a Real Steam Turbine System

abstract: In modern industrial systems, diagnosing faults in time and using the best methods becomes more and more crucial. It is possible to fail a system or to waste resources if faults are not detected or are detected late. Machine learning and deep learning have proposed various methods for data-based fault diagnosis, and we are looking for the most reliable and practical ones. This paper aims to develop a framework based on deep learning and reinforcement learning for fault detection. We can increase accuracy, overcome data imbalance, and better predict future defects by updating the reinforcement learning policy when new data is received. By implementing this method, we will see an increase of $3\%$ in all evaluation metrics, an improvement in prediction speed, and $3\%$ - $4\%$ in all evaluation metrics compared to typical backpropagation multi-layer neural network prediction with similar parameters.


title: Space-variant Shack-Hartmann wavefront sensing based on affine transformation estimation

abstract: The space-variant wavefront reconstruction problem inherently exists in deep tissue imaging. In this paper,we propose a framework of Shack-Hartmann wavefront space-variant sensing with extended source illumination. The space-variant wavefront is modeled as a four-dimensional function where two dimensionsare in the spatial domain and two in the Fourier domain with priors that both gently vary. Here, the affinetransformation is used to characterize the wavefront space-variant function. Correspondingly, the zonaland modal methods are both escalated to adapt to four-dimensional representation and reconstruction.Experiments and simulations show double to quadruple improvements in space-variant wavefront reconstruction accuracy compared to the conventional space-invariant correlation method.


title: Improving information retention in large scale online continual learning

abstract: Given a stream of data sampled from non-stationary distributions, online continual learning (OCL) aims to adapt efficiently to new data while retaining existing knowledge. The typical approach to address information retention (the ability to retain previous knowledge) is keeping a replay buffer of a fixed size and computing gradients using a mixture of new data and the replay buffer. Surprisingly, the recent work (Cai et al., 2021) suggests that information retention remains a problem in large scale OCL even when the replay buffer is unlimited, i.e., the gradients are computed using all past data. This paper focuses on this peculiarity to understand and address information retention. To pinpoint the source of this problem, we theoretically show that, given limited computation budgets at each time step, even without strict storage limit, naively applying SGD with constant or constantly decreasing learning rates fails to optimize information retention in the long term. We propose using a moving average family of methods to improve optimization for non-stationary objectives. Specifically, we design an adaptive moving average (AMA) optimizer and a moving-average-based learning rate schedule (MALR). We demonstrate the effectiveness of AMA+MALR on large-scale benchmarks, including Continual Localization (CLOC), Google Landmarks, and ImageNet. Code will be released upon publication.


title: Relaxed Kacanov scheme for the p-Laplacian with large p

abstract: We introduce a globally convergent relaxed Kacanov scheme for the computation of the discrete minimizer to the $p$-Laplace problem with $2 \leq p < \infty$. The iterative scheme is easy to implement since each iterate results only from the solve of a weighted, linear Poisson problem. It neither requires an additional line search nor involves unknown constants for the step length. The rate of convergence is independent of the underlying mesh.


title: On the location of ratios of zeros of special trinomials

abstract: Consider the sequence of complex polynomials $\{P_n(z)\}$ generated by the ordinary bivariate generating function $\displaystyle G(t; z)=\frac{1}{1+B(z)t^{\ell}+A(z)t^{k}}$ where $A(z), B(z)$ are arbitrary complex polynomials with $deg(A(z)B(z))\geqslant 1$ and $k, \ell$ are coprime integers with $k > \ell \geqslant 1$. For each zero $z_0$ of $P_n(z)$ with $A(z_0)\neq 0$, we study ratios of distinct zeros of the trinomial $D(t;z_0):={A(z_0)t^{k}+ B(z_0)t^{\ell}+1} $ and show that, at least two of the zeros of $D(t;z_0)$ have a ratio which lies on the real line and / or on a unit circle centered at the origin. We also give a characterization of the zeros of $D(t;z_0)$.


title: Graph Neural Network Surrogate for Seismic Reliability Analysis of Highway Bridge Systems

abstract: Rapid reliability assessment of transportation networks can enhance preparedness, risk mitigation, and response management procedures related to these systems. Network reliability analysis commonly considers network-level performance and does not consider the more detailed node-level responses due to computational cost. In this paper, we propose a rapid seismic reliability assessment approach for bridge networks based on graph neural networks, where node-level connectivities, between points of interest and other nodes, are evaluated under probabilistic seismic scenarios. Via numerical experiments on transportation systems in California, we demonstrate the accuracy, computational efficiency, and robustness of the proposed approach compared to the Monte Carlo approach.


title: Transformer-based Text Classification on Unified Bangla Multi-class Emotion Corpus

abstract: In this research, we propose a complete set of approaches for identifying and extracting emotions from Bangla texts. We provide a Bangla emotion classifier for six classes: anger, disgust, fear, joy, sadness, and surprise, from Bangla words using transformer-based models, which exhibit phenomenal results in recent days, especially for high-resource languages. The Unified Bangla Multi-class Emotion Corpus (UBMEC) is used to assess the performance of our models. UBMEC is created by combining two previously released manually labeled datasets of Bangla comments on six emotion classes with fresh manually labeled Bangla comments created by us. The corpus dataset and code we used in this work are publicly available.


title: Rigidity of mass-preserving $1$-Lipschitz maps from integral current spaces into $\mathbb{R}^n$

abstract: We prove that given an $n$-dimensional integral current space and a $1$-Lipschitz map, from this space onto the $n$-dimensional Euclidean ball, that preserves the mass of the current and is injective on the boundary, then the map has to be an isometry. We deduce as a consequence a stability result with respect to the intrinsic flat distance, which implies the stability of the positive mass theorem for graphical manifolds as originally formulated by Huang--Lee--Sormani.


title: Interactive Language: Talking to Robots in Real Time

abstract: We present a framework for building interactive, real-time, natural language-instructable robots in the real world, and we open source related assets (dataset, environment, benchmark, and policies). Trained with behavioral cloning on a dataset of hundreds of thousands of language-annotated trajectories, a produced policy can proficiently execute an order of magnitude more commands than previous works: specifically we estimate a 93.5% success rate on a set of 87,000 unique natural language strings specifying raw end-to-end visuo-linguo-motor skills in the real world. We find that the same policy is capable of being guided by a human via real-time language to address a wide range of precise long-horizon rearrangement goals, e.g. "make a smiley face out of blocks". The dataset we release comprises nearly 600,000 language-labeled trajectories, an order of magnitude larger than prior available datasets. We hope the demonstrated results and associated assets enable further advancement of helpful, capable, natural-language-interactable robots. See videos at https://interactive-language.github.io.


title: PriMeSRL-Eval: A Practical Quality Metric for Semantic Role Labeling Systems Evaluation

abstract: Semantic role labeling (SRL) identifies the predicate-argument structure in a sentence. This task is usually accomplished in four steps: predicate identification, predicate sense disambiguation, argument identification, and argument classification. Errors introduced at one step propagate to later steps. Unfortunately, the existing SRL evaluation scripts do not consider the full effect of this error propagation aspect. They either evaluate arguments independent of predicate sense (CoNLL09) or do not evaluate predicate sense at all (CoNLL05), yielding an inaccurate SRL model performance on the argument classification task. In this paper, we address key practical issues with existing evaluation scripts and propose a more strict SRL evaluation metric PriMeSRL. We observe that by employing PriMeSRL, the quality evaluation of all SoTA SRL models drops significantly, and their relative rankings also change. We also show that PriMeSRLsuccessfully penalizes actual failures in SoTA SRL models.


title: A Unified Framework with Meta-dropout for Few-shot Learning

abstract: Conventional training of deep neural networks usually requires a substantial amount of data with expensive human annotations. In this paper, we utilize the idea of meta-learning to explain two very different streams of few-shot learning, i.e., the episodic meta-learning-based and pre-train finetune-based few-shot learning, and form a unified meta-learning framework. In order to improve the generalization power of our framework, we propose a simple yet effective strategy named meta-dropout, which is applied to the transferable knowledge generalized from base categories to novel categories. The proposed strategy can effectively prevent neural units from co-adapting excessively in the meta-training stage. Extensive experiments on the few-shot object detection and few-shot image classification datasets, i.e., Pascal VOC, MS COCO, CUB, and mini-ImageNet, validate the effectiveness of our method.


title: Pinning control of networks: dimensionality reduction through simultaneous block-diagonalization of matrices

abstract: In this paper, we study the network pinning control problem in the presence of two different types of coupling: (i) node-to-node coupling among the network nodes and (ii) input-to-node coupling from the source node to the `pinned nodes'. Previous work has mainly focused on the case that (i) and (ii) are of the same type. We decouple the stability analysis of the target synchronous solution into subproblems of the lowest dimension by using the techniques of simultaneous block diagonalization (SBD) of matrices. Interestingly, we obtain two different types of blocks, driven and undriven. The overall dimension of the driven blocks is equal to the dimension of an appropriately defined controllable subspace, while all the remaining undriven blocks are scalar. Our main result is a decomposition of the stability problem into four independent sets of equations, which we call quotient controllable, quotient uncontrollable, redundant controllable, and redundant uncontrollable. Our analysis shows that the number and location of the pinned nodes affect the number and the dimension of each set of equations. We also observe that in a large variety of complex networks, stability of the target synchronous solution is de facto only determined by a single quotient controllable block.


title: Exploring the optimality of approximate state preparation quantum circuits with a genetic algorithm

abstract: We study the approximate state preparation problem on noisy intermediate-scale quantum (NISQ) computers by applying a genetic algorithm to generate quantum circuits for state preparation. The algorithm can account for the specific characteristics of the physical machine in the evaluation of circuits, such as the native gate set and qubit connectivity. We use our genetic algorithm to optimize the circuits provided by the low-rank state preparation algorithm introduced by Araujo et al., and find substantial improvements to the fidelity in preparing Haar random states with a limited number of CNOT gates. Moreover, we observe that already for a 5-qubit quantum processor with limited qubit connectivity and significant noise levels (IBM Falcon 5T), the maximal fidelity for Haar random states is achieved by a short approximate state preparation circuit instead of the exact preparation circuit. We also present a theoretical analysis of approximate state preparation circuit complexity to motivate our findings. Our genetic algorithm for quantum circuit discovery is freely available at https://github.com/beratyenilen/qc-ga .


title: Wash-in leptogenesis after axion inflation

abstract: CP violation and the violation of baryon-minus-lepton number B-L do not necessarily have to occur simultaneously in order to accomplish successful leptogenesis. Instead, it suffices if new CP-violating interactions at high energies result in primordial charge asymmetries, which are then reprocessed into a nonvanishing B-L asymmetry by right-handed neutrinos (RHNs) at lower energies. In this paper, we study this novel mechanism known as "wash-in leptogenesis", utilizing axion inflation as the source of high-scale CP violation. We specifically consider axion inflation coupled to the Standard Model hypercharge sector, which results in the dual production of hypermagnetic helicity and fermionic charge asymmetries. Although the survival of these charges is endangered by sphaleron processes, magnetic diffusion, and the chiral plasma instability, we find a large range of viable scenarios. We consistently account for RHN flavor effects and coherence among the Standard Model lepton flavors across a wide range of RHN masses. We find a lower bound of 10^(5...9) GeV on the mass of the lightest RHN involved in wash-in leptogenesis, depending on the onset of turbulence in the chiral plasma and the Hubble scale of inflation. Our model is representative of a broader class of new leptogenesis scenarios and suggests interesting observational signatures with regard to intergalactic magnetic fields, primordial black holes, and gravitational waves.


title: EleutherAI: Going Beyond "Open Science" to "Science in the Open"

abstract: Over the past two years, EleutherAI has established itself as a radically novel initiative aimed at both promoting open-source research and conducting research in a transparent, openly accessible and collaborative manner. EleutherAI's approach to research goes beyond transparency: by doing research entirely in public, anyone in the world can observe and contribute at every stage. Our work has been received positively and has resulted in several high-impact projects in Natural Language Processing and other fields. In this paper, we describe our experience doing public-facing machine learning research, the benefits we believe this approach brings, and the pitfalls we have encountered.


title: Evolution Driven by the Infinity Fractional Laplacian

abstract: We consider the evolution problem associated to the infinity fractional Laplacian introduced by Bjorland, Caffarelli and Figalli (2012) as the infinitesimal generator of a non-Brownian tug-of-war game. We first construct a class of viscosity solutions of the initial-value problem for bounded and uniformly continuous data. An important result is the equivalence of the nonlinear operator in higher dimensions with the one-dimensional fractional Laplacian when it is applied to radially symmetric and monotone functions. Thanks to this and a comparison theorem between classical and viscosity solutions, we are able to establish a global Harnack inequality that, in particular, explains the long-time behavior of the solutions.


title: Packing Densities of Delzant and Semitoric Polygons

abstract: Exploiting the relationship between 4-dimensional toric and semitoric integrable systems with Delzant and semitoric polygons, respectively, we develop techniques to compute certain equivariant packing densities and equivariant capacities of these systems by working exclusively with the polygons. This expands on results of Pelayo and Pelayo-Schmidt. We compute the densities of several important examples and we also use our techniques to solve the equivariant semitoric perfect packing problem, i.e., we list all semitoric polygons for which the associated semitoric system admits an equivariant packing which fills all but a set of measure zero of the manifold. This paper also serves as a concise and accessible introduction to Delzant and semitoric polygons in dimension four.


title: Quantifying Uncertainty with Probabilistic Machine Learning Modeling in Wireless Sensing

abstract: The application of machine learning (ML) techniques in wireless communication domain has seen a tremendous growth over the years especially in the wireless sensing domain. However, the questions surrounding the ML model's inference reliability, and uncertainty associated with its predictions are never answered or communicated properly. This itself raises a lot of questions on the transparency of these ML systems. Developing ML systems with probabilistic modeling can solve this problem easily, where one can quantify uncertainty whether it is arising from the data (irreducible error or aleotoric uncertainty) or from the model itself (reducible or epistemic uncertainty). This paper describes the idea behind these types of uncertainty quantification in detail and uses a real example of WiFi channel state information (CSI) based sensing for motion/no-motion cases to demonstrate the uncertainty modeling. This work will serve as a template to model uncertainty in predictions not only for WiFi sensing but for most wireless sensing applications ranging from WiFi to millimeter wave radar based sensing that utilizes AI/ML models.


title: BiaScope: Visual Unfairness Diagnosis for Graph Embeddings

abstract: The issue of bias (i.e., systematic unfairness) in machine learning models has recently attracted the attention of both researchers and practitioners. For the graph mining community in particular, an important goal toward algorithmic fairness is to detect and mitigate bias incorporated into graph embeddings since they are commonly used in human-centered applications, e.g., social-media recommendations. However, simple analytical methods for detecting bias typically involve aggregate statistics which do not reveal the sources of unfairness. Instead, visual methods can provide a holistic fairness characterization of graph embeddings and help uncover the causes of observed bias. In this work, we present BiaScope, an interactive visualization tool that supports end-to-end visual unfairness diagnosis for graph embeddings. The tool is the product of a design study in collaboration with domain experts. It allows the user to (i) visually compare two embeddings with respect to fairness, (ii) locate nodes or graph communities that are unfairly embedded, and (iii) understand the source of bias by interactively linking the relevant embedding subspace with the corresponding graph topology. Experts' feedback confirms that our tool is effective at detecting and diagnosing unfairness. Thus, we envision our tool both as a companion for researchers in designing their algorithms as well as a guide for practitioners who use off-the-shelf graph embeddings.


title: Relational Graph Convolutional Neural Networks for Multihop Reasoning: A Comparative Study

abstract: Multihop Question Answering is a complex Natural Language Processing task that requires multiple steps of reasoning to find the correct answer to a given question. Previous research has explored the use of models based on Graph Neural Networks for tackling this task. Various architectures have been proposed, including Relational Graph Convolutional Networks (RGCN). For these many node types and relations between them have been introduced, such as simple entity co-occurrences, modelling coreferences, or "reasoning paths" from questions to answers via intermediary entities. Nevertheless, a thoughtful analysis on which relations, node types, embeddings and architecture are the most beneficial for this task is still missing. In this paper we explore a number of RGCN-based Multihop QA models, graph relations, and node embeddings, and empirically explore the influence of each on Multihop QA performance on the WikiHop dataset.


title: Quantum divide and conquer

abstract: The divide-and-conquer framework, used extensively in classical algorithm design, recursively breaks a problem of size $n$ into smaller subproblems (say, $a$ copies of size $n/b$ each), along with some auxiliary work of cost $C^{\textrm{aux}}(n)$, to give a recurrence relation $$C(n) \leq a \, C(n/b) + C^{\textrm{aux}}(n)$$ for the classical complexity $C(n)$. We describe a quantum divide-and-conquer framework that, in certain cases, yields an analogous recurrence relation $$C_Q(n) \leq \sqrt{a} \, C_Q(n/b) + O(C^{\textrm{aux}}_Q(n))$$ that characterizes the quantum query complexity. We apply this framework to obtain near-optimal quantum query complexities for various string problems, such as (i) recognizing regular languages; (ii) decision versions of String Rotation and String Suffix; and natural parameterized versions of (iii) Longest Increasing Subsequence and (iv) Longest Common Subsequence.


title: Recoil corrections to the energy levels of hydrogenic atoms

abstract: We have completed the calculation of pure-recoil corrections of order $(Z \alpha)^6$ to Coulombic bound states of two spin-1/2 fermions without approximation in the particle masses. Our result applies to systems of arbitrary mass ratio such as muonium and positronium, and also hydrogen and muonic hydrogen (with the neglect of proton structure effects). We have shown how the two-loop master integrals that occur in the relativistic region can be computed in analytic form, and suggest that the same method can be applied to the three-loop integrals that would be present in a calculation of order $(Z \alpha)^7$ corrections.


title: Exact hairy black holes asymptotically $AdS_{2+1}$

abstract: We present a family of $AdS_{2+1}$ asymptotically hairy black holes, within the context of Einstein's minimally coupled scalar field theory. We study the boundary conditions and construct the thermal superpotential. In the Euclidean section, we calculate the free energy and in the Lorentzian section, the Brown-York tensor, both regularized by two methods. Finally, we calculate the relevant thermodynamic quantities and analyze the different phases.


title: A New Family of Generalization Bounds Using Samplewise Evaluated CMI

abstract: We present a new family of information-theoretic generalization bounds, in which the training loss and the population loss are compared through a jointly convex function. This function is upper-bounded in terms of the disintegrated, samplewise, evaluated conditional mutual information (CMI), an information measure that depends on the losses incurred by the selected hypothesis, rather than on the hypothesis itself, as is common in probably approximately correct (PAC)-Bayesian results. We demonstrate the generality of this framework by recovering and extending previously known information-theoretic bounds. Furthermore, using the evaluated CMI, we derive a samplewise, average version of Seeger's PAC-Bayesian bound, where the convex function is the binary KL divergence. In some scenarios, this novel bound results in a tighter characterization of the population loss of deep neural networks than previous bounds. Finally, we derive high-probability versions of some of these average bounds. We demonstrate the unifying nature of the evaluated CMI bounds by using them to recover average and high-probability generalization bounds for multiclass classification with finite Natarajan dimension.


title: Foundation Transformers

abstract: A big convergence of model architectures across language, vision, speech, and multimodal is emerging. However, under the same name "Transformers", the above areas use different implementations for better performance, e.g., Post-LayerNorm for BERT, and Pre-LayerNorm for GPT and vision Transformers. We call for the development of Foundation Transformer for true general-purpose modeling, which serves as a go-to architecture for various tasks and modalities with guaranteed training stability. In this work, we introduce a Transformer variant, named Magneto, to fulfill the goal. Specifically, we propose Sub-LayerNorm for good expressivity, and the initialization strategy theoretically derived from DeepNet for stable scaling up. Extensive experiments demonstrate its superior performance and better stability than the de facto Transformer variants designed for various applications, including language modeling (i.e., BERT, and GPT), machine translation, vision pretraining (i.e., BEiT), speech recognition, and multimodal pretraining (i.e., BEiT-3).


title: Computing Persistence Diagram Bundles

abstract: Persistence diagram (PD) bundles, a generalization of vineyards, were introduced as a way to study the persistent homology of a set of filtrations parameterized by a topological space $B$. In this paper, we present an algorithm for computing piecewise-linear PD bundles, a wide class that includes many of the PD bundles that one may encounter in practice. Full details are given for the case in which $B$ is a triangulated surface, and we outline the generalization to higher dimensions and other cases.


title: MiniALBERT: Model Distillation via Parameter-Efficient Recursive Transformers

abstract: Pre-trained Language Models (LMs) have become an integral part of Natural Language Processing (NLP) in recent years, due to their superior performance in downstream applications. In spite of this resounding success, the usability of LMs is constrained by computational and time complexity, along with their increasing size; an issue that has been referred to as `overparameterisation'. Different strategies have been proposed in the literature to alleviate these problems, with the aim to create effective compact models that nearly match the performance of their bloated counterparts with negligible performance losses. One of the most popular techniques in this area of research is model distillation. Another potent but underutilised technique is cross-layer parameter sharing. In this work, we combine these two strategies and present MiniALBERT, a technique for converting the knowledge of fully parameterised LMs (such as BERT) into a compact recursive student. In addition, we investigate the application of bottleneck adapters for layer-wise adaptation of our recursive student, and also explore the efficacy of adapter tuning for fine-tuning of compact models. We test our proposed models on a number of general and biomedical NLP tasks to demonstrate their viability and compare them with the state-of-the-art and other existing compact models. All the codes used in the experiments are available at https://github.com/nlpie-research/MiniALBERT. Our pre-trained compact models can be accessed from https://huggingface.co/nlpie.


title: On Synchronized Globular Cluster Formation over Supra-galactic Scales: A Virgo-Centaurus Group Connection

abstract: This work reports the detection of a multi peaked colour pattern in the integrated colours distribution of globular clusters associated to the giant elliptical galaxy NGC 4486, using Next Generation Virgo Survey data. This feature is imprinted on the well known bimodal colour distribution of these clusters. Remarkably, the pattern is similar to that found in previous works based on photometry from the HST Advanced Camera Virgo Survey, in less massive Virgo galaxies. This characteristic can be traced up to to 45 arcmin (217 Kpc) in galactocentric radius. This suggests that globular cluster formation in Virgo has been regulated, at least partially, by a collective process composed by several discrete events, working on spatial scales comparable to the size of the galaxy cluster. Furthermore, the presence of a similar colour pattern in NGC 5128, at the outskirsts of the Virgo Super-cluster, poses an intriguing question about the spatial scale of the phenomenon. The nature of the process that leads to the colour pattern is unknown. However, energetic events connected with galaxy or sub-galaxy cluster mergers and SMBH activity, in the early Universe, appear as possible candidates to explain an eventual enhancement/quenching of the globular clusters formation, reflected in the modulation of their integrated colours. Such events, presumably, may also have had an impact on the whole star formation history in Virgo galaxies.


title: Peer-to-Peer Energy Trading meets IOTA: Toward a Scalable, Low-Cost, and Efficient Trading System

abstract: Peer-to-Peer (P2P) energy trading provides various benefits over conventional wholesale energy markets and makes renewable energy more accessible. This paper proposes a novel multi-layer P2P energy trading system for microgrids based on IOTA 2.0, which is a distributed ledger technology (DLT) primarily designed for Internet-of-Things (IoT) applications. The proposed energy trading system, which is a manifestation of a cyber-physical system (CPS), exploits the benefits brought by IOTA's unique ledger structure as well as the recently introduced IOTA smart contract protocol (ISCP). Further, it implements a uniform double-auction market mechanism and a hierarchical routing structure for interconnected microgrids. Performance evaluation demonstrates key benefits over wholesale markets as well as speed, energy efficiency and cost benefits over conventional blockchain-based P2P energy trading systems.


title: Trap and Replace: Defending Backdoor Attacks by Trapping Them into an Easy-to-Replace Subnetwork

abstract: Deep neural networks (DNNs) are vulnerable to backdoor attacks. Previous works have shown it extremely challenging to unlearn the undesired backdoor behavior from the network, since the entire network can be affected by the backdoor samples. In this paper, we propose a brand-new backdoor defense strategy, which makes it much easier to remove the harmful influence of backdoor samples from the model. Our defense strategy, \emph{Trap and Replace}, consists of two stages. In the first stage, we bait and trap the backdoors in a small and easy-to-replace subnetwork. Specifically, we add an auxiliary image reconstruction head on top of the stem network shared with a light-weighted classification head. The intuition is that the auxiliary image reconstruction task encourages the stem network to keep sufficient low-level visual features that are hard to learn but semantically correct, instead of overfitting to the easy-to-learn but semantically incorrect backdoor correlations. As a result, when trained on backdoored datasets, the backdoors are easily baited towards the unprotected classification head, since it is much more vulnerable than the shared stem, leaving the stem network hardly poisoned. In the second stage, we replace the poisoned light-weighted classification head with an untainted one, by re-training it from scratch only on a small holdout dataset with clean samples, while fixing the stem network. As a result, both the stem and the classification head in the final network are hardly affected by backdoor training samples. We evaluate our method against ten different backdoor attacks. Our method outperforms previous state-of-the-art methods by up to $20.57\%$, $9.80\%$, and $13.72\%$ attack success rate and on-average $3.14\%$, $1.80\%$, and $1.21\%$ clean classification accuracy on CIFAR10, GTSRB, and ImageNet-12, respectively. Code is available online.


title: The Eccentricity Distribution of Wide Binaries

abstract: Future Gaia and Legacy Survey of Space and Time data releases, together with wide area spectroscopic surveys, will deliver large samples of resolved binary stars with phase space coordinates, albeit with low-cadence. Given an eccentricity law $f(\epsilon)$, we derive properties of (i) the velocity distribution $v/\sqrt{G M/r}$ normalised by the value for a circular orbit at the measured separation $r$; (ii) the astrometric acceleration distributions $a/\left(G M/r^2\right)$ again normalised to the circular orbit value. Our formulation yields analytic predictions for the full statistical distribution for some commonly used eccentricity laws, if the timescale of data-sampling is comparable to or exceeds the binary period. In particular, the velocity distribution for the linear eccentricity law is surprisingly simple. With Bayesian analysis, we suggest a method to infer the eccentricity distribution based on the measured velocity distribution.

categories: astro-ph.SR astro-ph.GA astro-ph.IM gr-qc


title: Towards DMC accuracy across chemical space with scalable $\Delta$-QML

abstract: In the past decade, quantum diffusion Monte Carlo (DMC) has been demonstrated to successfully predict the energetics and properties of a wide range of molecules and solids by numerically solving the electronic many-body Schr\"odinger equation. We show that when coupled with quantum machine learning (QML) based surrogate methods the computational burden can be alleviated such that QMC shows clear potential to undergird the formation of high quality descriptions across chemical space. We discuss three crucial approximations necessary to accomplish this: The fixed node approximation, universal and accurate references for chemical bond dissociation energies, and scalable minimal amons set based QML (AQML) models. Numerical evidence presented includes converged DMC results for over one thousand small organic molecules with up to 5 heavy atoms used as amons, and 50 medium sized organic molecules with 9 heavy atoms to validate the AQML predictions. Numerical evidence collected for $\Delta$-AQML models suggests that already modestly sized QMC training data sets of amons suffice to predict total energies with near chemical accuracy throughout chemical space.


title: BLAB Reporter: Automated journalism covering the Blue Amazon

abstract: This demo paper introduces the BLAB Reporter, a robot-journalist covering the Brazilian Blue Amazon. The Reporter is based on a pipeline architecture for Natural Language Generation; it offers daily reports, news summaries and curious facts in Brazilian Portuguese. By collecting, storing and analysing structured data from publicly available sources, the robot-journalist uses domain knowledge to generate and publish texts in Twitter. Code and corpus are publicly available


title: InfoCSE: Information-aggregated Contrastive Learning of Sentence Embeddings

abstract: Contrastive learning has been extensively studied in sentence embedding learning, which assumes that the embeddings of different views of the same sentence are closer. The constraint brought by this assumption is weak, and a good sentence representation should also be able to reconstruct the original sentence fragments. Therefore, this paper proposes an information-aggregated contrastive learning framework for learning unsupervised sentence embeddings, termed InfoCSE. InfoCSE forces the representation of [CLS] positions to aggregate denser sentence information by introducing an additional Masked language model task and a well-designed network. We evaluate the proposed InfoCSE on several benchmark datasets w.r.t the semantic text similarity (STS) task. Experimental results show that InfoCSE outperforms SimCSE by an average Spearman correlation of 2.60% on BERT-base, and 1.77% on BERT-large, achieving state-of-the-art results among unsupervised sentence representation learning methods. Our code are available at https://github.com/caskcsg/sentemb/tree/main/InfoCSE.


title: Self-supervised video pretraining yields human-aligned visual representations

abstract: Humans learn powerful representations of objects and scenes by observing how they evolve over time. Yet, outside of specific tasks that require explicit temporal understanding, static image pretraining remains the dominant paradigm for learning visual foundation models. We question this mismatch, and ask whether video pretraining can yield visual representations that bear the hallmarks of human perception: generalisation across tasks, robustness to perturbations, and consistency with human judgements. To that end we propose a novel procedure for curating videos, and develop a contrastive framework which learns from the complex transformations therein. This simple paradigm for distilling knowledge from videos, called VITO, yields general representations that far outperform prior video pretraining methods on image understanding tasks, and image pretraining methods on video understanding tasks. Moreover, VITO representations are significantly more robust to natural and synthetic deformations than image-, video-, and adversarially-trained ones. Finally, VITO's predictions are strongly aligned with human judgements, surpassing models that were specifically trained for that purpose. Together, these results suggest that video pretraining could be a simple way of learning unified, robust, and human-aligned representations of the visual world.


title: Cross-client Label Propagation for Transductive and Semi-Supervised Federated Learning

abstract: We present Cross-Client Label Propagation(XCLP), a new method for transductive federated learning. XCLP estimates a data graph jointly from the data of multiple clients and computes labels for the unlabeled data by propagating label information across the graph. To avoid clients having to share their data with anyone, XCLP employs two cryptographically secure protocols: secure Hamming distance computation and secure summation. We demonstrate two distinct applications of XCLP within federated learning. In the first, we use it in a one-shot way to predict labels for unseen test points. In the second, we use it to repeatedly pseudo-label unlabeled training data in a federated semi-supervised setting. Experiments on both real federated and standard benchmark datasets show that in both applications XCLP achieves higher classification accuracy than alternative approaches.


title: Bivariate fractal interpolation functions on triangular domain for numerical integration and approximation

abstract: The primary objectives of this paper are to present the construction of bivariate fractal interpolation functions over triangular interpolating domain using the concept of vertex coloring and to propose a double integration formula for the constructed interpolation functions. Unlike the conventional constructions, each vertex in the partition of the triangular region has been assigned a color such that the chromatic number of the partition is 3. A new method for the partitioning of the triangle is proposed with a result concerning the chromatic number of its graph. Following the construction, a formula determining the vertical scaling factor is provided. With the newly defined vertical scaling factor, it is clearly observed that the value of the double integral coincides with the integral value calculated using fractal theory. Further, a relation connecting the fractal interpolation function with the equation of the plane passing through the vertices of the triangle is established. Convergence of the proposed method to the actual integral value is proven with sufficient lemmas and theorems. Sufficient examples are also provided to illustrate the method of construction and to verify the formula of double integration.


title: Deep Combinatorial Aggregation

abstract: Neural networks are known to produce poor uncertainty estimations, and a variety of approaches have been proposed to remedy this issue. This includes deep ensemble, a simple and effective method that achieves state-of-the-art results for uncertainty-aware learning tasks. In this work, we explore a combinatorial generalization of deep ensemble called deep combinatorial aggregation (DCA). DCA creates multiple instances of network components and aggregates their combinations to produce diversified model proposals and predictions. DCA components can be defined at different levels of granularity. And we discovered that coarse-grain DCAs can outperform deep ensemble for uncertainty-aware learning both in terms of predictive performance and uncertainty estimation. For fine-grain DCAs, we discover that an average parameterization approach named deep combinatorial weight averaging (DCWA) can improve the baseline training. It is on par with stochastic weight averaging (SWA) but does not require any custom training schedule or adaptation of BatchNorm layers. Furthermore, we propose a consistency enforcing loss that helps the training of DCWA and modelwise DCA. We experiment on in-domain, distributional shift, and out-of-distribution image classification tasks, and empirically confirm the effectiveness of DCWA and DCA approaches.


title: Distributed, combined CPU and GPU profiling within HPX using APEX

abstract: Benchmarking and comparing performance of a scientific simulation across hardware platforms is a complex task. When the simulation in question is constructed with an asynchronous, many-task (AMT) runtime offloading work to GPUs, the task becomes even more complex. In this paper, we discuss the use of a uniquely suited performance measurement library, APEX, to capture the performance behavior of a simulation built on HPX, a highly scalable, distributed AMT runtime. We examine the performance of the astrophysics simulation carried-out by Octo-Tiger on two different supercomputing architectures. We analyze the results of scaling and measurement overheads. In addition, we look in-depth at two similarly configured executions on the two systems to study how architectural differences affect performance and identify opportunities for optimization. As one such opportunity, we optimize the communication for the hydro solver and investigated its performance impact.


title: From Task-Based GPU Work Aggregation to Stellar Mergers: Turning Fine-Grained CPU Tasks into Portable GPU Kernels

abstract: Meeting both scalability and performance portability requirements is a challenge for any HPC application, especially for adaptively refined ones. In Octo-Tiger, an astrophysics application for the simulation of stellar mergers, we approach this with existing solutions: We employ HPX to obtain fine-grained tasks to easily distribute work and finely overlap communication and computation. For the computations themselves, we use Kokkos to turn these tasks into compute kernels capable of running on hardware ranging from a few CPU cores to powerful accelerators. There is a missing link, however: while the fine-grained parallelism exposed by HPX is useful for scalability, it can hinder GPU performance when the tasks become too small to saturate the device, causing low resource utilization. To bridge this gap, we investigate multiple different GPU work aggregation strategies within Octo-Tiger, adding one new strategy, and evaluate the node-level performance impact on recent AMD and NVIDIA GPUs, achieving noticeable speedups.