title: Time-aware Metapath Feature Augmentation for Ponzi Detection in Ethereum

abstract: With the development of Web 3.0 which emphasizes decentralization, blockchain technology ushers in its revolution and also brings numerous challenges, particularly in the field of cryptocurrency. Recently, a large number of criminal behaviors continuously emerge on blockchain, such as Ponzi schemes and phishing scams, which severely endanger decentralized finance. Existing graph-based abnormal behavior detection methods on blockchain usually focus on constructing homogeneous transaction graphs without distinguishing the heterogeneity of nodes and edges, resulting in partial loss of transaction pattern information. Although existing heterogeneous modeling methods can depict richer information through metapaths, the extracted metapaths generally neglect temporal dependencies between entities and do not reflect real behavior. In this paper, we introduce Time-aware Metapath Feature Augmentation (TMFAug) as a plug-and-play module to capture the real metapath-based transaction patterns during Ponzi scheme detection on Ethereum. The proposed module can be adaptively combined with existing graph-based Ponzi detection methods. Extensive experimental results show that our TMFAug can help existing Ponzi detection methods achieve significant performance improvements on the Ethereum dataset, indicating the effectiveness of heterogeneous temporal information for Ponzi scheme detection.


title: Distribution of gamma-ray bursts on the t90-hardness ratio plane and their classification revisited

abstract: Using four mixed bivariate distributions (Normal distribution, Skew-Normal distribution, Student distribution, Skew-Student distribution) and bootstrap re-sampling analysis, we analyze the samples of CGRO/BATSE, Swift/BAT and Fermi/GBM gamma-ray bursts in detail on the t90-hardness ratio plane. The Bayesian information criterion is used to judge the goodness of fit for each sample, comprehensively. It is found that all the three samples show a symmetric (either normal or student) distribution. It is also found that the existence of three classes of gamma-ray bursts is preferred by the three samples, but the strength of this preference varies with the sample size: when the sample size of the data set is larger, the preference of three classes scheme becomes weaker. Therefore, the appearance of an intermediate class may be caused by a small sample size and the possibility that there are only two classes of gamma-ray bursts still cannot be expelled yet. A further bootstrap re-sampling analysis also confirms this result.


title: Learning to Decompose: Hypothetical Question Decomposition Based on Comparable Texts

abstract: Explicit decomposition modeling, which involves breaking down complex tasks into more straightforward and often more interpretable sub-tasks, has long been a central theme in developing robust and interpretable NLU systems. However, despite the many datasets and resources built as part of this effort, the majority have small-scale annotations and limited scope, which is insufficient to solve general decomposition tasks. In this paper, we look at large-scale intermediate pre-training of decomposition-based transformers using distant supervision from comparable texts, particularly large-scale parallel news. We show that with such intermediate pre-training, developing robust decomposition-based models for a diverse range of tasks becomes more feasible. For example, on semantic parsing, our model, DecompT5, improves 20% to 30% on two datasets, Overnight and TORQUE, over the baseline language model. We further use DecompT5 to build a novel decomposition-based QA system named DecompEntail, improving over state-of-the-art models, including GPT-3, on both HotpotQA and StrategyQA by 8% and 4%, respectively.


title: On the Effect of Nucleation Undercooling on Phase Transformation Kinetics

abstract: We carry out an extensive comparison between Johnson-Mehl-Avrami-Kolmogorov (JMAK) theory of first-order phase transformation kinetics and phase-field (PF) results of a benchmark problem on nucleation. To address the stochasticity of the problem, several hundreds of simulations are performed to establish a comprehensive, statistically-significant analysis of the coincidences and discrepancies between PF and JMAK transformation kinetics. We find that PF predictions are in excellent agreement with both classical nucleation theory and JMAK theory, as long as the original assumptions of the latter are appropriately reproduced - in particular, the constant nucleation and growth rates in an infinite domain. When deviating from these assumptions, PF results are at odds with JMAK theory. In particular, we observe that the size of the initial particle radius $r_0$ relative to the critical nucleation radius $r^*$ has a significant effect on the rate of transformation. While PF and JMAK agree when $r_0$ is sufficiently higher than $r^*$, the duration of initial transient growth stage of a particle, before it reaches a steady growth velocity, increases as $r_0/r^*\to 1$. This incubation time has a significant effect on the overall kinetics, e.g. on the Avrami exponent of the multi-particle simulations. In contrast, for the considered conditions and parameters, the effect of interface curvature upon transformation kinetics - in particular negative curvature regions appearing during particle impingement, present in PF but absent in JMAK theory - appears to be minor compared to that of $r_0/r^*$. We argue that rigorous benchmarking of phase-field models of stochastic processes (e.g. nucleation) need sufficient statistical data in order to make rigorous comparisons against ground truth theories. In these problems, analysis of probability distributions is clearly preferable to a deterministic approach.


title: Geometrical effects on the downstream conductance in quantum-Hall--superconductor hybrid systems

abstract: We consider a quantum Hall (QH) region in contact with a superconductor (SC), i.e., a QH-SC junction. Due to successive Andreev reflections, the QH-SC interface hosts hybridized electron and hole edge states called chiral Andreev edge states (CAES). We theoretically study the transport properties of these CAES by using a microscopic, tight-binding model. We find that the transport properties strongly depend on the contact geometry and the value of the filling factor. We notice that it is necessary to add local barriers at the corners of the junction in order to reproduce such properties, when using effective one-dimensional models.


title: Catching the geometric phase effect around conical intersection in molecules by high order harmonic spectroscopy

abstract: Nonadiabatic dynamics around an avoid crossing or a conical intersection play a crucial role in the photoinduced processes of most polyatomic molecules. The present work shows that the topological phase in conical intersection makes the behavior of pump-probe high-order harmonic spectroscopy different from the case of avoid crossing. The coherence built up when the system crosses the avoid crossing will lead to the oscillatory behavior of the spectrum, while the geometric phase erodes these oscillations in the case of conical intersection. Additionally, the dynamical blueshift and the splitting of time-resolved spectrum allow capturing the snapshot dynamics with sub-femtosecond resolution.


title: Inverse Dynamic Problem for a 1-D Dirac System on Finite Metric Tree Graphs and a Leaf Peeling Algorithm

abstract: In this paper, we consider the inverse dynamic problem for a one-dimensional Dirac system on finite metric tree graphs. Our main goal is to recover the topology (connectivity) of a tree, lengths of edges, and a matrix potential function on each edge. We use the dynamic response operator as our inverse data and apply a Leaf peeling algorithm. In addition, we present a new dynamic algorithm to solve the forward problem for the 1-D Dirac system on general finite metric tree graphs.


title: A simple, efficient and scalable contrastive masked autoencoder for learning visual representations

abstract: We introduce CAN, a simple, efficient and scalable method for self-supervised learning of visual representations. Our framework is a minimal and conceptually clean synthesis of (C) contrastive learning, (A) masked autoencoders, and (N) the noise prediction approach used in diffusion models. The learning mechanisms are complementary to one another: contrastive learning shapes the embedding space across a batch of image samples; masked autoencoders focus on reconstruction of the low-frequency spatial correlations in a single image sample; and noise prediction encourages the reconstruction of the high-frequency components of an image. The combined approach results in a robust, scalable and simple-to-implement algorithm. The training process is symmetric, with 50% of patches in both views being masked at random, yielding a considerable efficiency improvement over prior contrastive learning methods. Extensive empirical studies demonstrate that CAN achieves strong downstream performance under both linear and finetuning evaluations on transfer learning and robustness tasks. CAN outperforms MAE and SimCLR when pre-training on ImageNet, but is especially useful for pre-training on larger uncurated datasets such as JFT-300M: for linear probe on ImageNet, CAN achieves 75.4% compared to 73.4% for SimCLR and 64.1% for MAE. The finetuned performance on ImageNet of our ViT-L model is 86.1%, compared to 85.5% for SimCLR, and 85.4% for MAE. The overall FLOPs load of SimCLR is 70% higher than CAN for ViT-L models.


title: Improved acoustic-to-articulatory inversion using representations from pretrained self-supervised learning models

abstract: In this work, we investigate the effectiveness of pretrained Self-Supervised Learning (SSL) features for learning the mapping for acoustic to articulatory inversion (AAI). Signal processing-based acoustic features such as MFCCs have been predominantly used for the AAI task with deep neural networks. With SSL features working well for various other speech tasks such as speech recognition, emotion classification, etc., we experiment with its efficacy for AAI. We train on SSL features with transformer neural networks-based AAI models of 3 different model complexities and compare its performance with MFCCs in subject-specific (SS), pooled and fine-tuned (FT) configurations with data from 10 subjects, and evaluate with correlation coefficient (CC) score on the unseen sentence test set. We find that acoustic feature reconstruction objective-based SSL features such as TERA and DeCoAR work well for AAI, with SS CCs of these SSL features reaching close to the best FT CCs of MFCC. We also find the results consistent across different model sizes.


title: Planning to the Information Horizon of BAMDPs via Epistemic State Abstraction

abstract: The Bayes-Adaptive Markov Decision Process (BAMDP) formalism pursues the Bayes-optimal solution to the exploration-exploitation trade-off in reinforcement learning. As the computation of exact solutions to Bayesian reinforcement-learning problems is intractable, much of the literature has focused on developing suitable approximation algorithms. In this work, before diving into algorithm design, we first define, under mild structural assumptions, a complexity measure for BAMDP planning. As efficient exploration in BAMDPs hinges upon the judicious acquisition of information, our complexity measure highlights the worst-case difficulty of gathering information and exhausting epistemic uncertainty. To illustrate its significance, we establish a computationally-intractable, exact planning algorithm that takes advantage of this measure to show more efficient planning. We then conclude by introducing a specific form of state abstraction with the potential to reduce BAMDP complexity and gives rise to a computationally-tractable, approximate planning algorithm.


title: Controllable chirality and band gap of quantum anomalous Hall insulators

abstract: Finding guiding principles to optimize properties of quantum anomalous Hall (QAH) insulators is of pivotal importance to fundamental science and applications. Here, we build a first-principles QAH material database of chirality and band gap, explore microscopic mechanisms determining the QAH material properties, and obtain a general physical picture that can comprehensively understand the QAH data. Our results reveal that the usually neglected Coulomb exchange is unexpectedly strong in a large class of QAH materials, which is the key to resolve experimental puzzles. Moreover, we identify simple indicators for property evaluation and suggest material design strategies to control QAH chirality and gap by tuning cooperative or competing contributions via magnetic co-doping, heterostructuring, spin-orbit proximity, etc. The work is valuable to future research of magnetic topological physics and materials.


title: Grain growth competition during melt pool solidification -- Comparing phase-field and cellular automaton models

abstract: A broad range of computational models have been proposed to predict microstructure development during solidification processing but they have seldom been compared to each other on a quantitative and systematic basis. In this paper, we compare phase-field (PF) and cellular automaton (CA) simulations of polycrystalline growth in a two-dimensional melt pool under conditions relevant to additive manufacturing (powder-bed fusion). We compare the resulting grain structures using local (point-by-point) measurements, as well as averaged grain orientation distributions over several simulations. We explore the effect of the CA spatial discretization level and that of the melt pool aspect ratio upon the selected grain texture. Our simulations show that detailed microscopic features related to transient growth conditions and solid-liquid interface stability (e.g. the initial planar growth stage prior to its cellular/dendritic destabilization, or the early elimination of unfavorably oriented grains due to neighbor grain sidebranching) can only be captured by PF simulations. The resulting disagreement between PF and CA predictions can only be addressed partially by a refinement of the CA grid. However, overall grain distributions averaged over the entire melt pools of several simulations seem to lead to a notably better agreement between PF and CA, with some variability with the melt pool shape and CA grid. While further research remains required, in particular to identify the appropriate selection of CA spatial discretization and its link to characteristic microstructural length scales, this research provides a useful step forward in this direction by comparing both methods quantitatively at process-relevant length and time scales.


title: A Multi-modal Deformable Land-air Robot for Complex Environments

abstract: Single locomotion robots often struggle to adapt in highly variable or uncertain environments, especially in emergencies. In this paper, a multi-modal deformable robot is introduced that can both fly and drive. Compatibility issues with multi-modal locomotive fusion for this hybrid land-air robot are solved using proposed design conceptions, including power settings, energy selection, and designs of deformable structure. The robot can also automatically transform between land and air modes during 3D planning and tracking. Meanwhile, we proposed a algorithms for evaluation the performance of land-air robots. A series of comparisons and experiments were conducted to demonstrate the robustness and reliability of the proposed structure in complex field environments.


title: On some generating set of Thompson's group $F$

abstract: We prove that Thompson's group $F$ has a generating set with two elements such that every two powers of them generate a finite index subgroup of $F$.


title: On Rate-Distortion Theory in Capacity-Limited Cognition & Reinforcement Learning

abstract: Throughout the cognitive-science literature, there is widespread agreement that decision-making agents operating in the real world do so under limited information-processing capabilities and without access to unbounded cognitive or computational resources. Prior work has drawn inspiration from this fact and leveraged an information-theoretic model of such behaviors or policies as communication channels operating under a bounded rate constraint. Meanwhile, a parallel line of work also capitalizes on the same principles from rate-distortion theory to formalize capacity-limited decision making through the notion of a learning target, which facilitates Bayesian regret bounds for provably-efficient learning algorithms. In this paper, we aim to elucidate this latter perspective by presenting a brief survey of these information-theoretic models of capacity-limited decision making in biological and artificial agents.


title: Interpolation inequalities on the sphere: rigidity, branches of solutions, and symmetry breaking

abstract: This paper is devoted to three Gagliardo-Nirenberg-Sobolev interpolation inequalities on the sphere. We are interested in branches of optimal functions when a scale parameter varies and investigate whether optimal functions are constant, or not. In the latter case, a symmetry breaking phenomenon occurs and our goal is to decide whether the threshold between symmetry and symmetry breaking is determined by a spectral criterion or not, that is, whether it appears as a perturbation of the constants or not. The first inequality is classical while the two other inequalities are variants which reproduce patterns similar to those observed in Caffarelli-Kohn-Nirenberg inequalities, for weighted inequalities on the Euclidean space. In the simpler setting of the sphere, it is possible to implement a parabolic version of the entropy methods associated to nonlinear diffusion equations, which is so far an open question on weighted Euclidean spaces.


title: More on Groups and Counter Automata

abstract: Elder, Kambites, and Ostheimer showed that if the word problem of a finitely generated group $H$ is accepted by a $G$-automaton for an abelian group $G$, then $H$ is virtually abelian. We give a new, elementary, and purely combinatorial proof to the theorem. Furthermore, our method extracts an explicit connection between the two groups $G$ and $H$ from the automaton as a group homomorphism from a subgroup of $G$ onto a finite index subgroup of $H$.


title: Assessing the difference between integrated quantiles and integrated cumulative distribution functions

abstract: This paper offers a mathematical invention that shows how to convert integrated quantiles, which often appear in risk measures, into integrated cumulative distribution functions, which are technically more tractable from various perspectives. The invention helps to avoid a number of technical assumptions that have been traditionally imposed when working with quantities containing quantiles. In particular it helps to completely avoid the requirement of the existence of a probability density function. The developed results explain and illustrate the invention, whose byproducts include the assessment of model uncertainty and misspecification, and the derivation of statistical inference results.


title: Real-Time MRI Video synthesis from time aligned phonemes with sequence-to-sequence networks

abstract: Real-Time Magnetic resonance imaging (rtMRI) of the midsagittal plane of the mouth is of interest for speech production research. In this work, we focus on estimating utterance level rtMRI video from the spoken phoneme sequence. We obtain time-aligned phonemes from forced alignment, to obtain frame-level phoneme sequences which are aligned with rtMRI frames. We propose a sequence-to-sequence learning model with a transformer phoneme encoder and convolutional frame decoder. We then modify the learning by using intermediary features obtained from sampling from a pretrained phoneme-conditioned variational autoencoder (CVAE). We train on 8 subjects in a subject-specific manner and demonstrate the performance with a subjective test. We also use an auxiliary task of air tissue boundary (ATB) segmentation to obtain the objective scores on the proposed models. We show that the proposed method is able to generate realistic rtMRI video for unseen utterances, and adding CVAE is beneficial for learning the sequence-to-sequence mapping for subjects where the mapping is hard to learn.


title: A dynamic capillarity equation with stochastic forcing on manifolds: a singular limit problem

abstract: We consider a dynamic capillarity equation with stochastic forcing on a compact Riemannian manifold $(M,g)$. \begin{equation*}\tag{P} d \left(u_{\varepsilon,\delta}-\delta \Delta u_{\varepsilon,\delta}\right) +\operatorname{div} f_{\varepsilon}(x, u_{\varepsilon,\delta})\, dt =\varepsilon \Delta u_{\varepsilon,\delta}\, dt \Phi(x, u_{\varepsilon,\delta})\, dW_t, \end{equation*} where $f_{\varepsilon}$ is a sequence of smooth vector fields converging in $L^p(M\times \Bbb{R})$ ($p>2$) as $\varepsilon\downarrow 0$ towards a vector field $f\in L^p(M;C^1(\Bbb{R}))$, and $W_t$ is a Wiener process defined on a filtered probability space. First, for fixed values of $\varepsilon$ and $\delta$, we establish the existence and uniqueness of weak solutions to the Cauchy problem for (P). Assuming that $f$ is non-degenerate and that $\varepsilon$ and $\delta$ tend to zero with $\delta/\varepsilon^2$ bounded, we show that there exists a subsequence of solutions that strongly converges in $L^1_{\omega,t,x}$ to a martingale solution of the following stochastic conservation law with discontinuous flux: $$ d u +\operatorname{div} f(x, u)\,dt=\Phi(u)\, dW_t. $$ The proofs make use of Galerkin approximations, kinetic formulations as well as $H$-measures and new velocity averaging results for stochastic continuity equations. The analysis relies in an essential way on the use of a.s.~representations of random variables in some particular quasi-Polish spaces. The convergence framework developed here can be applied to other singular limit problems for stochastic conservation laws.


title: Rapid Electromagnetic Induction Imaging with an Optically Raster-Scanned Atomic Magnetometer

abstract: We present an apparatus to overcome the limitations of mechanical raster-scanning in electromagnetic induction imaging (EMI) techniques by instead performing a 2D optical raster-scan within the vapour cell of a radio-frequency atomic magnetometer (RF-AM). A large cuboidal 87Rb vapour cell is employed to act as the medium of an RF-AM with the pump and probe beams translated in the cell via acousto-optics. The technique is shown to give robust and repeatable magnetic measurements over the cell volume and successfully resolves conductive targets with EMI. Optical raster-scanning removes the limitation of slow mechanical actuation and a fast imaging procedure is enacted resolving conductive targets at a rate of 40 ms/pixel.


title: A Simple Hypergraph Kernel Convolution based on Discounted Markov Diffusion Process

abstract: Kernels on discrete structures evaluate pairwise similarities between objects which capture semantics and inherent topology information. Existing kernels on discrete structures are only developed by topology information(such as adjacency matrix of graphs), without considering original attributes of objects. This paper proposes a two-phase paradigm to aggregate comprehensive information on discrete structures leading to a Discount Markov Diffusion Learnable Kernel (DMDLK). Specifically, based on the underlying projection of DMDLK, we design a Simple Hypergraph Kernel Convolution (SHKC) for hidden representation of vertices. SHKC can adjust diffusion steps rather than stacking convolution layers to aggregate information from long-range neighborhoods which prevents over-smoothing issues of existing hypergraph convolutions. Moreover, we utilize the uniform stability bound theorem in transductive learning to analyze critical factors for the effectiveness and generalization ability of SHKC from a theoretical perspective. The experimental results on several benchmark datasets for node classification tasks verified the superior performance of SHKC over state-of-the-art methods.


title: Rationalization of indecisive choice behavior by majoritarian ballots

abstract: We describe a model that explains possibly indecisive choice behavior, that is, quasi-choices (choice correspondences that may be empty on some menus). The justification is here provided by a proportion of ballots, which are quasi-choices rationalizable by an arbitrary binary relation. We call a quasi-choice $s$-majoritarian if all options selected from a menu are endorsed by a share of ballots larger than $s$. We prove that all forms of majoritarianism are equivalent to a well-known behavioral property, namely Chernoff axiom. Then we focus on two paradigms of majoritarianism, whereby either a simple majority of ballots justifies a quasi-choice, or the endorsement by a single ballot suffices - a liberal justification. These benchmark explanations typically require a different minimum number of ballots. We determine the asymptotic minimum size of a liberal justification.


title: DiffusER: Discrete Diffusion via Edit-based Reconstruction

abstract: In text generation, models that generate text from scratch one token at a time are currently the dominant paradigm. Despite being performant, these models lack the ability to revise existing text, which limits their usability in many practical scenarios. We look to address this, with DiffusER (Diffusion via Edit-based Reconstruction), a new edit-based generative model for text based on denoising diffusion models -- a class of models that use a Markov chain of denoising steps to incrementally generate data. DiffusER is not only a strong generative model in general, rivalling autoregressive models on several tasks spanning machine translation, summarization, and style transfer; it can also perform other varieties of generation that standard autoregressive models are not well-suited for. For instance, we demonstrate that DiffusER makes it possible for a user to condition generation on a prototype, or an incomplete sequence, and continue revising based on previous edit steps.


title: Azimuthal structures and turbulent transport in Penning discharge

abstract: Azimuthal structures in cylindrical Penning discharge are studied with 2D3V radial-azimuthal PIC/MCC model with the axial magnetic field. The discharge is self-consistently supported by ionization due to the axial injection of electrons. It is shown that the steady-state discharge can be supported in two different regimes with different type of observed azimuthal structures. The transition between the regimes is controlled by the mechanism of the energy input to the discharge. In the first regime (low energy of the injected electrons), with the pronounced $m=1$ spoke activity, the power input is dominated by the energy absorption due to the radial current and self-consistent electric field. In the other regime (higher energy of the injected electrons), with prevalent small scale $m>1$ spiral structures, and the lower values of the anomalous transport, the total energy deposited to the discharge is lower and is mostly due to the direct input of the kinetic energy from the axial electron beam. We show that the large (m=1) spoke and small scale structures occur as a result of Simon-Hoh and lower hybrid instabilities driven by the electric field, density gradient, and collisions. We show that the spoke frequency follows the equilibrium ion rotation frequency.


abstract: Corrigenda to "$L^p$ estimates and asymptotic behavior for finite energy solutions of extremals to Hardy-Sobolev inequalities", Trans. Amer. Math. Soc. 363 (2011), no. 1, 37--62.


title: A Real-Space Perspective on Dephasing in Solid-State High Harmonic Generation

abstract: We develop and demonstrate a fully real-space perspective on HHG in crystals. Due to Wannier-Stark localization induced on sub-cycle timescales in the presence of a strong field, real-space descriptions are natural for strongly driven solids. Our approach allows us to address the origin of the extremely short dephasing times, which appear necessary for agreement between experimental HHG measurements and theoretical calculations generally performed in reciprocal space. We develop a physically transparent model of real-space dephasing which relates its rate to the distance between different sites in a laser-driven lattice. Our approach leads to well-structured high harmonic spectra at the microscopic level, reproduces results of macroscopic propagation, and demonstrates that the requirement for ultrafast dephasing times stems from the need for suppressing recombination events with large electron-hole separations during radiative recombination.


title: Linear nonsaturating magnetoresistance in kagome superconductor CsV3Sb5 thin flakes

abstract: Linear nonsaturating magnetoresistance (LMR) represents a class of anomalous resistivity response to external magnetic field that has been observed in a variety of materials including but not limited to topological semi-metals, high-Tc superconductors and materials with charge/spin density wave (CDW/SDW) orders. Here we report the observation of LMR in layered kagome superconductor and CDW material CsV3Sb5 thin flakes, as well as the dimensional crossover and temperature (T) crossover of such LMR. Specifically, in ultrathin CsV3Sb5 crystals, the magnetoresistance (MR) exhibits a crossover from LMR at low T to quadratic B dependence above the CDW transition temperature; the MR also exhibits a crossover from LMR to sublinear MR for sample thickness at around ~20 nm at low T. We discuss several possible origins of the LMR and attribute the effect to two-dimensional (2D) CDW fluctuations. Our results may provide a new perspective for understanding the interactions between competing orders in kagome superconductors.


title: Synchrotron Firehose Instability

abstract: We demonstrate using linear theory and particle-in-cell (PIC) simulations that a synchrotron-cooling collisionless plasma acquires pressure anisotropy and, if the plasma beta is sufficiently high, becomes unstable to the firehose instability, in a process that we dub the synchrotron firehose instability (SFHI). The SFHI channels free energy from the pressure anisotropy of the radiating, relativistic electrons (and/or positrons) into small-amplitude, kinetic-scale magnetic-field fluctuations, which pitch-angle scatter the particles and bring the plasma to a near-thermal state of marginal instability. The PIC simulations reveal a nonlinear cyclic evolution of firehose bursts interspersed by periods of stable cooling. We compare the SFHI for electron-positron and electron-ion plasmas. As a byproduct of the growing electron-firehose magnetic field fluctuations, magnetized ions gain a pressure anisotropy opposite to that of the electrons. If these ions are relativistically hot, we find that they also experience cooling due to collisionless thermal coupling with the electrons, which we argue is mediated by a secondary ion-cyclotron instability. We suggest that the SFHI may be activated in a number of astrophysical scenarios, such as within ejecta from black-hole accretion flows and relativistic jets, where the redistribution of energetic electrons from low to high pitch angles may cause transient bursts of radiation.


title: Partitioned Gradient Matching-based Data Subset Selection for Compute-Efficient Robust ASR Training

abstract: Training state-of-the-art ASR systems such as RNN-T often has a high associated financial and environmental cost. Training with a subset of training data could mitigate this problem if the subset selected could achieve on-par performance with training with the entire dataset. Although there are many data subset selection(DSS) algorithms, direct application to the RNN-T is difficult, especially the DSS algorithms that are adaptive and use learning dynamics such as gradients, as RNN-T tend to have gradients with a significantly larger memory footprint. In this paper, we propose Partitioned Gradient Matching (PGM) a novel distributable DSS algorithm, suitable for massive datasets like those used to train RNN-T. Through extensive experiments on Librispeech 100H and Librispeech 960H, we show that PGM achieves between 3x to 6x speedup with only a very small accuracy degradation (under 1% absolute WER difference). In addition, we demonstrate similar results for PGM even in settings where the training data is corrupted with noise.


title: Optimal decay for solutions of nonlocal semilinear equations with critical exponent in homogeneous group

abstract: In this paper we establish the sharp asymptotic decay of positive solutions of the Yamabe type equation $\frlap u=u^{\frac{Q+2s}{Q-2s}}$ in a homogeneous Lie group, where $\frlap$ represents a suitable pseudodifferential operator modelled on a class of nonlocal operators arising in conformal CR geometry.


title: Distributionally Robust Domain Adaptation

abstract: Domain Adaptation (DA) has recently received significant attention due to its potential to adapt a learning model across source and target domains with mismatched distributions. Since DA methods rely exclusively on the given source and target domain samples, they generally yield models that are vulnerable to noise and unable to adapt to unseen samples from the target domain, which calls for DA methods that guarantee the robustness and generalization of the learned models. In this paper, we propose DRDA, a distributionally robust domain adaptation method. DRDA leverages a distributionally robust optimization (DRO) framework to learn a robust decision function that minimizes the worst-case target domain risk and generalizes to any sample from the target domain by transferring knowledge from a given labeled source domain sample. We utilize the Maximum Mean Discrepancy (MMD) metric to construct an ambiguity set of distributions that provably contains the source and target domain distributions with high probability. Hence, the risk is shown to upper bound the out-of-sample target domain loss. Our experimental results demonstrate that our formulation outperforms existing robust learning approaches.


title: The Bright Supernova 1996cr in the Circinus Galaxy Imaged with VLBI: Shell Structure with Complex Evolution

abstract: We present broadband radio flux-density measurements supernova (SN) 1996cr, made with MeerKAT, ATCA and ALMA, and images made from very long baseline interferometry (VLBI) observations with the Australian Long Baseline Array. The spectral energy distribution of SN 1996cr in 2020, at age, $t \sim$8700 d, is a power-law, with flux density, $S \propto \nu^{-0.588 \pm 0.011}$ between 1 and 34 GHz, but may steepen at $>35$ GHz. The spectrum has flattened since $t = 5370$ d (2010). Also since $t = 5370$ d, the flux density has declined rapidly, with $S_{\rm 9 \, GHz} \propto t^{-2.9}$. The VLBI image at $t = 8859$ d shows an approximately circular structure, with a central minimum reminiscent of an optically-thin spherical shell of emission. For a distance of 3.7 Mpc, the average outer radius of the radio emission at $t = 8859$ d was $(5.1 \pm 0.3) \times 10^{17}$ cm, and SN 1996cr has been expanding with a velocity of $4650 \pm 1060$ km s$^{-1}$ between $t=4307$ and 8859 d. It must have undergone considerable deceleration before $t = 4307$ d. Deviations from a circular shell structure in the image suggest a range of velocities up to $\sim$7000 km s$^{-1}$, and hint at the presence of a ring- or equatorial-belt-like structure rather than a complete spherical shell.


title: Sparse Convex Optimization Toolkit: A Mixed-Integer Framework

abstract: This paper proposes an open-source distributed solver for solving Sparse Convex Optimization (SCO) problems over computational networks. Motivated by past algorithmic advances in mixed-integer optimization, the Sparse Convex Optimization Toolkit (SCOT) adopts a mixed-integer approach to find exact solutions to SCO problems. In particular, SCOT brings together various techniques to transform the original SCO problem into an equivalent convex Mixed-Integer Nonlinear Programming (MINLP) problem that can benefit from high-performance and parallel computing platforms. To solve the equivalent mixed-integer problem, we present the Distributed Hybrid Outer Approximation (DiHOA) algorithm that builds upon the LP/NLP based branch-and-bound and is tailored for this specific problem structure. The DiHOA algorithm combines the so-called single- and multi-tree outer approximation, naturally integrates a decentralized algorithm for distributed convex nonlinear subproblems, and utilizes enhancement techniques such as quadratic cuts. Finally, we present detailed computational experiments that show the benefit of our solver through numerical benchmarks on 140 SCO problems with distributed datasets. To show the overall efficiency of SCOT we also provide performance profiles comparing SCOT to other state-of-the-art MINLP solvers.


title: Time-rEversed diffusioN tEnsor Transformer: A new TENET of Few-Shot Object Detection

abstract: In this paper, we tackle the challenging problem of Few-shot Object Detection. Existing FSOD pipelines (i) use average-pooled representations that result in information loss; and/or (ii) discard position information that can help detect object instances. Consequently, such pipelines are sensitive to large intra-class appearance and geometric variations between support and query images. To address these drawbacks, we propose a Time-rEversed diffusioN tEnsor Transformer (TENET), which i) forms high-order tensor representations that capture multi-way feature occurrences that are highly discriminative, and ii) uses a transformer that dynamically extracts correlations between the query image and the entire support set, instead of a single average-pooled support embedding. We also propose a Transformer Relation Head (TRH), equipped with higher-order representations, which encodes correlations between query regions and the entire support set, while being sensitive to the positional variability of object instances. Our model achieves state-of-the-art results on PASCAL VOC, FSOD, and COCO.


title: Attention Swin U-Net: Cross-Contextual Attention Mechanism for Skin Lesion Segmentation

abstract: Melanoma is caused by the abnormal growth of melanocytes in human skin. Like other cancers, this life-threatening skin cancer can be treated with early diagnosis. To support a diagnosis by automatic skin lesion segmentation, several Fully Convolutional Network (FCN) approaches, specifically the U-Net architecture, have been proposed. The U-Net model with a symmetrical architecture has exhibited superior performance in the segmentation task. However, the locality restriction of the convolutional operation incorporated in the U-Net architecture limits its performance in capturing long-range dependency, which is crucial for the segmentation task in medical images. To address this limitation, recently a Transformer based U-Net architecture that replaces the CNN blocks with the Swin Transformer module has been proposed to capture both local and global representation. In this paper, we propose Att-SwinU-Net, an attention-based Swin U-Net extension, for medical image segmentation. In our design, we seek to enhance the feature re-usability of the network by carefully designing the skip connection path. We argue that the classical concatenation operation utilized in the skip connection path can be further improved by incorporating an attention mechanism. By performing a comprehensive ablation study on several skin lesion segmentation datasets, we demonstrate the effectiveness of our proposed attention mechanism.


title: Understanding the Maker Protocol

abstract: This paper discusses a decentralized finance (DeFi) application called MakerDAO. The Maker Protocol, built on the Ethereum blockchain, enables users to create and hold currency. Current elements of the Maker Protocol are the Dai stable coin, Maker Vaults, and Voting. MakerDAO governs the Maker Protocol by deciding on key parameters (e.g., stability fees, collateral types and rates, etc.) through the voting power of Maker (MKR) holders. The Maker Protocol is one of the largest decentralized applications (DApps) on the Ethereum blockchain and is the first decentralized finance (DeFi) application to earn significant adoption. The objective of this paper is to analyze and discuss the significance, uses, and functions of this DeFi application.


title: High Resolution Multi-Scale RAFT (Robust Vision Challenge 2022)

abstract: In this report, we present our optical flow approach, MS-RAFT+, that won the Robust Vision Challenge 2022. It is based on the MS-RAFT method, which successfully integrates several multi-scale concepts into single-scale RAFT. Our approach extends this method by exploiting an additional finer scale for estimating the flow, which is made feasible by on-demand cost computation. This way, it can not only operate at half the original resolution, but also use MS-RAFT's shared convex upsampler to obtain full resolution flow. Moreover, our approach relies on an adjusted fine-tuning scheme during training. This in turn aims at improving the generalization across benchmarks. Among all participating methods in the Robust Vision Challenge, our approach ranks first on VIPER and second on KITTI, Sintel, and Middlebury, resulting in the first place of the overall ranking.


title: Foreign Object Debris Detection for Airport Pavement Images based on Self-supervised Localization and Vision Transformer

abstract: Supervised object detection methods provide subpar performance when applied to Foreign Object Debris (FOD) detection because FOD could be arbitrary objects according to the Federal Aviation Administration (FAA) specification. Current supervised object detection algorithms require datasets that contain annotated examples of every to-be-detected object. While a large and expensive dataset could be developed to include common FOD examples, it is infeasible to collect all possible FOD examples in the dataset representation because of the open-ended nature of FOD. Limitations of the dataset could cause FOD detection systems driven by those supervised algorithms to miss certain FOD, which can become dangerous to airport operations. To this end, this paper presents a self-supervised FOD localization by learning to predict the runway images, which avoids the enumeration of FOD annotation examples. The localization method utilizes the Vision Transformer (ViT) to improve localization performance. The experiments show that the method successfully detects arbitrary FOD in real-world runway situations. The paper also provides an extension to the localization result to perform classification; a feature that can be useful to downstream tasks. To train the localization, this paper also presents a simple and realistic dataset creation framework that only collects clean runway images. The training and testing data for this method are collected at a local airport using unmanned aircraft systems (UAS). Additionally, the developed dataset is provided for public use and further studies.


title: Atlas: Automate Online Service Configuration in Network Slicing

abstract: Network slicing achieves cost-efficient slice customization to support heterogeneous applications and services. Configuring cross-domain resources to end-to-end slices based on service-level agreements, however, is challenging, due to the complicated underlying correlations and the simulation-to-reality discrepancy between simulators and real networks. In this paper, we propose Atlas, an online network slicing system, which automates the service configuration of slices via safe and sample-efficient learn-to-configure approaches in three interrelated stages. First, we design a learning-based simulator to reduce the sim-to-real discrepancy, which is accomplished by a new parameter searching method based on Bayesian optimization. Second, we offline train the policy in the augmented simulator via a novel offline algorithm with a Bayesian neural network and parallel Thompson sampling. Third, we online learn the policy in real networks with a novel online algorithm with safe exploration and Gaussian process regression. We implement Atlas on an end-to-end network prototype based on OpenAirInterface RAN, OpenDayLight SDN transport, OpenAir-CN core network, and Docker-based edge server. Experimental results show that, compared to state-of-the-art solutions, Atlas achieves 63.9% and 85.7% regret reduction on resource usage and slice quality of experience during the online learning stage, respectively.


title: On Gelfand and MacPherson's combinatorial formula for Pontrjagin classes

abstract: In 1992 Gelfand and MacPherson gave a local and combinatorial formula for the Pontrjagin classes of a differential manifold. We give an expanded version of their discussion and highlight the origins of combinatorial differential manifolds in their work.


title: CP Violation and Mixing in Beauty Sector: A Theoretical Overview

abstract: We provide an overview of the latest progress in the study of CP violation and mixing in the $B$ meson decays. Studying the $B^0_d \to J/\psi K^0_S$ and $B^0_s \to J/\psi \phi$ decays, we focus on the determination of the mixing phases $\phi_d$ and $\phi_s$, including hadronic uncertainties with the help of the data. CP violation in the non-leptonic decays $B \to \pi K$ and $B^0_s \to D_s^{\mp} K^{\pm}$ indicate puzzling patterns. Could these puzzles indicate New Physics?


title: Stock price reaction to power outages following extreme weather events: Evidence from Texas power outage

abstract: In this study, we evaluate the effects of natural disasters on the stock (market) values of firms located in the affected counties. We are able to measure the change in stock prices of the firms affected by the 2021 Texas winter storm. To measure the abnormal return due to the storm, we use four different benchmark models: (1) the market-adjusted model, (2) the market model, (3) the Fama-French three-factor model, and (4) the Fama French plus momentum model. These statistical models in finance characterize the normal risk-return trade-off.


title: DyG2Vec: Efficient Representation Learning for Dynamic Graphs

abstract: Temporal graph neural networks have shown promising results in learning inductive representations by automatically extracting temporal patterns. However, previous works often rely on complex memory modules or inefficient random walk methods to construct temporal representations. To address these limitations, we present an efficient yet effective attention-based encoder that leverages temporal edge encodings and window-based subgraph sampling to generate task-agnostic embeddings. Moreover, we propose a joint-embedding architecture using non-contrastive SSL to learn rich temporal embeddings without labels. Experimental results on 7 benchmark datasets indicate that on average, our model outperforms SoTA baselines on the future link prediction task by 4.23% for the transductive setting and 3.30% for the inductive setting while only requiring 5-10x less training/inference time. Lastly, different aspects of the proposed framework are investigated through experimental analysis and ablation studies. The code is publicly available at https://github.com/huawei-noah/noah-research/tree/master/graph_atlas.


title: Curved Elements in Weak Galerkin Finite Element Methods

abstract: A mathematical analysis is established for the weak Galerkin finite element methods for the Poisson equation with Dirichlet boundary value when the curved elements are involved on the interior edges of the finite element partition or/and on the boundary of the whole domain in two dimensions. The optimal orders of error estimates for the weak Galerkin approximations in both the $H^1$-norm and the $L^2$-norm are established. Numerical results are reported to demonstrate the performance of the weak Galerkin methods on general curved polygonal partitions.


title: Statistical properties for mixing Markov chains with applications to dynamical systems

abstract: We establish an abstract, effective, exponential large deviations type estimate for Markov systems satisfying a weaker form of mixing. We employ this result to derive such estimates, as well as a central limit theorem, for the skew product encoding a random torus translation, a model we call a mixed random-quasiperiodic dynamical system. This abstract scheme is applicable to many other types of skew product dynamics, including systems for which the spectral gap property for the transition or the transfer operator does not hold.


title: Multiple gas phases in supernova remnant IC 443: mapping shocked H$_2$ with VLT/KMOS

abstract: Supernovae and their remnants provide energetic feedback to the ambient interstellar medium (ISM), which is often distributed in multiple gas phases. Among them, warm molecular hydrogen (H$_2$) often dominates the cooling of the shocked molecular ISM, which has been observed with the H$_2$ emission lines at near-infrared wavelengths. Such studies, however, were either limited in narrow filter imaging or sparsely sampled mid-infrared spectroscopic observations with relatively poor angular resolutions. Here we present near-infrared ($H$- and $K$-band) spectroscopic mosaic observations towards the A, B, C, and G regions of the supernova remnant (SNR) IC 443, with the K-band Multi-Object Spectrograph (KMOS) onboard the Very Large Telescope (VLT). We detected 20 ro-vibrational transitions of H$_2$, one H line (Br$\gamma$), and two [Fe II] lines, which dominate broadband images at both $H$- and $K$-band. The spatial distribution of H$_2$ lines at all regions are clumpy on scales from $\sim 0.1$ pc down to $\sim 0.008$ pc. The fitted excitation temperature of H$_2$ is between 1500 K and 2500 K, indicating warm shocked gas in these regions. The multi-gas-phase comparison shows stratified shock structures in all regions, which explains the co-existence of multiple types of shocks in the same regions. Last, we verify the candidates of young stellar objects previously identified in these regions with our spectroscopic data, and find none of them are associated with young stars. This sets challenges to the previously proposed scenario of triggered star formation by SNR shocks in IC~443.


title: Using parity-nonconserving spin-spin coupling to measure the Tl nuclear anapole moment in a TlF molecular beam

abstract: An experiment utilizing a TlF molecular beam is being developed by the CeNTREX collaboration to search for hadronic interactions that violate both time-reversal (T) and parity (P) invariance. Here we propose to use the same beam to look for a T-invariance conserving but P-nonconserving (PNC) effect induced by the anapole moment of the Tl nucleus, via a vector coupling of the two nuclear spins in TlF. To measure the nuclear anapole moment, the dc electric and magnetic fields in CeNTREX are replaced by rf fields resonant with a nuclear spin flip transition. We adapt the relativistic coupled cluster method in a combination with relativistic density functional theory for the calculation of the molecular PNC spin-spin vector coupling constant that links the experimental signal with the anapole moment. The value of the P-conserving spin-spin coupling constant calculated within the same approach is found to be in good agreement with available experimental data.


title: Touchdown solutions in general MEMS models

abstract: We study general equations modeling electrostatic MEMS devices \begin{equation} \begin{cases} \label{P} \varphi\big(r,- u'(r)\big)=\lambda\int_0^r\frac{f(s)}{g(u(s))}\,\mathrm{d}s, & r\in(0,1), \\ 0 < u(r) < 1, & r\in(0,1), \\ u(1) = 0, \tag{$P_\lambda$} \end{cases} \end{equation} where $\varphi$, $g$, $f$ are some functions on $[0,1]$ and $\lambda>0$ is a parameter. We obtain results on the existence and regularity of a touchdown solution to \eqref{P} and find upper and lower bounds on the respective pull-in voltage. In the particular case, when $\varphi(r,v) = r^\alpha |v|^\beta v$, i.e., when the associated differential equation involves the operator $r^{-\gamma}(r^\alpha |u'|^\beta u')'$, we obtain an exact asymptotic behavior of the touchdown solution in a neighborhood of the origin.


title: Geometric invariants for a class of submodules of analytic Hilbert modules via the sheaf model

abstract: Let $\Omega \subseteq \mathbb C^m$ be a bounded connected open set and $\mathcal H \subseteq \mathcal O(\Omega)$ be an analytic Hilbert module, i.e., the Hilbert space $\mathcal H$ possesses a reproducing kernel $K$, the polynomial ring $\mathbb C[\boldsymbol{z}]\subseteq \mathcal H$ is dense and the point-wise multiplication induced by $p\in \mathbb C[\boldsymbol{z}]$ is bounded on $\mathcal H$. We fix an ideal $\mathcal I \subseteq \mathbb C[\boldsymbol{z}]$ generated by $p_1,\ldots,p_t$ and let $[\mathcal I]$ denote the completion of $\mathcal I$ in $\mathcal H$. The sheaf $\mathcal S^\mathcal H$ associated to analytic Hilbert module $\mathcal H$ is the sheaf $\mathcal O(\Omega)$ of holomorphic functions on $\Omega$ and hence is free. However, the subsheaf $\mathcal S^{\mathcal [\mathcal I]}$ associated to $[\mathcal I]$ is coherent and not necessarily locally free. Building on the earlier work of \cite{BMP}, we prescribe a hermitian structure for a coherent sheaf and use it to find tractable invariants. Moreover, we prove that if the zero set $V_{[\mathcal I]}$ is a submanifold of codimension $t$, then there is a unique local decomposition for the kernel $K_{[\mathcal I]}$ along the zero set that serves as a holomorphic frame for a vector bundle on $V_{[\mathcal I]}$. The complex geometric invariants of this vector bundle are also unitary invariants for the submodule $[\mathcal I] \subseteq \mathcal H$.


title: Revisiting Simple Regret: Fast Rates for Returning a Good Arm

abstract: Simple regret is a natural and parameter-free performance criterion for pure exploration in multi-armed bandits yet is less popular than the probability of missing the best arm or an $\epsilon$-good arm, perhaps due to lack of easy ways to characterize it. In this paper, we make significant progress on minimizing simple regret in both data-rich ($T\ge n$) and data-poor regime ($T \le n$) where $n$ is the number of arms, and $T$ is the number of samples. At its heart is our improved instance-dependent analysis of the well-known Sequential Halving (SH) algorithm, where we bound the probability of returning an arm whose mean reward is not within $\epsilon$ from the best (i.e., not $\epsilon$-good) for \textit{any} choice of $\epsilon>0$, although $\epsilon$ is not an input to SH. Our bound not only leads to an optimal worst-case simple regret bound of $\sqrt{n/T}$ up to logarithmic factors but also essentially matches the instance-dependent lower bound for returning an $\epsilon$-good arm reported by Katz-Samuels and Jamieson (2020). For the more challenging data-poor regime, we propose Bracketing SH (BSH) that enjoys the same improvement even without sampling each arm at least once. Our empirical study shows that BSH outperforms existing methods on real-world tasks.


title: FatNet: High Resolution Kernels for Classification Using Fully Convolutional Optical Neural Networks

abstract: This paper describes the transformation of a traditional in-silico classification network into an optical fully convolutional neural network with high-resolution feature maps and kernels. When using the free-space 4f system to accelerate the inference speed of neural networks, higher resolutions of feature maps and kernels can be used without the loss in frame rate. We present FatNet for the classification of images, which is more compatible with free-space acceleration than standard convolutional classifiers. It neglects the standard combination of convolutional feature extraction and classifier dense layers by performing both in one fully convolutional network. This approach takes full advantage of the parallelism in the 4f free-space system and performs fewer conversions between electronics and optics by reducing the number of channels and increasing the resolution, making the network faster in optics than off-the-shelf networks. To demonstrate the capabilities of FatNet, it trained with the CIFAR100 dataset on GPU and the simulator of the 4f system, then compared the results against ResNet-18. The results show 8.2 times fewer convolution operations at the cost of only 6% lower accuracy compared to the original network. These are promising results for the approach of training deep learning with high-resolution kernels in the direction towards the upcoming optics era.


title: Imitating Opponent to Win: Adversarial Policy Imitation Learning in Two-player Competitive Games

abstract: Recent research on vulnerabilities of deep reinforcement learning (RL) has shown that adversarial policies adopted by an adversary agent can influence a target RL agent (victim agent) to perform poorly in a multi-agent environment. In existing studies, adversarial policies are directly trained based on experiences of interacting with the victim agent. There is a key shortcoming of this approach; knowledge derived from historical interactions may not be properly generalized to unexplored policy regions of the victim agent, making the trained adversarial policy significantly less effective. In this work, we design a new effective adversarial policy learning algorithm that overcomes this shortcoming. The core idea of our new algorithm is to create a new imitator to imitate the victim agent's policy while the adversarial policy will be trained not only based on interactions with the victim agent but also based on feedback from the imitator to forecast victim's intention. By doing so, we can leverage the capability of imitation learning in well capturing underlying characteristics of the victim policy only based on sample trajectories of the victim. Our victim imitation learning model differs from prior models as the environment's dynamics are driven by adversary's policy and will keep changing during the adversarial policy training. We provide a provable bound to guarantee a desired imitating policy when the adversary's policy becomes stable. We further strengthen our adversarial policy learning by making our imitator a stronger version of the victim. Finally, our extensive experiments using four competitive MuJoCo game environments show that our proposed adversarial policy learning algorithm outperforms state-of-the-art algorithms.


title: Decomposing Impact on Longitudinal Outcome of Time-varying Covariate into Baseline Effect and Temporal Effect

abstract: Longitudinal processes are often associated with each other over time; therefore, it is important to investigate the associations among developmental processes and understand their joint development. The latent growth curve model (LGCM) with a time-varying covariate (TVC) provides a method to estimate the TVC's effect on a longitudinal outcome while simultaneously modeling the outcome's change. However, it does not allow the TVC to predict variations in the random growth coefficients. We propose decomposing the TVC's effect into initial trait and temporal states using three methods to address this limitation. In each method, the baseline of the TVC is viewed as an initial trait, and the corresponding effects are obtained by regressing random intercepts and slopes on the baseline value. Temporal states are characterized as (1) interval-specific slopes, (2) interval-specific changes, or (3) changes from the baseline at each measurement occasion, depending on the method. We demonstrate our methods through simulations and real-world data analyses, assuming a linear-linear functional form for the longitudinal outcome. The results demonstrate that LGCMs with a decomposed TVC can provide unbiased and precise estimates with target confidence intervals. We also provide OpenMx and Mplus 8 code for these methods with commonly used linear and nonlinear functions.


title: PHY-Fed: An Information-Theoretic Secure Aggregation in Federated Learning in Wireless Communications

abstract: Federated learning (FL) is a type of distributed machine learning at the wireless edge that preserves the privacy of clients' data from adversaries and even the central server. Existing federated learning approaches either use (i) secure multiparty computation (SMC) which is vulnerable to inference or (ii) differential privacy which may decrease the test accuracy given a large number of parties with relatively small amounts of data each. To tackle the problem with the existing methods in the literature, In this paper, we introduce PHY-Fed, a new framework that secures federated algorithms from an information-theoretic point of view.


title: Evaluation and comparison of federated learning algorithms for Human Activity Recognition on smartphones

abstract: Pervasive computing promotes the integration of smart devices in our living spaces to develop services providing assistance to people. Such smart devices are increasingly relying on cloud-based Machine Learning, which raises questions in terms of security (data privacy), reliance (latency), and communication costs. In this context, Federated Learning (FL) has been introduced as a new machine learning paradigm enhancing the use of local devices. At the server level, FL aggregates models learned locally on distributed clients to obtain a more general model. In this way, no private data is sent over the network, and the communication cost is reduced. Unfortunately, however, the most popular federated learning algorithms have been shown not to be adapted to some highly heterogeneous pervasive computing environments. In this paper, we propose a new FL algorithm, termed FedDist, which can modify models (here, deep neural network) during training by identifying dissimilarities between neurons among the clients. This permits to account for clients' specificity without impairing generalization. FedDist evaluated with three state-of-the-art federated learning algorithms on three large heterogeneous mobile Human Activity Recognition datasets. Results have shown the ability of FedDist to adapt to heterogeneous data and the capability of FL to deal with asynchronous situations.


title: Gravitational decoherence by the apparatus in the quantum-gravity induced entanglement of masses

abstract: One of the outstanding questions in modern physics is how to test whether gravity is classical or quantum in a laboratory. Recently there has been a proposal to test the quantum nature of gravity by creating quantum superpositions of two nearby neutral masses, close enough that the quantum nature of gravity can entangle the two quantum systems, but still sufficiently far away that all other known Standard Model interactions remain negligible. However, the mere process of preparing superposition states of a neutral mass (the light system), requires the vicinity of laboratory apparatus (the heavy system). We will suppose that such a heavy system can be modelled as another quantum system; since gravity is universal, the lighter system can get entangled with the heavier system, providing an inherent source of gravitational decoherence. In this paper, we will consider two light and two heavy quantum oscillators, forming pairs of probe-detector systems, and study under what conditions the entanglement between two light systems evades the decoherence induced by the heavy systems. We conclude by estimating the magnitude of the decoherence in the proposed experiment for testing the quantum nature of gravity.


title: Locally standard measure algebras

abstract: We parameterize countable locally standard measure algebras by pairs of a Steinitz number and a real number greater or equal to 1. This is an analog of the theorems of J.Dixmier and A.A.Baranov.


title: A Chemical Modelling Roadmap Linking Protoplanetary Disks and Exoplanet Atmospheres

abstract: [Abridged] This review paper discussed which chemical effects may be at play in a planet-forming disk midplane, which effects are relevant under different conditions, and which tools are available for modelling chemical kinetics in a disk midplane. The review goes on to discuss some important efforts in the planet formation modelling community to treat chemical evolution, and, vice versa, efforts in the chemical modelling community to implement more physical effects related to planet formation into the chemical modelling. The aim of this review is both to outline some concepts related to planet formation chemistry, but also to encourage, not just collaboration between the planet formation modelling community and the astrochemical community, but also assistance and guidance from one community to the other. Guidance, regarding which effects, out of many, might be more relevant than others under certain planet formation conditions, and regarding why certain included effects lead to certain important modelling outcomes. As the research fields of exoplanet atmospheres and protoplanetary disks near new frontiers in observational insights with upcoming facilities, developing appropriate modelling frameworks (including physical and chemical effects) is paramount to ultimately enable the linking of a chemically characterised exoplanet atmospheres to its formation history in its natal protoplanetary disk.


title: Asymptotic root distribution of Charlier polynomials with large negative parameter

abstract: We analyze the asymptotic distribution of roots of Charlier polynomials with negative parameter depending linearly on the index. The roots cluster on curves in the complex plane. We determine implicit equations for these curves and deduce the limiting density of the root distribution supported on these curves. The proof is based on a determination of the limiting Cauchy transform in a specific region and a careful application of the saddle point method. The obtained result represents a solvable example of a more general open problem.


title: See as a Bee: UV Sensor for Aerial Strawberry Crop Monitoring

abstract: Precision agriculture aims to use technological tools for the agro-food sector to increase productivity, cut labor costs, and reduce the use of resources. This work takes inspiration from bees vision to design a remote sensing system tailored to incorporate UV-reflectance into a flower detector. We demonstrate how this approach can provide feature-rich images for deep learning strawberry flower detection and we apply it to a scalable, yet cost effective aerial monitoring robotic system in the field. We also compare the performance of our UV-G-B image detector with a similar work that utilizes RGB images.


title: OGInfra: Geolocating Oil & Gas Infrastructure using Remote Sensing based Active Fire Data

abstract: Remote sensing has become a crucial part of our daily lives, whether it be from triangulating our location using GPS or providing us with a weather forecast. It has multiple applications in domains such as military, socio-economical, commercial, and even in supporting humanitarian efforts. This work proposes a novel technique for the automated geo-location of Oil & Gas infrastructure with the use of Active Fire Data from the NASA FIRMS data repository & Deep Learning techniques; achieving a top accuracy of 90.68% with the use of ResNet101.


title: Instrumentation for correlated prompt $n$-$\gamma$ emission studies in coincidence with fission fragments

abstract: Recent theoretical and experimental results have brought renewed interest and focus on the topic of fission fragment angular momentum. Measurements of neutrons and $\gamma$ rays in coincidence with fission fragments remain the most valuable tool in the exploration of fission physics. To achieve these scientific goals, we have developed a system that combines a state-of-the-art fission fragment detector and $n$-$\gamma$ radiation detectors. A new twin Frisch-gridded ionization chamber has been designed and constructed for use with a spontaneous fission source and an array of forty \textit{trans}-stilbene organic scintillators (FS-3) at Argonne National Laboratory. The new ionization chamber design we present in this work aims at minimizing particle attenuation in the chamber walls, and provides a compact apparatus that can be fit inside existing experimental systems. The ionization chamber is capable of measuring fission fragment masses and kinetic energies, whereas the FS-3 provides neutron and gamma-ray multiplicities and spectra. The details of both detector assembly are presented along with the first experimental results of this setup. Planned event-by-event analysis and future experiments are briefly discussed.


title: Equivalence after extension and Schur coupling for Fredholm operators on Banach spaces

abstract: Schur coupling (SC) and equivalence after extension (EAE) are important relations for bounded operators on Banach spaces. It has been known for 30 years that the former implies the latter, but only recently Ter Horst, Messerschmidt, Ran and Roelands disproved the converse by constructing a pair of Fredholm operators which are EAE, but not SC. Motivated by this result, we investigate when EAE and SC coincide for Fred\-holm operators. Fredholm operators which are EAE have the same Fredholm index. Surprisingly, we find that for each integer $k$ and every pair of Banach spaces $(\mathcal{X},\mathcal{Y})$, either no pair of Fredholm operators of index~$k$ acting on $\mathcal{X}$ and $\mathcal{Y}$, respectively, is SC, or every pair of this kind which is EAE is also SC. Consequently, the question whether EAE and SC coincide for Fredholm operators of index~$k$ depends only on the geometry of the underlying Banach spaces $\mathcal{X}$ and $\mathcal{Y}$, not on the properties of the operators themselves. We quantify this finding by introducing two numerical indices which capture the coincidence of EAE and SC, and provide a number of examples illustrating the possible values of these indices. Notably, this includes an example showing that the above-mentioned result of Ter Horst et al, which is based on a pair of essentially incomparable Banach spaces, does not extend to projectively incomparable Banach spaces.


title: Improved Gauge-Unfixing Formalism through a Prototypical Second-Class System

abstract: We contextualize the improved gauge-unfixing (GU) formalism within a rather general prototypical second-class system, obtaining a corresponding first-class equivalent description enjoying gauge invariance which can be applied to several situations. The prototypical system is chosen to represent a considerable class of relevant models in field theory. By considering the improved version of the GU formalism, we show that any gauge-invariant function can be obtained in terms of a specific deformation in phase space, benefiting thus from the fact that no auxiliary variables are needed in the process. In this way, the resulting converted first-class system is constructed out of the same original canonical variables, preserving the number of degrees of freedom. We illustrate the technique with an application to the nonlinear sigma model.


title: Forget Embedding Layers: Representation Learning for Cold-start in Recommender Systems

abstract: Recommender systems suffer from the cold-start problem whenever a new user joins the platform or a new item is added to the catalog. To address item cold-start, we propose to replace the embedding layer in sequential recommenders with a dynamic storage that has no learnable weights and can keep an arbitrary number of representations. In this paper, we present FELRec, a large embedding network that refines the existing representations of users and items in a recursive manner, as new information becomes available. In contrast to similar approaches, our model represents new users and items without side information or time-consuming fine-tuning. During item cold-start, our method outperforms similar method by 29.50%-47.45%. Further, our proposed model generalizes well to previously unseen datasets. The source code is publicly available at github.com/kweimann/FELRec.


title: Muonic-Atom Spectroscopy and Impact on Nuclear Structure and Precision QED Theory

abstract: Recent progress in laser and x-ray spectroscopy of muonic atoms offers promising long-term possibilities at the intersection of atomic, nuclear and particle physics. In muonic hydrogen, laser spectroscopy measurements will determine the ground-state hyperfine splitting (HFS) and additionally improve the Lamb shift by a factor of 5. Precision spectroscopy with cryogenic microcalorimeters has the potential to significantly improve the charge radii of the light nuclei in the $Z=3-8$ range. Complementary progress in precision should be achieved on the theory of nucleon- and nuclear-structure effects. The impact of this muonic-atom spectroscopy program will be amplified by the upcoming results from H and He$^+$ spectroscopy, simple molecules such as HD$^+$ and Penning trap measurements. In this broader context, one can test ab-initio nuclear theories, bound-state QED for two- or three-body systems, and determine fundamental constants, such as the Rydberg ($R_\infty$) and the fine-structure ($\alpha$) constants.


title: Sliding Block Puzzles with a Twist: On Segerman's 15+4 Puzzle

abstract: Segerman's 15+4 puzzle is a hinged version of the classic 15-puzzle, in which the tiles rotate as they slide around. In 1974, Wilson classified the groups of solutions to sliding block puzzles. We generalize Wilson's result to puzzles like the 15+4 puzzle, where the tiles can rotate, and the sets of solutions are subgroups of the generalized symmetric groups. Aside from two exceptional cases, we see that the group of solutions to such a puzzle is always either the entire generalized symmetric group or one of two special subgroups of index two.


title: Intrinsic polynomial squeezing for Balakrishnan-Taylor beam models

abstract: We explore the energy decay properties related to a model in extensible beams with the so-called energy damping. We investigate the influence of the nonloncal damping coefficient in the stability of the model. We prove, for the first time, that the corresponding energy functional is squeezed by polynomial-like functions involving the power of the damping coefficient, which arises intrinsically from the Balakrishnan-Taylor beam models. As a consequence, it is shown that such models with nonlocal energy damping are never exponentially stable in its essence.


title: Spin Density Matrix Elements in Exclusive $\rho ^0$ Meson Muoproduction

abstract: We report on a measurement of Spin Density Matrix Elements (SDMEs) in hard exclusive $\rho ^0$ meson muoproduction at COMPASS using 160~GeV/$c$ polarised $ \mu ^{+}$ and $ \mu ^{-}$ beams impinging on a liquid hydrogen target. The measurement covers the kinematic range 5.0~GeV/$c^2$ $< W <$ 17.0~GeV/$c^2$, 1.0 (GeV/$c$)$^2$ $< Q^2 <$ 10.0 (GeV/$c$)$^2$ and 0.01 (GeV/$c$)$^2$ $< p_{\rm{T}}^2 <$ 0.5 (GeV/$c$)$^2$. Here, $W$ denotes the mass of the final hadronic system, $Q^2$ the virtuality of the exchanged photon, and $p_{\rm{T}}$ the transverse momentum of the $\rho ^0$ meson with respect to the virtual-photon direction. The measured non-zero SDMEs for the transitions of transversely polarised virtual photons to longitudinally polarised vector mesons ($\gamma^*_T \to V^{ }_L$) indicate a violation of $s$-channel helicity conservation. Additionally, we observe a dominant contribution of natural-parity-exchange transitions and a very small contribution of unnatural-parity-exchange transitions, which is compatible with zero within experimental uncertainties. The results provide important input for modelling Generalised Parton Distributions (GPDs). In particular, they may allow one to evaluate in a model-dependent way the role of parton helicity-flip GPDs in exclusive $\rho ^0$ production.


title: Context-empowered Visual Attention Prediction in Pedestrian Scenarios

abstract: Effective and flexible allocation of visual attention is key for pedestrians who have to navigate to a desired goal under different conditions of urgency and safety preferences. While automatic modelling of pedestrian attention holds great promise to improve simulations of pedestrian behavior, current saliency prediction approaches mostly focus on generic free-viewing scenarios and do not reflect the specific challenges present in pedestrian attention prediction. In this paper, we present Context-SalNET, a novel encoder-decoder architecture that explicitly addresses three key challenges of visual attention prediction in pedestrians: First, Context-SalNET explicitly models the context factors urgency and safety preference in the latent space of the encoder-decoder model. Second, we propose the exponentially weighted mean squared error loss (ew-MSE) that is able to better cope with the fact that only a small part of the ground truth saliency maps consist of non-zero entries. Third, we explicitly model epistemic uncertainty to account for the fact that training data for pedestrian attention prediction is limited. To evaluate Context-SalNET, we recorded the first dataset of pedestrian visual attention in VR that includes explicit variation of the context factors urgency and safety preference. Context-SalNET achieves clear improvements over state-of-the-art saliency prediction approaches as well as over ablations. Our novel dataset will be made fully available and can serve as a valuable resource for further research on pedestrian attention prediction.


title: Learning to Compare Nodes in Branch and Bound with Graph Neural Networks

abstract: Branch-and-bound approaches in integer programming require ordering portions of the space to explore next, a problem known as node comparison. We propose a new siamese graph neural network model to tackle this problem, where the nodes are represented as bipartite graphs with attributes. Similar to prior work, we train our model to imitate a diving oracle that plunges towards the optimal solution. We evaluate our method by solving the instances in a plain framework where the nodes are explored according to their rank. On three NP-hard benchmarks chosen to be particularly primal-difficult, our approach leads to faster solving and smaller branch- and-bound trees than the default ranking function of the open-source solver SCIP, as well as competing machine learning methods. Moreover, these results generalize to instances larger than used for training. Code for reproducing the experiments can be found at https://github.com/ds4dm/learn2comparenodes.


title: Scalable and self-correcting photonic computation using balanced photonic binary tree cascades

abstract: Programmable unitary photonic networks that interfere hundreds of modes are emerging as a key technology in energy-efficient sensing, machine learning, cryptography, and linear optical quantum computing applications. In this work, we establish a theoretical framework to quantify error tolerance and scalability in a more general class of "binary tree cascade'' programmable photonic networks that accept up to tens of thousands of discrete input modes $N$. To justify this scalability claim, we derive error tolerance and configuration time that scale with $\log_2 N$ for balanced trees versus $N$ in unbalanced trees, despite the same number of total components. Specifically, we use second-order perturbation theory to compute phase sensitivity in each waveguide of balanced and unbalanced networks, and we compute the statistics of the sensitivity given random input vectors. We also evaluate such networks after they self-correct, or self-configure, themselves for errors in the circuit due to fabrication error and environmental drift. Our findings have important implications for scaling photonic circuits to much larger circuit sizes; this scaling is particularly critical for applications such as principal component analysis and fast Fourier transforms, which are important algorithms for machine learning and signal processing.


title: Superintegrable quantum mechanical systems with position dependent masses invariant with respect to three parametric Lie groups

abstract: Quantum mechanical systems with position dependent masses (PDM) admitting for and more dimensional symmetry algebras are classified. Namely, all PDM systems are specified which, in addition to their invariance w.r.t. a three parametric Lie group, admit at least one second order integral of motion. The presented classification is partially extended to the more generic systems which admit one or two parametric Lie groups.


title: Perspective Functions with Nonlinear Scaling

abstract: The classical perspective of a function is a construction which transforms a convex function into one that is jointly convex with respect to an auxiliary scaling variable. Motivated by applications in several areas of applied analysis, we investigate an extension of this construct in which the scaling variable is replaced by a nonlinear term. Our construction is placed in the general context of locally convex spaces and it generates a lower semicontinuous convex function under broad assumptions on the underlying functions. Various convex-analytical properties are established and closed-form expressions are derived. Several applications are presented.


title: A view on model misspecification in uncertainty quantification

abstract: Estimating uncertainty of machine learning models is essential to assess the quality of the predictions that these models provide. However, there are several factors that influence the quality of uncertainty estimates, one of which is the amount of model misspecification. Model misspecification always exists as models are mere simplifications or approximations to reality. The question arises whether the estimated uncertainty under model misspecification is reliable or not. In this paper, we argue that model misspecification should receive more attention, by providing thought experiments and contextualizing these with relevant literature.


title: BCI-Walls: A robust methodology to predict success or failure in brain computer interfaces

abstract: Brain computer interfaces (BCI) depend on reliable realtime detection of conscious EEG changes for example to control a video game. However, scalp recordings are contaminated with non-stationary noise, such as facial muscle activity and eye movements. This interferes with the detection process making it potentially unreliable or even impossible. We have developed a new methodology which provides a hard and measurable criterion if conscious EEG changes can be detected in the presence of non-stationary noise by requiring the signal-to-noise ratio of a scalp recording to be greater than the SNR-wall which in turn is based on the highest and lowest noise variances of the recording. As an instructional example, we have recorded signals from the central electrode Cz during eight different activities causing non-stationary noise such as playing a video game or reading out loud. The results show that facial muscle activity and eye-movements have a strong impact on the detectability of EEG and that minimising both eye-movement artefacts and muscle noise is essential to be able to detect conscious EEG changes.


title: FI-ODE: Certifiably Robust Forward Invariance in Neural ODEs

abstract: Forward invariance is a long-studied property in control theory that is used to certify that a dynamical system stays within some pre-specified set of states for all time, and also admits robustness guarantees (e.g., the certificate holds under perturbations). We propose a general framework for training and provably certifying robust forward invariance in Neural ODEs. We apply this framework to provide certified safety in robust continuous control. To our knowledge, this is the first instance of training Neural ODE policies with such non-vacuous certified guarantees. In addition, we explore the generality of our framework by using it to certify adversarial robustness for image classification.


title: Hybrid Reusable Computational Analytics Workflow Management with Cloudmesh

abstract: In this paper, we summarize our effort to create and utilize a simple framework to coordinate computational analytics tasks with the help of a workflow system. Our design is based on a minimalistic approach while at the same time allowing to access computational resources offered through the owner's computer, HPC computing centers, cloud resources, and distributed systems in general. The access to this framework includes a simple GUI for monitoring and managing the workflow, a REST service, a command line interface, as well as a Python interface. The resulting framework was developed for several examples targeting benchmarks of AI applications on hybrid compute resources and as an educational tool for teaching scientists and students sophisticated concepts to execute computations on resources ranging from a single computer to many thousands of computers as part of on-premise and cloud infrastructure. We demonstrate the usefulness of the tool on a number of examples. The code is available as an open-source project in GitHub and is based on an easy-to-enhance tool called cloudmesh.


title: Molecular dynamics simulations of active entangled polymers reptating through a passive mesh

abstract: In this work, we explore the dynamics of active entangled chains using molecular dynamics simulations of a modified Kremer-Grest model. The active chains are diluted in a mesh of very long passive linear chains, to avoid constraint release effects, and an active force is applied to the monomers in a way that it imparts a constant polar drift velocity along the primitive path. The simulation results show that, over a wide range of activity values, the conformational properties of the chains and the tubes are not affected, but the dynamics of the chains are severely modified. Despite not having an explicit tube, the simulations verify all the predictions of the theory about all possible observables very accurately, including a diffusion coefficient that becomes independent of the molecular weight at moderate values of the activity. Overall, this work provides novel information on the study of active entangled polymers, giving a route map for studying this phenomenon and an efficient way of obtaining a polar activity that reproduces the physics of the active reptation theory.


title: ViTASD: Robust Vision Transformer Baselines for Autism Spectrum Disorder Facial Diagnosis

abstract: Autism spectrum disorder (ASD) is a lifelong neurodevelopmental disorder with very high prevalence around the world. Research progress in the field of ASD facial analysis in pediatric patients has been hindered due to a lack of well-established baselines. In this paper, we propose the use of the Vision Transformer (ViT) for the computational analysis of pediatric ASD. The presented model, known as ViTASD, distills knowledge from large facial expression datasets and offers model structure transferability. Specifically, ViTASD employs a vanilla ViT to extract features from patients' face images and adopts a lightweight decoder with a Gaussian Process layer to enhance the robustness for ASD analysis. Extensive experiments conducted on standard ASD facial analysis benchmarks show that our method outperforms all of the representative approaches in ASD facial analysis, while the ViTASD-L achieves a new state-of-the-art. Our code and pretrained models are available at https://github.com/IrohXu/ViTASD.


title: Personalized Dose Guidance using Safe Bayesian Optimization

abstract: This work considers the problem of personalized dose guidance using Bayesian optimization that learns the optimum drug dose tailored to each individual, thus improving therapeutic outcomes. Safe learning using interior point method ensures patient safety with high probability. This is demonstrated using the problem of learning the optimum bolus insulin dose in patients with type 1 diabetes to counteract the effect of meal consumption. Starting from no a priori information about the patients, our dose guidance algorithm is able to improve the therapeutic outcome (measured in terms of % time-in-range) without jeopardizing patient safety. Other potential healthcare applications are also discussed.


title: A new variable shape parameter strategy for RBF approximation using neural networks

abstract: The choice of the shape parameter highly effects the behaviour of radial basis function (RBF) approximations, as it needs to be selected to balance between ill-condition of the interpolation matrix and high accuracy. In this paper, we demonstrate how to use neural networks to determine the shape parameters in RBFs. In particular, we construct a multilayer perceptron trained using an unsupervised learning strategy, and use it to predict shape parameters for inverse multiquadric and Gaussian kernels. We test the neural network approach in RBF interpolation tasks and in a RBF-finite difference method in one and two-space dimensions, demonstrating promising results.


title: AtOMICS: A neural network-based Automated Optomechanical Intelligent Coupling System for testing and characterization of silicon photonics chiplets

abstract: Recent advances in silicon photonics promise to revolutionize modern technology by improving performance of everyday devices in multiple fields. However, as the industry moves into a mass fabrication phase, the problem of effective testing of integrated silicon photonics devices remains to be solved. A cost-efficient manner that reduces schedule risk needs to involve automated testing of multiple devices that share common characteristics such as input-output coupling mechanisms, but at the same time needs to be generalizable to multiple types of devices and scenarios. In this paper we present a neural network-based automated system designed for in-plane fiber-chip-fiber testing, characterization, and active alignment of silicon photonic devices that use process-design-kit library edge couplers. The presented approach combines state-of-the-art computer vision techniques with time-series analysis, in order to control a testing setup that can process multiple devices and can be easily tuned to incorporate additional hardware. The system can operate at vacuum or atmospheric pressures and maintains stability for fairly long time periods in excess of a month.


title: Two Models are Better than One: Federated Learning Is Not Private For Google GBoard Next Word Prediction

abstract: In this paper we present new attacks against federated learning when used to train natural language text models. We illustrate the effectiveness of the attacks against the next word prediction model used in Google's GBoard app, a widely used mobile keyboard app that has been an early adopter of federated learning for production use. We demonstrate that the words a user types on their mobile handset, e.g. when sending text messages, can be recovered with high accuracy under a wide range of conditions and that counter-measures such a use of mini-batches and adding local noise are ineffective. We also show that the word order (and so the actual sentences typed) can be reconstructed with high fidelity. This raises obvious privacy concerns, particularly since GBoard is in production use.


title: QCL dynamics: thermal effects and rate equations beyond mean-field approach

abstract: The correct accounting for thermal effects is always a challenge when one needs to make quantitative predictions for any laser applications. In such complicated devices as quantum cascade lasers temperature strongly affects the operational conditions preventing reaching the CW mode as well as efficient lasing in pulsed regime. Rate equations are the most effective and simple way to model laser dynamics. However, the conventional approaches operate under the mean-field approximation, considering finite number of population levels, generalizing the obtained results to the infinite number of cascades, and do not take heating into account. In this work we modify the conventional three-level rate equation approach by adding self-heating description and applying it to the calculation of QCL dynamics. As a result we show how temperature affects the threshold characteristics and build-up time and include electronic aspects to the description of QCL.


title: Decentralized Channel Management in WLANs with Graph Neural Networks

abstract: Wireless local area networks (WLANs) manage multiple access points (APs) and assign scarce radio frequency resources to APs for satisfying traffic demands of associated user devices. This paper considers the channel allocation problem in WLANs that minimizes the mutual interference among APs, and puts forth a learning-based solution that can be implemented in a decentralized manner. We formulate the channel allocation problem as an unsupervised learning problem, parameterize the control policy of radio channels with graph neural networks (GNNs), and train GNNs with the policy gradient method in a model-free manner. The proposed approach allows for a decentralized implementation due to the distributed nature of GNNs and is equivariant to network permutations. The former provides an efficient and scalable solution for large network scenarios, and the latter renders our algorithm independent of the AP reordering. Empirical results are presented to evaluate the proposed approach and corroborate theoretical findings.


title: On the Motion of a Pendulum with a Cavity Filled with a Compressible Fluid

abstract: We study the motion of the coupled system, $\mathscr S$, constituted by a physical pendulum, $\mathscr B$, with an interior cavity entirely filled with a viscous, compressible fluid, $\mathscr F$. The presence of the fluid may strongly affect on the motion of $\mathscr B$. In fact, we prove that, under appropriate assumptions, the fluid acts as a damper, namely, $\mathscr S$ must eventually reach a rest-state. Such a state is characterized by a suitable time-independent density distribution of $\mathscr F$ and a corresponding equilibrium position of the center of mass of $\mathscr S$. These results are proved in the very general class of weak solutions and do not require any restriction on the initial data, other than having a finite energy. We complement our findings with some numerical tests. The latter show, among other things, the interesting property that ``large" compressibility favors the damping effect, since it drastically reduces the time that $\mathscr S$ takes to go to rest.


title: Intelligent Blockage Recognition using Cellular mmWave Beamforming Data: Feasibility Study

abstract: Joint Communication and Sensing (JCAS) is envisioned for 6G cellular networks, where sensing the operation environment, especially in presence of humans, is as important as the high-speed wireless connectivity. Sensing, and subsequently recognizing blockage types, is an initial step towards signal blockage avoidance. In this context, we investigate the feasibility of using human motion recognition as a surrogate task for blockage type recognition through a set of hypothesis validation experiments using both qualitative and quantitative analysis (visual inspection and hyperparameter tuning of deep learning (DL) models, respectively). A surrogate task is useful for DL model testing and/or pre-training, thereby requiring a low amount of data to be collected from the eventual JCAS environment. Therefore, we collect and use a small dataset from a 26 GHz cellular multi-user communication device with hybrid beamforming. The data is converted into Doppler Frequency Spectrum (DFS) and used for hypothesis validations. Our research shows that (i) the presence of domain shift between data used for learning and inference requires use of DL models that can successfully handle it, (ii) DFS input data dilution to increase dataset volume should be avoided, (iii) a small volume of input data is not enough for reasonable inference performance, (iv) higher sensing resolution, causing lower sensitivity, should be handled by doing more activities/gestures per frame and lowering sampling rate, and (v) a higher reported sampling rate to STFT during pre-processing may increase performance, but should always be tested on a per learning task basis.


title: Transfer Learning with Synthetic Corpora for Spatial Role Labeling and Reasoning

abstract: Recent research shows synthetic data as a source of supervision helps pretrained language models (PLM) transfer learning to new target tasks/domains. However, this idea is less explored for spatial language. We provide two new data resources on multiple spatial language processing tasks. The first dataset is synthesized for transfer learning on spatial question answering (SQA) and spatial role labeling (SpRL). Compared to previous SQA datasets, we include a larger variety of spatial relation types and spatial expressions. Our data generation process is easily extendable with new spatial expression lexicons. The second one is a real-world SQA dataset with human-generated questions built on an existing corpus with SPRL annotations. This dataset can be used to evaluate spatial language processing models in realistic situations. We show pretraining with automatically generated data significantly improves the SOTA results on several SQA and SPRL benchmarks, particularly when the training data in the target domain is small.


title: Improving Bilingual Lexicon Induction with Cross-Encoder Reranking

abstract: Bilingual lexicon induction (BLI) with limited bilingual supervision is a crucial yet challenging task in multilingual NLP. Current state-of-the-art BLI methods rely on the induction of cross-lingual word embeddings (CLWEs) to capture cross-lingual word similarities; such CLWEs are obtained 1) via traditional static models (e.g., VecMap), or 2) by extracting type-level CLWEs from multilingual pretrained language models (mPLMs), or 3) through combining the former two options. In this work, we propose a novel semi-supervised post-hoc reranking method termed BLICEr (BLI with Cross-Encoder Reranking), applicable to any precalculated CLWE space, which improves their BLI capability. The key idea is to 'extract' cross-lingual lexical knowledge from mPLMs, and then combine it with the original CLWEs. This crucial step is done via 1) creating a word similarity dataset, comprising positive word pairs (i.e., true translations) and hard negative pairs induced from the original CLWE space, and then 2) fine-tuning an mPLM (e.g., mBERT or XLM-R) in a cross-encoder manner to predict the similarity scores. At inference, we 3) combine the similarity score from the original CLWE space with the score from the BLI-tuned cross-encoder. BLICEr establishes new state-of-the-art results on two standard BLI benchmarks spanning a wide spectrum of diverse languages: it substantially outperforms a series of strong baselines across the board. We also validate the robustness of BLICEr with different CLWEs.