title: A deep investigation of two poorly studied open clusters Haffner 22 and Melotte 71 in Gaia era

abstract: This paper presents a deep investigation of two open clusters, Haffner 22 and Melotte 71, using astrometric and photometric data from Gaia EDR3. We identified 382 and 597 most probable cluster members with membership probability higher than 50 percent. Mean proper motion in RA and DEC are estimated as -1.63 and 2.889 respectively for Haffner 22 and -2.398 and 4.210 for Melotte 71. A comparison of observed CMDs with theoretical isochrones leads to an age of 2.25 and 1.27 Gyr for these clusters. The distances 2.88 and 2.28 kpc based on parallax are comparable with the values derived by isochrone fitting method. Five and four blue straggler stars are identified as cluster members in Haffner 22 and Melotte 71 respectively. Based on the relative number of high velocity (binary) and single stars, we inferred binary fractions for both clusters. We found binary content is larger in core region. Mass function slope is in good agreement with the Salpeter's value while it is flat for Haffner 22. Evidence for the existence of mass segregation effect is observed in both clusters. Using the Galactic potential models, Galactic orbits are derived, indicating that both clusters follow a circular path around the Galactic center, evolving slowly.


title: Ordered community detection in directed networks

abstract: We develop a method to infer community structure in directed networks where the groups are ordered in a latent one-dimensional hierarchy that determines the preferred edge direction. Our nonparametric Bayesian approach is based on a modification of the stochastic block model (SBM), which can take advantage of rank alignment and coherence to produce parsimonious descriptions of networks that combine ordered hierarchies with arbitrary mixing patterns between groups. Since our model also includes directed degree correction, we can use it to distinguish non-local hierarchical structure from local in- and out-degree imbalance -- thus removing a source of conflation present in most ranking methods. We also demonstrate how we can reliably compare with the results obtained with the unordered SBM variant to determine whether a hierarchical ordering is statistically warranted in the first place. We illustrate the application of our method on a wide variety of empirical networks across several domains.

categories: cs.SI physics.data-an physics.soc-ph stat.ME


title: Hook formulae from Segre-MacPherson classes

abstract: Nakada's colored hook formula is a vast generalization of many important formulae in combinatorics, such as the classical hook length formula and the Peterson's formula for the number of reduced expressions of minuscule Weyl group elements. In this paper, we utilize cohomological properties of Segre-MacPherson classes of Schubert cells and varieties to prove a generalization of a cohomological version of Nakada's formula, in terms of smoothness properties of Schubert varieties. A key ingredient in the proof is the study of a decorated version of the Bruhat graph. Summing over weighted paths of this graph give the terms in the generalized Nakada's formula, and also provide algorithms to calculate structure constants of multiplications of Segre-MacPherson classes of Schubert cells. For simply laced Weyl groups, we also show the equality of `skew' and `straight' Nakada's formulae. This utilizes a criterion for smoothness in terms of excited diagrams of heaps of minuscule elements, which might be of independent interest.


title: Convergence of gradient descent for deep neural networks

abstract: This article presents a criterion for convergence of gradient descent to a global minimum, which is then used to show that gradient descent with proper initialization converges to a global minimum when training any feedforward neural network with smooth and strictly increasing activation functions, provided that the input dimension is greater than or equal to the number of data points. The main difference with prior work is that the width of the network can be a fixed number instead of growing as some multiple or power of the number of data points.


title: Perfectly Accurate Membership Inference by a Dishonest Central Server in Federated Learning

abstract: Federated Learning is expected to provide strong privacy guarantees, as only gradients or model parameters but no plain text training data is ever exchanged either between the clients or between the clients and the central server. In this paper, we challenge this claim by introducing a simple but still very effective membership inference attack algorithm, which relies only on a single training step. In contrast to the popular honest-but-curious model, we investigate a framework with a dishonest central server. Our strategy is applicable to models with ReLU activations and uses the properties of this activation function to achieve perfect accuracy. Empirical evaluation on visual classification tasks with MNIST, CIFAR10, CIFAR100 and CelebA datasets show that our method provides perfect accuracy in identifying one sample in a training set with thousands of samples. Occasional failures of our method lead us to discover duplicate images in the CIFAR100 and CelebA datasets.


title: Towards Interpretable Deep Reinforcement Learning Models via Inverse Reinforcement Learning

abstract: Artificial intelligence, particularly through recent advancements in deep learning, has achieved exceptional performances in many tasks in fields such as natural language processing and computer vision. In addition to desirable evaluation metrics, a high level of interpretability is often required for these models to be reliably utilized. Therefore, explanations that offer insight into the process by which a model maps its inputs onto its outputs are much sought-after. Unfortunately, the current black box nature of machine learning models is still an unresolved issue and this very nature prevents researchers from learning and providing explicative descriptions for a model's behavior and final predictions. In this work, we propose a novel framework utilizing Adversarial Inverse Reinforcement Learning that can provide global explanations for decisions made by a Reinforcement Learning model and capture intuitive tendencies that the model follows by summarizing the model's decision-making process.


title: Can in-home laboratories foster learning, self-efficacy, and motivation during the COVID-19 pandemic? -- A case study in two engineering programs

abstract: The COVID-19 pandemic has represented a challenge for higher education in terms to provide quality education despite the lockdown periods, the transformation of the in-person classes to virtual classes, and the demotivation and anxiety that are experimented by the students. Because the basis of engineering is the experimentation through hands-on activities and learning by doing, the lockdown periods and the temporary suspension of the in-person classes and laboratories have meant a problem for educators that try to teach and motivate the students despite the situation. In this context, this study presents an educational methodology based on Problem-Based Learning (PBL) and in-home laboratories in engineering. The methodology was carried out in two phases during 2020, in the academic programs of Industrial Engineering and Technology in Electronics with (n=44) students. The in-home laboratories were sent to the students as part of "kits" with the devices needed in each subject. Besides, due to the difficulties in monitoring the learning process, the students made videos and blogs as a strategy to reinforce their learning and evidence the progress in the courses. The outcomes of the methodology show mainly the following points: (1) An improvement of the academic performance and learning of the students in the courses. (2) A positive influence of the usage of in-home laboratories in motivation, self-efficacy, and reduction of anxiety. (3) Positive correlations between the usage of in-home laboratories, the blogs and videos, and the teacher's feedback for learning, motivation, and self-efficacy. Thus, these results evidence that other alternatives that gather the cognitive and affective learning domains can emerge from engineering to deal with the educational problems produced by the crisis periods.


title: Social adaptive behavior and oscillatory prevalence in an epidemic model on evolving random geometric graphs

abstract: Our recent experience with the COVID-19 pandemic amply shows that spatial effects like the mobility of agents and average interpersonal distance, together with adaptation of agents, are very important in deciding the outcome of epidemic dynamics. Structural and dynamical aspects of random geometric graphs are widely employed in describing processes with a spatial dependence, such as the spread of an airborne disease. In this work, we investigate the interplay between spatial factors, such as agent mobility and average interpersonal distance, and the adaptive responses of individuals to an ongoing epidemic within the framework of random geometric graphs. We show that such spatial factors, together with the adaptive behavior of the agents in response to the prevailing level of global epidemic, can give rise to oscillatory prevalence even with the classical SIR framework. We characterize in detail the effects of social adaptation and mobility of agents on the disease dynamics and obtain the threshold values. We also study the effects of delayed adaptive response of agents on epidemic dynamics. We show that a delay in executing non-pharmaceutical spatial mitigation strategies can amplify oscillatory prevalence tendencies and have non-linear effects on peak prevalence. This underscores the importance of early implementation of adaptive strategies coupled with the dissemination of real-time prevalence information to manage and control the epidemic effectively.


title: Crack-path selection in phase-field models for brittle fracture

abstract: This work presents a critical overview of the effects of different aspects of model formulation on crack path selection in quasi-static phase field fracture. We consider different evolution methods, mechanics formulations, fracture dissipation energy formulations, and forms of the irreversibility condition. The different model variants are implemented with common numerical methods based on staggered solution of the phase-field and mechanics sub-problems via FFT-based solvers. These methods mix standard approaches with novel elements, such as the use of bound-constrained conjugate gradients for the phase field sub-problem and a heuristic method for near-equilibrium evolution. We examine differences in crack paths between model variants in simple model systems and microstructures with randomly heterogeneous Young's modulus. Our results indicate that near-equilibrium evolution methods are preferable for quasi-static fracture of heterogeneous microstructures compared to minimization and time-dependent methods. In examining mechanics formulations, we find distinct effects of crack driving force and the model for contact implicit in phase field fracture. Our results favor the use of a strain-spectral decomposition for the crack driving force but not the contact model. Irreversibility condition and fracture dissipation energy formulation were also found to affect crack path selection, but systematic effects were difficult to deduce due to the overall sensitivity of crack selection within the heterogeneous microstructures. Our findings support the use of the AT1 model over the AT2 model and irreversibility of the phase field within a crack set rather than the entire domain. Sensitivity to these differences in formulation was reduced but not eliminated by reducing the crack width parameter $\ell$ relative to the size scale of the random microstructures.


title: Magnetic structure and properties of a vanthoffite mineral Na6Mn(SO4)4

abstract: A detailed analysis of the magnetic properties of a vanthoffite type mineral Na6Mn(SO4)4 basedon dc magnetization, low temperature neutron powder diffraction and theoretical calculations is reported. The mineral crystallizes in a monoclinic system with space group P21/c, where MnO6 octahedra are linked via SO4 tetrahedra. This gives rise to super-exchange interaction between two Mn2+ ions mediated by two nonmagnetic bridging anions and leads to an antiferromagnetic ordering below 3 K. The magnetic structure derived from neutron powder diffraction at 1.7 K depicts an antiferromagnetic spin arrangement in the bc plane of the crystal. The magnetic properties are modelled by numerical calculations using exact diagonalization technique, which fits the experimental results and provides antiferromagnetic ground state of Na6Mn(SO4)4.


title: Factorials and Legendre's three-square theorem: II

abstract: Let $\bar{S}$ denote the set of integers $n$ such that $n!$ cannot be written as a sum of three squares. Let $\bar{S}(n)$ denote $\bar{S} \cap [1, n]$. We establish an exact formula for $\bar{S}(2^k)$ and show that $\bar{S}(n) = 1/8*n + \mathcal{O}(\sqrt{n})$. We also list the lengths of gaps appearing in $\bar{S}$. We make use of the software package Walnut to establish these results.


title: Remember to correct the bias when using deep learning for regression!

abstract: When training deep learning models for least-squares regression, we cannot expect that the training error residuals of the final model, selected after a fixed training time or based on performance on a hold-out data set, sum to zero. This can introduce a systematic error that accumulates if we are interested in the total aggregated performance over many data points. We suggest to adjust the bias of the machine learning model after training as a default postprocessing step, which efficiently solves the problem. The severeness of the error accumulation and the effectiveness of the bias correction is demonstrated in exemplary experiments.


title: On sets with unit Hausdorff density in homogeneous groups

abstract: It is a longstanding conjecture that given a subset $E$ of a metric space, if $E$ has finite Hausdorff measure in dimension $\alpha\ge 0$ and $\mathscr{H}^\alpha\llcorner E$ has unit density almost everywhere, then $E$ is an $\alpha$-rectifiable set. We prove this conjecture under the assumption that the ambient metric space is a homogeneous group with a smooth-box norm.


title: Multiple phonon modes in Feynman path-integral variational polaron mobility

abstract: The Feynman path-integral variational approach to the polaron problem\cite{Feynman1955}, along with the associated FHIP linear-response mobility theory\cite{Feynman1962}, provides a computationally amenable method to predict the frequency-resolved temperature-dependent charge-carrier mobility, and other experimental observables in polar semiconductors. We show that the FHIP mobility theory predicts non-Drude transport behaviour, and shows remarkably good agreement with the recent diagrammatic Monte-Carlo mobility simulations of Mishchenko et al.\cite{Mishchenko2019} for the abstract Fr\"ohlich Hamiltonian. We extend this method to multiple phonon modes in the Fr\"ohlich model action. This enables a slightly better variational solution, as inferred from the resulting energy. We carry forward this extra complexity into the mobility theory, where it shows richer structure in the frequency and temperature dependent mobility, due to the different phonon modes activating at different energies. The method provides a computationally efficient and fully quantitative method of predicting polaron mobility and response in real materials.


title: Time-Delayed Reservoir Computing Based on Dual-Waveband Quantum-Dot Spin-Polarized Vertical Cavity Surface-Emitting Laser

abstract: In this work we present numerical results concerning a time-delayed reservoir computing scheme, where its single nonlinear node, is a Quantum-Dot spin polarized Vertical Cavity Surface-Emitting Laser (QD s-VCSEL). The proposed photonic neuromorphic scheme, exploits the complex temporal dynamics of multiple energy states present in quantum dot materials and uses emission from two discrete wavebands and two polarization states, so as to enhance computational efficiency. The benchmark task used for this architecture, is the equalization of a distorted 25Gbaud PAM-4 signal after 50Km of transmission at 1550nm. Results confirm that although typical ground-state emitting quantum-dot nodes offer limited performance, due to bandwidth limitations; by exploiting dual emission, we achieved a one-hundred-fold improvement in bit-error rate. This performance boost can pave the way for the infiltration of quantum-dot based devices in high-speed demanding neuromorphic driven applications.


title: Zero Shot Crosslingual Eye-Tracking Data Prediction using Multilingual Transformer Models

abstract: Eye tracking data during reading is a useful source of information to understand the cognitive processes that take place during language comprehension processes. Different languages account for different brain triggers , however there seems to be some uniform indicators. In this paper, we describe our submission to the CMCL 2022 shared task on predicting human reading patterns for multi-lingual dataset. Our model uses text representations from transformers and some hand engineered features with a regression layer on top to predict statistical measures of mean and standard deviation for 2 main eye-tracking features. We train an end to end model to extract meaningful information from different languages and test our model on two seperate datasets. We compare different transformer models and show ablation studies affecting model performance. Our final submission ranked 4th place for SubTask-1 and 1st place for SubTask-2 for the shared task.


title: Concept Evolution in Deep Learning Training: A Unified Interpretation Framework and Discoveries

abstract: We present ConceptEvo, a unified interpretation framework for deep neural networks (DNNs) that reveals the inception and evolution of learned concepts during training. Our work addresses a critical gap in DNN interpretation research, as existing methods primarily focus on post-training interpretation. ConceptEvo introduces two novel technical contributions: (1) an algorithm that generates a unified semantic space, enabling side-by-side comparison of different models during training, and (2) an algorithm that discovers and quantifies important concept evolutions for class predictions. Through a large-scale human evaluation and quantitative experiments, we demonstrate that ConceptEvo successfully identifies concept evolutions across different models, which are not only comprehensible to humans but also crucial for class predictions. ConceptEvo is applicable to both modern DNN architectures, such as ConvNeXt, and classic DNNs, such as VGGs and InceptionV3.


title: Differentially Private All-Pairs Shortest Path Distances: Improved Algorithms and Lower Bounds

abstract: We study the problem of releasing the weights of all-pair shortest paths in a weighted undirected graph with differential privacy (DP). In this setting, the underlying graph is fixed and two graphs are neighbors if their edge weights differ by at most $1$ in the $\ell_1$-distance. We give an $\epsilon$-DP algorithm with additive error $\tilde{O}(n^{2/3} / \epsilon)$ and an $(\epsilon, \delta)$-DP algorithm with additive error $\tilde{O}(\sqrt{n} / \epsilon)$ where $n$ denotes the number of vertices. This positively answers a question of Sealfon (PODS'16), who asked whether a $o(n)$-error algorithm exists. We also show that an additive error of $\Omega(n^{1/6})$ is necessary for any sufficiently small $\epsilon, \delta > 0$. Finally, we consider a relaxed setting where a multiplicative approximation is allowed. We show that, with a multiplicative approximation factor $k$, %$2k - 1$, the additive error can be reduced to $\tilde{O}\left(n^{1/2 + O(1/k)} / \epsilon\right)$ in the $\epsilon$-DP case and $\tilde{O}(n^{1/3 + O(1/k)} / \epsilon)$ in the $(\epsilon, \delta)$-DP case, respectively.


title: A Coronal Mass Ejection and Magnetic Ejecta Observed In Situ by STEREO-A and Wind at 55$^\circ$ Angular Separation

abstract: We present an analysis of {\it in situ} and remote-sensing measurements of a coronal mass ejection (CME) that erupted on 2021 February 20 and impacted both the Solar TErrestrial RElations Observatory (STEREO)-A and the {\it Wind} spacecraft, which were separated longitudinally by 55$^\circ$. Measurements on 2021 February 24 at both spacecraft are consistent with the passage of a magnetic ejecta (ME), making this one of the widest reported multi-spacecraft ME detections. The CME is associated with a low-inclined and wide filament eruption from the Sun's southern hemisphere, which propagates between STEREO-A and {\it Wind} around E34. At STEREO-A, the measurements indicate the passage of a moderately fast ($\sim 425$~km\,s$^{-1}$) shock-driving ME, occurring 2--3 days after the end of a high speed stream (HSS). At {\it Wind}, the measurements show a faster ($\sim 490$~km\,s$^{-1}$) and much shorter ME, not preceded by a shock nor a sheath, and occurring inside the back portion of the HSS. The ME orientation measured at both spacecraft is consistent with a passage close to the legs of a curved flux rope. The short duration of the ME observed at {\it Wind} and the difference in the suprathermal electron pitch-angle data between the two spacecraft are the only results that do not satisfy common expectations. We discuss the consequence of these measurements on our understanding of the CME shape and extent and the lack of clear signatures of the interaction between the CME and the HSS.


title: A Sequential Quadratic Programming Approach to the Solution of Open-Loop Generalized Nash Equilibria

abstract: Dynamic games can be an effective approach to modeling interactive behavior between multiple non-cooperative agents and they provide a theoretical framework for simultaneous prediction and control in such scenarios. In this work, we propose a numerical method for the solution of local generalized Nash equilibria (GNE) for the class of open-loop general-sum dynamic games for agents with nonlinear dynamics and constraints. In particular, we formulate a sequential quadratic programming (SQP) approach which requires only the solution of a single convex quadratic program at each iteration. Central to the robustness of our approach is a non-monotonic line search method and a novel merit function for SQP step acceptance. We show that our method achieves linear convergence in the neighborhood of local GNE and we derive an update rule for the merit function which helps to improve convergence from a larger set of initial conditions. We demonstrate the effectiveness of the algorithm in the context of car racing, where we show up to 32\% improvement of success rate when comparing against a state-of-the-art solution approach for dynamic games. \url{https://github.com/zhu-edward/DGSQP}.


title: A phase-field model for ferroelectrics with general kinetics. Part I: Model formulation

abstract: When subjected to electro-mechanical loading, ferroelectrics see their polarization evolve through the nucleation and evolution of domains. Existing mesoscale phase-field models for ferroelectrics are typically based on a gradient-descent law for the evolution of the order parameter. While this implicitly assumes that domain walls evolve with linear kinetics, experiments instead indicate that domain wall kinetics is nonlinear. This, in turn, is an important feature for the modeling of rate-dependent effects in polarization switching. We propose a new multiple-phase-field model for ferroelectrics, which permits domain wall motion with nonlinear kinetics, with applications in other solid-solid phase transformation problems. By means of analytical traveling wave solutions, we characterize the interfacial properties (energy and width) and the interface kinetics of straight domain walls, as furnished by the general kinetics model, and compare them to those of the classical Allen--Cahn model. We show that the proposed model propagates domain walls with arbitrarily chosen nonlinear kinetic relations, which can be tuned to differ for the different types of domain walls in accordance with experimental evidence.


title: Realization of the topological Hopf term in two-dimensional lattice models

abstract: It is known that a two-dimensional spin system can acquire a topological Hopf term by coupling to massless Dirac fermions whose energy spectrum has a single cone. But it is challenging to realize the Hopf term in condensed matter physics due to the fermion-doubling in the low-energy spectrum. In this work we propose a scenario to realize the Hopf term in lattice models. The central aim is tuning the coupling between the spins and the Dirac fermions such that the topological terms contributed by the two cones do not cancel each other. To this end, we consider $p_x$ and $p_y$ orbitals for the Dirac fermions on the honeycomb lattice such that there are totally four bands. By utilizing the orbital degrees of freedom, a $\theta=2\pi$ Hopf term is successfully generated for the spin system after integrating out the Dirac fermions. If the fermions have a small gap $m_0$ or if the spin-orbit coupling is considered, then $\theta$ is no longer quantized, but it may flow to multiple of $2\pi$ under renormalization. The ground state and the physical response of a spin system having the Hopf term are discussed.


title: On Uncertainty, Tempering, and Data Augmentation in Bayesian Classification

abstract: Aleatoric uncertainty captures the inherent randomness of the data, such as measurement noise. In Bayesian regression, we often use a Gaussian observation model, where we control the level of aleatoric uncertainty with a noise variance parameter. By contrast, for Bayesian classification we use a categorical distribution with no mechanism to represent our beliefs about aleatoric uncertainty. Our work shows that explicitly accounting for aleatoric uncertainty significantly improves the performance of Bayesian neural networks. We note that many standard benchmarks, such as CIFAR, have essentially no aleatoric uncertainty. Moreover, we show data augmentation in approximate inference has the effect of softening the likelihood, leading to underconfidence and profoundly misrepresenting our honest beliefs about aleatoric uncertainty. Accordingly, we find that a cold posterior, tempered by a power greater than one, often more honestly reflects our beliefs about aleatoric uncertainty than no tempering -- providing an explicit link between data augmentation and cold posteriors. We show that we can match or exceed the performance of posterior tempering by using a Dirichlet observation model, where we explicitly control the level of aleatoric uncertainty, without any need for tempering.


title: RFNet-4D++: Joint Object Reconstruction and Flow Estimation from 4D Point Clouds with Cross-Attention Spatio-Temporal Features

abstract: Object reconstruction from 3D point clouds has been a long-standing research problem in computer vision and computer graphics, and achieved impressive progress. However, reconstruction from time-varying point clouds (a.k.a. 4D point clouds) is generally overlooked. In this paper, we propose a new network architecture, namely RFNet-4D++, that jointly reconstructs objects and their motion flows from 4D point clouds. The key insight is simultaneously performing both tasks via learning of spatial and temporal features from a sequence of point clouds can leverage individual tasks, leading to improved overall performance. To prove this ability, we design a temporal vector field learning module using an unsupervised learning approach for flow estimation task, leveraged by supervised learning of spatial structures for object reconstruction. Extensive experiments and analyses on benchmark datasets validated the effectiveness and efficiency of our method. As shown in experimental results, our method achieves state-of-the-art performance on both flow estimation and object reconstruction while performing much faster than existing methods in both training and inference. Our code and data are available at https://github.com/hkust-vgd/RFNet-4D


title: Ferromagnetism and doublon localization in a Wannier-Hubbard chain

abstract: We derive a "Wannier-Hubbard" model consisting of an array of overlapping atomic orbitals interacting via a local Coulomb interaction. Transforming to an orthogonal Wannier basis set, the resulting Hamiltonian displays long range hopping and interactions, with new terms such as correlated hopping and ferromagnetic direct exchange, among others. We numerically study the one-dimensional version of the model at half-filling using the density matrix renormalization group (DMRG) method, unveiling a rich phase diagram as a function of the interaction $U$ and the overlap $s$ with metallic, and ferromagnetic phases, separated by a ferrimagnetic region. Our results indicate a path toward understanding new emergent phases under pressure and beyond standard model Hamiltonians.


title: Two-Stage Robust Optimization with Decision Dependent Uncertainty

abstract: The type of decision dependent uncertainties (DDUs) imposes a great challenge in decision making, while existing methodologies are not sufficient to support many real practices. In this paper, we present a systematic study to handle this challenge in two-stage robust optimization~(RO). Our main contributions include three sophisticated variants of column-and-constraint generation method to exactly compute DDU-based two-stage RO. By a novel application of core concepts of linear programming, we provide rigorous analyses on their computational behaviors. Interestingly, in terms of the iteration complexity of those algorithms, DDU-based two-stage RO is not more demanding than its decision independent uncertainty (DIU) based counterpart. It is worth highlighting a counterintuitive discovery that converting a DIU set into a DDU set by making use of "deep knowledge" and then computing the resulting DDU-based formulation may lead to a significant improvement. Indeed, as shown in this paper, in addition to capturing the actual dependence existing in the real world, DDU is a powerful and flexible tool to represent and leverage analytical properties or simply domain expertise to achieve a strong solution capacity. So, we believe it will open a new direction to solve large-scale DIU- or DDU-based RO. Other important results include basic structural properties for two-stage RO, an approximation scheme to deal with mixed integer recourse, and a couple of enhancement techniques for the developed algorithms, as well as an organized numerical study to help us appreciate all algorithms and enhancement techniques' computational performances.


title: Optimal Control of ensembles of dynamical systems

abstract: In this paper we consider the problem of the optimal control of an ensemble of affine-control systems. After proving the well-posedness of the minimization problem under examination, we establish a $\Gamma$-convergence result that allows us to substitute the original (and usually infinite) ensemble with a sequence of finite increasing-in-size sub-ensembles. The solutions of the optimal control problems involving these sub-ensembles provide approximations in the $L^2$-strong topology of the minimizers of the original problem. Using again a $\Gamma$-convergence argument, we manage to derive a Maximum Principle for ensemble optimal control problems with end-point cost. Moreover, in the case of finite sub-ensembles, we can address the minimization of the related cost through numerical schemes. In particular, we propose an algorithm that consists of a subspace projection of the gradient field induced on the space of admissible controls by the approximating cost functional. In addition, we consider an iterative method based on the Pontryagin Maximum Principle. Finally, we test the algorithms on an ensemble of linear systems in $\mathbb{R}^2$.


title: Tailored XZZX codes for biased noise

abstract: Quantum error correction (QEC) for generic errors is challenging due to the demanding threshold and resource requirements. Interestingly, when physical noise is biased, we can tailor our QEC schemes to the noise to improve performance. Here we study a family of codes having XZZX-type stabilizer generators, including a set of cyclic codes generalized from the five-qubit code and a set of topological codes that we call generalized toric codes (GTCs). We show that these XZZX codes are highly qubit efficient if tailored to biased noise. To characterize the code performance, we use the notion of effective distance, which generalizes code distance to the case of biased noise and constitutes a proxy for the logical failure rate. We find that the XZZX codes can achieve a favorable resource scaling by this metric under biased noise. We also show that the XZZX codes have remarkably high thresholds that reach what is achievable by random codes, and furthermore they can be efficiently decoded using matching decoders. Finally, by adding only one flag qubit, the XZZX codes can realize fault-tolerant QEC while preserving their large effective distance. In combination, our results show that tailored XZZX codes give a resource-efficient scheme for fault-tolerant QEC against biased noise.


title: Speculative Decoding: Exploiting Speculative Execution for Accelerating Seq2seq Generation

abstract: We propose Speculative Decoding (SpecDec), for the first time ever, to formally study exploiting the idea of speculative execution to accelerate autoregressive (AR) decoding. Speculative Decoding has two innovations: Spec-Drafter -- an independent model specially optimized for efficient and accurate drafting -- and Spec-Verification -- a reliable method for verifying the drafted tokens efficiently in the decoding paradigm. Experimental results on various seq2seq tasks including machine translation and abstractive summarization show our approach can achieve around $5\times$ speedup for the popular Transformer architectures with comparable generation quality to beam search decoding, refreshing the impression that the draft-then-verify paradigm introduces only $1.4\times$$\sim$$2\times$ speedup. In addition to the remarkable speedup, we also demonstrate 3 additional advantages of SpecDec, revealing its practical value for accelerating generative models in real-world applications. Our models and codes are available at https://github.com/hemingkx/SpecDec.


title: Distributed quantum error correction for chip-level catastrophic errors

abstract: Quantum error correction holds the key to scaling up quantum computers. Cosmic ray events severely impact the operation of a quantum computer by causing chip-level catastrophic errors, essentially erasing the information encoded in a chip. Here, we present a distributed error correction scheme to combat the devastating effect of such events by introducing an additional layer of quantum erasure error correcting code across separate chips. We show that our scheme is fault tolerant against chip-level catastrophic errors and discuss its experimental implementation using superconducting qubits with microwave links. Our analysis shows that in state-of-the-art experiments, it is possible to suppress the rate of these errors from 1 per 10 seconds to less than 1 per month.


title: Semantics between customers and providers: The relation between product descriptions, reviews, and customer satisfaction in E-commerce

abstract: In social commerce, users dialogue with each other on the topics related to the providers' products. However, the language customers use may vary from the language vendors use on their e-commerce websites and product descriptions. This situation can lead to possible misunderstandings in the social dialogue between customers, and incidental costs in the dialogue between customers and vendors. One possible reason for this difference is that words used by customers may have different meanings compared to those used by product description writers. We present a novel approach to measure this potential lexical-semantic gap for various e-commerce domains using an information-theoretical approach based on a large corpus of user reviews and product descriptions. Additionally, we use neural word embeddings to identify words with the highest semantic drift between reviews and descriptions as a tool to construct a ground truth for the task. We found that low levels of lexical-semantic gap are related to better customer satisfaction. Besides, this work is a step towards a better understanding of the effect of the use of language in e-commerce and social commerce. Potential applications of this technology could lead to better communication between customers and improvements in customer satisfaction, services, and revenue. Furthermore, this study opens up perspectives for applications in other domains with relationships beyond client-vendor, such as citizen-government and patient-healthcare system.


title: Foveation-based Deep Video Compression without Motion Search

abstract: The requirements of much larger file sizes, different storage formats, and immersive viewing conditions of VR pose significant challenges to the goals of acquiring, transmitting, compressing, and displaying high-quality VR content. At the same time, the great potential of deep learning to advance progress on the video compression problem has driven a significant research effort. Because of the high bandwidth requirements of VR, there has also been significant interest in the use of space-variant, foveated compression protocols. We have integrated these techniques to create an end-to-end deep learning video compression framework. A feature of our new compression model is that it dispenses with the need for expensive search-based motion prediction computations. This is accomplished by exploiting statistical regularities inherent in video motion expressed by displaced frame differences. Foveation protocols are desirable since only a small portion of a video viewed in VR may be visible as a user gazes in any given direction. Moreover, even within a current field of view (FOV), the resolution of retinal neurons rapidly decreases with distance (eccentricity) from the projected point of gaze. In our learning based approach, we implement foveation by introducing a Foveation Generator Unit (FGU) that generates foveation masks which direct the allocation of bits, significantly increasing compression efficiency while making it possible to retain an impression of little to no additional visual loss given an appropriate viewing geometry. Our experiment results reveal that our new compression model, which we call the Foveated MOtionless VIdeo Codec (Foveated MOVI-Codec), is able to efficiently compress videos without computing motion, while outperforming foveated version of both H.264 and H.265 on the widely used UVG dataset and on the HEVC Standard Class B Test Sequences.


title: Analytical insight into dark matter subhalo boost factors for Sommerfeld-enhanced $s$- and $p$-wave $\gamma$-ray signals

abstract: As searches for thermal and self-annihilating dark matter (DM) intensify, it becomes crucial to include as many relevant physical processes and ingredients as possible to refine signal predictions, in particular those which directly relate to the intimate properties of DM. We investigate the combined impact of DM subhalos and of the (velocity-dependent) Sommerfeld enhancement of the annihilation cross section. Both features are expected to play an important role in searches for thermal DM particle candidates with masses around or beyond TeV, or in scenarios with a light dark sector. We provide a detailed analytical description of the phenomena at play, and show how they scale with the subhalo masses and the main Sommerfeld parameters. We derive approximate analytical expressions that can be used to estimate the overall boost factors resulting from these combined effects, from which the intricate phenomenology can be better understood. DM subhalos lead to an increase of the Sommerfeld effect by several orders of magnitude (for both $s$- and $p$-wave annihilation processes), especially on resonances, which makes them critical to get sensible gamma-ray signal predictions for typical targets of different masses (from dwarf galaxies to galaxy clusters).

categories: astro-ph.CO astro-ph.GA astro-ph.HE hep-ph


title: On the impact of dimensionally-consistent and physics-based inner products for POD-Galerkin and least-squares model reduction of compressible flows

abstract: Model reduction of the compressible Euler equations based on proper orthogonal decomposition (POD) and Galerkin orthogonality or least-squares residual minimization requires the selection of inner product spaces in which to perform projections and measure norms. The most popular choice is the vector-valued L2({\Omega}) inner product space. This choice, however, yields dimensionally-inconsistent reduced-order model (ROM) formulations which often lack robustness. In this work, we try to address this weakness by studying a set of dimensionally-consistent inner products with application to the compressible Euler equations. First, we demonstrate that non-dimensional inner products have a positive impact on both POD and Galerkin/least-squares ROMs. Second, we further demonstrate that physics-based inner products based on entropy principles result in drastically more accurate and robust ROM formulations than those based on non-dimensional L2({\Omega}) inner products.As test cases, we consider the following well-known problems: the one-dimensional Sod shock tube, the two-dimensional Kelvin-Helmholtz instability and two-dimensional homogeneous isotropic turbulence.


title: Numerical Study of Cosserat Fluid-Structure Interaction in a Monolithic Eulerian Framework

abstract: We propose a monolithic Eulerian variational formulation in non-classical sense of continuum description for the analysis of micro-viscosity parameters at micro-structural level. In this respect, Cosesrat fluid-structure interaction CFSI phenomena is taken into account by considering micro-rotational degrees of freedom of the particles. The governing equations and variational formulation for CFSI problem are presented. The space and time domains are discretized by the finite element method and semi-implicit scheme. The model is implemented and evaluated using FreeFem++. The present model is analyzed by computing a well known benchmark problem FLUSTRUK-FSI-3*, where the flow around a flag attached with cylinder is considered for numerical test. The obtained results suggest that the amplitude of oscillations and micro-rotational viscosity varies inversely and micro-viscosity parameter exhibit a significant effect on micro-rotation field as compare to velocity field.


title: S-OPT: A Points Selection Algorithm for Hyper-Reduction in Reduced Order Models

abstract: While projection-based reduced order models can reduce the dimension of full order solutions, the resulting reduced models may still contain terms that scale with the full order dimension. Hyper-reduction techniques are sampling-based methods that further reduce this computational complexity by approximating such terms with a much smaller dimension. The goal of this work is to introduce a points selection algorithm developed by Shin and Xiu [SIAM J. Sci. Comput., 38 (2016), pp. A385--A411], as a hyper-reduction method. The selection algorithm is originally proposed as a stochastic collocation method for uncertainty quantification. Since the algorithm aims at maximizing a quantity S that measures both the column orthogonality and the determinant, we refer to the algorithm as S-OPT. Numerical examples are provided to demonstrate the performance of S-OPT and to compare its performance with an over-sampled Discrete Empirical Interpolation (DEIM) algorithm. We found that using the S-OPT algorithm is shown to predict the full order solutions with higher accuracy for a given number of indices.


title: Crowdsourcing Creative Work

abstract: This article-based doctoral thesis explores the stakeholder perspectives and experiences of crowdsourced creative work on two of the leading crowdsourcing platforms. The thesis has two parts. In the first part, we explore creative work from the perspective of the crowd worker. In the second part, we explore and study the requester's perspective in different contexts and several case studies. The research is exploratory and we contribute empirical insights using survey-based and artefact-based approaches common in the field of Human-Computer Interaction (HCI). In the former approach, we explore the key issues that may limit creative work on paid crowdsourcing platforms. In the latter approach, we create computational artefacts to elicit authentic experiences from both crowd workers and requesters of crowdsourced creative work. The thesis contributes a classification of crowd workers into five archetypal profiles, based on the crowd workers' demographics, disposition, and preferences for creative work. We propose a three-part classification of creative work on crowdsourcing platforms: creative tasks, creativity tests, and creativity judgements (also referred to as creative feedback). The thesis further investigates the emerging research topic of how requesters can be supported in interpreting and evaluating complex creative work. Last, we discuss the design implications for research and practice and contribute a vision of creative work on future crowdsourcing platforms with the aim of empowering crowd workers and fostering an ecosystem around tailored platforms for creative microwork. Keywords: creative work, creativity, creativity support tools, crowdsourcing


title: Comment on A novel two-dimensional boron carbon nitride (BCN) monolayer: A first-principles insight [J. Appl. Phys. 2021, 130, 114301]

abstract: Recently, Bafekry et al. [J. Appl. Phys. 130, 114301(2021)] reported their density functional theory (DFT) results on the structural, phonon dispersion, elastic constants and electronic properties of a BCN monolayer. The aforementioned theoretical work however includes erroneous results and discussions, as will be explained in the following.


title: An Artificial Intelligence Browser Architecture (AIBA) For Our Kind and Others: A Voice Name System Speech implementation with two warrants, Wake Neutrality and Value Preservation of Personally Identifiable Information

abstract: Conversational commerce, first pioneered by Apple's Siri, is the first of may applications based on always-on artificial intelligence systems that decide on its own when to interact with the environment, potentially collecting 24x7 longitudinal training data that is often Personally Identifiable Information (PII). A large body of scholarly papers, on the order of a million according to a simple Google Scholar search, suggests that the treatment of many health conditions, including COVID-19 and dementia, can be vastly improved by this data if the dataset is large enough as it has happened in other domains (e.g. GPT3). In contrast, current dominant systems are closed garden solutions without wake neutrality and that can't fully exploit the PII data they have because of IRB and Cohues-type constraints. We present a voice browser-and-server architecture that aims to address these two limitations by offering wake neutrality and the possibility to handle PII aiming to maximize its value. We have implemented this browser for the collection of speech samples and have successfully demonstrated it can capture over 200.000 samples of COVID-19 coughs. The architecture we propose is designed so it can grow beyond our kind into other domains such as collecting sound samples from vehicles, video images from nature, ingestible robotics, multi-modal signals (EEG, EKG,...), or even interacting with other kinds such as dogs and cats.


title: Ab initio Approaches to High Entropy Alloys: A Comparison of CPA, SQS, and Supercell Methods

abstract: We present a comparative study of different modeling approaches to the electronic properties of the $\textrm{Hf}_{0.05}\textrm{Nb}_{0.05}\textrm{Ta}_{0.8}\textrm{Ti}_{0.05}\textrm{Zr}_{0.05}$ high entropy alloy. Common to our modeling is the methodology to compute the one-particle Green's function in the framework of density functional theory. We demonstrate that the special quasi-random structures modeling and the supercell, i.e. the locally self-consistent multiple-scatering methods provide very similar results for the ground state properties such as the spectral function (density of states) and the equilibrium lattice parameter. To reconcile the multiple-scattering single-site coherent potential approximation with the real space supercell methods, we included the effect of screening of the net charges of the alloy components. Based on the analysis of the total energy and spectral functions computed within the density functional theory, we found no signature for the long-range or local magnetic moments formation in the $\textrm{Hf}_{0.05}\textrm{Nb}_{0.05}\textrm{Ta}_{0.8}\textrm{Ti}_{0.05}\textrm{Zr}_{0.05}$ high entropy alloy, instead we find possible superconductivity below $\sim 9$K.


title: Forensic Analysis and Localization of Multiply Compressed MP3 Audio Using Transformers

abstract: Audio signals are often stored and transmitted in compressed formats. Among the many available audio compression schemes, MPEG-1 Audio Layer III (MP3) is very popular and widely used. Since MP3 is lossy it leaves characteristic traces in the compressed audio which can be used forensically to expose the past history of an audio file. In this paper, we consider the scenario of audio signal manipulation done by temporal splicing of compressed and uncompressed audio signals. We propose a method to find the temporal location of the splices based on transformer networks. Our method identifies which temporal portions of a audio signal have undergone single or multiple compression at the temporal frame level, which is the smallest temporal unit of MP3 compression. We tested our method on a dataset of 486,743 MP3 audio clips. Our method achieved higher performance and demonstrated robustness with respect to different MP3 data when compared with existing methods.


title: The Role of the Neutrino Form Factors in the Energy Loss Rates of Pair Annihilation Process

abstract: The stellar energy loss rates due to the production of the neutrino pair process $e^+e^- \rightarrow (W, Z, \gamma) \rightarrow \nu_e \bar{\nu_e}$ are calculated in the minimal extension of Standard Model with electromagnetic properties of Dirac neutrinos which takes the account of the contribution of the neutrino charge radius, anapole moment and dipole moments. We have shown that the contribution of the electron neutrino's dipole moment is small compared with that of the charge radius. The obtained results are also considered with results obtained using the Standard Model.


title: The Signal-to-Noise Ratio for Photon Counting After Photometric Corrections

abstract: Photon counting is a mode of processing astronomical observations of low-signal targets that have been observed using an electron-multiplying charge-coupled device (EMCCD). In photon counting, the EMCCD amplifies the signal, and a thresholding technique effectively selects for the signal electrons while drastically reducing relative noise sources. Photometric corrections have been developed which result in the extraction of a more accurate estimate of the signal of electrons, and the Nancy Grace Roman Telescope will utilize a theoretical expression for the signal-to-noise ratio (SNR) given these corrections based on well-calibrated noise parameters to plan observations taken by its coronagraph instrument. I derive here analytic expressions for the SNR for the method of photon counting, before and after these photometric corrections have been applied.


title: Generative Spoken Dialogue Language Modeling

abstract: We introduce dGSLM, the first "textless" model able to generate audio samples of naturalistic spoken dialogues. It uses recent work on unsupervised spoken unit discovery coupled with a dual-tower transformer architecture with cross-attention trained on 2000 hours of two-channel raw conversational audio (Fisher dataset) without any text or labels. We show that our model is able to generate speech, laughter and other paralinguistic signals in the two channels simultaneously and reproduces more naturalistic and fluid turn-taking compared to a text-based cascaded model.


title: Trigonometric K-matrices for finite-dimensional representations of quantum affine algebras

abstract: Let $\mathfrak{g}$ be a complex simple Lie algebra and $U_q\hat{\mathfrak{g}}$ the corresponding quantum affine algebra. We prove that every irreducible finite-dimensional $U_q\hat{\mathfrak{g}}$-module gives rise to a family of trigonometric K-matrices, i.e., rational solutions of Cherednik's generalized reflection equation. The result depends upon the choice of a quantum affine symmetric pair $U_q\mathfrak{k}\subset U_q\hat{\mathfrak{g}}$. It hinges on the construction of universal K-matrices for arbitrary quantum symmetric pairs, and relies on proving that every irreducible $U_q\hat{\mathfrak{g}}$-module is generically irreducible under restriction to $U_q{\mathfrak{k}}$. In the case of small modules and Kirillov-Reshetikhin modules, we obtain new solutions of the standard and the transposed reflection equations.


title: The CARMENES search for exoplanets around M dwarfs: Two Saturn-mass planets orbiting active stars

abstract: The CARMENES radial-velocity survey is currently searching for planets in a sample of 387 M dwarfs. Here we report on two Saturn-mass planets orbiting TYC 2187-512-1 ($M_\star = 0.50 M_\odot$) and TZ Ari ($M_\star = 0.15 M_\odot$), respectively. We obtained supplementary photometric time series, which we use along with spectroscopic information to determine the rotation periods of the two stars. In both cases, the radial velocities also show strong modulations at the respective rotation period. We thus modeled the radial velocities as a Keplerian orbit plus a Gaussian process representing the stellar variability. TYC 2187-512-1 is found to harbor a planet with a minimum mass of 0.33 $M_{\rm Jup}$ in a near-circular 692-day orbit. The companion of TZ Ari has a minimum mass of 0.21 $M_{\rm Jup}$, orbital period of 771 d, and orbital eccentricity of 0.46. We provide an overview of all known giant planets in the CARMENES sample, from which we infer an occurrence rate of giant planets orbiting M dwarfs with periods up to 2 years in the range between 2% to 6%. TZ Ari b is only the second giant planet discovered orbiting a host with mass less than 0.3 $M_\odot$. These objects occupy an extreme location in the planet mass versus host mass plane. It is difficult to explain their formation in core-accretion scenarios, so they may possibly have been formed through a disk fragmentation process.


title: Fast, Accurate and Memory-Efficient Partial Permutation Synchronization

abstract: Previous partial permutation synchronization (PPS) algorithms, which are commonly used for multi-object matching, often involve computation-intensive and memory-demanding matrix operations. These operations become intractable for large scale structure-from-motion datasets. For pure permutation synchronization, the recent Cycle-Edge Message Passing (CEMP) framework suggests a memory-efficient and fast solution. Here we overcome the restriction of CEMP to compact groups and propose an improved algorithm, CEMP-Partial, for estimating the corruption levels of the observed partial permutations. It allows us to subsequently implement a nonconvex weighted projected power method without the need of spectral initialization. The resulting new PPS algorithm, MatchFAME (Fast, Accurate and Memory-Efficient Matching), only involves sparse matrix operations, and thus enjoys lower time and space complexities in comparison to previous PPS algorithms. We prove that under adversarial corruption, though without additive noise and with certain assumptions, CEMP-Partial is able to exactly classify corrupted and clean partial permutations. We demonstrate the state-of-the-art accuracy, speed and memory efficiency of our method on both synthetic and real datasets.


title: An Improved Lightweight YOLOv5 Model Based on Attention Mechanism for Face Mask Detection

abstract: Coronavirus 2019 has brought severe challenges to social stability and public health worldwide. One effective way of curbing the epidemic is to require people to wear masks in public places and monitor mask-wearing states by utilizing suitable automatic detectors. However, existing deep learning based models struggle to simultaneously achieve the requirements of both high precision and real-time performance. To solve this problem, we propose an improved lightweight face mask detector based on YOLOv5, which can achieve an excellent balance of precision and speed. Firstly, a novel backbone ShuffleCANet that combines ShuffleNetV2 network with Coordinate Attention mechanism is proposed as the backbone. Afterwards, an efficient path aggression network BiFPN is applied as the feature fusion neck. Furthermore, the localization loss is replaced with alpha-CIoU in model training phase to obtain higher-quality anchors. Some valuable strategies such as data augmentation, adaptive image scaling, and anchor cluster operation are also utilized. Experimental results on AIZOO face mask dataset show the superiority of the proposed model. Compared with the original YOLOv5, the proposed model increases the inference speed by 28.3% while still improving the precision by 0.58%. It achieves the best mean average precision of 95.2% compared with other seven existing models, which is 4.4% higher than the baseline.


title: AdaMixer: A Fast-Converging Query-Based Object Detector

abstract: Traditional object detectors employ the dense paradigm of scanning over locations and scales in an image. The recent query-based object detectors break this convention by decoding image features with a set of learnable queries. However, this paradigm still suffers from slow convergence, limited performance, and design complexity of extra networks between backbone and decoder. In this paper, we find that the key to these issues is the adaptability of decoders for casting queries to varying objects. Accordingly, we propose a fast-converging query-based detector, named AdaMixer, by improving the adaptability of query-based decoding processes in two aspects. First, each query adaptively samples features over space and scales based on estimated offsets, which allows AdaMixer to efficiently attend to the coherent regions of objects. Then, we dynamically decode these sampled features with an adaptive MLP-Mixer under the guidance of each query. Thanks to these two critical designs, AdaMixer enjoys architectural simplicity without requiring dense attentional encoders or explicit pyramid networks. On the challenging MS COCO benchmark, AdaMixer with ResNet-50 as the backbone, with 12 training epochs, reaches up to 45.0 AP on the validation set along with 27.9 APs in detecting small objects. With the longer training scheme, AdaMixer with ResNeXt-101-DCN and Swin-S reaches 49.5 and 51.3 AP. Our work sheds light on a simple, accurate, and fast converging architecture for query-based object detectors. The code is made available at https://github.com/MCG-NJU/AdaMixer


title: Hadronic vacuum polarization contribution to the muon $g-2$ in holographic QCD

abstract: We evaluate the leading-order hadronic vacuum polarization contribution to the anomalous magnetic moment of the muon with two light flavors in minimal hard-wall and soft-wall holographic QCD models, as well as in simple generalizations thereof, and compare with the rather precise results available from dispersive and lattice approaches. While holographic QCD cannot be expected to shed light on the existing small discrepancies between the latter, this comparison in turn provides useful information on the holographic models, which have been used to evaluate hadronic light-by-light contributions where errors in data-driven and lattice approaches are more sizable. In particular, in the hard-wall model that has recently been used to implement the Melnikov-Vainshtein short-distance constraint on hadronic light-by-light contributions, a matching of the hadronic vacuum polarization to the data-driven approach points to the same correction of parameters that has been proposed recently in order to account for next-to-leading order effects.


title: High dynamic range electro-optic dual-comb interrogation of optomechanical sensors

abstract: An interleaved, chirped electro-optic dual comb system is demonstrated for rapid, high dynamic range measurements of cavity optomechanical sensors. This approach allows for the cavity displacements to be interrogated at measurement times as fast as 10 {\mu}s over ranges far larger than can be achieved with alternative methods. While the performance of this novel readout approach is evaluated with an optomechanical accelerometer, this method is applicable to a wide range of applications including temperature, pressure, and humidity sensing as well as acoustics and molecular spectroscopy.


title: Vector Bessel beams: general classification and scattering simulations

abstract: Apart from a lot of fundamental interest, vector Bessel beams are widely used in optical manipulation, material processing, and imaging. However, the existing description of such beams remains fragmentary, especially when their scattering by small particles is considered. We propose a new general classification of all existing vortex Bessel beam types in an isotropic medium based on the superposition of transverse Hertz vector potentials. This theoretical framework contains duality and coordinate rotations as elementary matrix operations and naturally describes all relations between various beam types. This leads to various bases for Bessel beams and uncovers the novel beam type with circularly symmetric energy density. We also discuss quadratic functionals of the fields (such as the energy density and Poynting vector) and derive orthogonality relations between various beam types. Altogether, it provides a comprehensive reference of all properties of Bessel beams that may be relevant for applications. Next we generalize the formalism of the Mueller scattering matrices to arbitrary Bessel beams accounting for their vorticity. Finally, we implement these beams in the ADDA code - an open-source parallel implementation of the discrete dipole approximation. This enables easy and efficient simulation of Bessel-beams scattering by particles with arbitrary shape and internal structure.


title: Super-exponential distinguishability of correlated quantum states

abstract: In the problem of asymptotic binary i.i.d. state discrimination, the optimal asymptotics of the type I and the type II error probabilities is in general an exponential decrease to zero as a function of the number of samples; the set of achievable exponent pairs is characterized by the quantum Hoeffding bound theorem. A super-exponential decrease for both types of error probabilities is only possible in the trivial case when the two states are orthogonal, and hence can be perfectly distinguished using only a single copy of the system. In this paper we show that a qualitatively different behaviour can occur when there is correlation between the samples. Namely, we use gauge-invariant and translation-invariant quasi-free states on the algebra of the canonical anti-commutation relations to exhibit pairs of states on an infinite spin chain with the properties that a) all finite-size restrictions of the states have invertible density operators, and b) the type I and the type II error probabilities both decrease to zero at least with the speed $e^{-nc\log n}$ with some positive constant $c$, i.e., with a super-exponential speed in the sample size $n$. Particular examples of such states include the ground states of the $XX$ model corresponding to different transverse magnetic fields. In fact, we prove our result in the setting of binary composite hypothesis testing, and hence it can be applied to prove super-exponential distinguishability of the hypotheses that the transverse magnetic field is above a certain threshold vs. that it is below a strictly lower value.


title: Vakyansh: ASR Toolkit for Low Resource Indic languages

abstract: We present Vakyansh, an end to end toolkit for Speech Recognition in Indic languages. India is home to almost 121 languages and around 125 crore speakers. Yet most of the languages are low resource in terms of data and pretrained models. Through Vakyansh, we introduce automatic data pipelines for data creation, model training, model evaluation and deployment. We create 14,000 hours of speech data in 23 Indic languages and train wav2vec 2.0 based pretrained models. These pretrained models are then finetuned to create state of the art speech recognition models for 18 Indic languages which are followed by language models and punctuation restoration models. We open source all these resources with a mission that this will inspire the speech community to develop speech first applications using our ASR models in Indic languages.


title: PromptDet: Towards Open-vocabulary Detection using Uncurated Images

abstract: The goal of this work is to establish a scalable pipeline for expanding an object detector towards novel/unseen categories, using zero manual annotations. To achieve that, we make the following four contributions: (i) in pursuit of generalisation, we propose a two-stage open-vocabulary object detector, where the class-agnostic object proposals are classified with a text encoder from pre-trained visual-language model; (ii) To pair the visual latent space (of RPN box proposals) with that of the pre-trained text encoder, we propose the idea of regional prompt learning to align the textual embedding space with regional visual object features; (iii) To scale up the learning procedure towards detecting a wider spectrum of objects, we exploit the available online resource via a novel self-training framework, which allows to train the proposed detector on a large corpus of noisy uncurated web images. Lastly, (iv) to evaluate our proposed detector, termed as PromptDet, we conduct extensive experiments on the challenging LVIS and MS-COCO dataset. PromptDet shows superior performance over existing approaches with fewer additional training images and zero manual annotations whatsoever. Project page with code: https://fcjian.github.io/promptdet.


title: Exceptional sets for geodesic flows of noncompact manifolds

abstract: For a geodesic flow on a negatively curved Riemannian manifold $M$ and some subset $A\subset T^1M$, we study the limit $A$-exceptional set, that is the set of points whose $\omega$-limit do not intersect $A$. We show that if the topological $\ast$-entropy of $A$ is smaller than the topological entropy of the geodesic flow, then the limit $A$-exceptional set has full topological entropy. Some consequences are stated for limit exceptional sets of invariant compact subsets and proper submanifolds.


title: Fast Light-Weight Near-Field Photometric Stereo

abstract: We introduce the first end-to-end learning-based solution to near-field Photometric Stereo (PS), where the light sources are close to the object of interest. This setup is especially useful for reconstructing large immobile objects. Our method is fast, producing a mesh from 52 512$\times$384 resolution images in about 1 second on a commodity GPU, thus potentially unlocking several AR/VR applications. Existing approaches rely on optimization coupled with a far-field PS network operating on pixels or small patches. Using optimization makes these approaches slow and memory intensive (requiring 17GB GPU and 27GB of CPU memory) while using only pixels or patches makes them highly susceptible to noise and calibration errors. To address these issues, we develop a recursive multi-resolution scheme to estimate surface normal and depth maps of the whole image at each step. The predicted depth map at each scale is then used to estimate `per-pixel lighting' for the next scale. This design makes our approach almost 45$\times$ faster and 2$^{\circ}$ more accurate (11.3$^{\circ}$ vs. 13.3$^{\circ}$ Mean Angular Error) than the state-of-the-art near-field PS reconstruction technique, which uses iterative optimization.


title: Designing a Transactive Electric Vehicle Agent with Customer's Participation Preference

abstract: The proliferation of electric vehicles (EVs) and their inherent flexibility in charging timings make them an asset to improve grid performance. In contrast to direct control by a utility or autonomous price-based charging, the transactive control framework not only provides benefits to both grid and customers but also ensures customer autonomy. In this work, we design a transactive electric vehicle (TEV) agent that incorporates the EV owner's willingness to trade-off between savings and amenity in form of a slider, where the EV owner's amenity is characterized as vehicle readiness. Further, a privacy-preserving bidding formulation is proposed that also represents the customer's transactive preference. A transactive market mechanism is discussed that integrates the TEV Agents into the local retail market and reconciles with the current day-ahead and real-time market structure. It is demonstrated that the proposed slider is able to provide a preferred trade-off between savings and amenity to individual customers. At the same time, the market mechanism is shown to successfully reduce both peak prices and peak demand. A comparative investigation of V1G and V2G technologies with respect to the battery prices is also discussed.


title: Unseen Classes at a Later Time? No Problem

abstract: Recent progress towards learning from limited supervision has encouraged efforts towards designing models that can recognize novel classes at test time (generalized zero-shot learning or GZSL). GZSL approaches assume knowledge of all classes, with or without labeled data, beforehand. However, practical scenarios demand models that are adaptable and can handle dynamic addition of new seen and unseen classes on the fly (that is continual generalized zero-shot learning or CGZSL). One solution is to sequentially retrain and reuse conventional GZSL methods, however, such an approach suffers from catastrophic forgetting leading to suboptimal generalization performance. A few recent efforts towards tackling CGZSL have been limited by difference in settings, practicality, data splits and protocols followed-inhibiting fair comparison and a clear direction forward. Motivated from these observations, in this work, we firstly consolidate the different CGZSL setting variants and propose a new Online-CGZSL setting which is more practical and flexible. Secondly, we introduce a unified feature-generative framework for CGZSL that leverages bi-directional incremental alignment to dynamically adapt to addition of new classes, with or without labeled data, that arrive over time in any of these CGZSL settings. Our comprehensive experiments and analysis on five benchmark datasets and comparison with baselines show that our approach consistently outperforms existing methods, especially on the more practical Online setting.


title: Collaborative Transformers for Grounded Situation Recognition

abstract: Grounded situation recognition is the task of predicting the main activity, entities playing certain roles within the activity, and bounding-box groundings of the entities in the given image. To effectively deal with this challenging task, we introduce a novel approach where the two processes for activity classification and entity estimation are interactive and complementary. To implement this idea, we propose Collaborative Glance-Gaze TransFormer (CoFormer) that consists of two modules: Glance transformer for activity classification and Gaze transformer for entity estimation. Glance transformer predicts the main activity with the help of Gaze transformer that analyzes entities and their relations, while Gaze transformer estimates the grounded entities by focusing only on the entities relevant to the activity predicted by Glance transformer. Our CoFormer achieves the state of the art in all evaluation metrics on the SWiG dataset. Training code and model weights are available at https://github.com/jhcho99/CoFormer.


title: Nonvolatile Electric Field Control of Thermal Magnons in the Absence of an Applied Magnetic Field

abstract: Spin transport through magnetic insulators has been demonstrated in a variety of materials and is an emerging pathway for next-generation spin-based computing. To modulate spin transport in these systems, one typically applies a sufficiently strong magnetic field to allow for deterministic control of magnetic order. Here, we make use of the well-known multiferroic magnetoelectric, BiFeO3, to demonstrate non-volatile, hysteretic, electric-field control of thermally excited magnon current in the absence of an applied magnetic field. These findings are an important step toward magnon-based devices, where electric-field-only control is highly desirable.


title: Highly-Multiplexed Superconducting Detector Readout: Approachable High-Speed FPGA Design

abstract: This work presents the design and preliminary performance of a highly-multiplexed superconducting detector readout. The readout system is implemented on the Xilinx ZCU111 RFSoC Evaluation Board. The current design uses 12% of the DSPs, 60% of the LUTs, 20% of the FFs, and 30% of the BRAM and makes timing at 512 MHz. The system uses two integrated ADCs and DACs running at 4.096 GSPS to read out 2,048 superconducting detectors. This work targets a 2x increase in the number of superconducting detectors processed per board with 80% less power than previous readout schemes. The open-source design leverages modern FPGA productivity tools including Vivado High-Level Synthesis to create all custom IP blocks, PYNQ to test and verify individual IP and develop Python drivers, and Vivado ML Intelligent Design Runs to close timing. We emphasize strategies for achieving timing closure without custom HDL which we expect to be useful for superconducting device groups looking to utilize FPGAs in high-performance applications without specialized knowledge in FPGA design.


title: CoordGAN: Self-Supervised Dense Correspondences Emerge from GANs

abstract: Recent advances show that Generative Adversarial Networks (GANs) can synthesize images with smooth variations along semantically meaningful latent directions, such as pose, expression, layout, etc. While this indicates that GANs implicitly learn pixel-level correspondences across images, few studies explored how to extract them explicitly. In this work, we introduce Coordinate GAN (CoordGAN), a structure-texture disentangled GAN that learns a dense correspondence map for each generated image. We represent the correspondence maps of different images as warped coordinate frames transformed from a canonical coordinate frame, i.e., the correspondence map, which describes the structure (e.g., the shape of a face), is controlled via a transformation. Hence, finding correspondences boils down to locating the same coordinate in different correspondence maps. In CoordGAN, we sample a transformation to represent the structure of a synthesized instance, while an independent texture branch is responsible for rendering appearance details orthogonal to the structure. Our approach can also extract dense correspondence maps for real images by adding an encoder on top of the generator. We quantitatively demonstrate the quality of the learned dense correspondences through segmentation mask transfer on multiple datasets. We also show that the proposed generator achieves better structure and texture disentanglement compared to existing approaches. Project page: https://jitengmu.github.io/CoordGAN/


title: Locally s-arc-transitive graphs arising from product action

abstract: We study locally $s$-arc-transitive graphs arising from the quasiprimitive product action (PA). We prove that, for any locally $(G,2)$-arc-transitive graph with $G$ acting quasiprimitively with type PA on both $G$-orbits of vertices, the group $G$ does not act primitively on either orbit. Moreover, we construct the first examples of locally $s$-arc-transitive graphs of PA type that are not standard double covers of $s$-arc-transitive graphs of PA type, answering the existence question for these graphs.


title: Shifted Witten classes and topological recursion

abstract: The Witten $r$-spin class defines a non-semisimple cohomological field theory. Pandharipande, Pixton and Zvonkine studied two special shifts of the Witten class along two semisimple directions of the associated Dubrovin--Frobenius manifold using the Givental--Teleman reconstruction theorem. We show that the $R$-matrix and the translation of these two specific shifts can be constructed from the solutions of two differential equations that generalise the classical Airy differential equation. Using this, we prove that the descendant intersection theory of the shifted Witten classes satisfies topological recursion on two $1$-parameter families of spectral curves. By taking the limit as the parameter goes to zero for these families of spectral curves, we prove that the descendant intersection theory of the Witten $r$-spin class can be computed by topological recursion on the $r$-Airy spectral curve. We finally show that this proof suffices to deduce Witten's $r$-spin conjecture, already proved by Faber, Shadrin and Zvonkine, which claims that the generating series of $r$-spin intersection numbers is the tau function of the $r$-KdV hierarchy that satisfies the string equation.


title: Dark matter-baryon scattering effects on temperature perturbations and implications for cosmic dawn

abstract: The nature of dark matter remains unknown, but upcoming measurements probing the high-redshift Universe may provide invaluable insight. In the presence of dark matter-baryon scattering, the suppression in the matter power spectrum and the colder mean gas temperature are expected to modify the evolution of cosmic dawn and reionization. However, the contributions from such interactions to the baryon and dark matter temperature perturbations have been neglected thus far. In this work, we derive these contributions, evolve the cosmological perturbations until the end of the dark ages and show that they may have a significant impact in the beginning of cosmic dawn. In particular, we find that the amplitude of the temperature power spectrum at large scales can change by up to 1--2 orders of magnitude and that the matter power spectrum is further suppressed with respect to $\Lambda$CDM by $5$-$10\%$ at $k\sim 200\, {\rm Mpc^{-1}}$ compared to the computation ignoring these contributions for scattering cross sections at current CMB limits. As a case example, we also compute the HI power spectrum from the dark ages, finding significant differences due to the changes in the temperature and ionization fraction power spectra. We argue that these new contributions must be included in studies of this dark matter model relying on cosmic dawn and reionization observables.


title: Probing neutrino magnetic moments and the XENON1T excess with coherent elastic solar neutrino scattering

abstract: The detection potential of the active neutrino magnetic moment ($\nu_{a}$MM) and the active sterile transition magnetic moment ($\nu_{s}$MM) of the solar neutrino CE$\nu$NS process in future Dark Matter direct detection experiments is studied and compared with the respective allowed range to explain the Xenon1T excess. We find that the sensitivity to the $\nu_{a}$MM approaches to the level between $10^{-10}\mu_B$ and $10^{-11}\mu_B$, which is dominantly limited by the detection threshold. On the other hand, the future solar neutrino CE$\nu$NS detection would be powerful in probing the $\nu_{s}$MM for the sterile neutrino mass below 10 MeV, which could unambiguously test the $\nu_{s}$MM explanation of the Xenon1T excess. The sensitivity in the general framework with both $\nu_{a}$MM and $\nu_{s}$MM contributions is also derived.


title: Tracking the evolution from isolated dimers to many-body entanglement in NaLu$_x$Yb$_{1-x}$Se$_2$

abstract: We synthesize homogeneous compositions of NaLu$_x$Yb$_{1-x}$Se$_2$, connecting non-magnetic NaLuSe$_2$ to the triangular lattice spin liquid candidate NaYbSe$_2$. Thermal and magnetic properties are studied as the system evolves from one with dilute magnetic defects to one of a dense magnetic lattice. The field and temperature dependent heat capacity show the carriers of entropy crossover from isolated magnetic ions to a correlated lattice borne from spin dimers. For the dilute system we estimate the single ion anisotropy $(g_\perp/g_\parallel =3.13)$ and also the dimer exchange couplings $J_\parallel(=5.4$~K) and $J_\perp(=9.6$~K), in order to draw comparison to the half-doped and full magnetic compounds.


title: Exploring Plain Vision Transformer Backbones for Object Detection

abstract: We explore the plain, non-hierarchical Vision Transformer (ViT) as a backbone network for object detection. This design enables the original ViT architecture to be fine-tuned for object detection without needing to redesign a hierarchical backbone for pre-training. With minimal adaptations for fine-tuning, our plain-backbone detector can achieve competitive results. Surprisingly, we observe: (i) it is sufficient to build a simple feature pyramid from a single-scale feature map (without the common FPN design) and (ii) it is sufficient to use window attention (without shifting) aided with very few cross-window propagation blocks. With plain ViT backbones pre-trained as Masked Autoencoders (MAE), our detector, named ViTDet, can compete with the previous leading methods that were all based on hierarchical backbones, reaching up to 61.3 AP_box on the COCO dataset using only ImageNet-1K pre-training. We hope our study will draw attention to research on plain-backbone detectors. Code for ViTDet is available in Detectron2.


title: L^3U-net: Low-Latency Lightweight U-net Based Image Segmentation Model for Parallel CNN Processors

abstract: In this research, we propose a tiny image segmentation model, L^3U-net, that works on low-resource edge devices in real-time. We introduce a data folding technique that reduces inference latency by leveraging the parallel convolutional layer processing capability of the CNN accelerators. We also deploy the proposed model to such a device, MAX78000, and the results show that L^3U-net achieves more than 90% accuracy over two different segmentation datasets with 10 fps.


title: CaDeX: Learning Canonical Deformation Coordinate Space for Dynamic Surface Representation via Neural Homeomorphism

abstract: While neural representations for static 3D shapes are widely studied, representations for deformable surfaces are limited to be template-dependent or lack efficiency. We introduce Canonical Deformation Coordinate Space (CaDeX), a unified representation of both shape and nonrigid motion. Our key insight is the factorization of the deformation between frames by continuous bijective canonical maps (homeomorphisms) and their inverses that go through a learned canonical shape. Our novel deformation representation and its implementation are simple, efficient, and guarantee cycle consistency, topology preservation, and, if needed, volume conservation. Our modelling of the learned canonical shapes provides a flexible and stable space for shape prior learning. We demonstrate state-of-the-art performance in modelling a wide range of deformable geometries: human bodies, animal bodies, and articulated objects.


title: Learning Instance-Specific Adaptation for Cross-Domain Segmentation

abstract: We propose a test-time adaptation method for cross-domain image segmentation. Our method is simple: Given a new unseen instance at test time, we adapt a pre-trained model by conducting instance-specific BatchNorm (statistics) calibration. Our approach has two core components. First, we replace the manually designed BatchNorm calibration rule with a learnable module. Second, we leverage strong data augmentation to simulate random domain shifts for learning the calibration rule. In contrast to existing domain adaptation methods, our method does not require accessing the target domain data at training time or conducting computationally expensive test-time model training/optimization. Equipping our method with models trained by standard recipes achieves significant improvement, comparing favorably with several state-of-the-art domain generalization and one-shot unsupervised domain adaptation approaches. Combining our method with the domain generalization methods further improves performance, reaching a new state of the art.


title: Understanding 3D Object Articulation in Internet Videos

abstract: We propose to investigate detecting and characterizing the 3D planar articulation of objects from ordinary videos. While seemingly easy for humans, this problem poses many challenges for computers. We propose to approach this problem by combining a top-down detection system that finds planes that can be articulated along with an optimization approach that solves for a 3D plane that can explain a sequence of observed articulations. We show that this system can be trained on a combination of videos and 3D scan datasets. When tested on a dataset of challenging Internet videos and the Charades dataset, our approach obtains strong performance. Project site: https://jasonqsy.github.io/Articulation3D


title: Gauged sigma models and exceptional dressing cosets

abstract: The Poisson-Lie (PL) T-duality is a generalized T-duality based on the Lie algebra of the Drinfel'd double. In particular, when we consider the PL T-duality of a coset space, the dual space is found to be a generalized coset space, which is called the dressing coset. In this paper, we investigate an extension of the dressing cosets to the U-duality setup. We propose the gauged actions for various branes in M-theory and type IIB theory, where the generalized metric is constructed by using the Exceptional Drinfel'd Algebra (EDA) and the gauge algebra is a certain isotropic subalgebra of the EDA. By eliminating the gauge fields, the gauged action reduces to the standard brane action on a certain reduced background, which we call the exceptional dressing coset. We also propose an alternative definition of the exceptional dressing cosets based on Sfetsos's approach and reproduce a known example of non-Abelian T-duality in the U-duality-covariant formulation.


title: Large-Scale Pre-training for Person Re-identification with Noisy Labels

abstract: This paper aims to address the problem of pre-training for person re-identification (Re-ID) with noisy labels. To setup the pre-training task, we apply a simple online multi-object tracking system on raw videos of an existing unlabeled Re-ID dataset "LUPerson" nd build the Noisy Labeled variant called "LUPerson-NL". Since theses ID labels automatically derived from tracklets inevitably contain noises, we develop a large-scale Pre-training framework utilizing Noisy Labels (PNL), which consists of three learning modules: supervised Re-ID learning, prototype-based contrastive learning, and label-guided contrastive learning. In principle, joint learning of these three modules not only clusters similar examples to one prototype, but also rectifies noisy labels based on the prototype assignment. We demonstrate that learning directly from raw videos is a promising alternative for pre-training, which utilizes spatial and temporal correlations as weak supervision. This simple pre-training task provides a scalable way to learn SOTA Re-ID representations from scratch on "LUPerson-NL" without bells and whistles. For example, by applying on the same supervised Re-ID method MGN, our pre-trained model improves the mAP over the unsupervised pre-training counterpart by 5.7%, 2.2%, 2.3% on CUHK03, DukeMTMC, and MSMT17 respectively. Under the small-scale or few-shot setting, the performance gain is even more significant, suggesting a better transferability of the learned representation. Code is available at https://github.com/DengpanFu/LUPerson-NL


title: A cellular automaton decoder for a noise-bias tailored color code

abstract: Self-correcting quantum memories demonstrate robust properties that can be exploited to improve active quantum error-correction protocols. Here we propose a cellular automaton decoder for a variation of the color code where the bases of the physical qubits are locally rotated, which we call the XYZ color code. The local transformation means our decoder demonstrates key properties of a two-dimensional fractal code if the noise acting on the system is infinitely biased towards dephasing, namely, no string-like logical operators. As such, in the high-bias limit, our local decoder reproduces the behavior of a partially self-correcting memory. At low error rates, our simulations show that the memory time diverges polynomially with system size without intervention from a global decoder, up to some critical system size that grows as the error rate is lowered. Furthermore, although we find that we cannot reproduce partially self-correcting behavior at finite bias, our numerics demonstrate improved memory times at realistic noise biases. Our results therefore motivate the design of tailored cellular automaton decoders that help to reduce the bandwidth demands of global decoding for realistic noise models.


title: Parallel framework for Dynamic Domain Decomposition of Data Assimilation problems a case study on Kalman Filter algorithm

abstract: We focus on Partial Differential Equation (PDE) based Data Assimilatio problems (DA) solved by means of variational approaches and Kalman filter algorithm. Recently, we presented a Domain Decomposition framework (we call it DD-DA, for short) performing a decomposition of the whole physical domain along space and time directions, and joining the idea of Schwarz' methods and parallel in time approaches. For effective parallelization of DD-DA algorithms, the computational load assigned to subdomains must be equally distributed. Usually computational cost is proportional to the amount of data entities assigned to partitions. Good quality partitioning also requires the volume of communication during calculation to be kept at its minimum. In order to deal with DD-DA problems where the observations are nonuniformly distributed and general sparse, in the present work we employ a parallel load balancing algorithm based on adaptive and dynamic defining of boundaries of DD -- which is aimed to balance workload according to data location. We call it DyDD. As the numerical model underlying DA problems arising from the so-called discretize-then-optimize approach is the constrained least square model (CLS), we will use CLS as a reference state estimation problem and we validate DyDD on different scenarios.


title: Recent improvements of ASR models in the face of adversarial attacks

abstract: Like many other tasks involving neural networks, Speech Recognition models are vulnerable to adversarial attacks. However recent research has pointed out differences between attacks and defenses on ASR models compared to image models. Improving the robustness of ASR models requires a paradigm shift from evaluating attacks on one or a few models to a systemic approach in evaluation. We lay the ground for such research by evaluating on various architectures a representative set of adversarial attacks: targeted and untargeted, optimization and speech processing-based, white-box, black-box and targeted attacks. Our results show that the relative strengths of different attack algorithms vary considerably when changing the model architecture, and that the results of some attacks are not to be blindly trusted. They also indicate that training choices such as self-supervised pretraining can significantly impact robustness by enabling transferable perturbations. We release our source code as a package that should help future research in evaluating their attacks and defenses.


title: Efficient Localness Transformer for Smart Sensor-Based Energy Disaggregation

abstract: Modern smart sensor-based energy management systems leverage non-intrusive load monitoring (NILM) to predict and optimize appliance load distribution in real-time. NILM, or energy disaggregation, refers to the decomposition of electricity usage conditioned on the aggregated power signals (i.e., smart sensor on the main channel). Based on real-time appliance power prediction using sensory technology, energy disaggregation has great potential to increase electricity efficiency and reduce energy expenditure. With the introduction of transformer models, NILM has achieved significant improvements in predicting device power readings. Nevertheless, transformers are less efficient due to O(l^2) complexity w.r.t. sequence length l. Moreover, transformers can fail to capture local signal patterns in sequence-to-point settings due to the lack of inductive bias in local context. In this work, we propose an efficient localness transformer for non-intrusive load monitoring (ELTransformer). Specifically, we leverage normalization functions and switch the order of matrix multiplication to approximate self-attention and reduce computational complexity. Additionally, we introduce localness modeling with sparse local attention heads and relative position encodings to enhance the model capacity in extracting short-term local patterns. To the best of our knowledge, ELTransformer is the first NILM model that addresses computational complexity and localness modeling in NILM. With extensive experiments and quantitative analyses, we demonstrate the efficiency and effectiveness of the the proposed ELTransformer with considerable improvements compared to state-of-the-art baselines.


title: Machine Learning Approaches for Non-Intrusive Home Absence Detection Based on Appliance Electrical Use

abstract: Home absence detection is an emerging field on smart home installations. Identifying whether or not the residents of the house are present, is important in numerous scenarios. Possible scenarios include but are not limited to: elderly people living alone, people suffering from dementia, home quarantine. The majority of published papers focus on either pressure / door sensors or cameras in order to detect outing events. Although the aforementioned approaches provide solid results, they are intrusive and require modifications for sensor placement. In our work, appliance electrical use is investigated as a means for detecting the presence or absence of residents. The energy use is the result of power disaggregation, a non intrusive / non invasive sensing method. Since a dataset providing energy data and ground truth for home absence is not available, artificial outing events were introduced on the UK-DALE dataset, a well known dataset for Non Intrusive Load Monitoring (NILM). Several machine learning algorithms were evaluated using the generated dataset. Benchmark results have shown that home absence detection using appliance power consumption is feasible.


title: Identification of diffracted vortex beams at different propagation distances using deep learning

abstract: Orbital angular momentum of light is regarded as a valuable resource in quantum technology, especially in quantum communication and quantum sensing and ranging. However, the OAM state of light is susceptible to undesirable experimental conditions such as propagation distance and phase distortions, which hinders the potential for the realistic implementation of relevant technologies. In this article, we exploit an enhanced deep learning neural network to identify different OAM modes of light at multiple propagation distances with phase distortions. Specifically, our trained deep learning neural network can efficiently identify the vortex beam's topological charge and propagation distance with 97% accuracy. Our technique has important implications for OAM based communication and sensing protocols.


title: Mind the gap: Challenges of deep learning approaches to Theory of Mind

abstract: Theory of Mind is an essential ability of humans to infer the mental states of others. Here we provide a coherent summary of the potential, current progress, and problems of deep learning approaches to Theory of Mind. We highlight that many current findings can be explained through shortcuts. These shortcuts arise because the tasks used to investigate Theory of Mind in deep learning systems have been too narrow. Thus, we encourage researchers to investigate Theory of Mind in complex open-ended environments. Furthermore, to inspire future deep learning systems we provide a concise overview of prior work done in humans. We further argue that when studying Theory of Mind with deep learning, the research's main focus and contribution ought to be opening up the network's representations. We recommend researchers use tools from the field of interpretability of AI to study the relationship between different network components and aspects of Theory of Mind.


title: Resilience of Sloshing Cold Fronts against Subsequent Minor Mergers

abstract: Minor mergers are common in galaxy clusters. They have the potential to create sloshing cold fronts (SCFs) in the intracluster medium (ICM) of the cluster. However, the resilience of SCFs to subsequent minor mergers is unknown. Here we investigate the extent to which SCFs established by an off-axis minor merger are disrupted by a subsequent minor merger. We perform a suite of 13 hydrodynamic + N-body simulations of idealised triple cluster mergers in which we vary the approach direction and impact parameter of the tertiary cluster. Except for ~1 Gyr after the first core passage of the tertiary cluster, clear SCFs are present in all merger configurations. Subsequent head-on minor mergers reduce the number of SCFs significantly, while subsequent off-axis minor mergers only moderately reduce the number of SCFs. In particular, outer (>~500 kpc) SCFs are resilient. The results of this work indicate that SCFs are easily formed in the course of a minor merger and are long-lived even if a further minor merger takes place. SCFs thus should be ubiquitous, but deriving the merger history of a given cluster based on its observed SCFs might be more complex than previously thought.