title: Action and periodic orbits on annulus

abstract: We consider the classical problem of area-preserving maps on annulus $\mathbb{A} = S^1 \times [0, 1]$ . Let $\mathcal{M}_f$ be the set of all invariant probability measures of an area-preserving, orientation preserving diffeomorphism $f$ on $\mathbb{A}$. Given any $\mu_1$ and $\mu_2$ in $\mathcal{M}_f$, Franks \cite{Franks1988}\cite{Franks1992}, generalizing Poincar\'e's last geometric theorem (Birkhoff \cite{Birkhoff1913}), showed that if their rotation numbers are different, then $f$ has infinitely many periodic orbits. In this paper, we show that if $\mu_1$ and $\mu_2$ have different actions, even if they have the same rotation number, then $f$ has infinitely many periodic orbits. In particular, if the action difference is larger than one, then $f$ has at least two fixed points. The same result is also true for area-preserving diffeomorphisms on unit disk, where no rotation number is available.


title: Wireless Communication with Extremely Large-Scale Intelligent Reflecting Surface

abstract: Intelligent reflecting surface (IRS) is a promising technology for wireless communications, thanks to its potential capability to engineer the radio environment. However, in practice, such an envisaged benefit is attainable only when the passive IRS is of a sufficiently large size, for which the conventional uniform plane wave (UPW)-based channel model may become inaccurate. In this paper, we pursue a new channel modelling and performance analysis for wireless communications with extremely large-scale IRS (XL-IRS). By taking into account the variations in signal's amplitude and projected aperture across different reflecting elements, we derive both lower- and upper-bounds of the received signal-to-noise ratio (SNR) for the general uniform planar array (UPA)-based XL-IRS. Our results reveal that, instead of scaling quadratically with the increased number of reflecting elements M as in the conventional UPW model, the SNR under the more practically applicable non-UPW model increases with M only with a diminishing return and gets saturated eventually. To gain more insights, we further study the special case of uniform linear array (ULA)-based XL-IRS, for which a closed-form SNR expression in terms of the IRS size and transmitter/receiver location is derived. This result shows that the SNR mainly depends on the two geometric angles formed by the transmitter/receiver locations with the IRS, as well as the boundary points of the IRS. Numerical results validate our analysis and demonstrate the importance of proper channel modelling for wireless communications aided by XL-IRS.


title: On global existence for semilinear wave equations with spacedependent critical damping

abstract: The global existence for semilinear wave equations with space-dependent critical damping $\partial_t^2u-\Delta u+\frac{V_0}{|x|}\partial_t u=f(u)$ in an exterior domain is dealt with, where $f(u)=|u|^{p-1}u$ and $f(u)=|u|^p$ are in mind. Existence and non-existence of global-in-time solutions are discussed. To obtain global existence, a weighted energy estimate for the linear problem is crucial. The proof of such a weighted energy estimate contains an alternative proof of energy estimates established by Ikehata--Todorova--Yordanov [J.\ Math.\ Soc.\ Japan (2013), 183--236] but this clarifies the precise independence of the location of the support of initial data. The blowup phenomena is verified by using a test function method with positive harmonic functions satisfying the Dirichlet boundary condition.


title: Atomistic deformation mechanism of silicon under laser-driven shock compression

abstract: Silicon (Si) is one of the most abundant elements on Earth, and it is the most important and widely used semiconductor, constituting the basis of modern electronic devices. Despite extensive study, some properties of Si remain elusive. For example, the behaviour of Si under high pressure, in particular at the ultra-high strain rates characteristic of dynamic compression, has been a matter of debate for decades. A detailed understanding of how Si deforms is crucial for a variety of fields, ranging from planetary science to materials design. Simulations suggest that in Si the shear stress generated during shock compression is released inelastically, i.e., via a high-pressure phase transition, challenging the classical picture of relaxation via defect-mediated plasticity. However, experiments at the short timescales characteristic of shock compression are challenging, and direct evidence supporting either deformation mechanism remain elusive. Here, we use sub-picosecond, highly-monochromatic x-ray diffraction to study (100)-oriented single-crystal Si under laser-driven shock compression. We provide the first unambiguous, time-resolved picture of Si deformation at ultra-high strain rates, demonstrating the predicted inelastic shear release. Our results resolve the longstanding controversy on silicon deformation under dynamic compression, and provide direct proof of strain rate-dependent deformation mechanisms in a non-metallic system, which is key for the study of planetary-relevant materials.


title: Superconductivity of centrosymmetric and non-centrosymmetric phases in antiperovskite (Ca,Sr)Pd$_3$P

abstract: In the recently discovered antiperovskite phosphide (Ca,Sr)Pd$_3$P, centrosymmetric (CS) and non-centrosymmetric (NCS) superconducting phases appear depending on the Sr concentration, and their transition temperatures ($T_\mathrm{c}$) differ by as much as one order of magnitude. In this study, we investigated the superconducting properties and electronic band structures of CS orthorhombic (CSo) (Ca$_{0.6}$Sr$_{0.4}$)Pd$_3$P ($T_\mathrm{c}$ = 3.5 K) and NCS tetragonal (NCSt) (Ca$_{0.25}$Sr$_{0.75}$)Pd$_3$P ($T_\mathrm{c}$ = 0.32 K) samples with a focus on explaining their large $T_\mathrm{c}$ difference. Specific heat measurements indicated that CSo (Ca$_{0.6}$Sr$_{0.4}$)Pd$_3$P was an s-wave superconductor in a moderate-coupling regime with a 2$\Delta$$_0$/k$_B$$T_\mathrm{c}$ value of 4.0. Low-lying phonons leading to the strong coupling in the structurally analogous SrPt$_3$P were unlikely to be present in CSo (Ca$_{0.6}$Sr$_{0.4}$)Pd$_3$P. Given that CSo (Ca$_{0.6}$Sr$_{0.4}$)Pd$_3$P and NCSt (Ca$_{0.25}$Sr$_{0.75}$)Pd$_3$P exhibited similar Debye temperatures ($\Theta$$_D$) of approximately 200 K, the large $T_\mathrm{c}$ difference could not be attributed to $\Theta$$_D$.$T_\mathrm{c}$ of each phase was accurately reproduced based on the Bardeen-Cooper-Schrieffer (BCS) theory using experimental data and the density of states of the Fermi level $N$(0) calculated from their band structures. We concluded that the considerable suppression of $T_\mathrm{c}$ in NCSt (Ca$_{0.25}$Sr$_{0.75}$)Pd$_3$P can be primarily attributed to the decrease in $N$(0) associated with the structural phase transition without considering the lack of inversion symmetry.


title: Assessing the Effectiveness of Syntactic Structure to Learn Code Edit Representations

abstract: In recent times, it has been shown that one can use code as data to aid various applications such as automatic commit message generation, automatic generation of pull request descriptions and automatic program repair. Take for instance the problem of commit message generation. Treating source code as a sequence of tokens, state of the art techniques generate commit messages using neural machine translation models. However, they tend to ignore the syntactic structure of programming languages. Previous work, i.e., code2seq has used structural information from Abstract Syntax Tree (AST) to represent source code and they use it to automatically generate method names. In this paper, we elaborate upon this state of the art approach and modify it to represent source code edits. We determine the effect of using such syntactic structure for the problem of classifying code edits. Inspired by the code2seq approach, we evaluate how using structural information from AST, i.e., paths between AST leaf nodes can help with the task of code edit classification on two datasets of fine-grained syntactic edits. Our experiments shows that attempts of adding syntactic structure does not result in any improvements over less sophisticated methods. The results suggest that techniques such as code2seq, while promising, have a long way to go before they can be generically applied to learning code edit representations. We hope that these results will benefit other researchers and inspire them to work further on this problem.


title: Superadiabatic basis in cosmological particle production: application to preheating

abstract: We discuss the adiabatic basis dependence of particle number in time-dependent backgrounds. In particular, we focus on preheating after inflation, and show that, for the optimal basis, the time dependence of the produced particle number can be well approximated by a simple connection formula, which can be obtained by analysing Stokes phenomenon in given backgrounds. As we show explicitly, the simple connection formula can describe various parameter regions such as narrow and broad resonance regime in a unified manner.


title: Spectral Unsupervised Domain Adaptation for Visual Recognition

abstract: Though unsupervised domain adaptation (UDA) has achieved very impressive progress recently, it remains a great challenge due to missing target annotations and the rich discrepancy between source and target distributions. We propose Spectral UDA (SUDA), an effective and efficient UDA technique that works in the spectral space and can generalize across different visual recognition tasks. SUDA addresses the UDA challenges from two perspectives. First, it introduces a spectrum transformer (ST) that mitigates inter-domain discrepancies by enhancing domain-invariant spectra while suppressing domain-variant spectra of source and target samples simultaneously. Second, it introduces multi-view spectral learning that learns useful unsupervised representations by maximizing mutual information among multiple ST-generated spectral views of each target sample. Extensive experiments show that SUDA achieves superior accuracy consistently across different visual tasks in object detection, semantic segmentation and image classification. Additionally, SUDA also works with the transformer-based network and achieves state-of-the-art performance on object detection.


title: Sample-efficient adaptive calibration of quantum networks using Bayesian optimization

abstract: Indistinguishable photons are imperative for advanced quantum communication networks. Indistinguishability is difficult to obtain because of environment-induced photon transformations and loss imparted by communication channels, especially in noisy scenarios. Strategies to mitigate these transformations often require hardware or software overhead that is restrictive (e.g. adding noise), infeasible (e.g. on a satellite), or time-consuming for deployed networks. Here we propose and develop resource-efficient Bayesian optimization techniques to rapidly and adaptively calibrate the indistinguishability of individual photons for quantum networks using only information derived from their measurement. To experimentally validate our approach, we demonstrate the optimization of Hong-Ou-Mandel interference between two photons -- a central task in quantum networking -- finding rapid, efficient, and reliable convergence towards maximal photon indistinguishability in the presence of high loss and shot noise. We expect our resource-optimized and experimentally friendly methodology will allow fast and reliable calibration of indistinguishable quanta, a necessary task in distributed quantum computing, communications, and sensing, as well as for fundamental investigations.


title: Interpreting Expert Annotation Differences in Animal Behavior

abstract: Hand-annotated data can vary due to factors such as subjective differences, intra-rater variability, and differing annotator expertise. We study annotations from different experts who labelled the same behavior classes on a set of animal behavior videos, and observe a variation in annotation styles. We propose a new method using program synthesis to help interpret annotation differences for behavior analysis. Our model selects relevant trajectory features and learns a temporal filter as part of a program, which corresponds to estimated importance an annotator places on that feature at each timestamp. Our experiments on a dataset from behavioral neuroscience demonstrate that compared to baseline approaches, our method is more accurate at capturing annotator labels and learns interpretable temporal filters. We believe that our method can lead to greater reproducibility of behavior annotations used in scientific studies. We plan to release our code.


title: Self-supervise, Refine, Repeat: Improving Unsupervised Anomaly Detection

abstract: Anomaly detection (AD), separating anomalies from normal data, has many applications across domains, from security to healthcare. While most previous works were shown to be effective for cases with fully or partially labeled data, that setting is in practice less common due to labeling being particularly tedious for this task. In this paper, we focus on fully unsupervised AD, in which the entire training dataset, containing both normal and anomalous samples, is unlabeled. To tackle this problem effectively, we propose to improve the robustness of one-class classification trained on self-supervised representations using a data refinement process. Our proposed data refinement approach is based on an ensemble of one-class classifiers (OCCs), each of which is trained on a disjoint subset of training data. Representations learned by self-supervised learning on the refined data are iteratively updated as the data refinement improves. We demonstrate our method on various unsupervised AD tasks with image and tabular data. With a 10% anomaly ratio on CIFAR-10 image data / 2.5% anomaly ratio on Thyroid tabular data, the proposed method outperforms the state-of-the-art one-class classifier by 6.3 AUC and 12.5 average precision / 22.9 F1-score.


title: Structural entropy and spatial decay of quasimodes in Vogel spirals

abstract: We investigate the spatial decay and temporal localization properties of quasimodes (i.e., scattering resonances) of two-dimensional Vogel spirals, composed of deterministic, aperiodic arrays of electric dipoles. By determining the structural entropy and localization maps of Vogel spirals using the Green's matrix method, we show that three distinctive decay types of quasimodes coexist in Vogel spirals: exponential, power-law, and Gaussian. While the exponential and the power-law decays typically occur in disordered media and multifractal systems, respectively, the Gaussian decay is demonstrated to characterize, on average, the most localized quasimodes of Vogel spirals, both spatially (smallest participation ratios) and temporarily (longest lifetimes). These decay forms are demonstrated by a no-fitting analysis of the localization maps, independently corroborated by calculating the electric field in real space, which also provides a direct evidence of the algebraic spatial decay of critical quasimodes. Altogether our findings unveil a rich spectrum of both long-lived and spatially localized quasimodes that coexist in Vogel spirals and can be of direct relevance to novel optical functionalities for applications to light sources and sensing devices.


title: On cubic fourfolds with an inductive structure

abstract: We study the number of planes for four dimensional projective hypersurfaces which has so-called inductive structure. We also determine transcendental lattices for cubic fourfolds of this type.


title: Single-shot quantitative polarization imaging of complex birefringent structure dynamics

abstract: Polarization light microscopes are powerful tools for probing molecular order and orientation in birefringent materials. While a multitude of polarization light microscopy techniques are often used to access steady-state properties of birefringent samples, quantitative measurements of the molecular orientation dynamics on the millisecond time scale have remained a challenge. We propose polarized shearing interference microscopy (PSIM), a single-shot quantitative polarization imaging method, for extracting the retardance and orientation angle of the laser beam transmitting through optically anisotropic specimens with complex structures. The measurement accuracy and imaging performances of PSIM are validated by imaging a rotating wave plate and a bovine tendon specimen. We demonstrate that PSIM can quantify the dynamics of a flowing lyotropic chromonic liquid crystal in a microfluidic channel at an imaging speed of 506 frames per second (only limited by the camera frame rate), with a field-of-view of up to $350\times350 \mu m^2$ and a diffraction-limit spatial resolution of $\sim 2\mu m$. We envision that PSIM will find a broad range of applications in quantitative material characterization under dynamical conditions.


title: The impact of nitrogen doping on the linear and nonlinear terahertz response of graphene

abstract: It is well known that impurities play a central role in the linear and nonlinear response of graphene at optical and terahertz frequencies. In this work, we calculate the bands and intraband dipole connection elements for nitrogen-doped monolayer graphene using a density functional tight binding approach. Employing these results, we calculate the linear and nonlinear response of the doped graphene to terahertz pulses using a density-matrix approach in the length gauge. We present the results for the linear and nonlinear mobility as well as third harmonic generation in graphene for adsorbed and substitutional nitrogen doping for a variety of doping densities. We show that the conduction bands are more parabolic in graphene structures with substitutional nitrogen doping than for those with adsorbed nitrogen. As a result, substitutional doping has a greater impact on the terahertz mobility and nonlinear response of graphene than adsorbed nitrogen does.


title: Landis-type conjecture for the half-Laplacian

abstract: In this paper, we study the Landis-type conjecture, i.e., unique continuation property from infinity, of the fractional Schr\"{o}dinger equation with drift and potential terms. We show that if any solution of the equation decays at a certain exponential rate, then it must be trivial. The main ingredients of our proof are the Caffarelli-Silvestre extension and Armitage's Liouville-type theorem.


title: On Dimension-dependent concentration for convex Lipschitz functions in product spaces

abstract: Let $n\geq 1$, $K>0$, and let $X=(X_1,X_2,\dots,X_n)$ be a random vector in $\mathbb{R}^n$ with independent $K$--subgaussian components. We show that for every $1$--Lipschitz convex function $f$ in $\mathbb{R}^n$ (the Lipschitzness with respect to the Euclidean metric), $$ \max\big(\mathbb{P}\big\{f(X)-{\rm Med}\,f(X)\geq t\big\},\mathbb{P}\big\{f(X)-{\rm Med}\,f(X)\leq -t\big\}\big)\leq \exp\bigg( -\frac{c\,t^2}{K^2\log\big(2+\frac{ n}{t^2/K^2}\big)}\bigg),\quad t>0, $$ where $c>0$ is a universal constant. The estimates are optimal in the sense that for every $n\geq \tilde C$ and $t>0$ there exist a product probability distribution $X$ in $\mathbb{R}^n$ with $K$--subgaussian components, and a $1$--Lipschitz convex function $f$, with $$ \mathbb{P}\big\{\big|f(X)-{\rm Med}\,f(X)\big|\geq t\big\}\geq \tilde c\,\exp\bigg( -\frac{\tilde C\,t^2}{K^2\log\big(2+\frac{n}{t^2/K^2}\big)}\bigg). $$ The obtained deviation estimates for subgaussian variables are in sharp contrast with the case of variables with bounded $\|X_i\|_{\psi_p}$--norms for $p\in[1,2)$.


title: Lateral contact yields longitudinal cohesion in active undulatory systems

abstract: Many animals and robots move using undulatory motion of their bodies. When in close proximity undulatory motion can lead to novel collective behaviors such as gait synchronization, spatial reconfiguration, and clustering. Here we study the role of contact interactions between model undulatory swimmers: three-link robots in experiment and multi-link robots in simulation. The undulatory gait of each swimmer is generated through a time-dependent sinusoidal-like waveform which has a fixed phase offset, $\phi$. By varying the phase relationship between neighboring swimmers we seek to study how contact forces and spatial configurations are governed by the phase difference between neighboring swimmers. We find that undulatory actuation in close proximity drives neighboring swimmers into spatial equilibrium configurations that depend on the actuation phase difference. We propose a model for spatial equilibrium of nearest neighbor undulatory swimmers which we call the gait compatibility condition, which is the set of spatial and gait configurations in which no collisions occur. Robotic experiments with two, three, and four swimmers exhibit good agreement with the compatibility model. To probe the interaction potential between undulatory swimmers we perturb the each longitudinally from their equilibrium configurations and we measure their steady-state displacement. These studies reveal that undulatory swimmers in close proximity exhibit cohesive longitudinal interaction forces that drive the swimmers from incompatible to compatible configurations. This system of undulatory swimmers provides new insight into active-matter systems which move through body undulation. In addition to the importance of velocity and orientation coherence in active-matter swarms, we demonstrate that undulatory phase coherence is also important for generating stable, cohesive group configurations.


title: A Unified Framework for Constructing Nonconvex Regularizations

abstract: Over the past decades, many individual nonconvex methods have been proposed to achieve better sparse recovery performance in various scenarios. However, how to construct a valid nonconvex regularization function remains open in practice. In this paper, we fill in this gap by presenting a unified framework for constructing the nonconvex regularization based on the probability density function. Meanwhile, a new nonconvex sparse recovery method constructed via the Weibull distribution is studied.


title: Twin Neural Network Regression is a Semi-Supervised Regression Algorithm

abstract: Twin neural network regression (TNNR) is a semi-supervised regression algorithm, it can be trained on unlabelled data points as long as other, labelled anchor data points, are present. TNNR is trained to predict differences between the target values of two different data points rather than the targets themselves. By ensembling predicted differences between the targets of an unseen data point and all training data points, it is possible to obtain a very accurate prediction for the original regression problem. Since any loop of predicted differences should sum to zero, loops can be supplied to the training data, even if the data points themselves within loops are unlabelled. Semi-supervised training improves TNNR performance, which is already state of the art, significantly.


title: Bridging Subword Gaps in Pretrain-Finetune Paradigm for Natural Language Generation

abstract: A well-known limitation in pretrain-finetune paradigm lies in its inflexibility caused by the one-size-fits-all vocabulary. This potentially weakens the effect when applying pretrained models into natural language generation (NLG) tasks, especially for the subword distributions between upstream and downstream tasks with significant discrepancy. Towards approaching this problem, we extend the vanilla pretrain-finetune pipeline with an extra embedding transfer step. Specifically, a plug-and-play embedding generator is introduced to produce the representation of any input token, according to pre-trained embeddings of its morphologically similar ones. Thus, embeddings of mismatch tokens in downstream tasks can also be efficiently initialized. We conduct experiments on a variety of NLG tasks under the pretrain-finetune fashion. Experimental results and extensive analyses show that the proposed strategy offers us opportunities to feel free to transfer the vocabulary, leading to more efficient and better performed downstream NLG models.


title: Exploiting Large-scale Teacher-Student Training for On-device Acoustic Models

abstract: We present results from Alexa speech teams on semi-supervised learning (SSL) of acoustic models (AM) with experiments spanning over 3000 hours of GPU time, making our study one of the largest of its kind. We discuss SSL for AMs in a small footprint setting, showing that a smaller capacity model trained with 1 million hours of unsupervised data can outperform a baseline supervised system by 14.3% word error rate reduction (WERR). When increasing the supervised data to seven-fold, our gains diminish to 7.1% WERR; to improve SSL efficiency at larger supervised data regimes, we employ a step-wise distillation into a smaller model, obtaining a WERR of 14.4%. We then switch to SSL using larger student models in low data regimes; while learning efficiency with unsupervised data is higher, student models may outperform teacher models in such a setting. We develop a theoretical sketch to explain this behavior.


title: Differentially Private Federated Learning via Inexact ADMM

abstract: Differential privacy (DP) techniques can be applied to the federated learning model to protect data privacy against inference attacks to communication among the learning agents. The DP techniques, however, hinder achieving a greater learning performance while ensuring strong data privacy. In this paper we develop a DP inexact alternating direction method of multipliers algorithm that solves a sequence of subproblems with the objective perturbation by random noises generated from a Laplace distribution. We show that our algorithm provides $\bar{\epsilon}$-DP for every iteration, where $\bar{\epsilon}$ is a privacy parameter controlled by a user. Using MNIST and FEMNIST datasets for the image classification, we demonstrate that our algorithm reduces the testing error by at most $22\%$ compared with the existing DP algorithm, while achieving the same level of data privacy. The numerical experiment also shows that our algorithm converges faster than the existing algorithm.


title: Maximizing Influence of Leaders in Social Networks

abstract: The operation of adding edges has been frequently used to the study of opinion dynamics in social networks for various purposes. In this paper, we consider the edge addition problem for the DeGroot model of opinion dynamics in a social network with $n$ nodes and $m$ edges, in the presence of a small number $s \ll n$ of competing leaders with binary opposing opinions 0 or 1. Concretely, we pose and investigate the problem of maximizing the equilibrium overall opinion by creating $k$ new edges in a candidate edge set, where each edge is incident to a 1-valued leader and a follower node. We show that the objective function is monotone and submodular. We then propose a simple greedy algorithm with an approximation factor $(1-\frac{1}{e})$ that approximately solves the problem in $O(n^3)$ time. Moreover, we provide a fast algorithm with a $(1-\frac{1}{e}-\epsilon)$ approximation ratio and $\tilde{O}(mk\epsilon^{-2})$ time complexity for any $\epsilon>0$, where $\tilde{O}(\cdot)$ notation suppresses the ${\rm poly} (\log n)$ factors. Extensive experiments demonstrate that our second approximate algorithm is efficient and effective, which scales to large networks with more than a million nodes.


title: Instance-Level Task Parameters: A Robust Multi-task Weighting Framework

abstract: Recent works have shown that deep neural networks benefit from multi-task learning by learning a shared representation across several related tasks. However, performance of such systems depend on relative weighting between various losses involved during training. Prior works on loss weighting schemes assume that instances are equally easy or hard for all tasks. In order to break this assumption, we let the training process dictate the optimal weighting of tasks for every instance in the dataset. More specifically, we equip every instance in the dataset with a set of learnable parameters (instance-level task parameters) where the cardinality is equal to the number of tasks learned by the model. These parameters model the weighting of each task for an instance. They are updated by gradient descent and do not require hand-crafted rules. We conduct extensive experiments on SURREAL and CityScapes datasets, for human shape and pose estimation, depth estimation and semantic segmentation tasks. In these tasks, our approach outperforms recent dynamic loss weighting approaches, e.g. reducing surface estimation errors by 8.97% on SURREAL. When applied to datasets where one or more tasks can have noisy annotations, the proposed method learns to prioritize learning from clean labels for a given task, e.g. reducing surface estimation errors by up to 60%. We also show that we can reliably detect corrupt labels for a given task as a by-product from learned instance-level task parameters.


title: ChemRL-GEM: Geometry Enhanced Molecular Representation Learning for Property Prediction

abstract: Effective molecular representation learning is of great importance to facilitate molecular property prediction, which is a fundamental task for the drug and material industry. Recent advances in graph neural networks (GNNs) have shown great promise in applying GNNs for molecular representation learning. Moreover, a few recent studies have also demonstrated successful applications of self-supervised learning methods to pre-train the GNNs to overcome the problem of insufficient labeled molecules. However, existing GNNs and pre-training strategies usually treat molecules as topological graph data without fully utilizing the molecular geometry information. Whereas, the three-dimensional (3D) spatial structure of a molecule, a.k.a molecular geometry, is one of the most critical factors for determining molecular physical, chemical, and biological properties. To this end, we propose a novel Geometry Enhanced Molecular representation learning method (GEM) for Chemical Representation Learning (ChemRL). At first, we design a geometry-based GNN architecture that simultaneously models atoms, bonds, and bond angles in a molecule. To be specific, we devised double graphs for a molecule: The first one encodes the atom-bond relations; The second one encodes bond-angle relations. Moreover, on top of the devised GNN architecture, we propose several novel geometry-level self-supervised learning strategies to learn spatial knowledge by utilizing the local and global molecular 3D structures. We compare ChemRL-GEM with various state-of-the-art (SOTA) baselines on different molecular benchmarks and exhibit that ChemRL-GEM can significantly outperform all baselines in both regression and classification tasks. For example, the experimental results show an overall improvement of 8.8% on average compared to SOTA baselines on the regression tasks, demonstrating the superiority of the proposed method.


title: Manipulation of Multipartite Entanglement in an Array of Quantum Dots

abstract: Multipartite entanglement is indispensable in the implementation of quantum technologies and the fundamental test of quantum mechanics. Here we study how the W state and W-like state may be generated in a quantum-dot array by controlling the coupling between an incident photon and the quantum dots on a waveguide. We also discuss how the coupling may be controlled to observe the sudden death of entanglement. Our work can find potential applications in quantum information processing.


title: TellMeWhy: A Dataset for Answering Why-Questions in Narratives

abstract: Answering questions about why characters perform certain actions is central to understanding and reasoning about narratives. Despite recent progress in QA, it is not clear if existing models have the ability to answer "why" questions that may require commonsense knowledge external to the input narrative. In this work, we introduce TellMeWhy, a new crowd-sourced dataset that consists of more than 30k questions and free-form answers concerning why characters in short narratives perform the actions described. For a third of this dataset, the answers are not present within the narrative. Given the limitations of automated evaluation for this task, we also present a systematized human evaluation interface for this dataset. Our evaluation of state-of-the-art models show that they are far below human performance on answering such questions. They are especially worse on questions whose answers are external to the narrative, thus providing a challenge for future QA and narrative understanding research.


title: Refining Pseudo Labels with Clustering Consensus over Generations for Unsupervised Object Re-identification

abstract: Unsupervised object re-identification targets at learning discriminative representations for object retrieval without any annotations. Clustering-based methods conduct training with the generated pseudo labels and currently dominate this research direction. However, they still suffer from the issue of pseudo label noise. To tackle the challenge, we propose to properly estimate pseudo label similarities between consecutive training generations with clustering consensus and refine pseudo labels with temporally propagated and ensembled pseudo labels. To the best of our knowledge, this is the first attempt to leverage the spirit of temporal ensembling to improve classification with dynamically changing classes over generations. The proposed pseudo label refinery strategy is simple yet effective and can be seamlessly integrated into existing clustering-based unsupervised re-identification methods. With our proposed approach, state-of-the-art method can be further boosted with up to 8.8% mAP improvements on the challenging MSMT17 dataset.


title: Is Homophily a Necessity for Graph Neural Networks?

abstract: Graph neural networks (GNNs) have shown great prowess in learning representations suitable for numerous graph-based machine learning tasks. When applied to semi-supervised node classification, GNNs are widely believed to work well due to the homophily assumption ("like attracts like"), and fail to generalize to heterophilous graphs where dissimilar nodes connect. Recent works design new architectures to overcome such heterophily-related limitations, citing poor baseline performance and new architecture improvements on a few heterophilous graph benchmark datasets as evidence for this notion. In our experiments, we empirically find that standard graph convolutional networks (GCNs) can actually achieve better performance than such carefully designed methods on some commonly used heterophilous graphs. This motivates us to reconsider whether homophily is truly necessary for good GNN performance. We find that this claim is not quite true, and in fact, GCNs can achieve strong performance on heterophilous graphs under certain conditions. Our work carefully characterizes these conditions, and provides supporting theoretical understanding and empirical observations. Finally, we examine existing heterophilous graphs benchmarks and reconcile how the GCN (under)performs on them based on this understanding.


title: DouZero: Mastering DouDizhu with Self-Play Deep Reinforcement Learning

abstract: Games are abstractions of the real world, where artificial agents learn to compete and cooperate with other agents. While significant achievements have been made in various perfect- and imperfect-information games, DouDizhu (a.k.a. Fighting the Landlord), a three-player card game, is still unsolved. DouDizhu is a very challenging domain with competition, collaboration, imperfect information, large state space, and particularly a massive set of possible actions where the legal actions vary significantly from turn to turn. Unfortunately, modern reinforcement learning algorithms mainly focus on simple and small action spaces, and not surprisingly, are shown not to make satisfactory progress in DouDizhu. In this work, we propose a conceptually simple yet effective DouDizhu AI system, namely DouZero, which enhances traditional Monte-Carlo methods with deep neural networks, action encoding, and parallel actors. Starting from scratch in a single server with four GPUs, DouZero outperformed all the existing DouDizhu AI programs in days of training and was ranked the first in the Botzone leaderboard among 344 AI agents. Through building DouZero, we show that classic Monte-Carlo methods can be made to deliver strong results in a hard domain with a complex action space. The code and an online demo are released at https://github.com/kwai/DouZero with the hope that this insight could motivate future work.


title: Security and Privacy for Healthcare Blockchains

abstract: Healthcare blockchains provide an innovative way to store healthcare information, execute healthcare transactions, and build trust for healthcare data sharing and data integration in a decentralized open healthcare network environment. Although the healthcare blockchain technology has attracted broad interests and attention in industry, government and academia, the security and privacy concerns remain the focus of debate when deploying blockchains for information sharing in the healthcare sector from business operation to research collaboration. This paper focuses on the security and privacy requirements for medical data sharing using blockchain, and provides a comprehensive analysis of the security and privacy risks and requirements, accompanied by technical solution techniques and strategies. First, we discuss the security and privacy requirements and attributes required for electronic medical data sharing by deploying the healthcare blockchain. Second, we categorize existing efforts into three reference blockchain usage scenarios for electronic medical data sharing, and discuss the technologies for implementing these security and privacy properties in the three categories of usage scenarios for healthcare blockchain, such as anonymous signatures, attribute-based encryption, zero-knowledge proofs, verification techniques for smart contract security. Finally, we discuss other potential blockchain application scenarios in healthcare sector. We conjecture that this survey will help healthcare professionals, decision makers, and healthcare service developers to gain technical and intuitive insights into the security and privacy of healthcare blockchains in terms of concepts, risks, requirements, development and deployment technologies and systems.


title: Conformal Bayesian Computation

abstract: We develop scalable methods for producing conformal Bayesian predictive intervals with finite sample calibration guarantees. Bayesian posterior predictive distributions, $p(y \mid x)$, characterize subjective beliefs on outcomes of interest, $y$, conditional on predictors, $x$. Bayesian prediction is well-calibrated when the model is true, but the predictive intervals may exhibit poor empirical coverage when the model is misspecified, under the so called ${\cal{M}}$-open perspective. In contrast, conformal inference provides finite sample frequentist guarantees on predictive confidence intervals without the requirement of model fidelity. Using 'add-one-in' importance sampling, we show that conformal Bayesian predictive intervals are efficiently obtained from re-weighted posterior samples of model parameters. Our approach contrasts with existing conformal methods that require expensive refitting of models or data-splitting to achieve computational efficiency. We demonstrate the utility on a range of examples including extensions to partially exchangeable settings such as hierarchical models.


title: Team RUC_AIM3 Technical Report at ActivityNet 2021: Entities Object Localization

abstract: Entities Object Localization (EOL) aims to evaluate how grounded or faithful a description is, which consists of caption generation and object grounding. Previous works tackle this problem by jointly training the two modules in a framework, which limits the complexity of each module. Therefore, in this work, we propose to divide these two modules into two stages and improve them respectively to boost the whole system performance. For the caption generation, we propose a Unified Multi-modal Pre-training Model (UMPM) to generate event descriptions with rich objects for better localization. For the object grounding, we fine-tune the state-of-the-art detection model MDETR and design a post processing method to make the grounding results more faithful. Our overall system achieves the state-of-the-art performances on both sub-tasks in Entities Object Localization challenge at Activitynet 2021, with 72.57 localization accuracy on the testing set of sub-task I and 0.2477 F1_all_per_sent on the hidden testing set of sub-task II.


title: A comprehensive solution to retrieval-based chatbot construction

abstract: In this paper we present the results of our experiments in training and deploying a self-supervised retrieval-based chatbot trained with contrastive learning for assisting customer support agents. In contrast to most existing research papers in this area where the focus is on solving just one component of a deployable chatbot, we present an end-to-end set of solutions to take the reader from an unlabelled chatlogs to a deployed chatbot. This set of solutions includes creating a self-supervised dataset and a weakly labelled dataset from chatlogs, as well as a systematic approach to selecting a fixed list of canned responses. We present a hierarchical-based RNN architecture for the response selection model, chosen for its ability to cache intermediate utterance embeddings, which helped to meet deployment inference speed requirements. We compare the performance of this architecture across 3 different learning objectives: self-supervised contrastive learning, binary classification, and multi-class classification. We find that using a self-supervised contrastive learning model outperforms training the binary and multi-class classification models on a weakly labelled dataset. Our results validate that the self-supervised contrastive learning approach can be effectively used for a real-world chatbot scenario.


title: Competing flow and collision effects in a monodispersed liquid-solid fluidized bed at a moderate Archimedes number

abstract: We study the effects of fluid-particle and particle-particle interactions in a three-dimensional monodispersed reactor with unstable fluidization. Simulations were conducted using the Immersed Boundary Method (IBM) for particle Reynolds numbers of 20-70 with an Archimedes number of 23600. Two different flow regimes were identified as a function of the particle Reynolds number. For low particle Reynolds numbers ($20 < Re_p < 40$), the porosity is relatively low and the particle dynamics are dominated by interparticle collisions that produce anisotropic particle velocity fluctuations. The relative importance of hydrodynamic effects increases with increasing particle Reynolds number, leading to a minimized anisotropy in the particle velocity fluctuations at an intermediate particle Reynolds number. For high particle Reynolds numbers ($Re_p > 40$), the particle dynamics are dominated by hydrodynamic effects, leading to decreasing and more anisotropic particle velocity fluctuations. A sharp increase in the anisotropy occurs when the particle Reynolds number increases from 40 to 50, corresponding to a transition from a regime in which collision and hydrodynamic effects are equally important (Regime 1) to a hydrodynamic-dominated regime (Regime 2). The results imply an optimum particle Reynolds number of roughly 40 for the investigated Archimedes number of 23600 at which mixing in the reactor is expected to peak, which is consistent with reactor studies showing peak performance at a similar particle Reynolds number and with a similar Archimedes number. Results also show that maximum effective collisions are attained at intermediate particle Reynolds number. Future work is required to relate optimum particle Reynolds number to Archimedes number.


title: A Taxonomy of Data Quality Challenges in Empirical Software Engineering

abstract: Reliable empirical models such as those used in software effort estimation or defect prediction are inherently dependent on the data from which they are built. As demands for process and product improvement continue to grow, the quality of the data used in measurement and prediction systems warrants increasingly close scrutiny. In this paper we propose a taxonomy of data quality challenges in empirical software engineering, based on an extensive review of prior research. We consider current assessment techniques for each quality issue and proposed mechanisms to address these issues, where available. Our taxonomy classifies data quality issues into three broad areas: first, characteristics of data that mean they are not fit for modeling; second, data set characteristics that lead to concerns about the suitability of applying a given model to another data set; and third, factors that prevent or limit data accessibility and trust. We identify this latter area as of particular need in terms of further research.


title: DORO: Distributional and Outlier Robust Optimization

abstract: Many machine learning tasks involve subpopulation shift where the testing data distribution is a subpopulation of the training distribution. For such settings, a line of recent work has proposed the use of a variant of empirical risk minimization(ERM) known as distributionally robust optimization (DRO). In this work, we apply DRO to real, large-scale tasks with subpopulation shift, and observe that DRO performs relatively poorly, and moreover has severe instability. We identify one direct cause of this phenomenon: sensitivity of DRO to outliers in the datasets. To resolve this issue, we propose the framework of DORO, for Distributional and Outlier Robust Optimization. At the core of this approach is a refined risk function which prevents DRO from overfitting to potential outliers. We instantiate DORO for the Cressie-Read family of R\'enyi divergence, and delve into two specific instances of this family: CVaR and $\chi^2$-DRO. We theoretically prove the effectiveness of the proposed method, and empirically show that DORO improves the performance and stability of DRO with experiments on large modern datasets, thereby positively addressing the open question raised by Hashimoto et al., 2018.


title: Monotonic Neural Network: combining Deep Learning with Domain Knowledge for Chiller Plants Energy Optimization

abstract: In this paper, we are interested in building a domain knowledge based deep learning framework to solve the chiller plants energy optimization problems. Compared to the hotspot applications of deep learning (e.g. image classification and NLP), it is difficult to collect enormous data for deep network training in real-world physical systems. Most existing methods reduce the complex systems into linear model to facilitate the training on small samples. To tackle the small sample size problem, this paper considers domain knowledge in the structure and loss design of deep network to build a nonlinear model with lower redundancy function space. Specifically, the energy consumption estimation of most chillers can be physically viewed as an input-output monotonic problem. Thus, we can design a Neural Network with monotonic constraints to mimic the physical behavior of the system. We verify the proposed method in a cooling system of a data center, experimental results show the superiority of our framework in energy optimization compared to the existing ones.


title: Defect-free arbitrary-geometry assembly of mixed-species atom arrays

abstract: Optically trapped mixed-species single atom arrays with arbitrary geometries are an attractive and promising platform for various applications, because tunable quantum systems with multiple components provide extra degrees of freedom for experimental control. Here, we report the first demonstration of two-dimensional $6\times4$ dual-species atom assembly with a filling fraction of 0.88 (0.89) for $^{85}$Rb ($^{87}$Rb) atoms. This mixed-species atomic synthetic is achieved via rearranging initially randomly distributed atoms using a sorting algorithm (heuristic heteronuclear algorithm) which is proposed for bottom-up atom assembly with both user-defined geometries and two-species atom number ratios. Our fully tunable hybrid-atom system of scalable advantages is a good starting point for high-fidelity quantum logic, many-body quantum simulation and forming defect-free single molecule arrays.


title: Reconstructing inflation in scalar-torsion $f(T,\phi)$ gravity

abstract: It is investigated the reconstruction during the slow-roll inflation in the most general class of scalar-torsion theories whose Lagrangian density is an arbitrary function $f(T,\phi)$ of the torsion scalar $T$ of teleparallel gravity and the inflaton $\phi$. For the class of theories with Lagrangian density $f(T,\phi)=-M_{pl}^{2} T/2 - G(T) F(\phi) - V(\phi)$, with $G(T)\sim T^{s+1}$ and the power $s$ as constant, we consider a reconstruction scheme for determining both the non-minimal coupling function $F(\phi)$ and the scalar potential $V(\phi)$ through the parametrization (or attractor) of the scalar spectral index $n_{s}(N)$ and the tensor-to-scalar ratio $r(N)$ as functions of the number of $e-$folds $N$. As specific examples, we analyze the attractors $n_{s}-1 \propto 1/N$ and $r\propto 1/N$, as well as the case $r\propto 1/N (N+\gamma)$ with $\gamma$ a dimensionless constant. In this sense and depending on the attractors considered, we obtain different expressions for the function $F(\phi)$ and the potential $V(\phi)$, as also the constraints on the parameters present in our model and its reconstruction.


title: Andreev reflection adjusting in the multi-terminal device with the kink states

abstract: At the domain wall between two regions with the opposite Chern number, there should be the one-dimensional chiral states, which are called as the kink states. The kink states are robust for the lattice deformations. We design a multi-terminal device with the kink states to study the local Andreev reflection and the crossed Andreev reflection. The coefficient of the crossed Andreev reflection can reach 1 in the four-terminal device. Besides adjusting the phase difference between superconductors, the local Andreev reflection and the crossed Andreev reflection can be controlled by changing the on-site energy and the stagger energy in the four-terminal device. Our results give some new ideas to design the quantum device in the future.


title: NAAQA: A Neural Architecture for Acoustic Question Answering

abstract: The goal of the Acoustic Question Answering (AQA) task is to answer a free-form text question about the content of an acoustic scene. It was inspired by the Visual Question Answering (VQA) task. In this paper, based on the previously introduced CLEAR dataset, we propose a new benchmark for AQA, namely CLEAR2, that emphasizes the specific challenges of acoustic inputs. These include handling of variable duration scenes, and scenes built with elementary sounds that differ between training and test set. We also introduce NAAQA, a neural architecture that leverages specific properties of acoustic inputs. The use of 1D convolutions in time and frequency to process 2D spectro-temporal representations of acoustic content shows promising results and enables reductions in model complexity. We show that time coordinate maps augment temporal localization capabilities which enhance performance of the network by ~17 percentage points. On the other hand, frequency coordinate maps have little influence on this task. NAAQA achieves 79.5% of accuracy on the AQA task with ~4 times fewer parameters than the previously explored VQA model. We evaluate the perfomance of NAAQA on an independent data set reconstructed from DAQA. We also test the addition of a MALiMo module in our model on both CLEAR2 and DAQA. We provide a detailed analysis of the results for the different question types. We release the code to produce CLEAR2 as well as NAAQA to foster research in this newly emerging machine learning task.


title: Cell-Free Symbiotic Radio: Channel Estimation Method and Achievable Rate Analysis

abstract: Cell-free massive MIMO and symbiotic radio are promising beyond 5G (B5G) networking architecture and transmission technology, respectively. This paper studies cell-free symbiotic radio systems, where a number of distributed access points (APs) cooperatively send primary information to a receiver, and simultaneously support the backscattering communication of the secondary backscatter device (BD). An efficient two-phase uplink-training based channel estimation method is proposed to estimate the direct-link channel and cascaded backscatter channel, and the achievable primary and secondary communication rates taking into account the channel estimation errors are derived. Furthermore, to achieve a flexible trade-off between the primary and secondary communication rates, we propose a low-complexity weighted-maximal-ratio transmission (weighted-MRT) beamforming scheme, which only requires local processing at each AP without having to exchange the estimated channel state information. Simulation results are provided to show the impact of the channel training lengths on the performance of the cell-free symbiotic radio systems.


title: Third-order many-body expansion of OSV-MP2 wavefunction for low-order scaling analytical gradient computation

abstract: We present a many-body expansion (MBE) formulation and implementation for efficient computation of analytical energy gradients from OSV-MP2 theory based on our earlier work (Zhou et al. J. Chem. Theory Comput. 2020, 16, 196-210). The third-order MBE(3) expansion of OSV-MP2 wavefunction was developed to adopt the orbital-specific clustering and long-range termination schemes, which avoids term-by-term differentiations of the MBE energy bodies. We achieve better efficiency by exploiting the algorithmic sparsity that allows to prune out insignificant fitting integrals and OSV relaxations. With these approximations, the present implementation is benchmarked on a range of molecules that show an economic scaling in the linear and quadratic regimes for computing MBE(3)-OSV-MP2 amplitude and gradient equations, respectively, and yields normal accuracy comparable to the original OSV-MP2 results. The MPI-3-based parallelism through shared memory one-sided communication is further developed for improving parallel scalability and memory accessibility by sorting the MBE(3) orbital clusters into independent tasks that are distributed on multiple processes across many nodes, supporting both global and local data locations in which selected MBE(3)-OSV-MP2 intermediates of different sizes are distinguished and accordingly placed. The accuracy and efficiency level of our MBE(3)-OSV-MP2 analytical gradient implementation is finally illustrated in two applications: we show that the subtle coordination structure differences of mechanically interlocked Cu-catenane complexes can be distinguished when tuning ligand lengths; and the porphycene molecular dynamics reveals the emergence of the vibrational signature arising from softened N-H stretching associated with hydrogen transfer, using an MP2 level of electron correlation and classical nuclei for the first time.


title: Global Neighbor Sampling for Mixed CPU-GPU Training on Giant Graphs

abstract: Graph neural networks (GNNs) are powerful tools for learning from graph data and are widely used in various applications such as social network recommendation, fraud detection, and graph search. The graphs in these applications are typically large, usually containing hundreds of millions of nodes. Training GNN models on such large graphs efficiently remains a big challenge. Despite a number of sampling-based methods have been proposed to enable mini-batch training on large graphs, these methods have not been proved to work on truly industry-scale graphs, which require GPUs or mixed-CPU-GPU training. The state-of-the-art sampling-based methods are usually not optimized for these real-world hardware setups, in which data movement between CPUs and GPUs is a bottleneck. To address this issue, we propose Global Neighborhood Sampling that aims at training GNNs on giant graphs specifically for mixed-CPU-GPU training. The algorithm samples a global cache of nodes periodically for all mini-batches and stores them in GPUs. This global cache allows in-GPU importance sampling of mini-batches, which drastically reduces the number of nodes in a mini-batch, especially in the input layer, to reduce data copy between CPU and GPU and mini-batch computation without compromising the training convergence rate or model accuracy. We provide a highly efficient implementation of this method and show that our implementation outperforms an efficient node-wise neighbor sampling baseline by a factor of 2X-4X on giant graphs. It outperforms an efficient implementation of LADIES with small layers by a factor of 2X-14X while achieving much higher accuracy than LADIES.We also theoretically analyze the proposed algorithm and show that with cached node data of a proper size, it enjoys a comparable convergence rate as the underlying node-wise sampling method.


title: Anomalous Sound Detection Using a Binary Classification Model and Class Centroids

abstract: An anomalous sound detection system to detect unknown anomalous sounds usually needs to be built using only normal sound data. Moreover, it is desirable to improve the system by effectively using a small amount of anomalous sound data, which will be accumulated through the system's operation. As one of the methods to meet these requirements, we focus on a binary classification model that is developed by using not only normal data but also outlier data in the other domains as pseudo-anomalous sound data, which can be easily updated by using anomalous data. In this paper, we implement a new loss function based on metric learning to learn the distance relationship from each class centroid in feature space for the binary classification model. The proposed multi-task learning of the binary classification and the metric learning makes it possible to build the feature space where the within-class variance is minimized and the between-class variance is maximized while keeping normal and anomalous classes linearly separable. We also investigate the effectiveness of additionally using anomalous sound data for further improving the binary classification model. Our results showed that multi-task learning using binary classification and metric learning to consider the distance from each class centroid in the feature space is effective, and performance can be significantly improved by using even a small amount of anomalous data during training.


title: On the Robustness of Average Losses for Partial-Label Learning

abstract: Partial-label learning (PLL) utilizes instances with PLs, where a PL includes several candidate labels but only one is the true label (TL). In PLL, identification-based strategy (IBS) purifies each PL on the fly to select the (most likely) TL for training; average-based strategy (ABS) treats all candidate labels equally for training and let trained models be able to predict TL. Although PLL research has focused on IBS for better performance, ABS is also worthy of study since modern IBS behaves like ABS in the beginning of training to prepare for PL purification and TL selection. In this paper, we analyze why ABS was unsatisfactory and propose how to improve it. Theoretically, we formalize five problem settings of PLL and prove that average PL losses (APLLs) with bounded multi-class losses are always robust, while APLLs with unbounded losses may be non-robust, which is the first robustness analysis for PLL. Experimentally, we have two promising findings: ABS using bounded losses can match/exceed state-of-the-art performance of IBS using unbounded losses; after using robust APLLs to warm start, IBS can further improve upon itself. Our work draws attention to ABS research, which can in turn boost IBS and push forward the whole PLL.


title: Towards Understanding Generalization via Decomposing Excess Risk Dynamics

abstract: Generalization is one of the fundamental issues in machine learning. However, traditional techniques like uniform convergence may be unable to explain generalization under overparameterization. As alternative approaches, techniques based on stability analyze the training dynamics and derive algorithm-dependent generalization bounds. Unfortunately, the stability-based bounds are still far from explaining the surprising generalization in deep learning since neural networks usually suffer from unsatisfactory stability. This paper proposes a novel decomposition framework to improve the stability-based bounds via a more fine-grained analysis of the signal and noise, inspired by the observation that neural networks converge relatively slowly when fitting noise (which indicates better stability). Concretely, we decompose the excess risk dynamics and apply the stability-based bound only on the noise component. The decomposition framework performs well in both linear regimes (overparameterized linear regression) and non-linear regimes (diagonal matrix recovery). Experiments on neural networks verify the utility of the decomposition framework.


title: Self-organising Roles in Agile Globally Distributed Teams

abstract: The ability to self-organise is posited to be a fundamental requirement for successful agile teams. In particular, self-organising teams are said to be crucial in agile globally distributed software development (AGSD) settings, where distance exacerbates team issues. We used contextual analysis to study the specific interaction behaviours and enacted roles of practitioners working in multiple AGSD teams. Our results show that the teams studied were extremely task focussed, and those who occupied team lead or programmer roles were central to their teams' self-organisation. These findings have implications for AGSD teams, and particularly for instances when programmers - or those occupying similar non-leadership positions - may not be willing to accept such responsibilities. We discuss the implications of our findings for information system development (ISD) practice.


title: $B_c \to D^{(*)}\tau \bar \nu_\tau$ processes in an effective field theory approach

abstract: We present a compressive study on rare semileptonic $B_c \to D^{(*)}\tau \bar \nu_\tau$ decays involving $b \to u \tau \bar \nu_\tau$ quark level transitions in an effective field theory approach. We consider the presence of an additional (pseudo)vector and (pseudo)scalar type interactions which can be either complex or real and constrain the new couplings using the existing data on $R_{D^{(*)}}$, $R_{J/\psi}$, $R_\pi^l$, Br($B_{u,c} \to \tau \bar \nu_\tau$) and Br($B \to\pi \tau \bar \nu_\tau$) parameters. In order to segregate the sensitivity of new coefficients, we check the effects of these couplings on the branching ratios, lepton non-universality and various angular observables of $B_c \to D^{(*)}\tau \bar \nu_\tau$ processes.


title: The TESS-Keck Survey: Science Goals and Target Selection

abstract: Space-based transit missions such as Kepler and TESS have demonstrated that planets are ubiquitous. However, the success of these missions heavily depends on ground-based radial velocity (RV) surveys, which combined with transit photometry can yield bulk densities and orbital properties. While most Kepler host stars are too faint for detailed follow-up observations, TESS is detecting planets orbiting nearby bright stars that are more amenable to RV characterization. Here we introduce the TESS-Keck Survey (TKS), an RV program using ~100 nights on Keck/HIRES to study exoplanets identified by TESS. The primary survey aims are investigating the link between stellar properties and the compositions of small planets; studying how the diversity of system architectures depends on dynamical configurations or planet multiplicity; identifying prime candidates for atmospheric studies with JWST; and understanding the role of stellar evolution in shaping planetary systems. We present a fully-automated target selection algorithm, which yielded 103 planets in 86 systems for the final TKS sample. Most TKS hosts are inactive, solar-like, main-sequence stars (4500 K < Teff < 6000 K) at a wide range of metallicities. The selected TKS sample contains 71 small planets (Rp < 4 Re), 11 systems with multiple transiting candidates, 6 sub-day period planets and 3 planets that are in or near the habitable zone of their host star. The target selection described here will facilitate the comparison of measured planet masses, densities, and eccentricities to predictions from planet population models. Our target selection software is publicly available (at https://github.com/ashleychontos/sort-a-survey) and can be adapted for any survey which requires a balance of multiple science interests within a given telescope allocation.


title: Assessing Political Prudence of Open-domain Chatbots

abstract: Politically sensitive topics are still a challenge for open-domain chatbots. However, dealing with politically sensitive content in a responsible, non-partisan, and safe behavior way is integral for these chatbots. Currently, the main approach to handling political sensitivity is by simply changing such a topic when it is detected. This is safe but evasive and results in a chatbot that is less engaging. In this work, as a first step towards a politically safe chatbot, we propose a group of metrics for assessing their political prudence. We then conduct political prudence analysis of various chatbots and discuss their behavior from multiple angles through our automatic metric and human evaluation metrics. The testsets and codebase are released to promote research in this area.


title: PyGAD: An Intuitive Genetic Algorithm Python Library

abstract: This paper introduces PyGAD, an open-source easy-to-use Python library for building the genetic algorithm. PyGAD supports a wide range of parameters to give the user control over everything in its life cycle. This includes, but is not limited to, population, gene value range, gene data type, parent selection, crossover, and mutation. PyGAD is designed as a general-purpose optimization library that allows the user to customize the fitness function. Its usage consists of 3 main steps: build the fitness function, create an instance of the pygad.GA class, and calling the pygad.GA.run() method. The library supports training deep learning models created either with PyGAD itself or with frameworks like Keras and PyTorch. Given its stable state, PyGAD is also in active development to respond to the user's requested features and enhancement received on GitHub https://github.com/ahmedfgad/GeneticAlgorithmPython. PyGAD comes with documentation https://pygad.readthedocs.io for further details and examples.


title: Learning the Precise Feature for Cluster Assignment

abstract: Clustering is one of the fundamental tasks in computer vision and pattern recognition. Recently, deep clustering methods (algorithms based on deep learning) have attracted wide attention with their impressive performance. Most of these algorithms combine deep unsupervised representation learning and standard clustering together. However, the separation of representation learning and clustering will lead to suboptimal solutions because the two-stage strategy prevents representation learning from adapting to subsequent tasks (e.g., clustering according to specific cues). To overcome this issue, efforts have been made in the dynamic adaption of representation and cluster assignment, whereas current state-of-the-art methods suffer from heuristically constructed objectives with representation and cluster assignment alternatively optimized. To further standardize the clustering problem, we audaciously formulate the objective of clustering as finding a precise feature as the cue for cluster assignment. Based on this, we propose a general-purpose deep clustering framework which radically integrates representation learning and clustering into a single pipeline for the first time. The proposed framework exploits the powerful ability of recently developed generative models for learning intrinsic features, and imposes an entropy minimization on the distribution of the cluster assignment by a dedicated variational algorithm. Experimental results show that the performance of the proposed method is superior, or at least comparable to, the state-of-the-art methods on the handwritten digit recognition, fashion recognition, face recognition and object recognition benchmark datasets.


title: Spoken Term Detection Methods for Sparse Transcription in Very Low-resource Settings

abstract: We investigate the efficiency of two very different spoken term detection approaches for transcription when the available data is insufficient to train a robust ASR system. This work is grounded in very low-resource language documentation scenario where only few minutes of recording have been transcribed for a given language so far.Experiments on two oral languages show that a pretrained universal phone recognizer, fine-tuned with only a few minutes of target language speech, can be used for spoken term detection with a better overall performance than a dynamic time warping approach. In addition, we show that representing phoneme recognition ambiguity in a graph structure can further boost the recall while maintaining high precision in the low resource spoken term detection task.


title: Bandwidth-Optimal Random Shuffling for GPUs

abstract: Linear-time algorithms that are traditionally used to shuffle data on CPUs, such as the method of Fisher-Yates, are not well suited to implementation on GPUs due to inherent sequential dependencies, and existing parallel shuffling algorithms are unsuitable for GPU architectures because they incur a large number of read/write operations to high latency global memory. To address this, we provide a method of generating pseudo-random permutations in parallel by fusing suitable pseudo-random bijective functions with stream compaction operations. Our algorithm, termed `bijective shuffle' trades increased per-thread arithmetic operations for reduced global memory transactions. It is work-efficient, deterministic, and only requires a single global memory read and write per shuffle input, thus maximising use of global memory bandwidth. To empirically demonstrate the correctness of the algorithm, we develop a statistical test for the quality of pseudo-random permutations based on kernel space embeddings. Experimental results show that the bijective shuffle algorithm outperforms competing algorithms on GPUs, showing improvements of between one and two orders of magnitude and approaching peak device bandwidth.


title: Hybrid Generative-Contrastive Representation Learning

abstract: Unsupervised representation learning has recently received lots of interest due to its powerful generalizability through effectively leveraging large-scale unlabeled data. There are two prevalent approaches for this, contrastive learning and generative pre-training, where the former learns representations from instance-wise discrimination tasks and the latter learns them from estimating the likelihood. These seemingly orthogonal approaches have their own strengths and weaknesses. Contrastive learning tends to extract semantic information and discards details irrelevant for classifying objects, making the representations effective for discriminative tasks while degrading robustness to out-of-distribution data. On the other hand, the generative pre-training directly estimates the data distribution, so the representations tend to be robust but not optimal for discriminative tasks. In this paper, we show that we could achieve the best of both worlds by a hybrid training scheme. Specifically, we demonstrated that a transformer-based encoder-decoder architecture trained with both contrastive and generative losses can learn highly discriminative and robust representations without hurting the generative performance. We extensively validate our approach on various tasks.


title: Deception Detection in Group Video Conversations using Dynamic Interaction Networks

abstract: Detecting groups of people who are jointly deceptive in video conversations is crucial in settings such as meetings, sales pitches, and negotiations. Past work on deception in videos focuses on detecting a single deceiver and uses facial or visual features only. In this paper, we propose the concept of Face-to-Face Dynamic Interaction Networks (FFDINs) to model the interpersonal interactions within a group of people. The use of FFDINs enables us to leverage network relations in detecting group deception in video conversations for the first time. We use a dataset of 185 videos from a deception-based game called Resistance. We first characterize the behavior of individual, pairs, and groups of deceptive participants and compare them to non-deceptive participants. Our analysis reveals that pairs of deceivers tend to avoid mutual interaction and focus their attention on non-deceivers. In contrast, non-deceivers interact with everyone equally. We propose Negative Dynamic Interaction Networks to capture the notion of missing interactions. We create the DeceptionRank algorithm to detect deceivers from NDINs extracted from videos that are just one minute long. We show that our method outperforms recent state-of-the-art computer vision, graph embedding, and ensemble methods by at least 20.9% AUROC in identifying deception from videos.


title: A new look at calendar anomalies: Multifractality and day of the week effect

abstract: Stock markets can become inefficient due to calendar anomalies known as day-of-the-week effect. Calendar anomalies are well-known in financial literature, but the phenomena remain to be explored in econophysics. In this paper we use multifractal analysis to evaluate if the temporal dynamics of market returns also exhibits calendar anomalies such as day-of-the-week effects. We apply the multifractal detrended fluctuation analysis (MF-DFA) to daily returns of market indices around the world for each day of the week. Our results indicate that individual days of the week are characterized by distinct multifractal properties. Monday returns tend to exhibit more persistent behavior and richer multifractal structures than other day-resolved returns. Shuffling the series reveals that multifractality arises both from a broad probability density function and from long-term correlations. From the time-dependent multifractal analysis we find that multifractal spectra for Monday returns are much wider than for other days during periods of financial crises. The presence of day-of-the-week effects in multifractal dynamics of market returns motivates further research on calendar anomalies from an econophysics perspective.


title: Modeling Sequences as Distributions with Uncertainty for Sequential Recommendation

abstract: The sequential patterns within the user interactions are pivotal for representing the user's preference and capturing latent relationships among items. The recent advancements of sequence modeling by Transformers advocate the community to devise more effective encoders for the sequential recommendation. Most existing sequential methods assume users are deterministic. However, item-item transitions might fluctuate significantly in several item aspects and exhibit randomness of user interests. This \textit{stochastic characteristics} brings up a solid demand to include uncertainties in representing sequences and items. Additionally, modeling sequences and items with uncertainties expands users' and items' interaction spaces, thus further alleviating cold-start problems. In this work, we propose a Distribution-based Transformer for Sequential Recommendation (DT4SR), which injects uncertainties into sequential modeling. We use Elliptical Gaussian distributions to describe items and sequences with uncertainty. We describe the uncertainty in items and sequences as Elliptical Gaussian distribution. And we adopt Wasserstein distance to measure the similarity between distributions. We devise two novel Trans-formers for modeling mean and covariance, which guarantees the positive-definite property of distributions. The proposed method significantly outperforms the state-of-the-art methods. The experiments on three benchmark datasets also demonstrate its effectiveness in alleviating cold-start issues. The code is available inhttps://github.com/DyGRec/DT4SR.


title: Self-Guided Quantum State Learning for Mixed States

abstract: We provide an adaptive learning algorithm for tomography of general quantum states. Our proposal is based on the simultaneous perturbation stochastic approximation algorithm and is applicable on mixed qudit states. The salient features of our algorithm are efficient ($O \left( d^3 \right)$) post-processing in the dimension $d$ of the state, robustness against measurement and channel noise, and improved infidelity performance as compared to the contemporary adaptive state learning algorithms. A higher resilience against measurement noise makes our algorithm suitable for noisy intermediate-scale quantum applications.


title: HIFI: Anomaly Detection for Multivariate Time Series with High-order Feature Interactions

abstract: Monitoring complex systems results in massive multivariate time series data, and anomaly detection of these data is very important to maintain the normal operation of the systems. Despite the recent emergence of a large number of anomaly detection algorithms for multivariate time series, most of them ignore the correlation modeling among multivariate, which can often lead to poor anomaly detection results. In this work, we propose a novel anomaly detection model for multivariate time series with \underline{HI}gh-order \underline{F}eature \underline{I}nteractions (HIFI). More specifically, HIFI builds multivariate feature interaction graph automatically and uses the graph convolutional neural network to achieve high-order feature interactions, in which the long-term temporal dependencies are modeled by attention mechanisms and a variational encoding technique is utilized to improve the model performance and robustness. Extensive experiments on three publicly available datasets demonstrate the superiority of our framework compared with state-of-the-art approaches.


title: Generate, Annotate, and Learn: NLP with Synthetic Text

abstract: This paper studies the use of language models as a source of synthetic unlabeled text for NLP. We formulate a general framework called ``generate, annotate, and learn (GAL)'' to take advantage of synthetic text within knowledge distillation, self-training, and few-shot learning applications. To generate high-quality task-specific text, we either fine-tune LMs on inputs from the task of interest, or prompt large LMs with few examples. We use the best available classifier to annotate synthetic text with soft pseudo labels for knowledge distillation and self-training, and use LMs to obtain hard labels for few-shot learning. We train new supervised models on the combination of labeled and pseudo-labeled data, which results in significant gains across several applications. We investigate key components of GAL and present theoretical and empirical arguments against the use of class-conditional LMs to generate synthetic labeled text instead of unlabeled text. GAL achieves new state-of-the-art knowledge distillation results for 6-layer transformers on the GLUE leaderboard.


title: BoB: BERT Over BERT for Training Persona-based Dialogue Models from Limited Personalized Data

abstract: Maintaining consistent personas is essential for dialogue agents. Although tremendous advancements have been brought, the limited-scale of annotated persona-dense data are still barriers towards training robust and consistent persona-based dialogue models. In this work, we show how the challenges can be addressed by disentangling persona-based dialogue generation into two sub-tasks with a novel BERT-over-BERT (BoB) model. Specifically, the model consists of a BERT-based encoder and two BERT-based decoders, where one decoder is for response generation, and another is for consistency understanding. In particular, to learn the ability of consistency understanding from large-scale non-dialogue inference data, we train the second decoder in an unlikelihood manner. Under different limited data settings, both automatic and human evaluations demonstrate that the proposed model outperforms strong baselines in response quality and persona consistency.


title: Taylor Expansion of Discount Factors

abstract: In practical reinforcement learning (RL), the discount factor used for estimating value functions often differs from that used for defining the evaluation objective. In this work, we study the effect that this discrepancy of discount factors has during learning, and discover a family of objectives that interpolate value functions of two distinct discount factors. Our analysis suggests new ways for estimating value functions and performing policy optimization updates, which demonstrate empirical performance gains. This framework also leads to new insights on commonly-used deep RL heuristic modifications to policy optimization algorithms.


title: Inter-domain Multi-relational Link Prediction

abstract: Multi-relational graph is a ubiquitous and important data structure, allowing flexible representation of multiple types of interactions and relations between entities. Similar to other graph-structured data, link prediction is one of the most important tasks on multi-relational graphs and is often used for knowledge completion. When related graphs coexist, it is of great benefit to build a larger graph via integrating the smaller ones. The integration requires predicting hidden relational connections between entities belonged to different graphs (inter-domain link prediction). However, this poses a real challenge to existing methods that are exclusively designed for link prediction between entities of the same graph only (intra-domain link prediction). In this study, we propose a new approach to tackle the inter-domain link prediction problem by softly aligning the entity distributions between different domains with optimal transport and maximum mean discrepancy regularizers. Experiments on real-world datasets show that optimal transport regularizer is beneficial and considerably improves the performance of baseline methods.


title: Deterministic Generation of Genuine Tri-Partite Hybrid Atom-Photon Entanglement through Dissipation

abstract: The ability to deterministically generate genuine multi-partite entanglement is fundamental for the advancement of quantum information science. We show that the interaction between entangled twin beams of light and an atomic ensemble under conditions for electromagnetically induced transparency leads to the generation of genuine hybrid tri-partite entanglement between the two input fields and the atomic ensemble. In such a configuration, the system is driven through dissipation to a steady state given by the hybrid entangled state. To show the presence of the genuine hybrid entanglement, we introduce a new approach to treat the atomic operators that makes it possible to show a violation of a tri-partite entanglement criterion based on the properties of the two optical fields and collective properties of the atomic ensemble. Additionally, we show that while each of the input optical fields does not exhibit single beam quadrature squeezing, as the fields propagate through the atomic medium their individual quadratures can become squeezed and in some cases oscillate between the presence and absence of squeezing. Finally, we propose a technique to characterize the tri-partite entanglement through joint measurements of the fields leaving the atomic medium, making such an approach experimentally accessible.


title: A practical guide for building superconducting quantum devices

abstract: Quantum computing offers a powerful new paradigm of information processing that has the potential to transform a wide range of industries. In the pursuit of the tantalizing promises of a universal quantum computer, a multitude of new knowledge and expertise has been developed, enabling the construction of novel quantum algorithms as well as increasingly robust quantum hardware. In particular, we have witnessed rapid progress in the circuit quantum electrodynamics (cQED) technology, which has emerged as one of the most promising physical systems that is capable of addressing the key challenges in realizing full-stack quantum computing on a large scale. In this article, we present some of the most crucial building blocks developed by the cQED community in recent years and a pr\'{e}cis of the latest achievements towards robust universal quantum computation. More importantly, we aim to provide a synoptic outline of the core techniques that underlie most cQED experiments and offer a practical guide for a novice experimentalist to design, construct, and characterize their first quantum device


title: Competition on Dynamic Optimization Problems Generated by Generalized Moving Peaks Benchmark (GMPB)

abstract: This document introduces the Generalized Moving Peaks Benchmark (GMPB), a tool for generating continuous dynamic optimization problem instances that is used for the CEC 2024 Competition on Dynamic Optimization. GMPB is adept at generating landscapes with a broad spectrum of characteristics, offering everything from unimodal to highly multimodal landscapes and ranging from symmetric to highly asymmetric configurations. The landscapes also vary in texture, from smooth to highly irregular surfaces, encompassing diverse degrees of variable interaction and conditioning. This document delves into the intricacies of GMPB, detailing the myriad ways in which its parameters can be tuned to produce these diverse landscape characteristics. GMPB's MATLAB implementation is available on the EDOLAB Platform.


title: Superconductivity and Quantum Oscillations in Single Crystals of the Compensated Semimetal CaSb$_{2}$

abstract: Bulk superconductivity in a topological semimetal is a first step towards realizing topological superconductors, which can host Majorana fermions allowing us to achieve quantum computing. Here, we report superconductivity and compensation of electrons and holes in single crystals of the nodal-line semimetal CaSb$_2$. We characterize the superconducting state and find that Cooper pairs have moderate-weak coupling, and the superconducting transition in specific heat down to 0.22 K deviates from that of a BCS superconductor. The non-saturating magnetoresistance and electron-hole compensation at low temperature are consistent with density functional theory (DFT) calculations showing nodal-line features. Furthermore, we observe de Haas-van Alphen (dHvA) oscillations consistent with a small Fermi surface in the semimetallic state of CaSb$_2$. Our DFT calculations show that the two electron bands crossing the Fermi level are associated with Sb1 zig-zag chains, while the hole band is associated with Sb2 zig-zag chains. The Sb1 zig-zag chains form a distorted square net, which may relate the $M$Sb$_2$ family to the well known $M$SbTe square net semimetals. Realization of superconductivity and a compensated semimetal state in single crystals of CaSb$_2$ establishes the diantimonide family as a candidate class of materials for achieving topological superconductivity.


title: An application of data driven reward of deep reinforcement learning by dynamic mode decomposition in active flow control

abstract: This paper focuses on the active flow control (AFC) of the flow over a circular cylinder with synthetic jets through deep reinforcement learning (DRL) by implementing a reward function based on dynamic mode decomposition (DMD). As a main factor that affects the DRL model, the reward is determined by the information extracted from flow field by performing DMD on measurements through simulation. With the data-driven reward, the DRL model is able to learn the AFC policy through the more global information of the field, and instructs the mass flow rate of the synthetic jets. As a result of this type of AFC, the vortex street is stabilized with a reduction of approximately 8% in drag and an improvement of approximately 109% in recirculation area. Furthermore, the configuration of the flow modified by the AFC is studied with DMD on the velocity measurement of the complete flow field.


title: Existence of quasiconformal maps with maximal stretching on any given countable set

abstract: Quasiconformal maps are homeomorphisms with useful local distortion inequalities; infinitesimally, they map balls to ellipsoids with bounded eccentricity. This leads to a number of useful regularity properties, including quantitative H\"older continuity estimates; on the other hand, one can use the radial stretches to characterize the extremizers for H\"older continuity. In this work, given any bounded countable set in $\mathbb{R}^d$, we will construct an example of a $K$-quasiconformal map which exhibits the maximum stretching at each point of the set. This will provide an example of a quasiconformal map that exhibits the worst-case regularity on a surprisingly large set, and generalizes constructions from the planar setting into $\mathbb{R}^d$.


title: AI Empowered Resource Management for Future Wireless Networks

abstract: Resource management plays a pivotal role in wireless networks, which, unfortunately, leads to challenging NP-hard problems. Artificial Intelligence (AI), especially deep learning techniques, has recently emerged as a disruptive technology to solve such challenging problems in a real-time manner. However, although promising results have been reported, practical design guidelines and performance guarantees of AI-based approaches are still missing. In this paper, we endeavor to address two fundamental questions: 1) What are the main advantages of AI-based methods compared with classical techniques; and 2) Which neural network should we choose for a given resource management task. For the first question, four advantages are identified and discussed. For the second question, \emph{optimality gap}, i.e., the gap to the optimal performance, is proposed as a measure for selecting model architectures, as well as, for enabling a theoretical comparison between different AI-based approaches. Specifically, for $K$-user interference management problem, we theoretically show that graph neural networks (GNNs) are superior to multi-layer perceptrons (MLPs), and the performance gap between these two methods grows with $\sqrt{K}$.


title: A physics-inspired alternative to spatial filtering for large-eddy simulations of turbulent flows

abstract: Large-eddy simulations (LES) are widely-used for computing high Reynolds number turbulent flows. Spatial filtering theory for LES is not without its shortcomings, including how to define filtering for wall-bounded flows, commutation errors for non-uniform filters, and extensibility to flows with additional complexity, such as multiphase flows. In this paper, the theory for LES is reimagined using a coarsening procedure that imitates nature. This physics-inspired approach is equivalent to Gaussian filtering for single-phase wall-free flows but opens up new insights for modeling even in that simple case. Boundaries and nonuniform resolution can be treated seemlessly in this framework without commutation errors, and the divergence-free condition is retained for incompressible flows. An alternative to the Germano identity is introduced and used to define a dynamic procedure without the need for a test filter. Potential extensions to more complex physics are briefly discussed.


title: Gas Detection and Identification Using Multimodal Artificial Intelligence Based Sensor Fusion

abstract: With the rapid industrialization and technological advancements, innovative engineering technologies which are cost effective, faster and easier to implement are essential. One such area of concern is the rising number of accidents happening due to gas leaks at coal mines, chemical industries, home appliances etc. In this paper we propose a novel approach to detect and identify the gaseous emissions using the multimodal AI fusion techniques. Most of the gases and their fumes are colorless, odorless, and tasteless, thereby challenging our normal human senses. Sensing based on a single sensor may not be accurate, and sensor fusion is essential for robust and reliable detection in several real-world applications. We manually collected 6400 gas samples (1600 samples per class for four classes) using two specific sensors: the 7-semiconductor gas sensors array, and a thermal camera. The early fusion method of multimodal AI, is applied The network architecture consists of a feature extraction module for individual modality, which is then fused using a merged layer followed by a dense layer, which provides a single output for identifying the gas. We obtained the testing accuracy of 96% (for fused model) as opposed to individual model accuracies of 82% (based on Gas Sensor data using LSTM) and 93% (based on thermal images data using CNN model). Results demonstrate that the fusion of multiple sensors and modalities outperforms the outcome of a single sensor.


title: Calibration and Auto-Refinement for Light Field Cameras

abstract: The ability to create an accurate three-dimensional reconstruction of a captured scene draws attention to the principles of light fields. This paper presents an approach for light field camera calibration and rectification, based on pairwise pattern-based parameters extraction. It is followed by a correspondence-based algorithm for camera parameters refinement from arbitrary scenes using the triangulation filter and nonlinear optimization. The effectiveness of our approach is validated on both real and synthetic data.


title: Wigner symmetries and Gleason's theorem

abstract: We prove an optimal version of Wigner's unitary-antiunitary theorem. The main tool in our proof is Gleason's theorem.


title: Improving RNN-T ASR Performance with Date-Time and Location Awareness

abstract: In this paper, we explore the benefits of incorporating context into a Recurrent Neural Network (RNN-T) based Automatic Speech Recognition (ASR) model to improve the speech recognition for virtual assistants. Specifically, we use meta information extracted from the time at which the utterance is spoken and the approximate location information to make ASR context aware. We show that these contextual information, when used individually, improves overall performance by as much as 3.48% relative to the baseline and when the contexts are combined, the model learns complementary features and the recognition improves by 4.62%. On specific domains, these contextual signals show improvements as high as 11.5%, without any significant degradation on others. We ran experiments with models trained on data of sizes 30K hours and 10K hours. We show that the scale of improvement with the 10K hours dataset is much higher than the one obtained with 30K hours dataset. Our results indicate that with limited data to train the ASR model, contextual signals can improve the performance significantly.


title: A Single-Layer Dual-Mesh Boundary Element Method for Multiscale Electromagnetic Modeling of Penetrable Objects in Layered Media

abstract: A surface integral representation of Maxwell's equations allows the efficient electromagnetic (EM) modeling of three-dimensional structures with a two-dimensional discretization, via the boundary element method (BEM). However, existing BEM formulations either lead to a poorly conditioned system matrix for multiscale problems, or are computationally expensive for objects embedded in layered substrates. This article presents a new BEM formulation which leverages the surface equivalence principle and Buffa-Christiansen basis functions defined on a dual mesh, to obtain a well-conditioned system matrix suitable for multiscale EM modeling. Unlike existing methods involving dual meshes, the proposed formulation avoids the double-layer potential operator for the surrounding medium, which may be a stratified substrate requiring the use of an advanced Green's function. This feature greatly alleviates the computational expense associated with the use of Buffa-Christiansen functions. Numerical examples drawn from several applications, including remote sensing, chip-level EM analysis, and metasurface modeling, demonstrate speed-ups ranging from 3x to 7x compared to state-of-the-art formulations.


title: Mean Field Portfolio Games

abstract: We study mean field portfolio games with random market parameters, where each player is concerned with not only her own wealth but also relative performance to her competitors. We use the martingale optimality principle approach to characterize the unique Nash equilibrium in terms of a mean field FBSDE with quadratic growth, which is solvable under a weak interaction assumption. Motivated by the weak interaction assumption, we establish an asymptotic expansion result in powers of the competition parameter. When the market parameters do not depend on the Brownian paths, we obtain the Nash equilibrium in closed form.