title: Topology, oxidation states, and charge transport in ionic conductors

abstract: Recent theoretical advances, based on a combination of concepts from Thouless' topological theory of adiabatic charge transport and a newly introduced gauge-invariance principle for transport coefficients, have permitted to connect (and reconcile) Faraday's picture of ionic transport -- whereby each atom carries a well-defined integer charge -- with a rigorous quantum description of the electronic charge-density distribution, which hardly suggests its partition into well defined atomic contributions. In this paper we review these progress and in particular that, by relaxing some general topological conditions, charge may be transported in ionic conductors without any net ionic displacements. After reporting numerical experiments which corroborate these findings, we introduce a new connection between our topological picture and the well-known Marcus-Hush theory of electron transfer, which we are able to connect with the topology of adiabatic paths drawn by atomic trajectories. As a significant byproduct, the results reviewed here permit to classify different regimes of ionic transport according to the topological properties of the electronic structure of the conducting material. We finally report on a few recent applications to energy materials and planetary sciences.

categories: cond-mat.mtrl-sci cond-mat.other physics.chem-ph physics.comp-ph


title: Point defect avalanches mediate grain boundary diffusion

abstract: Grain boundary (GB) diffusion in polycrystalline materials is a physical phenomenon of great fundamental interest and practical significance. Although the accelerated ("short circuit") atomic transport along GBs has been known for decades, the current atomic-level understanding of GB diffusion remains poor. Experiments can measure numerical values of GB diffusion coefficients but provide little information about the underlying mechanisms. Previous atomistic simulations focused on relatively low temperatures when the GB structure is ordered or relatively high temperatures when it is highly disordered. Here, we report on molecular dynamics simulations of GB diffusion at intermediate temperatures, which are most relevant to applications. One of the surprising results of this work is the observation of strongly intermittent GB diffusion behavior and its strong system-size dependence unseen in previous work. We demonstrate that both effects originate from an intermittent, avalanche-type generation of point defects causing spontaneous bursts of GB diffusivity mediated by highly cooperative atomic rearrangements. We identify the length and time scales of the avalanches and link their formation to the dynamic heterogeneity phenomenon in partially disordered systems. Our findings have significant implications for future computer modeling of GB diffusion and mass transport in nano-scale materials.


title: Analysis of inter-transaction time fluctuations in the cryptocurrency market

abstract: We analyse tick-by-tick data representing major cryptocurrencies traded on some different cryptocurrency trading platforms. We focus on such quantities like the inter-transaction times, the number of transactions in time unit, the traded volume, and volatility. We show that the inter-transaction times show long-range power-law autocorrelations. These lead to multifractality expressed by the right-side asymmetry of the singularity spectra $f(\alpha)$ indicating that the periods of increased market activity are characterised by richer multifractality compared to the periods of quiet market. We also show that neither the stretched exponential distribution nor the power-law-tail distribution are able to model universally the cumulative distribution functions of the quantities considered in this work. For each quantity, some data sets can be modeled by the former, some data sets by the latter, while both fail in other cases. An interesting, yet difficult to account for, observation is that parallel data sets from different trading platforms can show disparate statistical properties.


title: Adaptive Expert Models for Personalization in Federated Learning

abstract: Federated Learning (FL) is a promising framework for distributed learning when data is private and sensitive. However, the state-of-the-art solutions in this framework are not optimal when data is heterogeneous and non-Independent and Identically Distributed (non-IID). We propose a practical and robust approach to personalization in FL that adjusts to heterogeneous and non-IID data by balancing exploration and exploitation of several global models. To achieve our aim of personalization, we use a Mixture of Experts (MoE) that learns to group clients that are similar to each other, while using the global models more efficiently. We show that our approach achieves an accuracy up to 29.78 % and up to 4.38 % better compared to a local model in a pathological non-IID setting, even though we tune our approach in the IID setting.


title: Membrane flutter in three-dimensional inviscid flow

abstract: We develop a model and numerical method to study the large-amplitude flutter of rectangular membranes (of zero bending rigidity) that shed a trailing vortex-sheet wake in a three-dimensional (3D) inviscid fluid flow. We apply small initial perturbations and track their decay or growth to large-amplitude steady state motions. For 12 combinations of boundary conditions at the membrane edges we compute the stability thresholds and the subsequent large-amplitude dynamics across the three-parameter space of membrane mass density, pretension, and stretching rigidity. With free side edges we find good agreement with previous 2D results that used different discretization methods. We find that the 3D dynamics in the 12 cases naturally form four groups based on the conditions at the leading and trailing edges. The deflection amplitudes and oscillation frequencies have scalings similar to those in the 2D case. The conditions at the side edges, though generally less important, may have small or large qualitative effects on the membrane dynamics -- e.g. steady versus unsteady, periodic versus chaotic, or the variety of spanwise curvature distributions -- depending on the group and the physical parameter values.


title: Efficient Approximation of Expected Hypervolume Improvement using Gauss-Hermite Quadrature

abstract: Many methods for performing multi-objective optimisation of computationally expensive problems have been proposed recently. Typically, a probabilistic surrogate for each objective is constructed from an initial dataset. The surrogates can then be used to produce predictive densities in the objective space for any solution. Using the predictive densities, we can compute the expected hypervolume improvement (EHVI) due to a solution. Maximising the EHVI, we can locate the most promising solution that may be expensively evaluated next. There are closed-form expressions for computing the EHVI, integrating over the multivariate predictive densities. However, they require partitioning the objective space, which can be prohibitively expensive for more than three objectives. Furthermore, there are no closed-form expressions for a problem where the predictive densities are dependent, capturing the correlations between objectives. Monte Carlo approximation is used instead in such cases, which is not cheap. Hence, the need to develop new accurate but cheaper approximation methods remains. Here we investigate an alternative approach toward approximating the EHVI using Gauss-Hermite quadrature. We show that it can be an accurate alternative to Monte Carlo for both independent and correlated predictive densities with statistically significant rank correlations for a range of popular test problems.


title: Disentangling visual and written concepts in CLIP

abstract: The CLIP network measures the similarity between natural text and images; in this work, we investigate the entanglement of the representation of word images and natural images in its image encoder. First, we find that the image encoder has an ability to match word images with natural images of scenes described by those words. This is consistent with previous research that suggests that the meaning and the spelling of a word might be entangled deep within the network. On the other hand, we also find that CLIP has a strong ability to match nonsense words, suggesting that processing of letters is separated from processing of their meaning. To explicitly determine whether the spelling capability of CLIP is separable, we devise a procedure for identifying representation subspaces that selectively isolate or eliminate spelling capabilities. We benchmark our methods against a range of retrieval tasks, and we also test them by measuring the appearance of text in CLIP-guided generated images. We find that our methods are able to cleanly separate spelling capabilities of CLIP from the visual processing of natural images.


title: Personal Entity, Concept, and Named Entity Linking in Conversations

abstract: Building conversational agents that can have natural and knowledge-grounded interactions with humans requires understanding user utterances. Entity Linking (EL) is an effective and widely used method for understanding natural language text and connecting it to external knowledge. It is, however, shown that existing EL methods developed for annotating documents are suboptimal for conversations, where personal entities (e.g., "my cars") and concepts are essential for understanding user utterances. In this paper, we introduce a collection and a tool for entity linking in conversations. We collect EL annotations for 1327 conversational utterances, consisting of links to named entities, concepts, and personal entities. The dataset is used for training our toolkit for conversational entity linking, CREL. Unlike existing EL methods, CREL is developed to identify both named entities and concepts. It also utilizes coreference resolution techniques to identify personal entities and references to the explicit entity mentions in the conversations. We compare CREL with state-of-the-art techniques and show that it outperforms all existing baselines.


title: Modeling the Data-Generating Process is Necessary for Out-of-Distribution Generalization

abstract: Recent empirical studies on domain generalization (DG) have shown that DG algorithms that perform well on some distribution shifts fail on others, and no state-of-the-art DG algorithm performs consistently well on all shifts. Moreover, real-world data often has multiple distribution shifts over different attributes; hence we introduce multi-attribute distribution shift datasets and find that the accuracy of existing DG algorithms falls even further. To explain these results, we provide a formal characterization of generalization under multi-attribute shifts using a canonical causal graph. Based on the relationship between spurious attributes and the classification label, we obtain realizations of the canonical causal graph that characterize common distribution shifts and show that each shift entails different independence constraints over observed variables. As a result, we prove that any algorithm based on a single, fixed constraint cannot work well across all shifts, providing theoretical evidence for mixed empirical results on DG algorithms. Based on this insight, we develop Causally Adaptive Constraint Minimization (CACM), an algorithm that uses knowledge about the data-generating process to adaptively identify and apply the correct independence constraints for regularization. Results on fully synthetic, MNIST, small NORB, and Waterbirds datasets, covering binary and multi-valued attributes and labels, show that adaptive dataset-dependent constraints lead to the highest accuracy on unseen domains whereas incorrect constraints fail to do so. Our results demonstrate the importance of modeling the causal relationships inherent in the data-generating process.


title: Generic root counts and flatness in tropical geometry

abstract: We use tropical and non-archimedean geometry to study generic root counts of families of polynomial equations. These families are given as morphisms of schemes $X\to{Y}$ that factor through a closed embedding into a relative torus over a parameter space $Y$. We prove a generalization of Bernstein's theorem for these morphisms, showing that the root count of a single well-behaved tropical fiber spreads to an open dense subset of $Y$. We use this to express the generic root count of a wide class of square systems in terms of the matroidal degree of an explicit variety. This in particular gives tropical formulas for the birational intersection indices and volumes of Newton-Okounkov bodies defined by Kaveh and Khovanskii, and the generic root counts of the steady-state equations of chemical reaction networks. An important role in these theorems is played by the notion of tropical flatness, which allows us to infer generic properties of $X\to{Y}$ from a single tropical fiber. We show that the tropical analogue of the generic flatness theorem holds, in the sense that $X\to{{Y}}$ is tropically flat over an open dense subset of the Berkovich analytification of $Y$.


title: Linearity Grafting: Relaxed Neuron Pruning Helps Certifiable Robustness

abstract: Certifiable robustness is a highly desirable property for adopting deep neural networks (DNNs) in safety-critical scenarios, but often demands tedious computations to establish. The main hurdle lies in the massive amount of non-linearity in large DNNs. To trade off the DNN expressiveness (which calls for more non-linearity) and robustness certification scalability (which prefers more linearity), we propose a novel solution to strategically manipulate neurons, by "grafting" appropriate levels of linearity. The core of our proposal is to first linearize insignificant ReLU neurons, to eliminate the non-linear components that are both redundant for DNN performance and harmful to its certification. We then optimize the associated slopes and intercepts of the replaced linear activations for restoring model performance while maintaining certifiability. Hence, typical neuron pruning could be viewed as a special case of grafting a linear function of the fixed zero slopes and intercept, that might overly restrict the network flexibility and sacrifice its performance. Extensive experiments on multiple datasets and network backbones show that our linearity grafting can (1) effectively tighten certified bounds; (2) achieve competitive certifiable robustness without certified robust training (i.e., over 30% improvements on CIFAR-10 models); and (3) scale up complete verification to large adversarially trained models with 17M parameters. Codes are available at https://github.com/VITA-Group/Linearity-Grafting.


title: Architectural Backdoors in Neural Networks

abstract: Machine learning is vulnerable to adversarial manipulation. Previous literature has demonstrated that at the training stage attackers can manipulate data and data sampling procedures to control model behaviour. A common attack goal is to plant backdoors i.e. force the victim model to learn to recognise a trigger known only by the adversary. In this paper, we introduce a new class of backdoor attacks that hide inside model architectures i.e. in the inductive bias of the functions used to train. These backdoors are simple to implement, for instance by publishing open-source code for a backdoored model architecture that others will reuse unknowingly. We demonstrate that model architectural backdoors represent a real threat and, unlike other approaches, can survive a complete re-training from scratch. We formalise the main construction principles behind architectural backdoors, such as a link between the input and the output, and describe some possible protections against them. We evaluate our attacks on computer vision benchmarks of different scales and demonstrate the underlying vulnerability is pervasive in a variety of training settings.


title: TOKEN is a MASK: Few-shot Named Entity Recognition with Pre-trained Language Models

abstract: Transferring knowledge from one domain to another is of practical importance for many tasks in natural language processing, especially when the amount of available data in the target domain is limited. In this work, we propose a novel few-shot approach to domain adaptation in the context of Named Entity Recognition (NER). We propose a two-step approach consisting of a variable base module and a template module that leverages the knowledge captured in pre-trained language models with the help of simple descriptive patterns. Our approach is simple yet versatile and can be applied in few-shot and zero-shot settings. Evaluating our lightweight approach across a number of different datasets shows that it can boost the performance of state-of-the-art baselines by 2-5% F1-score.


title: Queried Unlabeled Data Improves and Robustifies Class-Incremental Learning

abstract: Class-incremental learning (CIL) suffers from the notorious dilemma between learning newly added classes and preserving previously learned class knowledge. That catastrophic forgetting issue could be mitigated by storing historical data for replay, which yet would cause memory overheads as well as imbalanced prediction updates. To address this dilemma, we propose to leverage "free" external unlabeled data querying in continual learning. We first present a CIL with Queried Unlabeled Data (CIL-QUD) scheme, where we only store a handful of past training samples as anchors and use them to query relevant unlabeled examples each time. Along with new and past stored data, the queried unlabeled are effectively utilized, through learning-without-forgetting (LwF) regularizers and class-balance training. Besides preserving model generalization over past and current tasks, we next study the problem of adversarial robustness for CIL-QUD. Inspired by the recent success of learning robust models with unlabeled data, we explore a new robustness-aware CIL setting, where the learned adversarial robustness has to resist forgetting and be transferred as new tasks come in continually. While existing options easily fail, we show queried unlabeled data can continue to benefit, and seamlessly extend CIL-QUD into its robustified versions, RCIL-QUD. Extensive experiments demonstrate that CIL-QUD achieves substantial accuracy gains on CIFAR-10 and CIFAR-100, compared to previous state-of-the-art CIL approaches. Moreover, RCIL-QUD establishes the first strong milestone for robustness-aware CIL. Codes are available in https://github.com/VITA-Group/CIL-QUD.


title: Recent Developments in Security-Constrained AC Optimal Power Flow: Overview of Challenge 1 in the ARPA-E Grid Optimization Competition

abstract: The optimal power flow problem is central to many tasks in the design and operation of electric power grids. This problem seeks the minimum cost operating point for an electric power grid while satisfying both engineering requirements and physical laws describing how power flows through the electric network. By additionally considering the possibility of component failures and using an accurate AC power flow model of the electric network, the security-constrained AC optimal power flow (SC-AC-OPF) problem is of paramount practical relevance. To assess recent progress in solution algorithms for SC-AC-OPF problems and spur new innovations, the U.S. Department of Energy's Advanced Research Projects Agency--Energy (ARPA-E) organized Challenge 1 of the Grid Optimization (GO) competition. This paper describes the SC-AC-OPF problem formulation used in the competition, overviews historical developments and the state of the art in SC-AC-OPF algorithms, discusses the competition, and summarizes the algorithms used by the top three teams in Challenge 1 of the GO Competition (Teams gollnlp, GO-SNIP, and GMI-GO).


title: Terahertz Slonczewski propagating spin waves and large output voltage in antiferromagnetic spin-Hall nano-oscillators

abstract: We study theoretically antiferromagnet (AFM) based spin-Hall nano-oscillators (SHNOs) consisting of a nano-constriction (NC) in a thin-film uniaxial AFM. By solving the derived SW equation we evidence radially propagating spin waves (SWs) at THz frequencies similar to the Slonczewski SWs known at GHz frequencies for a ferromagnet-based SHNO. We predict a minimum threshold current for a specific NC radius accessible by the state-of-the-art nanotechnology. The exchange interaction enhanced spin pumping for AFMs leads to a strong thickness dependent threshold frequency. We show that the uniaxial AFMs generate ac electrical fields via spin pumping that are three orders of magnitude larger than reported for biaxial AFMs. Our work enhances the fundamental understanding of current-driven SWs in AFM-SHNOs and enables optimization of practical devices in terms of material choice, device geometry, and frequency tunability. The propagating SWs offer remote THz signal generation and an efficient means for synchronization of SHNOs when aiming at high power.


title: Optimality of Matched-Pair Designs in Randomized Controlled Trials

abstract: In randomized controlled trials (RCTs), treatment is often assigned by stratified randomization. I show that among all stratified randomization schemes which treat all units with probability one half, a certain matched-pair design achieves the maximum statistical precision for estimating the average treatment effect (ATE). In an important special case, the optimal design pairs units according to the baseline outcome. In a simulation study based on datasets from 10 RCTs, this design lowers the standard error for the estimator of the ATE by 10% on average, and by up to 34%, relative to the original designs.


title: Action Spotting using Dense Detection Anchors Revisited: Submission to the SoccerNet Challenge 2022

abstract: This brief technical report describes our submission to the Action Spotting SoccerNet Challenge 2022. The challenge was part of the CVPR 2022 ActivityNet Workshop. Our submission was based on a recently proposed method which focuses on increasing temporal precision via a densely sampled set of detection anchors. Due to its emphasis on temporal precision, this approach had shown significant improvements in the tight average-mAP metric. Tight average-mAP was used as the evaluation criterion for the challenge, and is defined using small temporal evaluation tolerances, thus being more sensitive to small temporal errors. In order to further improve results, here we introduce small changes in the pre- and post-processing steps, and also combine different input feature types via late fusion. These changes brought improvements that helped us achieve the first place in the challenge and also led to a new state-of-the-art on SoccerNet's test set when using the dataset's standard experimental protocol. This report briefly reviews the action spotting method based on dense detection anchors, then focuses on the modifications introduced for the challenge. We also describe the experimental protocols and training procedures we used, and finally present our results.


title: Disk-like surfaces of section and symplectic capacities

abstract: We prove that the cylindrical capacity of a dynamically convex domain in $\mathbb{R}^4$ agrees with the least symplectic area of a disk-like global surface of section of the Reeb flow on the boundary of the domain. Moreover, we prove the strong Viterbo conjecture for all convex domains in $\mathbb{R}^4$ which are sufficiently $C^3$ close to the round ball. This generalizes a result of Abbondandolo-Bramham-Hryniewicz-Salom\~{a}o establishing a systolic inequality for such domains.


title: Bulk viscosity of dual Bose and Fermi gases in one dimension

abstract: One-dimensional Bose and Fermi gases with contact interactions are known to exhibit the weak-strong duality, where the equilibrium thermodynamic properties of one system at weak coupling are identical to those of the other system at strong coupling. Here, we show that such duality extends beyond the thermodynamics to the frequency-dependent complex bulk viscosity, which is provided by the contact-contact response function. In particular, we confirm that the bulk viscosities of the Bose and Fermi gases agree in the high-temperature limit, where the systematic expansion in terms of fugacity is available at arbitrary coupling. We also compute their bulk viscosities perturbatively in the weak-coupling limit at arbitrary temperature, which via the duality serve as those of the Fermi and Bose gases in the strong-coupling limit.


title: Spiraling and Folding: The Topological View

abstract: For every $n$, we construct two curves in the plane that intersect at least $n$ times and do not form spirals. The construction is in three stages: we first exhibit closed curves on the torus that do not form double spirals, then arcs on the torus that do not form spirals, and finally pairs of planar arcs that do not form spirals. These curves provide a counterexample to a proof of Pach and T\'{o}th concerning string graphs.


title: HF-NeuS: Improved Surface Reconstruction Using High-Frequency Details

abstract: Neural rendering can be used to reconstruct implicit representations of shapes without 3D supervision. However, current neural surface reconstruction methods have difficulty learning high-frequency geometry details, so the reconstructed shapes are often over-smoothed. We develop HF-NeuS, a novel method to improve the quality of surface reconstruction in neural rendering. We follow recent work to model surfaces as signed distance functions (SDFs). First, we offer a derivation to analyze the relationship between the SDF, the volume density, the transparency function, and the weighting function used in the volume rendering equation and propose to model transparency as transformed SDF. Second, we observe that attempting to jointly encode high-frequency and low-frequency components in a single SDF leads to unstable optimization. We propose to decompose the SDF into a base function and a displacement function with a coarse-to-fine strategy to gradually increase the high-frequency details. Finally, we design an adaptive optimization strategy that makes the training process focus on improving those regions near the surface where the SDFs have artifacts. Our qualitative and quantitative results show that our method can reconstruct fine-grained surface details and obtain better surface reconstruction quality than the current state of the art. Code available at https://github.com/yiqun-wang/HFS.


title: Conformal prediction set for time-series

abstract: When building either prediction intervals for regression (with real-valued response) or prediction sets for classification (with categorical responses), uncertainty quantification is essential to studying complex machine learning methods. In this paper, we develop Ensemble Regularized Adaptive Prediction Set (ERAPS) to construct prediction sets for time-series (with categorical responses), based on the prior work of [Xu and Xie, 2021]. In particular, we allow unknown dependencies to exist within features and responses that arrive in sequence. Method-wise, ERAPS is a distribution-free and ensemble-based framework that is applicable for arbitrary classifiers. Theoretically, we bound the coverage gap without assuming data exchangeability and show asymptotic set convergence. Empirically, we demonstrate valid marginal and conditional coverage by ERAPS, which also tends to yield smaller prediction sets than competing methods.


title: Performance analysis of coreset selection for quantum implementation of K-Means clustering algorithm

abstract: Quantum computing is anticipated to offer immense computational capabilities which could provide efficient solutions to many data science problems. However, the current generation of quantum devices are small and noisy, which makes it difficult to process large data sets relevant for practical problems. Coreset selection aims to circumvent this problem by reducing the size of input data without compromising the accuracy. Recent work has shown that coreset selection can help to implement quantum K-Means clustering problem. However, the impact of coreset selection on the performance of quantum K-Means clustering has not been explored. In this work, we compare the relative performance of two coreset techniques (BFL16 and ONESHOT), and the size of coreset construction in each case, with respect to a variety of data sets and layout the advantages and limitations of coreset selection in implementing quantum algorithms. We also investigated the effect of depolarisation quantum noise and bit-flip error, and implemented the Quantum AutoEncoder technique for surpassing the noise effect. Our work provides useful insights for future implementation of data science algorithms on near-term quantum devices where problem size has been reduced by coreset selection.


title: Landau-Zener transition between two quantum dots coupled by resonant tunneling

abstract: We consider the transition of electron between two quantum dots in which the discrete levels are swept past each other with a constant velocity. If a direct tunneling between the dot levels was allowed, an electron will be transferred between the dots when the levels cross. This transfer is described in terms of the conventional Landau-Zener theory. We assume that direct tunneling between the dots is forbidden. Rather, the transfer is due to the resonant tunneling via a discrete impurity level separating the dots. Then the description of the electron transfer reduces to a threestate (two dots plus impurity) Landau-Zener transition. Transition probability depends on the relative positions of the resonant level and the energy at which the levels cross. It also depends on the left-right asymmetry of tunneling between the impurity and the left(right) dots. We calculate the transition probability in different limits of the horizontal (in space) and vertical (in energy) impurity level positions.


title: Study of dielectric breakdown in liquid xenon with the XeBrA experiment

abstract: Maintaining the electric fields necessary for the current generation of noble liquid time projection chambers (TPCs), with drift lengths exceeding one meter, requires a large negative voltage applied to their cathode. Delivering such high voltage is associated with an elevated risk of electrostatic discharge and electroluminescence, which would be detrimental to the performance of the experiment. The Xenon Breakdown Apparatus (XeBrA) is a five-liter, high voltage test chamber built to investigate the contributing factors to electrical breakdown in noble liquids. In this work, we present the main findings after conducting scans over stressed electrode areas, surface finish, pressure, and high voltage ramp speed in the medium of liquid xenon. Area scaling and surface finish were observed to be the dominant factors affecting breakdown, whereas no significant changes were observed with varying pressure or ramp speed. A general rise in both anode current and photon rate was observed in the last 30 seconds leading up to a breakdown, with a marked increase in the last couple of seconds. In addition, the position of breakdowns was reconstructed with a system of high-speed cameras and a moderate correlation with the Fowler-Nordheim field emission model was found. Tentative evidence for bubble nucleation being the originating mechanism of breakdown in the liquid was also observed. We deem the results presented in this work to be of particular interest for the design of future, large TPCs, and practical recommendations are provided.


title: Visualizing Attractors of the Three-Dimensional Generalized H\'{e}non Map

abstract: We study dynamics of a generic quadratic diffeomorphism, a 3D generalization of the planar H\'{e}non map. Focusing on the dissipative, orientation preserving case, we give a comprehensive parameter study of codimension-one and two bifurcations. Periodic orbits, born at resonant, Neimark-Sacker bifurcations, give rise to Arnold tongues in parameter space. Aperiodic attractors include invariant circles and chaotic orbits; these are distinguished by rotation number and Lyapunov exponents. Chaotic orbits include H\'{e}non-like and Lorenz-like attractors, which can arise from period-doubling cascades, and those born from the destruction of invariant circles. The latter lie on paraboloids near the local unstable manifold of a fixed point.


title: On skein algebras of planar surfaces

abstract: Let $R$ be a commutative ring with identity and a fixed invertible element $q^{\frac{1}{2}}$. Let $\mathcal{S}_n$ denote the Kauffman bracket skein algebra of the planar surface $\Sigma_{0,n+1}$ over $R$. When $q+q^{-1}$ is invertible in $R$, we find a generating set for $\mathcal{S}_n$, and show that the ideal of defining relations is generated by relations of degree at most $6$ supported by certain subsurfaces homeomorphic to $\Sigma_{0,k+1}$ with $k\le 6$. When $q+q^{-1}$ is not invertible, we find another generating set for $\mathcal{S}_n$, and show that the ideal of defining relations is generated by certain relations of degree at most $2n+2$.


title: The Scattering Transform Network with Generalized Morse Wavelets and Its Application to Music Genre Classification

abstract: We propose to use the Generalized Morse Wavelets (GMWs) instead of commonly-used Morlet (or Gabor) wavelets in the Scattering Transform Network (STN), which we call the GMW-STN, for signal classification problems. The GMWs form a parameterized family of truly analytic wavelets while the Morlet wavelets are only approximately analytic. The analyticity of underlying wavelet filters in the STN is particularly important for nonstationary oscillatory signals such as music signals because it improves interpretability of the STN representations by providing multiscale amplitude and phase (and consequently frequency) information of input signals. We demonstrate the superiority of the GMW-STN over the conventional STN in music genre classification using the so-called GTZAN database. Moreover, we show the performance improvement of the GMW-STN by increasing its number of layers to three over the typical two-layer STN.}


title: Driving Potential and Fission-Fragment Charge Distributions

abstract: We propose an efficient approach to describe the fission-fragment charge yields for actinides based on the driving potential of fissioning system. Considering the properties of primary fission fragments at their ground states, the driving potential, which represents the potential energies of the system around scission configuration and closely relates to the yields of fragments, can be unambiguously and quickly obtained from the Skyrme energy-density functional together with the Weizsaecker-Skyrme mass model. The fission-fragment charge distributions for thermal-neutroninduced fission and spontaneous fission of a series of actinides, especially the odd-even staggering in charge distributions can be well reproduced. Nuclear dynamical deformations and pairing corrections of fragments play an important role in the charge distributions.


title: Phase-Only Holographic Assisted Planar Printing for Massively Multiplexed Optical Display and Encryption

abstract: Multiplexed planar printings, made of single or few layer micro and nano optical platforms, are essential for high capacity display, information storage and encryption. Although having been developed rapidly, the demonstrated channels are still limited and also lack instantaneity. Here, holograms and printings, always regarded as two independent information coding domains with totally different principles, are combined together through our proposed angle multiplexing framework, leading to multiplexed printings with hundreds of channels. Based on such approach, we experimentally encode respectively 25 gray scale printings into 25 angles and even 8 gray scale videos into 8 angles with a phase-only spatial light modulator. As a bridge between printings and holograms, our method allows to generate printings combining various holographic methods. Beneficial from this, we demonstrate a gradient metasurface based 324 channel printing which multiplexes angles, polarizations and wavelengths simultaneously. Our work paves the way to flexibly angle-dependent printing display and massively multiplexed encryption systems.


title: EPG2S: Speech Generation and Speech Enhancement based on Electropalatography and Audio Signals using Multimodal Learning

abstract: Speech generation and enhancement based on articulatory movements facilitate communication when the scope of verbal communication is absent, e.g., in patients who have lost the ability to speak. Although various techniques have been proposed to this end, electropalatography (EPG), which is a monitoring technique that records contact between the tongue and hard palate during speech, has not been adequately explored. Herein, we propose a novel multimodal EPG-to-speech (EPG2S) system that utilizes EPG and speech signals for speech generation and enhancement. Different fusion strategies based on multiple combinations of EPG and noisy speech signals are examined, and the viability of the proposed method is investigated. Experimental results indicate that EPG2S achieves desirable speech generation outcomes based solely on EPG signals. Further, the addition of noisy speech signals is observed to improve quality and intelligibility. Additionally, EPG2S is observed to achieve high-quality speech enhancement based solely on audio signals, with the addition of EPG signals further improving the performance. The late fusion strategy is deemed to be the most effective approach for simultaneous speech generation and enhancement.


title: Text normalization for low-resource languages: the case of Ligurian

abstract: Text normalization is a crucial technology for low-resource languages which lack rigid spelling conventions or that have undergone multiple spelling reforms. Low-resource text normalization has so far relied upon hand-crafted rules, which are perceived to be more data efficient than neural methods. In this paper we examine the case of text normalization for Ligurian, an endangered Romance language. We collect 4,394 Ligurian sentences paired with their normalized versions, as well as the first open source monolingual corpus for Ligurian. We show that, in spite of the small amounts of data available, a compact transformer-based model can be trained to achieve very low error rates by the use of backtranslation and appropriate tokenization.


title: Unifying Framework for Optimizations in non-boolean Formalisms

abstract: Search-optimization problems are plentiful in scientific and engineering domains. Artificial intelligence has long contributed to the development of search algorithms and declarative programming languages geared towards solving and modeling search-optimization problems. Automated reasoning and knowledge representation are the subfields of AI that are particularly vested in these developments. Many popular automated reasoning paradigms provide users with languages supporting optimization statements. Recall integer linear programming, MaxSAT, optimization satisfiability modulo theory, and (constraint) answer set programming. These paradigms vary significantly in their languages in ways they express quality conditions on computed solutions. Here we propose a unifying framework of so called extended weight systems that eliminates syntactic distinctions between paradigms. They allow us to see essential similarities and differences between optimization statements provided by distinct automated reasoning languages. We also study formal properties of the proposed systems that immediately translate into formal properties of paradigms that can be captured within our framework. Under consideration in Theory and Practice of Logic Programming (TPLP).


title: Frattini-resistant direct products of pro-$p$ groups

abstract: A pro-$p$ group $G$ is called strongly Frattini-resistant if the function $H \mapsto \Phi(H)$, from the poset of all closed subgroups of $G$ into itself, is a poset embedding. Frattini-resistant pro-$p$ groups appear naturally in Galois theory. Indeed, every maximal pro-$p$ Galois group over a field that contains a primitive $p$th root of unity (and also contains $\sqrt{-1}$ if $p=2$) is strongly Frattini-resistant. Let $G_1$ and $G_2$ be non-trivial pro-$p$ groups. We prove that $G_1 \times G_2$ is strongly Frattini-resistant if and only if one of the direct factors $G_1$ or $G_2$ is torsion-free abelian and the other one has the property that all of its closed subgroups have torsion-free abelianization. As a corollary we obtain a group theoretic proof of a result of Koenigsmann on maximal pro-$p$ Galois groups that admit a non-trivial decomposition as a direct product. In addition, we give an example of a group that is not strongly Frattini-resistant, but has the property that its Frattini-function defines an order self-embedding of the poset of all topologically finitely generated subgroups.


title: Anomalous curvature evolution and geometric regularization of energy focusing in the snapping dynamics of a flexible body

abstract: We examine the focusing of kinetic energy and the amplification of various quantities during the snapping motion of the free end of a flexible structure. This brief but violent event appears to be a regularized finite-time singularity, with remarkably large spikes in velocity, acceleration, and tension easily induced by generic initial and boundary conditions. A numerical scheme for the inextensible string equations is validated against available experimental data for a falling chain and further employed to explore the phenomenon. We determine that the discretization of the equations, equivalent to the physically discrete problem of a chain, does not provide the regularizing length scale, which in the absence of other physical effects must then arise from the geometry of the problem. An analytical solution for a geometrically singular limit, a falling perfectly-folded string, accounts surprisingly well for the scalings of several quantities in the numerics, but can only indirectly suggest a behavior for the curvature, one which seems to explain prior experimental data but does not correspond to the evolution of the curvature peak in our system, which instead displays a newly observed anomalously slow scaling. A simple model, incorporating only knowledge of the initial conditions along with the anomalous and singular-limit scalings, provides reasonable estimates for the amplifications of relevant quantities. This is a first step to predict and harness arbitrarily large energy focusing in structures, with a practical limit set only by length scales present in the discrete mechanical system or the initial conditions.


title: A global test of jet structure and delay time distribution of short-duration gamma-ray bursts

abstract: The multi-messenger joint observations of GW170817 and GRB170817A shed new light on the study of short-duration gamma-ray bursts (SGRBs). Not only did it substantiate the assumption that SGRBs originate from binary neutron star (BNS) mergers, but it also confirms that the jet generated by this type of merger must be structured, hence the observed energy of an SGRB depends on the viewing angle from the observer. However, the precise structure of the jet is still subject to debate. Moreover, whether a single unified jet model can be applied to all SGRBs is not known. Another uncertainty is the delay timescale of BNS mergers with respect to star formation history of the Universe. In this paper, we conduct a global test of both delay and jet models of BNS mergers across a wide parameter space with simulated SGRBs. We compare the simulated peak flux, redshift and luminosity distributions with the observed ones and test the goodness-of-fit for a set of models and parameter combinations. Our simulations suggest that GW170817/GRB 170817A and all SGRBs can be understood within the framework of a universal structured jet viewed at different viewing angles. Furthermore, models invoking a jet plus cocoon structure with a lognormal delay timescale is most favored. Some other combinations (e.g. a Gaussian delay with a power-law jet model) are also acceptable. However, the Gaussian delay with Gaussian jet model and the entire set of power-law delay models are disfavored.


title: Resonant Axion Radiation Conversion in Solar Spicules

abstract: It has recently been observed that solar spicules covering almost of all solar surface have strong magnetic field $B\sim 10^2$G. They are supposed to be plasma jets emitted from chromosphere and they arrive up to $\sim 10^4$km. Their electron number density is such that $n_e=10^{10}\rm cm^{-3}\sim $$10^{12}\rm cm^{-3}$. Corresponding plasma frequency $m_p=\sqrt{e^2n_e/m_e}$ ( electron mass $m_e$ ) is nearly equal to axion mass $m_a=10^{-5}$eV$\sim 10^{-4}$eV. Thus, resonant radiation conversion of axion with the mass can arise in the spicules. We show that radiations converted from axion dark matter possess flux density $\sim 10^{-6}\mbox{Jy}(m_a/10^{-4}\mbox{eV})(B/3\times 10^2\rm G)^2$. The radiations show line spectrum with frequency $\simeq 24$GHz$(m_a/10^{-4}\rm eV)$. Our estimation has fewer ambiguities in physical parameters than similar estimation in neutron stars because physical parameters like electron number density have been more unambiguously observed in the sun. But, much strong solar thermal radiations would preclude sensitive observations of such radiations from the axions.


title: A visual introduction to information theory

abstract: Though originally developed for communications engineering, information theory contains mathematical tools with numerous applications in science and engineering. These tools can be used to characterize the fundamental limits of data compression and transmission in the presence of noise. Here, we present a practical guide to key concepts in information theory, focusing on intuitions and providing visual explanations wherever possible. Our presentation assumes only a familiarity with basic probability theory.


title: Computer simulations of the Gardner transition in structural glasses

abstract: The exact mean-field theory for the simplest glass-forming system - the dense assembly of hard spheres in the large dimensional limit - predicts the existence of a Gardner phase. This transition is characterized by full replica symmetry breaking that implies two fascinating physical consequences: (i) a hierarchical free-energy landscape, and (ii) marginal stability. Here we discuss recent results of numerical simulations to examine these mean-field predictions in physical dimensions.


title: Let Invariant Rationale Discovery Inspire Graph Contrastive Learning

abstract: Leading graph contrastive learning (GCL) methods perform graph augmentations in two fashions: (1) randomly corrupting the anchor graph, which could cause the loss of semantic information, or (2) using domain knowledge to maintain salient features, which undermines the generalization to other domains. Taking an invariance look at GCL, we argue that a high-performing augmentation should preserve the salient semantics of anchor graphs regarding instance-discrimination. To this end, we relate GCL with invariant rationale discovery, and propose a new framework, Rationale-aware Graph Contrastive Learning (RGCL). Specifically, without supervision signals, RGCL uses a rationale generator to reveal salient features about graph instance-discrimination as the rationale, and then creates rationale-aware views for contrastive learning. This rationale-aware pre-training scheme endows the backbone model with the powerful representation ability, further facilitating the fine-tuning on downstream tasks. On MNIST-Superpixel and MUTAG datasets, visual inspections on the discovered rationales showcase that the rationale generator successfully captures the salient features (i.e. distinguishing semantic nodes in graphs). On biochemical molecule and social network benchmark datasets, the state-of-the-art performance of RGCL demonstrates the effectiveness of rationale-aware views for contrastive learning. Our codes are available at https://github.com/lsh0520/RGCL.


title: How to talk so AI will learn: Instructions, descriptions, and autonomy

abstract: From the earliest years of our lives, humans use language to express our beliefs and desires. Being able to talk to artificial agents about our preferences would thus fulfill a central goal of value alignment. Yet today, we lack computational models explaining such language use. To address this challenge, we formalize learning from language in a contextual bandit setting and ask how a human might communicate preferences over behaviors. We study two distinct types of language: $\textit{instructions}$, which provide information about the desired policy, and $\textit{descriptions}$, which provide information about the reward function. We show that the agent's degree of autonomy determines which form of language is optimal: instructions are better in low-autonomy settings, but descriptions are better when the agent will need to act independently. We then define a pragmatic listener agent that robustly infers the speaker's reward function by reasoning about $\textit{how}$ the speaker expresses themselves. We validate our models with a behavioral experiment, demonstrating that (1) our speaker model predicts human behavior, and (2) our pragmatic listener successfully recovers humans' reward functions. Finally, we show that this form of social learning can integrate with and reduce regret in traditional reinforcement learning. We hope these insights facilitate a shift from developing agents that $\textit{obey}$ language to agents that $\textit{learn}$ from it.


title: On strong solutions of time inhomogeneous It\^o's equations with Morrey diffusion and drift

abstract: We prove strong existense of solutions of It\^o's stochastic time dependent equations with irregular diffusion and drift terms of Morrey class type.


title: On the spectral radius of minimally 2-(edge)-connected graphs with given size

abstract: A graph is minimally $k$-connected ($k$-edge-connected) if it is $k$-connected ($k$-edge-connected) and deleting arbitrary chosen edge always leaves a graph which is not $k$-connected ($k$-edge-connected). A classic result of minimally $k$-connected graph is given by Mader who determined the extremal size of a minimally $k$-connected graph of high order in 1937. Naturally, for a fixed size of a minimally $k$-(edge)-connected graphs, what is the extremal spectral radius? In this paper, we determine the maximum spectral radius for the minimally $2$-connected ($2$-edge-connected) graphs of given size, moreover the corresponding extremal graphs are also determined.


title: Experimental study of closed and open microwave waveguide graphs with preserved and partially violated time-reversal invariance

abstract: We report on experiments that were performed with microwave waveguide systems and demonstrate that in the frequency range of a single transversal mode they may serve as a model for closed and open quantum graphs. These consist of bonds that are connected at vertices. On the bonds, they are governed by the one-dimensional Schr\"odinger equation with boundary conditions imposed at the vertices. The resulting transport properties through the vertices may be expressed in terms of a vertex scattering matrix. Quantum graphs with incommensurate bond lengths attracted interest within the field of quantum chaos because, depending on the characteristics of the vertex scattering matrix, its wave dynamic may exhibit features of a typical quantum system with chaotic counterpart. In distinction to microwave networks, which serve as an experimental model of quantum graphs with Neumann boundary conditions, the vertex scattering matrices associated with a waveguide system depend on the wavenumber and the wave functions can be determined experimentally. We analyze the spectral properties of microwave waveguide systems with preserved and partially violated time-reversal invariance, and the properties of the associated wave functions. Furthermore, we study properties of the scattering matrix describing the measurement process within the frame work of random matrix theory for quantum chaotic scattering systems.


title: Variable thermal transport in black, blue, and violet phosphorene from extensive atomistic simulations with a neuroevolution potential

abstract: Phosphorus has diverse chemical bonds and even in its two-dimensional form there are three stable allotropes: black phosphorene (Black-P), blue phosphorene (Blue-P), and violet phosphorene (Violet-P). Due to the complexity of these structures, no efficient and accurate classical interatomic potential has been developed for them. In this paper, we develop an efficient machine-learned neuroevolution potential model for these allotropes and apply it to study thermal transport in them via extensive molecular dynamics (MD) simulations. Based on the homogeneous nonequilibrium MD method, the thermal conductivities are predicted to be $12.5 \pm 0.2$ (Black-P in armchair direction), $78.4 \pm 0.4$ (Black-P in zigzag direction), $128 \pm 3$ (Blue-P), and $2.36 \pm 0.05$ (Violet-P) $\mathrm{Wm^{-1}K^{-1}}$. The underlying reasons for the significantly different thermal conductivity values in these allotropes are unraveled through spectral decomposition, phonon eigenmodes, and phonon participation ratio. Under external tensile strain, the thermal conductivity in black-P and violet-P are finite, while that in blue-P appears unbounded due to the linearization of the flexural phonon dispersion that increases the phonon mean free paths in the zero-frequency limit.


title: Optimization-Derived Learning with Essential Convergence Analysis of Training and Hyper-training

abstract: Recently, Optimization-Derived Learning (ODL) has attracted attention from learning and vision areas, which designs learning models from the perspective of optimization. However, previous ODL approaches regard the training and hyper-training procedures as two separated stages, meaning that the hyper-training variables have to be fixed during the training process, and thus it is also impossible to simultaneously obtain the convergence of training and hyper-training variables. In this work, we design a Generalized Krasnoselskii-Mann (GKM) scheme based on fixed-point iterations as our fundamental ODL module, which unifies existing ODL methods as special cases. Under the GKM scheme, a Bilevel Meta Optimization (BMO) algorithmic framework is constructed to solve the optimal training and hyper-training variables together. We rigorously prove the essential joint convergence of the fixed-point iteration for training and the process of optimizing hyper-parameters for hyper-training, both on the approximation quality, and on the stationary analysis. Experiments demonstrate the efficiency of BMO with competitive performance on sparse coding and real-world applications such as image deconvolution and rain streak removal.


title: Domain Generalization via Selective Consistency Regularization for Time Series Classification

abstract: Domain generalization methods aim to learn models robust to domain shift with data from a limited number of source domains and without access to target domain samples during training. Popular domain alignment methods for domain generalization seek to extract domain-invariant features by minimizing the discrepancy between feature distributions across all domains, disregarding inter-domain relationships. In this paper, we instead propose a novel representation learning methodology that selectively enforces prediction consistency between source domains estimated to be closely-related. Specifically, we hypothesize that domains share different class-informative representations, so instead of aligning all domains which can cause negative transfer, we only regularize the discrepancy between closely-related domains. We apply our method to time-series classification tasks and conduct comprehensive experiments on three public real-world datasets. Our method significantly improves over the baseline and achieves better or competitive performance in comparison with state-of-the-art methods in terms of both accuracy and model calibration.


title: Roadblocks to Attracting Students to Software Testing Careers: Comparisons of Replicated Studies

abstract: Context. Recently, a family of studies highlighted the unpopularity of software testing careers among undergraduate students in software engineering and computer science courses. The original study and its replications explored the perception of students in universities in four countries (Cana-da, China, India, and Malaysia), and indicated that most students do not consider a career in software testing as an option after graduation. This scenario represents a problem for the software industry since the lack of skilled testing professionals might decrease the quality of software projects and increase the number of unsuccessful projects. Goal. The present study aims to replicate, in Brazil, the studies conducted in the other four countries to establish comparisons and support the development of strategies to improve the visibility and importance of software testing among undergraduate students across the globe. Method. We followed the same protocol in the original study to collect data using a questionnaire and analyzed the answers using descriptive statistics and qualitative data analysis. Results. Our findings indicate similarities among the results obtained in Brazil in comparison to those obtained from other countries. We observed that students are not motivated to follow a testing career in the software industry based on a belief that testing activities lack challenges and opportunities for continuous learning. Conclusions. In summary, students seem to be interested in learning more about software testing. However, the lack of discussions about the theme in software development courses, as well as the limited offer of courses focused on software quality at the university level reduce the visibility of this area, which causes a decrease in the interest in this career.


title: Inverse Primakoff Scattering for Axionlike Particle Coupling

abstract: Axionlike particles (ALPs) can be produced in the Sun, and are considered viable candidates for the cosmological dark matter (DM). It can decay into two photons or interact with matter. We identify new inelastic channels of inverse Primakoff processes due to atomic excitation and ionization. Their cross sections are derived by incorporating full electromagnetic fields of atomic charge and current densities, and computed by well-benchmarked atomic many-body methods. Complementing data from the underground XENONnT and surface TEXONO experiments are analyzed. Event rates and sensitivity reaches are evaluated with respect to solar- and DM-ALPs. New parameter space in ALP couplings with the photons versus ALP masses in (1~eV$-$10~keV) not previously accessible to laboratory experiments are probed and excluded with solar-ALPs. However, at regions where DM-ALPs have already decayed, there would be no ALP-flux and hence no interactions at the detectors in direct search experiments. No physics constraints can be derived. Future projects would be able to evade the stability bound and open new observable windows in (100~eV$-$1~MeV) for DM-ALPs.


title: Extreme ratio between spectral and Frobenius norms of nonnegative tensors

abstract: One of the fundamental problems in multilinear algebra, the minimum ratio between the spectral and Frobenius norms of tensors, has received considerable attention in recent years. While most values are unknown for real and complex tensors, the asymptotic order of magnitude and tight lower bounds have been established. However, little is known about nonnegative tensors. In this paper, we present an almost complete picture of the ratio for nonnegative tensors. In particular, we provide a tight lower bound that can be achieved by a wide class of nonnegative tensors under a simple necessary and sufficient condition, which helps to characterize the extreme tensors and obtain results such as the asymptotic order of magnitude. We show that the ratio for symmetric tensors is no more than that for general tensors multiplied by a constant depending only on the order of tensors, hence determining the asymptotic order of magnitude for real, complex, and nonnegative symmetric tensors. We also find that the ratio is in general different to the minimum ratio between the Frobenius and nuclear norms for nonnegative tensors, a sharp contrast to the case for real tensors and complex tensors.


title: Gradient type estimates for linear elliptic systems from composite materials

abstract: In this paper, we consider linear elliptic systems from composite materials where the coefficients depend on the shape and might have the discontinuity between the subregions. We derive a function which is related to the gradient of the weak solutions and which is not only locally piecewise H\"{o}lder continuous but locally H\"{o}lder continuous. The gradient of the weak solutions can be estimated by this derived function and we also prove local piecewise gradient H\"{o}lder continuity which was obtained by the previous results.


title: A Lateral AlGaN/GaN Schottky Barrier Diode with 0.36 V Turn-on Voltage and 10 kV Breakdown Voltage by Using Double Barrier Anode Structure

abstract: In this letter, we demonstrate a lateral AlGaN/GaN Schottky barrier diode (SBD) on sapphire substrate with low turn-on voltage (Von) and high breakdown voltage (VBK). By using a double barrier anode (DBA) structure formed by the mixture of Platinum (Pt) and Tantalum (Ta), the Von of the SBD can be as low as 0.36 V with a leakage current of 2.5E-6 A/mm. Supported by the high-quality carbon-doped GaN buffer on sapphire, the VBK can reach more than 10 kV with the anode-to-cathode spacing of 85 {\mu}m. Combining the VBK and the specific on-resistance (Ron,sp) of 25.1 m{\Omega}.cm^2, the power figure of merit of the SBD can reach 4.0 GW/cm^2, demonstrating a great potential for the application in ultra-high-voltage electronics.


title: Accelerating Inference and Language Model Fusion of Recurrent Neural Network Transducers via End-to-End 4-bit Quantization

abstract: We report on aggressive quantization strategies that greatly accelerate inference of Recurrent Neural Network Transducers (RNN-T). We use a 4 bit integer representation for both weights and activations and apply Quantization Aware Training (QAT) to retrain the full model (acoustic encoder and language model) and achieve near-iso-accuracy. We show that customized quantization schemes that are tailored to the local properties of the network are essential to achieve good performance while limiting the computational overhead of QAT. Density ratio Language Model fusion has shown remarkable accuracy gains on RNN-T workloads but it severely increases the computational cost of inference. We show that our quantization strategies enable using large beam widths for hypothesis search while achieving streaming-compatible runtimes and a full model compression ratio of 7.6$\times$ compared to the full precision model. Via hardware simulations, we estimate a 3.4$\times$ acceleration from FP16 to INT4 for the end-to-end quantized RNN-T inclusive of LM fusion, resulting in a Real Time Factor (RTF) of 0.06. On the NIST Hub5 2000, Hub5 2001, and RT-03 test sets, we retain most of the gains associated with LM fusion, improving the average WER by $>$1.5%.


title: Combinatorial Pure Exploration of Causal Bandits

abstract: The combinatorial pure exploration of causal bandits is the following online learning task: given a causal graph with unknown causal inference distributions, in each round we choose a subset of variables to intervene or do no intervention, and observe the random outcomes of all random variables, with the goal that using as few rounds as possible, we can output an intervention that gives the best (or almost best) expected outcome on the reward variable $Y$ with probability at least $1-\delta$, where $\delta$ is a given confidence level. We provide the first gap-dependent and fully adaptive pure exploration algorithms on two types of causal models -- the binary generalized linear model (BGLM) and general graphs. For BGLM, our algorithm is the first to be designed specifically for this setting and achieves polynomial sample complexity, while all existing algorithms for general graphs have either sample complexity exponential to the graph size or some unreasonable assumptions. For general graphs, our algorithm provides a significant improvement on sample complexity, and it nearly matches the lower bound we prove. Our algorithms achieve such improvement by a novel integration of prior causal bandit algorithms and prior adaptive pure exploration algorithms, the former of which utilize the rich observational feedback in causal bandits but are not adaptive to reward gaps, while the latter of which have the issue in reverse.


title: Piecewise smoothness for linear elliptic systems with piecewise smooth coefficients

abstract: Li and Vogelius, and Li and Nirenberg obtained piecewise $C^{1,\gamma}$-regularity for linear elliptic problems with piecewise $C^{\gamma}$-coefficients which come from composite materials. In this paper, we obtain piecewise $C^{m+1,\gamma}$-regularity for linear elliptic systems with piecewise $C^{m,\gamma}$-coefficients which also come from composite materials. This answers the open problem suggested by Li and Vogelius, and Li and Nirenberg.


title: Quantum Circuit Optimization and Transpilation via Parameterized Circuit Instantiation

abstract: Parameterized circuit instantiation is a common technique encountered in the generation of circuits for a large class of hybrid quantum-classical algorithms. Despite being supported by popular quantum compilation infrastructures such as IBM Qiskit and Google Cirq, instantiation has not been extensively considered in the context of circuit compilation and optimization pipelines. In this work, we describe algorithms to apply instantiation during two common compilation steps: circuit optimization and gate-set transpilation. When placed in a compilation workflow, our circuit optimization algorithm produces circuits with an average of 13% fewer gates than other optimizing compilers. Our gate-set transpilation algorithm can target any gate-set, even sets with multiple two-qubit gates, and produces circuits with an average of 12% fewer two-qubit gates than other compilers. Overall, we show how instantiation can be incorporated into a compiler workflow to improve circuit quality and enhance portability, all while maintaining a reasonably low compile time overhead.


title: Generalization Bounds for Data-Driven Numerical Linear Algebra

abstract: Data-driven algorithms can adapt their internal structure or parameters to inputs from unknown application-specific distributions, by learning from a training sample of inputs. Several recent works have applied this approach to problems in numerical linear algebra, obtaining significant empirical gains in performance. However, no theoretical explanation for their success was known. In this work we prove generalization bounds for those algorithms, within the PAC-learning framework for data-driven algorithm selection proposed by Gupta and Roughgarden (SICOMP 2017). Our main results are closely matching upper and lower bounds on the fat shattering dimension of the learning-based low rank approximation algorithm of Indyk et al.~(NeurIPS 2019). Our techniques are general, and provide generalization bounds for many other recently proposed data-driven algorithms in numerical linear algebra, covering both sketching-based and multigrid-based methods. This considerably broadens the class of data-driven algorithms for which a PAC-learning analysis is available.


title: Resilient Operational Planning for Microgrids Against Extreme Events

abstract: This paper proposes a novel resilience index, a microgrid survivability rate (SR) under extreme events, and then proposes a novel Resilient Operational Planning (ROP) algorithm to maximize the proposed resilience index SR. The proposed ROP algorithm can incorporate predetermined inverter failure probabilities and generate multiple scenarios accordingly to optimize resilient operations during an extreme event. The implemented ROP algorithm consists of two main steps: (i) optimization of resilient operational planning, and (ii) preventive resilience enhancement if minimum SR is not met per the analysis in step 1. A typical microgrid (MG) is studied to compare the proposed ROP algorithm against a traditional microgrid energy management (MEM) model. Results indicate that an enhanced resilience operation is achieved by the ROP algorithm, which is demonstrated by the quantification of resilience via the SR. Moreover, the proposed ROP algorithm is able to obtain a greater SR overall compared to that achieved by the traditional MEM, and this benefit of using the proposed ROP increases as the inverter failure probabilities increase.


title: A vector magnetometer based on a single spin-orbit torque anomalous Hall device

abstract: In many applications, the ability to measure the vector information of a magnetic field with high spatial resolution and low cost is essential, but it is still a challenge for existing magnetometers composed of multiple sensors. Here, we report a single-device based vector magnetometer, which is enabled by spin-orbit torque, capable of measuring a vector magnetic field using the harmonic Hall resistances of a superparamagnetic ferromagnet (FM)/heavy metal (HM) bilayer. Under an ac driving current, the first and second harmonic Hall resistances of the FM/HM bilayer show a linear relationship with the vertical and longitudinal component (along the current direction) of the magnetic field, respectively. By employing a L-shaped Hall device with two orthogonal arms, we can measure all the three field components simultaneously, so as to detect both the amplitude and direction of magnetic field in a three-dimensional space. As proof of concepts, we demonstrate both angular position sensing on the three coordinate planes and vector mapping of magnetic field generated by a permanent magnet, both of which are in good agreement with the simulation results. Crosstalk between vertical and longitudinal field components at large field is discussed using theoretical models.


title: Arnoldi-based orthonormal and hierarchical divergence-free polynomial basis and its applications

abstract: This paper presents a methodology to construct a divergence-free polynomial basis of an arbitrary degree in a simplex (triangles in 2D and tetrahedra in 3D) of arbitrary dimension. It allows for fast computation of all numerical solutions from degree zero to a specified degree \textit{k} for certain PDEs. The generated divergence-free basis is orthonormal, hierarchical, and robust in finite-precision arithmetic. At the core is an Arnoldi-based procedure. It constructs an orthonormal and hierarchical basis for multi-dimensional polynomials of degree less than or equal to \textit{k}. The divergence-free basis is generated by combining these polynomial basis functions. An efficient implementation of the hybridized BDM mixed method is developed using these basis functions. Hierarchy allows for incremental construction of the global matrix and the global vector for all degrees (zero to \textit{k}) using the local problem solution computed just for degree \textit{k}. Orthonormality and divergence-free properties simplify the local problem. PDEs considered are Helmholtz, Laplace, and Poisson problems in smooth domains and in a corner domain. These advantages extend to other PDEs such as incompressible Stokes, incompressible Navier-Stokes, and Maxwell equations.


title: Equivalent Topologies on the Contracting Boundary

abstract: The contracting boundary of a proper geodesic metric space generalizes the Gromov boundary of a hyperbolic space. It consists of contracting geodesics up to bounded Hausdorff distances. Another generalization of the Gromov boundary is the $\kappa$-Morse boundary with a sublinear function $\kappa$. The two generalizations model the Gromov boundary based on different characteristics of geodesics in Gromov hyperbolic spaces. It was suspected that the $\kappa$-Morse boundary contains the contracting boundary. We will prove this conjecture: when $\kappa =1$ is the constant function, the 1-Morse boundary and the contracting boundary are equivalent as topological spaces.


title: Gauge symmetry of linearised Nordstr\"om gravity and the dual spin two field theory

abstract: The field equations are proposed for the third rank tensor field with the hook Young diagram. The equations describe the irreducible spin two massless representation in any $d\geq 3$. The starting point of the construction is the linearised system of Einstein equations which includes the Nordstr\"om equation. This equation, being considered irrespectively to the rest of the Einstein system, corresponds to the topological field theory. The general solution is a pure gauge, modulo topological modes which we neglect in this article. We find the sequence of the reducible gauge transformations for the linearised Nordstr\"om equation, with the hook tensor being the initial gauge symmetry parameter. By substituting the general solution of the Nordstr\"om equation into the rest of the Einstein's system, we arrive at the field equations for the hook tensor. The degree of freedom number count confirms, it is the spin two theory.


title: Max-Margin Works while Large Margin Fails: Generalization without Uniform Convergence

abstract: A major challenge in modern machine learning is theoretically understanding the generalization properties of overparameterized models. Many existing tools rely on uniform convergence (UC), a property that, when it holds, guarantees that the test loss will be close to the training loss, uniformly over a class of candidate models. Nagarajan and Kolter (2019) show that in certain simple linear and neural-network settings, any uniform convergence bound will be vacuous, leaving open the question of how to prove generalization in settings where UC fails. Our main contribution is proving novel generalization bounds in two such settings, one linear, and one non-linear. We study the linear classification setting of Nagarajan and Kolter, and a quadratic ground truth function learned via a two-layer neural network in the non-linear regime. We prove a new type of margin bound showing that above a certain signal-to-noise threshold, any near-max-margin classifier will achieve almost no test loss in these two settings. Our results show that near-max-margin is important: while any model that achieves at least a $(1 - \epsilon)$-fraction of the max-margin generalizes well, a classifier achieving half of the max-margin may fail terribly. Building on the impossibility results of Nagarajan and Kolter, under slightly stronger assumptions, we show that one-sided UC bounds and classical margin bounds will fail on near-max-margin classifiers. Our analysis provides insight on why memorization can coexist with generalization: we show that in this challenging regime where generalization occurs but UC fails, near-max-margin classifiers simultaneously contain some generalizable components and some overfitting components that memorize the data. The presence of the overfitting components is enough to preclude UC, but the near-extremal margin guarantees that sufficient generalizable components are present.


title: PeQuENet: Perceptual Quality Enhancement of Compressed Video with Adaptation- and Attention-based Network

abstract: In this paper we propose a generative adversarial network (GAN) framework to enhance the perceptual quality of compressed videos. Our framework includes attention and adaptation to different quantization parameters (QPs) in a single model. The attention module exploits global receptive fields that can capture and align long-range correlations between consecutive frames, which can be beneficial for enhancing perceptual quality of videos. The frame to be enhanced is fed into the deep network together with its neighboring frames, and in the first stage features at different depths are extracted. Then extracted features are fed into attention blocks to explore global temporal correlations, followed by a series of upsampling and convolution layers. Finally, the resulting features are processed by the QP-conditional adaptation module which leverages the corresponding QP information. In this way, a single model can be used to enhance adaptively to various QPs without requiring multiple models specific for every QP value, while having similar performance. Experimental results demonstrate the superior performance of the proposed PeQuENet compared with the state-of-the-art compressed video quality enhancement algorithms.


title: Floquet driven frictional effects

abstract: When the coupled electron-nuclear dynamics are subjected to strong Floquet driving, there is a strong breakdown of the Born-Oppenheimer approximation. In this article, we derive a Fokker-Planck equation to describe non-adiabatic molecular dynamics with electronic friction for Floquet driven systems. We first provide a new derivation of the Floquet quantum-classical Liouville equation (QCLE) for driven electron-nuclear dynamics. We then transform the Floquet QCLE into a Fokker-Planck equation with explicit forms of frictional force and random force. We recast the electronic friction in terms of Floquet Green's functions such that we can evaluate the electronic friction explicitly. We show that the Floquet electronic friction tensor exhibits antisymmetric terms even at equilibrium for real-valued Hamiltonian, suggesting that there is a Lorentz-like force in Floquet driven non-Born Oppenheimer dynamics even without any spin-orbit couplings.


title: Dual-channel Early Warning Framework for Ethereum Ponzi Schemes

abstract: Blockchain technology supports the generation and record of transactions, and maintains the fairness and openness of the cryptocurrency system. However, many fraudsters utilize smart contracts to create fraudulent Ponzi schemes for profiting on Ethereum, which seriously affects financial security. Most existing Ponzi scheme detection techniques suffer from two major restricted problems: the lack of motivation for temporal early warning and failure to fuse multi-source information finally cause the lagging and unsatisfactory performance of Ethereum Ponzi scheme detection. In this paper, we propose a dual-channel early warning framework for Ethereum Ponzi schemes, named Ponzi-Warning, which performs feature extraction and fusion on both code and transaction levels. Moreover, we represent a temporal evolution augmentation strategy for generating transaction graph sequences, which can effectively increase the data scale and introduce temporal information. Comprehensive experiments on our Ponzi scheme datasets demonstrate the effectiveness and timeliness of our framework for detecting the Ponzi contract accounts.


title: CuPBoP: CUDA for Parallelized and Broad-range Processors

abstract: CUDA is one of the most popular choices for GPU programming, but it can only be executed on NVIDIA GPUs. Executing CUDA on non-NVIDIA devices not only benefits the hardware community, but also allows data-parallel computation in heterogeneous systems. To make CUDA programs portable, some researchers have proposed using source-to-source translators to translate CUDA to portable programming languages that can be executed on non-NVIDIA devices. However, most CUDA translators require additional manual modifications on the translated code, which imposes a heavy workload on developers. In this paper, CuPBoP is proposed to execute CUDA on non-NVIDIA devices without relying on any portable programming languages. Compared with existing work that executes CUDA on non-NVIDIA devices, CuPBoP does not require manual modification of the CUDA source code, but it still achieves the highest coverage (69.6%), much higher than existing frameworks (56.6%) on the Rodinia benchmark. In particular, for CPU backends, CuPBoP supports several ISAs (e.g., X86, RISC-V, AArch64) and has close or even higher performance compared with other projects. We also compare and analyze the performance among CuPBoP, manually optimized OpenMP/MPI programs, and CUDA programs on the latest Ampere architecture GPU, and show future directions for supporting CUDA programs on non-NVIDIA devices with high performance


title: NCAGC: A Neighborhood Contrast Framework for Attributed Graph Clustering

abstract: Attributed graph clustering is one of the most fundamental tasks among graph learning field, the goal of which is to group nodes with similar representations into the same cluster without human annotations. Recent studies based on graph contrastive learning method have achieved remarkable results when exploit graph-structured data. However, most existing methods 1) do not directly address the clustering task, since the representation learning and clustering process are separated; 2) depend too much on data augmentation, which greatly limits the capability of contrastive learning; 3) ignore the contrastive message for clustering tasks, which adversely degenerate the clustering results. In this paper, we propose a Neighborhood Contrast Framework for Attributed Graph Clustering, namely NCAGC, seeking for conquering the aforementioned limitations. Specifically, by leveraging the Neighborhood Contrast Module, the representation of neighbor nodes will be 'push closer' and become clustering-oriented with the neighborhood contrast loss. Moreover, a Contrastive Self-Expression Module is built by minimizing the node representation before and after the self-expression layer to constraint the learning of self-expression matrix. All the modules of NCAGC are optimized in a unified framework, so the learned node representation contains clustering-oriented messages. Extensive experimental results on four attributed graph datasets demonstrate the promising performance of NCAGC compared with 16 state-of-the-art clustering methods. The code is available at https://github.com/wangtong627/NCAGC.


title: Multimodal Dialogue State Tracking

abstract: Designed for tracking user goals in dialogues, a dialogue state tracker is an essential component in a dialogue system. However, the research of dialogue state tracking has largely been limited to unimodality, in which slots and slot values are limited by knowledge domains (e.g. restaurant domain with slots of restaurant name and price range) and are defined by specific database schema. In this paper, we propose to extend the definition of dialogue state tracking to multimodality. Specifically, we introduce a novel dialogue state tracking task to track the information of visual objects that are mentioned in video-grounded dialogues. Each new dialogue utterance may introduce a new video segment, new visual objects, or new object attributes, and a state tracker is required to update these information slots accordingly. We created a new synthetic benchmark and designed a novel baseline, Video-Dialogue Transformer Network (VDTN), for this task. VDTN combines both object-level features and segment-level features and learns contextual dependencies between videos and dialogues to generate multimodal dialogue states. We optimized VDTN for a state generation task as well as a self-supervised video understanding task which recovers video segment or object representations. Finally, we trained VDTN to use the decoded states in a response prediction task. Together with comprehensive ablation and qualitative analysis, we discovered interesting insights towards building more capable multimodal dialogue systems.


title: Probing the progenitor of high-$z$ short-duration GRB 201221D and its possible bulk acceleration in prompt emission

abstract: The growing observed evidence shows that the long- and short-duration gamma-ray bursts (GRBs) originate from massive star core-collapse and the merger of compact stars, respectively. GRB 201221D is a short-duration GRB lasting $\sim 0.1$ s without extended emission (EE) at high redshift $z=1.046$. By analyzing data observed with the Swift/BAT and Fermi/GBM, we find that a cutoff power-law model can adequately fit the spectrum with a soft $E_{\rm p}=113^{+9}_{-7}$ keV, and isotropic energy $E_{\gamma,iso} =1.36^{+0.17}_{-0.14}\times 10^{51}~\rm erg$. In order to reveal the possible physical origin of GRB 201221D, we adopted multi-wavelength criteria (e.g., Amati relation, $\varepsilon$-parameter, amplitude parameter, local event rate density, luminosity function, and properties of the host galaxy), and find that most of the observations of GRB 201221D favor a compact star merger origin. Moreover, we find that $\hat{\alpha}$ is larger than $2+\hat{\beta}$ in the prompt emission phase which suggests that the emission region is possibly undergoing acceleration during the prompt emission phase with a Poynting-flux-dominated jet.


title: Quest for eternal oscillons

abstract: Nonlinear field theories produce unstable but long-lived configurations known as oscillons. These structures have been studied with asymmetric and symmetric double-well potentials and extended to other forms of potentials. In the present work, we examine the consequences of considering higher-order field theories, where we have used a generalization of the symmetric double-well potential and a $\phi^6$ potential. Consequently, we have found $3+1$ spherically symmetric oscillons with significantly large lifetimes without parameter fine-tuning.


title: Target-oriented elastic full-waveform inversion through extended image-space redatuming

abstract: Elastic full-waveform inversion (FWI) when successfully applied can provide accurate and high-resolution subsurface parameters. However, its high computational cost prevents the application of this method to large-scale field-data scenarios. To mitigate this limitation, we propose a target-oriented elastic FWI methodology based on a redatuming step that relies upon an extended least-squared migration process. In our approach, the surface-reflection data can be attributed to a given subsurface portion when mapped into the image space. This process allows us to reconstruct reflection data generated by a target area and recorded with a virtual acquisition geometry positioned directly above it. The redatuming step enables the application of an elastic FWI method within the target portion only. The entire workflow drastically diminishes the overall cost of the surface-data inversion and allows the retrieval of accurate elastic parameters of the area of interest. We demonstrate the effectiveness of our approach on a synthetic case based on the well-known Marmousi2 model and on a 3D ocean-bottom-node (OBN) pressure data recorded in the Gulf of Mexico. We first discuss the fundamental aspects of the methodology and apply the proposed workflow to the synthetic test case. We also employ the methodology on the field-data scenario and show its efficacy at correctly retrieving the elastic parameters and rock-physical properties of a gas-bearing sand reservoir positioned in proximity of a salt-dome flank.


title: On Privacy and Personalization in Cross-Silo Federated Learning

abstract: While the application of differential privacy (DP) has been well-studied in cross-device federated learning (FL), there is a lack of work considering DP and its implications for cross-silo FL, a setting characterized by a limited number of clients each containing many data subjects. In cross-silo FL, usual notions of client-level DP are less suitable as real-world privacy regulations typically concern the in-silo data subjects rather than the silos themselves. In this work, we instead consider an alternative notion of silo-specific sample-level DP, where silos set their own privacy targets for their local examples. Under this setting, we reconsider the roles of personalization in federated learning. In particular, we show that mean-regularized multi-task learning (MR-MTL), a simple personalization framework, is a strong baseline for cross-silo FL: under stronger privacy requirements, silos are incentivized to federate more with each other to mitigate DP noise, resulting in consistent improvements relative to standard baseline methods. We provide an empirical study of competing methods as well as a theoretical characterization of MR-MTL for mean estimation, highlighting the interplay between privacy and cross-silo data heterogeneity. Our work serves to establish baselines for private cross-silo FL as well as identify key directions of future work in this area.


title: Investigating the role and limitation of colliding partners variables in heavy actinide nuclei

abstract: Measurements on mass , angular distributions, fusion-fission cross-sections of fission fragments from actinide nuclei $^{249}$Bk and $^{257}$Md, produced in fusion reactions $^{11}$B, $^{19}$F + $^{238}$U, and comparative studies with projectiles $^{12}$C, $^{16}$O,$^{30}$Si on same target with help of existing works are presented. The measured mass distribution data agree well with statistical model GEMINI++ predictions, the measured angular anisotropy data for $^{19}$F + $^{238}$U reaction exhibit deviation from the Transition State Model (TSM) results at energies below the fusion barrier. The fission cross-section data are reproduced fairly well using the coupled-channel CCFULL calculations. The microscopic TDHF quantum calculations also show no significant interplay between the orientation of the prolate deformed $^{238}$U whether tip to tip or side by side collision. Fusion-fission mechanism involving projectiles with atomic mass (A) 22 and charge 9 on actinide targets in the actinide chart are dominated by shell manifestation comparatively colliding partner's variables in reactions.


title: Explainable Models via Compression of Tree Ensembles

abstract: Ensemble models (bagging and gradient-boosting) of relational decision trees have proved to be one of the most effective learning methods in the area of probabilistic logic models (PLMs). While effective, they lose one of the most important aspect of PLMs -- interpretability. In this paper we consider the problem of compressing a large set of learned trees into a single explainable model. To this effect, we propose CoTE -- Compression of Tree Ensembles -- that produces a single small decision list as a compressed representation. CoTE first converts the trees to decision lists and then performs the combination and compression with the aid of the original training set. An experimental evaluation demonstrates the effectiveness of CoTE in several benchmark relational data sets.


title: Estimating Parameterized Entanglement Measure

abstract: The parameterized entanglement monotone, the $q$-concurrence, is also a reasonable parameterized entanglement measure. By exploring the properties of the $q$-concurrence with respect to the positive partial transposition and realignment of density matrices, we present tight lower bounds of the $q$-concurrence for arbitrary $q\geqslant 2$. Detailed examples are given to show that the bounds are better than the previous ones.


title: Improved Forward Problem Modeling in Magnetic Induction Tomography for Biomedical Applications

abstract: The main contribution of this thesis is to investigate the incorporating skin and proximity effects in magnetic induction tomography (MIT) coils and present an improved model for the two-dimensional (2D) forward problem. To evaluate the performance of the improved method in possible biomedical applications, a 16 coils 2D MIT system is modeled, and the finite element method (FEM) is employed to solve the forward problem. Results show the difference between the induced voltages obtained from the early and improved method falls into the meaningful range in terms of achievable conductivity contrast from the improved one. This finding revealed the importance and necessity of using the improved forward method for modeling 2D MIT coils for biomedical applications...


title: Comparative analysis of error mitigation techniques for variational quantum eigensolver implementations on IBM quantum system

abstract: Quantum computers are anticipated to transcend classical supercomputers for computationally intensive tasks by exploiting the principles of quantum mechanics. However, the capabilities of the current generation of quantum devices are limited due to noise or errors, and therefore implementation of error mitigation and/or correction techniques is pivotal to reliably process quantum algorithms. In this work, we have performed a comparative analysis of the error mitigation capability of the [[4,2,2]] quantum error-detecting code (QEC method), duplicate circuit technique, and the Bayesian read-out error mitigation (BREM) approach in the context of proof-of-concept implementations of variational quantum eigensolver (VQE) algorithm for determining the ground state energy of H$_2$ molecule. Based on experiments on IBM quantum device, our results show that the duplicate circuit approach performs superior to the QEC method in the presence of the hardware noise. A significant impact of cross-talk noise was observed when multiple mappings of the duplicate circuit and the QEC method were implemented simultaneously $-$ again the duplicate circuit approach overall performed better than the QEC method. To gain further insights into the performance of the studied error mitigation techniques, we also performed quantum simulations on IBM system with varying strengths of depolarising circuit noise and read-out errors which further supported the main finding of our work that the duplicate circuit offer superior performance towards mitigating of errors when compared to the QEC method. Our work reports a first assessment of the duplicate circuit approach for a quantum algorithm implementation and the documented evidence will pave the way for future scalable implementations of the duplicated circuit techniques for the error-mitigated practical applications of near-term quantum computers.

categories: quant-ph cond-mat.mtrl-sci physics.chem-ph physics.comp-ph


title: Simultaneously Learning Stochastic and Adversarial Bandits with General Graph Feedback

abstract: The problem of online learning with graph feedback has been extensively studied in the literature due to its generality and potential to model various learning tasks. Existing works mainly study the adversarial and stochastic feedback separately. If the prior knowledge of the feedback mechanism is unavailable or wrong, such specially designed algorithms could suffer great loss. To avoid this problem, \citet{erez2021towards} try to optimize for both environments. However, they assume the feedback graphs are undirected and each vertex has a self-loop, which compromises the generality of the framework and may not be satisfied in applications. With a general feedback graph, the observation of an arm may not be available when this arm is pulled, which makes the exploration more expensive and the algorithms more challenging to perform optimally in both environments. In this work, we overcome this difficulty by a new trade-off mechanism with a carefully-designed proportion for exploration and exploitation. We prove the proposed algorithm simultaneously achieves $\mathrm{poly} \log T$ regret in the stochastic setting and minimax-optimal regret of $\tilde{O}(T^{2/3})$ in the adversarial setting where $T$ is the horizon and $\tilde{O}$ hides parameters independent of $T$ as well as logarithmic terms. To our knowledge, this is the first best-of-both-worlds result for general feedback graphs.


title: Methods to Simplify Object Tracking in Video Data

abstract: Recent years have seen an explosion of interest in analyzing the motion of objects in video data as a way for students to connect the concepts of physics to something tangible like a video recording of an experiment. A variety of software exists for students to look at individual frames and click on the object to infer the x,y position. Some of these tools include a capability to automatically identify the position of the object in the frame. But it is not unusual, especially when inexperienced users are recording the video and configuring the program, for these algorithms to struggle to "lock on" to the moving object. In this paper, we both include some general advice to help object tracking algorithms locate an object and we provide our own algorithms that are simpler and potentially more effective than the sophisticated image processing algorithms that are currently being used. These algorithms focus not on a "template image" of the moving object but instead distinguish between the object and the background by analyzing only the colors of individual pixels. These algorithms are built into a free and open source program called the STEMcoding Object Tracker (http://go.osu.edu/objecttracker) which works in the browser (without any downloads) and is compatible with a variety of operating systems including chromebooks.


title: Introducing the Huber mechanism for differentially private low-rank matrix completion

abstract: Performing low-rank matrix completion with sensitive user data calls for privacy-preserving approaches. In this work, we propose a novel noise addition mechanism for preserving differential privacy where the noise distribution is inspired by Huber loss, a well-known loss function in robust statistics. The proposed Huber mechanism is evaluated against existing differential privacy mechanisms while solving the matrix completion problem using the Alternating Least Squares approach. We also propose using the Iteratively Re-Weighted Least Squares algorithm to complete low-rank matrices and study the performance of different noise mechanisms in both synthetic and real datasets. We prove that the proposed mechanism achieves {\epsilon}-differential privacy similar to the Laplace mechanism. Furthermore, empirical results indicate that the Huber mechanism outperforms Laplacian and Gaussian in some cases and is comparable, otherwise.