title: Audio classification of the content of food containers and drinking glasses

abstract: Food containers, drinking glasses and cups handled by a person generate sounds that vary with the type and amount of their content. In this paper, we propose a new model for sound-based classification of the type and amount of content in a container. The proposed model is based on the decomposition of the problem into two steps, namely action recognition and content classification. We use the scenario of the recent CORSMAL Containers Manipulation dataset and consider two actions (shaking and pouring), and seven combinations of material and filling level. The first step identifies the action performed by a person with the container. The second step determines the amount and type of content using an action-specific classifier. Experiments show that the proposed model achieves 76.02, 78.24, and 41.89 weighted average F1 score on the three test sets, respectively, and outperforms baselines and existing approaches that classify the content amount and type either independently or jointly.


title: Liquid-jet instability at high pressures with real-fluid interface thermodynamics

abstract: The injection of liquid fuel at supercritical pressures is a relevant topic in combustion, but usually overlooked. In the past, the wrong assumption whereby the liquid experiments a fast transition to a supercritical state was made, thus neglecting any role of two-phase interface dynamics in the early stages of the atomization process. However, recent studies have shown that local thermodynamic phase equilibrium and mixing between the involved species allow the coexistence of both phases in this pressure range. In this work, a Volume-of-Fluid method adapted to variable-density real fluids is used to solve the low-Mach-number governing equations coupled with a thermodynamic model based on the Soave-Redlich-Kwong equation of state. The mixing process, interface thermodynamics and early deformation of a cool liquid jet composed of n-decane surrounded by a hotter gas composed of oxygen at 150 bar are analyzed. Although heat conducts from the hotter gas into the liquid, net condensation can provide the proper local energy balance at high pressures. Then, vaporization and condensation may happen simultaneously at different interface locations. As pressure increases, liquid and gas mixtures become more alike in the vicinity of the interface. Thus, a combination of low surface tension force and gas-like liquid viscosities causes an early growth of surface instabilities. Early results indicate some similarity with high-Weber-number incompressible flows. The role of vortex dynamics on the interface deformation is analyzed by using the dynamical vortex identification method.


title: Classical Poincar{\'e} conjecture via 4D topology

abstract: The classical Poincar{\'e} conjecture that every homotopy 3-sphere is diffeomorphic to the 3-sphere is confirmed by Perelman in arXiv papers solving Thurston's program on geometrizations of 3-manifolds. A new confirmation of this conjecture is given by a method of 4D topology. For this proof, the spun torus-knot of every knot in every homotopy 3-sphere is observed to be a ribbon torus-knot in the 4-sphere, where Smooth 4D Poincar{\'e} Conjecture and Ribbonness of a sphere-link with (not necessarily meridian-based) free fundamental group are used. By examining a disk-chord system of a ribbon solid torus bounded by the spun torus-knot,it is proved that the knot belongs to a 3-ball in the homotopy 3-sphere. Then by Bing's result, it is confirmed that the homotopy 3-sphere is diffeomorphic to the 3-sphere.


title: AGQA: A Benchmark for Compositional Spatio-Temporal Reasoning

abstract: Visual events are a composition of temporal actions involving actors spatially interacting with objects. When developing computer vision models that can reason about compositional spatio-temporal events, we need benchmarks that can analyze progress and uncover shortcomings. Existing video question answering benchmarks are useful, but they often conflate multiple sources of error into one accuracy metric and have strong biases that models can exploit, making it difficult to pinpoint model weaknesses. We present Action Genome Question Answering (AGQA), a new benchmark for compositional spatio-temporal reasoning. AGQA contains $192M$ unbalanced question answer pairs for $9.6K$ videos. We also provide a balanced subset of $3.9M$ question answer pairs, $3$ orders of magnitude larger than existing benchmarks, that minimizes bias by balancing the answer distributions and types of question structures. Although human evaluators marked $86.02\%$ of our question-answer pairs as correct, the best model achieves only $47.74\%$ accuracy. In addition, AGQA introduces multiple training/test splits to test for various reasoning abilities, including generalization to novel compositions, to indirect references, and to more compositional steps. Using AGQA, we evaluate modern visual reasoning systems, demonstrating that the best models barely perform better than non-visual baselines exploiting linguistic biases and that none of the existing models generalize to novel compositions unseen during training.


title: Feature-Based Compliance Control for Peg-in-Hole Assembly with Clearance or Interference Fit

abstract: This paper aims at solving mass precise peg-in-hole assembly. First, a feature space and a response space are constructed according to the relative pose and equivalent forces and moments. Then the contact states are segmented in the feature space and the segmentation boundaries are mapped into the response space. Further, a feature-based compliance control (FBCC) algorithm is proposed based on boundary mapping. In the FBCC algorithm, a direction matrix is designed to execute accurate adjustment and an integrator is applied to eliminate the residual responses. Finally, the simulations and experiments demonstrate the superiority, robustness, and generalization ability of the FBCC.


title: A Review of Containerization for Interactive and Reproducible Analysis

abstract: In recent decades the analysis of data has become increasingly computational. Correspondingly, this has changed how scientific and statistical work is shared. For example, it is now commonplace for underlying analysis code and data to be proffered alongside journal publications and conference talks. Unfortunately, sharing code faces several challenges. First, it is often difficult to take code from one computer and run it on another. Code configuration, version, and dependency issues often make this challenging. Secondly, even if the code runs, it is often hard to understand or interact with the analysis. This makes it difficult to assess the code and its findings, for example, in a peer review process. In this review we describe the combination of two computing technologies that help make analyses shareable, interactive, and completely reproducible. These technologies are (1) analysis containerization, which leverages virtualization to fully encapsulate analysis, data, code and dependencies into an interactive and shareable format, and (2) code notebooks, a literate programming format for interacting with analyses. The fusion of these two technologies offers significant advantages over using either individually. This review surveys how the combination enhances the accessibility and reproducibility of code, analyses, and ideas.


title: Iwasawa Invariants for elliptic curves over $\mathbb{Z}_{p}$-extensions and Kida's Formula

abstract: This paper aims at studying the Iwasawa $\lambda$-invariant of the $p$-primary Selmer group. We study the growth behaviour of $p$-primary Selmer groups in $p$-power degree extensions over non-cyclotomic $\mathbb{Z}_p$-extensions of a number field. We prove a generalization of Kida's formula in such a case. Unlike the cyclotomic $\mathbb{Z}_p$-extension, where all primes are finitely decomposed; in the $\mathbb{Z}_p$-extensions we consider, primes may be infinitely decomposed. In the second part of the paper, we study the relationship for Iwasawa invariants with respect to congruences, obtaining refinements of the results of R. Greenberg-V. Vatsal and K. Kidwell. As an application, we provide an algorithm for constructing elliptic curves with large anticyclotomic $\lambda$-invariant. Our results are illustrated by explicit computation.


title: On the $C_p$-equivariant dual Steenrod algebra

abstract: We compute the $C_p$-equivariant dual Steenrod algebras associated to the constant Mackey functors $\underline{\mathbb{F}}_p$ and $\underline{\mathbb{Z}}_{(p)}$, as $\underline{\mathbb{Z}}_{(p)}$-modules. The $C_p$-spectrum $\underline{\mathbb{F}}_p \otimes \underline{\mathbb{F}}_p$ is not a direct sum of $RO(C_p)$-graded suspensions of $\underline{\mathbb{F}}_p$ when $p$ is odd, in contrast with the classical and $C_2$-equivariant dual Steenrod algebras.


title: Production Machine Learning Pipelines: Empirical Analysis and Optimization Opportunities

abstract: Machine learning (ML) is now commonplace, powering data-driven applications in various organizations. Unlike the traditional perception of ML in research, ML production pipelines are complex, with many interlocking analytical components beyond training, whose sub-parts are often run multiple times on overlapping subsets of data. However, there is a lack of quantitative evidence regarding the lifespan, architecture, frequency, and complexity of these pipelines to understand how data management research can be used to make them more efficient, effective, robust, and reproducible. To that end, we analyze the provenance graphs of 3000 production ML pipelines at Google, comprising over 450,000 models trained, spanning a period of over four months, in an effort to understand the complexity and challenges underlying production ML. Our analysis reveals the characteristics, components, and topologies of typical industry-strength ML pipelines at various granularities. Along the way, we introduce a specialized data model for representing and reasoning about repeatedly run components in these ML pipelines, which we call model graphlets. We identify several rich opportunities for optimization, leveraging traditional data management ideas. We show how targeting even one of these opportunities, i.e., identifying and pruning wasted computation that does not translate to model deployment, can reduce wasted computation cost by 50% without compromising the model deployment cadence.


title: The open access effect in social media exposure of scholarly articles: A matched-pair analysis

abstract: Scholarly journals are increasingly using social media to share their latest research publications and communicate with their readers. Having a presence on social media gives journals a platform to raise their profile and promote their content. This study compares the number of clicks received when journals provide two types of links to subscription articles: open access (OA) and paid content links. We examine the OA effect using unique matched-pair data for the journal Nature Materials. Our study finds that OA links perform better than paid content links. In particular, when the journal does not indicate that a link to an article is an OA link, there is an obvious drop in performance against clicks on links indicating OA status. OA has a positive effect on the number of clicks in all countries, but its positive impact is slightly greater in developed countries. The results suggest that free content is more attractive to users than paid content. Social media exposure of scholarly articles promotes the use of research outputs. Combining social media dissemination with OA appears to enhance the reach of scientific information. However, extensive further efforts are needed to remove barriers to OA.


title: Revisiting Local Descriptor for Improved Few-Shot Classification

abstract: Few-shot classification studies the problem of quickly adapting a deep learner to understanding novel classes based on few support images. In this context, recent research efforts have been aimed at designing more and more complex classifiers that measure similarities between query and support images, but left the importance of feature embeddings seldom explored. We show that the reliance on sophisticated classifiers is not necessary, and a simple classifier applied directly to improved feature embeddings can instead outperform most of the leading methods in the literature. To this end, we present a new method named \textbf{DCAP} for few-shot classification, in which we investigate how one can improve the quality of embeddings by leveraging \textbf{D}ense \textbf{C}lassification and \textbf{A}ttentive \textbf{P}ooling. Specifically, we propose to train a learner on base classes with abundant samples to solve dense classification problem first and then meta-train the learner on a bunch of randomly sampled few-shot tasks to adapt it to few-shot scenario or the test time scenario. During meta-training, we suggest to pool feature maps by applying attentive pooling instead of the widely used global average pooling (GAP) to prepare embeddings for few-shot classification. Attentive pooling learns to reweight local descriptors, explaining what the learner is looking for as evidence for decision making. Experiments on two benchmark datasets show the proposed method to be superior in multiple few-shot settings while being simpler and more explainable. Code is available at: \url{https://github.com/Ukeyboard/dcap/}.


title: Theory-Guided Machine Learning for Process Simulation of Advanced Composites

abstract: Science-based simulation tools such as Finite Element (FE) models are routinely used in scientific and engineering applications. While their success is strongly dependent on our understanding of underlying governing physical laws, they suffer inherent limitations including trade-off between fidelity/accuracy and speed. The recent rise of Machine Learning (ML) proposes a theory-agnostic paradigm. In complex multi-physics problems, however, creating large enough datasets for successful training of ML models has proven to be challenging. One promising strategy to bridge the divide between these approaches and take advantage of their respective strengths is Theory-Guided Machine Learning (TGML) which aims to integrate physical laws into ML algorithms. In this paper, three case studies on thermal management during processing of advanced composites are presented and studied using FE, ML and TGML. A structured approach to incrementally adding increasingly complex physics to training of TGML model is presented. The benefits of TGML over ML models are seen in more accurate predictions, particularly outside the training region, and ability to train with small datasets. One benefit of TGML over FE is significant speed improvement to potentially develop real-time feedback systems. A recent successful implementation of a TGML model to assess producibility of aerospace composite parts is presented.


title: Umbel convexity and the geometry of trees

abstract: For every $p\in(0,\infty)$, a new metric invariant called umbel $p$-convexity is introduced. The asymptotic notion of umbel convexity captures the geometry of countably branching trees, much in the same way as Markov convexity, the local invariant which inspired it, captures the geometry of bounded degree trees. Umbel convexity is used to provide a "Poincar\'e-type" metric characterization of the class of Banach spaces that admit an equivalent norm with Rolewicz's property $(\beta)$. We explain how a relaxation of umbel $p$-convexity, called umbel cotype $p$, plays a role in obtaining compression rate bounds for coarse embeddings of countably branching trees. Local analogs of these invariants, fork $q$-convexity and fork cotype $q$, are introduced and their relationship to Markov $q$-convexity and relaxations of the $q$-tripod inequality is discussed. The metric invariants are estimated for a large class of Heisenberg groups. Finally, a new characterization of non-negative curvature is given.


title: A database of travel-related behaviors and attitudes before, during, and after COVID-19 in the United States

abstract: The COVID-19 pandemic has impacted billions of people around the world. To capture some of these impacts in the United States, we are conducting a nationwide longitudinal survey collecting information about activity and travel-related behaviors and attitudes before, during, and after the COVID-19 pandemic. The survey questions cover a wide range of topics including commuting, daily travel, air travel, working from home, online learning, shopping, and risk perception, along with attitudinal, socioeconomic, and demographic information. The survey is deployed over multiple waves to the same respondents to monitor how behaviors and attitudes evolve over time. Version 1.0 of the survey contains 8,723 Wave 1 responses that are publicly available. This article details the methodology adopted for the collection, cleaning, and processing of the data. In addition, the data are weighted to be representative of national and regional demographics. This survey dataset can aid researchers, policymakers, businesses, and government agencies in understanding both the extent of behavioral shifts and the likelihood that changes in behaviors will persist after COVID-19.


title: Training Sparse Neural Network by Constraining Synaptic Weight on Unit Lp Sphere

abstract: Sparse deep neural networks have shown their advantages over dense models with fewer parameters and higher computational efficiency. Here we demonstrate constraining the synaptic weights on unit Lp-sphere enables the flexibly control of the sparsity with p and improves the generalization ability of neural networks. Firstly, to optimize the synaptic weights constrained on unit Lp-sphere, the parameter optimization algorithm, Lp-spherical gradient descent (LpSGD) is derived from the augmented Empirical Risk Minimization condition, which is theoretically proved to be convergent. To understand the mechanism of how p affects Hoyer's sparsity, the expectation of Hoyer's sparsity under the hypothesis of gamma distribution is given and the predictions are verified at various p under different conditions. In addition, the "semi-pruning" and threshold adaptation are designed for topology evolution to effectively screen out important connections and lead the neural networks converge from the initial sparsity to the expected sparsity. Our approach is validated by experiments on benchmark datasets covering a wide range of domains. And the theoretical analysis pave the way to future works on training sparse neural networks with constrained optimization.


title: BO 2.0: Plasma Wave and Instability Analysis with Enhanced Polarization Calculations

abstract: Besides the relation between the wave vector $\bm k$ and the complex frequency $\omega$, wave polarization is useful for characterizing the properties of a plasma wave. The polarization of the electromagnetic fields, $\delta \bm E$ and $\delta \bm B$, have been widely used in plasma physics research. Here, we derive equations for the density and velocity perturbations, $\delta n_s$ and $\delta{\bm v}_s$, respectively, of each species in the electromagnetic kinetic plasma dispersion relation by using their relation to the species current density perturbation $\delta {\bm J}_s$. Then we compare results with those of another commonly used plasma dispersion code (WHAMP) and with those of a multi-fluid plasma dispersion relation. We also summarize a number of useful polarization quantities, such as magnetic ellipticity, orientation of the major axis of the magnetic ellipse, various ratios of field energies and kinetic energies, species compressibility, parallel phase ratio, Alfv\'en-ratio, etc., which are useful for plasma physics research, especially for space plasma studies. This work represents an extension of the BO electromagnetic dispersion code [H.S. Xie, Comput. Phys. Comm. 244 (2019) 343-371] to enhance its calculation of polarization and to include the capability of solving the electromagnetic magnetized multi-fluid plasma dispersion relation.


title: Dynamically corrected gates from geometric space curves

abstract: Quantum information technologies demand highly accurate control over quantum systems. Achieving this requires control techniques that perform well despite the presence of decohering noise and other adverse effects. Here, we review a general technique for designing control fields that dynamically correct errors while performing operations using a close relationship between quantum evolution and geometric space curves. This approach provides access to the global solution space of control fields that accomplish a given task, facilitating the design of experimentally feasible gate operations for a wide variety of applications.


title: Ultrahigh Q SOI Ring Resonator With Strip Waveguide

abstract: The design and experimental demonstration of a large-area, ultra-high-Q-factor and single-mode operation silicon ring resonator based on a strip silicon photonic waveguide are presented, which is suitable for photon gyroscopic application. Based on these designs, simulation results show that the resonance depth is 0.9979 while the resonator is in an undercoupled state with the coupling length L=2um and coupling gap d=0.2um. For the fabricated resonator, the ultrahigh Q factor of 1.54*106 is experimentally demonstrated, with the free spectrum range (FSR) of 0.036nm and the resonance depth is 0.9810.


title: Performance and characterization of the SPT-3G digital frequency-domain multiplexed readout system using an improved noise and crosstalk model

abstract: The third generation South Pole Telescope camera (SPT-3G) improves upon its predecessor (SPTpol) by an order of magnitude increase in detectors on the focal plane. The technology used to read out and control these detectors, digital frequency-domain multiplexing (DfMUX), is conceptually the same as used for SPTpol, but extended to accommodate more detectors. A nearly 5x expansion in the readout operating bandwidth has enabled the use of this large focal plane, and SPT-3G performance meets the forecasting targets relevant to its science objectives. However, the electrical dynamics of the higher-bandwidth readout differ from predictions based on models of the SPTpol system due to the higher frequencies used, and parasitic impedances associated with new cryogenic electronic architecture. To address this, we present an updated derivation for electrical crosstalk in higher-bandwidth DfMUX systems, and identify two previously uncharacterized contributions to readout noise, which become dominant at high bias frequency. The updated crosstalk and noise models successfully describe the measured crosstalk and readout noise performance of SPT-3G. These results also suggest specific changes to warm electronics component values, wire-harness properties, and SQUID parameters, to improve the readout system for future experiments using DfMUX, such as the LiteBIRD space telescope.


title: Contribution of heavy neutrinos to decay of standard-model-like Higgs boson $h\rightarrow \mu\tau$ in a 3-3-1 model with additional gauge singlets

abstract: In the framework of the improved version of the 3-3-1 models with right-handed neutrinos, which is added to the Majorana neutrinos as new gauge singlets, the recent experimental neutrino oscillation data is completely explained through the inverse seesaw mechanism. We show that the major contributions to $Br(\mu\rightarrow e\gamma)$ are derived from corrections at 1-loop order of heavy neutrinos and bosons. But, these contributions are sometimes mutually destructive, creating regions of parametric spaces where the experimental limits of $Br(\mu\rightarrow e\gamma)$ are satisfied. In these regions, we find that $Br(\tau\rightarrow \mu\gamma)$ can achieve values of $10 ^{- 10}$ and $Br(\tau\rightarrow e\gamma)$ may even reach values of $10 ^{- 9}$ very close to the upper bound of the current experimental limits. Those are ideal areas to study lepton-flavor-violating decays of the standard- model- like Higgs boson ($h_1^0$). We also pointed out that the contributions of heavy neutrinos play an important role to change $Br(h_1^0\rightarrow \mu\tau)$, this is presented through different forms of mass mixing matrices ($M_R$) of heavy neutrinos. When $M_R \sim diag(1,1,1)$, $Br(h_1^0\rightarrow \mu\tau)$ can get a greater value than the cases $M_R \sim diag(1,2,3)$ and $M_R \sim diag(3,2,1)$ and the largest that $Br(h_1^0\rightarrow \mu\tau)$ can reach is very close $10 ^{-3}$.


title: Identity-Aware CycleGAN for Face Photo-Sketch Synthesis and Recognition

abstract: Face photo-sketch synthesis and recognition has many applications in digital entertainment and law enforcement. Recently, generative adversarial networks (GANs) based methods have significantly improved the quality of image synthesis, but they have not explicitly considered the purpose of recognition. In this paper, we first propose an Identity-Aware CycleGAN (IACycleGAN) model that applies a new perceptual loss to supervise the image generation network. It improves CycleGAN on photo-sketch synthesis by paying more attention to the synthesis of key facial regions, such as eyes and nose, which are important for identity recognition. Furthermore, we develop a mutual optimization procedure between the synthesis model and the recognition model, which iteratively synthesizes better images by IACycleGAN and enhances the recognition model by the triplet loss of the generated and real samples. Extensive experiments are performed on both photo-tosketch and sketch-to-photo tasks using the widely used CUFS and CUFSF databases. The results show that the proposed method performs better than several state-of-the-art methods in terms of both synthetic image quality and photo-sketch recognition accuracy.


title: Machine learning method for light field refocusing

abstract: Light field imaging introduced the capability to refocus an image after capturing. Currently there are two popular methods for refocusing, shift-and-sum and Fourier slice methods. Neither of these two methods can refocus the light field in real-time without any pre-processing. In this paper we introduce a machine learning based refocusing technique that is capable of extracting 16 refocused images with refocusing parameters of \alpha=0.125,0.250,0.375,...,2.0 in real-time. We have trained our network, which is called RefNet, in two experiments. Once using the Fourier slice method as the training -- i.e., "ground truth" -- data and another using the shift-and-sum method as the training data. We showed that in both cases, not only is the RefNet method at least 134x faster than previous approaches, but also the color prediction of RefNet is superior to both Fourier slice and shift-and-sum methods while having similar depth of field and focus distance performance.


title: Fast and Feature-Complete Differentiable Physics for Articulated Rigid Bodies with Contact

abstract: We present a fast and feature-complete differentiable physics engine, Nimble (nimblephysics.org), that supports Lagrangian dynamics and hard contact constraints for articulated rigid body simulation. Our differentiable physics engine offers a complete set of features that are typically only available in non-differentiable physics simulators commonly used by robotics applications. We solve contact constraints precisely using linear complementarity problems (LCPs). We present efficient and novel analytical gradients through the LCP formulation of inelastic contact that exploit the sparsity of the LCP solution. We support complex contact geometry, and gradients approximating continuous-time elastic collision. We also introduce a novel method to compute complementarity-aware gradients that help downstream optimization tasks avoid stalling in saddle points. We show that an implementation of this combination in an existing physics engine (DART) is capable of a 87x single-core speedup over finite-differencing in computing analytical Jacobians for a single timestep, while preserving all the expressiveness of original DART.


title: Self-supervised Image-text Pre-training With Mixed Data In Chest X-rays

abstract: Pre-trained models, e.g., from ImageNet, have proven to be effective in boosting the performance of many downstream applications. It is too demanding to acquire large-scale annotations to build such models for medical imaging. Meanwhile, there are numerous clinical data (in the form of images and text reports) stored in the hospital information systems. The paired image-text data from the same patient study could be utilized for the pre-training task in a weakly supervised manner. However, the integrity, accessibility, and amount of such raw data vary across different institutes, e.g., paired vs. unpaired (image-only or text-only). In this work, we introduce an image-text pre-training framework that can learn from these raw data with mixed data inputs, i.e., paired image-text data, a mixture of paired and unpaired data. The unpaired data can be sourced from one or multiple institutes (e.g., images from one institute coupled with texts from another). Specifically, we propose a transformer-based training framework for jointly learning the representation of both the image and text data. In addition to the existing masked language modeling, multi-scale masked vision modeling is introduced as a self-supervised training task for image patch regeneration. We not only demonstrate the feasibility of pre-training across mixed data inputs but also illustrate the benefits of adopting such pre-trained models in 3 chest X-ray applications, i.e., classification, retrieval, and image regeneration. Superior results are reported in comparison to prior art using MIMIC-CXR, NIH14-CXR, and OpenI-CXR datasets.


title: Unveiling short period binaries in the inner VVV bulge

abstract: Most of our knowledge about the structure of the Milky Way has come from the study of variable stars. Among the variables, mimicking the periodic variation of pulsating stars, are the eclipsing binaries. These stars are important in astrophysics because they allow us to directly measure radii and masses of the components, as well as the distance to the system, thus being useful in studies of Galactic structure alongside pulsating RR Lyrae and Cepheids. Using the distinguishing features of their light curves, one can identify them using a semi-automated process. In this work, we present a strategy to search for eclipsing variables in the inner VVV bulge across an area of 13.4 sq. deg. within $1.68^{\rm o}<l<7.53^{\rm o}$ and $-3.73^{\rm o}<b<-1.44^{\rm o}$, corresponding to the VVV tiles b293 to b296 and b307 to b310. We accurately classify 212 previously unknown eclipsing binaries, including six very reddened sources. The preliminary analysis suggests these eclipsing binaries are located in the most obscured regions of the foreground disk and bulge of the Galaxy. This search is therefore complementary to other variable stars searches carried out at optical wavelengths.


title: Augmented Transformer with Adaptive Graph for Temporal Action Proposal Generation

abstract: Temporal action proposal generation (TAPG) is a fundamental and challenging task in video understanding, especially in temporal action detection. Most previous works focus on capturing the local temporal context and can well locate simple action instances with clean frames and clear boundaries. However, they generally fail in complicated scenarios where interested actions involve irrelevant frames and background clutters, and the local temporal context becomes less effective. To deal with these problems, we present an augmented transformer with adaptive graph network (ATAG) to exploit both long-range and local temporal contexts for TAPG. Specifically, we enhance the vanilla transformer by equipping a snippet actionness loss and a front block, dubbed augmented transformer, and it improves the abilities of capturing long-range dependencies and learning robust feature for noisy action instances.Moreover, an adaptive graph convolutional network (GCN) is proposed to build local temporal context by mining the position information and difference between adjacent features. The features from the two modules carry rich semantic information of the video, and are fused for effective sequential proposal generation. Extensive experiments are conducted on two challenging datasets, THUMOS14 and ActivityNet1.3, and the results demonstrate that our method outperforms state-of-the-art TAPG methods. Our code will be released soon.


title: On the Predictability of Utilizing Rank Percentile to Evaluate Scientific Impact

abstract: Bibliographic metrics are commonly utilized for evaluation purposes within academia, often in conjunction with other metrics. These metrics vary widely across fields and change with the seniority of the scholar; consequently, the only way to interpret these values is by comparison with other academics within the same field who are of similar seniority. Among the field- and time- normalized indicators, rank percentile has grown in popularity, and it is preferred over other types of indicators. In this paper, we propose and justify a novel rank percentile indicator for scholars. Furthermore, we emphasize on the time factor that is built into the rank percentile, and we demonstrate that the rank percentile is highly predictable. The publication percentile is highly stable over time, while the scholar percentile exhibits short-term stability and can be predicted via a simple linear regression model. More advanced models that utilize extensive lists of features offer slightly superior performance; however, the simplicity and interpretability of the simple model impose significant advantages over the additional complexity of other models.


title: Progressively Complementary Network for Fisheye Image Rectification Using Appearance Flow

abstract: Distortion rectification is often required for fisheye images. The generation-based method is one mainstream solution due to its label-free property, but its naive skip-connection and overburdened decoder will cause blur and incomplete correction. First, the skip-connection directly transfers the image features, which may introduce distortion and cause incomplete correction. Second, the decoder is overburdened during simultaneously reconstructing the content and structure of the image, resulting in vague performance. To solve these two problems, in this paper, we focus on the interpretable correction mechanism of the distortion rectification network and propose a feature-level correction scheme. We embed a correction layer in skip-connection and leverage the appearance flows in different layers to pre-correct the image features. Consequently, the decoder can easily reconstruct a plausible result with the remaining distortion-less information. In addition, we propose a parallel complementary structure. It effectively reduces the burden of the decoder by separating content reconstruction and structure correction. Subjective and objective experiment results on different datasets demonstrate the superiority of our method.


title: A comprehensive study of the physical properties of Nb2P5 via ab-initio technique

abstract: Binary metallic phosphide, Nb2P5, belongs to technologically important class of materials. Quite surprisingly, a large number of physical properties of Nb2P5, including elastic properties and their anisotropy, acoustic, electronic (DOS, charge density distribution, electron density difference), thermo-physical, bonding characteristics, and optical properties have not been investigated at all. In the present work we have explored all these properties in details for the first time employing density functional theory based first-principles method. Nb2P5 is found to be a mechanically stable, elastically anisotropic compound with weak brittle character. The bondings among the atoms are dominated by covalent and ionic contributions with small signature of metallic feature. The compound possesses high level of machinability. Nb2P5 is a moderately hard compound. The band structure calculations reveal metallic conduction with a large electronic density of states at the Fermi level. Calculated values of different thermal properties indicate that Nb2P5 has the potential to be used as a thermal barrier coating material. The energy dependent optical parameters show close agreement with the underlying electronic band structure. The optical absorption and reflectivity spectra and the static index of refraction of Nb2P5 show that the compound holds promise to be used in optoelectronic device sector. Unlike notable anisotropy in elastic and mechanical properties, the optical parameters are found to be almost isotropic.


title: Spatial and temporal scaled physical modeling of fluid convection using hypergravity

abstract: Scaled physical modeling is an important means to understand the behavior of fluids in nature. However, a common source of errors is conflicting similarity criteria. Here, we present using hypergravity to improve the scaling similarity of gravity-dominated fluid convection, e.g. natural convection and multi-phase flow. We demonstrate the validity of the approach by investigating water-brine buoyant jet experiments conducted under hypergravity created by a centrifuge. Results show that the scaling similarity increases with the gravitational acceleration. In particular, the model best represents the prototype under N3g with a spatial scale of 1/N and a time scale of 1/N2 by simultaneously satisfying the Froude and Reynolds criteria. The significance of centrifuge radius and fluid velocity in determining the accuracy of the scaled model is discussed in the light of Coriolis force and turbulence. This study demonstrates a new direction for the physical modeling of fluids subject to gravity with broad application prospects.


title: Early Detection of In-Memory Malicious Activity based on Run-time Environmental Features

abstract: In recent years malware has become increasingly sophisticated and difficult to detect prior to exploitation. While there are plenty of approaches to malware detection, they all have shortcomings when it comes to identifying malware correctly prior to exploitation. The trade-off is usually between false positives, causing overhead, preventing normal usage and the risk of letting the malware execute and cause damage to the target. We present a novel end-to-end solution for in-memory malicious activity detection done prior to exploitation by leveraging machine learning capabilities based on data from unique run-time logs, which are carefully curated in order to detect malicious activity in the memory of protected processes. This solution achieves reduced overhead and false positives as well as deployment simplicity. We implemented our solution for Windows-based systems, employing multi disciplinary knowledge from malware research, machine learning, and operating system internals. Our experimental evaluation yielded promising results. As we expect future sophisticated malware may try to bypass it, we also discuss how our solution can be extended to thwart such bypassing attempts.


title: An Efficient Signal to Noise Approximation for Eccentric Inspiraling Binaries

abstract: Eccentricity has emerged as a potentially useful tool for helping to identify the origin of black hole mergers. However, owing to the large number of harmonics required to compute the amplitude of an eccentric signal, eccentric templates can be computationally very expensive, making statistical analyses to distinguish distributions from different formation channels very challenging. In this paper, we outline a method for estimating the signal-to-noise ratio for inspiraling binaries at lower frequencies such as those proposed for LISA and DECIGO. Our approximation can be useful more generally for any quasi-periodic sources. We argue that surprisingly, the signal-to-noise ratio evaluated at or near the peak frequency (of the power) is well approximated by using a constant noise curve, even if in reality the noise strain has power law dependence. We furthermore improve this initial estimate over our previous calculation to allow for frequency-dependence in the noise to expand the range of eccentricity and frequency over which our approximation applies. We show how to apply this method to get an answer accurate to within a factor of two over almost the entire projected observable frequency range. We emphasize this method is not a replacement for detailed signal processing. The utility lies chiefly in identifying theoretically useful discriminators among different populations and providing fairly accurate estimates for how well they should work. This approximation can furthermore be useful for narrowing down parameter ranges in a computationally economical way when events are observed. We furthermore show a distinctive way to identify events with extremely high eccentricity where the signal is enhanced relative to na\"ive expectations on the high frequency end.


title: Certifiably-Robust Federated Adversarial Learning via Randomized Smoothing

abstract: Federated learning is an emerging data-private distributed learning framework, which, however, is vulnerable to adversarial attacks. Although several heuristic defenses are proposed to enhance the robustness of federated learning, they do not provide certifiable robustness guarantees. In this paper, we incorporate randomized smoothing techniques into federated adversarial training to enable data-private distributed learning with certifiable robustness to test-time adversarial perturbations. Our experiments show that such an advanced federated adversarial learning framework can deliver models as robust as those trained by the centralized training. Further, this enables provably-robust classifiers to $\ell_2$-bounded adversarial perturbations in a distributed setup. We also show that one-point gradient estimation based training approach is $2-3\times$ faster than popular stochastic estimator based approach without any noticeable certified robustness differences.


title: Hubble diagram at higher redshifts: Model independent calibration of quasars

abstract: In this paper, we present a model-independent approach to calibrate the largest quasar sample. Calibrating quasar samples is essentially constraining the parameters of the linear relation between the $\log$ of the ultraviolet (UV) and X-ray luminosities. This calibration allows quasars to be used as standardized candles. There is a strong correlation between the parameters characterizing the quasar luminosity relation and the cosmological distances inferred from using quasars as standardized candles. We break this degeneracy by using Gaussian process regression to model-independently reconstruct the expansion history of the Universe from the latest type Ia supernova observations. Using the calibrated quasar dataset, we further reconstruct the expansion history up to redshift of $z\sim 7.5$. Finally, we test the consistency between the calibrated quasar sample and the standard $\rm{\Lambda}CDM$ model based on the posterior probability distribution of the GP hyperparameters. Our results show that the quasar sample is in good agreement with the standard $\rm{\Lambda}CDM$ model in the redshift range of the supernova, despite of mildly significant deviations taking place at higher redshifts. Fitting the standard $\rm{\Lambda}CDM$ model to the calibrated quasar sample, we obtain a high value of the matter density parameter $\Omega_m = 0.382^{+0.045}_{-0.042}$, which is marginally consistent with the constraints from other cosmological observations.


title: FaiR-IoT: Fairness-aware Human-in-the-Loop Reinforcement Learning for Harnessing Human Variability in Personalized IoT

abstract: Thanks to the rapid growth in wearable technologies, monitoring complex human context becomes feasible, paving the way to develop human-in-the-loop IoT systems that naturally evolve to adapt to the human and environment state autonomously. Nevertheless, a central challenge in designing such personalized IoT applications arises from human variability. Such variability stems from the fact that different humans exhibit different behaviors when interacting with IoT applications (intra-human variability), the same human may change the behavior over time when interacting with the same IoT application (inter-human variability), and human behavior may be affected by the behaviors of other people in the same environment (multi-human variability). To that end, we propose FaiR-IoT, a general reinforcement learning-based framework for adaptive and fairness-aware human-in-the-loop IoT applications. In FaiR-IoT, three levels of reinforcement learning agents interact to continuously learn human preferences and maximize the system's performance and fairness while taking into account the intra-, inter-, and multi-human variability. We validate the proposed framework on two applications, namely (i) Human-in-the-Loop Automotive Advanced Driver Assistance Systems and (ii) Human-in-the-Loop Smart House. Results obtained on these two applications validate the generality of FaiR-IoT and its ability to provide a personalized experience while enhancing the system's performance by 40%-60% compared to non-personalized systems and enhancing the fairness of the multi-human systems by 1.5 orders of magnitude.


title: TensorDiffEq: Scalable Multi-GPU Forward and Inverse Solvers for Physics Informed Neural Networks

abstract: Physics-Informed Neural Networks promise to revolutionize science and engineering practice, by introducing domain-aware deep machine learning models into scientific computation. Several software suites have emerged to make the implementation and usage of these architectures available to the research and industry communities. Here we introduce\linebreak TensorDiffEq, built on Tensorflow 2.x, which presents an intuitive Keras-like interface for problem domain definition, model definition, and solution of forward and inverse problems using physics-aware deep learning methods. TensorDiffEq takes full advantage of Tensorflow 2.x infrastructure for deployment on multiple GPUs, allowing the implementation of large high-dimensional and complex models. Simultaneously, TensorDiffEq supports the Keras API for custom neural network architecture definitions. In the case of smaller or simpler models, the package allows for rapid deployment on smaller-scale CPU platforms with negligible changes to the implementation scripts. We demonstrate the basic usage and capabilities of TensorDiffEq in solving forward, inverse, and data assimilation problems of varying sizes and levels of complexity. The source code is available at https://github.com/tensordiffeq.


title: LASSO risk and phase transition under dependence

abstract: We consider the problem of recovering a $k$-sparse signal ${\mbox{$\beta$}}_0\in\mathbb{R}^p$ from noisy observations $\bf y={\bf X}\mbox{$\beta$}_0+{\bf w}\in\mathbb{R}^n$. One of the most popular approaches is the $l_1$-regularized least squares, also known as LASSO. We analyze the mean square error of LASSO in the case of random designs in which each row of ${\bf X}$ is drawn from distribution $N(0,{\mbox{$\Sigma$}})$ with general ${\mbox{$\Sigma$}}$. We first derive the asymptotic risk of LASSO in the limit of $n,p\rightarrow\infty$ with $n/p\rightarrow\delta$. We then examine conditions on $n$, $p$, and $k$ for LASSO to exactly reconstruct ${\mbox{$\beta$}}_0$ in the noiseless case ${\bf w}=0$. A phase boundary $\delta_c=\delta(\epsilon)$ is precisely established in the phase space defined by $0\le\delta,\epsilon\le 1$, where $\epsilon=k/p$. Above this boundary, LASSO perfectly recovers ${\mbox{$\beta$}}_0$ with high probability. Below this boundary, LASSO fails to recover $\mbox{$\beta$}_0$ with high probability. While the values of the non-zero elements of ${\mbox{$\beta$}}_0$ do not have any effect on the phase transition curve, our analysis shows that $\delta_c$ does depend on the signed pattern of the nonzero values of $\mbox{$\beta$}_0$ for general ${\mbox{$\Sigma$}}\ne{\bf I}_p$. This is in sharp contrast to the previous phase transition results derived in i.i.d. case with $\mbox{$\Sigma$}={\bf I}_p$ where $\delta_c$ is completely determined by $\epsilon$ regardless of the distribution of $\mbox{$\beta$}_0$. Underlying our formalism is a recently developed efficient algorithm called approximate message passing (AMP) algorithm. We generalize the state evolution of AMP from i.i.d. case to general case with ${\mbox{$\Sigma$}}\ne{\bf I}_p$. Extensive computational experiments confirm that our theoretical predictions are consistent with simulation results on moderate size system.


title: A Tensor-EM Method for Large-Scale Latent Class Analysis with Binary Responses

abstract: Latent class models are powerful statistical modeling tools widely used in psychological, behavioral, and social sciences. In the modern era of data science, researchers often have access to response data collected from large-scale surveys or assessments, featuring many items (large J) and many subjects (large N). This is in contrary to the traditional regime with fixed J and large N. To analyze such large-scale data, it is important to develop methods that are both computationally efficient and theoretically valid. In terms of computation, the conventional EM algorithm for latent class models tends to have a slow algorithmic convergence rate for large-scale data and may converge to some local optima instead of the maximum likelihood estimator(MLE). Motivated by this, we introduce the tensor decomposition perspective into latent class analysis with binary responses. Methodologically, we propose to use a moment-based tensor power method in the first step, and then use the obtained estimates as initialization for the EM algorithm in the second step. Theoretically, we establish the clustering consistency of the MLE in assigning subjects into latent classes when N and J both go to infinity. Simulation studies suggest that the proposed tensor-EM pipeline enjoys both good accuracy and computational efficiency for large-scale data with binary responses. We also apply the proposed method to an educational assessment dataset as an illustration.


title: Higher-Order Neighborhood Truss Decomposition

abstract: $k$-truss model is a typical cohesive subgraph model and has been received considerable attention recently. However, the $k$-truss model only considers the direct common neighbors of an edge, which restricts its ability to reveal fine-grained structure information of the graph. Motivated by this, in this paper, we propose a new model named $(k, \tau)$-truss that considers the higher-order neighborhood ($\tau$ hop) information of an edge. Based on the $(k, \tau)$-truss model, we study the higher-order truss decomposition problem which computes the $(k, \tau)$-trusses for all possible $k$ values regarding a given $\tau$. Higher-order truss decomposition can be used in the applications such as community detection and search, hierarchical structure analysis, and graph visualization. To address this problem, we first propose a bottom-up decomposition paradigm in the increasing order of $k$ values to compute the corresponding $(k, \tau)$-truss. Based on the bottom-up decomposition paradigm, we further devise three optimization strategies to reduce the unnecessary computation. We evaluate our proposed algorithms on real datasets and synthetic datasets, the experimental results demonstrate the efficiency, effectiveness and scalability of our proposed algorithms.


title: Photoinduced Transient States of Antiferromagnetic Orderings in La${}_{1/3}$Sr${}_{2/3}$FeO${}_{3}$ and SrFeO${}_{3}$ Thin Films Observed through Time-resolved Resonant Soft X-ray Scattering

abstract: The relationship between the magnetic interaction and photoinduced dynamics in antiferromagnetic perovskites is investigated in this study. In La${}_{1/3}$Sr${}_{2/3}$FeO${}_{3}$ thin films, commensurate spin ordering is accompanied by charge disproportionation, whereas SrFeO${}_{3}$ thin films show incommensurate helical antiferromagnetic spin ordering due to increased ferromagnetic coupling compared to La${}_{1/3}$Sr${}_{2/3}$FeO${}_{3}$. To understand the photoinduced spin dynamics in these materials, we investigate the spin ordering through time-resolved resonant soft X-ray scattering. In La${}_{1/3}$Sr${}_{2/3}$FeO${}_{3}$, ultrafast quenching of the magnetic ordering within 130 fs through a nonthermal process is observed, triggered by charge transfer between the Fe atoms. We compare this to the photoinduced dynamics of the helical magnetic ordering of SrFeO${}_{3}$. We find that the change in the magnetic coupling through optically induced charge transfer can offer an even more efficient channel for spin-order manipulation.


title: V-static spaces with positive isotropic curvature

abstract: In this paper, we give a complete classification of critical metrics of the volume functional on a compact manifold $M$ with boundary $\partial M$ having positive isotropic curvature. We prove that for a pair $(f, \kappa)$ of a nontrivial smooth function $f: M \to {\Bbb R}$ and a nonnegative real number $\kappa$, if $(M, g)$ having positive isotropic curvature satisfies $$ Ddf - (\Delta f)g - f{\rm Ric} = \kappa g, $$ then $(M, g)$ is isometric to a geodesic ball in ${\Bbb S}^n$ when $\kappa >0$, and either $M$ isometric to ${\Bbb S}^n_+$, or the product $I \times {\Bbb S}^{n-1}$, up to finite cover when $\kappa =0$.


title: Defects-Assisted Piezoelectric Response in Liquid Exfoliated MoS2 Nanosheets

abstract: We report piezoelectric response in liquid phase exfoliated MoS2 nanosheets with desired structure and morphology. The piezoelectric effect in liquid phase exfoliated few layers of MoS2 flakes is interesting as it may allow the scalable fabrication of electronic devices such as self-powered electronics, piezoelectric transformers, antennas and more. The piezo force microscopy (PFM) measurements were used to quantify the amplitude and phase loop, which shows strong piezoelectric coefficient. Herein, the piezoelectric response in few layers of MoS2 is attributed to the defects formed in it during the synthesis procedure. The presence of defects is confirmed by XPS analysis


title: Scalable Statistical Inference of Photometric Redshift via Data Subsampling

abstract: Handling big data has largely been a major bottleneck in traditional statistical models. Consequently, when accurate point prediction is the primary target, machine learning models are often preferred over their statistical counterparts for bigger problems. But full probabilistic statistical models often outperform other models in quantifying uncertainties associated with model predictions. We develop a data-driven statistical modeling framework that combines the uncertainties from an ensemble of statistical models learned on smaller subsets of data carefully chosen to account for imbalances in the input space. We demonstrate this method on a photometric redshift estimation problem in cosmology, which seeks to infer a distribution of the redshift -- the stretching effect in observing the light of far-away galaxies -- given multivariate color information observed for an object in the sky. Our proposed method performs balanced partitioning, graph-based data subsampling across the partitions, and training of an ensemble of Gaussian process models.


title: Generalizable Physics-constrained Modeling using Learning and Inference assisted by Feature Space Engineering

abstract: This work presents a formalism to improve the predictive accuracy of physical models by learning generalizable augmentations from sparse data. Building on recent advances in data-driven turbulence modeling, the present approach, referred to as Learning and Inference assisted by Feature-space Engineering (LIFE), is based on the hypothesis that robustness and generalizability demand a meticulously-designed feature space that is informed by the underlying physics, and a carefully constructed features-to-augmentation map. The critical components of this approach are: (1) Maintaining consistency across the learning and prediction environments; (2) Tightly-coupled inference and learning by constraining the augmentation to be learnable throughout the inference process; (3) Identification of relevant physics-informed features in appropriate functional forms to enable significant overlap in feature space for a wide variety of cases to promote generalizability; (4) Maintaining explicit control over feature space to change the augmentation function behavior only in the vicinity of available datapoints. To demonstrate the viability of this approach, it is used in the modeling of bypass transition. The augmentation is developed on skin friction data from two flat plate cases from the ERCOFTAC dataset. Piecewise linear interpolation on a structured grid in feature-space is used as a sample functional form for the augmentation to demonstrate the capability of localized learning. The augmented model is then applied to a variety of flat plate cases which are characterized by different freestream turbulence intensities, pressure gradients, and Reynolds numbers. The predictive capability of the augmented model is also tested on single-stage high-pressure-turbine cascade cases, and the model performance is analyzed from the perspective of information contained in the feature space.


title: Empirical Analysis of Capacity Investment Solution in Distribution Grids

abstract: This paper presents an analysis of the stability and quality of the distributed generation planning problem's investment solution. The entry of distributed generators power based on non-conventional energy sources has been extensively promoted in distribution grids. In this paper, a two-stage stochastic programming model is used to find the optimal distributed generators' installed capacities. We emphasize the design of scenarios to represent the stochasticity of power production on renewable sources. In the scenario generation, a method is proposed based on the clustering of real measurements of meteorological variables. We measure the quality and stability of the investment solution as a function of the number of scenarios. The results show that a reduced selection of scenarios can give an inadequate solution to distributed generators' investment strategy.


title: First-order Bose-Einstein condensation with three-body interacting bosons

abstract: Bose-Einstein condensation, observed in either strongly interacting liquid helium or weakly interacting atomic Bose gases, is widely known to be a second-order phase transition. Here, we predict a first-order Bose-Einstein condensation in a cloud of harmonically trapped bosons interacting with both attractive two-body interaction and repulsive three-body interaction, characterized respectively by an $s$-wave scattering length $a<0$ and a three-body scattering hypervolume $D>0$. It happens when the harmonic trapping potential is weak, so with increasing temperature the system changes from a low-temperature liquid-like quantum droplet to a normal gas, and therefore experiences a first-order liquid-to-gas transition. At large trapping potential, however, the quantum droplet can first turn into a superfluid gas, rendering the condensation transition occurred later from a superfluid gas to a normal gas smooth. We determine a rich phase diagram and show the existence of a tri-critical point, where the three phases - quantum droplet, superfluid gas and normal gas - meet together. We argue that an ensemble of spin-polarized tritium atoms could be a promising candidate to observe the predicted first-order Bose-Einstein condensation, across which the condensate fraction or central condensate density jumps to zero and the surface-mode frequencies diverge.


title: The Matter of Time -- A General and Efficient System for Precise Sensor Synchronization in Robotic Computing

abstract: Time synchronization is a critical task in robotic computing such as autonomous driving. In the past few years, as we developed advanced robotic applications, our synchronization system has evolved as well. In this paper, we first introduce the time synchronization problem and explain the challenges of time synchronization, especially in robotic workloads. Summarizing these challenges, we then present a general hardware synchronization system for robotic computing, which delivers high synchronization accuracy while maintaining low energy and resource consumption. The proposed hardware synchronization system is a key building block in our future robotic products.


title: Unsupervised Hyperbolic Representation Learning via Message Passing Auto-Encoders

abstract: Most of the existing literature regarding hyperbolic embedding concentrate upon supervised learning, whereas the use of unsupervised hyperbolic embedding is less well explored. In this paper, we analyze how unsupervised tasks can benefit from learned representations in hyperbolic space. To explore how well the hierarchical structure of unlabeled data can be represented in hyperbolic spaces, we design a novel hyperbolic message passing auto-encoder whose overall auto-encoding is performed in hyperbolic space. The proposed model conducts auto-encoding the networks via fully utilizing hyperbolic geometry in message passing. Through extensive quantitative and qualitative analyses, we validate the properties and benefits of the unsupervised hyperbolic representations. Codes are available at https://github.com/junhocho/HGCAE.


title: Noise-resistant Deep Metric Learning with Ranking-based Instance Selection

abstract: The existence of noisy labels in real-world data negatively impacts the performance of deep learning models. Although much research effort has been devoted to improving robustness to noisy labels in classification tasks, the problem of noisy labels in deep metric learning (DML) remains open. In this paper, we propose a noise-resistant training technique for DML, which we name Probabilistic Ranking-based Instance Selection with Memory (PRISM). PRISM identifies noisy data in a minibatch using average similarity against image features extracted by several previous versions of the neural network. These features are stored in and retrieved from a memory bank. To alleviate the high computational cost brought by the memory bank, we introduce an acceleration method that replaces individual data points with the class centers. In extensive comparisons with 12 existing approaches under both synthetic and real-world label noise, PRISM demonstrates superior performance of up to 6.06% in Precision@1.


title: Post-Processing of MCMC

abstract: Markov chain Monte Carlo (MCMC) is the engine of modern Bayesian statistics, being used to approximate the posterior and derived quantities of interest. Despite this, the issue of how the output from a Markov chain is post-processed and reported is often overlooked. Convergence diagnostics can be used to control bias via burn-in removal, but these do not account for (common) situations where a limited computational budget engenders a bias-variance trade-off. The aim of this article is to review state-of-the-art techniques for post-processing Markov chain output. Our review covers methods based on discrepancy minimisation, which directly address the bias-variance trade-off, as well as general-purpose control variate methods for approximating expected quantities of interest.


title: Technological Leapfrogging and Manufacturing Value-added in sub-Saharan African (1990-2018)

abstract: This study examines the impact of technological leapfrogging on manufacturing value-added in SSA. The study utilizes secondary data spanning 1990 to 2018. The data is analyzed using cross-sectional autoregressive distributed lags (CS-ARDL) and cross-sectional distributed lags (CS-DL) techniques. The study found that technological leapfrogging is a positive driver of manufacturing value-added in SSA. This implies that SSA can copy the foreign technologies and adapt them for domestic uses, rather than going through the evolutionary process of the old technologies that are relatively less efficient. If the governments of SSA could reinforce their absorptive capacity and beef up productivity through proper utilization of the existing technology. The productive activities of the domestic firms will stir new innovations and discoveries that will eventually translate into indigenous technology


title: Progressive Domain Expansion Network for Single Domain Generalization

abstract: Single domain generalization is a challenging case of model generalization, where the models are trained on a single domain and tested on other unseen domains. A promising solution is to learn cross-domain invariant representations by expanding the coverage of the training domain. These methods have limited generalization performance gains in practical applications due to the lack of appropriate safety and effectiveness constraints. In this paper, we propose a novel learning framework called progressive domain expansion network (PDEN) for single domain generalization. The domain expansion subnetwork and representation learning subnetwork in PDEN mutually benefit from each other by joint learning. For the domain expansion subnetwork, multiple domains are progressively generated in order to simulate various photometric and geometric transforms in unseen domains. A series of strategies are introduced to guarantee the safety and effectiveness of the expanded domains. For the domain invariant representation learning subnetwork, contrastive learning is introduced to learn the domain invariant representation in which each class is well clustered so that a better decision boundary can be learned to improve it's generalization. Extensive experiments on classification and segmentation have shown that PDEN can achieve up to 15.28% improvement compared with the state-of-the-art single-domain generalization methods.


title: Reduced Dynamics and Control for an Autonomous Bicycle

abstract: In this paper, we propose the reduced model for the full dynamics of a bicycle and analyze its nonlinear behavior under a proportional control law for steering. Based on the Gibbs-Appell equations for the Whipple bicycle, we obtain a second-order nonlinear ordinary differential equation (ODE) that governs the bicycle's controlled motion. Two types of equilibrium points for the governing equation are found, which correspond to the bicycle's uniform straight forward and circular motions, respectively. By applying the Hurwitz criterion to the linearized equation, we find that the steer coefficient must be negative, consistent with the human's intuition of turning toward a fall. Under this condition, a critical angular velocity of the rear wheel exists, above which the uniform straight forward motion is stable, and slightly below which a pair of symmetrical stable uniform circular motions will occur. These theoretical findings are verified by both numerical simulations and experiments performed on a powered autonomous bicycle.


title: Nematic and smectic stripe phases and stripe-SkX transformations

abstract: Based on the findings of stripe skyrmions and the metastability of a state of an arbitrary number of skyrmions, precisely controlled manipulation of stripe skyrmions in pre-designed structures and mutual transformation between helical states and skyrmion crystals (SkXs) are demonstrated in chiral magnetic films. As a proof of the concept, we show how to use patterned magnetic fields and spin-transfer torques (STTs) to generate nematic and smectic stripe phases, as well as "UST" mosaic from three curved stripe skyrmions. Cutting one stripe into many pieces and coalescing several skyrmions into one by various external fields are good ways to transform helical states and SkXs from each other.


title: Infinitely Many Multipulse Solitons of Different Symmetry Types in the Nonlinear Schr\"{o}dinger Equation with Quartic Dispersion

abstract: We show that the generalised nonlinear Schr\"{o}dinger equation (GNLSE) with quartic dispersion supports infinitely many multipulse solitons for a wide parameter range of the dispersion terms. These solitons exist through the balance between the quartic and quadratic dispersions with the Kerr nonlinearity, and they come in infinite families with different signatures. A travelling wave ansatz, where the optical pulse does not undergo a change in shape while propagating, allows us to transform the GNLSE into a fourth-order nonlinear Hamiltonian ordinary differential equation with two reversibilities. Studying families of connecting orbits with different symmetry properties of this reduced system, connecting equilibria to themselves or to periodic solutions, provides the key to understanding the overall structure of solitons of the GNLSE. Integrating a perturbation of them as solutions of the GNLSE suggests that some of these solitons may be observable experimentally in photonic crystal wave-guides over several dispersion lengths.


title: 3D-MAN: 3D Multi-frame Attention Network for Object Detection

abstract: 3D object detection is an important module in autonomous driving and robotics. However, many existing methods focus on using single frames to perform 3D detection, and do not fully utilize information from multiple frames. In this paper, we present 3D-MAN: a 3D multi-frame attention network that effectively aggregates features from multiple perspectives and achieves state-of-the-art performance on Waymo Open Dataset. 3D-MAN first uses a novel fast single-frame detector to produce box proposals. The box proposals and their corresponding feature maps are then stored in a memory bank. We design a multi-view alignment and aggregation module, using attention networks, to extract and aggregate the temporal features stored in the memory bank. This effectively combines the features coming from different perspectives of the scene. We demonstrate the effectiveness of our approach on the large-scale complex Waymo Open Dataset, achieving state-of-the-art results compared to published single-frame and multi-frame methods.


title: 1-Bit Compressive Sensing for Efficient Federated Learning Over the Air

abstract: For distributed learning among collaborative users, this paper develops and analyzes a communication-efficient scheme for federated learning (FL) over the air, which incorporates 1-bit compressive sensing (CS) into analog aggregation transmissions. To facilitate design parameter optimization, we theoretically analyze the efficacy of the proposed scheme by deriving a closed-form expression for the expected convergence rate of the FL over the air. Our theoretical results reveal the tradeoff between convergence performance and communication efficiency as a result of the aggregation errors caused by sparsification, dimension reduction, quantization, signal reconstruction and noise. Then, we formulate 1-bit CS based FL over the air as a joint optimization problem to mitigate the impact of these aggregation errors through joint optimal design of worker scheduling and power scaling policy. An enumeration-based method is proposed to solve this non-convex problem, which is optimal but becomes computationally infeasible as the number of devices increases. For scalable computing, we resort to the alternating direction method of multipliers (ADMM) technique to develop an efficient implementation that is suitable for large-scale networks. Simulation results show that our proposed 1-bit CS based FL over the air achieves comparable performance to the ideal case where conventional FL without compression and quantification is applied over error-free aggregation, at much reduced communication overhead and transmission latency.


title: Analytical solution of the Euler-Poinsot problem

abstract: In the present paper, an analysis was performed on the torque-free motion of a rigid body, developing Euler's analytical solution and Poinsot's geometric solution. From mathematical formulations, the analytical solution for the time evolution of the angular velocity and Euler's angles was obtained and described given some initial conditions. Besides, an animation of Poinsot's geometric solution was elaborated and a study was carried out on the conditions in which the herpolhode forms a closed curve. Finally, an algorithm was developed in the software Scilab that displays the analytical and numerical solutions obtained, it also generates an animation of the geometric solution, moreover to having an algorithm that generates closed herpolhodes.


title: Grounding Open-Domain Instructions to Automate Web Support Tasks

abstract: Grounding natural language instructions on the web to perform previously unseen tasks enables accessibility and automation. We introduce a task and dataset to train AI agents from open-domain, step-by-step instructions originally written for people. We build RUSS (Rapid Universal Support Service) to tackle this problem. RUSS consists of two models: First, a BERT-LSTM with pointers parses instructions to ThingTalk, a domain-specific language we design for grounding natural language on the web. Then, a grounding model retrieves the unique IDs of any webpage elements requested in ThingTalk. RUSS may interact with the user through a dialogue (e.g. ask for an address) or execute a web operation (e.g. click a button) inside the web runtime. To augment training, we synthesize natural language instructions mapped to ThingTalk. Our dataset consists of 80 different customer service problems from help websites, with a total of 741 step-by-step instructions and their corresponding actions. RUSS achieves 76.7% end-to-end accuracy predicting agent actions from single instructions. It outperforms state-of-the-art models that directly map instructions to actions without ThingTalk. Our user study shows that RUSS is preferred by actual users over web navigation.


title: Likelihood-based estimation and prediction for a measles outbreak in Samoa

abstract: Prediction of the progression of an infectious disease outbreak is important for planning and coordinating a response. Differential equations are often used to model an epidemic outbreak's behaviour but are challenging to parameterise. Furthermore, these models can suffer from misspecification, which biases predictions and parameter estimates. Stochastic models can help with misspecification but are even more expensive to simulate and perform inference with. Here, we develop an explicitly likelihood-based variation of the generalised profiling method as a tool for prediction and inference under model misspecification. Our approach allows us to carry out identifiability analysis and uncertainty quantification using profile likelihood-based methods without the need for marginalisation. We provide justification for this approach by introducing a new interpretation of the model approximation component as a stochastic constraint. This preserves the rationale for using profiling rather than integration to remove nuisance parameters while also providing a link back to stochastic models. We applied an initial version of this method during an outbreak of measles in Samoa in 2019-2020 and found that it achieved relatively fast, accurate predictions. Here we present the most recent version of our method and its application to this measles outbreak, along with additional validation.


title: Large voltage-tunable spin valve based on a double quantum dot

abstract: We study the spin-dependent transport properties of a spin valve based on a double quantum dot. Each quantum dot is assumed to be strongly coupled to its own ferromagnetic lead, while the coupling between the dots is relatively weak. The current flowing through the system is determined within the perturbation theory in the hopping between the dots, whereas the spectrum of a quantum dot-ferromagnetic lead subsystem is determined by means of the numerical renormalization group method. The spin-dependent charge fluctuations between ferromagnets and quantum dots generate an effective exchange field, which splits the double dot levels. Such field can be controlled, separately for each quantum dot, by the gate voltages or by changing the magnetic configuration of external leads. We demonstrate that the considered double quantum dot spin valve setup exhibits enhanced magnetoresistive properties, including both normal and inverse tunnel magnetoresistance. We also show that this system allows for the generation of highly spin-polarized currents, which can be controlled by purely electrical means. The considered double quantum dot with ferromagnetic contacts can thus serve as an efficient voltage-tunable spin valve characterized by high output parameters.


title: PIXLISE-C: Exploring The Data Analysis Needs of NASA Scientists for Mineral Identification

abstract: NASA JPL scientists working on the micro x-ray fluorescence (microXRF) spectroscopy data collected from Mars surface perform data analysis to look for signs of past microbial life on Mars. Their data analysis workflow mainly involves identifying mineral compounds through the element abundance in spatially distributed data points. Working with the NASA JPL team, we identified pain points and needs to further develop their existing data visualization and analysis tool. Specifically, the team desired improvements for the process of creating and interpreting mineral composition groups. To address this problem, we developed an interactive tool that enables scientists to (1) cluster the data using either manual lasso-tool selection or through various machine learning clustering algorithms, and (2) compare the clusters and individual data points to make informed decisions about mineral compositions. Our preliminary tool supports a hybrid data analysis workflow where the user can manually refine the machine-generated clusters.

categories: cs.HC cs.GR physics.comp-ph physics.ins-det


title: A Multi-View Framework to Detect Redundant Activity Labels for More Representative Event Logs in Process Mining

abstract: Process mining aims to gain knowledge of business processes via the discovery of process models from event logs generated by information systems. The insights revealed from process mining heavily rely on the quality of the event logs. Activities extracted from different data sources or the free-text nature within the same system may lead to inconsistent labels. Such inconsistency would then lead to redundancy in activity labels, which refer to labels that have different syntax but share the same behaviours. Redundant activity labels could introduce unnecessary complexities to the event logs. The identifications of these labels from data-driven process discovery are difficult and rely heavily on human intervention. Neither existing process discovery algorithms nor event data preprocessing techniques can solve such redundancy efficiently. In this paper, we propose a multi-view approach to automatically detect redundant activity labels using not only context-aware features such as control--flow relations and attribute values but also semantic features from the event logs. Our evaluation of several publicly available datasets and a real-life case study demonstrate that our approach can efficiently detect redundant activity labels even with low-occurrence frequencies. The proposed approach can add value to the preprocessing step to generate more representative event logs.


title: Magnetic Fluctuations in Gyrokinetic Simulations of Tokamak Scrape-Off Layer Turbulence

abstract: Understanding turbulent transport physics in the tokamak edge and scrape-off layer (SOL) is critical to developing a successful fusion reactor. The dynamics in these regions plays a key role in achieving high fusion performance by determining the edge pedestal that suppresses turbulence in H-mode. Additionally, the survivability of a reactor is set by the heat load to the vessel walls, making it important to understand turbulent spreading of heat as it flows along open magnetic field lines in the SOL. Large-amplitude fluctuations, magnetic X-point geometry, and plasma interactions with material walls make simulating turbulence in the edge/SOL more challenging than in the core region, necessitating specialized gyrokinetic codes. Further, the inclusion of electromagnetic effects in gyrokinetic simulations that can handle the unique challenges of the boundary plasma is critical to the understanding of phenomena such as the pedestal and ELMs, for which electromagnetic dynamics are expected to be important. In this thesis, we develop the first capability to simulate electromagnetic gyrokinetic turbulence on open magnetic field lines. This is an important step towards comprehensive electromagnetic gyrokinetic simulations of the coupled edge/SOL system. By using a continuum full-f approach via an energy-conserving discontinuous Galerkin (DG) discretization scheme that avoids the Ampere cancellation problem, we show that electromagnetic fluctuations can be handled in a robust, stable, and efficient manner in the gyrokinetic module of the Gkeyll code. We then present results which roughly model the scrape-off layer of the National Spherical Torus Experiment (NSTX), and show that electromagnetic effects can affect blob dynamics and transport. We also formulate the gyrokinetic system in field-aligned coordinates for modeling realistic edge and scrape-off layer geometries in experiments.


title: Automatic Graph Partitioning for Very Large-scale Deep Learning

abstract: This work proposes RaNNC (Rapid Neural Network Connector) as middleware for automatic hybrid parallelism. In recent deep learning research, as exemplified by T5 and GPT-3, the size of neural network models continues to grow. Since such models do not fit into the memory of accelerator devices, they need to be partitioned by model parallelism techniques. Moreover, to accelerate training for huge training data, we need a combination of model and data parallelisms, i.e., hybrid parallelism. Given a model description for PyTorch without any specification for model parallelism, RaNNC automatically partitions the model into a set of subcomponents so that (1) each subcomponent fits a device memory and (2) a high training throughput for pipeline parallelism is achieved by balancing the computation times of the subcomponents. In our experiments, we compared RaNNC with two popular frameworks, Megatron-LM (hybrid parallelism) and GPipe (originally proposed for model parallelism, but a version allowing hybrid parallelism also exists), for training models with increasingly greater numbers of parameters. In the pre-training of enlarged BERT models, RaNNC successfully trained models five times larger than those Megatron-LM could, and RaNNC's training throughputs were comparable to Megatron-LM's when pre-training the same models. RaNNC also achieved better training throughputs than GPipe on both the enlarged BERT model pre-training (GPipe with hybrid parallelism) and the enlarged ResNet models (GPipe with model parallelism) in all of the settings we tried. These results are remarkable, since RaNNC automatically partitions models without any modification to their descriptions; Megatron-LM and GPipe require users to manually rewrite the models' descriptions.


title: Disappearance and Survival of Superconductivity in FeSe under High Pressure

abstract: Superconductivity in FeSe was investigated under high pressure through the measurements of DC magnetization by using a diamond anvil cell. We successfully observed that the disappearance of the superconductivity as a results of the appearance of the non-superconducting ortho I\hspace{-1pt}I phase above $\sim$7 GPa ($\sim$5 GPa), when Ar (glycerin) is used as the pressure transmitting media. Contrary to this, it has been found that the superconductivity even survives under pressure above 7 GPa, when the thickness ($t$) of a platelet-single crystal specimen is reduced. The survival of the superconductivity above 7 GPa is consistent with a previous observation under hydrostatic pressure by using a cubic anvil apparatus, suggesting that the hydrostaticity of the pressure is improved by reducing $t$. It is also inferred that the appearance of the ortho I\hspace{-1pt}I phase is due to uniaxial stress along the [001] direction.


title: General local energy-preserving integrators for solving multi-symplectic Hamiltonian PDEs

abstract: In this paper we propose and investigate a general approach to constructing local energy-preserving algorithms which can be of arbitrarily high order in time for solving Hamiltonian PDEs. This approach is based on the temporal discretization using continuous Runge-Kutta-type methods, and the spatial discretization using pseudospectral methods or Gauss--Legendre collocation methods. The local energy conservation law of our new schemes is analyzed in detail. The effectiveness of the novel local energy-preserving integrators is demonstrated by coupled nonlinear Schr\"odinger equations and 2D nonlinear Schr\"odinger equations with external fields. Our new schemes are compared with some classical multi-symplectic and symplectic schemes in numerical experiments. The numerical results show the remarkable \emph{long-term} behaviour of our new schemes.


title: Fast and Accurate Normal Estimation for Point Cloud via Patch Stitching

abstract: This paper presents an effective normal estimation method adopting multi-patch stitching for an unstructured point cloud. The majority of learning-based approaches encode a local patch around each point of a whole model and estimate the normals in a point-by-point manner. In contrast, we suggest a more efficient pipeline, in which we introduce a patch-level normal estimation architecture to process a series of overlapping patches. Additionally, a multi-normal selection method based on weights, dubbed as multi-patch stitching, integrates the normals from the overlapping patches. To reduce the adverse effects of sharp corners or noise in a patch, we introduce an adaptive local feature aggregation layer to focus on an anisotropic neighborhood. We then utilize a multi-branch planar experts module to break the mutual influence between underlying piecewise surfaces in a patch. At the stitching stage, we use the learned weights of multi-branch planar experts and distance weights between points to select the best normal from the overlapping parts. Furthermore, we put forward constructing a sparse matrix representation to reduce large-scale retrieval overheads for the loop iterations dramatically. Extensive experiments demonstrate that our method achieves SOTA results with the advantage of lower computational costs and higher robustness to noise over most of the existing approaches.


title: Data-Driven Synthesis of Optimization-Based Controllers for Regulation of Unknown Linear Systems

abstract: This paper proposes a data-driven framework to solve time-varying optimization problems associated with unknown linear dynamical systems. Making online control decisions to regulate a dynamical system to the solution of an optimization problem is a central goal in many modern engineering applications. Yet, the available methods critically rely on a precise knowledge of the system dynamics, thus mandating a preliminary system identification phase before a controller can be designed. In this work, we leverage results from behavioral theory to show that the steady-state transfer function of a linear system can be computed from data samples without any knowledge or estimation of the system model. We then use this data-driven representation to design a controller, inspired by a gradient-descent optimization method, that regulates the system to the solution of a convex optimization problem, without requiring any knowledge of the time-varying disturbances affecting the model equation. Results are tailored to cost functions satisfy the Polyak-\L ojasiewicz inequality.


title: On the Magnetic Fields of Ultraluminous X-ray Pulsars

abstract: So far quite a few ultraluminous X-ray (ULX) pulsars have been discovered. In this work, we construct a super-Eddington, magnetic accretion disk model to estimate the dipole magnetic field of eight ULX pulsars based on their observed spin-up variations and luminosities. We obtain two branches of dipole magnetic field solutions. They are distributed in the range of $B\sim (0.16-64.5)\times 10^{10}\,{\rm G}$ and $\sim (0.275-79.0)\times 10^{13}\,{\rm G}$ corresponding to the low- and high-$B$ solutions respectively. The low magnetic field solutions correspond to the state that the neutron stars are far away from the spin equilibrium, and the high magnetic field solutions are close to the spin equilibrium. The ultra-strong magnetic fields derived in Be-type ULX pulsars imply that the accretion mode in Be-type ULX pulsars could be more complicated than in the persistent ULX pulsars and may not be accounted for by the magnetized accretion disk model. We suggest that the transition between the accretor and the propeller regimes may be used to distinguish between the low- and high-$B$ magnetic field solutions in addition to the detection of the cyclotron resonance scattering features.


title: Do LIGO/Virgo black hole mergers produce AGN flares? The case of GW190521 and prospects for reaching a confident association

abstract: The recent report of an association of the gravitational-wave (GW) binary black hole (BBH) merger GW190521 with a flare in the Active Galactic Nuclei (AGN) J124942.3+344929 has generated tremendous excitement. However, GW190521 has one of the largest localization volumes amongst all of the GW events detected so far. The 90\% localization volume likely contains $7,400$ unobscured AGN brighter than $g \leq 20.5$ AB mag, and it results in a $\gtrsim 70\%$ probability of chance coincidence for an AGN flare consistent with the GW event. We present a Bayesian formalism to estimate the confidence of an AGN association by analyzing a population of BBH events with dedicated follow-up observations. Depending on the fraction of BBH arising from AGNs, counterpart searches of $\mathcal{O}(1)-\mathcal{O}(100)$ GW events are needed to establish a confident association, and more than an order of magnitude more for searches without followup (i.e, using only the locations of AGNs and GW events). Follow-up campaigns of the top $\sim 5\%$ (based on volume localization and binary mass) of BBH events with total rest frame mass $\ge 50~M_\odot$ are expected to establish a confident association during the next LIGO/Virgo/KAGRA observing run (O4), as long as the true value of the fraction of BBH giving rise to AGN flares is $>0.1$. Our formalism allows us to jointly infer cosmological parameters from a sample of BBH events that include chance coincidence flares. Until the confidence of AGN associations is established, the probability of chance coincidence must be taken into account to avoid biasing astrophysical and cosmological constraints.


title: Searching for local counterparts of high-redshift post-starburst galaxies in integral field unit spectroscopic surveys of nearby galaxies

abstract: Searching in the MaNGA IFU survey, I identify 9 galaxies that have strong Balmer absorption lines and weak nebular emission lines measured from the spectra integrated over the entire IFUs. The spectral features measured from the bulk of the stellar light make these galaxies local analogs of high-redshift spectroscopically-selected post-starburst galaxies, thus, proxies to understand the mechanisms producing post-starburst galaxies at high-redshifts. I present the distributions of absorption-line indices and emission-line strengths, as well as stellar kinematics of these local post-starburst galaxies. Almost all local post-starburst galaxies have central compact emission-line regions at the central $<1$ kpc, mostly powered by weak star-formation activities. The age-sensitive absorption line indices EW(H$\delta$) and Dn4000 indicate that the stellar populations at the outskirts are older. Toy stellar population synthesis models suggest that the entire galaxies are experiencing a rapid decline of star formation with residual star-formation activities at the centers. These features demand that most post-starburst galaxies are the aftermath of highly dissipative processes that drive gas into centers, invoke centrally-concentrated star formation, then quench the galaxies. Meanwhiles, when measurable, post-starburst galaxies have the directions of maximum stellar velocity gradients align with photometric major axes, which suggest against major mergers being the principal driving mechanism, while gas-rich minor mergers are plausible. While directly obtaining the same quality of spatially-resolved spectra of high-redshift post-starburst galaxies is very difficult, finding proper local counterparts provides an alternative to understand quenching processes in the distant Universe.


title: Approximate Nearest-Neighbor Search for Line Segments

abstract: Approximate nearest-neighbor search is a fundamental algorithmic problem that continues to inspire study due its essential role in numerous contexts. In contrast to most prior work, which has focused on point sets, we consider nearest-neighbor queries against a set of line segments in $\mathbb{R}^d$, for constant dimension $d$. Given a set $S$ of $n$ disjoint line segments in $\mathbb{R}^d$ and an error parameter $\varepsilon > 0$, the objective is to build a data structure such that for any query point $q$, it is possible to return a line segment whose Euclidean distance from $q$ is at most $(1+\varepsilon)$ times the distance from $q$ to its nearest line segment. We present a data structure for this problem with storage $O((n^2/\varepsilon^{d}) \log (\Delta/\varepsilon))$ and query time $O(\log (\max(n,\Delta)/\varepsilon))$, where $\Delta$ is the spread of the set of segments $S$. Our approach is based on a covering of space by anisotropic elements, which align themselves according to the orientations of nearby segments.


title: Electronic structure of URu$_2$Si$_2$ in paramagnetic phase: Three-dimensional angle resolved photoelectron spectroscopy study

abstract: The three-dimensional (3D) electronic structure of the hidden order compound URu$_2$Si$_2$ in a paramagnetic phase was revealed using a 3D angle-resolved photoelectron spectroscopy where the electronic structure of the entire Brillouin zone is obtained by scanning both incident photon energy and detection angles of photoelectrons. The quasi-particle bands with enhanced contribution from the $\mathrm{U}~5f$ state were observed near $E_\mathrm{F}$, formed by the hybridization with the $\mathrm{Ru}~4d$ states. The energy dispersion of the quasi-particle band is significantly depend on $k_z$, indicating that they inherently have a 3D nature. The band-structure calculation qualitatively explain the characteristic features of the band structure and Fermi surface although the electron correlation effect strongly renormalizes the quasi-particle bands. The 3D and strongly-correlated nature of the quasi-particle bands in URu$_2$Si$_2$ is an essential ingredient for modeling its hidden-order transition.


title: Fast multipole accelerated boundary element methods for room acoustics

abstract: The direct and indirect boundary element methods, accelerated via the fast multipole method, are applied to numerical simulation of room acoustics for large rooms of volume $\sim 150$ $m^{3}$ and frequencies up to 5 kHz on a workstation. As the parameter $kD$ (wavenumber times room diameter) is large, stabilization of the previously developed FMM algorithms is required for accuracy. A stabilization scheme is one of the key contribution of this paper. The computations are validated using well-known image source solutions for shoebox shaped rooms. Computations for L-shaped rooms are performed to illustrate the ability to capture diffractions. The ability to model in-room baffles, and boundary openings (doors/windows) is also demonstrated. The largest case has $kD>1100$ with a discretization of size 6 million elements. The performance of different boundary integral formulations was compared, and their rates of convergence using a preconditioned flexible GMRES were found to be substantially different. These promising results suggest a path to efficient simulations of room acoustics via high performance boundary element methods.


title: PointBA: Towards Backdoor Attacks in 3D Point Cloud

abstract: 3D deep learning has been increasingly more popular for a variety of tasks including many safety-critical applications. However, recently several works raise the security issues of 3D deep models. Although most of them consider adversarial attacks, we identify that backdoor attack is indeed a more serious threat to 3D deep learning systems but remains unexplored. We present the backdoor attacks in 3D point cloud with a unified framework that exploits the unique properties of 3D data and networks. In particular, we design two attack approaches on point cloud: the poison-label backdoor attack (PointPBA) and the clean-label backdoor attack (PointCBA). The first one is straightforward and effective in practice, while the latter is more sophisticated assuming there are certain data inspections. The attack algorithms are mainly motivated and developed by 1) the recent discovery of 3D adversarial samples suggesting the vulnerability of deep models under spatial transformation; 2) the proposed feature disentanglement technique that manipulates the feature of the data through optimization methods and its potential to embed a new task. Extensive experiments show the efficacy of the PointPBA with over 95% success rate across various 3D datasets and models, and the more stealthy PointCBA with around 50% success rate. Our proposed backdoor attack in 3D point cloud is expected to perform as a baseline for improving the robustness of 3D deep models.