title: Adversarial Attacks on Speech Recognition Systems for Mission-Critical Applications: A Survey

abstract: A Machine-Critical Application is a system that is fundamentally necessary to the success of specific and sensitive operations such as search and recovery, rescue, military, and emergency management actions. Recent advances in Machine Learning, Natural Language Processing, voice recognition, and speech processing technologies have naturally allowed the development and deployment of speech-based conversational interfaces to interact with various machine-critical applications. While these conversational interfaces have allowed users to give voice commands to carry out strategic and critical activities, their robustness to adversarial attacks remains uncertain and unclear. Indeed, Adversarial Artificial Intelligence (AI) which refers to a set of techniques that attempt to fool machine learning models with deceptive data, is a growing threat in the AI and machine learning research community, in particular for machine-critical applications. The most common reason of adversarial attacks is to cause a malfunction in a machine learning model. An adversarial attack might entail presenting a model with inaccurate or fabricated samples as it's training data, or introducing maliciously designed data to deceive an already trained model. While focusing on speech recognition for machine-critical applications, in this paper, we first review existing speech recognition techniques, then, we investigate the effectiveness of adversarial attacks and defenses against these systems, before outlining research challenges, defense recommendations, and future work. This paper is expected to serve researchers and practitioners as a reference to help them in understanding the challenges, position themselves and, ultimately, help them to improve existing models of speech recognition for mission-critical applications. Keywords: Mission-Critical Applications, Adversarial AI, Speech Recognition Systems.


title: Statistical Mechanical theory for spatio-temporal evolution of Intra-tumor heterogeneity in cancers: Analysis of Multiregion sequencing data

abstract: Heterogeneity in characteristics from one region (sub-population) to another, commonly observed in complex systems, such as glasses and a collection of cells, is hard to describe theoretically. In the context of cancer, intra-tumor heterogeneity (ITH), characterized by cells with genetic and phenotypic variability that co-exist within a single tumor, is often the cause of ineffective therapy and recurrence of cancer. Multi-region sequencing (M-Seq), obtained by sampling multiple regions of a single tumor, has vividly demonstrated the pervasive nature of ITH, raising the need for a theory that accounts for evolution of tumor heterogeneity. Here, we develop a statistical mechanical theory to quantify ITH, using the Hamming distance, between genetic mutations in distinct regions within a single tumor. An analytic expression for ITH, expressed in terms of cell division probability ($\alpha$) and mutation probability ($p$), is validated using cellular-automaton type simulations. Application of the theory successfully captures ITH extracted from M-seq data in patients with exogenous cancers (melanoma and lung). The theory, based on punctuated evolution at the early stages of the tumor followed by neutral evolution, is accurate provided the spatial variation in the tumor mutation burden is not large. We show that there are substantial variations in ITH in distinct regions of a single solid tumor, which supports the notion that distinct subclones could co-exist. The simulations show that there are substantial variations in the sub-populations, with the ITH increasing as the distance between the regions increases. The analytical and simulation framework developed here could be used in the quantitative analyses of the experimental (M-Seq) data. More broadly, our theory is likely to be useful in analyzing dynamic heterogeneity in complex systems such as super-cooled liquids.

categories: cond-mat.soft cond-mat.stat-mech physics.bio-ph q-bio.PE q-bio.TO


title: Constrained multibody kinematics and dynamics in absolute coordinates: a discussion of three approaches to representing rigid body rotation

abstract: We compare three approaches to posing the index 3 set of differential algebraic equations (DAEs) associated with the constrained multibody dynamics problem formulated in absolute coordinates. The first approach works directly with the orientation matrix and therefore eschews the need for generalized coordinates used to produce the orientation matrix $ \mathbf{A} $. The approach is informed by the fact that rotation matrices belong to the SO(3) Lie matrix group. The second approach employs Euler parameters, while the third uses Euler angles. In all cases, the index 3 DAE problem is solved via a first order implicit numerical integrator. We note a roughly twofold speedup of $ \mathbf{rA} $ over $ \mathbf{r\epsilon} $, and a 1.2 -- 1.3 times speedup of $ \mathbf{r\epsilon} $ over $ \mathbf{rp} $. The tests were carried out in conjunction with four 3D mechanisms. The improvements in simulation speed of the $ \mathbf{rA} $ approach are traced back to a simpler form of the equations of motion and more concise Jacobians that enter the numerical solution. The contributions made herein are twofold. First, we provide first order variations of all the quantities that enter the $ \mathbf{rA} $ formulation when used in the context of implicit integration; i.e., sensitivity of the kinematic constraints for all lower pair joints, as well as the sensitivity of the constraint reaction forces. Second, to the best of our knowledge, there is no other contribution that compares head to head the solution efficiency of $ \mathbf{rA} $, $ \mathbf{rp} $, and $ \mathbf{r\epsilon} $ in the context of the multibody dynamics problem posed in absolute coordinates.


title: On the monodromy manifold of $q$-Painlev\'e VI and its Riemann-Hilbert problem

abstract: We study the sixth $q$-difference Painlev\'e equation ($q{\textrm{P}_{\textrm{VI}}}$) through its associated Riemann-Hilbert problem (RHP) and show that the RHP is always solvable for irreducible monodromy data. This enables us to identify the solution space of $q{\textrm{P}_{\textrm{VI}}}$ with a monodromy manifold for generic parameter values. We deduce this manifold explicitly and show it is a smooth and affine algebraic surface when it does not contain reducible monodromy. Furthermore, we describe the RHP for reducible monodromy data and show that, when solvable, its solution is given explicitly in terms of certain orthogonal polynomials yielding special function solutions of $q{\textrm{P}_{\textrm{VI}}}$.


title: A frequency resolved atlas of the sky in continuous gravitational waves

abstract: We present the first atlas of the continuous gravitational wave sky, produced using LIGO O3a public data. For each 0.045 Hz frequency band and every point on the sky the atlas provides gravitational wave amplitude upper limits, signal-to-noise ratios (SNR) and frequencies where the search measures the maximum SNR. The approximately top 1.5% of the atlas results are reanalyzed with a series of more sensitive searches with the purpose of finding high SNR long coherence signals from isolated neutron stars. However, these searches do not reveal the presence of such signals. The results presented in the atlas are produced with the Falcon pipeline and cover nearly monochromatic gravitational-wave signals in the 500-1000 Hz band, with up to +/- 5e-11 Hz/s frequency derivative. The Falcon pipeline computes loosely coherent power estimates to search data using a succession of coherence lengths. For this search we used 6 months of data, started with a 12 hour coherence length and progressed to 6 days. Compared to the most sensitive results previously published (also produced with the Falcon pipeline) our upper limits are 50% more constraining. Neutron stars with ellipticity of 1e-8 can be detected up to 150 pc away, while allowing for a large fraction of the stars' energy to be lost through non-gravitational channels. These results are within an order of magnitude of the _minimum_ neutron star ellipticity of 1e-9 suggested in [33].


title: Rank One Perturbations Supported by Hybrid Geometries and Their Deformations

abstract: We study the hybrid type of rank one perturbations in $\mathbb{R}^2$ and $\mathbb{R}^3$, where the perturbation supported by a circle/sphere is considered together with the delta potential supported by a point outside of the circle/sphere. The construction of the self-adjoint Hamiltonian operator associated with the formal expressions for the rank one perturbation supported by a circle and by a point is explicitly given. The bound state energies and scattering properties for each problem are also studied. Finally, we consider the rank one perturbation supported by a deformed circle/sphere and show that the first order change in the bound state energies under small deformations of the circle/sphere has a simple geometric interpretation. Finally, we consider the delta potentials supported by deformed circle/sphere and show that the first order change in the bound state energies under small deformations of circle/sphere has a simple geometric interpretation.


title: Myriad: a real-world testbed to bridge trajectory optimization and deep learning

abstract: We present Myriad, a testbed written in JAX for learning and planning in real-world continuous environments. The primary contributions of Myriad are threefold. First, Myriad provides machine learning practitioners access to trajectory optimization techniques for application within a typical automatic differentiation workflow. Second, Myriad presents many real-world optimal control problems, ranging from biology to medicine to engineering, for use by the machine learning community. Formulated in continuous space and time, these environments retain some of the complexity of real-world systems often abstracted away by standard benchmarks. As such, Myriad strives to serve as a stepping stone towards application of modern machine learning techniques for impactful real-world tasks. Finally, we use the Myriad repository to showcase a novel approach for learning and control tasks. Trained in a fully end-to-end fashion, our model leverages an implicit planning module over neural ordinary differential equations, enabling simultaneous learning and planning with complex environment dynamics.


title: Quantum Gaussian process model of potential energy surface for a polyatomic molecule

abstract: With gates of a quantum computer designed to encode multi-dimensional vectors, projections of quantum computer states onto specific qubit states can produce kernels of reproducing kernel Hilbert spaces. We show that quantum kernels obtained with a fixed ansatz implementable on current quantum computers can be used for accurate regression models of global potential energy surfaces (PES) for polyatomic molecules. To obtain accurate regression models, we apply Bayesian optimization to maximize marginal likelihood by varying the parameters of the quantum gates. This yields Gaussian process models with quantum kernels. We illustrate the effect of qubit entanglement in the quantum kernels and explore the generalization performance of quantum Gaussian processes by extrapolating global six-dimensional PES in the energy domain.


title: Optimization under Connected Uncertainty

abstract: Robust optimization methods have shown practical advantages in a wide range of decision-making applications under uncertainty. Recently, their efficacy has been extended to multi-period settings. Current approaches model uncertainty either independent of the past or in an implicit fashion by budgeting the aggregate uncertainty. In many applications, however, past realizations directly influence future uncertainties. For this class of problems, we develop a modeling framework that explicitly incorporates this dependence via connected uncertainty sets, whose parameters at each period depend on previous uncertainty realizations. To find optimal here-and-now solutions, we reformulate robust and distributionally robust constraints for popular set structures and demonstrate this modeling framework numerically on broadly applicable knapsack and portfolio-optimization problems.


title: Disentangling Light Fields for Super-Resolution and Disparity Estimation

abstract: Light field (LF) cameras record both intensity and directions of light rays, and encode 3D scenes into 4D LF images. Recently, many convolutional neural networks (CNNs) have been proposed for various LF image processing tasks. However, it is challenging for CNNs to effectively process LF images since the spatial and angular information are highly inter-twined with varying disparities. In this paper, we propose a generic mechanism to disentangle these coupled information for LF image processing. Specifically, we first design a class of domain-specific convolutions to disentangle LFs from different dimensions, and then leverage these disentangled features by designing task-specific modules. Our disentangling mechanism can well incorporate the LF structure prior and effectively handle 4D LF data. Based on the proposed mechanism, we develop three networks (i.e., DistgSSR, DistgASR and DistgDisp) for spatial super-resolution, angular super-resolution and disparity estimation. Experimental results show that our networks achieve state-of-the-art performance on all these three tasks, which demonstrates the effectiveness, efficiency, and generality of our disentangling mechanism. Project page: https://yingqianwang.github.io/DistgLF/.


title: I4/mcm-Si$_{48}$: An Ideal Topological Nodal-Line Semimetal

abstract: Topological semimetals (TSMs) have attracted numerous attention due to their exotic physical properties and great application potentials. Silicon-based TMSs are of particularly importance because of their high abundance, nontoxicity and natural compatibility with current semiconductor industry. In this work, an ideal low-energy topological nodal-line semimetal (TNLSM) silicon (I4/mcm-Si$_{48}$) with a clean band crossing at Fermi level is screened from thousands of silicon allotropes by the transferable tight-binding and DFT-HSE calculations. The results of formation energy, phonon dispersion, ab initio molecular dynamics and elastic constants show that I4/mcm-Si48 possesses good stability and is more stable than several synthetized silicon structures. By analyzing the symmetry, it reveals that the topological nodal-line of I4/mcm-Si48 is protected by mirror symmetry and inversion, time-reversal and SU(2) spin-rotation symmetries, and the nearly flat drumhead-like surface spectrum is observed. Furthermore, I4/mcm-Si48 exhibits exotic photoelectric properties and the Dirac fermions with high Fermi velocity (3.4$\sim$4.36$\times$10$^5$ m/s) can be excited by low energy photons. Our study provides a promising topological nodal-line semimetal for fundamental research and potential practical applications in semiconductor-compatible high-speed photoelectric devices.


title: Space Layout of Low-entropy Hydration Shells Guides Protein Binding

abstract: Protein-protein binding enables orderly and lawful biological self-organization, and is therefore considered a miracle of nature. Protein-protein binding is steered by electrostatic forces, hydrogen bonding, van der Waals force, and hydrophobic interactions. Among these physical forces, only the hydrophobic interactions can be considered as long-range intermolecular attractions between proteins in intracellular and extracellular fluid. Low-entropy regions of hydration shells around proteins drive hydrophobic attraction among them that essentially coordinate protein-protein docking in rotational-conformational space of mutual orientations at the guidance stage of the binding. Here, an innovative method was developed for identifying the low-entropy regions of hydration shells of given proteins, and we discovered that the largest low-entropy regions of hydration shells on proteins typically cover the binding sites. According to an analysis of determined protein complex structures, shape matching between the largest low-entropy hydration shell region of a protein and that of its partner at the binding sites is revealed as a regular pattern. Protein-protein binding is thus found to be mainly guided by hydrophobic collapse between the shape-matched low-entropy hydration shells that is verified by bioinformatics analyses of hundreds of structures of protein complexes. A simple algorithm is developed to precisely predict protein binding sites.


title: No-Regret Learning in Partially-Informed Auctions

abstract: Auctions with partially-revealed information about items are broadly employed in real-world applications, but the underlying mechanisms have limited theoretical support. In this work, we study a machine learning formulation of these types of mechanisms, presenting algorithms that are no-regret from the buyer's perspective. Specifically, a buyer who wishes to maximize his utility interacts repeatedly with a platform over a series of $T$ rounds. In each round, a new item is drawn from an unknown distribution and the platform publishes a price together with incomplete, "masked" information about the item. The buyer then decides whether to purchase the item. We formalize this problem as an online learning task where the goal is to have low regret with respect to a myopic oracle that has perfect knowledge of the distribution over items and the seller's masking function. When the distribution over items is known to the buyer and the mask is a SimHash function mapping $\mathbb{R}^d$ to $\{0,1\}^{\ell}$, our algorithm has regret $\tilde O((Td\ell)^{1/2})$. In a fully agnostic setting when the mask is an arbitrary function mapping to a set of size $n$ and the prices are stochastic, our algorithm has regret $\tilde O((Tn)^{1/2})$.


title: Stability of heteroclinic cycles in rings of coupled oscillators

abstract: Networks of interacting nodes connected by edges arise in almost every branch of scientific enquiry. The connectivity structure of the network can force the existence of invariant subspaces, which would not arise in generic dynamical systems. These invariant subspaces can result in the appearance of robust heteroclinic cycles, which would otherwise be structurally unstable. Typically, the dynamics near a stable heteroclinic cycle is non-ergodic: mean residence times near the fixed points in the cycle are undefined, and there is a persistent slowing down. In this paper, we examine ring networks with nearest-neighbour or nearest-m-neighbour coupling, and show that there exist classes of heteroclinic cycles in the phase space of the dynamics. We show that there is always at least one heteroclinic cycle which can be asymptotically stable, and thus the attracting dynamics of the network are expected to be non-ergodic. We conjecture that much of this behaviour persists in less structured networks and as such, non-ergodic behaviour is somehow typical.


title: It Takes Four to Tango: Multiagent Selfplay for Automatic Curriculum Generation

abstract: We are interested in training general-purpose reinforcement learning agents that can solve a wide variety of goals. Training such agents efficiently requires automatic generation of a goal curriculum. This is challenging as it requires (a) exploring goals of increasing difficulty, while ensuring that the agent (b) is exposed to a diverse set of goals in a sample efficient manner and (c) does not catastrophically forget previously solved goals. We propose Curriculum Self Play (CuSP), an automated goal generation framework that seeks to satisfy these desiderata by virtue of a multi-player game with four agents. We extend the asymmetric curricula learning in PAIRED (Dennis et al., 2020) to a symmetrized game that carefully balances cooperation and competition between two off-policy student learners and two regret-maximizing teachers. CuSP additionally introduces entropic goal coverage and accounts for the non-stationary nature of the students, allowing us to automatically induce a curriculum that balances progressive exploration with anti-catastrophic exploitation. We demonstrate that our method succeeds at generating an effective curricula of goals for a range of control tasks, outperforming other methods at zero-shot test-time generalization to novel out-of-distribution goals.


title: Phase-space stochastic quantum hydrodynamics for interacting Bose gases

abstract: Hydrodynamic theories offer successful approaches that are capable of simulating the otherwise difficult-to-compute dynamics of quantum many-body systems. In this work we derive, within the positive-P phase-space formalism, a new stochastic hydrodynamic method for the description of interacting Bose gases. It goes beyond existing hydrodynamic approaches, such as superfluid hydrodynamics or generalized hydrodynamics, in its capacity to simulate the full quantum dynamics of these systems: it possesses the ability to compute non-equilibrium quantum correlations, even for short-wavelength phenomena. Using this description, we derive a linearized stochastic hydrodynamic scheme which is able to simulate such non-equilibrium situations for longer times than the full positive-P approach, at the expense of approximating the treatment of quantum fluctuations, and show that this linearized scheme can be directly connected with existing Bogoliubov approaches. Furthermore, we go on to demonstrate the usefulness and advantages of this formalism by exploring the correlations that arise in a quantum shock wave scenario and comparing its predictions to other established quantum many-body approaches.

categories: cond-mat.quant-gas physics.comp-ph physics.flu-dyn quant-ph


title: Knowledge Base Question Answering by Case-based Reasoning over Subgraphs

abstract: Question answering (QA) over knowledge bases (KBs) is challenging because of the diverse, essentially unbounded, types of reasoning patterns needed. However, we hypothesize in a large KB, reasoning patterns required to answer a query type reoccur for various entities in their respective subgraph neighborhoods. Leveraging this structural similarity between local neighborhoods of different subgraphs, we introduce a semiparametric model (CBR-SUBG) with (i) a nonparametric component that for each query, dynamically retrieves other similar $k$-nearest neighbor (KNN) training queries along with query-specific subgraphs and (ii) a parametric component that is trained to identify the (latent) reasoning patterns from the subgraphs of KNN queries and then apply them to the subgraph of the target query. We also propose an adaptive subgraph collection strategy to select a query-specific compact subgraph, allowing us to scale to full Freebase KB containing billions of facts. We show that CBR-SUBG can answer queries requiring subgraph reasoning patterns and performs competitively with the best models on several KBQA benchmarks. Our subgraph collection strategy also produces more compact subgraphs (e.g. 55\% reduction in size for WebQSP while increasing answer recall by 4.85\%)\footnote{Code, model, and subgraphs are available at \url{https://github.com/rajarshd/CBR-SUBG}}.


title: Universal 1-Bit Compressive Sensing for Bounded Dynamic Range Signals

abstract: A {\em universal 1-bit compressive sensing (CS)} scheme consists of a measurement matrix $A$ such that all signals $x$ belonging to a particular class can be approximately recovered from $\textrm{sign}(Ax)$. 1-bit CS models extreme quantization effects where only one bit of information is revealed per measurement. We focus on universal support recovery for 1-bit CS in the case of {\em sparse} signals with bounded {\em dynamic range}. Specifically, a vector $x \in \mathbb{R}^n$ is said to have sparsity $k$ if it has at most $k$ nonzero entries, and dynamic range $R$ if the ratio between its largest and smallest nonzero entries is at most $R$ in magnitude. Our main result shows that if the entries of the measurement matrix $A$ are i.i.d.~Gaussians, then under mild assumptions on the scaling of $k$ and $R$, the number of measurements needs to be $\tilde{\Omega}(Rk^{3/2})$ to recover the support of $k$-sparse signals with dynamic range $R$ using $1$-bit CS. In addition, we show that a near-matching $O(R k^{3/2} \log n)$ upper bound follows as a simple corollary of known results. The $k^{3/2}$ scaling contrasts with the known lower bound of $\tilde{\Omega}(k^2 \log n)$ for the number of measurements to recover the support of arbitrary $k$-sparse signals.


title: A Decentralized Communication Framework based on Dual-Level Recurrence for Multi-Agent Reinforcement Learning

abstract: We propose a model enabling decentralized multiple agents to share their perception of environment in a fair and adaptive way. In our model, both the current message and historical observation are taken into account, and they are handled in the same recurrent model but in different forms. We present a dual-level recurrent communication framework for multi-agent systems, in which the first recurrence occurs in the communication sequence and is used to transmit communication data among agents, while the second recurrence is based on the time sequence and combines the historical observations for each agent. The developed communication flow separates communication messages from memories but allows agents to share their historical observations by the dual-level recurrence. This design makes agents adapt to changeable communication objects, while the communication results are fair to these agents. We provide a sufficient discussion about our method in both partially observable and fully observable environments. The results of several experiments suggest our method outperforms the existing decentralized communication frameworks and the corresponding centralized training method.


title: Gaussian Processes and Statistical Decision-making in Non-Euclidean Spaces

abstract: Bayesian learning using Gaussian processes provides a foundational framework for making decisions in a manner that balances what is known with what could be learned by gathering data. In this dissertation, we develop techniques for broadening the applicability of Gaussian processes. This is done in two ways. Firstly, we develop pathwise conditioning techniques for Gaussian processes, which allow one to express posterior random functions as prior random functions plus a dependent update term. We introduce a wide class of efficient approximations built from this viewpoint, which can be randomly sampled once in advance, and evaluated at arbitrary locations without any subsequent stochasticity. This key property improves efficiency and makes it simpler to deploy Gaussian process models in decision-making settings. Secondly, we develop a collection of Gaussian process models over non-Euclidean spaces, including Riemannian manifolds and graphs. We derive fully constructive expressions for the covariance kernels of scalar-valued Gaussian processes on Riemannian manifolds and graphs. Building on these ideas, we describe a formalism for defining vector-valued Gaussian processes on Riemannian manifolds. The introduced techniques allow all of these models to be trained using standard computational methods. In total, these contributions make Gaussian processes easier to work with and allow them to be used within a wider class of domains in an effective and principled manner. This, in turn, makes it possible to potentially apply Gaussian processes to novel decision-making settings.


title: Upsilon invariant for graphs and the homology cobordism group of homology cylinders

abstract: Upsilon is a homomorphism on the smooth concordance group of knots defined by Ozsv\'{a}th, Stipsicz and Szab\'{o}. In this paper, we define a generalization of upsilon for a family of embedded graphs in rational homolog spheres. We show that our invariant will induce a homomorphism on the homology cobordism group of homology cylinders, and present some applications. To define this invariant, we use tangle Floer homology. We lift relative gradings on tangle Floer homology to absolute gradings (for certain tangles) and prove a concatenation formula for it.


title: On Average-Case Error Bounds for Kernel-Based Bayesian Quadrature

abstract: In this paper, we study error bounds for {\em Bayesian quadrature} (BQ), with an emphasis on noisy settings, randomized algorithms, and average-case performance measures. We seek to approximate the integral of functions in a {\em Reproducing Kernel Hilbert Space} (RKHS), particularly focusing on the Mat\'ern-$\nu$ and squared exponential (SE) kernels, with samples from the function potentially being corrupted by Gaussian noise. We provide a two-step meta-algorithm that serves as a general tool for relating the average-case quadrature error with the $L^2$-function approximation error. When specialized to the Mat\'ern kernel, we recover an existing near-optimal error rate while avoiding the existing method of repeatedly sampling points. When specialized to other settings, we obtain new average-case results for settings including the SE kernel with noise and the Mat\'ern kernel with misspecification. Finally, we present algorithm-independent lower bounds that have greater generality and/or give distinct proofs compared to existing ones.

categories: stat.ML cs.IT cs.LG math.IT math.ST stat.TH


title: Isotopy classes of involutions of del Pezzo surfaces

abstract: Let $M_n := \mathbb{CP}^2 \# n\overline{\mathbb{CP}^2}$ for $0 \leq n \leq 8$ be the underlying smooth manifold of a degree $9-n$ del Pezzo surface. We prove three results about the mapping class group $\text{Mod}(M_n) := \pi_0(\text{Homeo}^+(M_n))$: 1. the classification of, and a structure theorem for, all involutions in $\text{Mod}(M_n)$, 2. a positive solution to the smooth Nielsen realization problem for involutions of $M_n$, and 3. a purely topological characterization of three remarkable types of involutions on certain $M_n$ coming from birational geometry: de Jonqui\'eres involutions, Geiser involutions, and Bertini involutions. One main ingredient is the theory of hyperbolic reflection groups.


title: An Ensemble Learning Framework for Vehicle Trajectory Prediction in Interactive Scenarios

abstract: Precisely modeling interactions and accurately predicting trajectories of surrounding vehicles are essential to the decision-making and path-planning of intelligent vehicles. This paper proposes a novel framework based on ensemble learning to improve the performance of trajectory predictions in interactive scenarios. The framework is termed Interactive Ensemble Trajectory Predictor (IETP). IETP assembles interaction-aware trajectory predictors as base learners to build an ensemble learner. Firstly, each base learner in IETP observes historical trajectories of vehicles in the scene. Then each base learner handles interactions between vehicles to predict trajectories. Finally, an ensemble learner is built to predict trajectories by applying two ensemble strategies on the predictions from all base learners. Predictions generated by the ensemble learner are final outputs of IETP. In this study, three experiments using different data are conducted based on the NGSIM dataset. Experimental results show that IETP improves the predicting accuracy and decreases the variance of errors compared to base learners. In addition, IETP exceeds baseline models with 50% of the training data, indicating that IETP is data-efficient. Moreover, the implementation of IETP is publicly available at https://github.com/BIT-Jack/IETP.


title: Differential Secrecy for Distributed Data and Applications to Robust Differentially Secure Vector Summation

abstract: Computing the noisy sum of real-valued vectors is an important primitive in differentially private learning and statistics. In private federated learning applications, these vectors are held by client devices, leading to a distributed summation problem. Standard Secure Multiparty Computation (SMC) protocols for this problem are susceptible to poisoning attacks, where a client may have a large influence on the sum, without being detected. In this work, we propose a poisoning-robust private summation protocol in the multiple-server setting, recently studied in PRIO. We present a protocol for vector summation that verifies that the Euclidean norm of each contribution is approximately bounded. We show that by relaxing the security constraint in SMC to a differential privacy like guarantee, one can improve over PRIO in terms of communication requirements as well as the client-side computation. Unlike SMC algorithms that inevitably cast integers to elements of a large finite field, our algorithms work over integers/reals, which may allow for additional efficiencies.


title: An Architecture for Web 3.0 and the Emergence of Spontaneous Time Order

abstract: In this study, we proposed an architecture for Web 3.0, which is based on the hashed interactions among user nodes that can transform bilateral trusts into collective time order, which is the major achievement of blockchain technology, without the expensive Proof of Work or the questionable Proof of Stake.


title: Analysis of Personal Data Visualization Reviews On mHealth Apps (short paper)

abstract: Mobile devices, specifically, smartphones proved easy and quick access to data visualisations throughout various tracking apps. Mobile health (mHealth) apps have given non-expert users access to data visualisation to track their activities and health-related issues such as heart tracking and medication. However, no work is done on user experience or perception of data visualisations in mHealth apps. App reviews offer an indirect anchor for researchers to examine how non-expert users perceive and interact with data visualisations and identify the key challenges and recommendations. This paper introduces an analysis of app reviews on data visualisations reported on a dataset of 250 mHealth apps on the Google Play Store. We identified 8,406 comments related to data visualisations. 919 neutral comments, 1,557 negative comments and 5,930 positive comments. From analysing the user reviews, functional requirements turned out to be the most common problem across these app reviews, followed by the look and feel and then data problems. A complete set of data visualisations seem to be the most well-received capability of mHealth apps. We used these comments to develop classification and data visualisation guidelines when developing mobile data visualisations.


title: Universal classical optical computing inspired by quantum information process

abstract: Quantum computing has attracted much attention in recent decades, since it is believed to solve certain problems substantially faster than traditional computing methods. Theoretically, such an advance can be obtained by networks of the quantum operators in universal gate sets, one famous example of which is formed by CNOT gate and single qubit gates. However, realizing a device that performs practical quantum computing is tricky. This is because it requires a scalable qubit system with long coherence time and good controls, which is harsh for most current platforms. Here, we demonstrate that the information process based on a relatively stable system -- classical optical system, can be considered as an analogy of universal quantum computing. By encoding the information via the polarization state of classical beams, the optical computing elements that corresponds to the universal gate set are presented and their combination for a general information process are theoretically illustrated. Taking the analogy of two-qubit processor as an example, we experimentally verify that our proposal works well. Considering the potential of optical system for reliable and low-energy-consuming computation, our results open a new way towards advanced information processing with high quality and efficiency.


title: Implications of the first evidence for coherent elastic scattering of reactor neutrinos

abstract: The recent evidence for coherent elastic neutrino-nucleus scattering (CE$\nu$NS) in the NCC-1701 germanium detector using antineutrinos from the Dresden-II nuclear reactor is in good agreement with standard model expectations. However, we show that a $2\sigma$ improvement in the fit to the data can be achieved if the quenching factor is described by a modified Lindhard model. We also place constraints on the parameter space of a light vector or scalar mediator that couples to neutrinos and quarks, and on a neutrino magnetic moment. We demonstrate that the constraints are quite sensitive to the quenching factor at low recoil energies by comparing constraints for the standard Lindhard model with those by marginalizing over the two parameters of the modified Lindhard model.


title: On financial market correlation structures and diversification benefits across and within equity sectors

abstract: We study how to assess the potential benefit of diversifying an equity portfolio by investing within and across equity sectors. We analyse 20 years of US stock price data, which includes the global financial crisis (GFC) and the COVID-19 market crash, as well as periods of financial stability, to determine the `all weather' nature of equity portfolios. We establish that one may use the leading eigenvalue of the cross-correlation matrix of log returns as well as graph-theoretic diagnostics such as modularity to quantify the collective behaviour of the market or a subset of it. We confirm that financial crises are characterised by a high degree of collective behaviour of equities, whereas periods of financial stability exhibit less collective behaviour. We argue that during times of increased collective behaviour, risk reduction via sector-based portfolio diversification is ineffective. Using the degree of collectivity as a proxy for the benefit of diversification, we perform an extensive sampling of equity portfolios to confirm the old financial adage that 30-40 stocks provide sufficient diversification. Using hierarchical clustering, we discover a `best value' equity portfolio for diversification consisting of 36 equities sampled uniformly from 9 sectors. We further show that it is typically more beneficial to diversify across sectors rather than within. Our findings have implications for cost-conscious retail investors seeking broad diversification across equity markets.


title: Passive verification protocol for thermal graph states

abstract: Graph states are entangled resource states for universal measurement-based quantum computation. Although matter qubits such as superconducting circuits and trapped ions are promising candidates to generate graph states, it is technologically hard to entangle a large number of them due to several types of noise. Since they must be sufficiently cooled to maintain their quantum properties, thermal noise is one of major ones. In this paper, we show that for any temperature $T$, the fidelity $\langle G|\rho_T|G\rangle$ between an ideal graph state $|G\rangle$ at zero temperature and a thermal graph state $\rho_T$, which is a graph state at temperature $T$, can be efficiently estimated by using only one measurement setting. A remarkable property of our protocol is that it is passive, while existing protocols are active, namely they switch between at least two measurement settings. Since thermal noise is equivalent to an independent phase-flip error, our estimation protocol also works for that error. By generalizing our protocol to hypergraph states, we apply our protocol to the quantum-computational-supremacy demonstration with instantaneous quantum polynomial time circuits. Our results should make the characterization of entangled matter qubits extremely feasible under thermal noise.


title: Gradient estimate of the solutions to Hessian equations with oblique boundary value

abstract: In this paper, we study Hessian equations with prescribed contact angle boundary value or oblique derivative boundary value and finally derive the a priori global gradient estimate for the admissible solutions.


title: On the Schur Multiplier of finite $p$-groups of maximal class

abstract: In this article, we prove that the Schur Multiplier of a finite $p$-group of maximal class of order $p^n ~(4 \leq n \leq p+1)$ is elementary abelian. The case $n = p+1$ settles a question raised by Primo\v{z} Moravec in an earlier article.


title: On the Effectiveness of Adversarial Training against Backdoor Attacks

abstract: DNNs' demand for massive data forces practitioners to collect data from the Internet without careful check due to the unacceptable cost, which brings potential risks of backdoor attacks. A backdoored model always predicts a target class in the presence of a predefined trigger pattern, which can be easily realized via poisoning a small amount of data. In general, adversarial training is believed to defend against backdoor attacks since it helps models to keep their prediction unchanged even if we perturb the input image (as long as within a feasible range). Unfortunately, few previous studies succeed in doing so. To explore whether adversarial training could defend against backdoor attacks or not, we conduct extensive experiments across different threat models and perturbation budgets, and find the threat model in adversarial training matters. For instance, adversarial training with spatial adversarial examples provides notable robustness against commonly-used patch-based backdoor attacks. We further propose a hybrid strategy which provides satisfactory robustness across different backdoor attacks.


title: A Survey on Offloading in Federated Cloud-Edge-Fog Systems with Traditional Optimization and Machine Learning

abstract: The huge amount of data generated by the Internet of things (IoT) devices needs the computational power and storage capacity provided by cloud, edge, and fog computing paradigms. Each of these computing paradigms has its own pros and cons. Cloud computing provides enhanced data storage and computing power but causes high communication latency. Edge and fog computing provide similar services with lower latency but with limited capacity, capability, and coverage. A single computing paradigm cannot fulfil all the requirements of IoT devices and a federation between them is needed to extend their capacity, capability, and services. This federation is beneficial to both subscribers and providers and also reveals research issues in traffic offloading between clouds, edges, and fogs. Optimization has traditionally been used to solve the problem of traffic offloading. However, in such a complex federated system, traditional optimization cannot keep up with the strict latency requirements of decision making, ranging from milliseconds to sub-seconds. Machine learning approaches, especially reinforcement learning, are consequently becoming popular because they can quickly solve offloading problems in dynamic environments with large amounts of unknown information. This study provides a novel federal classification between cloud, edge, and fog and presents a comprehensive research roadmap on offloading for different federated scenarios. We survey the relevant literature on the various optimization approaches used to solve this offloading problem, and compare their salient features. We then provide a comprehensive survey on offloading in federated systems with machine learning approaches and the lessons learned as a result of these surveys. Finally, we outline several directions for future research and challenges that have to be faced in order to achieve such a federation.


title: Model Reprogramming: Resource-Efficient Cross-Domain Machine Learning

abstract: In data-rich domains such as vision, language, and speech, deep learning prevails to deliver high-performance task-specific models and can even learn general task-agnostic representations for efficient finetuning to downstream tasks. However, deep learning in resource-limited domains still faces multiple challenges including (i) limited data, (ii) constrained model development cost, and (iii) lack of adequate pre-trained models for effective finetuning. This paper provides an overview of model reprogramming to bridge this gap. Model reprogramming enables resource-efficient cross-domain machine learning by repurposing and reusing a well-developed pre-trained model from a source domain to solve tasks in a target domain without model finetuning, where the source and target domains can be vastly different. In many applications, model reprogramming outperforms transfer learning and training from scratch. This paper elucidates the methodology of model reprogramming, summarizes existing use cases, provides a theoretical explanation of the success of model reprogramming, and concludes with a discussion on open-ended research questions and opportunities. A list of model reprogramming studies is actively maintained and updated at https://github.com/IBM/model-reprogramming.


title: Behaviour-Diverse Automatic Penetration Testing: A Curiosity-Driven Multi-Objective Deep Reinforcement Learning Approach

abstract: Penetration Testing plays a critical role in evaluating the security of a target network by emulating real active adversaries. Deep Reinforcement Learning (RL) is seen as a promising solution to automating the process of penetration tests by reducing human effort and improving reliability. Existing RL solutions focus on finding a specific attack path to impact the target hosts. However, in reality, a diverse range of attack variations are needed to provide comprehensive assessments of the target network's security level. Hence, the attack agents must consider multiple objectives when penetrating the network. Nevertheless, this challenge is not adequately addressed in the existing literature. To this end, we formulate the automatic penetration testing in the Multi-Objective Reinforcement Learning (MORL) framework and propose a Chebyshev decomposition critic to find diverse adversary strategies that balance different objectives in the penetration test. Additionally, the number of available actions increases with the agent consistently probing the target network, making the training process intractable in many practical situations. Thus, we introduce a coverage-based masking mechanism that reduces attention on previously selected actions to help the agent adapt to future exploration. Experimental evaluation on a range of scenarios demonstrates the superiority of our proposed approach when compared to adapted algorithms in terms of multi-objective learning and performance efficiency.


title: Hidden bawls, whispers, and yelps: can text be made to sound more than just its words?

abstract: Whether a word was bawled, whispered, or yelped, captions will typically represent it in the same way. If they are your only way to access what is being said, subjective nuances expressed in the voice will be lost. Since so much of communication is carried by these nuances, we posit that if captions are to be used as an accurate representation of speech, embedding visual representations of paralinguistic qualities into captions could help readers use them to better understand speech beyond its mere textual content. This paper presents a model for processing vocal prosody (its loudness, pitch, and duration) and mapping it into visual dimensions of typography (respectively, font-weight, baseline shift, and letter-spacing), creating a visual representation of these lost vocal subtleties that can be embedded directly into the typographical form of text. An evaluation was carried out where participants were exposed to this speech-modulated typography and asked to match it to its originating audio, presented between similar alternatives. Participants (n=117) were able to correctly identify the original audios with an average accuracy of 65%, with no significant difference when showing them modulations as animated or static text. Additionally, participants' comments showed their mental models of speech-modulated typography varied widely.


title: Local well-posedness of the Skew mean curvature flow for small data in $d\geq 2$ dimensions

abstract: The skew mean curvature flow is an evolution equation for $d$ dimensional manifolds embedded in $\mathbb{R}^{d+2}$ (or more generally, in a Riemannian manifold). It can be viewed as a Schr\"odinger analogue of the mean curvature flow, or alternatively as a quasilinear version of the Schr\"odinger Map equation. In an earlier paper, the authors introduced a harmonic/Coulomb gauge formulation of the problem, and used it to prove small data local well-posedness in dimensions $d \geq 4$. In this article, we prove small data local well-posedness in low-regularity Sobolev spaces for the skew mean curvature flow in dimension $d\geq 2$. This is achieved by introducing a new, heat gauge formulation of the equations, which turns out to be more robust in low dimensions.


title: Pulse-echo speed-of-sound imaging using convex probes

abstract: Computed ultrasound tomography in echo mode (CUTE) is a new ultrasound (US)-based medical imaging modality with promise for diagnosing various types of disease based on the tissue's speed of sound (SoS). It is developed for conventional pulse-echo US using handheld probes and can thus be implemented in state-of-the-art medical US systems. One promising application is the quantification of the liver fat fraction in fatty liver disease. So far, CUTE was demonstrated using linear array probes where the imaging depth is comparable to the aperture size. For liver imaging, however, convex probes are preferred since they provide a larger penetration depth and a wider view angle allowing to capture a large area of the liver. With the goal of liver imaging in mind, we adapt CUTE to convex probes, with a special focus on discussing strategies that make use of the convex geometry in order to make our implementation computationally efficient. We then demonstrate in an abdominal imaging phantom that accurate quantitative SoS using convex probes is feasible, in spite of the smaller aperture size in relation to the image area compared to linear arrays. A preliminary in vivo result of liver imaging confirms this outcome, but also indicates that deep quantitative imaging in the real liver can be more challenging, probably due to the increased complexity of the tissue compared to phantoms.


title: Time Division Multiplexing Ising Computer Using Single Tunable True Random Number Generator Based on Spin Torque Nano-Oscillator

abstract: Ising computer is a powerful computation scheme to deal with NP-hard optimization problems that cannot be efficiently addressed by conventional computers. A robust probabilistic bit (P-Bit) which is realized by a hardware entity fluctuating in time between -1 and 1 plays a key role in the success of Ising computer. Spintronics technology, such as stochastic nanomagnet, is recently proposed as a good platform for the hardware emulation of P-Bit. Here, we report, for the first time, a Time Division Multiplexing (TDM) Ising computer using single tunable true random number generator which is comprised of a Spin Torque Nano-Oscillator (STNO). First, the intrinsic frequency fluctuation of the STNO is utilized to design a simple digital true random number generator (TRNG). The true random number generator is further evolved into a tunable random number generator to act as a P-Bit. Second, in order to accomplish combinational optimization with our proposed P-Bit under Ising model, a novel incremental coupling rule is proposed. With such coupling rule between P-Bit array, high fidelity NOT and XOR logic gate is demonstrated. Third, it is proposed that our digital TRNG can be simply reused acting as a P-Bit array by time division multiplexing. The whole Ising computer can be implemented by one single STNO, and integer factorization of as high as 87% accuracy rate is achieved.


title: Online Learning of Trellis Diagram Using Neural Network for Robust Detection and Decoding

abstract: This paper studies machine learning-assisted maximum likelihood (ML) and maximum a posteriori (MAP) receivers for a communication system with memory, which can be modelled by a trellis diagram. The prerequisite of the ML/MAP receiver is to obtain the likelihood of the received samples under different state transitions of the trellis diagram, which relies on the channel state information (CSI) and the distribution of the channel noise. We propose to learn the trellis diagram real-time using an artificial neural network (ANN) trained by a pilot sequence. This approach, termed as the online learning of trellis diagram (OLTD), requires neither the CSI nor statistics of the noise, and can be incorporated into the classic Viterbi and the BCJR algorithm. %Compared with the state-of-the-art ViterbiNet and BCJRNet algorithms in the literature, it It is shown to significantly outperform the model-based methods in non-Gaussian channels. It requires much less training overhead than the state-of-the-art methods, and hence is more feasible for real implementations. As an illustrative example, the OLTD-based BCJR is applied to a Bluetooth low energy (BLE) receiver trained only by a 256-sample pilot sequence. Moreover, the OLTD-based BCJR can accommodate for turbo equalization, while the state-of-the-art BCJRNet/ViterbiNet cannot. As an interesting by-product, we propose an enhancement to the BLE standard by introducing a bit interleaver to its physical layer; the resultant improvement of the receiver sensitivity can make it a better fit for some Internet of Things (IoT) communications.


title: Metric currents, barycenter maps and the spherical Plateau problem

abstract: We introduce the spherical Plateau problem, a variational problem in homology classes of quotients of the infinite dimensional separable Hilbert sphere. We start with a review of the Ambrosio-Kirchheim theory of metric currents, and the barycenter map method developed by Besson-Courtois-Gallot. Then, we outline the following applications: 1. the intrinsic uniqueness of spherical Plateau solutions for negatively curved, locally symmetric, closed oriented manifolds, 2. the intrinsic uniqueness of spherical Plateau solutions for all 3-dimensional closed oriented manifolds, 3. the construction of higher dimensional analogues of hyperbolic Dehn fillings. We also propose some open questions.


title: BRST Ghost-Vertex Operator in Witten's Cubic Open String Field Theory on Multiple $Dp$-branes

abstract: The Becchi-Rouet-Stora-Tyutin (BRST) ghost field is a key element in constructing Witten's cubic open string field theory. However, to date, the ghost sector of the string field theory has not received a great deal of attention. In this study, we address the BRST ghost on multiple $Dp$-branes, which carries non-Abelian indices and couples to a non-Ablelian gauge field. We found that the massless components of the BRST ghost field can play the role of the Faddeev-Popov ghost in the non-Alelian gauge field, such that the string field theory maintains the local non-Abelian gauge invariance.


title: Invariance Learning in Deep Neural Networks with Differentiable Laplace Approximations

abstract: Data augmentation is commonly applied to improve performance of deep learning by enforcing the knowledge that certain transformations on the input preserve the output. Currently, the data augmentation parameters are chosen by human effort and costly cross-validation, which makes it cumbersome to apply to new datasets. We develop a convenient gradient-based method for selecting the data augmentation without validation data during training of a deep neural network. Our approach relies on phrasing data augmentation as an invariance in the prior distribution on the functions of a neural network, which allows us to learn it using Bayesian model selection. This has been shown to work in Gaussian processes, but not yet for deep neural networks. We propose a differentiable Kronecker-factored Laplace approximation to the marginal likelihood as our objective, which can be optimised without human supervision or validation data. We show that our method can successfully recover invariances present in the data, and that this improves generalisation and data efficiency on image datasets.


title: A Heuristic Proof Procedure for Propositional Logic

abstract: Theorem proving is one of the oldest applications which require heuristics to prune the search space. Invertible proof procedures has been the major tool. In this paper, we present a novel and powerful heuristic called $nongshim$ which can be seen as an underlying principle of invertible proof procedures. Using this heuristic, we derive an invertible sequent calculus\cite{Ketonen,Troe} from sequent calculus for propositional logic.


title: Convergence of online $k$-means

abstract: We prove asymptotic convergence for a general class of $k$-means algorithms performed over streaming data from a distribution: the centers asymptotically converge to the set of stationary points of the $k$-means cost function. To do so, we show that online $k$-means over a distribution can be interpreted as stochastic gradient descent with a stochastic learning rate schedule. Then, we prove convergence by extending techniques used in optimization literature to handle settings where center-specific learning rates may depend on the past trajectory of the centers.


title: Viscous-inertial transition in dense granular suspension

abstract: Granular suspensions present a transition from a Newtonian rheology in the Stokes limit to a Bagnoldian rheology when inertia is increased. A custom rheometer which can be run in a pressure or a volume-imposed mode is used to examine this transition in the dense regime close to jamming. By varying systematically the interstitial fluid, shear rate, and packing fraction in volume-imposed measurements, we show that the transition takes place at a Stokes number of 10 independent of the packing fraction. Using pressure-imposed rheometry, we investigate whether the inertial and viscous regimes can be unified as a function of a single dimensionless number based on stress additivity.


title: Local Sliced-Wasserstein Feature Sets for Illumination-invariant Face Recognition

abstract: We present a new method for face recognition from digital images acquired under varying illumination conditions. The method is based on mathematical modeling of local gradient distributions using the Radon Cumulative Distribution Transform (R-CDT). We demonstrate that lighting variations cause certain types of deformations of local image gradient distributions which, when expressed in R-CDT domain, can be modeled as a subspace. Face recognition is then performed using a nearest subspace in R-CDT domain of local gradient distributions. Experiment results demonstrate the proposed method outperforms other alternatives in several face recognition tasks with challenging illumination conditions. Python code implementing the proposed method is available, which is integrated as a part of the software package PyTransKit.


title: Equivariant Graph Hierarchy-Based Neural Networks

abstract: Equivariant Graph neural Networks (EGNs) are powerful in characterizing the dynamics of multi-body physical systems. Existing EGNs conduct flat message passing, which, yet, is unable to capture the spatial/dynamical hierarchy for complex systems particularly, limiting substructure discovery and global information fusion. In this paper, we propose Equivariant Hierarchy-based Graph Networks (EGHNs) which consist of the three key components: generalized Equivariant Matrix Message Passing (EMMP) , E-Pool and E-UpPool. In particular, EMMP is able to improve the expressivity of conventional equivariant message passing, E-Pool assigns the quantities of the low-level nodes into high-level clusters, while E-UpPool leverages the high-level information to update the dynamics of the low-level nodes. As their names imply, both E-Pool and E-UpPool are guaranteed to be equivariant to meet physic symmetry. Considerable experimental evaluations verify the effectiveness of our EGHN on several applications including multi-object dynamics simulation, motion capture, and protein dynamics modeling.


title: Multiview Scattering Scanning Imaging Confocal Microscopy through a Multimode Fiber

abstract: Confocal and multiphoton microscopy are effective techniques to obtain high-contrast images of 2-D sections within bulk tissue. However, scattering limits their application to depths only up to ~1 millimeter. Multimode fibers make excellent ultrathin endoscopes that can penetrate deep inside the tissue with minimal damage. Here, we present Multiview Scattering Scanning Imaging Confocal (MUSSIC) Microscopy that enables high signal-to-noise ratio (SNR) imaging through a multimode fiber, hence combining the optical sectioning and resolution gain of confocal microscopy with the minimally invasive penetration capability of multimode fibers. The key advance presented here is the high SNR image reconstruction enabled by employing multiple coplanar virtual pinholes to capture multiple perspectives of the object, re-shifting them appropriately and combining them to obtain a high-contrast and high-resolution confocal image. We present the theory for the gain in contrast and resolution in MUSSIC microscopy and validate the concept through experimental results.


title: Combining the Silhouette and Skeleton Data for Gait Recognition

abstract: Gait recognition, a long-distance biometric technology, has aroused intense interest recently. Currently, the two dominant gait recognition works are appearance-based and model-based, which extract features from silhouettes and skeletons, respectively. However, appearance-based methods are greatly affected by clothes-changing and carrying conditions, while model-based methods are limited by the accuracy of pose estimation. To tackle this challenge, a simple yet effective two-branch network is proposed in this paper, which contains a CNN-based branch taking silhouettes as input and a GCN-based branch taking skeletons as input. In addition, for better gait representation in the GCN-based branch, we present a fully connected graph convolution operator to integrate multi-scale graph convolutions and alleviate the dependence on natural joint connections. Also, we deploy a multi-dimension attention module named STC-Att to learn spatial, temporal and channel-wise attention simultaneously. The experimental results on CASIA-B and OUMVLP show that our method achieves state-of-the-art performance in various conditions.


title: Photomolecular Effect: Visible Light Absorption at Water-Vapor Interface

abstract: The evaporation of water is ubiquitous in nature and industrial technologies. The known mechanism for evaporation is "thermal evaporation" which highlights the energy input for evaporation is via heat. Due to the weak absorption of water to visible light, the first step to using solar energy to evaporate water is usually by converting it into thermal energy through photothermal processes via additional absorbing materials. Contrary to this conventional wisdom, we report here strong absorption of photons in the visible spectrum at the water-vapor interface by direct cleavage of water clusters via a process we call photomolecular effect. We show that this process happens at the water-vapor interface by measuring the dependence of the photomolecular evaporation rate on the wavelength, the angle of incidence, and the polarization of the incident light. The spectra signatures in the vapor phase further support the photomolecular effect. Despite the long propagation lengths of visible light in bulk water, we demonstrate that they can heat a thin layer of fog easily, suggesting that this process is ubiquitous. The photomolecular effect will have significant implications for the earth's water cycle, global warming, plant transpiration, as well as different technologies involving the evaporation of liquids from drying to power generation

categories: physics.atm-clus cond-mat.mes-hall physics.flu-dyn physics.optics


title: Efficient numerical algorithm for multi-level ionization of high-atomic-number gases

abstract: An efficient numerical algorithm for the laser driven multi-level ionization of high-atomic-number gases is proposed and implemented in an electromagnetic particle-in-cell code SPACE. The algorithm is based on analytical solutions to the system of differential equations describing ionization evolution. Using analytical solutions resolves the multiscale issue of ionization due to different characteristic time scales of ionization processes and the main code time step. Algorithm efficiency is improved by using a locally-reduced system of differential equations. The effects of the orbital quantum numbers and their projections have been examined. The algorithm is applied to the study of ionization injection of electrons into laser-driven plasma wakefields.


title: Overcoming Van der Waals Forces in reconfigurable nanostructures

abstract: Reconfigurable metamaterials require constituent nanostructures to demonstrate switching of shapes with external stimuli. For generality, such nanostructures would touch and stick to other surfaces in one of its configurations. Yet, a longstanding challenge is in overcoming this stiction caused by Van der Waals forces, which impedes shape recovery. Here, we introduce a stiff yet self-recovering material system based on acrylic acid, and tested it in high-aspect ratio structures, where recovery is weak. This designer material has a storage modulus of ~5.2 GPa at room temperature and ~90 MPa in the rubbery state at 150 Celsius, an order of magnitude higher than previous reports. A high-resolution resin for two-photon lithography was developed based on this polymer system, enabling 3D printing of nanopillars with diameters of ~400 nm and aspect ratio as high as ~10. Experimentally, we observed self-recovery as collapsed and touching structures overcome stiction to stand back up. We developed a theoretical model to explain the recoverability of these sub-micron structures. Reconfigurable structural colour prints and holograms were demonstrated, indicating potential applications of the material system as a shape memory polymer suitable for sub-micron reconfigurable metamaterials.


title: On Local Distributions in Graph Signal Processing

abstract: Graph filtering is the cornerstone operation in graph signal processing (GSP). Thus, understanding it is key in developing potent GSP methods. Graph filters are local and distributed linear operations, whose output depends only on the local neighborhood of each node. Moreover, a graph filter's output can be computed separately at each node by carrying out repeated exchanges with immediate neighbors. Graph filters can be compactly written as polynomials of a graph shift operator (typically, a sparse matrix description of the graph). This has led to relating the properties of the filters with the spectral properties of the corresponding matrix -- which encodes global structure of the graph. In this work, we propose a framework that relies solely on the local distribution of the neighborhoods of a graph. The crux of this approach is to describe graphs and graph signals in terms of a measurable space of rooted balls. Leveraging this, we are able to seamlessly compare graphs of different sizes and coming from different models, yielding results on the convergence of spectral densities, transferability of filters across arbitrary graphs, and continuity of graph signal properties with respect to the distribution of local substructures.


title: Movies2Scenes: Using Movie Metadata to Learn Scene Representation

abstract: Understanding scenes in movies is crucial for a variety of applications such as video moderation, search, and recommendation. However, labeling individual scenes is a time-consuming process. In contrast, movie level metadata (e.g., genre, synopsis, etc.) regularly gets produced as part of the film production process, and is therefore significantly more commonly available. In this work, we propose a novel contrastive learning approach that uses movie metadata to learn a general-purpose scene representation. Specifically, we use movie metadata to define a measure of movie similarity, and use it during contrastive learning to limit our search for positive scene-pairs to only the movies that are considered similar to each other. Our learned scene representation consistently outperforms existing state-of-the-art methods on a diverse set of tasks evaluated using multiple benchmark datasets. Notably, our learned representation offers an average improvement of 7.9% on the seven classification tasks and 9.7% improvement on the two regression tasks in LVU dataset. Furthermore, using a newly collected movie dataset, we present comparative results of our scene representation on a set of video moderation tasks to demonstrate its generalizability on previously less explored tasks.


title: Tail Asymptotics in any direction of the stationary distribution in a two-dimensional discrete-time QBD process

abstract: We consider a discrete-time two-dimensional quasi-birth-and-death process (2d-QBD process for short) $\{(\boldsymbol{X}_n,J_n)\}$ on $\mathbb{Z}_+^2\times S_0$, where $\boldsymbol{X}_n=(X_{1,n},X_{2,n})$ is the level state, $J_n$ the phase state (background state) and $S_0$ a finite set, and study asymptotic properties of the stationary tail distribution. The 2d-QBD process is an extension of usual one-dimensional QBD process. By using the matrix analytic method of the queueing theory and the complex analytic method, we obtain the asymptotic decay rate of the stationary tail distribution in any direction. This result is an extension of the corresponding result for a certain two-dimensional reflecting random work without background processes, obtained by using the large deviation techniques. We also present a condition ensuring the sequence of the stationary probabilities geometrically decays without power terms, asymptotically. Asymptotic properties of the stationary tail distribution in the coordinate directions in a 2d-QBD process have already been studied in the literature. The results of this paper are also important complements to those results.


title: Signature of electromagnetic quantum fluctuations in exciton physics

abstract: Quantum fluctuations of the electromagnetic field are known to produce the atomic Lamb shift. We here reveal their iconic signature in semiconductor physics, through the blue-shift they produce to optically bright excitons, thus lifting the energy of these excitons above their dark counterparts. The electromagnetic field here acts in its full complexity: in addition to the longitudinal part via interband \textit{virtual Coulomb} processes, the transverse part -- which has been missed up to now -- also acts via resonant and nonresonant \textit{virtual photons}. These two parts beautifully combine to produce a bright exciton blue-shift independent of the exciton wave-vector direction. Our work readily leads to a striking prediction: long-lived excitons must have a small bright-dark splitting. Although the analogy between exciton and hydrogen atom could lead us to see the bright exciton shift as a Lamb shift, this is not fully so: the atom shift entirely comes from virtual photons, whereas the Coulomb interaction also contributes to the exciton shift through the so-called "electron-hole exchange".


title: Multiplicative functions commutable with binary quadratic forms $x^2 \pm xy + y^2$

abstract: If a multiplicative function $f$ is commutable with a quadratic form $x^2+xy+y^2$, i.e., \[ f(x^2+xy+y^2) = f(x)^2 + f(x)\,f(y) + f(y)^2, \] then $f$ is the identity function. In other hand, if $f$ is commutable with a quadratic form $x^2-xy+y^2$, then $f$ is one of three kinds of functions: the identity function, the constant function, and an indicator function for $\mathbb{N}\setminus p\mathbb{N}$ with a prime $p$.


title: M2-branes and $\mathfrak{q}$-Painlev\'e equations

abstract: In this paper we investigate a novel connection between the effective theory of M2-branes on $(\mathbb{C}^2/\mathbb{Z}_2\times \mathbb{C}^2/\mathbb{Z}_2)/\mathbb{Z}_k$ and the $\mathfrak{q}$-deformed Painlev\'e equations, by proposing that the grand canonical partition function of the corresponding four-nodes circular quiver $\mathcal{N}=4$ Chern-Simons matter theory solves the $\mathfrak{q}$-Painlev\'e VI equation. We analyse how this describes the moduli space of the topological string on local $\text{dP}_5$ and, via geometric engineering, five dimensional $N_f=4$ $\text{SU}(2)$ $\mathcal{N}=1$ gauge theory on a circle. The results we find extend the known relation between ABJM theory, $\mathfrak{q}$-Painlev\'e $\text{III}_3$, and topological strings on local ${\mathbb P}^1\times{\mathbb P}^1$. From the mathematical viewpoint the quiver Chern-Simons theory provides a conjectural Fredholm determinant realisation of the $\mathfrak{q}$-Painlev\'e VI $\tau$-function. We provide evidence for this proposal by analytic and numerical checks and discuss in detail the successive decoupling limits down to $N_f=0$, corresponding to $\mathfrak{q}$-Painlev\'e$\,\,$III${}_3$.


title: Shape-Haptics: Planar & Passive Force Feedback Mechanisms for Physical Interfaces

abstract: We present Shape-Haptics, an approach for designers to rapidly design and fabricate passive force feedback mechanisms for physical interfaces. Such mechanisms are used in everyday interfaces and tools, and they are challenging to design. Shape-Haptics abstracts and broadens the haptic expression of this class of force feedback systems through 2D laser cut configurations that are simple to fabricate. They leverage the properties of polyoxymethylene plastic and comprise a compliant spring structure that engages with a sliding profile during tangible interaction. By shaping the sliding profile, designers can easily customize the haptic force feedback delivered by the mechanism. We provide a computational design sandbox to facilitate designers to explore and fabricate Shape-Haptics mechanisms. We also propose a series of applications that demonstrate the utility of Shape-Haptics in creating and customizing haptics for different physical interfaces.


title: Giant spin torque efficiency in naturally oxidized polycrystalline TaAs thin films

abstract: We report the measurement of efficient charge-to-spin conversion at room temperature in Weyl semimetal/ferromagnet heterostructures with both oxidized and pristine interfaces. Polycrystalline films of the Weyl semimetal, TaAs, are grown by molecular beam epitaxy on (001) GaAs and interfaced with a metallic ferromagnet (Ni$_{0.8}$Fe$_{0.2}$). Spin torque ferromagnetic resonance (ST-FMR) measurements in samples with an oxidized interface yield a spin torque efficiency as large as $\xi_{\mathrm{FMR}}=0.45\pm 0.25$ for a 8 nm Ni$_{0.8}$Fe$_{0.2}$ layer thickness. By studying ST-FMR in these samples with varying Ni$_{0.8}$Fe$_{0.2}$ layer thickness, we extract a damping-like torque efficiency as high as $\xi_{\mathrm{DL}}=1.36\pm 0.66$. In samples with a pristine (unoxidized) interface, the spin torque efficiency has opposite sign to that observed in oxidized samples ($\xi_{\mathrm{FMR}}=-0.27\pm 0.14$ for a 5 nm Ni$_{0.8}$Fe$_{0.2}$ layer thickness). We also find a lower bound on the spin Hall conductivity ($424 \pm 110 \frac{\hbar}{e}$ S/cm) which is surprisingly consistent with theoretical predictions for the single crystal Weyl semimetal state of TaAs.


title: Hidden spatiotemporal sequence in transition to shear band in amorphous solids

abstract: Shear banding is a fundamental non-equilibrium phenomenon in amorphous solids. Due to the intrinsic entangling of three local atomic motions: shear, dilatation and rotation, the precise physical process of shear band emergence is still an enigma. To unveil this mystery, we formulate for the first time a theoretical protocol covering both affine and non-affine components of deformation, to decode these highly entangled local atomic-scale events. In contrast to the broad concept of shear transformation zone, plastic behavior can be demonstrated comprehensively as the operative manipulation of more exact shear-dominated zones (SDZs), dilatation-dominated zones (DDZs) and rotation-dominated zones (RDZs). Their spatiotemporal evolution exhibits a novel transition from synchronous motion to separate distribution at the onset of shear band, which is in striking resemblance with the transition from laminar flow to turbulent flow in flow dynamics. The hidden mechanism is revealed with the help of extreme value theory (EVT) and percolation analysis. Analysis of EVT indicates dilatation is the dominant mode at the embryo of initial plastic units. The percolation analysis points towards the critical power-law scaling nature at the transition from stochastic activation to percolation of plastic regions. Then the comprehensive pictures of shear banding emergence are uncovered. Firstly, dilatation triggers initial shear and rotation in soft regions, leading to embryo of flow units, which is followed by the inhomogeneous turbulent-like pattern manifesting as the secondary activation of rotation in neighboring hard material. Such rotation activation contributes to further perturbation, and ultimately, leads to shear band formation. Our findings also reinforce that the discussion of plastic behavior in disordered materials must take into account both affine and non-affine component deformation.


title: Decentralized Safe Multi-agent Stochastic Optimal Control using Deep FBSDEs and ADMM

abstract: In this work, we propose a novel safe and scalable decentralized solution for multi-agent control in the presence of stochastic disturbances. Safety is mathematically encoded using stochastic control barrier functions and safe controls are computed by solving quadratic programs. Decentralization is achieved by augmenting to each agent's optimization variables, copy variables, for its neighbors. This allows us to decouple the centralized multi-agent optimization problem. However, to ensure safety, neighboring agents must agree on "what is safe for both of us" and this creates a need for consensus. To enable safe consensus solutions, we incorporate an ADMM-based approach. Specifically, we propose a Merged CADMM-OSQP implicit neural network layer, that solves a mini-batch of both, local quadratic programs as well as the overall consensus problem, as a single optimization problem. This layer is embedded within a Deep FBSDEs network architecture at every time step, to facilitate end-to-end differentiable, safe and decentralized stochastic optimal control. The efficacy of the proposed approach is demonstrated on several challenging multi-robot tasks in simulation. By imposing requirements on safety specified by collision avoidance constraints, the safe operation of all agents is ensured during the entire training process. We also demonstrate superior scalability in terms of computational and memory savings as compared to a centralized approach.


title: ABAW: Valence-Arousal Estimation, Expression Recognition, Action Unit Detection & Multi-Task Learning Challenges

abstract: This paper describes the third Affective Behavior Analysis in-the-wild (ABAW) Competition, held in conjunction with IEEE International Conference on Computer Vision and Pattern Recognition (CVPR), 2022. The 3rd ABAW Competition is a continuation of the Competitions held at ICCV 2021, IEEE FG 2020 and IEEE CVPR 2017 Conferences, and aims at automatically analyzing affect. This year the Competition encompasses four Challenges: i) uni-task Valence-Arousal Estimation, ii) uni-task Expression Classification, iii) uni-task Action Unit Detection, and iv) Multi-Task-Learning. All the Challenges are based on a common benchmark database, Aff-Wild2, which is a large scale in-the-wild database and the first one to be annotated in terms of valence-arousal, expressions and action units. In this paper, we present the four Challenges, with the utilized Competition corpora, we outline the evaluation metrics and present the baseline systems along with their obtained results.


title: Batched Dueling Bandits

abstract: The $K$-armed dueling bandit problem, where the feedback is in the form of noisy pairwise comparisons, has been widely studied. Previous works have only focused on the sequential setting where the policy adapts after every comparison. However, in many applications such as search ranking and recommendation systems, it is preferable to perform comparisons in a limited number of parallel batches. We study the batched $K$-armed dueling bandit problem under two standard settings: (i) existence of a Condorcet winner, and (ii) strong stochastic transitivity and stochastic triangle inequality. For both settings, we obtain algorithms with a smooth trade-off between the number of batches and regret. Our regret bounds match the best known sequential regret bounds (up to poly-logarithmic factors), using only a logarithmic number of batches. We complement our regret analysis with a nearly-matching lower bound. Finally, we also validate our theoretical results via experiments on synthetic and real data.


title: A simple analytic example of the gravitational wave memory effect

abstract: We report an analytical example of the gravitational wave memory effect in exact plane wave spacetimes. A square pulse profile is chosen which gives rise to a curved wave region sandwiched between two flat Minkowski spacetimes. Working in the Brinkmann coordinate system, we solve the geodesic equations exactly in all three regions. Issues related to the continuity and differentiability of the solutions at the boundaries of the pulse are addressed. The evolution of the geodesic separation reveals displacement and velocity memory effects with quantitative estimates depending on initial values and the amplitude, width of the pulse. The deformation caused by the pulse on a ring of particles is then examined in detail. Formation of caustics is found in both scenarios i.e. evolution of separation for a pair of geodesics and shape deformation of a ring of particles -- a feature consistent with previous work on geodesic congruences in this spacetime. In summary, our analysis provides a useful illustration of memory effects involving closed-form exact expressions.


title: Random Graph Matching in Geometric Models: the Case of Complete Graphs

abstract: This paper studies the problem of matching two complete graphs with edge weights correlated through latent geometries, extending a recent line of research on random graph matching with independent edge weights to geometric models. Specifically, given a random permutation $\pi^*$ on $[n]$ and $n$ iid pairs of correlated Gaussian vectors $\{X_{\pi^*(i)}, Y_i\}$ in $\mathbb{R}^d$ with noise parameter $\sigma$, the edge weights are given by $A_{ij}=\kappa(X_i,X_j)$ and $B_{ij}=\kappa(Y_i,Y_j)$ for some link function $\kappa$. The goal is to recover the hidden vertex correspondence $\pi^*$ based on the observation of $A$ and $B$. We focus on the dot-product model with $\kappa(x,y)=\langle x, y \rangle$ and Euclidean distance model with $\kappa(x,y)=\|x-y\|^2$, in the low-dimensional regime of $d=o(\log n)$ wherein the underlying geometric structures are most evident. We derive an approximate maximum likelihood estimator, which provably achieves, with high probability, perfect recovery of $\pi^*$ when $\sigma=o(n^{-2/d})$ and almost perfect recovery with a vanishing fraction of errors when $\sigma=o(n^{-1/d})$. Furthermore, these conditions are shown to be information-theoretically optimal even when the latent coordinates $\{X_i\}$ and $\{Y_i\}$ are observed, complementing the recent results of [DCK19] and [KNW22] in geometric models of the planted bipartite matching problem. As a side discovery, we show that the celebrated spectral algorithm of [Ume88] emerges as a further approximation to the maximum likelihood in the geometric model.


title: The Open Problem of Finding a General Classification of Geodetic Graphs

abstract: This note describes some open problems that can be examined with the purpose of gaining additional insight of how to solve the problem of finding a general classification of geodetic graphs


title: Detailed magneto-heat capacity analysis of SnAs topological superconductor

abstract: In this article, we report magneto-heat capacity analysis of superconducting SnAs, which is characterized through X-ray diffraction (XRD), X-ray photoelectron spectroscopy (XPS), and magneto-transport measurements. The studied SnAs superconductor evidenced the presence of superconductivity at around 4K, and the same is seen to persist up to an applied field of 250Oe. The bulk nature of superconductivity is determined through AC susceptibility along with heat capacity measurements. Magneto-heat capacity measurements show SnAs to be a fully gapped s wave superconductor. This finding is well supported by calculated superconducting physical parameters. Further, the calculation of the residual Sommerfeld coefficient at different fields confirms node-less superconductivity in SnAs.


title: Partial Identification with Noisy Covariates: A Robust Optimization Approach

abstract: Causal inference from observational datasets often relies on measuring and adjusting for covariates. In practice, measurements of the covariates can often be noisy and/or biased, or only measurements of their proxies may be available. Directly adjusting for these imperfect measurements of the covariates can lead to biased causal estimates. Moreover, without additional assumptions, the causal effects are not point-identifiable due to the noise in these measurements. To this end, we study the partial identification of causal effects given noisy covariates, under a user-specified assumption on the noise level. The key observation is that we can formulate the identification of the average treatment effects (ATE) as a robust optimization problem. This formulation leads to an efficient robust optimization algorithm that bounds the ATE with noisy covariates. We show that this robust optimization approach can extend a wide range of causal adjustment methods to perform partial identification, including backdoor adjustment, inverse propensity score weighting, double machine learning, and front door adjustment. Across synthetic and real datasets, we find that this approach provides ATE bounds with a higher coverage probability than existing methods.


title: ClF diatomic molecule: rovibrational spectra

abstract: Following the first principles the analytic Born-Oppenheimer (BO) potential curve for the ground state $X^1\Sigma^+$ of the molecule ClF is proposed for whole range of internuclear distances $R \in [0,\infty)$. It is based on matching the perturbation theory at small internuclear distances $R$ and multipole expansion at large distances $R$, it has the form of two-point Pade approximant and provides 3-4 figures in rovibrational energies. It supports 5719 rovibrational states with maximal vibrational number $\nu_{max} = 47$ and maximal angular momentum $L_{max} = 210$ including 36 weakly-bound states close to threshold (to dissociation limit) with the energies $\lesssim 10^{-4}$ Hartree. The van der Waals constant $C^{(ClF)}_6\ \sim\ 29.3$ a.u. is predicted.


title: Visually Grounded Task and Motion Planning for Mobile Manipulation

abstract: Task and motion planning (TAMP) algorithms aim to help robots achieve task-level goals, while maintaining motion-level feasibility. This paper focuses on TAMP domains that involve robot behaviors that take extended periods of time (e.g., long-distance navigation). In this paper, we develop a visual grounding approach to help robots probabilistically evaluate action feasibility, and introduce a TAMP algorithm, called GROP, that optimizes both feasibility and efficiency. We have collected a dataset that includes 96,000 simulated trials of a robot conducting mobile manipulation tasks, and then used the dataset to learn to ground symbolic spatial relationships for action feasibility evaluation. Compared with competitive TAMP baselines, GROP exhibited a higher task-completion rate while maintaining lower or comparable action costs. In addition to these extensive experiments in simulation, GROP is fully implemented and tested on a real robot system.


title: Automatically Generating Counterfactuals for Relation Classification

abstract: The goal of relation classification (RC) is to extract the semantic relations between/among entities in the text. As a fundamental task in natural language processing, it is crucial to ensure the robustness of RC models. Despite the high accuracy current deep neural models have achieved in RC tasks, they are easily affected by spurious correlations. One solution to this problem is to train the model with counterfactually augmented data (CAD) such that it can learn the causation rather than the confounding. However, no attempt has been made on generating counterfactuals for RC tasks. In this paper, we formulate the problem of automatically generating CAD for RC tasks from an entity-centric viewpoint, and develop a novel approach to derive contextual counterfactuals for entities. Specifically, we exploit two elementary topological properties, i.e., the centrality and the shortest path, in syntactic and semantic dependency graphs, to first identify and then intervene on the contextual causal features for entities. We conduct a comprehensive evaluation on four RC datasets by combining our proposed approach with a variety of backbone RC models. The results demonstrate that our approach not only improves the performance of the backbones, but also makes them more robust in the out-of-domain test.


title: On Uncertainty Estimation by Tree-based Surrogate Models in Sequential Model-based Optimization

abstract: Sequential model-based optimization sequentially selects a candidate point by constructing a surrogate model with the history of evaluations, to solve a black-box optimization problem. Gaussian process (GP) regression is a popular choice as a surrogate model, because of its capability of calculating prediction uncertainty analytically. On the other hand, an ensemble of randomized trees is another option and has practical merits over GPs due to its scalability and easiness of handling continuous/discrete mixed variables. In this paper we revisit various ensembles of randomized trees to investigate their behavior in the perspective of prediction uncertainty estimation. Then, we propose a new way of constructing an ensemble of randomized trees, referred to as BwO forest, where bagging with oversampling is employed to construct bootstrapped samples that are used to build randomized trees with random splitting. Experimental results demonstrate the validity and good performance of BwO forest over existing tree-based models in various circumstances.


title: From Optimization Dynamics to Generalization Bounds via {\L}ojasiewicz Gradient Inequality

abstract: Optimization and generalization are two essential aspects of statistical machine learning. In this paper, we propose a framework to connect optimization with generalization by analyzing the generalization error based on the optimization trajectory under the gradient flow algorithm. The key ingredient of this framework is the Uniform-LGI, a property that is generally satisfied when training machine learning models. Leveraging the Uniform-LGI, we first derive convergence rates for gradient flow algorithm, then we give generalization bounds for a large class of machine learning models. We further apply our framework to three distinct machine learning models: linear regression, kernel regression, and two-layer neural networks. Through our approach, we obtain generalization estimates that match or extend previous results.


title: Fast Eye Detector Using Siamese Network for NIR Partial Face Images

abstract: This paper proposes a fast eye detection method that is based on a Siamese network for near infrared (NIR) partial face images. NIR partial face images do not include the whole face of a subject since they are captured using iris recognition systems with the constraint of frame rate and resolution. The iris recognition systems such as the iris on the move (IOTM) system require fast and accurate eye detection as a pre-process. Our goal is to design eye detection with high speed, high discrimination performance between left and right eyes, and high positional accuracy of eye center. Our method adopts a Siamese network and coarse to fine position estimation with a fast lightweight CNN backbone. The network outputs features of images and the similarity map indicating coarse position of an eye. A regression on a portion of a feature with high similarity refines the coarse position of the eye to obtain the fine position with high accuracy. We demonstrate the effectiveness of the proposed method by comparing it with conventional methods, including SOTA, in terms of the positional accuracy, the discrimination performance, and the processing speed. Our method achieves superior performance in speed.


title: Contrastive-mixup learning for improved speaker verification

abstract: This paper proposes a novel formulation of prototypical loss with mixup for speaker verification. Mixup is a simple yet efficient data augmentation technique that fabricates a weighted combination of random data point and label pairs for deep neural network training. Mixup has attracted increasing attention due to its ability to improve robustness and generalization of deep neural networks. Although mixup has shown success in diverse domains, most applications have centered around closed-set classification tasks. In this work, we propose contrastive-mixup, a novel augmentation strategy that learns distinguishing representations based on a distance metric. During training, mixup operations generate convex interpolations of both inputs and virtual labels. Moreover, we have reformulated the prototypical loss function such that mixup is enabled on metric learning objectives. To demonstrate its generalization given limited training data, we conduct experiments by varying the number of available utterances from each speaker in the VoxCeleb database. Experimental results show that applying contrastive-mixup outperforms the existing baseline, reducing error rate by 16% relatively, especially when the number of training utterances per speaker is limited.


title: Seeing is Living? Rethinking the Security of Facial Liveness Verification in the Deepfake Era

abstract: Facial Liveness Verification (FLV) is widely used for identity authentication in many security-sensitive domains and offered as Platform-as-a-Service (PaaS) by leading cloud vendors. Yet, with the rapid advances in synthetic media techniques (e.g., deepfake), the security of FLV is facing unprecedented challenges, about which little is known thus far. To bridge this gap, in this paper, we conduct the first systematic study on the security of FLV in real-world settings. Specifically, we present LiveBugger, a new deepfake-powered attack framework that enables customizable, automated security evaluation of FLV. Leveraging LiveBugger, we perform a comprehensive empirical assessment of representative FLV platforms, leading to a set of interesting findings. For instance, most FLV APIs do not use anti-deepfake detection; even for those with such defenses, their effectiveness is concerning (e.g., it may detect high-quality synthesized videos but fail to detect low-quality ones). We then conduct an in-depth analysis of the factors impacting the attack performance of LiveBugger: a) the bias (e.g., gender or race) in FLV can be exploited to select victims; b) adversarial training makes deepfake more effective to bypass FLV; c) the input quality has a varying influence on different deepfake techniques to bypass FLV. Based on these findings, we propose a customized, two-stage approach that can boost the attack success rate by up to 70%. Further, we run proof-of-concept attacks on several representative applications of FLV (i.e., the clients of FLV APIs) to illustrate the practical implications: due to the vulnerability of the APIs, many downstream applications are vulnerable to deepfake. Finally, we discuss potential countermeasures to improve the security of FLV. Our findings have been confirmed by the corresponding vendors.


title: Extending structures for Gel'fand-Dorfman bialgebras

abstract: Gel'fand-Dorfman bialgebra, which is both a Lie algebra and a Novikov algebra with some compatibility condition, appears in the study of Hamiltonian pairs in completely integrable systems and a class of special Lie conformal algebras called quadratic Lie conformal algebras. In this paper, we investigate the extending structures problem for Gel'fand-Dorfman bialgebras, which is equivalent to some extending structures problem of quadratic Lie conformal algebras. Explicitly, given a Gel'fand-Dorfman bialgebra $(A, \circ, [\cdot,\cdot])$, this problem asks that how to describe and classify all Gel'fand-Dorfman bialgebraic structures on a vector space $E$ $(A\subset E$) such that $(A, \circ, [\cdot,\cdot])$ is a subalgebra of $E$ up to an isomorphism whose restriction on $A$ is the identity map. Motivated by the theories of extending structures for Lie algebras and Novikov algebras, we construct an object $\mathcal{GH}^2(V,A)$ to answer the extending structures problem by introducing a definition of unified product for Gel'fand-Dorfman bialgebras, where $V$ is a complement of $A$ in $E$. In particular, we investigate the special case when $\text{dim}(V)=1$ in detail.