title: Combinatorial Mori-Zwanzig Theory

abstract: We introduce a combinatorial version Mori-Zwanzig theory and develop from it a family of self-consistent evolution equations for the correlation function or Green's function of interactive many-body systems. The core idea is to use an ansatz to rewrite the memory kernel (self-energy) of the regular Mori-Zwanzig equation as a function composition of the correlation (Green's) function. Then a series of algebraic combinatorial tools, especially the commutative and noncommutative Bell polynomials, are used to determine the exact Taylor series expansion of the composition function. The resulting combinatorial Mori-Zwanzig equation (CMZE) yields novel non-perturbative expansions of the equation of motion for the correlation (Green's) function. The structural equation for deriving such a combinatorial expansion resembles the combinatorial Dyson-Schwinger equation and may be viewed as its temporal-domain analogue. After introducing the abstract word and tree representation of the CMZE, we show its wide-range application in classical, stochastic, and quantum many-body systems. In all these examples, the new self-consistent expansions we obtained with the CMZE are similar to the diagrammatic skeleton expansions used in quantum many-body theory and lattice statistical field theory. We expect such a new framework can be used to calculate the correlation (Green's) function for strongly correlated/interactive many-body systems.

categories: math-ph cond-mat.stat-mech cond-mat.str-el math.CO math.MP


title: Building blocks of non-Euclidean ribbons: Size-controlled self-assembly via discrete, frustrated particles

abstract: Geometric frustration offers a pathway to soft matter self-assembly with controllable finite sizes. While the understanding of frustration in soft matter assembly derives almost exclusively from continuum elastic descriptions, a current challenge is to understand the connection between microscopic physical properties of misfitting ``building blocks" and emergent assembly behavior at mesoscale. We present and analyze a particle-based description of what is arguably the best studied example for frustrated soft matter assembly, negative-curvature ribbon assembly, observed in both assemblies of chiral surfactants and shape-frustrated nanoparticles. Based on our particle model, known as {\it saddle wedge monomers}, we numerically test the connection between microscopic shape and interactions of the misfitting subunits and the emergent behavior at the supra-particle scale, specifically focusing on the propagation and relaxation of inter-particle strains, the emergent role of extrinsic shape on frustrated ribbons and the equilibrium regime of finite width selection. Beyond the intuitive role of shape misfit, we show that self-limitation is critically dependent on the finite range of cohesive interactions, with larger size finite assemblies requiring increasing short-range interparticle forces. Additionally, we demonstrate that non-linearities arising from discrete particle interactions alter self-limiting behavior due to both strain-softening in shape-flattened assembly and partial yielding of highly strained bonds, which in turn may give rise to states of hierarchical, multidomain assembly. Tracing the regimes of frustration-limited assembly to the specific microscopic features of misfitting particle shapes and interactions provides necessary guidance for translating the theory of size-programmable assembly into design of intentionally-frustrated colloidal particles.


title: Taxonomy of A Decision Support System for Adaptive Experimental Design in Field Robotics

abstract: Experimental design in field robotics is an adaptive human-in-the-loop decision-making process in which an experimenter learns about system performance and limitations through interactions with a robot in the form of constructed experiments. This can be challenging because of system complexity, the need to operate in unstructured environments, and the competing objectives of maximizing information gain while simultaneously minimizing experimental costs. Based on the successes in other domains, we propose the use of a Decision Support System (DSS) to amplify the human's decision-making abilities, overcome their inherent shortcomings, and enable principled decision-making in field experiments. In this work, we propose common terminology and a six-stage taxonomy of DSSs specifically for adaptive experimental design of more informative tests and reduced experimental costs. We construct and present our taxonomy using examples and trends from DSS literature, including works involving artificial intelligence and Intelligent DSSs. Finally, we identify critical technical gaps and opportunities for future research to direct the scientific community in the pursuit of next-generation DSSs for experimental design.


title: SPIDR: SDF-based Neural Point Fields for Illumination and Deformation

abstract: Neural radiance fields (NeRFs) have recently emerged as a promising approach for 3D reconstruction and novel view synthesis. However, NeRF-based methods encode shape, reflectance, and illumination implicitly and this makes it challenging for users to manipulate these properties in the rendered images explicitly. Existing approaches only enable limited editing of the scene and deformation of the geometry. Furthermore, no existing work enables accurate scene illumination after object deformation. In this work, we introduce SPIDR, a new hybrid neural SDF representation. SPIDR combines point cloud and neural implicit representations to enable the reconstruction of higher quality object surfaces for geometry deformation and lighting estimation. meshes and surfaces for object deformation and lighting estimation. To more accurately capture environment illumination for scene relighting, we propose a novel neural implicit model to learn environment light. To enable more accurate illumination updates after deformation, we use the shadow mapping technique to approximate the light visibility updates caused by geometry editing. We demonstrate the effectiveness of SPIDR in enabling high quality geometry editing with more accurate updates to the illumination of the scene.


title: Tensor-Train Compression of Discrete Element Method Simulation Data

abstract: We propose a framework for discrete scientific data compression based on the tensor-train (TT) decomposition. Our approach is tailored to handle unstructured output data from discrete element method (DEM) simulations, demonstrating its effectiveness in compressing both raw (e.g. particle position and velocity) and derived (e.g. stress and strain) datasets. We show that geometry-driven "tensorization" coupled with the TT decomposition (known as quantized TT) yields a hierarchical compression scheme, achieving high compression ratios for key variables in these DEM datasets.


title: A Multilevel Reinforcement Learning Framework for PDE-based Control

abstract: Reinforcement learning (RL) is a promising method to solve control problems. However, model-free RL algorithms are sample inefficient and require thousands if not millions of samples to learn optimal control policies. A major source of computational cost in RL corresponds to the transition function, which is dictated by the model dynamics. This is especially problematic when model dynamics is represented with coupled PDEs. In such cases, the transition function often involves solving a large-scale discretization of the said PDEs. We propose a multilevel RL framework in order to ease this cost by exploiting sublevel models that correspond to coarser scale discretization (i.e. multilevel models). This is done by formulating an approximate multilevel Monte Carlo estimate of the objective function of the policy and / or value network instead of Monte Carlo estimates, as done in the classical framework. As a demonstration of this framework, we present a multilevel version of the proximal policy optimization (PPO) algorithm. Here, the level refers to the grid fidelity of the chosen simulation-based environment. We provide two examples of simulation-based environments that employ stochastic PDEs that are solved using finite-volume discretization. For the case studies presented, we observed substantial computational savings using multilevel PPO compared to its classical counterpart.


title: Probing the Structure and Evolution of BASS AGN through Eddington Ratios

abstract: We constrain the intrinsic Eddington ratio (\lamEdd ) distribution function for local AGN in bins of low and high obscuration (log NH <= 22 and 22 < log NH < 25), using the Swift-BAT 70-month/BASS DR2 survey. We interpret the fraction of obscured AGN in terms of circum-nuclear geometry and temporal evolution. Specifically, at low Eddington ratios (log lamEdd < -2), obscured AGN outnumber unobscured ones by a factor of ~4, reflecting the covering factor of the circum-nuclear material (0.8, or a torus opening angle of ~ 34 degrees). At high Eddington ratios (\log lamEdd > -1), the trend is reversed, with < 30% of AGN having log NH > 22, which we suggest is mainly due to the small fraction of time spent in a highly obscured state. Considering the Eddington ratio distribution function of narrow-line and broad-line AGN from our prior work, we see a qualitatively similar picture. To disentangle temporal and geometric effects at high lamEdd, we explore plausible clearing scenarios such that the time-weighted covering factors agree with the observed population ratio. We find that the low fraction of obscured AGN at high lamEdd is primarily due to the fact that the covering factor drops very rapidly, with more than half the time is spent with < 10% covering factor. We also find that nearly all obscured AGN at high-lamEdd exhibit some broad-lines. We suggest that this is because the height of the depleted torus falls below the height of the broad-line region, making the latter visible from all lines of sight.


title: LAION-5B: An open large-scale dataset for training next generation image-text models

abstract: Groundbreaking language-vision architectures like CLIP and DALL-E proved the utility of training on large amounts of noisy image-text data, without relying on expensive accurate labels used in standard vision unimodal supervised learning. The resulting models showed capabilities of strong text-guided image generation and transfer to downstream tasks, while performing remarkably at zero-shot classification with noteworthy out-of-distribution robustness. Since then, large-scale language-vision models like ALIGN, BASIC, GLIDE, Flamingo and Imagen made further improvements. Studying the training and capabilities of such models requires datasets containing billions of image-text pairs. Until now, no datasets of this size have been made openly available for the broader research community. To address this problem and democratize research on large-scale multi-modal models, we present LAION-5B - a dataset consisting of 5.85 billion CLIP-filtered image-text pairs, of which 2.32B contain English language. We show successful replication and fine-tuning of foundational models like CLIP, GLIDE and Stable Diffusion using the dataset, and discuss further experiments enabled with an openly available dataset of this scale. Additionally we provide several nearest neighbor indices, an improved web-interface for dataset exploration and subset generation, and detection scores for watermark, NSFW, and toxic content detection. Announcement page https://laion.ai/laion-5b-a-new-era-of-open-large-scale-multi-modal-datasets/


title: Semantic Segmentation with Active Semi-Supervised Representation Learning

abstract: Obtaining human per-pixel labels for semantic segmentation is incredibly laborious, often making labeled dataset construction prohibitively expensive. Here, we endeavor to overcome this problem with a novel algorithm that combines semi-supervised and active learning, resulting in the ability to train an effective semantic segmentation algorithm with significantly lesser labeled data. To do this, we extend the prior state-of-the-art S4AL algorithm by replacing its mean teacher approach for semi-supervised learning with a self-training approach that improves learning with noisy labels. We further boost the neural network's ability to query useful data by adding a contrastive learning head, which leads to better understanding of the objects in the scene, and hence, better queries for active learning. We evaluate our method on CamVid and CityScapes datasets, the de-facto standards for active learning for semantic segmentation. We achieve more than 95% of the network's performance on CamVid and CityScapes datasets, utilizing only 12.1% and 15.1% of the labeled data, respectively. We also benchmark our method across existing stand-alone semi-supervised learning methods on the CityScapes dataset and achieve superior performance without any bells or whistles.


title: Using Answer Set Programming for HPC Dependency Solving

abstract: Modern scientific software stacks have become extremely complex, using many programming models and libraries to exploit a growing variety of GPUs and accelerators. Package managers can mitigate this complexity using dependency solvers, but they are reaching their limits. Finding compatible dependency versions is NP-complete, and modeling the semantics of package compatibility modulo build-time options, GPU runtimes, flags, and other parameters is extremely difficult. Within this enormous configuration space, defining a "good" configuration is daunting. We tackle this problem using Answer Set Programming (ASP), a declarative model for combinatorial search problems. We show, using the Spack package manager, that ASP programs can concisely express the compatibility rules of HPC software stacks and provide strong quality-of-solution guarantees. Using ASP, we can mix new builds with preinstalled binaries, and solver performance is acceptable even when considering tens of thousands of packages.


title: Non-Transferability in Communication Channels and Tarski's Truth Theorem

abstract: This article aims to study transferability issues in communication channels. The transferability of certain situations is not possible through communication channels. As a result, it is highlighted that a communication channel trying to transmit its error situation is in a non-transferrable state. I argue in this paper that Tarski's Truth Undefinability Theorem and non-transferability in communication channels are equivalent. Due to this new approach, the other aspects of this famous theorem can be expressed more clearly.


title: On the angular anisotropy of the randomly-averaged magnetic neutron scattering cross section of nanoparticles

abstract: We calculate the magnetic SANS cross section of dilute ensembles of uniformly magnetized and randomly-oriented Stoner-Wohlfarth particles using the Landau-Lifshitz equation. The focus of our study is on the angular anisotropy of the magnetic SANS signal as it can be seen on a two-dimensional position-sensitive detector. Depending on the symmetry of the magnetic anisotropy of the particles (e.g. uniaxial, cubic), an anisotropic magnetic SANS pattern may result, even in the demagnetized state or at the coercive field. The case of inhomogeneously magnetized particles and the effects of a particle-size distribution and interparticle correlations are discussed.


title: Heating up Peccei-Quinn scale

abstract: We discuss production of QCD axion dark matter in a novel scenario, which assumes time-varying scale of Peccei-Quinn symmetry breaking. The latter decreases as the Universe's temperature at early times and eventually stabilises at a large constant value. Such behavior is caused by the portal interaction between the complex field carrying Peccei-Quinn charge and a Higgs-like scalar, which is in thermal equilibrium with primordial plasma. In this scenario, axions are efficiently produced during the parametric resonance decay of the complex Peccei-Quinn field, relaxing to the minimum of its potential in the radiation-dominated stage. Notably, this process is not affected by the Universe's expansion rate and allows to generate the required abundance of dark matter independently of an axion mass. Phenomenological constraints on the model parameter space depend on the number density of radial field fluctuations, which are also generically excited along with axions, and the rate of their thermalization in the primordial plasma. For the ratio of radial field and axion particles number densities larger than $\sim 0.01$ at the end of parametric resonance decay, the combination of cosmological and astrophysical observations with the CAST limit confines the Peccei-Quinn scale to a narrow range of values $\sim 10^{8}~\mbox{GeV}$, - this paves the way for ruling out our scenario with the near future searches for axions.


title: Learning-based Motion Planning in Dynamic Environments Using GNNs and Temporal Encoding

abstract: Learning-based methods have shown promising performance for accelerating motion planning, but mostly in the setting of static environments. For the more challenging problem of planning in dynamic environments, such as multi-arm assembly tasks and human-robot interaction, motion planners need to consider the trajectories of the dynamic obstacles and reason about temporal-spatial interactions in very large state spaces. We propose a GNN-based approach that uses temporal encoding and imitation learning with data aggregation for learning both the embeddings and the edge prioritization policies. Experiments show that the proposed methods can significantly accelerate online planning over state-of-the-art complete dynamic planning algorithms. The learned models can often reduce costly collision checking operations by more than 1000x, and thus accelerating planning by up to 95%, while achieving high success rates on hard instances as well.


title: A Framework to Evaluate Independent Component Analysis applied to EEG signal: testing on the Picard algorithm

abstract: Independent component analysis (ICA), is a blind source separation method that is becoming increasingly used to separate brain and non-brain related activities in electroencephalographic (EEG) and other electrophysiological recordings. It can be used to extract effective brain source activities and estimate their cortical source areas, and is commonly used in machine learning applications to classify EEG artifacts. Previously, we compared results of decomposing 13 71-channel scalp EEG datasets using 22 ICA and other blind source separation (BSS) algorithms. We are now making this framework available to the scientific community and, in the process of its release are testing a recent ICA algorithm (Picard) not included in the previous assay. Our test framework uses three main metrics to assess BSS performance: Pairwise Mutual Information (PMI) between scalp channel pairs; PMI remaining between component pairs after decomposition; and, the complete (not pairwise) Mutual Information Reduction (MIR) produced by each algorithm. We also measure the "dipolarity" of the scalp projection maps for the decomposed component, defined by the number of components whose scalp projection maps nearly match the projection of a single equivalent dipole. Within this framework, Picard performed similarly to Infomax ICA. This is not surprising since Picard is a type of Infomax algorithm that uses the L-BFGS method for faster convergence, in contrast to Infomax and Extended Infomax (runica) which use gradient descent. Our results show that Picard performs similarly to Infomax and, likewise, better than other BSS algorithms, excepting the more computationally complex AMICA. We have released the source code of our framework and the test data through GitHub.


title: ELIAS: End-to-End Learning to Index and Search in Large Output Spaces

abstract: Extreme multi-label classification (XMC) is a popular framework for solving many real-world problems that require accurate prediction from a very large number of potential output choices. A popular approach for dealing with the large label space is to arrange the labels into a shallow tree-based index and then learn an ML model to efficiently search this index via beam search. Existing methods initialize the tree index by clustering the label space into a few mutually exclusive clusters based on pre-defined features and keep it fixed throughout the training procedure. This approach results in a sub-optimal indexing structure over the label space and limits the search performance to the quality of choices made during the initialization of the index. In this paper, we propose a novel method ELIAS which relaxes the tree-based index to a specialized weighted graph-based index which is learned end-to-end with the final task objective. More specifically, ELIAS models the discrete cluster-to-label assignments in the existing tree-based index as soft learnable parameters that are learned jointly with the rest of the ML model. ELIAS achieves state-of-the-art performance on several large-scale extreme classification benchmarks with millions of labels. In particular, ELIAS can be up to 2.5% better at precision@1 and up to 4% better at recall@100 than existing XMC methods. A PyTorch implementation of ELIAS along with other resources is available at https://github.com/nilesh2797/ELIAS.


title: Error-correcting codes for fermionic quantum simulation

abstract: Utilizing the framework of $\mathbb{Z}_2$ lattice gauge theories in the context of Pauli stabilizer codes, we present methodologies for simulating fermions via qubit systems on a two-dimensional square lattice. We investigate the symplectic automorphisms of the Pauli module over the Laurent polynomial ring. This enables us to systematically increase the code distances of stabilizer codes while fixing the rate between encoded logical fermions and physical qubits. We identify a family of stabilizer codes suitable for fermion simulation, achieving code distances of $d=2,3,4,5,6,7$, allowing correction of any $\lfloor \frac{d-1}{2} \rfloor$-qubit error. In contrast to the traditional code concatenation approach, our method can increase the code distances without decreasing the (fermionic) code rate. In particular, we explicitly show all stabilizers and logical operators for codes with code distances of $d=3,4,5$. We provide syndromes for all Pauli errors and invent a syndrome-matching algorithm to compute code distances numerically.

categories: quant-ph cond-mat.str-el math-ph math.MP math.QA


title: Towards an Interpretable Hierarchical Agent Framework using Semantic Goals

abstract: Learning to solve long horizon temporally extended tasks with reinforcement learning has been a challenge for several years now. We believe that it is important to leverage both the hierarchical structure of complex tasks and to use expert supervision whenever possible to solve such tasks. This work introduces an interpretable hierarchical agent framework by combining planning and semantic goal directed reinforcement learning. We assume access to certain spatial and haptic predicates and construct a simple and powerful semantic goal space. These semantic goal representations are more interpretable, making expert supervision and intervention easier. They also eliminate the need to write complex, dense reward functions thereby reducing human engineering effort. We evaluate our framework on a robotic block manipulation task and show that it performs better than other methods, including both sparse and dense reward functions. We also suggest some next steps and discuss how this framework makes interaction and collaboration with humans easier.


title: ALMA Observation of a $z\gtrsim10$ Galaxy Candidate Discovered with JWST

abstract: We report the ALMA observation of a $z\gtrsim10$ galaxy candidate (GHZ1) discovered from the GLASS-JWST Early Release Science Program. Our ALMA program aims to detect the [OIII] emission line at the rest-frame 3393.0062 GHz ($88.36\mu$m) and far-IR continuum emission with the spectral window setup seamlessly covering a 26.125 GHz frequency range ($10.10<z<11.14$). A total of 7 hours of on-source integration was employed, using four frequency settings to cover the full range (1.7 hours per setting), with $0''.7$ angular resolution. No line or continuum is clearly detected, with a 5$\sigma$ upper limit of the line emission of 0.93 mJy beam$^{-1}$ at 25 km s$^{-1}$ channel$^{-1}$ and of the continuum emission of 30$\mu$Jy beam$^{-1}$. We report marginal spectral (at 225 km s$^{-1}$ resolution) and continuum features ($4.1\sigma$ and $2.6\sigma$ peak signal-to-noise ratio, respectively), within $0''.17$ from the JWST position of GHZ1. This spectral feature implies $z=10.38$ and needs to be verified with further observations. Assuming that the best photometric redshift estimate ($z=10.60^{+0.52}_{-0.60}$) is correct, the broadband galaxy spectral energy distribution model for the $3\sigma$ upper limit of the continuum flux from GHZ1 suggests that GHZ1 has a small amount of dust ($M_d\lesssim10^4 M_{\odot}$) with high temperature ($T_d\gtrsim90$K). The $5\sigma$ upper limit of the [OIII]$_{88\mu m}$ line luminosity and the inferred star formation rate of GHZ1 is consistent with the properties of the low metallicity dwarf galaxies. We also report serendipitous clear detections of six continuum sources at the locations of the JWST galaxy counterparts in the field.


title: Using Virtual Reality to Simulate Human-Robot Emergency Evacuation Scenarios

abstract: This paper describes our recent effort to use virtual reality to simulate threatening emergency evacuation scenarios in which a robot guides a person to an exit. Our prior work has demonstrated that people will follow a robot's guidance, even when the robot is faulty, during an emergency evacuation. Yet, because physical in-person emergency evacuation experiments are difficult and costly to conduct and because we would like to evaluate many different factors, we are motivated to develop a system that immerses people in the simulation environment to encourage genuine subject reactions. We are working to complete experiments verifying the validity of our approach.


title: Stability of Accuracy for the Training of DNNs Via the Uniform Doubling Condition

abstract: We study the stability of accuracy during the training of deep neural networks (DNNs). In this context, the training of a DNN is performed via the minimization of a cross-entropy loss function, and the performance metric is accuracy (the proportion of objects that are classified correctly). While training results in a decrease of loss, the accuracy does not necessarily increase during the process and may sometimes even decrease. The goal of achieving stability of accuracy is to ensure that if accuracy is high at some initial time, it remains high throughout training. A recent result by Berlyand, Jabin, and Safsten introduces a doubling condition on the training data, which ensures the stability of accuracy during training for DNNs using the absolute value activation function. For training data in $\mathbb{R}^n$, this doubling condition is formulated using slabs in $\mathbb{R}^n$ and depends on the choice of the slabs. The goal of this paper is twofold. First, to make the doubling condition uniform, that is, independent of the choice of slabs. This leads to sufficient conditions for stability in terms of training data only. In other words, for a training set $T$ that satisfies the uniform doubling condition, there exists a family of DNNs such that a DNN from this family with high accuracy on the training set at some training time $t_0$ will have high accuracy for all time $t>t_0$. Moreover, establishing uniformity is necessary for the numerical implementation of the doubling condition. The second goal is to extend the original stability results from the absolute value activation function to a broader class of piecewise linear activation functions with finitely many critical points, such as the popular Leaky ReLU.


title: A special D4-D2-branes configuration on K3 fiberation Calabi-Yau threefolds

abstract: We construct a special D4-D2-brane configuration on the K3 fibered Calabi-Yau threefolds: canonical D4-branes on K3 fiberations and another D2-branes on its base $\mathbb{P}_1$, by using the ordinary nonlinear sigma model in two dimensions. We would derive the exact expression of $Ext$ groups of this construction. By using the Gepner model, we achieve the feasibility of the existence of such a configuration and get more available sheaf's data of this brane system.


title: The Fokas-Lenells equation on the line: Global well-posedness with solitons

abstract: In this paper, we prove the existence of global solutions in $H^3(\mathbb{R})\cap H^{2,1}(\mathbb{R})$ to the Fokas-Lenells (FL) equation on the line when the initial data includes solitons.A key tool in proving this result is a newly modified Darboux transformation, which adds or subtracts a soliton with given spectral and scattering parameters. In this way the inverse scattering transform technique is then applied to establish the global well-posedness of initial value problem with a finite number of solitons based on our previous results on the global well-posedness of the FL equation.


title: VerifyML: Obliviously Checking Model Fairness Resilient to Malicious Model Holder

abstract: In this paper, we present VerifyML, the first secure inference framework to check the fairness degree of a given Machine learning (ML) model. VerifyML is generic and is immune to any obstruction by the malicious model holder during the verification process. We rely on secure two-party computation (2PC) technology to implement VerifyML, and carefully customize a series of optimization methods to boost its performance for both linear and nonlinear layer execution. Specifically, (1) VerifyML allows the vast majority of the overhead to be performed offline, thus meeting the low latency requirements for online inference. (2) To speed up offline preparation, we first design novel homomorphic parallel computing techniques to accelerate the authenticated Beaver's triple (including matrix-vector and convolution triples) generation procedure. It achieves up to $1.7\times$ computation speedup and gains at least $10.7\times$ less communication overhead compared to state-of-the-art work. (3) We also present a new cryptographic protocol to evaluate the activation functions of non-linear layers, which is $4\times$--$42\times$ faster and has $>48\times$ lesser communication than existing 2PC protocol against malicious parties. In fact, VerifyML even beats the state-of-the-art semi-honest ML secure inference system! We provide formal theoretical analysis for VerifyML security and demonstrate its performance superiority on mainstream ML models including ResNet-18 and LeNet.


title: Mass-dependent transport of hadron species from soft to hard (nonjet to jet) spectrum components within small collision systems at the large hadron collider

abstract: In previous analyses a two-component (soft+hard) model (TCM) was developed for identified-hadron (PID) spectra from 5 TeV $p$-Pb and 13 TeV $p$-$p$ collisions. Spectrum data are generally described within their statistical uncertainties. Within the model are coefficients $z_{si}(n_s)$ and $z_{hi}(n_s)$ that denote the fractions of hadron species $i$ within total soft $\bar \rho_s$ and hard $\bar \rho_h$ charge densities and that vary significantly with event index $n_s = \Delta \eta \bar \rho_s$. This letter reports that variation of those coefficients with $n_s$ implies transport of hadron species from soft component to hard component, increasingly with increased jet production, while conserving the total particle number for each species that is predicted by a statistical model. The extent of transport is simply proportional to hadron mass.


title: A convergence time of Grover walk on regular graph to stationary state

abstract: We consider a quantum walk model on a finite graph which has an interaction with the outside. Here a quantum walker from the outside penetrates the graph and also a quantum walker in the graph goes out to the outside at every time step. This dynamics of the quantum walk converges to a stationary state. In this paper, we estimate the speed of the convergence to the stationary state on the $\kappa$-regular graph with the uniformly inserting of the inflow to the graph. We show that larger degree of the regular graph makes the convergence speed of this quantum walk model slower.


title: New Secure Sparse Inner Product with Applications to Machine Learning

abstract: Sparse inner product (SIP) has the attractive property of overhead being dominated by the intersection of inputs between parties, independent of the actual input size. It has intriguing prospects, especially for boosting machine learning on large-scale data, which is tangled with sparse data. In this paper, we investigate privacy-preserving SIP problems that have rarely been explored before. Specifically, we propose two concrete constructs, one requiring offline linear communication which can be amortized across queries, while the other has sublinear overhead but relies on the more computationally expensive tool. Our approach exploits state-of-the-art cryptography tools including garbled Bloom filters (GBF) and Private Information Retrieval (PIR) as the cornerstone, but carefully fuses them to obtain non-trivial overhead reductions. We provide formal security analysis of the proposed constructs and implement them into representative machine learning algorithms including k-nearest neighbors, naive Bayes classification and logistic regression. Compared to the existing efforts, our method achieves $2$-$50\times$ speedup in runtime and up to $10\times$ reduction in communication.


title: Duality in optimal consumption--investment problems with alternative data

abstract: This study investigates an optimal consumption--investment problem in which the unobserved stock trend is modulated by a hidden Markov chain that represents different economic regimes. In the classical approach, the hidden state is estimated from historical asset prices, but recent advancements in technology enable investors to consider alternative data in their decision-making. These include social media commentary, expert opinions, COVID-19 pandemic data, and GPS data, which originate outside of the standard sources of market data but are considered useful for predicting stock trends. We develop a novel duality theory for this problem and consider a jump-diffusion process for the alternative data series. This theory helps investors in identifying ``useful'' alternative data for dynamic decision-making by offering conditions to the filter equation that permit the use of a control approach based on the dynamic programming principle. We demonstrate an application for proving a unique smooth solution for a constant relative risk-averse agent once the distributions of the signals generated from alternative data satisfy a bounded likelihood ratio condition. In doing so, we obtain an explicit consumption--investment strategy that takes advantage of different types of alternative data that have not been addressed in the literature.


title: TransVisDrone: Spatio-Temporal Transformer for Vision-based Drone-to-Drone Detection in Aerial Videos

abstract: Drone-to-drone detection using visual feed has crucial applications, such as detecting drone collisions, detecting drone attacks, or coordinating flight with other drones. However, existing methods are computationally costly, follow non-end-to-end optimization, and have complex multi-stage pipelines, making them less suitable for real-time deployment on edge devices. In this work, we propose a simple yet effective framework, \textit{TransVisDrone}, that provides an end-to-end solution with higher computational efficiency. We utilize CSPDarkNet-53 network to learn object-related spatial features and VideoSwin model to improve drone detection in challenging scenarios by learning spatio-temporal dependencies of drone motion. Our method achieves state-of-the-art performance on three challenging real-world datasets (Average Precision@0.5IOU): NPS 0.95, FLDrones 0.75, and AOT 0.80, and a higher throughput than previous methods. We also demonstrate its deployment capability on edge devices and its usefulness in detecting drone-collision (encounter). Project: \url{https://tusharsangam.github.io/TransVisDrone-project-page/}.


title: A cusp-capturing PINN for elliptic interface problems

abstract: In this paper, we propose a cusp-capturing physics-informed neural network (PINN) to solve discontinuous-coefficient elliptic interface problems whose solution is continuous but has discontinuous first derivatives on the interface. To find such a solution using neural network representation, we introduce a cusp-enforced level set function as an additional feature input to the network to retain the inherent solution properties; that is, capturing the solution cusps (where the derivatives are discontinuous) sharply. In addition, the proposed neural network has the advantage of being mesh-free, so it can easily handle problems in irregular domains. We train the network using the physics-informed framework in which the loss function comprises the residual of the differential equation together with certain interface and boundary conditions. We conduct a series of numerical experiments to demonstrate the effectiveness of the cusp-capturing technique and the accuracy of the present network model. Numerical results show that even using a one-hidden-layer (shallow) network with a moderate number of neurons and sufficient training data points, the present network model can achieve prediction accuracy comparable with traditional methods. Besides, if the solution is discontinuous across the interface, we can simply incorporate an additional supervised learning task for solution jump approximation into the present network without much difficulty.


title: A generalized scalar auxiliary variable method for the time-dependent Ginzburg-Landau equations

abstract: This paper develops a generalized scalar auxiliary variable (SAV) method for the time-dependent Ginzburg-Landau equations. The backward Euler is used for discretizing the temporal derivative of the time-dependent Ginzburg-Landau equations. In this method, the system is decoupled and linearized to avoid solving the non-linear equation at each step. The theoretical analysis proves that the generalized SAV method can preserve the maximum bound principle and energy stability, which is confirmed by the numerical results. It shows that the numerical algorithm is stable.


title: A Geometric(1/2) Distribution Associated with Record Breaking

abstract: Let $X_i,i=0,1,\ldots$ be a sequence of iid random variables whose distribution is continuous. Associated with this sequence is the sequence $(i,X_i),i=0,1,\ldots$. Let ${\cal R}_{n}$ denote the set of Pareto optimal elements of $\{ (i,X_i):i=0,\ldots,n\}.$ We refer to the elements of ${\cal R}_{n}$ as the current records at time $n,$ and we define $R_n=\vert {\cal R}_n\vert,$ the number of such records. Observe that $R_n$ has $\{1,\ldots,n+1\}$ as its support. When $(n,X_n)$ is realized, it is a Pareto optimal element of $\{ (i,X_i)~:~i=0,\ldots,n\}$ and ${\cal R}_{n} \backslash (n,X_n) \subset {\cal R}_{n-1}.$ Then we refer to those elements of ${\cal B}_n = {\cal R}_{n-1} \backslash {\cal R}_{n}$ as the records broken at time $n.$ Let $B_n= \vert {\cal B}_n \vert.$ We show that $$P[B_n = k] \rightarrow 1/2^{k+1} \mbox{ for } k=0,1,2,\ldots.$$


title: Shape Estimation of Continuum Robots via Modal Parameterization and Dual Extended Kalman Filter

abstract: The equilibrium shape of a continuum robot is resulted from both its internal actuation and the external physical interaction with a surrounding environment. A fast and accurate shape estimation method (i) can be used as a feedback to compensate for more accurate motion; and (ii) can reveal rich information about physical interactions (e.g. instrument-anatomy contacts / forces during a surgery). From a prior work that demonstrated an offline calibration of continuum robots, we adopt its shape modal representation and error propagation models that include identification Jacobians. In this work, we present an iterative observer approach to enable online shape estimation. We develop a dual Extended Kalman Filter (EKF) to estimate both the robot state and the shape modal parameters. The dual EKF provides robust estimation on (i) the configuration space variables that are controllable and driven by internal actuation; and (ii) the modal coefficients representing homotopies of shape families that are governed by the physical interactions with the environment. We report results from simulation studies in this work, and plan to investigate methods in the future to use the proposed approach for predicting physical interactions.


title: Global well-posedness of the quantum Boltzmann equation for bosons interacting via inverse power law potentials

abstract: We consider the spatially inhomogeneous quantum Boltzmann equation for bosons with a singular collision kernel, the weak-coupling limit of a large system of Bose-Einstein particles interacting through inverse power law. Global well-posedness of the corresponding Cauchy problem is proved in a periodic box near equilibrium for initial data satisfying high temperature condition.


title: Magnetic damping anisotropy in the two-dimensional van der Waals material Fe$_3$GeTe$_2$ from first principles

abstract: Magnetization relaxation in the two-dimensional itinerant ferromagnetic van der Waals material Fe$_3$GeTe$_2$, below the Curie temperature, is fundamentally important for applications to low-dimensional spintronics devices. We use first-principles scattering theory to calculate the temperature-dependent Gilbert damping for bulk and single-layer Fe$_3$GeTe$_2$. The calculated damping frequency of bulk Fe$_3$GeTe$_2$ increases monotonically with temperature because of the dominance of resistivitylike behavior. By contrast, a very weak temperature dependence is found for the damping frequency of a single layer, which is attributed to strong surface scattering in this highly confined geometry. A systematic study of the damping anisotropy reveals that orientational anisotropy is present in both bulk and single-layer Fe3GeTe2. Rotational anisotropy is significant at low temperatures for both the bulk and a single layer and is gradually diminished by temperature-induced disorder. The rotational anisotropy can be significantly enhanced by up to 430% in gated single-layer Fe$_3$GeTe$_2$.


title: Explainable Causal Analysis of Mental Health on Social Media Data

abstract: With recent developments in Social Computing, Natural Language Processing and Clinical Psychology, the social NLP research community addresses the challenge of automation in mental illness on social media. A recent extension to the problem of multi-class classification of mental health issues is to identify the cause behind the user's intention. However, multi-class causal categorization for mental health issues on social media has a major challenge of wrong prediction due to the overlapping problem of causal explanations. There are two possible mitigation techniques to solve this problem: (i) Inconsistency among causal explanations/ inappropriate human-annotated inferences in the dataset, (ii) in-depth analysis of arguments and stances in self-reported text using discourse analysis. In this research work, we hypothesise that if there exists the inconsistency among F1 scores of different classes, there must be inconsistency among corresponding causal explanations as well. In this task, we fine tune the classifiers and find explanations for multi-class causal categorization of mental illness on social media with LIME and Integrated Gradient (IG) methods. We test our methods with CAMS dataset and validate with annotated interpretations. A key contribution of this research work is to find the reason behind inconsistency in accuracy of multi-class causal categorization. The effectiveness of our methods is evident with the results obtained having category-wise average scores of $81.29 \%$ and $0.906$ using cosine similarity and word mover's distance, respectively.


title: Modeling Context With Linear Attention for Scalable Document-Level Translation

abstract: Document-level machine translation leverages inter-sentence dependencies to produce more coherent and consistent translations. However, these models, predominantly based on transformers, are difficult to scale to long documents as their attention layers have quadratic complexity in the sequence length. Recent efforts on efficient attention improve scalability, but their effect on document translation remains unexplored. In this work, we investigate the efficacy of a recent linear attention model by Peng et al. (2021) on document translation and augment it with a sentential gate to promote a recency inductive bias. We evaluate the model on IWSLT 2015 and OpenSubtitles 2018 against the transformer, demonstrating substantially increased decoding speed on long sequences with similar or better BLEU scores. We show that sentential gating further improves translation quality on IWSLT.


title: QStack: Re-architecting User-space Network Stack to Optimize CPU Efficiency and Service Quality

abstract: TCP/IP network stack is irreplaceable for Web services in datacenter front-end servers, and the demand for which is growing rapidly for emerging high concurrency network service applications (including Internet, Internet of Things, mobile Internet, etc.) especially. The existing network stack schemes often face the dilemma between the data center server resource utilization (i.e., high CPU efficiency) and application service quality (i.e., low tail latency). We break this dilemma via a flexible architectural design QStack, which simultaneously achieves CPU efficiency and low tail latency in user-space network stack for front-end datacenter server. QStack proposes elastic framework and application definable full-datapath priority, such that the network stack collaboration among CPU cores horizontally and coordination across network layers in fine grained vertically on demand. We prototype QStack on commodity servers. Testbed experiments demonstrate the effectiveness of QStack over state-of-the-art user-space network stack designs.


title: On Distributionally Robust Multistage Convex Optimization: Data-driven Models and Performance

abstract: This paper presents a novel algorithmic study with extensive numerical experiments of distributionally robust multistage convex optimization (DR-MCO). Following the previous work on dual dynamic programming (DDP) algorithmic framework for DR-MCO [48], we focus on data-driven DR-MCO models with Wasserstein ambiguity sets that allow probability measures with infinite supports. These data-driven Wasserstein DR-MCO models have out-of-sample performance guarantees and adjustable in-sample conservatism. Then by exploiting additional concavity or convexity in the uncertain cost functions, we design exact single stage subproblem oracle (SSSO) implementations that ensure the convergence of DDP algorithms. We test the data-driven Wasserstein DR-MCO models against multistage robust convex optimization (MRCO), risk-neutral and risk-averse multistage stochastic convex optimization (MSCO) models on multi-commodity inventory problems and hydro-thermal power planning problems. The results show that our DR-MCO models could outperform MRCO and MSCO models when the data size is small.


title: He-star donor AM CVn stars and their progenitors as LISA sources

abstract: Ultracompact cataclysmic variables (CVs) of the AM CVn type are deemed to be important verification sources for the future space gravitational wave detectors such as the Laser Interferometer Space Antenna (LISA). We model the present-day Galactic population of AM CVn stars with He-star donors. Such a population has long expected to exist, though only a couple of candidates are known. We applied the hybrid method of binary population synthesis (BPS) which combines a simulation of the population of immediate precursors of AM CVn stars by a fast BPS code with subsequent tracking of their evolution by a full evolutionary code. The model predicts that the present birthrate of He-donor AM CVn stars in the Galaxy is $4.6\times 10^{-4}$ per yr and the Galaxy may harbour about 112000 objects of this class which have orbital periods less than 42-43 min. The foreground confusion limit and instrumental noise of LISA prevent the discovery of longer periods systems in gravitational waves. We find that about 500 He-star AM CVns may be detected by LISA with signal-to-noise ratio (S/N)>5 during a 4 yr mission. Within 1 Kpc from the Sun, there may exist up to 130 He-star AM CVns with the periods in the same range, which may serve as verification binaries, if detected in the electromagnetic spectrum. In the Milky Way, there are also about 14800 immediate precursors of AM CVn stars. They are detached systems with a stripped low-mass He-star and a white dwarf companion, out of which about 75 may potentially be observed by LISA during its mission.


title: On the User Behavior Leakage from Recommender System Exposure

abstract: Modern recommender systems are trained to predict users potential future interactions from users historical behavior data. During the interaction process, despite the data coming from the user side recommender systems also generate exposure data to provide users with personalized recommendation slates. Compared with the sparse user behavior data, the system exposure data is much larger in volume since only very few exposed items would be clicked by the user. Besides, the users historical behavior data is privacy sensitive and is commonly protected with careful access authorization. However, the large volume of recommender exposure data usually receives less attention and could be accessed within a relatively larger scope of various information seekers. In this paper, we investigate the problem of user behavior leakage in recommender systems. We show that the privacy sensitive user past behavior data can be inferred through the modeling of system exposure. Besides, one can infer which items the user have clicked just from the observation of current system exposure for this user. Given the fact that system exposure data could be widely accessed from a relatively larger scope, we believe that the user past behavior privacy has a high risk of leakage in recommender systems. More precisely, we conduct an attack model whose input is the current recommended item slate (i.e., system exposure) for the user while the output is the user's historical behavior. Experimental results on two real-world datasets indicate a great danger of user behavior leakage. To address the risk, we propose a two-stage privacy-protection mechanism which firstly selects a subset of items from the exposure slate and then replaces the selected items with uniform or popularity-based exposure. Experimental evaluation reveals a trade-off effect between the recommendation accuracy and the privacy disclosure risk.


title: Neutrino Oscillation Caused by Local Symmetry Broken

abstract: Neutrino flavor conversion is assumed to be induced by right-handed neutrino flavor conversion via seesaw mechanism. Neutrino oscillation is the macroscopic phenomenon before all neutrino flavor-flip interactions reaching equilibrium. The model for the hypothesis is the extension by introducing large mass Majorana right-handed neutrino into the Standard Model and exerting horizontal symmetry only on the right-handed neutrino sector.


title: Model Independent Approach of the JUNO $^8$B Solar Neutrino Program

abstract: The physics potential of detecting $^8$B solar neutrinos will be exploited at the Jiangmen Underground Neutrino Observatory (JUNO), in a model independent manner by using three distinct channels of the charged-current (CC), neutral-current (NC) and elastic scattering (ES) interactions. Due to the largest-ever mass of $^{13}$C nuclei in the liquid-scintillator detectors and the {expected} low background level, $^8$B solar neutrinos would be observable in the CC and NC interactions on $^{13}$C for the first time. By virtue of optimized event selections and muon veto strategies, backgrounds from the accidental coincidence, muon-induced isotopes, and external backgrounds can be greatly suppressed. Excellent signal-to-background ratios can be achieved in the CC, NC and ES channels to guarantee the $^8$B solar neutrino observation. From the sensitivity studies performed in this work, we show that JUNO, with ten years of data, can reach the {1$\sigma$} precision levels of 5%, 8% and 20% for the $^8$B neutrino flux, $\sin^2\theta_{12}$, and $\Delta m^2_{21}$, respectively. It would be unique and helpful to probe the details of both solar physics and neutrino physics. In addition, when combined with SNO, the world-best precision of 3% is expected for the $^8$B neutrino flux measurement.


title: ARIEL experiments and theory

abstract: I present an overview of experiments at TRIUMF ARIEL and ISAC facilities covering both the current and the future envisioned programs. I also briefly review theory program at TRIUMF that relates to the ARIEL experimental program. I highlight several recent experimental results from the nuclear astrophysics, nuclear structure, fundamental symmetries, and the sterile neutrino search. Finally, I mention ongoing theoretical ab initio calculations of the proton capture on 7Li related to the X17 boson observation.


title: Diversified Ruderman-Kittel-Kasuya-Yosida Interactions in a Nonsymmorphic Crystal

abstract: We show that there are diversified Ruderman-Kittel-Kasuya-Yosida (RKKY) interactions between magnetic impurities, mediated by itinerant electrons, in a centrosymmetric crystal respecting a nonsymmorphic space group. We take the $P4/nmm$ space group as an example. We demonstrate that the different type of interactions, including the Heisenberg-type, the Dzyaloshinskii-Moriya (DM)-type, the Ising-type and the anisotropic interactions, can appear in accordance with the positions of the impurities in the real space. Their strengths strongly depend on the location of the itinerant electrons in the reciprocal space. The diversity stems from the position-dependent site groups and the momentum-dependent electronic structures guaranteed by the nonsymmorphic symmetries. Our study unveils the role of the nonsymmorphic symmetries in affecting magnetism, and suggests that the nonsymmorphic crystals can be promising platforms to design magnetic interactions.


title: Consistency pays off in science

abstract: The exponentially growing number of scientific papers stimulates a discussion on the interplay between quantity and quality in science. In particular, one may wonder which publication strategy may offer more chances of success: publishing lots of papers, producing a few hit papers, or something in between. Here we tackle this question by studying the scientific portfolios of Nobel Prize laureates. A comparative analysis of different citation-based indicators of individual impact suggests that the best path to success may rely on consistently producing high-quality work. Such a pattern is especially rewarded by a new metric, the $E$-index, which identifies excellence better than state-of-the-art measures.


title: On the one-sided boundedness of the local discrepancy of $\{n\alpha\}$-sequences

abstract: The main interest of this article is the one-sided boundedness of the local discrepancy of $\alpha\in\mathbb{R}\setminus\mathbb{Q}$ on the interval $(0,c)\subset(0,1)$ defined by \[D_n(\alpha,c)=\sum_{j=1}^n 1_{\{\{j\alpha\}<c\}}-cn.\] We focus on the special case $c\in (0,1)\cap\mathbb{Q}$. Several necessary and sufficient conditions on $\alpha$ for $(D_n(\alpha,c))$ to be one-side bounded are derived. Using these, certain topological properties are given to describe the size of the set \[O_c=\{\alpha\in \irr: (D_n(\alpha,c)) \text{ is one-side bounded}\}.\]


title: Navigating Memory Construction by Global Pseudo-Task Simulation for Continual Learning

abstract: Continual learning faces a crucial challenge of catastrophic forgetting. To address this challenge, experience replay (ER) that maintains a tiny subset of samples from previous tasks has been commonly used. Existing ER works usually focus on refining the learning objective for each task with a static memory construction policy. In this paper, we formulate the dynamic memory construction in ER as a combinatorial optimization problem, which aims at directly minimizing the global loss across all experienced tasks. We first apply three tactics to solve the problem in the offline setting as a starting point. To provide an approximate solution to this problem in the online continual learning setting, we further propose the Global Pseudo-task Simulation (GPS), which mimics future catastrophic forgetting of the current task by permutation. Our empirical results and analyses suggest that the GPS consistently improves accuracy across four commonly used vision benchmarks. We have also shown that our GPS can serve as the unified framework for integrating various memory construction policies in existing ER works.


title: CLEAR: Generative Counterfactual Explanations on Graphs

abstract: Counterfactual explanations promote explainability in machine learning models by answering the question "how should an input instance be perturbed to obtain a desired predicted label?". The comparison of this instance before and after perturbation can enhance human interpretation. Most existing studies on counterfactual explanations are limited in tabular data or image data. In this work, we study the problem of counterfactual explanation generation on graphs. A few studies have explored counterfactual explanations on graphs, but many challenges of this problem are still not well-addressed: 1) optimizing in the discrete and disorganized space of graphs; 2) generalizing on unseen graphs; and 3) maintaining the causality in the generated counterfactuals without prior knowledge of the causal model. To tackle these challenges, we propose a novel framework CLEAR which aims to generate counterfactual explanations on graphs for graph-level prediction models. Specifically, CLEAR leverages a graph variational autoencoder based mechanism to facilitate its optimization and generalization, and promotes causality by leveraging an auxiliary variable to better identify the underlying causal model. Extensive experiments on both synthetic and real-world graphs validate the superiority of CLEAR over the state-of-the-art methods in different aspects.


title: Model Criticism for Long-Form Text Generation

abstract: Language models have demonstrated the ability to generate highly fluent text; however, it remains unclear whether their output retains coherent high-level structure (e.g., story progression). Here, we propose to apply a statistical tool, model criticism in latent space, to evaluate the high-level structure of the generated text. Model criticism compares the distributions between real and generated data in a latent space obtained according to an assumptive generative process. Different generative processes identify specific failure modes of the underlying model. We perform experiments on three representative aspects of high-level discourse -- coherence, coreference, and topicality -- and find that transformer-based language models are able to capture topical structures but have a harder time maintaining structural coherence or modeling coreference.


title: Connection-Based Scheduling for Real-Time Intersection Control

abstract: We introduce a heuristic scheduling algorithm for real-time adaptive traffic signal control to reduce traffic congestion. This algorithm adopts a lane-based model that estimates the arrival time of all vehicles approaching an intersection through different lanes, and then computes a schedule (i.e., a signal timing plan) that minimizes the cumulative delay incurred by all approaching vehicles. State space, pruning checks and an admissible heuristic for A* search are described and shown to be capable of generating an intersection schedule in real-time (i.e., every second). Due to the effectiveness of the heuristics, the proposed approach outperforms a less expressive Dynamic Programming approach and previous A*-based approaches in run-time performance, both in simulated test environments and actual field tests.


title: Analytical expression for the exact curved surface area and volume of a hyperboloid of one sheet via Mellin-Barnes type contour integration

abstract: In this article, we aim at obtaining the analytical expression ({\bf not previously found and recorded in the literature}) for the exact curved surface area of a hyperboloid of one sheet in terms of Srivastava-Daoust triple hypergeometric function. The derivation is based on Mellin-Barnes type contour integral representations of generalized hypergeometric function$~_pF_q(z)$, Meijer's $G$-function, decomposition formula for Meijer's $G$-function and series rearrangement technique. Further, we also obtain the formula for the volume of a hyperboloid of one sheet. The closed forms for the exact curved surface area and volume of the hyperboloid of one sheet are also verified numerically by using {\it Mathematica Program}.


title: Repeated values of some restricted divisor functions

abstract: We prove that $d_k(n)=d_k(n+B)$ infinitely often for any positive integers $k$ and $B$, where $d_k(n)$ denotes the number of divisors of $n$ coprime to $k$.


title: Resolving the Mixing Time of the Langevin Algorithm to its Stationary Distribution for Log-Concave Sampling

abstract: Sampling from a high-dimensional distribution is a fundamental task in statistics, engineering, and the sciences. A canonical approach is the Langevin Algorithm, i.e., the Markov chain for the discretized Langevin Diffusion. This is the sampling analog of Gradient Descent. Despite being studied for several decades in multiple communities, tight mixing bounds for this algorithm remain unresolved even in the seemingly simple setting of log-concave distributions over a bounded domain. This paper completely characterizes the mixing time of the Langevin Algorithm to its stationary distribution in this setting (and others). This mixing result can be combined with any bound on the discretization bias in order to sample from the stationary distribution of the continuous Langevin Diffusion. In this way, we disentangle the study of the mixing and bias of the Langevin Algorithm. Our key insight is to introduce a technique from the differential privacy literature to the sampling literature. This technique, called Privacy Amplification by Iteration, uses as a potential a variant of R\'enyi divergence that is made geometrically aware via Optimal Transport smoothing. This gives a short, simple proof of optimal mixing bounds and has several additional appealing properties. First, our approach removes all unnecessary assumptions required by other sampling analyses. Second, our approach unifies many settings: it extends unchanged if the Langevin Algorithm uses projections, stochastic mini-batch gradients, or strongly convex potentials (whereby our mixing time improves exponentially). Third, our approach exploits convexity only through the contractivity of a gradient step -- reminiscent of how convexity is used in textbook proofs of Gradient Descent. In this way, we offer a new approach towards further unifying the analyses of optimization and sampling algorithms.


title: Characteristic space of orbits of Morse-Smale diffeomorphisms on surfaces

abstract: The classical approach to the study of dynamical systems consists in representing the dynamics of the system in the form of a "source-sink", that means identifying an attractor-repeller pair, which are attractor-repellent sets for all other trajectories of the system. If there is a way to choose this pair so that the space orbits in its complement (the characteristic space of orbits) is connected, this creates prerequisites for finding complete topological invariants of the dynamical system. It is known that such a pair always exists for arbitrary Morse-Smale diffeomorphisms given on any manifolds of dimension $n \geqslant 3$. Whereas for $n=2$ the existence of a connected characteristic space has been proved only for orientation-preserving gradient-like (without heteroclinic points) diffeomorphisms defined on an orientable surface. In the present work, it is constructively shown that the violation of at least one of the above conditions (absence of heteroclinic points, orientability of a surface, orientability of a diffeomorphism) leads to the existence of Morse-Smale diffeomorphisms on surfaces that do not have a connected characteristic space of orbits.


title: FAQS: Communication-efficient Federate DNN Architecture and Quantization Co-Search for personalized Hardware-aware Preferences

abstract: Due to user privacy and regulatory restrictions, federate learning (FL) is proposed as a distributed learning framework for training deep neural networks (DNN) on decentralized data clients. Recent advancements in FL have applied Neural Architecture Search (NAS) to replace the predefined one-size-fit-all DNN model, which is not optimal for all tasks of various data distributions, with searchable DNN architectures. However, previous methods suffer from expensive communication cost rasied by frequent large model parameters transmission between the server and clients. Such difficulty is further amplified when combining NAS algorithms, which commonly require prohibitive computation and enormous model storage. Towards this end, we propose FAQS, an efficient personalized FL-NAS-Quantization framework to reduce the communication cost with three features: weight-sharing super kernels, bit-sharing quantization and masked transmission. FAQS has an affordable search time and demands very limited size of transmitted messages at each round. By setting different personlized pareto function loss on local clients, FAQS can yield heterogeneous hardware-aware models for various user preferences. Experimental results show that FAQS achieves average reduction of 1.58x in communication bandwith per round compared with normal FL framework and 4.51x compared with FL+NAS framwork.


title: Bridging the Domain Gap for Multi-Agent Perception

abstract: Existing multi-agent perception algorithms usually select to share deep neural features extracted from raw sensing data between agents, achieving a trade-off between accuracy and communication bandwidth limit. However, these methods assume all agents have identical neural networks, which might not be practical in the real world. The transmitted features can have a large domain gap when the models differ, leading to a dramatic performance drop in multi-agent perception. In this paper, we propose the first lightweight framework to bridge such domain gaps for multi-agent perception, which can be a plug-in module for most existing systems while maintaining confidentiality. Our framework consists of a learnable feature resizer to align features in multiple dimensions and a sparse cross-domain transformer for domain adaption. Extensive experiments on the public multi-agent perception dataset V2XSet have demonstrated that our method can effectively bridge the gap for features from different domains and outperform other baseline methods significantly by at least 8% for point-cloud-based 3D object detection.


title: Efficient Cross-Modal Video Retrieval with Meta-Optimized Frames

abstract: Cross-modal video retrieval aims to retrieve the semantically relevant videos given a text as a query, and is one of the fundamental tasks in Multimedia. Most of top-performing methods primarily leverage Visual Transformer (ViT) to extract video features [1, 2, 3], suffering from high computational complexity of ViT especially for encoding long videos. A common and simple solution is to uniformly sample a small number (say, 4 or 8) of frames from the video (instead of using the whole video) as input to ViT. The number of frames has a strong influence on the performance of ViT, e.g., using 8 frames performs better than using 4 frames yet needs more computational resources, resulting in a trade-off. To get free from this trade-off, this paper introduces an automatic video compression method based on a bilevel optimization program (BOP) consisting of both model-level (i.e., base-level) and frame-level (i.e., meta-level) optimizations. The model-level learns a cross-modal video retrieval model whose input is the "compressed frames" learned by frame-level optimization. In turn, the frame-level optimization is through gradient descent using the meta loss of video retrieval model computed on the whole video. We call this BOP method as well as the "compressed frames" as Meta-Optimized Frames (MOF). By incorporating MOF, the video retrieval model is able to utilize the information of whole videos (for training) while taking only a small number of input frames in actual implementation. The convergence of MOF is guaranteed by meta gradient descent algorithms. For evaluation, we conduct extensive experiments of cross-modal video retrieval on three large-scale benchmarks: MSR-VTT, MSVD, and DiDeMo. Our results show that MOF is a generic and efficient method to boost multiple baseline methods, and can achieve a new state-of-the-art performance.


title: Learning Probabilities of Causation from Finite Population Data

abstract: This paper deals with the problem of learning the probabilities of causation of subpopulations given finite population data. The tight bounds of three basic probabilities of causation, the probability of necessity and sufficiency (PNS), the probability of sufficiency (PS), and the probability of necessity (PN), were derived by Tian and Pearl. However, obtaining the bounds for each subpopulation requires experimental and observational distributions of each subpopulation, which is usually impractical to estimate given finite population data. We propose a machine learning model that helps to learn the bounds of the probabilities of causation for subpopulations given finite population data. We further show by a simulated study that the machine learning model is able to learn the bounds of PNS for 32768 subpopulations with only knowing roughly 500 of them from the finite population data.


title: Improved iterative quantum algorithm for ground-state preparation

abstract: Finding the ground state of a Hamiltonian system is of great significance in many-body quantum physics and quantum chemistry. We propose an improved iterative quantum algorithm to prepare the ground state of a Hamiltonian. The crucial point is to optimize a cost function on the state space via the quantum gradient descent (QGD) implemented on quantum devices. We provide practical guideline on the selection of the learning rate in QGD by finding a fundamental upper bound and establishing a relationship between our algorithm and the first-order approximation of the imaginary time evolution. Furthermore, we adapt a variational quantum state preparation method as a subroutine to generate an ancillary state by utilizing only polylogarithmic quantum resources. The performance of our algorithm is demonstrated by numerical calculations of the deuteron molecule and Heisenberg model without and with noises. Compared with the existing algorithms, our approach has advantages including the higher success probability at each iteration, the measurement precision-independent sampling complexity, the lower gate complexity, and only quantum resources are required when the ancillary state is well prepared.


title: Self-Reconfigurable Soft-Rigid Mobile Agent with Variable Stiffness and Adaptive Morphology

abstract: In this paper, we propose a novel design of a hybrid mobile robot with controllable stiffness and deformable shape. Compared to conventional mobile agents, our system can switch between rigid and compliant phases by solidifying or melting Field's metal in its structure and, thus, alter its shape through the motion of its active components. In the soft state, the robot's main body can bend into circular arcs, which enables it to conform to surrounding curved objects. This variable geometry of the robot creates new motion modes which cannot be described by standard (i.e., fixed geometry) models. To this end, we develop a unified mathematical model that captures the differential kinematics of both rigid and soft states. An optimised control strategy is further proposed to select the most appropriate phase states and motion modes needed to reach a target pose-shape configuration. The performance of our new method is validated with numerical simulations and experiments conducted on a prototype system. The simulation source code is available at https://github.com/Louashka/2sr-agent-simulation.git}{GitHub repository.


title: $L^2$-extension indices, sharper estimates and curvature positivity

abstract: In this paper, we introduce a new concept of $L^2$-extension indices. This index is a function that gives the minimum constant with respect to the $L^2$-estimate of an Ohsawa--Takegoshi-type extension at each point. By using this notion, we propose a new way to study the positivity of curvature. We prove that there is an equivalence between how sharp the $L^2$-extension is and how positive the curvature is. New examples of sharper $L^2$-extensions are also systematically given. As applications, we use the $L^2$-extension index to study Pr\'ekopa-type theorems and to study the positivity of a certain direct image sheaf. We also provide new characterizations of pluriharmonicity and curvature flatness.


title: Scratching Visual Transformer's Back with Uniform Attention

abstract: The favorable performance of Vision Transformers (ViTs) is often attributed to the multi-head self-attention (MSA). The MSA enables global interactions at each layer of a ViT model, which is a contrasting feature against Convolutional Neural Networks (CNNs) that gradually increase the range of interaction across multiple layers. We study the role of the density of the attention. Our preliminary analyses suggest that the spatial interactions of attention maps are close to dense interactions rather than sparse ones. This is a curious phenomenon, as dense attention maps are harder for the model to learn due to steeper softmax gradients around them. We interpret this as a strong preference for ViT models to include dense interaction. We thus manually insert the uniform attention to each layer of ViT models to supply the much needed dense interactions. We call this method Context Broadcasting, CB. We observe that the inclusion of CB reduces the degree of density in the original attention maps and increases both the capacity and generalizability of the ViT models. CB incurs negligible costs: 1 line in your model code, no additional parameters, and minimal extra operations.


title: Learning Self-Regularized Adversarial Views for Self-Supervised Vision Transformers

abstract: Automatic data augmentation (AutoAugment) strategies are indispensable in supervised data-efficient training protocols of vision transformers, and have led to state-of-the-art results in supervised learning. Despite the success, its development and application on self-supervised vision transformers have been hindered by several barriers, including the high search cost, the lack of supervision, and the unsuitable search space. In this work, we propose AutoView, a self-regularized adversarial AutoAugment method, to learn views for self-supervised vision transformers, by addressing the above barriers. First, we reduce the search cost of AutoView to nearly zero by learning views and network parameters simultaneously in a single forward-backward step, minimizing and maximizing the mutual information among different augmented views, respectively. Then, to avoid information collapse caused by the lack of label supervision, we propose a self-regularized loss term to guarantee the information propagation. Additionally, we present a curated augmentation policy search space for self-supervised learning, by modifying the generally used search space designed for supervised learning. On ImageNet, our AutoView achieves remarkable improvement over RandAug baseline (+10.2% k-NN accuracy), and consistently outperforms sota manually tuned view policy by a clear margin (up to +1.3% k-NN accuracy). Extensive experiments show that AutoView pretraining also benefits downstream tasks (+1.2% mAcc on ADE20K Semantic Segmentation and +2.8% mAP on revisited Oxford Image Retrieval benchmark) and improves model robustness (+2.3% Top-1 Acc on ImageNet-A and +1.0% AUPR on ImageNet-O). Code and models will be available at https://github.com/Trent-tangtao/AutoView.


title: StoryER: Automatic Story Evaluation via Ranking, Rating and Reasoning

abstract: Existing automatic story evaluation methods place a premium on story lexical level coherence, deviating from human preference. We go beyond this limitation by considering a novel \textbf{Story} \textbf{E}valuation method that mimics human preference when judging a story, namely \textbf{StoryER}, which consists of three sub-tasks: \textbf{R}anking, \textbf{R}ating and \textbf{R}easoning. Given either a machine-generated or a human-written story, StoryER requires the machine to output 1) a preference score that corresponds to human preference, 2) specific ratings and their corresponding confidences and 3) comments for various aspects (e.g., opening, character-shaping). To support these tasks, we introduce a well-annotated dataset comprising (i) 100k ranked story pairs; and (ii) a set of 46k ratings and comments on various aspects of the story. We finetune Longformer-Encoder-Decoder (LED) on the collected dataset, with the encoder responsible for preference score and aspect prediction and the decoder for comment generation. Our comprehensive experiments result in a competitive benchmark for each task, showing the high correlation to human preference. In addition, we have witnessed the joint learning of the preference scores, the aspect ratings, and the comments brings gain in each single task. Our dataset and benchmarks are publicly available to advance the research of story evaluation tasks.\footnote{Dataset and pre-trained model demo are available at anonymous website \url{http://storytelling-lab.com/eval} and \url{https://github.com/sairin1202/StoryER}}


title: Quantum transport in driven systems with vibrations: Floquet nonequilibrium Green's functions and the GD approximation

abstract: We investigate the effects of alternating voltage on nonequilibrium quantum systems with localised phonon modes. Nonequilibrium Green's functions are utilised, with electron-phonon coupling being considered with the $GD$ approximation (self-consistent Born approximation). Using a Floquet approach, we assume periodicity of the dynamics. This approach allows us to investigate the influence of the driven electronic component on the nonequilibrium occupation of the vibrations. It was found that signatures of inelastic transport gained photon-assisted peaks. A simplistic model was proposed and found to be in good agreement with the full model in certain parameter ranges. Moreover, it was found that driving the alternating current at resonance with vibrational frequencies caused an increase in phonon occupation.


title: Positive-Unlabeled Learning using Random Forests via Recursive Greedy Risk Minimization

abstract: The need to learn from positive and unlabeled data, or PU learning, arises in many applications and has attracted increasing interest. While random forests are known to perform well on many tasks with positive and negative data, recent PU algorithms are generally based on deep neural networks, and the potential of tree-based PU learning is under-explored. In this paper, we propose new random forest algorithms for PU-learning. Key to our approach is a new interpretation of decision tree algorithms for positive and negative data as \emph{recursive greedy risk minimization algorithms}. We extend this perspective to the PU setting to develop new decision tree learning algorithms that directly minimizes PU-data based estimators for the expected risk. This allows us to develop an efficient PU random forest algorithm, PU extra trees. Our approach features three desirable properties: it is robust to the choice of the loss function in the sense that various loss functions lead to the same decision trees; it requires little hyperparameter tuning as compared to neural network based PU learning; it supports a feature importance that directly measures a feature's contribution to risk minimization. Our algorithms demonstrate strong performance on several datasets. Our code is available at \url{https://github.com/puetpaper/PUExtraTrees}.


title: Spectrality of Infinite Convolutions in $\mathbb{R}^d$

abstract: In this paper, we study the spectrality of infinite convolutions in $\mathbb{R}^d$, where the spectrality means the corresponding square integrable function space admits a family of exponential functions as an orthonormal basis. Suppose that the infinite convolutions are generated by a sequence of admissible pairs in $\mathbb{R}^d$. We give two sufficient conditions for their spectrality by using the equi-positivity condition and the integral periodic zero set of Fourier transform. By applying these results, we show the spectrality of some specific infinite convolutions in $\mathbb{R}^d$.


title: Two classes of narrow-sense BCH codes and their duals

abstract: BCH codes and their dual codes are two special subclasses of cyclic codes and are the best linear codes in many cases. A lot of progress on the study of BCH cyclic codes has been made, but little is known about the minimum distances of the duals of BCH codes. Recently, a new concept called dually-BCH code was introduced to investigate the duals of BCH codes and the lower bounds on their minimum distances in \cite{GDL21}. For a prime power $q$ and an integer $m \ge 4$, let $n=\frac{q^m-1}{q+1}$ \ ($m$ even), or $n=\frac{q^m-1}{q-1}$ \ ($q>2$). In this paper, some sufficient and necessary conditions in terms of the designed distance will be given to ensure that the narrow-sense BCH codes of length $n$ are dually-BCH codes, which extended the results in \cite{GDL21}. Lower bounds on the minimum distances of their dual codes are developed for $n=\frac{q^m-1}{q+1}$ \ ($m$ even). As byproducts, we present the largest coset leader $\delta_1$ modulo $n$ being of two types, which proves a conjecture in \cite{WLP19} and partially solves an open problem in \cite{Li2017}. We also investigate the parameters of the narrow-sense BCH codes of length $n$ with design distance $\delta_1$. The BCH codes presented in this paper have good parameters in general.


title: Federated Learning with Privacy-Preserving Ensemble Attention Distillation

abstract: Federated Learning (FL) is a machine learning paradigm where many local nodes collaboratively train a central model while keeping the training data decentralized. This is particularly relevant for clinical applications since patient data are usually not allowed to be transferred out of medical facilities, leading to the need for FL. Existing FL methods typically share model parameters or employ co-distillation to address the issue of unbalanced data distribution. However, they also require numerous rounds of synchronized communication and, more importantly, suffer from a privacy leakage risk. We propose a privacy-preserving FL framework leveraging unlabeled public data for one-way offline knowledge distillation in this work. The central model is learned from local knowledge via ensemble attention distillation. Our technique uses decentralized and heterogeneous local data like existing FL approaches, but more importantly, it significantly reduces the risk of privacy leakage. We demonstrate that our method achieves very competitive performance with more robust privacy preservation based on extensive experiments on image classification, segmentation, and reconstruction tasks.


title: Character-Centric Story Visualization via Visual Planning and Token Alignment

abstract: Story visualization advances the traditional text-to-image generation by enabling multiple image generation based on a complete story. This task requires machines to 1) understand long text inputs and 2) produce a globally consistent image sequence that illustrates the contents of the story. A key challenge of consistent story visualization is to preserve characters that are essential in stories. To tackle the challenge, we propose to adapt a recent work that augments Vector-Quantized Variational Autoencoders (VQ-VAE) with a text-tovisual-token (transformer) architecture. Specifically, we modify the text-to-visual-token module with a two-stage framework: 1) character token planning model that predicts the visual tokens for characters only; 2) visual token completion model that generates the remaining visual token sequence, which is sent to VQ-VAE for finalizing image generations. To encourage characters to appear in the images, we further train the two-stage framework with a character-token alignment objective. Extensive experiments and evaluations demonstrate that the proposed method excels at preserving characters and can produce higher quality image sequences compared with the strong baselines. Codes can be found in https://github.com/sairin1202/VP-CSV


title: Aspects of type IIA AdS$_4$ orientifold vacua

abstract: In this thesis we explore the vacua structure of type IIA orientifold (CY) compactifications with fluxes, from the 4d and the 10d point of view. We start by reviewing type IIA Calabi-Yau orientifold compactifications with fluxes. We consider RR and NSNS fluxes, and then add (non)-geometric fluxes. We recall how the potential can be written as a bilinear expression and review the main swampland conjectures involving these scenarios. Once the basics have been setted, we perform a systematic search of vacua, using directly the 4d action. We focus first on the case with RR and NSNS fluxes and then repeat the same game by including geometric fluxes. We find several families of SUSY and non-SUSY AdS$_4$ vacua. We check which of them are (perturbatively) stable and which have separation of scales. We then analyse from the 10d perspective the SUSY vacua derived in the 4d effective theory. We comment on how an uplift to $SU(3)$ structure manifolds does not exist unless the O6 planes are smeared. We go beyond this approximation and look for an uplift in $SU(3)\times SU(3)$ manifolds, considering only the case with RR and NSNS fluxes. To do so, we expand the equations of motion in terms of $g_s$. At zeroth order we recover the smearing approximation. We solve the expansion at first order, where the localised nature of the O6-planes is taken into account. We use the same machinery to study the non-perturbative stability of some of the families of non-SUSY vacua with only RR and NSNS fluxes. According to a refined version of the weak gravity conjecture, there should be membranes in the spectrum with $Q > T$, triggering its decay. We see that D8 branes wrapping the internal manifold with D6 branes ending on them can satisfy this requirement. We finish by recapping all the results and making some comments about which questions are still open.


title: Scaling Solutions of Wiggly Cosmic Strings

abstract: Cosmic string networks form during cosmological phase transitions as a consequence of the Kibble mechanism. The evolution of the simplest networks is accurately described by the canonical Velocity Dependent One-Scale (VOS) model. However, numerical simulations have demonstrated the existence of significant quantities of short-wavelength propagation modes on the strings, known as wiggles, which motivated the recent development of a wiggly string extension of the VOS. Here we summarize recent progress in the physical interpretation of this model through a systematic study of the allowed asymptotic scaling solutions of the model. The modeling mainly relies on three mechanisms: the universe's expansion rate, energy transfer mechanisms (e.g., the production of loops and wiggles), and the choice of the scale in which wiggles are coarse-grained. We consider the various limits in which each mechanism dominates and compare the scaling solutions for each case, in order to gain insight into the role of each mechanism in the overall behavior of the network. Our results show that there are three scaling regimes for the wiggliness, consisting of the well-known Nambu-Goto solution, and non-trivial regimes where the amount of wiggliness can grow as the network evolves or, for specific expansion rates, become a constant. We also demonstrate that full scaling of the network is more likely in the matter era than in the radiation epoch, in agreement with numerical simulations.


title: Quantum Fourier Transform Has Small Entanglement

abstract: The Quantum Fourier Transform (QFT) is a key component of many important quantum algorithms, most famously as being the essential ingredient in Shor's algorithm for factoring products of primes. Given its remarkable capability, one would think it can introduce large entanglement to qubit systems and would be difficult to simulate classically. While early results showed QFT indeed has maximal operator entanglement, we show that this is entirely due to the bit reversal in the QFT. The core part of the QFT has Schmidt coefficients decaying exponentially quickly, and thus it can only generate a constant amount of entanglement regardless of the number of qubits. In addition, we show the entangling power of the QFT is the same as the time evolution of a Hamiltonian with exponentially decaying interactions, and thus a variant of the area law for dynamics can be used to understand the low entanglement intuitively. Using the low entanglement property of the QFT, we show that classical simulations of the QFT on a matrix product state with low bond dimension only take time linear in the number of qubits, providing a potential speedup over the classical fast Fourier transform (FFT) on many classes of functions. We demonstrate this speedup in test calculations on some simple functions. For data vectors of length $10^6$ to $10^8$, the speedup can be a few orders of magnitude.


title: Explicit bound for singularities on the base of a Fano type fibration of relative dimension one

abstract: Let $\pi:X\rightarrow Z$ be a Fano type fibration with $\dim X-\dim Z=d$ and let $(X,B)$ be an $\epsilon$-lc pair with $K_X+B\sim_{R} 0/Z$. The canonical bundle formula gives $(Z,B_Z+M_Z)$ where $B_Z$ is the discriminant part and $M_Z$ is the moduli part which is determined up to R-linear equivalence. Shokurov conjectured that one can choose $M_Z\geq 0$ such that $(Z,B_Z+M_Z)$ is $\delta$-lc where $\delta$ only depends on $d,\epsilon$. Very recently, this conjecture was proved by Birkar. For $d=1$ and $\epsilon=1$, Han, Jiang and Luo gived the optimal value of $\delta=1/2$. In this paper, we prove that for $d=1$ and arbitrary $0<\epsilon\leq 1$, one can take $$\delta= \sup\{(\epsilon-1/n)/(n-1)\mid n\in \mathbb N_{\geq 2}\}.$$ In particular, one can take $\delta = \epsilon^2/4$ in this case. An example indicates that one can not take $\delta> \epsilon^2$ and hence the order $O(\epsilon^2)$ is sharp.


title: Class Distribution Monitoring for Concept Drift Detection

abstract: We introduce Class Distribution Monitoring (CDM), an effective concept-drift detection scheme that monitors the class-conditional distributions of a datastream. In particular, our solution leverages multiple instances of an online and nonparametric change-detection algorithm based on QuantTree. CDM reports a concept drift after detecting a distribution change in any class, thus identifying which classes are affected by the concept drift. This can be precious information for diagnostics and adaptation. Our experiments on synthetic and real-world datastreams show that when the concept drift affects a few classes, CDM outperforms algorithms monitoring the overall data distribution, while achieving similar detection delays when the drift affects all the classes. Moreover, CDM outperforms comparable approaches that monitor the classification error, particularly when the change is not very apparent. Finally, we demonstrate that CDM inherits the properties of the underlying change detector, yielding an effective control over the expected time before a false alarm, or Average Run Length (ARL$_0$).


title: Improving Semantic Matching through Dependency-Enhanced Pre-trained Model with Adaptive Fusion

abstract: Transformer-based pre-trained models like BERT have achieved great progress on Semantic Sentence Matching. Meanwhile, dependency prior knowledge has also shown general benefits in multiple NLP tasks. However, how to efficiently integrate dependency prior structure into pre-trained models to better model complex semantic matching relations is still unsettled. In this paper, we propose the \textbf{D}ependency-Enhanced \textbf{A}daptive \textbf{F}usion \textbf{A}ttention (\textbf{DAFA}), which explicitly introduces dependency structure into pre-trained models and adaptively fuses it with semantic information. Specifically, \textbf{\emph{(i)}} DAFA first proposes a structure-sensitive paradigm to construct a dependency matrix for calibrating attention weights. It adopts an adaptive fusion module to integrate the obtained dependency information and the original semantic signals. Moreover, DAFA reconstructs the attention calculation flow and provides better interpretability. By applying it on BERT, our method achieves state-of-the-art or competitive performance on 10 public datasets, demonstrating the benefits of adaptively fusing dependency structure in semantic matching task.


title: Object-Attentional Untargeted Adversarial Attack

abstract: Deep neural networks are facing severe threats from adversarial attacks. Most existing black-box attacks fool target model by generating either global perturbations or local patches. However, both global perturbations and local patches easily cause annoying visual artifacts in adversarial example. Compared with some smooth regions of an image, the object region generally has more edges and a more complex texture. Thus small perturbations on it will be more imperceptible. On the other hand, the object region is undoubtfully the decisive part of an image to classification tasks. Motivated by these two facts, we propose an object-attentional adversarial attack method for untargeted attack. Specifically, we first generate an object region by intersecting the object detection region from YOLOv4 with the salient object detection (SOD) region from HVPNet. Furthermore, we design an activation strategy to avoid the reaction caused by the incomplete SOD. Then, we perform an adversarial attack only on the detected object region by leveraging Simple Black-box Adversarial Attack (SimBA). To verify the proposed method, we create a unique dataset by extracting all the images containing the object defined by COCO from ImageNet-1K, named COCO-Reduced-ImageNet in this paper. Experimental results on ImageNet-1K and COCO-Reduced-ImageNet show that under various system settings, our method yields the adversarial example with better perceptual quality meanwhile saving the query budget up to 24.16\% compared to the state-of-the-art approaches including SimBA.


title: 1st Place Solution in Google Universal Images Embedding

abstract: This paper presents the 1st place solution for the Google Universal Images Embedding Competition on Kaggle. The highlighted part of our solution is based on 1) A novel way to conduct training and fine-tuning; 2) The idea of a better ensemble in the pool of models that make embedding; 3) The potential trade-off between fine-tuning on high-resolution and overlapping patches; 4) The potential factors to work for the dynamic margin. Our solution reaches 0.728 in the private leader board, which achieve 1st place in Google Universal Images Embedding Competition.


title: Sentence Representation Learning with Generative Objective rather than Contrastive Objective

abstract: Though offering amazing contextualized token-level representations, current pre-trained language models take less attention on accurately acquiring sentence-level representation during their self-supervised pre-training. However, contrastive objectives which dominate the current sentence representation learning bring little linguistic interpretability and no performance guarantee on downstream semantic tasks. We instead propose a novel generative self-supervised learning objective based on phrase reconstruction. To overcome the drawbacks of previous generative methods, we carefully model intra-sentence structure by breaking down one sentence into pieces of important phrases. Empirical studies show that our generative learning achieves powerful enough performance improvement and outperforms the current state-of-the-art contrastive methods not only on the STS benchmarks, but also on downstream semantic retrieval and reranking tasks. Our code is available at https://github.com/chengzhipanpan/PaSeR.


title: RedApt: An Adaptor for wav2vec 2 Encoding \\ Faster and Smaller Speech Translation without Quality Compromise

abstract: Pre-trained speech Transformers in speech translation (ST) have facilitated state-of-the-art (SotA) results; yet, using such encoders is computationally expensive. To improve this, we present a novel Reducer Adaptor block, RedApt, that could be seamlessly integrated within any Transformer-based speech encoding architecture. Integrating the pretrained wav2vec 2 speech encoder with RedAptbrings 41% speedup, 33% memory reduction with 24% fewer FLOPs at inference. To our positive surprise, our ST model with RedApt outperforms the SotA architecture by an average of 0.68 BLEU score on 8 language pairs from Must-C.