title: Task Adaptive Parameter Sharing for Multi-Task Learning

abstract: Adapting pre-trained models with broad capabilities has become standard practice for learning a wide range of downstream tasks. The typical approach of fine-tuning different models for each task is performant, but incurs a substantial memory cost. To efficiently learn multiple downstream tasks we introduce Task Adaptive Parameter Sharing (TAPS), a general method for tuning a base model to a new task by adaptively modifying a small, task-specific subset of layers. This enables multi-task learning while minimizing resources used and competition between tasks. TAPS solves a joint optimization problem which determines which layers to share with the base model and the value of the task-specific weights. Further, a sparsity penalty on the number of active layers encourages weight sharing with the base model. Compared to other methods, TAPS retains high accuracy on downstream tasks while introducing few task-specific parameters. Moreover, TAPS is agnostic to the model architecture and requires only minor changes to the training scheme. We evaluate our method on a suite of fine-tuning tasks and architectures (ResNet, DenseNet, ViT) and show that it achieves state-of-the-art performance while being simple to implement.


title: Class Numbers and Pell's Equation $x^2 + 105y^2 = z^2$

abstract: Two well-studied Diophantine equations are those of Pythagorean triples and elliptic curves, for the first we have a parametrization through rational points on the unit circle, and for the second we have a structure theorem for the group of rational solutions. Recently, Yekutieli discussed a connection between these two problems, and described the group structure of Pythagorean triples and the number of triples for a given hypotenuse. In arXiv:2112.03663 we generalized these methods and results to Pell's equation. We find a similar group structure and count on the number of solutions for a given $z$ to $x^2 + Dy^2 = z^2$ when $D$ is 1 or 2 modulo 4 and the class group of $\mathbb{Q}[\sqrt{-D}]$ is a free $\mathbb{Z}_2$ module, which always happens if the class number is at most 2. In this paper, we discuss the main results of arXiv:2112.03663 using some concrete examples in the case of $D=105$.


title: Detecting Treatment Interference under the K-Nearest-Neighbors Interference Model

abstract: We propose a model of treatment interference where the response of a unit depends only on its treatment status and the statuses of units within its K-neighborhood. Current methods for detecting interference include carefully designed randomized experiments and conditional randomization tests on a set of focal units. We give guidance on how to choose focal units under this model of interference. We then conduct a simulation study to evaluate the efficacy of existing methods for detecting network interference. We show that this choice of focal units leads to powerful tests of treatment interference which outperform current experimental methods.


title: Analytic theory for the dynamics of wide quantum neural networks

abstract: Parameterized quantum circuits can be used as quantum neural networks and have the potential to outperform their classical counterparts when trained for addressing learning problems. To date, much of the results on their performance on practical problems are heuristic in nature. In particular, the convergence rate for the training of quantum neural networks is not fully understood. Here, we analyze the dynamics of gradient descent for the training error of a class of variational quantum machine learning models. We define wide quantum neural networks as parameterized quantum circuits in the limit of a large number of qubits and variational parameters. We then find a simple analytic formula that captures the average behavior of their loss function and discuss the consequences of our findings. For example, for random quantum circuits, we predict and characterize an exponential decay of the residual training error as a function of the parameters of the system. We finally validate our analytic results with numerical experiments.


title: An algebraic approach to Borel CSPs

abstract: We adapt tools from the algebraic approach to constraint satisfaction problems to answer descriptive set theoretic questions about Borel CSPs. We show that if a structure $\mathcal D$ does not have a Taylor polymorphism, then the corresponding Borel CSP is $\mathbf{\Sigma}^1_2$-complete. In particular, by the CSP Dichotomy Theorem, if $\operatorname{CSP}(\mathcal D)$ is $\mathrm{NP}$-complete, then the Borel version, $\operatorname{csp}_B(\mathcal D)$, is $\mathbf{\Sigma}^1_2$-complete (assuming $\mathrm{P}\not=\mathrm{NP}$). We also have partial converses, such as a descriptive analogue of the Hell--Ne\v set\v ril theorem characterizing $\mathbf{\Sigma}^1_2$-complete graph homomorphism problems. We show that the structures where every solvable Borel instance of their CSP has a Borel solution are exactly the width 1 structures. And, we prove a handful of results bounding the projective complexity of certain bounded width structures.


title: Wordle is NP-hard

abstract: Wordle is a single-player word-guessing game where the goal is to discover a secret word $w$ that has been chosen from a dictionary $D$. In order to discover $w$, the player can make at most $\ell$ guesses, which must also be words from $D$, all words in $D$ having the same length $k$. After each guess, the player is notified of the positions in which their guess matches the secret word, as well as letters in the guess that appear in the secret word in a different position. We study the game of Wordle from a complexity perspective, proving NP-hardness of its natural formalization: to decide given a dictionary $D$ and an integer $\ell$ if the player can guarantee to discover the secret word within $\ell$ guesses. Moreover, we prove that hardness holds even over instances where words have length $k = 5$, and that even in this case it is NP-hard to approximate the minimum number of guesses required to guarantee discovering the secret word. We also present results regarding its parameterized complexity and offer some related open problems.


title: End-to-End Table Question Answering via Retrieval-Augmented Generation

abstract: Most existing end-to-end Table Question Answering (Table QA) models consist of a two-stage framework with a retriever to select relevant table candidates from a corpus and a reader to locate the correct answers from table candidates. Even though the accuracy of the reader models is significantly improved with the recent transformer-based approaches, the overall performance of such frameworks still suffers from the poor accuracy of using traditional information retrieval techniques as retrievers. To alleviate this problem, we introduce T-RAG, an end-to-end Table QA model, where a non-parametric dense vector index is fine-tuned jointly with BART, a parametric sequence-to-sequence model to generate answer tokens. Given any natural language question, T-RAG utilizes a unified pipeline to automatically search through a table corpus to directly locate the correct answer from the table cells. We apply T-RAG to recent open-domain Table QA benchmarks and demonstrate that the fine-tuned T-RAG model is able to achieve state-of-the-art performance in both the end-to-end Table QA and the table retrieval tasks.


title: Cyberattack Detection for Nonlinear Leader-Following Multi-Agent Systems Using Set-Membership Fuzzy Filtering

abstract: This paper is concerned with cyberattack detection in discrete-time, leader-following, nonlinear, multi-agent systems subject to unknown but bounded (UBB) system noises. The Takagi-Sugeno (T-S) fuzzy model is employed to approximate the nonlinear systems over the true value of the state. A distributed cyberattack detection method, based on a new fuzzy set-membership filtering method, which consists of two steps, namely a prediction step and a measurement update step, is developed for each agent to identify two types of cyberattacks at the time of their occurrence. The attacks are replay attacks and false data injection attacks affecting the leader-following consensus. We calculate an estimation ellipsoid set by updating the prediction ellipsoid set with the current sensor measurement data. Two criteria are provided to detect cyberattacks based on the intersection between the ellipsoid sets. If there is no intersection between the prediction set and the estimation set of an agent at the current time instant, a cyberattack on its sensors is declared. Control signal or communication signal data of an agent are under a cyberattack if its prediction set has no intersection with the estimation set updated at the previous time instant. Recursive algorithms for solving the consensus protocol and calculating the two ellipsoid sets for detecting attacks are proposed. Simulation results are provided to demonstrate the effectiveness of the proposed method.


title: Radio Scattering Horizons for Galactic and Extragalactic Transients

abstract: Radio wave scattering can cause severe reductions in detection sensitivity for surveys of Galactic and extragalactic fast ($\sim$ms duration) transients. While Galactic sources like pulsars undergo scattering in the Milky Way interstellar medium (ISM), extragalactic fast radio bursts (FRBs) can also experience scattering in their host galaxies and other galaxies intervening their lines-of-sight. We assess Galactic and extragalactic scattering horizons for fast radio transients using a combination of NE2001 to model the dispersion measure (DM) and scattering time ($\tau$) contributed by the Galactic disk, and independently constructed electron density models for the Galactic halo and other galaxies' ISMs and halos that account for different galaxy morphologies, masses, densities, and strengths of turbulence. For source redshifts $0.5\leq z_{\rm s}\leq1$, an all-sky, isotropic FRB population has simulated values of $\tau(1\rm~GHz)$ ranging from $\sim1~\mu$s to $\sim2$ ms ($90\%$ confidence, observer frame) that are dominated by host galaxies, although $\tau$ can be $\gg2$ ms at low Galactic latitudes. A population at $z_{\rm s}=5$ has $0.01\lesssim\tau\lesssim300$ ms at 1 GHz ($90\%$ confidence), dominated by intervening galaxies. About $20\%$ of these high-redshift FRBs are predicted to have $\tau>5$ ms at 1 GHz (observer frame), and $\gtrsim40\%$ of FRBs between $z_{\rm s}\sim0.5-5$ have $\tau\gtrsim1$ ms for $\nu\leq 800$ MHz. Our scattering predictions may be conservative if scattering from circumsource environments is significant, which is possible under specific conditions. The percentage of FRBs selected against from scattering could also be substantially larger than we predict if circumgalactic turbulence causes more small-scale ($\ll1$ au) density fluctuations than observed from nearby halos.


title: A comparison of strategies for selecting auxiliary variables for multiple imputation

abstract: Multiple imputation (MI) is a popular method for handling missing data. Auxiliary variables can be added to the imputation model(s) to improve MI estimates. However, the choice of which auxiliary variables to include in the imputation model is not always straightforward. Including too few may lead to important information being discarded, but including too many can cause problems with convergence of the estimation procedures for imputation models. Several data-driven auxiliary variable selection strategies have been proposed. This paper uses a simulation study and a case study to provide a comprehensive comparison of the performance of eight auxiliary variable selection strategies, with the aim of providing practical advice to users of MI. A complete case analysis and an MI analysis with all auxiliary variables included in the imputation model (the full model) were also performed for comparison. Our simulation study results suggest that the full model outperforms all auxiliary variable selection strategies, providing further support for adopting an inclusive auxiliary variable strategy where possible. Auxiliary variable selection using the Least Absolute Selection and Shrinkage Operator (LASSO) was the best performing auxiliary variable selection strategy overall and is a promising alternative when the full model fails. All MI analysis strategies that we were able to apply to the case study led to similar estimates.


title: A Large-Scale Comparison of Python Code in Jupyter Notebooks and Scripts

abstract: In recent years, Jupyter notebooks have grown in popularity in several domains of software engineering, such as data science, machine learning, and computer science education. Their popularity has to do with their rich features for presenting and visualizing data, however, recent studies show that notebooks also share a lot of drawbacks: high number of code clones, low reproducibility, etc. In this work, we carry out a comparison between Python code written in Jupyter Notebooks and in traditional Python scripts. We compare the code from two perspectives: structural and stylistic. In the first part of the analysis, we report the difference in the number of lines, the usage of functions, as well as various complexity metrics. In the second part, we show the difference in the number of stylistic issues and provide an extensive overview of the 15 most frequent stylistic issues in the studied mediums. Overall, we demonstrate that notebooks are characterized by the lower code complexity, however, their code could be perceived as more entangled than in the scripts. As for the style, notebooks tend to have 1.4 times more stylistic issues, but at the same time, some of them are caused by specific coding practices in notebooks and should be considered as false positives. With this research, we want to pave the way to studying specific problems of notebooks that should be addressed by the development of notebook-specific tools, and provide various insights that can be useful in this regard.


title: Ubiquity of the quantum boomerang effect in Hermitian Anderson-localized systems

abstract: A particle with finite initial velocity in a disordered potential comes back and in average stops at the original location. This phenomenon dubbed 'quantum boomerang effect' (QBE) has been recently observed in an experiment simulating the quantum kicked-rotor model [Phys. Rev. X 12, 011035 (2022)]. We provide analytical arguments that support QBE in a wide class of disordered systems. Sufficient conditions to observe the real-space QBE effect are (a) Anderson localization, (b) the reality of the spectrum for the case of non-Hermitian systems, (c) the ensemble of disorder realizations $\{H\}$ be invariant under the application of $\mathcal{R\, T}$, and (d) the initial state is an eigenvector of $\mathcal{R\, T}$, where $\mathcal{R}$ is a reflection $x \rightarrow -x$ and $\mathcal{T}$ is the time-reversal operator. The QBE can be observed in momentum-space in systems with dynamical localization if conditions (c) and (d) are satisfied with respect to the operator $\mathcal{T}$ instead of $\mathcal{RT}$. These conditions allow the observation of the QBE in time-reversal symmetry broken models, contrarily to what was expected from previous analyses of the effect, and in a large class of non-Hermitian models. We provide examples of QBE in lattice models with magnetic flux breaking time-reversal symmetry and in a model with electric field. Whereas the QBE straightforwardly applies to noninteracting many-body systems, we argue that a real-space (momentum-space) QBE is absent in weakly interacting bosonic systems due to the breaking of $RT$ ($T$) symmetry.


title: Quantum Control of Spin Qubits Using Nanomagnets

abstract: Single-qubit gates are essential components of a universal quantum computer. Without selective addressing of individual qubits, scalable implementation of quantum algorithms is not possible. When the qubits are discrete points or regions on a lattice, the selective addressing of magnetic spin qubits at the nanoscale remains a challenge due to the difficulty of localizing and confining a classical divergence-free field to a small volume of space. Herein we propose a new technique for addressing spin qubits using voltage-control of nanoscale magnetism, exemplified by the use of voltage control of magnetic anisotropy (VCMA). We show that by tuning the frequency of the nanomagnet's electric field drive to the Larmor frequency of the spins confined to a nanoscale volume, and by modulating the phase of the drive, single-qubit quantum gates with fidelities approaching those for fault-tolerant quantum computing can be implemented. Such single-qubit gate operations have the advantage of remarkable energy efficiency, requiring only tens of femto-Joules per gate operation, and lossless, purely magnetic field control (no E-field over the target volume). Their physical realization is also straightforward using existing foundry manufacturing techniques.


title: General lossless polarization and phase transformation using bilayer metasurfaces

abstract: Metasurface optical elements enable wavefront control and polarization manipulation with subwavelength resolution. Metasurfaces made of linearly birefringent meta-atoms such as rectangular nano-posts are commonly used to control phase and polarization, but a single layer of these meta-atoms cannot implement transformations with elliptically polarized or circularly polarized eigenstates (i.e., chiral transformations). Here, it is shown that two cascaded metasurface layers comprising linearly birefringent meta-atoms provide sufficiently many degrees of freedom to implement arbitrary unitary phase and polarization transformations. A systematic design method for such metastructures is described and used to design a bifocal metalens that cannot be implemented by a single layer of birefringent meta-atoms. The presented design and implementation techniques introduce a systematic approach for realizing the most general form of lossless polarization and phase transformations using metasurfaces with high efficiency.


title: Optimizing Observables with Machine Learning for Better Unfolding

abstract: Most measurements in particle and nuclear physics use matrix-based unfolding algorithms to correct for detector effects. In nearly all cases, the observable is defined analogously at the particle and detector level. We point out that while the particle-level observable needs to be physically motivated to link with theory, the detector-level need not be and can be optimized. We show that using deep learning to define detector-level observables has the capability to improve the measurement when combined with standard unfolding methods.


title: Exploiting Explainable Metrics for Augmented SGD

abstract: Explaining the generalization characteristics of deep learning is an emerging topic in advanced machine learning. There are several unanswered questions about how learning under stochastic optimization really works and why certain strategies are better than others. In this paper, we address the following question: \textit{can we probe intermediate layers of a deep neural network to identify and quantify the learning quality of each layer?} With this question in mind, we propose new explainability metrics that measure the redundant information in a network's layers using a low-rank factorization framework and quantify a complexity measure that is highly correlated with the generalization performance of a given optimizer, network, and dataset. We subsequently exploit these metrics to augment the Stochastic Gradient Descent (SGD) optimizer by adaptively adjusting the learning rate in each layer to improve in generalization performance. Our augmented SGD -- dubbed RMSGD -- introduces minimal computational overhead compared to SOTA methods and outperforms them by exhibiting strong generalization characteristics across application, architecture, and dataset.


title: Effect of quantum coherence on Landauer's principle

abstract: Quantum Landauer's principle provides a fundamental lower bound for energy dissipation occurred with information erasure in the quantum regime. While most studies have related the entropy reduction incorporated with the erasure to the lower bound~(entropic bound), recent efforts have also provided another lower bound associated with the thermal fluctuation of the dissipated energy~(thermodynamic bound). The coexistence of the two bounds has stimulated comparative studies of their properties; however, these studies were performed for systems where the time-evolution of diagonal (population) and off-diagonal (coherence) elements of the density matrix are decoupled. In this paper, we aimed to broaden the comparative study to include the influence of quantum coherence induced by the tilted system--reservoir interaction direction. By examining their dependence on the initial state of the information-bearing system, we find that the following properties of the bounds are generically held regardless of whether the influence of the coherence is present or not: the entropic bound serves as the tighter bound for a sufficiently mixed initial state, while the thermodynamic bound is tighter when the purity of the initial state is sufficiently high. The exception is the case where the system dynamics involve only phase relaxation; in this case, the two bounds coincide when the initial coherence is zero; otherwise, the thermodynamic bound serves the tighter bound. We also find the quantum information erasure inevitably accompanies constant energy dissipation caused by the creation of system--reservoir correlation, which may cause an additional source of energetic cost for the erasure.


title: A class of singular bilinear maximal functions

abstract: Lebesgue space bounds $L^{p_1}({\mathbb R}^1) \times L^{p_2}(^1) \to L^q({\mathbb R}^1)$ are established for certain maximal bilinear operators. The proof combines a trilinear smoothing inequality with Calder\'on-Zygmund theory. A reference to overlapping work of other authors on one observation has been added.


title: Hybrid normal mode and energy flux model for an ideal oceanic wedge environment with radial sound speed front

abstract: Energy flux is an acoustic propagation model that calculates the locally-averaged intensity without computing explicit eigenvalues or tracing rays. The energy flux method has so far only been used for two-dimensional problems that have collapsed the third dimension by rotational or translational symmetry. This report outlines the derivation and implementation of a three-dimensional ocean acoustic propagation model using a combination of normal modes and the energy flux method. This model is specifically derived for a wedge environment with a radial sound speed front at some distance from the shoreline. The hybrid energy flux model's output is compared to that of another propagation model for this environment that is built on normal modes alone. General agreement in the shape, location, and amplitude of caustic features is observed with some discrepancies that may be attributable to inherent differences in the model derivations. This work serves as a stepping-stone toward developing a more generalized three-dimensional energy flux model.


title: Mid-Infrared studies of dusty sources in the Galactic Center

abstract: Mid-Infrared (MIR) images of the Galactic center show extended gas and dust features along with bright IRS sources. Some of these dust features are a part of ionized clumpy streamers orbiting Sgr~A*, known as the mini-spiral. We present their proper motions over 12 year time period and report their flux densities in $N$-band filters {and derive their spectral indices}. The observations were carried out by VISIR at ESO VLT. High-pass filtering led to the detection of several resolved filaments and clumps along the mini-spiral. Each source was fit by a 2-D Gaussian profile to determine the offsets and aperture sizes. We perform aperture photometry to extract fluxes in two different bands. We present the proper motions of the largest consistent set of resolved and reliably determined sources. In addition to stellar orbital motions, we identify a stream-like motion of extended clumps along the mini-spiral. We also detect MIR counterparts of the radio tail components of the IRS7 source. They show a clear kinematical deviation with respect to the star. They likely represent Kelvin-Helmholtz instabilities formed downstream in the shocked stellar wind. We also analyze the shape and the orientation of the extended late-type IRS3 star that is consistent with the ALMA sub-mm detection of the source. Its puffed-up envelope with the radius of $\sim 2\times 10^6\,R_{\odot}$ could be the result of the red-giant collision with a nuclear jet, which was followed by the tidal prolongation along the orbit.


title: On the convergence of Denjoy-Wolff points

abstract: If $\varphi$ is an analytic function from the unit disk $\mathbb{D}$ to itself, and $\varphi$ is not a conformal automorphism, we denote by $\lambda_{\varphi}$ its Denjoy-Wolff point, that is, the limit of the iterates $\varphi(\varphi(\cdots\varphi(0)\cdots))$. A result of Heins shows that, given a sequence $(\varphi_{n})_{n\in\mathbb{N}}$ of such analytic functions that convergence pointwise to $\varphi$, it follows that $\lim_{n\to\infty}\lambda_{\varphi_{n}}=\lambda_{\varphi}$. This allows us to improve results about the contnuous extensions of the subordination functions that arise in the study of free convolutions. We also offer an alternate proof of the result of Heins.


title: A Trace Formula on Stationary Kaluza-Klein Spacetimes

abstract: We prove relativistic versions of the ladder asymptotics from V. Guillemin and A. Uribe [Journal of Differential Geometry, 32(2):315-347, 1990] on principal bundles over globally hyperbolic, stationary, spatially compact spacetimes equipped with a Kaluza-Klein metric. This involves understanding the distribution of the frequency spectrum for the wave equation on a Kaluza-Klein spacetime when restricted to the isotypic subspace of an irreducible representation of the structure group, in the limit that the weight of the representation approaches infinity in the Weyl chamber. This is a direct generalization of the results from A. Strohmaier and S. Zelditch [Indagationes Mathematicae 32 (2021), 323-363] and is closely related to Strohmaier-Zelditch [Advances in Mathematics, Volume 376, 2021, 107434] and O. Islam arXiv:2109.09219. Furthermore we show how to apply these results to frequency asymptotics for the massive Klein-Gordon equation on vector bundles as one takes the representation defining the vector bundle to infinity.


title: Cancellable Template Design for Privacy-Preserving EEG Biometric Authentication Systems

abstract: As a promising candidate to complement traditional biometric modalities, brain biometrics using electroencephalography (EEG) data has received a widespread attention in recent years. However, compared with existing biometrics such as fingerprints and face recognition, research on EEG biometrics is still in its infant stage. Most of the studies focus on either designing signal elicitation protocols from the perspective of neuroscience or developing feature extraction and classification algorithms from the viewpoint of machine learning. These studies have laid the ground for the feasibility of using EEG as a biometric authentication modality, but they have also raised security and privacy concerns as EEG data contains sensitive information. Existing research has used hash functions and cryptographic schemes to protect EEG data, but they do not provide functions for revoking compromised templates as in cancellable template design. This paper proposes the first cancellable EEG template design for privacy-preserving EEG-based authentication systems, which can protect raw EEG signals containing sensitive privacy information (e.g., identity, health and cognitive status). A novel cancellable EEG template is developed based on EEG graph features and a non-invertible transform. The proposed transformation provides cancellable templates, while taking advantage of EEG elicitation protocol fusion to enhance biometric performance. The proposed authentication system offers equivalent authentication performance (8.58\% EER on a public database) as in the non-transformed domain, while protecting raw EEG data. Furthermore, we analyze the system's capacity for resisting multiple attacks, and discuss some overlooked but critical issues and possible pitfalls involving hill-climbing attacks, second attacks, and classification-based authentication systems.


title: Symmetries of the Primordial Sky

abstract: Quantum field theory, which is generally used to describe the origin of large-scale gravitational perturbations during cosmic inflation, has been shown to omit an important physical effect in curved space-time, the nonlocal entanglement among quantized modes from their gravitational effect on causal structure. It is argued here that in a different model of quantum gravity that coherently preserves nonlocal directional and causal relationships, primordial perturbations originate instead from coherent quantum distortions of emergent inflationary horizons; and moreover, that causal constraints account for approximate symmetries of cosmic microwave background correlations measured at large angular separations, which are highly anomalous in the standard picture. Thus, symmetries already apparent in the large-angle CMB pattern may be unique signatures of the emergence of locality and causal structure from quantum gravity.


title: Spatio-Temporal Graph Convolutional Neural Networks for Physics-Aware Grid Learning Algorithms

abstract: This paper proposes a model-free Volt-VAR control (VVC) algorithm via the spatio-temporal graph ConvNet-based deep reinforcement learning (STGCN-DRL) framework, whose goal is to control smart inverters in an unbalanced distribution system. We first identify the graph shift operator (GSO) based on the power flow equations. Then, we develop a spatio-temporal graph ConvNet (STGCN), testing both recurrent graph ConvNets (RGCN) and convolutional graph ConvNets (CGCN) architectures, aimed at capturing the spatiotemporal correlation of voltage phasors. The STGCN layer performs the feature extraction task for the policy function and the value function of the reinforcement learning architecture, and then we utilize the proximal policy optimization (PPO) to search the action spaces for an optimum policy function and to approximate an optimum value function. We further utilize the low-pass property of voltage graph signal to introduce an GCN architecture for the the policy whose input is a decimated state vector, i.e. a partial observation. Case studies on the unbalanced 123-bus systems validate the excellent performance of the proposed method in mitigating instabilities and maintaining nodal voltage profiles within a desirable range.


title: Neuron Growth Output-Feedback Control by PDE Backstepping

abstract: Neurological injuries predominantly result in loss of functioning of neurons. These neurons may regain function after particular medical therapeutics, such as Chondroitinase ABC (ChABC), that promote axon elongation by manipulating the extracellular matrix, the network of extracellular macromolecules, and minerals that control the tubulin protein concentration, which is fundamental to axon elongation. We introduce an observer for the concentration of unmeasured tubulin along the axon, as well as in the growth cone, using the measurement of the axon length and the tubulin flux at the growth cone. We employ this observer in a boundary control law which actuates the tubulin concentration at the soma (nucleus), i.e., at the end of the axon distal from the measurement location. For this PDE system with a moving boundary, coupled with a two-state ODE system, we establish global exponential convergence of the observer and local exponential stabilization of the [axon, observer] system in the spatial $\mathcal{H}_1$-norm. The results require that the axon growth speed be bounded. For an open-loop observer, this is ensured by assumption (which requires that tubulin influx at the soma be limited), whereas for the output-feedback system the growth rate of the axon is ensured by assuming that the initial conditions of all the states, including the axon length, be sufficiently close to their setpoint values.


title: KMT-2021-BLG-1077L: The fifth confirmed multiplanetary system detected by microlensing

abstract: The high-magnification microlensing event KMT-2021-BLG-1077 exhibits a subtle and complex anomaly pattern in the region around the peak. We analyze the lensing light curve of the event with the aim of revealing the nature of the anomaly. We test various models in combination with several interpretations. We find that the anomaly cannot be explained by the usual three-body (2L1S and 1L2S) models. The 2L2S model improves the fit compared to the three-body models, but it still leaves noticeable residuals. On the other hand, the 3L1S interpretation yields a model explaining all the major anomalous features in the lensing light curve. According to the 3L1S interpretation, the estimated mass ratios of the lens companions to the primary are $\sim 1.56 \times 10^{-3}$ and $\sim 1.75 \times 10^{-3}$, which correspond to $\sim 1.6$ and $\sim 1.8$ times the Jupiter/Sun mass ratio, respectively, and therefore the lens is a multiplanetary system containing two giant planets. With the constraints of the event time-scale and angular Einstein radius, it is found that the host of the lens system is a low-mass star of mid-to-late M spectral type with a mass of $M_{\rm h} = 0.14^{+0.19}_{-0.07}~M_\odot$, and it hosts two gas giant planets with masses of $M_{\rm p_1}=0.22^{+0.31}_{-0.12}~M_{\rm J}$ and $M_{\rm p_2}=0.25^{+0.35}_{-0.13}~M_{\rm J}$. The planets lie beyond the snow line of the host with projected separations of $a_{\perp, {\rm p}_1}=1.26^{+1.41}_{-1.08}~{\rm AU}$ and $a_{\perp, {\rm p}_2}=0.93^{+1.05}_{-0.80}~{\rm AU}$. The planetary system resides in the Galactic bulge at a distance of $D_{\rm L}=8.24^{+1.02}_{-1.16}~{\rm kpc}$. The lens of the event is the fifth confirmed multiplanetary system detected by microlensing following OGLE-2006-BLG-109L, OGLE-2012-BLG-0026L, OGLE-2018-BLG-1011L, and OGLE-2019-BLG-0468L.


title: Gas Disk Sizes from CO Line Observations: A Test of Angular Momentum Evolution

abstract: The size of a disk encodes important information about its evolution. Combining new Submillimeter Array (SMA) observations with archival Atacama Large Millimeter Array (ALMA) data, we analyze mm continuum and CO emission line sizes for a sample of 44 protoplanetary disks around stars with masses of 0.15--2\,$M_{\odot}$ in several nearby star-forming regions. Sizes measured from $^{12}$CO line emission span from 50 to 1000\,au. This range could be explained by viscous evolution models with different $\alpha$ values (mostly of $10^{-4}-10^{-3}$) and/or a spread of initial conditions. The CO sizes for most disks are also consistent with MHD wind models that directly remove disk angular momentum, but very large initial disk sizes would be required to account for the very extended CO disks in the sample. As no CO size evolution is observed across stellar ages of 0.5--20\,Myr in this sample, determining the dominant mechanism of disk evolution will require a more complete sample for both younger and more evolved systems. We find that the CO emission is universally more extended than the continuum emission by an average factor of $2.9\pm1.2$. The ratio of the CO to continuum sizes does not show any trend with stellar mass, mm continuum luminosity, or the properties of substructures. The GO Tau disk has the most extended CO emission in this sample, with an extreme CO to continuum size ratio of 7.6. Seven additional disks in the sample show high size ratios ($\gtrsim4$) that we interpret as clear signs of substantial radial drift.


title: Long-time dynamical behavior for a piezoelectric system with magnetic effect and nonlinear dampings

abstract: This paper is concerned with the long-time dynamical behavior of a piezoelectric system with magnetic effect, which has nonlinear damping terms and external forces with a parameter. At first, we use the nonlinear semigroup theory to prove the well-posedness of solutions. Then, we investigate the properties of global attractors and the existence of exponential attractors. Finally, the upper semicontinuity of global attractors has been investigated.


title: The Bell-Touchard Counting process

abstract: The Poisson process is one of the simplest stochastic processes defined in continuous time, having interesting mathematical properties, leading, in many situations, to applications mathematically treatable. One of the limitations of the Poisson process is the rare events hypothesis; which is the hypothesis of unitary jumps within an infinitesimal window of time. Although that restriction may be avoided by the compound Poisson process, in most situations, we don't have a closed expression for the probability distribution of the increments of such processes, leaving us options such as working with probability generating functions, numerical analysis and simulations. It is with this motivation in mind, inspired by the recent developments of discrete distributions, that we propose a new counting process based on the Bell-Touchard probability distribution, naming it the Bell-Touchard process. We verify that the process is a compound Poisson process, a multiple Poisson process and that it is closed for convolution plus decomposition operations. Besides, we show that the Bell-Touchard process arises naturally from the composition of two Poisson processes. Moreover, we propose two generalizations; namely, the compound Bell-Touchard process and the non-homogeneous Bell-Touchard process, showing that the last one arises from the composition of a non-homogeneous Poisson process along with a homogeneous Poisson process. We emphasize that since previous works have been shown that the Bell-Touchard probability distribution can be used quite effectively for modelling count data, the Bell-Touchard process and its generalizations may contribute to the formulation of mathematical treatable models where the rare events hypothesis is not suitable.


title: Improving speaker de-identification with functional data analysis of f0 trajectories

abstract: Due to a constantly increasing amount of speech data that is stored in different types of databases, voice privacy has become a major concern. To respond to such concern, speech researchers have developed various methods for speaker de-identification. The state-of-the-art solutions utilize deep learning solutions which can be effective but might be unavailable or impractical to apply for, for example, under-resourced languages. Formant modification is a simpler, yet effective method for speaker de-identification which requires no training data. Still, remaining intonational patterns in formant-anonymized speech may contain speaker-dependent cues. This study introduces a novel speaker de-identification method, which, in addition to simple formant shifts, manipulates f0 trajectories based on functional data analysis. The proposed speaker de-identification method will conceal plausibly identifying pitch characteristics in a phonetically controllable manner and improve formant-based speaker de-identification up to 25%.


title: Chip-Based Laser with 1 Hertz Integrated Linewidth

abstract: Lasers with hertz-level linewidths on timescales up to seconds are critical for precision metrology, timekeeping, and manipulation of quantum systems. Such frequency stability typically relies on bulk-optic lasers and reference cavities, where increased size is leveraged to improve noise performance, but with the trade-off of cost, hand assembly, and limited application environments. On the other hand, planar waveguide lasers and cavities exploit the benefits of CMOS scalability but are fundamentally limited from achieving hertz-level linewidths at longer times by stochastic noise and thermal sensitivity inherent to the waveguide medium. These physical limits have inhibited the development of compact laser systems with frequency noise required for portable optical clocks that have performance well beyond conventional microwave counterparts. In this work, we break this paradigm to demonstrate a compact, high-coherence laser system at 1548 nm with a 1 s integrated linewidth of 1.1 Hz and fractional frequency instability less than 10$^{-14}$ from 1 ms to 1 s. The frequency noise at 1 Hz offset is suppressed by 11 orders of magnitude from that of the free-running diode laser down to the cavity thermal noise limit near 1 Hz$^2$/Hz, decreasing to 10$^{-3}$ Hz$^2$/Hz at 4 kHz offset. This low noise performance leverages wafer-scale integrated lasers together with an 8 mL vacuum-gap cavity that employs micro-fabricated mirrors with sub-angstrom roughness to yield an optical $Q$ of 11.8 billion. Significantly, all the critical components are lithographically defined on planar substrates and hold the potential for parallel high-volume manufacturing. Consequently, this work provides an important advance towards compact lasers with hertz-level linewidths for applications such as portable optical clocks, low-noise RF photonic oscillators, and related communication and navigation systems.


title: Hunting for neutrino emission from multi-frequency variable sources

abstract: Pinpointing the neutrino sources is crucial to unveil the mystery of high-energy cosmic rays. The search for neutrino-source candidates from coincident neutrino-photon signatures and electromagnetic objects with peculiar flaring behaviors have the potential to increase our chances of finding neutrino emitters. In this paper, we first study the temporal correlations of astrophysical flares with neutrinos, considering a few hundreds of multi-frequency sources from ALMA, WISE, Swift, and Fermi in the containment regions of IceCube high-energy alerts. Furthermore, the spatial correlations between blazars and neutrinos are investigated using the subset of 10-year IceCube track-like neutrinos with around 250 thousand events. In the second test, we account for 2700 blazars with different types of flaring phases in addition to sole position. No significant neutrino emissions were found from our analyses. Our results indicate an interesting trend showing the infrared flaring stages of WISE blazars might be correlated with arrival times of the neutrino alerts. Possible overflow of neutrinos associated with two of our blazar sub-samples are also illustrated. One is characterized by a significant flaring lag in infrared with respect to gamma-rays, like seen for TXS0506+056, and the other is characterized by highly simultaneous infrared and gamma-ray flares. These phenomena suggest the need to improve current multi-frequency light-curve catalogs to pair with the advent of more sensitive neutrino observatories.


title: Multi-gap topological conversion of Euler class via band-node braiding: minimal models, $PT$-linked nodal rings, and chiral heirs

abstract: The past few years have seen rapid progress in characterizing topological band structures using symmetry eigenvalue indicated methods. Recently, however, there has been increasing theoretical and experimental interest in multi-gap dependent topological phases that cannot be captured by this paradigm. These topologies arise by braiding band degeneracies that reside between different bands and carry non-Abelian charges due to the presence of either $C_2T$ or $PT$ symmetry, culminating in different invariants such as $\mathbb{Z}$-valued Euler class. Here, we present a universal formulation for Euler phases motivated by their homotopy classification that is related to the Skyrmion-profile of a single unit-vector in three-level systems, and that of two unit-vectors in four-level systems. In addition, upon employing the strategy of systematically building 3D models from a pair of sub-dimensional Euler phases, we show that phase transitions between any two inequivalent Euler phases are mediated by the presence of adjacent (in-gap) nodal rings linked with sub-gap nodal lines, forming trajectories corresponding to the braiding or debraiding of nodal points. The stability of the linked adjacent nodal rings is furthermore demonstrated to be indicated by an Euler class monopole charge matching with its $\mathbb{Z}$-valued linking numbers. We finally also systematically address the conversion of Euler phases into descendant Chern phases upon breaking the $C_2T$ or $PT$ symmetry. All the topological phases discussed in this work are corroborated with explicit minimal lattice models. These models can themselves directly serve as an extra impetus for experimental searches or be employed for theoretical studies, thereby underpinning the upcoming of this nascent pursuit.


title: On the number of $k$-powers in a finite word

abstract: This note is an attempt to attack a conjecture of Fraenkel and Simpson stated in 1998 concerning the number of distinct squares in a finite word. By counting the number of (right-)special factors, we give an upper bound of the number of {\em $k$-powers} in a finite word for any integer $k\geq 3$. By {\em $k$-power}, we mean a word of the form $\underbrace{uu...u}_{k \; \text{times}}$.


title: A Peek into the Political Biases in Email Spam Filtering Algorithms During US Election 2020

abstract: Email services use spam filtering algorithms (SFAs) to filter emails that are unwanted by the user. However, at times, the emails perceived by an SFA as unwanted may be important to the user. Such incorrect decisions can have significant implications if SFAs treat emails of user interest as spam on a large scale. This is particularly important during national elections. To study whether the SFAs of popular email services have any biases in treating the campaign emails, we conducted a large-scale study of the campaign emails of the US elections 2020 by subscribing to a large number of Presidential, Senate, and House candidates using over a hundred email accounts on Gmail, Outlook, and Yahoo. We analyzed the biases in the SFAs towards the left and the right candidates and further studied the impact of the interactions (such as reading or marking emails as spam) of email recipients on these biases. We observed that the SFAs of different email services indeed exhibit biases towards different political affiliations. We present this and several other important observations in this paper.


title: A unified construction of vertex algebras from infinite-dimensional Lie algebras

abstract: In this paper, we give a unified construction of vertex algebras arising from infinite-dimensional Lie algebras, including the affine Kac-Moody algebras, Virasoro algebras, Heisenberg algebras and their higher rank analogs, orbifolds and deformations. We define a notion of what we call quasi vertex Lie algebra to unify these Lie algebras. Starting from any (maximal) quasi vertex Lie algebra $\mathfrak{g}$, we construct a corresponding vertex Lie algebra ${\mathfrak{g}}_0$, and establish a canonical isomorphism between the category of restricted $\mathfrak{g}$-modules and that of equivariant $\phi$-coordinated quasi $V_{{\mathfrak{g}}_0}$-modules, where $V_{{\mathfrak{g}}_0}$ is the universal enveloping vertex algebra of ${\mathfrak{g}}_0$. This unified all the previous constructions of vertex algebras from infinite-dimensional Lie algebras and shed light on the way to associate vertex algebras with Lie algebras.


title: Channel Measurement and Characterization with Modified SAGE Algorithm in an Indoor Corridor at 300 GHz

abstract: The much higher frequencies in the Terahertz (THz) band prevent the effective utilization of channel models dedicated for microwave or millimeter-wave frequency bands. In this paper, a measurement campaign is conducted in an indoor corridor scenario at 306-321 GHz with a frequency-domain Vector Network Analyzer (VNA)-based sounder. To realize high-resolution multipath component (MPC) extraction for the direction-scan measurement campaigns in the THz band, a novel modified space-alternating generalized expectation-maximization (SAGE) algorithm is further proposed. Moreover, critical channel characteristics, including the path loss, shadow fading, K-factor, delay spread, angular spreads, cluster parameters, and cross correlations are calculated and analyzed in the LoS case. Besides, two contrasted measurement campaigns in the NLoS case are conducted, with and without additional reflective foils on walls to serve as effective scatterers. Comparison results indicate that the reflective foils are useful to improve the channel conditions in the NLoS case by nearly 6 dB, which is potential to be utilized as alternative of intelligent reflecting surfaces (IRS) to enhance the coverage ability of THz communications.


title: Resilient Distribution System Restoration with Communication Recovery by Drone Small Cells

abstract: Distribution system (DS) restoration after natural disasters often faces the challenge of communication failures to feeder automation (FA) facilities, resulting in prolonged load pick-up process. This letter discusses the utilization of drone small cells for wireless communication recovery of FA, and proposes an integrated DS restoration strategy with communication recovery. Demonstrative case studies are conducted to validate the proposed model, and its advantages are illustrated by comparing to benchmark strategies.


title: How Pre-trained Language Models Capture Factual Knowledge? A Causal-Inspired Analysis

abstract: Recently, there has been a trend to investigate the factual knowledge captured by Pre-trained Language Models (PLMs). Many works show the PLMs' ability to fill in the missing factual words in cloze-style prompts such as "Dante was born in [MASK]." However, it is still a mystery how PLMs generate the results correctly: relying on effective clues or shortcut patterns? We try to answer this question by a causal-inspired analysis that quantitatively measures and evaluates the word-level patterns that PLMs depend on to generate the missing words. We check the words that have three typical associations with the missing words: knowledge-dependent, positionally close, and highly co-occurred. Our analysis shows: (1) PLMs generate the missing factual words more by the positionally close and highly co-occurred words than the knowledge-dependent words; (2) the dependence on the knowledge-dependent words is more effective than the positionally close and highly co-occurred words. Accordingly, we conclude that the PLMs capture the factual knowledge ineffectively because of depending on the inadequate associations.


title: Topological Optimization with Big Steps

abstract: Using persistent homology to guide optimization has emerged as a novel application of topological data analysis. Existing methods treat persistence calculation as a black box and backpropagate gradients only onto the simplices involved in particular pairs. We show how the cycles and chains used in the persistence calculation can be used to prescribe gradients to larger subsets of the domain. In particular, we show that in a special case, which serves as a building block for general losses, the problem can be solved exactly in linear time. This relies on another contribution of this paper, which eliminates the need to examine a factorial number of permutations of simplices with the same value. We present empirical experiments that show the practical benefits of our algorithm: the number of steps required for the optimization is reduced by an order of magnitude.


title: SpecGrad: Diffusion Probabilistic Model based Neural Vocoder with Adaptive Noise Spectral Shaping

abstract: Neural vocoder using denoising diffusion probabilistic model (DDPM) has been improved by adaptation of the diffusion noise distribution to given acoustic features. In this study, we propose SpecGrad that adapts the diffusion noise so that its time-varying spectral envelope becomes close to the conditioning log-mel spectrogram. This adaptation by time-varying filtering improves the sound quality especially in the high-frequency bands. It is processed in the time-frequency domain to keep the computational cost almost the same as the conventional DDPM-based neural vocoders. Experimental results showed that SpecGrad generates higher-fidelity speech waveform than conventional DDPM-based neural vocoders in both analysis-synthesis and speech enhancement scenarios. Audio demos are available at wavegrad.github.io/specgrad/.


title: Torus orbit closures in the flag variety

abstract: The study of torus orbit closures in the (complete) flag variety was initiated by Klyachko and Gelfand--Serganova in the mid-1980s, but it seems that not much has been done since then. In this chapter, we present some of the work by Klyachko and Gelfand--Serganova and our recent work on the topology, geometry, and combinatorics of torus orbit closures in the flag variety.


title: An unsupervised cluster-level based method for learning node representations of heterogeneous graphs in scientific papers

abstract: Learning knowledge representation of scientific paper data is a problem to be solved, and how to learn the representation of paper nodes in scientific paper heterogeneous network is the core to solve this problem. This paper proposes an unsupervised cluster-level scientific paper heterogeneous graph node representation learning method (UCHL), aiming at obtaining the representation of nodes (authors, institutions, papers, etc.) in the heterogeneous graph of scientific papers. Based on the heterogeneous graph representation, this paper performs link prediction on the entire heterogeneous graph and obtains the relationship between the edges of the nodes, that is, the relationship between papers and papers. Experiments results show that the proposed method achieves excellent performance on multiple evaluation metrics on real scientific paper datasets.


title: Higher-order boundary layers and regularity for Stokes systems over rough boundaries

abstract: In this paper, we study the large-scale boundary regularity for the Stokes system in periodically oscillating John domains. Our main contribution is the construction of boundary layer correctors of arbitrary order. This is a significant generalization of the known results restricted to the first and second orders. As an application, we prove the large-scale regularity estimate, as well as a Liouville theorem, of arbitrary order for the Stokes system. Our results are also related to higher-order boundary layer tails and wall laws in viscous fluids over rough boundaries.


title: Observable vacuum energy is finite in expanding space

abstract: In this work I reason that in expanding space only those quantum modes contribute to the measured vacuum energy that do not transcend the observable volume. Since all quantised field modes have various observable consequences, when a gravitational horizon causally confines an observer to a finite volume quantised modes should be restricted to the observable patch to remain consistent with gravity. Within the observable patch of Friedmann-Lemaitre-Robertson-Walker (FLRW) space the vacuum expectation value of the energy-momentum tensor can be expressed as a sum over discrete field modes. Friedmann's first equation provides a straightforward ultraviolet cut-off allowing only a finite number of modes in the sum. The finite volume acts as an infrared regulator and the calculation of the vacuum energy density is tractable without regularisation and renormalisation. To test the validity of this idea I quantise a scalar field on an FLRW background and calculate its vacuum energy density in the vacuum dominated, conformal, holographic limit. In this limit I show that the quantum vacuum energy density scales with the square of the Hubble parameter, consistently with gravity. In this example quantum vacuum expands space while the horizon of the expanding space limits the energy density of the vacuum to the observed value.


title: Personalized Image Aesthetics Assessment with Rich Attributes

abstract: Personalized image aesthetics assessment (PIAA) is challenging due to its highly subjective nature. People's aesthetic tastes depend on diversified factors, including image characteristics and subject characters. The existing PIAA databases are limited in terms of annotation diversity, especially the subject aspect, which can no longer meet the increasing demands of PIAA research. To solve the dilemma, we conduct so far, the most comprehensive subjective study of personalized image aesthetics and introduce a new Personalized image Aesthetics database with Rich Attributes (PARA), which consists of 31,220 images with annotations by 438 subjects. PARA features wealthy annotations, including 9 image-oriented objective attributes and 4 human-oriented subjective attributes. In addition, desensitized subject information, such as personality traits, is also provided to support study of PIAA and user portraits. A comprehensive analysis of the annotation data is provided and statistic study indicates that the aesthetic preferences can be mirrored by proposed subjective attributes. We also propose a conditional PIAA model by utilizing subject information as conditional prior. Experimental results indicate that the conditional PIAA model can outperform the control group, which is also the first attempt to demonstrate how image aesthetics and subject characters interact to produce the intricate personalized tastes on image aesthetics. We believe the database and the associated analysis would be useful for conducting next-generation PIAA study. The project page of PARA can be found at: https://cv-datasets.institutecv.com/#/data-sets.


title: Stochastic Backpropagation: A Memory Efficient Strategy for Training Video Models

abstract: We propose a memory efficient method, named Stochastic Backpropagation (SBP), for training deep neural networks on videos. It is based on the finding that gradients from incomplete execution for backpropagation can still effectively train the models with minimal accuracy loss, which attributes to the high redundancy of video. SBP keeps all forward paths but randomly and independently removes the backward paths for each network layer in each training step. It reduces the GPU memory cost by eliminating the need to cache activation values corresponding to the dropped backward paths, whose amount can be controlled by an adjustable keep-ratio. Experiments show that SBP can be applied to a wide range of models for video tasks, leading to up to 80.0% GPU memory saving and 10% training speedup with less than 1% accuracy drop on action recognition and temporal action detection.


title: Casual 6-DoF: free-viewpoint panorama using a handheld 360 camera

abstract: Six degrees-of-freedom (6-DoF) video provides telepresence by enabling users to move around in the captured scene with a wide field of regard. Compared to methods requiring sophisticated camera setups, the image-based rendering method based on photogrammetry can work with images captured with any poses, which is more suitable for casual users. However, existing image-based rendering methods are based on perspective images. When used to reconstruct 6-DoF views, it often requires capturing hundreds of images, making data capture a tedious and time-consuming process. In contrast to traditional perspective images, 360{\deg} images capture the entire surrounding view in a single shot, thus, providing a faster capturing process for 6-DoF view reconstruction. This paper presents a novel method to provide 6-DoF experiences over a wide area using an unstructured collection of 360{\deg} panoramas captured by a conventional 360{\deg} camera. Our method consists of 360{\deg} data capturing, novel depth estimation to produce a high-quality spherical depth panorama, and high-fidelity free-viewpoint generation. We compared our method against state-of-the-art methods, using data captured in various environments. Our method shows better visual quality and robustness in the tested scenes.


title: Exploiting Single-Channel Speech for Multi-Channel End-to-End Speech Recognition: A Comparative Study

abstract: Recently, the end-to-end training approach for multi-channel ASR has shown its effectiveness, which usually consists of a beamforming front-end and a recognition back-end. However, the end-to-end training becomes more difficult due to the integration of multiple modules, particularly considering that multi-channel speech data recorded in real environments are limited in size. This raises the demand to exploit the single-channel data for multi-channel end-to-end ASR. In this paper, we systematically compare the performance of three schemes to exploit external single-channel data for multi-channel end-to-end ASR, namely back-end pre-training, data scheduling, and data simulation, under different settings such as the sizes of the single-channel data and the choices of the front-end. Extensive experiments on CHiME-4 and AISHELL-4 datasets demonstrate that while all three methods improve the multi-channel end-to-end speech recognition performance, data simulation outperforms the other two, at the cost of longer training time. Data scheduling outperforms back-end pre-training marginally but nearly consistently, presumably because that in the pre-training stage, the back-end tends to overfit on the single-channel data, especially when the single-channel data size is small.


title: CUSIDE: Chunking, Simulating Future Context and Decoding for Streaming ASR

abstract: History and future contextual information are known to be important for accurate acoustic modeling. However, acquiring future context brings latency for streaming ASR. In this paper, we propose a new framework - Chunking, Simulating Future Context and Decoding (CUSIDE) for streaming speech recognition. A new simulation module is introduced to recursively simulate the future contextual frames, without waiting for future context. The simulation module is jointly trained with the ASR model using a self-supervised loss; the ASR model is optimized with the usual ASR loss, e.g., CTC-CRF as used in our experiments. Experiments show that, compared to using real future frames as right context, using simulated future context can drastically reduce latency while maintaining recognition accuracy. With CUSIDE, we obtain new state-of-the-art streaming ASR results on the AISHELL-1 dataset.


title: How to Report and Benchmark Emerging Field-Effect Transistors

abstract: Emerging low-dimensional nanomaterials have been studied for decades in device applications as field-effect transistors (FETs). However, properly reporting and comparing device performance has been challenging due to the involvement and interlinking of multiple device parameters. More importantly, the interdisciplinarity of this research community results in a lack of consistent reporting and benchmarking guidelines. Here we report a consensus among the authors regarding guidelines for reporting and benchmarking important FET parameters and performance metrics. We provide an example of this reporting and benchmarking process for a two-dimensional (2D) semiconductor FET. Our consensus will help promote an improved approach for assessing device performance in emerging FETs, thus aiding the field to progress more consistently and meaningfully.


title: Effective data screening technique for crowdsourced speech intelligibility experiments: Evaluation with IRM-based speech enhancement

abstract: It is essential to perform speech intelligibility (SI) experiments with human listeners in order to evaluate objective intelligibility measures for developing effective speech enhancement and noise reduction algorithms. Recently, crowdsourced remote testing has become a popular means for collecting a massive amount and variety of data at a relatively small cost and in a short time. However, careful data screening is essential for attaining reliable SI data. We performed SI experiments on speech enhanced by an "oracle" ideal ratio mask (IRM) in a well-controlled laboratory and in crowdsourced remote environments that could not be controlled directly. We introduced simple tone pip tests, in which participants were asked to report the number of audible tone pips, to estimate their listening levels above audible thresholds. The tone pip tests were very effective for data screening to reduce the variability of crowdsourced remote results so that the laboratory results would become similar. The results also demonstrated the SI of an oracle IRM, giving us the upper limit of the mask-based single-channel speech enhancement.


title: MeMOT: Multi-Object Tracking with Memory

abstract: We propose an online tracking algorithm that performs the object detection and data association under a common framework, capable of linking objects after a long time span. This is realized by preserving a large spatio-temporal memory to store the identity embeddings of the tracked objects, and by adaptively referencing and aggregating useful information from the memory as needed. Our model, called MeMOT, consists of three main modules that are all Transformer-based: 1) Hypothesis Generation that produce object proposals in the current video frame; 2) Memory Encoding that extracts the core information from the memory for each tracked object; and 3) Memory Decoding that solves the object detection and data association tasks simultaneously for multi-object tracking. When evaluated on widely adopted MOT benchmark datasets, MeMOT observes very competitive performance.


title: Mapping Topics in 100,000 Real-life Moral Dilemmas

abstract: Moral dilemmas play an important role in theorizing both about ethical norms and moral psychology. Yet thought experiments borrowed from the philosophical literature often lack the nuances and complexity of real life. We leverage 100,000 threads -- the largest collection to date -- from Reddit's r/AmItheAsshole to examine the features of everyday moral dilemmas. Combining topic modeling with evaluation from both expert and crowd-sourced workers, we discover 47 finer-grained, meaningful topics and group them into five meta-categories. We show that most dilemmas combine at least two topics, such as family and money. We also observe that the pattern of topic co-occurrence carries interesting information about the structure of everyday moral concerns: for example, the generation of moral dilemmas from nominally neutral topics, and interaction effects in which final verdicts do not line up with the moral concerns in the original stories in any simple way. Our analysis demonstrates the utility of a fine-grained data-driven approach to online moral dilemmas, and provides a valuable resource for researchers aiming to explore the intersection of practical and theoretical ethics.


title: CREATE: A Benchmark for Chinese Short Video Retrieval and Title Generation

abstract: Previous works of video captioning aim to objectively describe the video's actual content, which lacks subjective and attractive expression, limiting its practical application scenarios. Video titling is intended to achieve this goal, but there is a lack of a proper benchmark. In this paper, we propose to CREATE, the first large-scale Chinese shoRt vidEo retrievAl and Title gEneration benchmark, to facilitate research and application in video titling and video retrieval in Chinese. CREATE consists of a high-quality labeled 210K dataset and two large-scale 3M/10M pre-training datasets, covering 51 categories, 50K+ tags, 537K manually annotated titles and captions, and 10M+ short videos. Based on CREATE, we propose a novel model ALWIG which combines video retrieval and video titling tasks to achieve the purpose of multi-modal ALignment WIth Generation with the help of video tags and a GPT pre-trained model. CREATE opens new directions for facilitating future research and applications on video titling and video retrieval in the field of Chinese short videos.


title: Exclusion Volumes of Convex Bodies in High Space Dimensions: Applications to Virial Coefficients and Continuum Percolation

abstract: Using the concepts of mixed volumes and quermassintegrals of convex geometry, we derive an exact formula for the exclusion volume for a general convex body that applies in any space dimension, including both the rotationally-averaged exclusion volume and with the same orientation. We show that the sphere minimizes the dimensionless exclusion volume $v_{ex}(K)/v(K)$ among all convex bodies, whether randomly oriented or uniformly oriented, for any $d$, where $v(K)$ is the volume of $K$. When the bodies have the same orientation, the simplex maximizes the dimensionless exclusion volume for any $d$ with a large-$d$ asymptotic scaling behavior of $2^{2d}/d^{3/2}$, which is to be contrasted with the scaling of $2^d$ for the sphere. We present explicit formulas for quermassintegrals for many nonspherical convex bodies as well as as well as lower-dimensional bodies. These results are utilized to determine the rotationally-averaged exclusion volume for these shapes for dimensions 2 through 12. While the sphere is the shape possessing the minimal dimensionless exclusion volume, among the convex bodies considered that are sufficiently compact, the simplex possesses the maximal dimensionless exclusion volume with a scaling behavior of $2^{1.6618\ldots d}$. We also determine the corresponding second virial coefficient $B_2(K)$ of the aforementioned hard hyperparticles and compute estimates of the continuum percolation threshold $\eta_c$ derived previously by the authors. We conjecture that overlapping spheres possess the maximal value of $\eta_c$ among all identical nonzero-volume convex overlapping bodies for $d \ge 2$, randomly or uniformly oriented, and that, among all identical, oriented nonzero-volume convex bodies, overlapping simplices have the minimal value of $\eta_c$ for $d\ge 2$.


title: Approximation by Simple Poles -- Part II: System Level Synthesis Beyond Finite Impulse Response

abstract: In Part I, a novel Galerkin-type method for finite dimensional approximations of transfer functions in Hardy space was developed based on approximation by simple poles. In Part II, this approximation is applied to system level synthesis, a recent approach based on a clever reparameterization, to develop a new technique for optimal control design. To solve system level synthesis problems, prior work relies on finite impulse response approximations that lead to deadbeat control, and that can experience infeasibility and increased suboptimality, especially in systems with large separation of time scales. The new design method does not result in deadbeat control, is convex and tractable, always feasible, can incorporate prior knowledge, and works well for systems with large separation of time scales. Suboptimality bounds with convergence rate depending on the geometry of the pole selection are provided. An example demonstrates superior performance of the method.


title: First-principles method for nonlinear light propagation at oblique incidence

abstract: We have developed a computational method to describe the nonlinear light propagation of an intense and ultrashort pulse at oblique incidence on a flat surface. In the method, coupled equations of macroscopic light propagation and microscopic electron dynamics are simultaneously solved using a multiscale modeling. The microscopic electronic motion is described by first-principles time-dependent density functional theory. The macroscopic Maxwell equations that describe oblique light propagation are transformed into one-dimensional wave equations. As an illustration of the method, light propagation at oblique incidence on a silicon thin film is presented.


title: SpatioTemporal Focus for Skeleton-based Action Recognition

abstract: Graph convolutional networks (GCNs) are widely adopted in skeleton-based action recognition due to their powerful ability to model data topology. We argue that the performance of recent proposed skeleton-based action recognition methods is limited by the following factors. First, the predefined graph structures are shared throughout the network, lacking the flexibility and capacity to model the multi-grain semantic information. Second, the relations among the global joints are not fully exploited by the graph local convolution, which may lose the implicit joint relevance. For instance, actions such as running and waving are performed by the co-movement of body parts and joints, e.g., legs and arms, however, they are located far away in physical connection. Inspired by the recent attention mechanism, we propose a multi-grain contextual focus module, termed MCF, to capture the action associated relation information from the body joints and parts. As a result, more explainable representations for different skeleton action sequences can be obtained by MCF. In this study, we follow the common practice that the dense sample strategy of the input skeleton sequences is adopted and this brings much redundancy since number of instances has nothing to do with actions. To reduce the redundancy, a temporal discrimination focus module, termed TDF, is developed to capture the local sensitive points of the temporal dynamics. MCF and TDF are integrated into the standard GCN network to form a unified architecture, named STF-Net. It is noted that STF-Net provides the capability to capture robust movement patterns from these skeleton topology structures, based on multi-grain context aggregation and temporal dependency. Extensive experimental results show that our STF-Net significantly achieves state-of-the-art results on three challenging benchmarks NTU RGB+D 60, NTU RGB+D 120, and Kinetics-skeleton.


title: ReSTR: Convolution-free Referring Image Segmentation Using Transformers

abstract: Referring image segmentation is an advanced semantic segmentation task where target is not a predefined class but is described in natural language. Most of existing methods for this task rely heavily on convolutional neural networks, which however have trouble capturing long-range dependencies between entities in the language expression and are not flexible enough for modeling interactions between the two different modalities. To address these issues, we present the first convolution-free model for referring image segmentation using transformers, dubbed ReSTR. Since it extracts features of both modalities through transformer encoders, it can capture long-range dependencies between entities within each modality. Also, ReSTR fuses features of the two modalities by a self-attention encoder, which enables flexible and adaptive interactions between the two modalities in the fusion process. The fused features are fed to a segmentation module, which works adaptively according to the image and language expression in hand. ReSTR is evaluated and compared with previous work on all public benchmarks, where it outperforms all existing models.


title: Large-gap insulating dimer ground state in monolayer IrTe2

abstract: Monolayers of two-dimensional van der Waals materials exhibit novel electronic phases distinct from their bulk due to the symmetry breaking and reduced screening in the absence of the interlayer coupling. In this work, we combine angle-resolved photoemission spectroscopy and scanning tunneling microscopy/spectroscopy to demonstrate the emergence of a unique insulating 2 x 1 dimer ground state in monolayer 1T-IrTe2 that has a large band gap in contrast to the metallic bilayer-to-bulk forms of this material. First-principles calculations reveal that phonon and charge instabilities as well as local bond formation collectively enhance and stabilize a charge-ordered ground state. Our findings provide important insights into the subtle balance of interactions having similar energy scales that occurs in the absence of strong interlayer coupling, which offers new opportunities to engineer the properties of 2D monolayers.


title: BV spaces and the perimeters related to Schrodinger operators with inverse-square potentials and applications to the rank-one theorem

abstract: For $a \ge - {( \frac{{d}}{2}- 1)^2} $ and $2\sigma= {{d - 2}}-( {{{(d - 2)}^2} + 4a})^{1/2}$, let $$\begin{cases}\mathcal{H}_{a}= - \Delta + \frac{a} {{{{ | x |}^2}}},\\ \mathcal{\widetilde{H}}_{\sigma}= 2\big( { - \Delta + \frac{{{\sigma ^2}}} {{{{ | x |}^2}}}}\big)\end{cases}$$ be two Schr\"odinger operators with inverse-square potentials. In this paper, on the domain $\Omega \subset {\mathbb {R}^d}\backslash \{ 0\}, d\geq 2,$ %apart from the origin, the ${\mathcal{H} _a}$-BV space $\mathcal{B} {\mathcal{V} _{{\mathcal{H} _a}}}(\Omega )$ and the ${\mathcal{\widetilde{H}}_{\sigma}}$-BV space $\mathcal{B} {\mathcal{V} _{{\mathcal{\widetilde H} _\sigma}}}(\Omega )$ related to $\mathcal{H}_{a}$ and $\mathcal{\widetilde{H}}_{\sigma}$ are introduced, respectively. We investigate a series of basic properties of $\mathcal{B} {\mathcal{V} _{{\mathcal{H} _a}}}(\Omega )$ and $\mathcal{B} {\mathcal{V} _{{\mathcal{\widetilde H} _{\sigma}}}}(\Omega )$. Furthermore, we prove that ${\mathcal{\widetilde{H}}_{\sigma}}$-restricted BV functions can be characterized equivalently via their subgraphs. As applications, we derive the rank-one theorem for ${\mathcal{\widetilde{H}}_{\sigma}}$-restricted BV functions.


title: LAKe-Net: Topology-Aware Point Cloud Completion by Localizing Aligned Keypoints

abstract: Point cloud completion aims at completing geometric and topological shapes from a partial observation. However, some topology of the original shape is missing, existing methods directly predict the location of complete points, without predicting structured and topological information of the complete shape, which leads to inferior performance. To better tackle the missing topology part, we propose LAKe-Net, a novel topology-aware point cloud completion model by localizing aligned keypoints, with a novel Keypoints-Skeleton-Shape prediction manner. Specifically, our method completes missing topology using three steps: 1) Aligned Keypoint Localization. An asymmetric keypoint locator, including an unsupervised multi-scale keypoint detector and a complete keypoint generator, is proposed for localizing aligned keypoints from complete and partial point clouds. We theoretically prove that the detector can capture aligned keypoints for objects within a sub-category. 2) Surface-skeleton Generation. A new type of skeleton, named Surface-skeleton, is generated from keypoints based on geometric priors to fully represent the topological information captured from keypoints and better recover the local details. 3) Shape Refinement. We design a refinement subnet where multi-scale surface-skeletons are fed into each recursive skeleton-assisted refinement module to assist the completion process. Experimental results show that our method achieves the state-of-the-art performance on point cloud completion.


title: Learning Decoupling Features Through Orthogonality Regularization

abstract: Keyword spotting (KWS) and speaker verification (SV) are two important tasks in speech applications. Research shows that the state-of-art KWS and SV models are trained independently using different datasets since they expect to learn distinctive acoustic features. However, humans can distinguish language content and the speaker identity simultaneously. Motivated by this, we believe it is important to explore a method that can effectively extract common features while decoupling task-specific features. Bearing this in mind, a two-branch deep network (KWS branch and SV branch) with the same network structure is developed and a novel decoupling feature learning method is proposed to push up the performance of KWS and SV simultaneously where speaker-invariant keyword representations and keyword-invariant speaker representations are expected respectively. Experiments are conducted on Google Speech Commands Dataset (GSCD). The results demonstrate that the orthogonality regularization helps the network to achieve SOTA EER of 1.31% and 1.87% on KWS and SV, respectively.


title: SpeechPrompt: An Exploration of Prompt Tuning on Generative Spoken Language Model for Speech Processing Tasks

abstract: Speech representations learned from Self-supervised learning (SSL) models can benefit various speech processing tasks. However, utilizing SSL representations usually requires fine-tuning the pre-trained models or designing task-specific downstream models and loss functions, causing much memory usage and human labor. Recently, prompting in Natural Language Processing (NLP) has been found to be an efficient technique to leverage pre-trained language models (LMs). Specifically, prompt tuning optimizes a limited number of task-specific parameters with a fixed pre-trained model; as a result, only a small set of parameters is needed to be stored for each task. Prompt tuning improves computation and memory efficiency by leveraging the pre-trained LM's prediction ability. Nevertheless, such a paradigm is little studied in the speech community. We report in this paper the first exploration of the prompt tuning paradigm for speech processing tasks based on Generative Spoken Language Model (GSLM). Experiment results show that the prompt tuning technique achieves competitive performance in speech classification tasks with fewer trainable parameters than fine-tuning specialized downstream models. We further study the technique in challenging sequence generation tasks. Prompt tuning also demonstrates its potential, while the limitation and possible research directions are discussed in this paper. The source code is available on https://github.com/ga642381/SpeechPrompt.


title: On the variation of the Frobenius in a non abelian Iwasawa tower

abstract: For varieties over a finite field $\mathbb F_q$ with "many" automorphisms, we study the $\ell$-adic properties of the eigenvalues of the Frobenius operator on their cohomology. The main goal of this paper is to consider towers such as $y^2 = f(x^{\ell^n})$ and prove that the characteristic polynomials of the Frobenius on the \'etale cohomology show a surprising $\ell$-adic convergence. We prove this by proving a more general statement about the convergence of certain invariants related to a skew-abelian cohomology group. Along the way, we will prove that many natural sequences $(x_n)_{n\geq 1} \in \mathbb Z_\ell^{\mathbb N}$ converge $\ell$-adically and give explicit rates of convergence. In a different direction, we provide a precise criterion for curves with many automorphisms to be supersingular, generalizing and unifying many old results.


title: Bangla hate speech detection on social media using attention-based recurrent neural network

abstract: Hate speech has spread more rapidly through the daily use of technology and, most notably, by sharing your opinions or feelings on social media in a negative aspect. Although numerous works have been carried out in detecting hate speeches in English, German, and other languages, very few works have been carried out in the context of the Bengali language. In contrast, millions of people communicate on social media in Bengali. The few existing works that have been carried out need improvements in both accuracy and interpretability. This article proposed encoder decoder based machine learning model, a popular tool in NLP, to classify user's Bengali comments on Facebook pages. A dataset of 7,425 Bengali comments, consisting of seven distinct categories of hate speeches, was used to train and evaluate our model. For extracting and encoding local features from the comments, 1D convolutional layers were used. Finally, the attention mechanism, LSTM, and GRU based decoders have been used for predicting hate speech categories. Among the three encoder decoder algorithms, the attention-based decoder obtained the best accuracy (77%).


title: An Empirical Study of Language Model Integration for Transducer based Speech Recognition

abstract: Utilizing text-only data with an external language model (ELM) in end-to-end RNN-Transducer (RNN-T) for speech recognition is challenging. Recently, a class of methods such as density ratio (DR) and internal language model estimation (ILME) have been developed, outperforming the classic shallow fusion (SF) method. The basic idea behind these methods is that RNN-T posterior should first subtract the implicitly learned internal language model (ILM) prior, in order to integrate the ELM. While recent studies suggest that RNN-T only learns some low-order language model information, the DR method uses a well-trained neural language model with full context, which may be inappropriate for the estimation of ILM and deteriorate the integration performance. Based on the DR method, we propose a low-order density ratio method (LODR) by replacing the estimation with a low-order weak language model. Extensive empirical experiments are conducted on both in-domain and cross-domain scenarios on English LibriSpeech & Tedlium-2 and Chinese WenetSpeech & AISHELL-1 datasets. It is shown that LODR consistently outperforms SF in all tasks, while performing generally close to ILME and better than DR in most tests.


title: Mask Atari for Deep Reinforcement Learning as POMDP Benchmarks

abstract: We present Mask Atari, a new benchmark to help solve partially observable Markov decision process (POMDP) problems with Deep Reinforcement Learning (DRL)-based approaches. To achieve a simulation environment for the POMDP problems, Mask Atari is constructed based on Atari 2600 games with controllable, moveable, and learnable masks as the observation area for the target agent, especially with the active information gathering (AIG) setting in POMDPs. Given that one does not yet exist, Mask Atari provides a challenging, efficient benchmark for evaluating the methods that focus on the above problem. Moreover, the mask operation is a trial for introducing the receptive field in the human vision system into a simulation environment for an agent, which means the evaluations are not biased from the sensing ability and purely focus on the cognitive performance of the methods when compared with the human baseline. We describe the challenges and features of our benchmark and evaluate several baselines with Mask Atari.


title: ViSTA: Vision and Scene Text Aggregation for Cross-Modal Retrieval

abstract: Visual appearance is considered to be the most important cue to understand images for cross-modal retrieval, while sometimes the scene text appearing in images can provide valuable information to understand the visual semantics. Most of existing cross-modal retrieval approaches ignore the usage of scene text information and directly adding this information may lead to performance degradation in scene text free scenarios. To address this issue, we propose a full transformer architecture to unify these cross-modal retrieval scenarios in a single $\textbf{Vi}$sion and $\textbf{S}$cene $\textbf{T}$ext $\textbf{A}$ggregation framework (ViSTA). Specifically, ViSTA utilizes transformer blocks to directly encode image patches and fuse scene text embedding to learn an aggregated visual representation for cross-modal retrieval. To tackle the modality missing problem of scene text, we propose a novel fusion token based transformer aggregation approach to exchange the necessary scene text information only through the fusion token and concentrate on the most important features in each modality. To further strengthen the visual modality, we develop dual contrastive learning losses to embed both image-text pairs and fusion-text pairs into a common cross-modal space. Compared to existing methods, ViSTA enables to aggregate relevant scene text semantics with visual appearance, and hence improve results under both scene text free and scene text aware scenarios. Experimental results show that ViSTA outperforms other methods by at least $\bf{8.4}\%$ at Recall@1 for scene text aware retrieval task. Compared with state-of-the-art scene text free retrieval methods, ViSTA can achieve better accuracy on Flicker30K and MSCOCO while running at least three times faster during the inference stage, which validates the effectiveness of the proposed framework.


title: The Calder\'on problem with finitely many unknowns is equivalent to convex semidefinite optimization

abstract: We consider the inverse boundary value problem of determining a coefficient function in an elliptic partial differential equation from knowledge of the associated Neumann-Dirichlet-operator. The unknown coefficient function is assumed to be piecewise constant with respect to a given pixel partition, and upper and lower bounds are assumed to be known a-priori. We will show that this Calder\'on problem with finitely many unknowns can be equivalently formulated as a minimization problem for a linear cost functional with a convex non-linear semidefinite constraint. We also prove error estimates for noisy data, and extend the result to the practically relevant case of finitely many measurements, where the coefficient is to be reconstructed from a finite-dimensional Galerkin projection of the Neumann-Dirichlet-operator. Our result is based on previous works on Loewner monotonicity and convexity of the Neumann-Dirichlet-operator, and the technique of localized potentials. It connects the emerging fields of inverse coefficient problems and semidefinite optimization.


title: A Pixel-based Encryption Method for Privacy-Preserving Deep Learning Models

abstract: In the recent years, pixel-based perceptual algorithms have been successfully applied for privacy-preserving deep learning (DL) based applications. However, their security has been broken in subsequent works by demonstrating a chosen-plaintext attack. In this paper, we propose an efficient pixel-based perceptual encryption method. The method provides a necessary level of security while preserving the intrinsic properties of the original image. Thereby, can enable deep learning (DL) applications in the encryption domain. The method is substitution based where pixel values are XORed with a sequence (as opposed to a single value used in the existing methods) generated by a chaotic map. We have used logistic maps for their low computational requirements. In addition, to compensate for any inefficiency because of the logistic maps, we use a second key to shuffle the sequence. We have compared the proposed method in terms of encryption efficiency and classification accuracy of the DL models on them. We have validated the proposed method with CIFAR datasets. The analysis shows that when classification is performed on the cipher images, the model preserves accuracy of the existing methods while provides better security.


title: Misogynistic Meme Detection using Early Fusion Model with Graph Network

abstract: In recent years , there has been an upsurge in a new form of entertainment medium called memes. These memes although seemingly innocuous have transcended onto the boundary of online harassment against women and created an unwanted bias against them . To help alleviate this problem , we propose an early fusion model for prediction and identification of misogynistic memes and its type in this paper for which we participated in SemEval-2022 Task 5 . The model receives as input meme image with its text transcription with a target vector. Given that a key challenge with this task is the combination of different modalities to predict misogyny, our model relies on pretrained contextual representations from different state-of-the-art transformer-based language models and pretrained image pretrained models to get an effective image representation. Our model achieved competitive results on both SubTask-A and SubTask-B with the other competition teams and significantly outperforms the baselines.


title: Weakly Supervised Patch Label Inference Networks for Efficient Pavement Distress Detection and Recognition in the Wild

abstract: Automatic image-based pavement distress detection and recognition are vital for pavement maintenance and management. However, existing deep learning-based methods largely omit the specific characteristics of pavement images, such as high image resolution and low distress area ratio, and are not end-to-end trainable. In this paper, we present a series of simple yet effective end-to-end deep learning approaches named Weakly Supervised Patch Label Inference Networks (WSPLIN) for efficiently addressing these tasks under various application settings. WSPLIN transforms the fully supervised pavement image classification problem into a weakly supervised pavement patch classification problem for solutions. Specifically, WSPLIN first divides the pavement image under different scales into patches with different collection strategies and then employs a Patch Label Inference Network (PLIN) to infer the labels of these patches to fully exploit the resolution and scale information. Notably, we design a patch label sparsity constraint based on the prior knowledge of distress distribution and leverage the Comprehensive Decision Network (CDN) to guide the training of PLIN in a weakly supervised way. Therefore, the patch labels produced by PLIN provide interpretable intermediate information, such as the rough location and the type of distress. We evaluate our method on a large-scale bituminous pavement distress dataset named CQU-BPDD and the augmented Crack500 (Crack500-PDD) dataset, which is a newly constructed pavement distress detection dataset augmented from the Crack500. Extensive results demonstrate the superiority of our method over baselines in both performance and efficiency. The source codes of WSPLIN are released on https://github.com/DearCaat/wsplin.


title: Mode-walk-off interferometry for position-resolved optical fiber sensing

abstract: Simultaneously sensing and resolving the position of measurands along an optical fiber enables numerous opportunities, especially for application in environments where massive sensor deployment is not feasible. Despite significant progress in techniques based on round-trip time-of-flight measurements, the need for bidirectional propagation imposes fundamental barriers to their deployment in fiber communication links containing non-reciprocal elements. In this work, we break this barrier by introducing a position-resolved sensing technique based on the interference of two weakly-coupled non-degenerate modes of an optical fiber, as they walk-off through each other. We use this mode-walk-off interferometry to experimentally measure and localize physical changes to the fiber under test (axial strain and temperature) without the typical requirement of round-trip time-of-flight measurements. The unidirectional propagation requirement of this method makes it compatible with fiber links incorporating non-reciprocal elements, uncovering a path for multiple sensing applications, including ultra-long range distributed sensing in amplified space-division-multiplexed telecommunication links.


title: Video-Text Representation Learning via Differentiable Weak Temporal Alignment

abstract: Learning generic joint representations for video and text by a supervised method requires a prohibitively substantial amount of manually annotated video datasets. As a practical alternative, a large-scale but uncurated and narrated video dataset, HowTo100M, has recently been introduced. But it is still challenging to learn joint embeddings of video and text in a self-supervised manner, due to its ambiguity and non-sequential alignment. In this paper, we propose a novel multi-modal self-supervised framework Video-Text Temporally Weak Alignment-based Contrastive Learning (VT-TWINS) to capture significant information from noisy and weakly correlated data using a variant of Dynamic Time Warping (DTW). We observe that the standard DTW inherently cannot handle weakly correlated data and only considers the globally optimal alignment path. To address these problems, we develop a differentiable DTW which also reflects local information with weak temporal alignment. Moreover, our proposed model applies a contrastive learning scheme to learn feature representations on weakly correlated data. Our extensive experiments demonstrate that VT-TWINS attains significant improvements in multi-modal representation learning and outperforms various challenging downstream tasks. Code is available at https://github.com/mlvlab/VT-TWINS.


title: Exclusive $\pi^{-}$ Electroproduction off the Neutron in Deuterium in the Resonance Region

abstract: New results for the exclusive and quasi-free cross sections off neutrons bound in deuterium ${\gamma}_vn(p) \rightarrow p{\pi}^{-} (p)$ are presented over a wide final state hadron angle range with a kinematic coverage of the invariant mass ($W$) up to 1.825 GeV and the virtual photon four-momentum transfer squared ($Q^{2}$) from 0.4 to 1.0 GeV$^2$. The exclusive structure functions were extracted and their Legendre moments were obtained. Final-state-interaction contributions have been kinematically separated from the extracted quasi-free cross sections off bound neutrons solely based on the analysis of the experimental data. These new results will serve as long-awaited input for phenomenological analyses to extract the $Q^{2}$ evolution of previously unavailable $n \to N^{*}$ electroexcitation amplitudes and to improve state-of-the-art models of neutrino scattering off nuclei by augmenting the already available results from free protons.