title: Discriminant, vertex and general type of a family of polynomials

abstract: In this paper we give a formal expression to the limits of dual plane curves by using the method introduced by Katz. As an application, we give a formula to compute the vertices of $C(0)$ a plane curve in $C(t)$ a one-parameter family of plane curves and we show that those vertices depend only on the first $\tau$ terms of that family, where $\tau$ is the general type of $C(t)$.


title: AIROPA II: Modeling Instrumental Aberrations for Off-Axis Point Spread Functions in Adaptive Optics

abstract: Images obtained with single-conjugate adaptive optics (AO) show spatial variation of the point spread function (PSF) due to both atmospheric anisoplanatism and instrumental aberrations. The poor knowledge of the PSF across the field of view strongly impacts the ability to take full advantage of AO capabilities. The AIROPA project aims to model these PSF variations for the NIRC2 imager at the Keck Observatory. Here, we present the characterization of the instrumental phase aberrations over the entire NIRC2 field of view and we present a new metric for quantifying the quality of the calibration, the fraction of variance unexplained (FVU). We used phase diversity measurements obtained on an artificial light source to characterize the variation of the aberrations across the field of view and their evolution with time. We find that there is a daily variation of the wavefront error (RMS of the residuals is 94~nm) common to the whole detector, but the differential aberrations across the field of view are very stable (RMS of the residuals between different epochs is 59~nm). This means that instrumental calibrations need to be monitored often only at the center of the detector, and the much more time-consuming variations across the field of view can be characterized less frequently (most likely when hardware upgrades happen). Furthermore, we tested AIROPA's instrumental model through real data of the fiber images on the detector. We find that modeling the PSF variations across the field of view improves the FVU metric by 60\% and reduces the detection of fake sources by 70\%.


title: Spectral theory of $p-adic$ Hermite operator

abstract: We give the definition of $p-adic$ Hermite operator and set up the $p-adic$ spectral measure. We compare the Archimedean case with non-Archimedean case. The structure of Hermite conjugate in $C^{*}$-Algebra corresponds to three canonical structures of $p-adic$ ultrametric Banach algebra: 1. mod $p$ reduction 2. Frobenius map 3. Teichm\"uller lift. There is a nature connection between Galois theory and Hermite operator spectral decomposition. The Galois group $\mathrm{Gal}(\bar{\mathbb{F}}_p|\mathbb{F}_p)$ generate the $p-adic$ spectral measure. We point out some relationships with $p-adic$ quantum mechanics: 1. creation operator and annihilation operator 2. $p-adic$ uncertainty principle.

categories: math-ph math.FA math.MP math.NT math.SP quant-ph


title: Lecture notes on Legendre polynomials: their origin and main properties

abstract: As is well-known, the separation of variables in second order partial differential equations (PDEs) for physical problems with spherical symmetry usually leads to Cauchy's differential equation for the radial coordinate $r$ and Legendre's differential equation for the polar angle $\theta$. For eigenvalues of the form $n\,(n+1)$, $n \ge 0\,$ being an integer, Legendre's equation admits certain polynomials $P_n(\cos{\theta})$ as solutions, which form a complete set of continuous orthogonal functions for all $\theta \in [0,\pi]$. This allows us to take the polynomials $P_n(x)$, where $x = \cos{\theta}$, as a basis for the Fourier-Legendre series expansion of any function $f(x)$ continuous by parts over $\,x \in [-1,1]$. These lecture notes correspond to the end of my course on Mathematical Methods for Physics, when I did derive the differential equations and solutions for physical problems with spherical symmetry. For those interested in Number Theory, I have included an application of shifted Legendre polynomials in \emph{irrationality proofs}, following a method introduced by Beukers to show that $\zeta{(2)}$ and $\zeta{(3)}$ are irrational numbers.


title: Dissociation slowdown by collective optical response under strong coupling conditions

abstract: We consider an ensemble of diatomic molecules resonantly coupled to an optical cavity under strong coupling conditions at normal incidence. Photodissociation dynamics is examined via direct numerical integration of the coupled Maxwell-Schrodinger equations with molecular ro-vibrational degrees of freedom explicitly taken into account. It is shown that the dissociation is significantly affected (slowed down) when the system is driven at its polaritonic frequencies. The observed effect is demonstrated to be of transient nature and has no classical analog. An intuitive explanation of the dissociation slowdown at polaritonic frequencies is proposed.


title: An evaluation for geometries, formation enthalpies, and dissociation energies of diatomic and triatomic (C, H, N, O), NO3, and HNO3 molecules from the PAW DFT method with PBE and optB88-vdW functionals

abstract: Structural geometries, formation enthalpies, and dissociation energies of all diatomic and triatomic molecules consisting of the four basic elements C, H, N, and/or O are calculated from the projector augmented wave (PAW) density functional theory (DFT) method with the PBE and optB88-vdW exchange-correlation functionals. The calculations are also extended to two larger molecules NO3 and HNO3, which consist of 4 and 5 atoms, respectively. In total, 82 molecules or isomers are considered in the calculations. The geometric parameters including 42 bond lengths and 15 bond angles of these molecules from the planewave DFT method are highly satisfactory, relative to available experimental data. The error analysis is also performed for 49 formation enthalpies and 138 dissociation energies (including 51 atomization energies as well as corresponding bond dissociation energies). The results are also compared with the previous data from various atomic-orbitals-based methods for molecules and from similar or different planewave DFT methods for various solids and other molecules. This provides an informative and instructive evaluation, especially for calculating the large-size material systems containing these small molecules as well as for further developing DFT methods.


title: Competitive Online Truthful Time-Sensitive-Valued Data Auction

abstract: In this work, we investigate online mechanisms for trading time-sensitive valued data. We adopt a continuous function $d(t)$ to represent the data value fluctuation over time $t$. Our objective is to design an \emph{online} mechanism achieving \emph{truthfulness} and \emph{revenue-competitiveness}. We first prove several lower bounds on the revenue competitive ratios under various assumptions. We then propose several online truthful auction mechanisms for various adversarial models, such as a randomized observe-then-select mechanism $\mathcal{M}_1$ and prove that it is \textit{truthful} and $\Theta(\log n)$-competitive under some assumptions. Then we present an effective truthful weighted-selection mechanism $\mathcal{M'}_W$ by relaxing the assumptions on the sizes of the discount-classes. We prove that it achieves a competitive ratio $\Theta(n\log n)$ for any known non-decreasing discount function $d(t)$, and the number of buyers in each discount class $n_c \ge 2$. When the optimum expected revenue $OPT_1$ can be estimated within a constant factor, i.e. $c_0 \cdot OPT_1 \le Z \le OPT_1 $ for some constant $c_0 \in(0,1)$, we propose a truthful online posted-price mechanism that achieves a constant competitive ratio $\frac{4}{c_0}$. Our extensive numerical evaluations demonstrate that our mechanisms perform very well in most cases.


title: Causally-guided Regularization of Graph Attention Improves Generalizability

abstract: Graph attention networks estimate the relational importance of node neighbors to aggregate relevant information over local neighborhoods for a prediction task. However, the inferred attentions are vulnerable to spurious correlations and connectivity in the training data, hampering the generalizability of the model. We introduce CAR, a general-purpose regularization framework for graph attention networks. Embodying a causal inference approach, CAR aligns the attention mechanism with the causal effects of active interventions on graph connectivity in a scalable manner. CAR is compatible with a variety of graph attention architectures, and we show that it systematically improves generalizability on various node classification tasks. Our ablation studies indicate that CAR hones in on the aspects of graph structure most pertinent to the prediction (e.g., homophily), and does so more effectively than alternative approaches. Finally, we also show that CAR enhances interpretability of attention weights by accentuating node-neighbor relations that point to causal hypotheses. For social media network-sized graphs, a CAR-guided graph rewiring approach could allow us to combine the scalability of graph convolutional methods with the higher performance of graph attention.


title: Does Learning from Decentralized Non-IID Unlabeled Data Benefit from Self Supervision?

abstract: Decentralized learning has been advocated and widely deployed to make efficient use of distributed datasets, with an extensive focus on supervised learning (SL) problems. Unfortunately, the majority of real-world data are unlabeled and can be highly heterogeneous across sources. In this work, we carefully study decentralized learning with unlabeled data through the lens of self-supervised learning (SSL), specifically contrastive visual representation learning. We study the effectiveness of a range of contrastive learning algorithms under decentralized learning settings, on relatively large-scale datasets including ImageNet-100, MS-COCO, and a new real-world robotic warehouse dataset. Our experiments show that the decentralized SSL (Dec-SSL) approach is robust to the heterogeneity of decentralized datasets, and learns useful representation for object classification, detection, and segmentation tasks. This robustness makes it possible to significantly reduce communication and reduce the participation ratio of data sources with only minimal drops in performance. Interestingly, using the same amount of data, the representation learned by Dec-SSL can not only perform on par with that learned by centralized SSL which requires communication and excessive data storage costs, but also sometimes outperform representations extracted from decentralized SL which requires extra knowledge about the data labels. Finally, we provide theoretical insights into understanding why data heterogeneity is less of a concern for Dec-SSL objectives, and introduce feature alignment and clustering techniques to develop a new Dec-SSL algorithm that further improves the performance, in the face of highly non-IID data. Our study presents positive evidence to embrace unlabeled data in decentralized learning, and we hope to provide new insights into whether and why decentralized SSL is effective.


title: Observational Appearance of a Freely-falling Star in an Asymmetric Thin-shell Wormhole

abstract: It has been recently reported that, at late times, the total luminosity of a star freely falling in black holes decays exponentially with time, and one or two series of flashes with decreasing intensity are seen by a specific observer, depending on the number of photon spheres. In this paper, we examine observational appearances of an infalling star in a reflection-asymmetric wormhole, which has two photon spheres, one on each side of the wormhole. We find that the late-time total luminosity measured by distant observers gradually decays with time or remains roughly constant due to the absence of the event horizon. Moreover, a specific observer would detect a couple of light flashes in a bright background at late times. These observations would offer a new tool to distinguish wormholes from black holes, even those with multiple photon spheres.


title: Structural distortion induced Dzyaloshinskii-Moriya interaction in monolayer CrI3 at van der Waals heterostructures

abstract: The van der Waals (vdW) magnetic heterostructures provide flexible ways to realize particular magnetic properties that possess both scientific and practical significance. Here, by firstprinciples calculation, we predict strong Dzyaloshinskii-Moriya interactions (DMIs) by constructing CrI3/Metal vdW heterostructures. The underlaying mechanisms are ascribed the large spin-orbital coupling (SOC) of the I atom and the structural distortion in CrI3 layer caused by interlayer interaction. This is different from the traditional way that deposit magnetic films on substrate to generate DMI, wherein DMI is dominated by interlayer hybridization and large SOC of substrates. In addition, both Heisenberg exchange and magnetic anisotropy are modulated dramatically, such as Heisenberg exchange is nearly doubled on Au(111), and the out-of-plane magnetism is enhanced by 88% on Ir(111). Our work may provide a experimentally accessible strategy to induce DMI in vdW magnetic materials, which will be helpful to the design of spintronics devices.


title: ESPNN: A novel electronic stopping power neural-network code built on the IAEA stopping power database. I. Atomic targets

abstract: The International Atomic Energy Agency (IAEA) stopping power database is a highly valued public resource compiling most of the experimental measurements published over nearly a century. The database-accessible to the global scientific community-is continuously updated and has been extensively employed in theoretical and experimental research for more than 30 years. This work aims to employ machine learning algorithms on the 2021 IAEA database to predict accurate electronic stopping power cross sections for any ion and target combination in a wide range of incident energies. Unsupervised machine learning methods are applied to clean the database in an automated manner. These techniques purge the data by removing suspicious outliers and old isolated values. A large portion of the remaining data is used to train a deep neural network, while the rest is set aside, constituting the test set. The present work considers collisional systems only with atomic targets. The first version of the ESPNN (electronic stopping power neural-network code), openly available to users, is shown to yield predicted values in excellent agreement with the experimental results of the test set.


title: Automatic Document Selection for Efficient Encoder Pretraining

abstract: Building pretrained language models is considered expensive and data-intensive, but must we increase dataset size to achieve better performance? We propose an alternative to larger training sets by automatically identifying smaller yet domain-representative subsets. We extend Cynical Data Selection, a statistical sentence scoring method that conditions on a representative target domain corpus. As an example, we treat the OntoNotes corpus as a target domain and pretrain a RoBERTa-like encoder from a cynically selected subset of the Pile. On both perplexity and across several downstream tasks in the target domain, it consistently outperforms random selection with 20x less data, 3x fewer training iterations, and 2x less estimated cloud compute cost, validating the recipe of automatic document selection for LM pretraining.


title: Autoencoded sparse Bayesian in-IRT factorization, calibration, and amortized inference for the Work Disability Functional Assessment Battery

abstract: The Work Disability Functional Assessment Battery (WD-FAB) is a multidimensional item response theory (IRT) instrument designed for assessing work-related mental and physical function based on responses to an item bank. In prior iterations it was developed using traditional means -- linear factorization and null hypothesis statistical testing for item partitioning/selection, and finally, posthoc calibration of disjoint unidimensional IRT models. As a result, the WD-FAB, like many other IRT instruments, is a posthoc model. Its item partitioning, based on exploratory factor analysis, is blind to the final nonlinear IRT model and is not performed in a manner consistent with goodness of fit to the final model. In this manuscript, we develop a Bayesian hierarchical model for self-consistently performing the following simultaneous tasks: scale factorization, item selection, parameter identification, and response scoring. This method uses sparsity-based shrinkage to obviate the linear factorization and null hypothesis statistical tests that are usually required for developing multidimensional IRT models, so that item partitioning is consistent with the ultimate nonlinear factor model. We also analogize our multidimensional IRT model to probabilistic autoencoders, specifying an encoder function that amortizes the inference of ability parameters from item responses. The encoder function is equivalent to the "VBE" step in a stochastic variational Bayesian expectation maximization (VBEM) procedure that we use for approxiamte Bayesian inference on the entire model. We use the method on a sample of WD-FAB item responses and compare the resulting item discriminations to those obtained using the traditional posthoc method.


title: Discovering Many Diverse Solutions with Bayesian Optimization

abstract: Bayesian optimization (BO) is a popular approach for sample-efficient optimization of black-box objective functions. While BO has been successfully applied to a wide range of scientific applications, traditional approaches to single-objective BO only seek to find a single best solution. This can be a significant limitation in situations where solutions may later turn out to be intractable. For example, a designed molecule may turn out to violate constraints that can only be reasonably evaluated after the optimization process has concluded. To address this issue, we propose Rank-Ordered Bayesian Optimization with Trust-regions (ROBOT) which aims to find a portfolio of high-performing solutions that are diverse according to a user-specified diversity metric. We evaluate ROBOT on several real-world applications and show that it can discover large sets of high-performing diverse solutions while requiring few additional function evaluations compared to finding a single best solution.


title: Nonnegative solutions of the heat equation in a cylindrical domain and Widder's theorem

abstract: It is shown every nonnegative solution of the heat equation in a bounded cylindrical domain has an integral representation in terms of a trace triple consisting of a bottom trace, a corner trace and a lateral trace on its parabolic boundary. Conversely this trace triple uniquely determines the solution.


title: Mapping the Weak-Field Limit of Scalar-Gauss-Bonnet Gravity

abstract: We derive the weak field limit of scalar-Gauss-Bonnet theory and place novel bounds on the parameter space using terrestrial and space-based experiments. In order to analyze the theory in the context of a wide range of experiments, we compute the deviations from Einstein gravity around source masses with planar, cylindrical, and spherical symmetry. We find a correction to the Newtonian potential around spherical and cylindrical sources that can be larger than PPN corrections sufficiently close to the source. We use this to improve on laboratory constraints on the scalar-Gauss-Bonnet coupling parameter $\Lambda$ by two orders of magnitude. Present laboratory and Solar System bounds reported here are superseded by tests deriving from black holes.


title: Non-Iterative Scribble-Supervised Learning with Pacing Pseudo-Masks for Medical Image Segmentation

abstract: Scribble-supervised medical image segmentation tackles the limitation of sparse masks. Conventional approaches alternate between: labeling pseudo-masks and optimizing network parameters. However, such iterative two-stage paradigm is unwieldy and could be trapped in poor local optima since the networks undesirably regress to the erroneous pseudo-masks. To address these issues, we propose a non-iterative method where a stream of varying (pacing) pseudo-masks teach a network via consistency training, named PacingPseudo. Our motivation lies first in a non-iterative process. Interestingly, it can be achieved gracefully by a siamese architecture, wherein a stream of pseudo-masks naturally assimilate a stream of predicted masks during training. Second, we make the consistency training effective with two necessary designs: (i) entropy regularization to obtain high-confidence pseudo-masks for effective teaching; and (ii) distorted augmentations to create discrepancy between the pseudo-mask and predicted-mask streams for consistency regularization. Third, we devise a new memory bank mechanism that provides an extra source of ensemble features to complement scarce labeled pixels. The efficacy of the proposed PacingPseudo is validated on three public medical image datasets, including the segmentation tasks of abdominal multi-organs, cardiac structures, and myocardium. Extensive experiments demonstrate our PacingPseudo improves the baseline by large margins and consistently outcompetes several previous methods. In some cases, our PacingPseudo achieves comparable performance with its fully-supervised counterparts, showing the feasibility of our method for the challenging scribble-supervised segmentation applications. The code and scribble annotations will be publicly available.


title: 3D Human Mesh Construction Leveraging Wi-Fi

abstract: In this paper, we present, Wi-Mesh, a WiFi vision-based 3D human mesh construction system. Our system leverages the advances of WiFi to visualize the shape and deformations of the human body for 3D mesh construction. In particular, it leverages multiple transmitting and receiving antennas on WiFi devices to estimate the two-dimensional angle of arrival (2D AoA) of the WiFi signal reflections to enable WiFi devices to see the physical environment as we humans do. It then extracts only the images of the human body from the physical environment and leverages deep learning models to digitize the extracted human body into a 3D mesh representation. Experimental evaluation under various indoor environments shows that Wi-Mesh achieves an average vertices location error of 2.81cm and joint position error of 2.4cm, which is comparable to the systems that utilize specialized and dedicated hardware. The proposed system has the advantage of re-using the WiFi devices that already exist in the environment for potential mass adoption. It can also work in non-line of sight (NLoS), poor lighting conditions, and baggy clothes, where the camera-based systems do not work well.


title: Federated Unlearning for On-Device Recommendation

abstract: The increasing data privacy concerns in recommendation systems have made federated recommendations (FedRecs) attract more and more attention. Existing FedRecs mainly focus on how to effectively and securely learn personal interests and preferences from their on-device interaction data. Still, none of them considers how to efficiently erase a user's contribution to the federated training process. We argue that such a dual setting is necessary. First, from the privacy protection perspective, ``the right to be forgotten'' requires that users have the right to withdraw their data contributions. Without the reversible ability, FedRecs risk breaking data protection regulations. On the other hand, enabling a FedRec to forget specific users can improve its robustness and resistance to malicious clients' attacks. To support user unlearning in FedRecs, we propose an efficient unlearning method FRU (Federated Recommendation Unlearning), inspired by the log-based rollback mechanism of transactions in database management systems. It removes a user's contribution by rolling back and calibrating the historical parameter updates and then uses these updates to speed up federated recommender reconstruction. However, storing all historical parameter updates on resource-constrained personal devices is challenging and even infeasible. In light of this challenge, we propose a small-sized negative sampling method to reduce the number of item embedding updates and an importance-based update selection mechanism to store only important model updates. To evaluate the effectiveness of FRU, we propose an attack method to disturb FedRecs via a group of compromised users and use FRU to recover recommenders by eliminating these users' influence. Finally, we conduct experiments on two real-world recommendation datasets with two widely used FedRecs to show the efficiency and effectiveness of our proposed approaches.


title: Geo6D: Geometric Constraints Learning for 6D Pose Estimation

abstract: Numerous 6D pose estimation methods have been proposed that employ end-to-end regression to directly estimate the target pose parameters. Since the visible features of objects are implicitly influenced by their poses, the network allows inferring the pose by analyzing the differences in features in the visible region. However, due to the unpredictable and unrestricted range of pose variations, the implicitly learned visible feature-pose constraints are insufficiently covered by the training samples, making the network vulnerable to unseen object poses. To tackle these challenges, we proposed a novel geometric constraints learning approach called Geo6D for direct regression 6D pose estimation methods. It introduces a pose transformation formula expressed in relative offset representation, which is leveraged as geometric constraints to reconstruct the input and output targets of the network. These reconstructed data enable the network to estimate the pose based on explicit geometric constraints and relative offset representation mitigates the issue of the pose distribution gap. Extensive experimental results show that when equipped with Geo6D, the direct 6D methods achieve state-of-the-art performance on multiple datasets and demonstrate significant effectiveness, even with only 10% amount of data.


title: Diffusion Models already have a Semantic Latent Space

abstract: Diffusion models achieve outstanding generative performance in various domains. Despite their great success, they lack semantic latent space which is essential for controlling the generative process. To address the problem, we propose asymmetric reverse process (Asyrp) which discovers the semantic latent space in frozen pretrained diffusion models. Our semantic latent space, named h-space, has nice properties for accommodating semantic image manipulation: homogeneity, linearity, robustness, and consistency across timesteps. In addition, we introduce a principled design of the generative process for versatile editing and quality boost ing by quantifiable measures: editing strength of an interval and quality deficiency at a timestep. Our method is applicable to various architectures (DDPM++, iD- DPM, and ADM) and datasets (CelebA-HQ, AFHQ-dog, LSUN-church, LSUN- bedroom, and METFACES). Project page: https://kwonminki.github.io/Asyrp/


title: Axion Dark Matter Search around 4.55 $\mu$eV with Dine-Fischler-Srednicki-Zhitnitskii Sensitivity

abstract: We report an axion dark matter search at Dine-Fischler-Srednicki-Zhitnitskii sensitivity with the CAPP-12TB haloscope, assuming axions contribute 100\% of the local dark matter density. The search excluded the axion--photon coupling $g_{a\gamma\gamma}$ down to about $6.2\times10^{-16}$ GeV$^{-1}$ over the axion mass range between 4.51 and 4.59 $\mu$eV at a 90\% confidence level. The achieved experimental sensitivity can also exclude Kim-Shifman-Vainshtein-Zakharov axion dark matter that makes up just 13\% of the local dark matter density. The CAPP-12TB haloscope will continue the search over a wide range of axion masses.


title: Optimization on Manifolds via Graph Gaussian Processes

abstract: This paper integrates manifold learning techniques within a \emph{Gaussian process upper confidence bound} algorithm to optimize an objective function on a manifold. Our approach is motivated by applications where a full representation of the manifold is not available and querying the objective is expensive. We rely on a point cloud of manifold samples to define a graph Gaussian process surrogate model for the objective. Query points are sequentially chosen using the posterior distribution of the surrogate model given all previous queries. We establish regret bounds in terms of the number of queries and the size of the point cloud. Several numerical examples complement the theory and illustrate the performance of our method.


title: UAV-Assisted Multi-Cluster Over-the-Air Computation

abstract: In this paper, we study unmanned aerial vehicles (UAVs) assisted wireless data aggregation (WDA) in multicluster networks, where multiple UAVs simultaneously perform different WDA tasks via over-the-air computation (AirComp) without terrestrial base stations. This work focuses on maximizing the minimum amount of WDA tasks performed among all clusters by optimizing the UAV's trajectory and transceiver design as well as cluster scheduling and association, while considering the WDA accuracy requirement. Such a joint design is critical for interference management in multi-cluster AirComp networks, via enhancing the signal quality between each UAV and its associated cluster for signal alignment and meanwhile reducing the inter-cluster interference between each UAV and its nonassociated clusters. Although it is generally challenging to optimally solve the formulated non-convex mixed-integer nonlinear programming, an efficient iterative algorithm as a compromise approach is developed by exploiting bisection and block coordinate descent methods, yielding an optimal transceiver solution in each iteration. The optimal binary variables and a suboptimal trajectory are obtained by using the dual method and successive convex approximation, respectively. Simulations show the considerable performance gains of the proposed design over benchmarks and the superiority of deploying multiple UAVs in increasing the number of performed tasks while reducing access delays.


title: Uncertainty Disentanglement with Non-stationary Heteroscedastic Gaussian Processes for Active Learning

abstract: Gaussian processes are Bayesian non-parametric models used in many areas. In this work, we propose a Non-stationary Heteroscedastic Gaussian process model which can be learned with gradient-based techniques. We demonstrate the interpretability of the proposed model by separating the overall uncertainty into aleatoric (irreducible) and epistemic (model) uncertainty. We illustrate the usability of derived epistemic uncertainty on active learning problems. We demonstrate the efficacy of our model with various ablations on multiple datasets.


title: IDM-Follower: A Model-Informed Deep Learning Method for Long-Sequence Car-Following Trajectory Prediction

abstract: Model-based and learning-based methods are two major types of methodologies to model car following behaviors. Model-based methods describe the car-following behaviors with explicit mathematical equations, while learning-based methods focus on getting a mapping between inputs and outputs. Both types of methods have advantages and weaknesses. Meanwhile, most car-following models are generative and only consider the inputs of the speed, position, and acceleration of the last time step. To address these issues, this study proposes a novel framework called IDM-Follower that can generate a sequence of following vehicle trajectory by a recurrent autoencoder informed by a physical car-following model, the Intelligent Driving Model (IDM).We implement a novel structure with two independent encoders and a self-attention decoder that could sequentially predict the following trajectories. A loss function considering the discrepancies between predictions and labeled data integrated with discrepancies from model-based predictions is implemented to update the neural network parameters. Numerical experiments with multiple settings on simulation and NGSIM datasets show that the IDM-Follower can improve the prediction performance compared to the model-based or learning-based methods alone. Analysis on different noise levels also shows good robustness of the model.


title: Maximization of the first Laplace eigenvalue of a finite graph

abstract: Given a length function on the edge set of a finite graph, we define a vertex-weight and an edge-weight in terms of it and consider the corresponding graph Laplacian. In this paper, we consider the problem of maximizing the first nonzero eigenvalue of this Laplacian over all edge-length functions subject to a certain normalization. For an extremal solution of this problem, we prove that there exists a map from the vertex set to a Euclidean space consisting of first eigenfunctions of the corresponding Laplacian so that the length function can be explicitly expressed in terms of the map and the Euclidean distance. This is a graph-analogue of Nadirashvili's result related to first-eigenvalue maximization problem on a smooth surface. We discuss simple examples and also prove a similar result for a maximizing solution of the Goering-Helmberg-Wappler problem.


title: Adaptive greedy forward variable selection for linear regression models with incomplete data using multiple imputation

abstract: Variable selection is crucial for sparse modeling in this age of big data. Missing values are common in data, and make variable selection more complicated. The approach of multiple imputation (MI) results in multiply imputed datasets for missing values, and has been widely applied in various variable selection procedures. However, directly performing variable selection on the whole MI data or bootstrapped MI data may not be worthy in terms of computation cost. To fast identify the active variables in the linear regression model, we propose the adaptive grafting procedure with three pooling rules on MI data. The proposed methods proceed iteratively, which starts from finding the active variables based on the complete case subset and then expand the working data matrix with both the number of active variables and available observations. A comprehensive simulation study shows the selection accuracy in different aspects and computational efficiency of the proposed methods. Two real-life examples illustrate the strength of the proposed methods.


title: Identities and periodic oscillations of divide-and-conquer recurrences splitting at half

abstract: We study divide-and-conquer recurrences of the form \begin{equation*} f(n) = \alpha f(\lfloor \tfrac n2\rfloor) + \beta f(\lceil \tfrac n2\rceil) + g(n) \qquad(n\ge2), \end{equation*} with $g(n)$ and $f(1)$ given, where $\alpha,\beta\ge0$ with $\alpha+\beta>0$; such recurrences appear often in analysis of computer algorithms, numeration systems, combinatorial sequences, and related areas. We show that the solution satisfies always the simple \emph{identity} \begin{equation*} f(n) = n^{\log_2(\alpha+\beta)} P(\log_2n) - Q(n) \end{equation*} under an optimum (iff) condition on $g(n)$. This form is not only an identity but also an asymptotic expansion because $Q(n)$ is of a smaller order. Explicit forms for the \emph{continuity} of the periodic function $P$ are provided, together with a few other smoothness properties. We show how our results can be easily applied to many dozens of concrete examples collected from the literature, and how they can be extended in various directions. Our method of proof is surprisingly simple and elementary, but leads to the strongest types of results for all examples to which our theory applies.


title: SSiT: Saliency-guided Self-supervised Image Transformer for Diabetic Retinopathy Grading

abstract: Self-supervised Learning (SSL) has been widely applied to learn image representations through exploiting unlabeled images. However, it has not been fully explored in the medical image analysis field. In this work, Saliency-guided Self-Supervised image Transformer (SSiT) is proposed for Diabetic Retinopathy (DR) grading from fundus images. We novelly introduce saliency maps into SSL, with a goal of guiding self-supervised pre-training with domain-specific prior knowledge. Specifically, two saliency-guided learning tasks are employed in SSiT: (1) Saliency-guided contrastive learning is conducted based on the momentum contrast, wherein fundus images' saliency maps are utilized to remove trivial patches from the input sequences of the momentum-updated key encoder. Thus, the key encoder is constrained to provide target representations focusing on salient regions, guiding the query encoder to capture salient features. (2) The query encoder is trained to predict the saliency segmentation, encouraging the preservation of fine-grained information in the learned representations. To assess our proposed method, four publicly-accessible fundus image datasets are adopted. One dataset is employed for pre-training, while the three others are used to evaluate the pre-trained models' performance on downstream DR grading. The proposed SSiT significantly outperforms other representative state-of-the-art SSL methods on all downstream datasets and under various evaluation settings. For example, SSiT achieves a Kappa score of 81.88% on the DDR dataset under fine-tuning evaluation, outperforming all other ViT-based SSL methods by at least 9.48%.


title: Federated Learning via Unmanned Aerial Vehicle

abstract: To enable communication-efficient federated learning (FL), this paper studies an unmanned aerial vehicle (UAV)-enabled FL system, where the UAV coordinates distributed ground devices for a shared model training. Specifically, by exploiting the UAV's high altitude and mobility, the UAV can proactively establish short-distance line-of-sight links with devices and prevent any device from being a communication straggler. Thus, the model aggregation process can be accelerated while the cumulative model loss caused by device scheduling can be reduced, resulting in a decreased completion time. We first present the convergence analysis of FL without the assumption of convexity, demonstrating the effect of device scheduling on the global gradients. Based on the derived convergence bound, we further formulate the completion time minimization problem by jointly optimizing device scheduling, UAV trajectory, and time allocation. This problem explicitly incorporates the devices' energy budgets, dynamic channel conditions, and convergence accuracy of FL constraints. Despite the non-convexity of the formulated problem, we exploit its structure to decompose it into two sub-problems and further derive the optimal solutions via the Lagrange dual ascent method. Simulation results show that the proposed design significantly improves the tradeoff between completion time and prediction accuracy in practical FL settings compared to existing benchmarks.


title: Optimal Settings for Cryptocurrency Trading Pairs

abstract: The goal of cryptocurrencies is decentralization. In principle, all currencies have equal status. Unlike traditional stock markets, there is no default currency of denomination (fiat), thus the trading pairs can be set freely. However, it is impractical to set up a trading market between every two currencies. In order to control management costs and ensure sufficient liquidity, we must give priority to covering those large-volume trading pairs and ensure that all coins are reachable. We note that this is an optimization problem. Its particularity lies in: 1) the trading volume between most (>99.5%) possible trading pairs cannot be directly observed. 2) It satisfies the connectivity constraint, that is, all currencies are guaranteed to be tradable. To solve this problem, we use a two-stage process: 1) Fill in missing values based on a regularized, truncated eigenvalue decomposition, where the regularization term is used to control what extent missing values should be limited to zero. 2) Search for the optimal trading pairs, based on a branch and bound process, with heuristic search and pruning strategies. The experimental results show that: 1) If the number of denominated coins is not limited, we will get a more decentralized trading pair settings, which advocates the establishment of trading pairs directly between large currency pairs. 2) There is a certain room for optimization in all exchanges. The setting of inappropriate trading pairs is mainly caused by subjectively setting small coins to quote, or failing to track emerging big coins in time. 3) Too few trading pairs will lead to low coverage; too many trading pairs will need to be adjusted with markets frequently. Exchanges should consider striking an appropriate balance between them.


title: A Multimodal Sensor Fusion Framework Robust to Missing Modalities for Person Recognition

abstract: Utilizing the sensor characteristics of the audio, visible camera, and thermal camera, the robustness of person recognition can be enhanced. Existing multimodal person recognition frameworks are primarily formulated assuming that multimodal data is always available. In this paper, we propose a novel trimodal sensor fusion framework using the audio, visible, and thermal camera, which addresses the missing modality problem. In the framework, a novel deep latent embedding framework, termed the AVTNet, is proposed to learn multiple latent embeddings. Also, a novel loss function, termed missing modality loss, accounts for possible missing modalities based on the triplet loss calculation while learning the individual latent embeddings. Additionally, a joint latent embedding utilizing the trimodal data is learnt using the multi-head attention transformer, which assigns attention weights to the different modalities. The different latent embeddings are subsequently used to train a deep neural network. The proposed framework is validated on the Speaking Faces dataset. A comparative analysis with baseline algorithms shows that the proposed framework significantly increases the person recognition accuracy while accounting for missing modalities.


title: Scalable Bayesian Transformed Gaussian Processes

abstract: The Bayesian transformed Gaussian process (BTG) model, proposed by Kedem and Oliviera, is a fully Bayesian counterpart to the warped Gaussian process (WGP) and marginalizes out a joint prior over input warping and kernel hyperparameters. This fully Bayesian treatment of hyperparameters often provides more accurate regression estimates and superior uncertainty propagation, but is prohibitively expensive. The BTG posterior predictive distribution, itself estimated through high-dimensional integration, must be inverted in order to perform model prediction. To make the Bayesian approach practical and comparable in speed to maximum-likelihood estimation (MLE), we propose principled and fast techniques for computing with BTG. Our framework uses doubly sparse quadrature rules, tight quantile bounds, and rank-one matrix algebra to enable both fast model prediction and model selection. These scalable methods allow us to regress over higher-dimensional datasets and apply BTG with layered transformations that greatly improve its expressibility. We demonstrate that BTG achieves superior empirical performance over MLE-based models.


title: Bootstrap in High Dimension with Low Computation

abstract: The bootstrap is a popular data-driven method to quantify statistical uncertainty, but for modern high-dimensional problems, it could suffer from huge computational costs due to the need to repeatedly generate resamples and refit models. We study the use of bootstraps in high-dimensional environments with a small number of resamples. In particular, we show that with a recent "cheap" bootstrap perspective, using a number of resamples as small as one could attain valid coverage even when the dimension grows closely with the sample size, thus strongly supporting the implementability of the bootstrap for large-scale problems. We validate our theoretical results and compare the performance of our approach with other benchmarks via a range of experiments.


title: Improving Segmentation of Breast Ultrasound Images: Semi Automatic Two Pointers Histogram Splitting Technique

abstract: Automatically segmenting lesion area in breast ultrasound (BUS) images is a challenging one due to its noise, speckle and artifacts. Edge-map of BUS images also does not help because in most cases the edge-map gives no information whatsoever. Almost all segmentation technique takes the edge-map of the image as its first step, though there are a few algorithms that try to avoid edge-maps as well. Improving the edge-map of breast ultrasound images theoretically improves the chances of automatic segmentation to be more precise. In this paper, we propose a semi-automatic technique of histogram splitting using two pointers. Here the user only has to select two initially guessed points denoting a circle on the region of interest (ROI). The method will automatically study the internal histogram and split it using two pointers. The output BUS image has improved edge-map and ultimately the segmentation on it is better compared to regular segmentation using same algorithm and same initialization. Also, we further processed the edge-map to have less edge-pixels to area ratio, improving the homogeneity and the chances of easy segmentation in the future.


title: Steady jet ejections from the innermost region of advection-dominated accretion flow around a black hole

abstract: We study ejection mechanisms for two kinds of steady jets: one observed from black hole binaries in the low/hard state and the other from SS433. The specific energy of the ejected gas is required to be positive for the jets to get to infinity, while that of the accreted gas is naively considered to be negative at the outermost boundary of the accretion flow. To reconcile the opposite sign of the specific energies, we propose a situation where two layers exist in the accretion flow and one layer receives energy from the other sufficiently for the specific energy to be positive. For the steady jets in the low/hard state, the accretion ring at the outermost end of the accretion flow is considered to yield two-layer flow in which a geometrically thick ADAF sandwiches a geometrically thin accretion disk and the thin disk is supposed to turn to another ADAF on the inner side. The energy transfer is expected to occur through turbulent mixing between the two layers and the upper layer is discussed to have the positive specific energy large enough for the terminal velocity to be $\sim$ 0.1 $c$. For the steady jets from SS433, a slim disk is argued to separate into two stratified layers due to the photon diffusion in the direction perpendicular to the equatorial plane under the advection dominated situation. In this case, the specific energy of the upper layer is expected to be positive such that the terminal velocity exceeds 0.2 $c$. The jet ejection process near the black hole is investigated commonly to both the two-layer cases and predicts the jet opening angle becomes as small as 2$^{\circ}$.


title: Bell Inequalities Induced by Pseudo Pauli Operators on Single Logical Qubits

abstract: In most Bell tests, the measurement settings are specially chosen so that the maximal quantum violations of the Bell inequalities can be detected, or at least, the violations are strong enough to be observed. Such choices can usually associate the corresponding Bell operators to a kind of effective observables, called pseudo Pauli operators, providing us a more intuitive understanding of Bell nonlocality in some sense. Based on that, a more general quantum-to-classical approach for the constructions of Bell inequalities is developed. Using this approach, one can not only derive several kinds of well-known Bell inequalities, but also explore many new ones. Besides, we show that some quadratic Bell inequalities can be induced from the uncertainty relations of pseudo Pauli operators as well, which may shed new light on the study of uncertainty relations of some nonlocal observables.


title: A Comprehensive Survey on Edge Data Integrity Verification: Fundamentals and Future Trends

abstract: Recent advances in edge computing have pushed cloud-based data caching services to edge, however, such emerging edge storage comes with numerous challenging and unique security issues. One of them is the problem of edge data integrity verification (EDIV) which coordinates multiple participants (e.g., data owners and edge nodes) to inspect whether data cached on edge is authentic. To date, various solutions have been proposed to address the EDIV problem, while there is no systematic review. Thus, we offer a comprehensive survey for the first time, aiming to show current research status, open problems, and potentially promising insights for readers to further investigate this under-explored field. Specifically, we begin with stating the significance of the EDIV problem, the integrity verification difference between data cached on cloud and edge, and three typical system models with corresponding inspection processes. Then, we synthesize a universal criteria framework that an effective verification approach should satisfy. Subsequently, we adopt a schematic development timeline to reveal the research advance on EDIV in a sequential manner, followed by a detailed review on the existing EDIV solutions. Finally, we highlight intriguing research challenges and possible directions for future research.


title: Spontaneous microwave platicon frequency microcomb in dispersion-managed microresonators

abstract: Temporally stabilized optical pules, confined in microresonators driven by a continuous-wave laser, have attracted tremendous attention due to their fascinating features with many applications. Here we report the observations of mode-locked platicon frequency microcomb formation in normal dispersion dispersion-managed microresonators operating at microwave K-band repetition rate for the first time. Facilitated by the thermally controllable modulated background induced by avoided mode-crossings, various platicon bound state patterns with regular and irregular temporal separation are stably generated due to an additional balance between repulsive and attractive forces resulting from non-trivial interpulse and background electromagnetic field interactions. The number of mode-locked pulses can be switched by forward- and backward-cavity pump detuning and, with increasing pump power, result in stationary bound-state complexes. These experimental observations are in accordance with our nonlinear numerical simulations that includes avoided mode-crossing, anomalous fourth-order dispersion and quality-factor spectral filtering. The observed platicon mode-locked pulses have broad spectral profiles overlapping Kelly-sideband-like parametric oscillation. The single-sideband phase noise of microcomb repetition rate is characterized for the different mode-locked states, comparable with electronic microwave oscillators. The ability to achieve mode-locking in dispersion-managed microresonators provides a platform to reduce pulse timing jitter and enrich the exploration of ultrafast phenomena in microresonators.


title: Sieve Method and Prime Gaps via Probabilistic Method

abstract: Most prime gaps results have been proven using tools from analytic or algebraic number theory in the last few centuries. In this paper, we would like to present some probabilistic way of proving many essential results. A major component of the proof is a probabilistic approach to the sieve method. In addition, we discuss their connections with recent work by Zhang and Maynard on small and large gaps in prime numbers.


title: MGTUNet: An new UNet for colon nuclei instance segmentation and quantification

abstract: Colorectal cancer (CRC) is among the top three malignant tumor types in terms of morbidity and mortality. Histopathological images are the gold standard for diagnosing colon cancer. Cellular nuclei instance segmentation and classification, and nuclear component regression tasks can aid in the analysis of the tumor microenvironment in colon tissue. Traditional methods are still unable to handle both types of tasks end-to-end at the same time, and have poor prediction accuracy and high application costs. This paper proposes a new UNet model for handling nuclei based on the UNet framework, called MGTUNet, which uses Mish, Group normalization and transposed convolution layer to improve the segmentation model, and a ranger optimizer to adjust the SmoothL1Loss values. Secondly, it uses different channels to segment and classify different types of nucleus, ultimately completing the nuclei instance segmentation and classification task, and the nuclei component regression task simultaneously. Finally, we did extensive comparison experiments using eight segmentation models. By comparing the three evaluation metrics and the parameter sizes of the models, MGTUNet obtained 0.6254 on PQ, 0.6359 on mPQ, and 0.8695 on R2. Thus, the experiments demonstrated that MGTUNet is now a state-of-the-art method for quantifying histopathological images of colon cancer.


title: A generalized expansion method for computing Laplace-Beltrami eigenfunctions on manifolds

abstract: Eigendecomposition of the Laplace-Beltrami operator is instrumental for a variety of applications from physics to data science. We develop a numerical method of computation of the eigenvalues and eigenfunctions of the Laplace-Beltrami operator on a smooth bounded domain based on the relaxation to the Schr\"odinger operator with finite potential on a Riemannian manifold and projection in a special basis. We prove spectral exactness of the method and provide examples of calculated results and applications, particularly, in quantum billiards on manifolds.


title: PSA-Det3D: Pillar Set Abstraction for 3D object Detection

abstract: Small object detection for 3D point cloud is a challenging problem because of two limitations: (1) Perceiving small objects is much more diffcult than normal objects due to the lack of valid points. (2) Small objects are easily blocked which breaks the shape of their meshes in 3D point cloud. In this paper, we propose a pillar set abstraction (PSA) and foreground point compensation (FPC) and design a point-based detection network, PSA-Det3D, to improve the detection performance for small object. The PSA embeds a pillar query operation on the basis of set abstraction (SA) to expand its receptive field of the network, which can aggregate point-wise features effectively. To locate more occluded objects, we persent a proposal generation layer consisting of a foreground point segmentation and a FPC module. Both the foreground points and the estimated centers are finally fused together to generate the detection result. The experiments on the KITTI 3D detection benchmark show that our proposed PSA-Det3D outperforms other algorithms with high accuracy for small object detection.


title: RAIS: Robust and Accurate Interactive Segmentation via Continual Learning

abstract: Interactive image segmentation aims at segmenting a target region through a way of human-computer interaction. Recent works based on deep learning have achieved excellent performance, while most of them focus on improving the accuracy of the training set and ignore potential improvement on the test set. In the inference phase, they tend to have a good performance on similar domains to the training set, and lack adaptability to domain shift, so they require more user efforts to obtain satisfactory results. In this work, we propose RAIS, a robust and accurate architecture for interactive segmentation with continuous learning, where the model can learn from both train and test data sets. For efficient learning on the test set, we propose a novel optimization strategy to update global and local parameters with a basic segmentation module and adaptation module, respectively. Moreover, we perform extensive experiments on several benchmarks that show our method can handle data distribution shifts and achieves SOTA performance compared with recent interactive segmentation methods. Besides, our method also shows its robustness in the datasets of remote sensing and medical imaging where the data domains are completely different between training and testing.


title: Large-scale learning of generalised representations for speaker recognition

abstract: The objective of this work is to develop a speaker recognition model to be used in diverse scenarios. We hypothesise that two components should be adequately configured to build such a model. First, adequate architecture would be required. We explore several recent state-of-the-art models, including ECAPA-TDNN and MFA-Conformer, as well as other baselines. Second, a massive amount of data would be required. We investigate several new training data configurations combining a few existing datasets. The most extensive configuration includes over 87k speakers' 10.22k hours of speech. Four evaluation protocols are adopted to measure how the trained model performs in diverse scenarios. Through experiments, we find that MFA-Conformer with the least inductive bias generalises the best. We also show that training with proposed large data configurations gives better performance. A boost in generalisation is observed, where the average performance on four evaluation protocols improves by more than 20%. In addition, we also demonstrate that these models' performances can improve even further when increasing capacity.


title: Geodesic path for the optimal nonequilibrium transition: Momentum-independent protocol

abstract: Accelerating controlled thermodynamic processes requires an auxiliary Hamiltonian to steer the system into instantaneous equilibrium states. An extra energy cost is inevitably needed in such finite-time operation. We recently develop a geodesic approach to minimize such energy cost for the shortcut to isothermal process. The auxiliary control typically contains momentum-dependent terms, which are hard to be experimentally implemented due to the requirement of constantly monitoring the speed. In this work, we employ a variational auxiliary control without the momentum-dependent force to approximate the exact control. Following the geometric approach, we obtain the optimal control protocol with variational minimum energy cost. We demonstrate the construction of such protocol via an example of Brownian motion with a controllable harmonic potential.


title: Seebeck coefficient in a nickelate superconductor: electronic dispersion in the strange metal phase

abstract: Superconducting nickelates are a new family of materials that combine strongly-correlated magnetism with unconventional superconductivity. While comparisons with the superconducting cuprates are natural, very little is known about the metallic state of the nickelates, making these comparisons difficult. We probe the electronic dispersion of thin-film superconducting 5-layer ($n=5$) and metallic 3-layer ($n=3$) nickelates by measuring the Seebeck coefficient, $S$. We find a temperature independent and negative $S/T$ for both the $n=5$ nickelate, with strange metal resistivity, and the $n=3$ compound, with more conventional Fermi liquid resistivity. These results are in stark contrast with the strongly temperature-dependent $S/T$ measured at similar electron filling in the cuprate La$_{1.36}$Nd$_{0.4}$Sr$_{0.24}$CuO$_4$. We reproduce the temperature dependence, sign, and amplitude of $S/T$ in the nickelates using Boltzmann transport theory combined with the electronic structure calculated from density functional theory. This demonstrates that the electronic structure obtained from first-principles calculations is a good starting point for calculating the transport properties of superconducting nickelates, and suggests that, despite indications of strong electronic correlations, there are well-defined quasiparticles in the metallic state of this family of materials. Finally, we explain the differences in the Seebeck coefficient between nickelates and cuprates as originating in strong dissimilarities in impurity concentrations. Beyond establishing a baseline understanding of how the electronic structure relates to transport coefficients in these new materials, this work demonstrates the power of the semi-classical approach to quantitatively describe transport measurements, even in the strange-metallic state.


title: Quantifying broadband chromatic drifts in Fabry-Perot resonators for exoplanet science

abstract: The possibility of an Earth-Sun analog beyond our solar system is one of the most longstanding questions in science. At present, answering this question embodies an extremely difficult measurement problem that requires multiple coordinated advances in astronomical telescopes, fiber optics, precision spectrographs, large format detector arrays, and advanced data processing. Taken together, addressing this challenge will require the measurement and calibration of shifts in stellar spectra at the 10^-10 level over multi-year periods. The potential for such precision has recently been advanced by the introduction of laser frequency combs (LFCs) to the field of precision astronomical spectroscopy. However, the expense, complexity and lack of full spectral coverage of LFCs has limited their widespread use and ultimate impact. To address this issue, we explore simple and robust white-light-illuminated Fabry-Perot (FP) etalons as spectral calibrators for precise radial velocity measurements. We track the frequencies of up to 13,000 etalon modes of the installed FPs from two state-of-the-art astronomical spectrographs. Combining these measurements with modeling, we trace unexpected chromatic variations of the FP modes to sub-picometer changes in the dielectric layers of the broad bandwidth FP mirrors. This yields the determination of the frequencies of the FP modes with precision approaching 10^-11/day, equivalent to a radial velocity (RV) Doppler shift of 3 mm/s/day. These results represent critical progress in precision RV measurements on two fronts: first, they make FP etalons a more powerful stand-alone calibration tool, and second, they demonstrate the capability of LFCs to extend cm/s level RV measurement precision over periods approaching a year. Together, these advances highlight a path to achieving spectroscopic calibration at levels that will be critical for finding earths like our own.


title: A curious identity in connection with saddle-point method and Stirling's formula

abstract: We prove the curious identity in the sense of formal power series: \[ \int_{-\infty}^{\infty}[y^m] \exp\left(-\frac{t^2}2 +\sum_{j\ge3}\frac{(it)^j}{j!}\, y^{j-2}\right)\mathrm{d} t = \int_{-\infty}^{\infty}[y^m] \exp\left(-\frac{t^2}2+ \sum_{j\ge3}\frac{(it)^j}{j}\, y^{j-2}\right)\mathrm{d} t, \] for $m=0,1,\dots$, where $[y^m]f(y)$ denotes the coefficient of $y^m$ in the Taylor expansion of $f$. The generality of this identity from the perspective of saddle-point method is also examined.


title: Convergence Analysis of Discrete Conformal Transformation

abstract: Continuous conformal transformation minimizes the conformal energy. The convergence of minimizing discrete conformal energy when the discrete mesh size tends to zero is an open problem. This paper addresses this problem via a careful error analysis of the discrete conformal energy. Under a weak condition on triangulation, the discrete function minimizing the discrete conformal energy converges to the continuous conformal mapping as the mesh size tends to zero.


title: Block-wise Primal-dual Algorithms for Large-scale Doubly Penalized ANOVA Modeling

abstract: For multivariate nonparametric regression, doubly penalized ANOVA modeling (DPAM) has recently been proposed, using hierarchical total variations (HTVs) and empirical norms as penalties on the component functions such as main effects and multi-way interactions in a functional ANOVA decomposition of the underlying regression function. The two penalties play complementary roles: the HTV penalty promotes sparsity in the selection of basis functions within each component function, whereas the empirical-norm penalty promotes sparsity in the selection of component functions. We adopt backfitting or block minimization for training DPAM, and develop two suitable primal-dual algorithms, including both batch and stochastic versions, for updating each component function in single-block optimization. Existing applications of primal-dual algorithms are intractable in our setting with both HTV and empirical-norm penalties. Through extensive numerical experiments, we demonstrate the validity and advantage of our stochastic primal-dual algorithms, compared with their batch versions and a previous active-set algorithm, in large-scale scenarios.


title: NIFT: Neural Interaction Field and Template for Object Manipulation

abstract: We introduce NIFT, Neural Interaction Field and Template, a descriptive and robust interaction representation of object manipulations to facilitate imitation learning. Given a few object manipulation demos, NIFT guides the generation of the interaction imitation for a new object instance by matching the Neural Interaction Template (NIT) extracted from the demos in the target Neural Interaction Field (NIF) defined for the new object. Specifically, the NIF is a neural field that encodes the relationship between each spatial point and a given object, where the relative position is defined by a spherical distance function rather than occupancies or signed distances, which are commonly adopted by conventional neural fields but less informative. For a given demo interaction, the corresponding NIT is defined by a set of spatial points sampled in the demo NIF with associated neural features. To better capture the interaction, the points are sampled on the Interaction Bisector Surface (IBS), which consists of points that are equidistant to the two interacting objects and has been used extensively for interaction representation. With both point selection and pointwise features defined for better interaction encoding, NIT effectively guides the feature matching in the NIFs of the new object instances such that the relative poses are optimized to realize the manipulation while imitating the demo interactions. Experiments show that our NIFT solution outperforms state-of-the-art imitation learning methods for object manipulation and generalizes better to objects from new categories.


title: A Magnetic Framelet-Based Convolutional Neural Network for Directed Graphs

abstract: Spectral Graph Convolutional Networks (spectral GCNNs), a powerful tool for analyzing and processing graph data, typically apply frequency filtering via Fourier transform to obtain representations with selective information. Although research shows that spectral GCNNs can be enhanced by framelet-based filtering, the massive majority of such research only considers undirected graphs. In this paper, we introduce Framelet-MagNet, a magnetic framelet-based spectral GCNN for directed graphs (digraphs). The model applies the framelet transform to digraph signals to form a more sophisticated representation for filtering. Digraph framelets are constructed with the complex-valued magnetic Laplacian, simultaneously leading to signal processing in both real and complex domains. We empirically validate the predictive power of Framelet-MagNet over a range of state-of-the-art models in node classification, link prediction, and denoising.


title: MBTI Personality Prediction for Fictional Characters Using Movie Scripts

abstract: An NLP model that understands stories should be able to understand the characters in them. To support the development of neural models for this purpose, we construct a benchmark, Story2Personality. The task is to predict a movie character's MBTI or Big 5 personality types based on the narratives of the character. Experiments show that our task is challenging for the existing text classification models, as none is able to largely outperform random guesses. We further proposed a multi-view model for personality prediction using both verbal and non-verbal descriptions, which gives improvement compared to using only verbal descriptions. The uniqueness and challenges in our dataset call for the development of narrative comprehension techniques from the perspective of understanding characters.


title: Reference Governor for Input-Constrained MPC to Enforce State Constraints at Lower Computational Cost

abstract: In this paper, a control scheme is developed based on an input constrained Model Predictive Controller (MPC) and the idea of modifying the reference command to enforce constraints, usual of Reference Governors (RG). The proposed scheme, referred to as the RGMPC, requires optimization for MPC with input constraints for which fast algorithms exist, and can handle (possibly nonlinear) state and input constraints. Conditions are given that ensure recursive feasibility of the RGMPC scheme and finite-time convergence of the modified command to the the desired reference command. Simulation results for a spacecraft rendezvous maneuver with linear and nonlinear constraints demonstrate that the RGMPC scheme has lower average computational time as compared to state and input constrained MPC with similar performance.


title: Improving Chinese Spelling Check by Character Pronunciation Prediction: The Effects of Adaptivity and Granularity

abstract: Chinese spelling check (CSC) is a fundamental NLP task that detects and corrects spelling errors in Chinese texts. As most of these spelling errors are caused by phonetic similarity, effectively modeling the pronunciation of Chinese characters is a key factor for CSC. In this paper, we consider introducing an auxiliary task of Chinese pronunciation prediction (CPP) to improve CSC, and, for the first time, systematically discuss the adaptivity and granularity of this auxiliary task. We propose SCOPE which builds on top of a shared encoder two parallel decoders, one for the primary CSC task and the other for a fine-grained auxiliary CPP task, with a novel adaptive weighting scheme to balance the two tasks. In addition, we design a delicate iterative correction strategy for further improvements during inference. Empirical evaluation shows that SCOPE achieves new state-of-the-art on three CSC benchmarks, demonstrating the effectiveness and superiority of the auxiliary CPP task. Comprehensive ablation studies further verify the positive effects of adaptivity and granularity of the task. Code and data used in this paper are publicly available at https://github.com/jiahaozhenbang/SCOPE.


title: Demystifying Hidden Sensitive Operations in Android apps

abstract: Security of Android devices is now paramount, given their wide adoption among consumers. As researchers develop tools for statically or dynamically detecting suspicious apps, malware writers regularly update their attack mechanisms to hide malicious behavior implementation. This poses two problems to current research techniques: static analysis approaches, given their over-approximations, can report an overwhelming number of false alarms, while dynamic approaches will miss those behaviors that are hidden through evasion techniques. We propose in this work a static approach specifically targeted at highlighting hidden sensitive operations, mainly sensitive data flows. The prototype version of HiSenDroid has been evaluated on a large-scale dataset of thousands of malware and goodware samples on which it successfully revealed anti-analysis code snippets aiming at evading detection by dynamic analysis. We further experimentally show that, with FlowDroid, some of the hidden sensitive behaviors would eventually lead to private data leaks. Those leaks would have been hard to spot either manually among the large number of false positives reported by the state of the art static analyzers, or by dynamic tools. Overall, by putting the light on hidden sensitive operations, HiSenDroid helps security analysts in validating potential sensitive data operations, which would be previously unnoticed.


title: Semi-supervised object detection based on single-stage detector for thighbone fracture localization

abstract: The thighbone is the largest bone supporting the lower body. If the thighbone fracture is not treated in time, it will lead to lifelong inability to walk. Correct diagnosis of thighbone disease is very important in orthopedic medicine. Deep learning is promoting the development of fracture detection technology. However, the existing computer aided diagnosis (CAD) methods baesd on deep learning rely on a large number of manually labeled data, and labeling these data costs a lot of time and energy. Therefore, we develop a object detection method with limited labeled image quantity and apply it to the thighbone fracture localization. In this work, we build a semi-supervised object detection(SSOD) framework based on single-stage detector, which including three modules: adaptive difficult sample oriented (ADSO) module, Fusion Box and deformable expand encoder (Dex encoder). ADSO module takes the classification score as the label reliability evaluation criterion by weighting, Fusion Box is designed to merge similar pseudo boxes into a reliable box for box regression and Dex encoder is proposed to enhance the adaptability of image augmentation. The experiment is conducted on the thighbone fracture dataset, which includes 3484 training thigh fracture images and 358 testing thigh fracture images. The experimental results show that the proposed method achieves the state-of-the-art AP in thighbone fracture detection at different labeled data rates, i.e. 1%, 5% and 10%. Besides, we use full data to achieve knowledge distillation, our method achieves 86.2% AP50 and 52.6% AP75.


title: Task Phasing: Automated Curriculum Learning from Demonstrations

abstract: Applying reinforcement learning (RL) to sparse reward domains is notoriously challenging due to insufficient guiding signals. Common RL techniques for addressing such domains include (1) learning from demonstrations and (2) curriculum learning. While these two approaches have been studied in detail, they have rarely been considered together. This paper aims to do so by introducing a principled task phasing approach that uses demonstrations to automatically generate a curriculum sequence. Using inverse RL from (suboptimal) demonstrations we define a simple initial task. Our task phasing approach then provides a framework to gradually increase the complexity of the task all the way to the target task, while retuning the RL agent in each phasing iteration. Two approaches for phasing are considered: (1) gradually increasing the proportion of time steps an RL agent is in control, and (2) phasing out a guiding informative reward function. We present conditions that guarantee the convergence of these approaches to an optimal policy. Experimental results on 3 sparse reward domains demonstrate that our task phasing approaches outperform state-of-the-art approaches with respect to asymptotic performance.


title: Visual-Semantic Contrastive Alignment for Few-Shot Image Classification

abstract: Few-Shot learning aims to train and optimize a model that can adapt to unseen visual classes with only a few labeled examples. The existing few-shot learning (FSL) methods, heavily rely only on visual data, thus fail to capture the semantic attributes to learn a more generalized version of the visual concept from very few examples. However, it is a known fact that human visual learning benefits immensely from inputs from multiple modalities such as vision, language, and audio. Inspired by the human learning nature of encapsulating the existing knowledge of a visual category which is in the form of language, we introduce a contrastive alignment mechanism for visual and semantic feature vectors to learn much more generalized visual concepts for few-shot learning. Our method simply adds an auxiliary contrastive learning objective which captures the contextual knowledge of a visual category from a strong textual encoder in addition to the existing training mechanism. Hence, the approach is more generalized and can be plugged into any existing FSL method. The pre-trained semantic feature extractor (learned from a large-scale text corpora) we use in our approach provides a strong contextual prior knowledge to assist FSL. The experimental results done in popular FSL datasets show that our approach is generic in nature and provides a strong boost to the existing FSL baselines.


title: Foliated-Exotic Duality in Fractonic BF Theories

abstract: There has been proposed two continuum descriptions of fracton systems: foliated quantum field theories (FQFTs) and exotic quantum field theories. Certain fracton systems are believed to admit descriptions by both, and hence a duality is expected between such a class of FQFTs and exotic QFTs. In this paper we study this duality in detail for concrete examples in $2+1$ and $3+1$ dimensions. In the examples, both sides of the continuum theories are of $BF$-type, and we find the explicit correspondences of gauge-invariant operators, gauge fields, parameters, and allowed singularities and discontinuities. This deepens the understanding of dualities in fractonic quantum field theories.


title: Contactomorphisms of the sphere without translated points

abstract: We construct a contactomorphism of the standard sphere which does not have any translated points, providing a negative answer to a conjecture posed by Sandon.


title: Synthetic Blip Effects: Generalizing Synthetic Controls for the Dynamic Treatment Regime

abstract: We propose a generalization of the synthetic control and synthetic interventions methodology to the dynamic treatment regime. We consider the estimation of unit-specific treatment effects from panel data collected via a dynamic treatment regime and in the presence of unobserved confounding. That is, each unit receives multiple treatments sequentially, based on an adaptive policy, which depends on a latent endogenously time-varying confounding state of the treated unit. Under a low-rank latent factor model assumption and a technical overlap assumption we propose an identification strategy for any unit-specific mean outcome under any sequence of interventions. The latent factor model we propose admits linear time-varying and time-invariant dynamical systems as special cases. Our approach can be seen as an identification strategy for structural nested mean models under a low-rank latent factor assumption on the blip effects. Our method, which we term "synthetic blip effects", is a backwards induction process, where the blip effect of a treatment at each period and for a target unit is recursively expressed as linear combinations of blip effects of a carefully chosen group of other units that received the designated treatment. Our work avoids the combinatorial explosion in the number of units that would be required by a vanilla application of prior synthetic control and synthetic intervention methods in such dynamic treatment regime settings.


title: Asymmetric Leptoquark Pair Production at LHC

abstract: We investigate asymmetric leptoquark pair production mechanism at the Large Hadron Collider to advocate its potential relevance to establish reliable constraints on the leptoquark parameter space and its ability to aid in correct identification of these attractive sources of new physics. The main feature of asymmetric pair production that genuinely distinguishes it from the usual leptoquark pair production is given by the fact that the two leptoquarks that are produced in proton-proton collisions through a $t$-channel lepton exchange are not charge conjugates of each other. Hence the proposed name of asymmetric leptoquark pair production for this type of process. We spell out prerequisite conditions for the asymmetric leptoquark pair production mechanism to be operational and enumerate all possible combinations of leptoquark multiplets that can potentially generate it. We finally reinterpret existing leptoquark pair production search results within several simple scalar leptoquark extensions of the Standard Model, assuming that the leptoquarks exclusively couple to either electrons or muons and the first generation quarks, to demonstrate proper inclusion of asymmetric pair production. We consequently present accurate parameter space constraints for the $S_1$, $S_3$, $R_2$, $S_1$+$S_3$, and $S_1$+$R_2$ leptoquark scenarios.


title: Pre-trained Sentence Embeddings for Implicit Discourse Relation Classification

abstract: Implicit discourse relations bind smaller linguistic units into coherent texts. Automatic sense prediction for implicit relations is hard, because it requires understanding the semantics of the linked arguments. Furthermore, annotated datasets contain relatively few labeled examples, due to the scale of the phenomenon: on average each discourse relation encompasses several dozen words. In this paper, we explore the utility of pre-trained sentence embeddings as base representations in a neural network for implicit discourse relation sense classification. We present a series of experiments using both supervised end-to-end trained models and pre-trained sentence encoding techniques - SkipThought, Sent2vec and Infersent. The pre-trained embeddings are competitive with the end-to-end model, and the approaches are complementary, with combined models yielding significant performance improvements on two of the three evaluations.


title: SimpleClick: Interactive Image Segmentation with Simple Vision Transformers

abstract: Click-based interactive image segmentation aims at extracting objects with a limited user clicking. A hierarchical backbone is the de-facto architecture for current methods. Recently, the plain, non-hierarchical Vision Transformer (ViT) has emerged as a competitive backbone for dense prediction tasks. This design allows the original ViT to be a foundation model that can be finetuned for downstream tasks without redesigning a hierarchical backbone for pretraining. Although this design is simple and has been proven effective, it has not yet been explored for interactive image segmentation. To fill this gap, we propose SimpleClick, the first interactive segmentation method that leverages a plain backbone. Based on the plain backbone, we introduce a symmetric patch embedding layer that encodes clicks into the backbone with minor modifications to the backbone itself. With the plain backbone pretrained as a masked autoencoder (MAE), SimpleClick achieves state-of-the-art performance. Remarkably, our method achieves 4.15 NoC@90 on SBD, improving 21.8% over the previous best result. Extensive evaluation on medical images demonstrates the generalizability of our method. We further develop an extremely tiny ViT backbone for SimpleClick and provide a detailed computational analysis, highlighting its suitability as a practical annotation tool.


title: Sensitivity of quantum gate fidelity to laser phase and intensity noise

abstract: The fidelity of gate operations on neutral atom qubits is often limited by fluctuations of the laser drive. Here, we quantify the sensitivity of quantum gate fidelities to laser phase and intensity noise. We first develop models to identify features observed in laser self-heterodyne noise spectra, focusing on the effects of white noise and servo bumps. In the weak-noise regime, characteristic of well-stabilized lasers, we show that an analytical theory based on a perturbative solution of a master equation agrees very well with numerical simulations that incorporate phase noise. We compute quantum gate fidelities for one- and two-photon Rabi oscillations and show that they can be enhanced by an appropriate choice of Rabi frequency relative to spectral noise peaks. We also analyze the influence of intensity noise with spectral support smaller than the Rabi frequency. Our results establish requirements on laser noise levels needed to achieve desired gate fidelities.


title: Nonlinear potential estimates for sublinear problems with applications to elliptic semilinear and quasilinear equations

abstract: We give a survey of nonlinear potential estimates and their applications obtained recently for positive solutions to sublinear problems of the type \[ u = \mathbf{G}(\sigma u^q) + f \quad \textrm{in} \,\, \Omega, \] where $0 < q < 1$, $\sigma\ge 0$ is a Radon measure in $\Omega$, $ f \ge 0$ is a measurable function, and $\mathbf{G}$ is a linear integral operator with positive kernel $G$ on $\Omega\times\Omega$. For quasi-metric (or quasi-metrically modifiable) kernels $G$, these bilateral pointwise estimates yield existence criteria and uniqueness of solutions $u \in L^q_{{\rm loc}} (\Omega, \sigma)$. Applications are considered to semilinear elliptic equations involving the (fractional) Laplacian, \[ (-\Delta)^{\frac{\alpha}{2}} u = \sigma u^q + \mu \quad \textrm{in} \,\, \Omega, \qquad u=0 \, \, \textrm{in} \,\, \Omega^c. \] Here $0<q<1$, $\mu, \sigma \ge 0$ are Radon measures, and $\Omega$ is a bounded uniform domain in ${\mathbb R}^n$, if $0 < \alpha \le 2$, or the entire space ${\mathbb R}^n$, a ball or half-space, if $0 < \alpha <n$. Analogues of these results are presented for elliptic equations involving the $p$-Laplace operator on the entire space ${\mathbb R}^n$, \[ -\Delta_p u = \sigma u^q + \mu \quad \textrm{in} \,\, {\mathbb R}^n, \qquad \liminf_{x\to \infty} u(x)=0, \] where $0<q<p-1$, and $\mu, \sigma \ge 0$ are Radon measures. More general quasilinear equations with $\mathcal{A}$-Laplace operators ${\rm div} \mathcal{A}(x, \nabla u)$ in place of $\Delta_p$ are covered as well.


title: Laser-induced Creation of antiferromagnetic 180-degree domains in NiO/Pt bilayers

abstract: We demonstrate how the antiferromagnetic order in heterostructures of NiO/Pt thin films can be modified by optical pulses. We irradiate our samples with laser light and identify an optically induced creation of antiferromagnetic domains by imaging the created domain structure utilizing the X-ray magnetic linear dichroism effect. We study the effect of different laser polarizations on the domain formation and identify a polarization-independent creation of 180{\deg} domain walls and domains with 180{\deg} different N\'eel vector orientation. By varying the irradiation parameters, we determine the switching mechanism to be thermally induced and demonstrate the reversibility. We thus demonstrate experimentally the possibility to optically create antiferromagnetic domains, an important step towards future functionalization of all optical switching mechanisms in antiferromagnets.


title: Efficient variational approximations for state space models

abstract: Variational Bayes methods are a potential scalable estimation approach for state space models. However, existing methods are inaccurate or computationally infeasible for many state space models. This paper proposes a variational approximation that is accurate and fast for any model with a closed-form measurement density function and a state transition distribution within the exponential family of distributions. We show that our method can accurately and quickly estimate a multivariate Skellam stochastic volatility model with high-frequency tick-by-tick discrete price changes of four stocks, and a time-varying parameter vector autoregression with a stochastic volatility model using eight macroeconomic variables.


title: Exploring the cosmological dark matter coincidence using infrared fixed points

abstract: The asymmetric dark matter (ADM) paradigm is motivated by the apparent coincidence between the cosmological mass densities of visible and dark matter, $\Omega_\mathrm{DM} \simeq 5\Omega_\mathrm{VM}$. However, most ADM models only relate the number densities of visible and dark matter, and do not motivate the similarity in their particle masses. One exception is a framework introduced by Bai and Schwaller, where the dark matter is a confined state of a dark QCD-like gauge group, and the confinement scales of visible and dark QCD are related by a dynamical mechanism utilising infrared fixed points of the two gauge couplings. We build upon this framework by properly implementing the dependence of the results on the initial conditions for the gauge couplings in the UV. We then reassess the ability of this framework to naturally explain the cosmological mass density coincidence, and find a reduced number of viable models. We identify features of the viable models that allow them to naturally relate the masses of the dark baryon and the proton while also avoiding collider constraints on the new particle content introduced.


title: Law Article-Enhanced Legal Case Matching: a Causal Learning Approach

abstract: Legal case matching, which automatically constructs a model to estimate the similarities between the source and target cases, has played an essential role in intelligent legal systems. Semantic text matching models have been applied to the task where the source and target legal cases are considered as long-form text documents. These general-purpose matching models make the predictions solely based on the texts in the legal cases, overlooking the essential role of the law articles in legal case matching. In the real world, the matching results (e.g., relevance labels) are dramatically affected by the law articles because the contents and the judgments of a legal case are radically formed on the basis of law. From the causal sense, a matching decision is affected by the mediation effect from the cited law articles by the legal cases, and the direct effect of the key circumstances (e.g., detailed fact descriptions) in the legal cases. In light of the observation, this paper proposes a model-agnostic causal learning framework called Law-Match, under which the legal case matching models are learned by respecting the corresponding law articles. Given a pair of legal cases and the related law articles, Law-Match considers the embeddings of the law articles as instrumental variables (IVs), and the embeddings of legal cases as treatments. Using IV regression, the treatments can be decomposed into law-related and law-unrelated parts, respectively reflecting the mediation and direct effects. These two parts are then combined with different weights to collectively support the final matching prediction. We show that the framework is model-agnostic, and a number of legal case matching models can be applied as the underlying models. Comprehensive experiments show that Law-Match can outperform state-of-the-art baselines on three public datasets.


title: Evaluation of multiple imputation to address intended and unintended missing data in case-cohort studies with a binary endpoint

abstract: Case-cohort studies are conducted within cohort studies, wherein collection of exposure data is limited to a subset of the cohort, leading to a large proportion of missing data by design. Standard analysis uses inverse probability weighting (IPW) to address this intended missing data, but little research has been conducted into how best to perform analysis when there is also unintended missingness. Multiple imputation (MI) has become a default standard for handling unintended missingness, but when used in combination with IPW, the imputation model needs to take account of the weighting to ensure compatibility with the analysis model. Alternatively, MI could be used to handle both the intended and unintended missingness. While the performance of a solely MI approach has been investigated in the context of a case-cohort study with a time-to-event outcome, it is unclear how this approach performs with binary outcomes. We conducted a simulation study to assess and compare the performance of approaches using only MI, only IPW, and a combination of MI and IPW, for handling intended and unintended missingness in this setting. We also applied the approaches to a case study. Our results show that the combined approach is approximately unbiased for estimation of the exposure effect when the sample size is large, and was the least biased with small sample sizes, while MI-only or IPW-only exhibited larger biases in both sample size settings. These findings suggest that MI is the preferred approach to handle intended and unintended missing data in case-cohort studies with binary outcomes.


title: Homological and homotopical aspects of Gorenstein flat modules and complexes relative to duality pairs

abstract: We study homological and homotopical aspects of Gorenstein flat modules over a ring with respect to a duality pair $(\mathcal{L,A})$. These modules are defined as cycles of exact chain complexes with components in $\mathcal{L}$ which remain exact after tensoring by objects in $\mathcal{A} \cap {}^\perp\mathcal{A} = \mathcal{A} \cap \Big( \bigcap_{i \in \mathbb{Z}_{> 0}} {\rm Ker}({\rm Ext}^i_{R^{\rm o}}(-,\mathcal{A})) \Big)$. In the case where $(\mathcal{L,A})$ is product closed and bicomplete (meaning in addition that $\mathcal{L}$ is closed under extensions, (co)products, $R \in \mathcal{L}$, $(\mathcal{A,L})$ is also a duality pair, and $\mathcal{A}$ is the right half of a hereditary complete cotorsion pair) we prove that these relative Gorenstein flat modules are closed under extensions, and that the corresponding Gorenstein flat dimension is well behaved in the sense that it recovers many of the properties and characterizations of its (absolute) Gorenstein flat counterpart (for instance, it can be described in terms of torsion functors). The latter in turn is a consequence of a Pontryagin duality relation that we show between these relative Gorenstein flat modules and certain Gorenstein injective modules relative to $\mathcal{A}$. We also find several hereditary and cofibrantly generated abelian model structures from these Gorenstein flat modules and complexes relative to $(\mathcal{L,A})$. At the level of chain complexes, we find three recollements between the homotopy categories of these model structures, along with several derived adjunctions connecting these recollements.


title: Life in Complex Fluids: Swimming in Polymers

abstract: Many microorganisms live and evolve in complex fluids. Examples include mammalian spermatozoa in cervical mucus, worms (e.g., \textit{C. elegans}) in wet soil, and bacteria (e.g., \textit{H. pylori}) in our stomach lining. Due to the presence of (bio)polymers and/or solids, such fluids often display nonlinear response to (shear) stresses including viscoelasticity and shear-rate dependent viscosity. The successful interaction between these microorganisms and their fluid environment is critical to the function of many biological processes including human reproduction, ecosystem dynamics, and the spread of disease \& infection. This interaction is often nonlinear and can lead to many unexpected behavior. Here, I will discuss developments in characterizing, modeling, and understanding the swimming behavior of model microorganism in viscoelastic and shear-thinning fluids. Three main microorganisms will be explored: (i) the nematode \textit{C. elegans}, an undulatory swimmer; (ii) the green algae \textit{C. reinhardtii}, a puller swimmer; and (iii) the bacterium \textit{E. coli}, a pusher swimmer. Investigation with artificial particles/swimmers will also be discussed; such studies are helpful in decoupling the biology from hydrodynamic effects. We will explore the interactions between these swimmers' gaits, geometry, and actuation and fluid rheological behavior using mostly experiments, and discuss these results relative to numerical and analytical predictions.


title: Towards Sustainable Self-supervised Learning

abstract: Although increasingly training-expensive, most self-supervised learning (SSL) models have repeatedly been trained from scratch but not fully utilized, since only a few SOTAs are employed for downstream tasks. In this work, we explore a sustainable SSL framework with two major challenges: i) learning a stronger new SSL model based on the existing pretrained SSL model, also called as "base" model, in a cost-friendly manner, ii) allowing the training of the new model to be compatible with various base models. We propose a Target-Enhanced Conditional (TEC) scheme which introduces two components to the existing mask-reconstruction based SSL. Firstly, we propose patch-relation enhanced targets which enhances the target given by base model and encourages the new model to learn semantic-relation knowledge from the base model by using incomplete inputs. This hardening and target-enhancing help the new model surpass the base model, since they enforce additional patch relation modeling to handle incomplete input. Secondly, we introduce a conditional adapter that adaptively adjusts new model prediction to align with the target of different base models. Extensive experimental results show that our TEC scheme can accelerate the learning speed, and also improve SOTA SSL base models, e.g., MAE and iBOT, taking an explorative step towards sustainable SSL.


title: Multi-Granularity Optimization for Non-Autoregressive Translation

abstract: Despite low latency, non-autoregressive machine translation (NAT) suffers severe performance deterioration due to the naive independence assumption. This assumption is further strengthened by cross-entropy loss, which encourages a strict match between the hypothesis and the reference token by token. To alleviate this issue, we propose multi-granularity optimization for NAT, which collects model behaviors on translation segments of various granularities and integrates feedback for backpropagation. Experiments on four WMT benchmarks show that the proposed method significantly outperforms the baseline models trained with cross-entropy loss, and achieves the best performance on WMT'16 En-Ro and highly competitive results on WMT'14 En-De for fully non-autoregressive translation.