title: Optimization of Rocker-Bogie Mechanism using Heuristic Approaches

abstract: Optimal locomotion and efficient traversal of extraterrestrial rovers in dynamic terrains and environments is an important problem statement in the field of planetary science and geophysical systems. Designing a superlative and efficient architecture for the suspension mechanism of planetary rovers is a crucial step towards robust rovers. This paper focuses on the Rocker Bogie mechanism, a standard suspension methodology associated with foreign terrains. After scrutinizing the available previous literature and by leveraging various optimization and global minimization algorithms, this paper offers a novel study on mechanical design optimization of a rovers suspension mechanism. This paper presents extensive tests on Simulated Annealing, Genetic Algorithms, Swarm Intelligence techniques, Basin Hoping and Differential Evolution, while thoroughly assessing every related hyper parameter, to find utility driven solutions. We also assess Dual Annealing and subsidiary algorithms for the aforementioned task while maintaining an unbiased testing standpoint for ethical research. Computational efficiency and overall fitness are considered key valedictory parameters for assessing the related algorithms, emphasis is also given to variable input seeds to find the most suitable utility driven strategy. Simulated Annealing was obtained empirically to be the top performing heuristic strategy, with a fitness of 760, which was considerably superior to other algorithms and provided consistent performance across various input seeds and individual performance indicators.


title: Limit Cycles of AdaBoost

abstract: The iterative weight update for the AdaBoost machine learning algorithm may be realized as a dynamical map on a probability simplex. When learning a low-dimensional data set this algorithm has a tendency towards cycling behavior, which is the topic of this paper. AdaBoost's cycling behavior lends itself to direct computational methods that are ineffective in the general, non-cycling case of the algorithm. From these computational properties we give a concrete correspondence between AdaBoost's cycling behavior and continued fractions dynamics. Then we explore the results of this correspondence to expound on how the algorithm comes to be in this periodic state at all. What we intend for this work is to be a novel and self-contained explanation for the cycling dynamics of this machine learning algorithm.


title: A large-scale kinematic study of molecular gas in high-z cluster galaxies: Evidence for high levels of kinematic asymmetry

abstract: We investigate the resolved kinematics of the molecular gas, as traced by ALMA in CO (2-1), of 25 cluster member galaxies across three different clusters at a redshift of $z\sim1.6$. This is the first large-scale analysis of the molecular gas kinematics of cluster galaxies at this redshift. By separately estimating the rotation curve of the approaching and receding side of each galaxy via kinematic modeling, we quantify the difference in total circular velocity to characterize the overall kinematic asymmetry of each galaxy. 3/14 of the galaxies in our sample that we are able to model have similar degrees of asymmetry as that observed in galaxies in the field at similar redshift. However, this leaved 11/14 galaxies in our sample with significantly higher asymmetry, and some of these galaxies have degrees of asymmetry of up to $\sim$50 times higher than field galaxies observed at similar redshift. Some of these extreme cases also have one-sided tail-like morphology seen in the molecular gas, supporting a scenario of tidal and/or ram pressure interaction. Such stark differences in the kinematic asymmetry in clusters versus the field suggest the evolutionary influence of dense environments, established as being a major driver of galaxy evolution at low-redshift, is also active in the high-redshift universe.


title: How Much Structure Is Needed for Huge Quantum Speedups?

abstract: I survey, for a general scientific audience, three decades of research into which sorts of problems admit exponential speedups via quantum computers -- from the classics (like the algorithms of Simon and Shor), to the breakthrough of Yamakawa and Zhandry from April 2022. I discuss both the quantum circuit model, which is what we ultimately care about in practice but where our knowledge is radically incomplete, and the so-called oracle or black-box or query complexity model, where we've managed to achieve a much more thorough understanding that then informs our conjectures about the circuit model. I discuss the strengths and weaknesses of switching attention to sampling tasks, as was done in the recent quantum supremacy experiments. I make some skeptical remarks about widely-repeated claims of exponential quantum speedups for practical machine learning and optimization problems. Through many examples, I try to convey the "law of conservation of weirdness," according to which every problem admitting an exponential quantum speedup must have some unusual property to allow the amplitude to be concentrated on the unknown right answer(s).


title: Robust Transferable Feature Extractors: Learning to Defend Pre-Trained Networks Against White Box Adversaries

abstract: The widespread adoption of deep neural networks in computer vision applications has brought forth a significant interest in adversarial robustness. Existing research has shown that maliciously perturbed inputs specifically tailored for a given model (i.e., adversarial examples) can be successfully transferred to another independently trained model to induce prediction errors. Moreover, this property of adversarial examples has been attributed to features derived from predictive patterns in the data distribution. Thus, we are motivated to investigate the following question: Can adversarial defenses, like adversarial examples, be successfully transferred to other independently trained models? To this end, we propose a deep learning-based pre-processing mechanism, which we refer to as a robust transferable feature extractor (RTFE). After examining theoretical motivation and implications, we experimentally show that our method can provide adversarial robustness to multiple independently pre-trained classifiers that are otherwise ineffective against an adaptive white box adversary. Furthermore, we show that RTFEs can even provide one-shot adversarial robustness to models independently trained on different datasets.


title: Optimizing Connectivity through Network Gradients for Restricted Boltzmann Machines

abstract: Leveraging sparse networks to connect successive layers in deep neural networks has recently been shown to provide benefits to large scale state-of-the-art models. However, network connectivity also plays a significant role on the learning performance of shallow networks, such as the classic Restricted Boltzmann Machines (RBM). Efficiently finding sparse connectivity patterns that improve the learning performance of shallow networks is a fundamental problem. While recent principled approaches explicitly include network connections as model parameters that must be optimized, they often rely on explicit penalization or have network sparsity as a hyperparameter. This work presents the Network Connectivity Gradients (NCG), a method to find optimal connectivity patterns for RBMs based on the idea of network gradients: computing the gradient of every possible connection, given a specific connection pattern, and using the gradient to drive a continuous connection strength parameter that in turn is used to determine the connection pattern. Thus, learning RBM parameters and learning network connections is truly jointly performed, albeit with different learning rates, and without changes to the model's classic objective function. The method is applied to the MNIST and other data sets showing that better RBM models are found for the benchmark tasks of sample generation and input classification. Results also show that NCG is robust to network initialization, both adding and removing network connections while learning.


title: Distribution of a second-class particle's position in the two-species ASEP with a special initial configuration

abstract: In this paper, we consider the two-species asymmetric simple exclusion process consisting of $N-1$ first-class particles and one second-class particle. We assume that the second-class particle is the rightmost particle at t=0. We provide an alternative method to Tracy and Widom's method in [J. Phys. A, 42, 425002, (2009)] to find the probability distribution of the second-class particle's position.

categories: math.PR cond-mat.stat-mech math-ph math.MP


title: Prime Solutions of Diagonal Diophantine Systems

abstract: Consider a general diagonal system of Diophantine equations. Contingent on existence of an appropriate mean value bound (and local solvability), an asymptotic formula for the number of prime solutions is found. This is used in conjunction with the Vinogradov Mean Value Theorem to give an asymptotic formula for solutions of Vinogradov systems, and in conjunction with Hooley's work on seven cubes to give a conditional result for the Waring-Goldbach problem on seven cubes of primes, contingent on Hooley's form of Riemann hypothesis.


title: Spurious dipole mode in random-phase approximation and in the RPA-based models

abstract: The problems related to the existence of the spurious dipole mode (SDM) in the self-consistent nuclear-structure models are considered. A method is formulated that allows to eliminate coupling of the SDM with the physical modes in the extended random-phase approximation (ERPA) theories, in particular, in the time blocking approximation (TBA) which is the model of the ERPA type. It is shown that the application of this method in the realistic TBA calculations of the $E1$ excitations gives the results which are very close to the results of the TBA calculations without using this method if the bare external-field $E1$ operators are replaced by the effective ones.


title: Vision-Based Uncertainty-Aware Motion Planning based on Probabilistic Semantic Segmentation

abstract: For safe operation, a robot must be able to avoid collisions in uncertain environments. Existing approaches for motion planning under uncertainties often assume parametric obstacle representations and Gaussian uncertainty, which can be inaccurate. While visual perception can deliver a more accurate representation of the environment, its use for safe motion planning is limited by the inherent miscalibration of neural networks and the challenge of obtaining adequate datasets. To address these limitations, we propose to employ ensembles of deep semantic segmentation networks trained with massively augmented datasets to ensure reliable probabilistic occupancy information. To avoid conservatism during motion planning, we directly employ the probabilistic perception in a scenario-based path planning approach. A velocity scheduling scheme is applied to the path to ensure a safe motion despite tracking inaccuracies. We demonstrate the effectiveness of the massive data augmentation in combination with deep ensembles and the proposed scenario-based planning approach in comparisons to state-of-the-art methods and validate our framework in an experiment with a human hand as an obstacle.


title: A CHEOPS-enhanced view of the HD3167 system

abstract: Much remains to be understood about the nature of exoplanets smaller than Neptune, most of which have been discovered in compact multi-planet systems. With its inner ultra-short period planet b aligned with the star and two larger outer planets d-c on polar orbits, the multi-planet system HD 3167 features a peculiar architecture and offers the possibility to investigate both dynamical and atmospheric evolution processes. To this purpose we combined multiple datasets of transit photometry and radial velocimetry (RV) to revise the properties of the system and inform models of its planets. This effort was spearheaded by CHEOPS observations of HD 3167b, which appear inconsistent with a purely rocky composition despite its extreme irradiation. Overall the precision on the planetary orbital periods are improved by an order of magnitude, and the uncertainties on the densities of the transiting planets b and c are decreased by a factor of 3. Internal structure and atmospheric simulations draw a contrasting picture between HD 3167d, likely a rocky super-Earth that lost its atmosphere through photo-evaporation, and HD 3167c, a mini-Neptune that kept a substantial primordial gaseous envelope. We detect a fourth, more massive planet on a larger orbit, likely coplanar with HD 3167d-c. Dynamical simulations indeed show that the outer planetary system d-c-e was tilted, as a whole, early in the system history, when HD 3167b was still dominated by the star influence and maintained its aligned orbit. RV data and direct imaging rule out that the companion that could be responsible for the present-day architecture is still bound to the HD\,3167 system. Similar global studies of multi-planet systems will tell how many share the peculiar properties of the HD3167 system, which remains a target of choice for follow-up observations and simulations.


title: Quantum corrections to Einstein's equations

abstract: In this master thesis, the Frobenius power series method is used to find spherically symmetric and static vacuum solutions to quadratic and cubic gravitational actions, representing quantum corrections to the Einstein-Hilbert action. After a motivation to the topic and an introduction, the power series solutions are presented. After recovering the results for the quadratic action of Stelle and collaborators, we found that when the Weyl cubic operator is present, the (2,2) family of solutions is still present while the Schwarzschid-de Sitter-like (1,-1) is not.


title: The Complexity Classes of Hamming Distance Recoverable Robust Problems

abstract: In the well-known complexity class NP are combinatorial problems, whose optimization counterparts are important for many practical settings. These problems typically consider full knowledge about the input. In practical settings, however, uncertainty in the input data is a usual phenomenon, whereby this is normally not covered in optimization versions of NP problems. One concept to model the uncertainty in the input data, is recoverable robustness. The instance of the recoverable robust version of a combinatorial problem P is split into a base scenario $\sigma_0$ and an uncertainty scenario set $\textsf{S}$. The base scenario and all members of the uncertainty scenario set are instances of the original combinatorial problem P. The task is to calculate a solution $s_0$ for the base scenario $\sigma_0$ and solutions $s$ for all uncertainty scenarios $\sigma \in \textsf{S}$ such that $s_0$ and $s$ are not too far away from each other according to a distance measure, so $s_0$ can be easily adapted to $s$. This paper introduces Hamming Distance Recoverable Robustness, in which solutions $s_0$ and $s$ have to be calculated, such that $s_0$ and $s$ may only differ in at most $\kappa$ elements. We survey the complexity of Hamming distance recoverable robust versions of optimization problems, typically found in NP for different scenario encodings. The complexity is primarily situated in the lower levels of the polynomial hierarchy. The main contribution of the paper is a gadget reduction framework that shows that the recoverable robust versions of problems in a large class of combinatorial problems is $\Sigma^P_{3}$-complete. This class includes problems such as Vertex Cover, Coloring or Subset Sum. Additionally, we expand the results to $\Sigma^P_{2m+1}$-completeness for multi-stage recoverable robust problems with $m \in \mathbb{N}$ stages.


title: TEAM: a parameter-free algorithm to teach collaborative robots motions from user demonstrations

abstract: Learning from demonstrations (LfD) enables humans to easily teach collaborative robots (cobots) new motions that can be generalized to new task configurations without retraining. However, state-of-the-art LfD methods require manually tuning intrinsic parameters and have rarely been used in industrial contexts without experts. We propose a parameter-free LfD method based on probabilistic movement primitives, where parameters are determined using Jensen-Shannon divergence and Bayesian optimization, and users do not have to perform manual parameter tuning. The cobot's precision in reproducing learned motions, and its ease of teaching and use by non-expert users are evaluated in two field tests. In the first field test, the cobot works on elevator door maintenance. In the second test, three factory workers teach the cobot tasks useful for their daily workflow. Errors between the cobot and target joint angles are insignificant -- at worst 0.28 deg -- and the motion is accurately reproduced -- GMCC score of 1. Questionnaires completed by the workers highlighted the method's ease of use and the accuracy of the reproduced motion. Public implementation of our method and datasets are made available online.


title: Joint Debiased Representation and Image Clustering Learning with Self-Supervision

abstract: Contrastive learning is among the most successful methods for visual representation learning, and its performance can be further improved by jointly performing clustering on the learned representations. However, existing methods for joint clustering and contrastive learning do not perform well on long-tailed data distributions, as majority classes overwhelm and distort the loss of minority classes, thus preventing meaningful representations to be learned. Motivated by this, we develop a novel joint clustering and contrastive learning framework by adapting the debiased contrastive loss to avoid under-clustering minority classes of imbalanced datasets. We show that our proposed modified debiased contrastive loss and divergence clustering loss improves the performance across multiple datasets and learning tasks. The source code is available at https://anonymous.4open.science/r/SSL-debiased-clustering


title: Linearly Mismatched Free-by-Cyclic Groups are Asynchronously Automatic

abstract: We call the family of free-by-cyclic groups defined by $G = \left< a, t, b_1, b_2, \ldots b_k \mid at = ta, b_1^{-1}tb_1 = a^{n_1}t, \ldots b_k^{-1}tb_k = a^{n_k}t \right>$ for $n_1, n_2, \ldots n_k \in \mathbb Z$ linearly mismatched since the automorphisms used to define the HNN extensions grow linearly at different rates. Using techniques from Elder's thesis, namely words with a parallel stable letter structure, we prove that linearly mismatched free-by-cyclic groups are asynchronously automatic, and thus they have a solvable word problem.


title: Horofunctions and metric compactification of noncompact Hermitian symmetric spaces

abstract: Given a Hermitian symmetric space $M$ of noncompact type, we give a complete description of the horofunctions in the metric compactification of $M$ with respect to the Carath\'eodory distance, via the realisation of $M$ as the open unit ball $D$ of a Banach space $(V,\|\cdot\|)$ equipped with a Jordan structure, called a $\mathrm{JB}^*$-triple. The Carath\'eodory distance $\rho$ on $D$ has a Finsler structure. It is the integrated distance of the Carath\'eodory differential metric, and the norm $\|\cdot\|$ in the realisation is the Carath\'eodory norm with respect to the origin $0\in D$. We also identify the horofunctions of the metric compactification of $(V,\|\cdot\|)$ and relate its geometry and global topology to the closed dual unit ball (i.e., the polar of $D$). Moreover, we show that the exponential map $\exp_0 \colon V \longrightarrow D$ at $0\in D$ extends to a homeomorphism between the metric compactifications of $(V,\|\cdot\|)$ and $(D,\rho)$, preserving the geometric structure. Consequently, the metric compactification of $M$ admits a concrete realisation as the closed dual unit ball of $(V,\|\cdot\|)$.


title: Bioeconomic analysis of harvesting within a predator-prey system: A case study in the Chesapeake Bay fisheries

abstract: Sustainable use of biological resources is very important as over exploitation on the long run may lead to stock depletion, which in turn may threaten biodiversity. The Chesapeake Bay is an extremely complex ecosystem, and sustainable harvesting of its fisheries is essential both for the ecosystem's biodiversity and economic prosperity of the area. Here, we use ecosystem based mathematical modeling to study the population dynamics with harvesting of two key fishes in the Chesapeake Bay, the Atlantic Menhaden (Brevoortia tyrannus) as a prey and the Striped Bass (Morone saxatilis) as a predator. We start by fitting the generalized Lotka-Volterra model to actual time series abundance data of the two species obtained from fisheries in the Bay. We derive conditions for the existence of the bio-economic equilibrium and investigate the stability and the resilience of the biological system. We study the maximum sustainable yield, maximum economic yield, and resilience maximizing yield policies and their effects on the fisheries long term sustainability, particularly with respect to the menhaden-bass population dynamics. This study may be used by policy-makers to balance the economic and ecological harvesting goals while managing the populations of Atlantic menhaden and striped bass in the Chesapeake Bay fisheries.


title: Robust Oscillations and Edge Modes in Nonunitary Floquet Systems

abstract: We explore oscillatory behaviour in a family of periodically driven spin chains which are subject to a weak measurement followed by post-selection. We discover a transition to an oscillatory phase as the strength of the measurement is increased. By mapping these spin chains to free fermion models, we find that this transition is reflected in the opening of a gap in the imaginary direction. Interestingly, we find a robust, purely real, edge $\pi$-mode in the oscillatory phase. We establish a correspondence between the complex bulk spectrum and these edge modes. These oscillations are numerically found to be stable against interactions and disorder.


title: Robust Product Classification with Instance-Dependent Noise

abstract: Noisy labels in large E-commerce product data (i.e., product items are placed into incorrect categories) are a critical issue for product categorization task because they are unavoidable, non-trivial to remove and degrade prediction performance significantly. Training a product title classification model which is robust to noisy labels in the data is very important to make product classification applications more practical. In this paper, we study the impact of instance-dependent noise to performance of product title classification by comparing our data denoising algorithm and different noise-resistance training algorithms which were designed to prevent a classifier model from over-fitting to noise. We develop a simple yet effective Deep Neural Network for product title classification to use as a base classifier. Along with recent methods of stimulating instance-dependent noise, we propose a novel noise stimulation algorithm based on product title similarity. Our experiments cover multiple datasets, various noise methods and different training solutions. Results uncover the limit of classification task when noise rate is not negligible and data distribution is highly skewed.


title: Metrics to guide development of machine learning algorithms for malaria diagnosis

abstract: Automated malaria diagnosis is a difficult but high-value target for machine learning (ML), and effective algorithms could save many thousands of children's lives. However, current ML efforts largely neglect crucial use case constraints and are thus not clinically useful. Two factors in particular are crucial to developing algorithms translatable to clinical field settings: (i) Clear understanding of the clinical needs that ML solutions must accommodate; and (ii) task-relevant metrics for guiding and evaluating ML models. Neglect of these factors has seriously hampered past ML work on malaria, because the resulting algorithms do not align with clinical needs. In this paper we address these two issues in the context of automated malaria diagnosis via microscopy on Giemsa-stained blood films. First, we describe why domain expertise is crucial to effectively apply ML to malaria, and list technical documents and other resources that provide this domain knowledge. Second, we detail performance metrics tailored to the clinical requirements of malaria diagnosis, to guide development of ML models and evaluate model performance through the lens of clinical needs (versus a generic ML lens). We highlight the importance of a patient-level perspective, interpatient variability, false positive rates, limit of detection, and different types of error. We also discuss reasons why ROC curves, AUC, and F1, as commonly used in ML work, are poorly suited to this context. These findings also apply to other diseases involving parasite loads, including neglected tropical diseases (NTDs) such as schistosomiasis.


title: Automated 2D and 3D Finite Element Overclosure Adjustment and Mesh Morphing Using Generalized Regression Neural Networks

abstract: Computer representations of three-dimensional (3D) geometries are crucial for simulating systems and processes in engineering and science. In medicine, and more specifically, biomechanics and orthopaedics, obtaining and using 3D geometries is critical to many workflows. However, while many tools exist to obtain 3D geometries of organic structures, little has been done to make them usable for their intended medical purposes. Furthermore, many of the proposed tools are proprietary, limiting their use. This work introduces two novel algorithms based on Generalized Regression Neural Networks (GRNN) and 4 processes to perform mesh morphing and overclosure adjustment. These algorithms were implemented, and test cases were used to validate them against existing algorithms to demonstrate improved performance. The resulting algorithms demonstrate improvements to existing techniques based on Radial Basis Function (RBF) networks by converting to GRNN-based implementations. Implementations in MATLAB of these algorithms and the source code are publicly available at the following locations: https://github.com/thor-andreassen/femors https://simtk.org/projects/femors-rbf https://www.mathworks.com/matlabcentral/fileexchange/120353-finite-element-morphing-overclosure-reduction-and-slicing


title: Absence of a pressure gap and atomistic mechanism of the oxidation of pure Co nanoparticles

abstract: We present a detailed atomistic picture of the oxidation mechanism of Co nanoparticles and its impact on magnetism by experimentally following the evolution of the structure, chemical composition, and magnetism of individual, gas-phase grown Co nanoparticles during controlled oxidation. The early stage oxidation occurs in a twostep process characterized by (i) the initial formation of small CoO crystallites randomly distributed across the nanoparticle surface, until their coalescence leads to structural completion of the oxide shell and passivation of the metallic core; (ii) progressive conversion of the CoO shell to Co3O4, accompanied by void formation due to the nanoscale Kirkendall effect. The Co nanoparticles remain highly reactive toward oxygen during phase (i), demonstrating the absence of a pressure gap whereby a low reactivity at low pressures is postulated. Our results provide an important benchmark for an improved understanding of the magnetism of oxidized cobalt nanoparticles, with potential implications on their performance in catalytic reactions.


title: Lossy Image Compression with Conditional Diffusion Models

abstract: This paper outlines an end-to-end optimized lossy image compression framework using diffusion generative models. The approach relies on the transform coding paradigm, where an image is mapped into a latent space for entropy coding and, from there, mapped back to the data space for reconstruction. In contrast to VAE-based neural compression, where the (mean) decoder is a deterministic neural network, our decoder is a conditional diffusion model. Our approach thus introduces an additional ``content'' latent variable on which the reverse diffusion process is conditioned and uses this variable to store information about the image. The remaining ``texture'' variables characterizing the diffusion process are synthesized at decoding time. We show that the model's performance can be tuned toward perceptual metrics of interest. Our extensive experiments involving multiple datasets and image quality assessment metrics show that our approach yields stronger reported FID scores than the GAN-based model, while also yielding competitive performance with VAE-based models in several distortion metrics. Furthermore, training the diffusion with $\mathcal{X}$-parameterization enables high-quality reconstructions in only a handful of decoding steps, greatly affecting the model's practicality. Our code is available at: \url{https://github.com/buggyyang/CDC_compression}


title: Spectroscopic r-Process Abundance Retrieval for Kilonovae I: The Inferred Abundance Pattern of Early Emission from GW170817

abstract: Freshly-synthesized r-process elements in kilonovae ejecta imprint absorption features on optical spectra, as observed in the GW170817 binary neutron star merger. These spectral features encode insights into the physical conditions of the r-process and the origins of the ejected material, but associating features with particular elements and inferring the resultant abundance pattern is computationally challenging. We introduce Spectroscopic r-Process Abundance Retrieval for Kilonovae (SPARK), a modular framework to perform Bayesian inference on kilonova spectra with the goals of inferring elemental abundance patterns and identifying absorption features at early times. SPARK inputs an atomic line list and abundance patterns from reaction network calculations into the TARDIS radiative transfer code. It then performs fast Bayesian inference on observed kilonova spectra by training a Gaussian process surrogate for the approximate posteriors of kilonova ejecta parameters, via active learning. We use the spectrum of GW170817 at 1.4 days to perform the first inference on a kilonova spectrum, and recover a complete abundance pattern. Our inference shows that this ejecta was generated by an r-process with either (1) high electron fraction Y_e ~ 0.35 and high entropy s/k_B ~ 25, or, (2) a more moderate Y_e ~ 0.30 and s/k_B ~ 14. These parameters are consistent with a shocked, polar dynamical component, and a viscously-driven outflow from a remnant accretion disk, respectively. We also recover previous identifications of strontium absorption at ~8000 AA, and tentatively identify yttrium and/or zirconium at < 4500 AA. Our approach will enable computationally-tractable inference on the spectra of future kilonovae discovered through multi-messenger observations.


title: Landmark Tracking in Liver US images Using Cascade Convolutional Neural Networks with Long Short-Term Memory

abstract: This study proposed a deep learning-based tracking method for ultrasound (US) image-guided radiation therapy. The proposed cascade deep learning model is composed of an attention network, a mask region-based convolutional neural network (mask R-CNN), and a long short-term memory (LSTM) network. The attention network learns a mapping from a US image to a suspected area of landmark motion in order to reduce the search region. The mask R-CNN then produces multiple region-of-interest (ROI) proposals in the reduced region and identifies the proposed landmark via three network heads: bounding box regression, proposal classification, and landmark segmentation. The LSTM network models the temporal relationship among the successive image frames for bounding box regression and proposal classification. To consolidate the final proposal, a selection method is designed according to the similarities between sequential frames. The proposed method was tested on the liver US tracking datasets used in the Medical Image Computing and Computer Assisted Interventions (MICCAI) 2015 challenges, where the landmarks were annotated by three experienced observers to obtain their mean positions. Five-fold cross-validation on the 24 given US sequences with ground truths shows that the mean tracking error for all landmarks is 0.65+/-0.56 mm, and the errors of all landmarks are within 2 mm. We further tested the proposed model on 69 landmarks from the testing dataset that has a similar image pattern to the training pattern, resulting in a mean tracking error of 0.94+/-0.83 mm. Our experimental results have demonstrated the feasibility and accuracy of our proposed method in tracking liver anatomic landmarks using US images, providing a potential solution for real-time liver tracking for active motion management during radiation therapy.


title: On the interplay of adversarial robustness and architecture components: patches, convolution and attention

abstract: In recent years novel architecture components for image classification have been developed, starting with attention and patches used in transformers. While prior works have analyzed the influence of some aspects of architecture components on the robustness to adversarial attacks, in particular for vision transformers, the understanding of the main factors is still limited. We compare several (non)-robust classifiers with different architectures and study their properties, including the effect of adversarial training on the interpretability of the learnt features and robustness to unseen threat models. An ablation from ResNet to ConvNeXt reveals key architectural changes leading to almost $10\%$ higher $\ell_\infty$-robustness.


title: Correlation Information Bottleneck: Towards Adapting Pretrained Multimodal Models for Robust Visual Question Answering

abstract: Benefiting from large-scale pretrained vision language models (VLMs), the performance of visual question answering (VQA) has approached human oracles. However, finetuning such models on limited data often suffers from overfitting and poor generalization issues, leading to a lack of model robustness. In this paper, we aim to improve input robustness from an information bottleneck perspective when adapting pretrained VLMs to the downstream VQA task. Input robustness refers to the ability of models to defend against visual and linguistic input variations, as well as shortcut learning involved in inputs. Generally, the representations obtained by pretrained VLMs inevitably contain irrelevant and redundant information for a specific downstream task, resulting in statistically spurious correlations and insensitivity to input variations. To encourage representations to converge to a minimal sufficient statistic in multimodal learning, we propose Correlation Information Bottleneck (CIB), which seeks a tradeoff between compression and redundancy in representations by minimizing the mutual information (MI) between inputs and representations while maximizing the MI between outputs and representations. Moreover, we derive a tight theoretical upper bound for the mutual information between multimodal inputs and representations, incorporating different internal correlations that guide models to learn more robust representations and facilitate modality alignment. Extensive experiments consistently demonstrate the effectiveness and superiority of the proposed CIB in terms of input robustness and accuracy.


title: Adversarial Correctness and Privacy for Probabilistic Data Structures

abstract: We study the security of Probabilistic Data Structures (PDS) for handling Approximate Membership Queries (AMQ); prominent examples of AMQ-PDS are Bloom and Cuckoo filters. AMQ-PDS are increasingly being deployed in environments where adversaries can gain benefit from carefully selecting inputs, for example to increase the false positive rate of an AMQ-PDS. They are also being used in settings where the inputs are sensitive and should remain private in the face of adversaries who can access an AMQ-PDS through an API or who can learn its internal state by compromising the system running the AMQ-PDS. We develop simulation-based security definitions that speak to correctness and privacy of AMQ-PDS. Our definitions are general and apply to a broad range of adversarial settings. We use our definitions to analyse the behaviour of both Bloom filters and insertion-only Cuckoo filters. We show that these AMQ-PDS can be provably protected through replacement or composition of hash functions with keyed pseudorandom functions in their construction. We also examine the practical impact on storage size and computation of providing secure instances of Bloom and insertion-only Cuckoo filters.


title: Design and Analysis of Polar Codes Based on Piecewise Gaussian Approximation

abstract: In this article, we propose the construction of polar codes based on piecewise Gaussian approximation (PGA) techniques. The PGA is first optimized and then compared to the Gaussian approximation (GA) construction method, showing performance gains for medium blocks and high precision for long blocks, in scenarios with successive cancellation (SC) decoding and additive white gaussian noise (AWGN) channel. Based on the PGA, we develop two approximations based on multi-segmented polynomials that are easy to implement. We present the Approximate PGA (APGA) that is optimized for medium blocks and provides a performance improvement without increasing complexity. Furthermore, we develop the simplified PGA (SPGA) as an alternative to the GA, which is optimized for long blocks and achieves high construction accuracy. Simulation results show that the APGA and SPGA construction methods outperform existing GA and competing approaches for medium and long block codes with notable performance improvement.


title: Reduced models with nonlinear approximations of latent dynamics for model premixed flame problems

abstract: Efficiently reducing models of chemically reacting flows is often challenging because their characteristic features such as sharp gradients in the flow fields and couplings over various time and length scales lead to dynamics that evolve in high-dimensional spaces. In this work, we show that online adaptive reduced models that construct nonlinear approximations by adapting low-dimensional subspaces over time can predict well latent dynamics with properties similar to those found in chemically reacting flows. The adaptation of the subspaces is driven by the online adaptive empirical interpolation method, which takes sparse residual evaluations of the full model to compute low-rank basis updates of the subspaces. Numerical experiments with a premixed flame model problem show that reduced models based on online adaptive empirical interpolation accurately predict flame dynamics far outside of the training regime and in regimes where traditional static reduced models, which keep reduced spaces fixed over time and so provide only linear approximations of latent dynamics, fail to make meaningful predictions.


title: TESS-Keck Survey XIV: Two giant exoplanets from the Distant Giants Survey

abstract: We present the Distant Giants Survey, a three-year radial velocity (RV) campaign to measure P(DG|CS), the conditional occurrence of distant giant planets (DG; M_p ~ 0.3 - 13 M_J, P > 1 year) in systems hosting a close-in small planet (CS; R_p < 10 R_E). For the past two years, we have monitored 47 Sun-like stars hosting small transiting planets detected by TESS. We present the selection criteria used to assemble our sample and report the discovery of two distant giant planets, TOI-1669 b and TOI-1694 c. For TOI-1669 b we find that Msin i = 0.573 +/- 0.074 M_J, P = 502 +/- 16 days, and e < 0.27, while for TOI-1694 c, Msin i = 1.05 +/- 0.05 M_J, P = 389.2 +/- 3.9 days, and e = 0.18 +/- 0.05. We also confirmed the 3.8-day transiting planet TOI-1694 b by measuring a true mass of M = 26.1 +/- 2.2 M_E. We also confirmed the 3.8-day transiting planet TOI-1694 b by measuring a true mass of M = 26.1 +/- 2.2 M_E. At the end of the Distant Giants Survey, we will incorporate TOI-1669 b and TOI-1694 c into our calculation of P(DG|CS), a crucial statistic for understanding the relationship between outer giants and small inner companions.


title: Conductivity and size quantization effects in semiconductor $\delta$-layer systems

abstract: We present an open-system quantum-mechanical 3D real-space study of the conduction band structure and conductive properties of two semiconductor systems, interesting for their beyond-Moore and quantum computing applications: phosphorus $\delta$-layers in silicon and the corresponding $\delta$-layer tunnel junctions. In order to evaluate size quantization effects on the conductivity, we consider two principal cases: nanoscale finite-width structures, used in transistors, and infinitely-wide structures, electrical properties of which are typically known experimentally. For devices widths $W<10$~nm, quantization effects are strong and it is shown that the number of propagating modes determines not only the conductivity, but the distinctive spatial distribution of the current-carrying electron states. For $W>10$~nm, the quantization effects practically vanish and the conductivity tends to the infinitely-wide device values. For tunnel junctions, two distinct conductivity regimes are predicted due to the strong conduction band quantization.


title: Comparison of star formation histories of AGN and non-AGN galaxies

abstract: We use AGN with $\rm L_{X} \sim 10^{42.5-44}\,erg\,s^{-1}$, from the COSMOS-Legacy survey that lie within the UltraVISTA region and cross match them with the LEGA-C catalogue. The latter provides measurements of the calcium break, D$_n$4000, and H$_\delta$ Balmer line that allow us to study the stellar populations of AGN and compare them with a galaxy reference catalogue. Our samples consist of 69 AGN and 2176 non-AGN systems, within $\rm 0.6<z<1.3$, that satisfy the same photometric selection criteria. We construct the SEDs of both population and use the CIGALE code to investigate the effect of the two indices in the SED fitting process. Our analysis shows that the inclusion of D$_n$4000 and H$_\delta$ allows CIGALE to constrain better the ages of the stellar populations. Furthermore, we find an increase of the estimated stellar masses by, on average, $\sim 0.2$ dex, in particular for systems with young stars (D$_n$4000$\,<1.5$), when the two indices are included in the SED fitting. We then compare the D$_n$4000 and H$_\delta$ of AGN with sources in the reference catalogue, accounting for the different stellar mass of the two populations. Low to moderate L$_X$ AGN tend to reside in galaxies with older stellar populations and are less likely to have experienced a recent star formation burst, compared to galaxies in the control sample. We, also, compare the two populations as a function of their morphology (bulge-dominated, BD, vs. non-BD) and compactness. A similar fraction of AGN and non-AGN systems are classified as non-BD ($\sim 70\%$). Our analysis shows that BD AGN tend to have younger stellar populations compared to BD, non-AGN systems. On the other hand, non-BD AGN have, on average, older stellar populations and are less likely to have experienced a burst compared to non-BD sources in the reference sample. Furthermore, AGN tend to prefer more compact systems compared to non-AGN.


title: Particle-like skyrmions interacting with a funnel obstacle

abstract: The skyrmion-substrate interaction is an important issue to consider when studying particle-like skyrmions in nanostructures, which may strongly affect the skyrmion dynamics and lead to complex dynamic phenomena. Here, we report the current-driven dynamic behaviors of particle-like skyrmions interacting with the funnel obstacle in a ferromagnetic layer. We computationally demonstrate that a funnel obstacle with enhanced perpendicular magnetic anisotropy can be used to modify the dynamics of skyrmions due to the repulsive skyrmion-funnel interaction, which could generate several nontrivial effects, including the compression, clogging, annihilation, guided motion, and capturing of skyrmions. It is also found that the funnel obstacle can separate an incoming flow of skyrmions into two asymmetric flows. Moreover, we show that it is possible to capture skyrmions by the funnel obstacle in both static and dynamic ways. Our results are useful for understanding the skyrmion dynamics interacting with the substrate and could provide guidelines for the control of skyrmion flows in a transmission channel.


title: Task-adaptive physical reservoir computing

abstract: Reservoir computing is a neuromorphic architecture that potentially offers viable solutions to the growing energy costs of machine learning. In software-based machine learning, neural network properties and performance can be readily reconfigured to suit different computational tasks by changing hyperparameters. This critical functionality is missing in ``physical" reservoir computing schemes that exploit nonlinear and history-dependent memory responses of physical systems for data processing. Here, we experimentally present a `task-adaptive' approach to physical reservoir computing, capable of reconfiguring key reservoir properties (nonlinearity, memory-capacity and complexity) to optimise computational performance across a broad range of tasks. As a model case of this, we use the temperature and magnetic-field controlled spin-wave response of Cu$_2$OSeO$_3$ that hosts skyrmion, conical and helical magnetic phases, providing on-demand access to a host of different physical reservoir responses. We quantify phase-tunable reservoir performance, characterise their properties and discuss the correlation between these in physical reservoirs. This task-adaptive approach overcomes key prior limitations of physical reservoirs, opening opportunities to apply thermodynamically stable and metastable phase control across a wide variety of physical reservoir systems, as we show its transferable nature using above(near)-room-temperature demonstration with Co$_{8.5}$Zn$_{8.5}$Mn$_{3}$ (FeGe).


title: Slow dynamics and non-ergodicity of the bosonic quantum East model in the semiclassical limit

abstract: We study the unitary dynamics of the bosonic quantum East model, a kinetically constrained lattice model which generalises the quantum East model to arbitrary occupation per site. We consider the semiclassical limit of large (but finite) site occupancy, so that the dynamics are approximated by an evolution equation of the Gross-Pitaevskii kind. This allows us to numerically study in detail system sizes of hundreds of sites. Like in the spin-$1/2$ case, we find two dynamical phases, an active one of fast thermalisation, and an inactive one of slow relaxation and absence of ergodicity on numerically accessible timescales. The location of this apparent ergodic to non-ergodic transition coincides with the localisation transition of the ground state. We further characterize states which are non-ergodic on all timescales in the otherwise ergodic regime.


title: Bipedal Robot Walking Control Using Human Whole-Body Dynamic Telelocomotion

abstract: For humanoids to be deployed in demanding situations, such as search and rescue, highly intelligent decision making and proficient sensorimotor skill is expected. A promising solution is to leverage human prowess by interconnecting robot and human via teleoperation. Towards creating seamless operation, this paper presents a dynamic telelocomotion framework that synchronizes the gait of a human pilot with the walking of a bipedal robot. First, we introduce a method to generate a virtual human walking model from the stepping behavior of a human pilot which serves as a reference for the robot to walk. Second, the dynamics of the walking reference and robot walking are synchronized by applying forces to the human pilot and the robot to achieve dynamic similarity between the two systems. This enables the human pilot to continuously perceive and cancel any asynchrony between the walking reference and robot. A consistent step placement strategy for the robot is derived to maintain dynamic similarity through step transitions. Using our human-machine-interface, we demonstrate that the human pilot can achieve stable and synchronous teleoperation of a simulated robot through stepping-in-place, walking, and disturbance rejection experiments. This work provides a fundamental step towards transferring human intelligence and reflexes to humanoid robots.


title: Hyperplanes in abelian groups and twisted signatures

abstract: We investigate the following question: if $A$ and $A'$ are products of finite cyclic groups, when does there exist an isomorphism $f: A \to A'$ which preserves the union of coordinate hyperplanes (equivalently, so that $f(x)$ has some coordinate zero if and only if $x$ has some coordinate zero)? We show that if such an isomorphism exists, then $A$ and $A'$ have the same cyclic factors; if all cyclic factors have order larger than $2$, the map $f$ is diagonal up to permutation, hence sends coordinate hyperplanes to coordinate hyperplanes. Thus one can recover the coordinate hyperplanes from knowledge of their union. This result is well-adapted for application to invariants with a certain multiplicativity property. As a model application, we show using twisted signatures that there exists a family of compact 4-manifolds $X(n)$ with $H_1 X(n) = \mathbb Z/n$ with the property that $\prod X(n_i) \cong \prod X(n'_j)$ if and only if the factors may be identified (up to permutation), and that the induced map on first homology is (up to permutation) represented by a diagonal matrix.


title: Optically probing the asymmetric interlayer coupling in rhombohedral-stacked MoS2 bilayer

abstract: The interlayer coupling is emerging as a new parameter for tuning the physical properties of two-dimensional (2D) van der Waals materials. When two identical semiconductor monolayers are stacked with a twist angle, the periodic interlayer coupling modulation due to the moir\'e superlattice may endow exotic physical phenomena, such as moir\'e excitons and correlated electronic phases. To gain insight into these new phenomena, it is crucial to unveil the underlying coupling between atomic layers. Recently, the rhombohedral-stacked transition metal dichalcogenide (TMD) bilayer has attracted significant interest because of the emergence of an out-of-plane polarization from non-ferroelectric monolayer constituents. However, as a key parameter responsible for the physical properties, the interlayer coupling and its relationship with ferroelectricity in them remain elusive. Here we probe the asymmetric interlayer coupling between the conduction band of one layer and the valence band from the other layer in a 3R-MoS2 bilayer, which can be understood as a result of a layer-dependent Berry phase winding. By performing optical spectroscopy in a dual-gated device, we show a type-II band alignment exists at K points in the 3R-MoS2 bilayer. Furthermore, by unraveling various contributions to the band offset, we quantitatively determine the asymmetric interlayer coupling and spontaneous polarization in 3R-MoS2.


title: A novel illumination condition varied image dataset-Food Vision Dataset (FVD) for fair and reliable consumer acceptability predictions from food

abstract: Recent advances in artificial intelligence promote a wide range of computer vision applications in many different domains. Digital cameras, acting as human eyes, can perceive fundamental object properties, such as shapes and colors, and can be further used for conducting high-level tasks, such as image classification, and object detections. Human perceptions have been widely recognized as the ground truth for training and evaluating computer vision models. However, in some cases, humans can be deceived by what they have seen. Well-functioned human vision relies on stable external lighting while unnatural illumination would influence human perception of essential characteristics of goods. To evaluate the illumination effects on human and computer perceptions, the group presents a novel dataset, the Food Vision Dataset (FVD), to create an evaluation benchmark to quantify illumination effects, and to push forward developments of illumination estimation methods for fair and reliable consumer acceptability prediction from food appearances. FVD consists of 675 images captured under 3 different power and 5 different temperature settings every alternate day for five such days.


title: Stochastic strategies for patrolling a terrain with a synchronized multi-robot system

abstract: A group of cooperative aerial robots can be deployed to efficiently patrol a terrain, in which each robot flies around an assigned area and shares information with the neighbors periodically in order to protect or supervise it. To ensure robustness, previous works on these synchronized systems propose sending a robot to the neighboring area in case it detects a failure. In order to deal with unpredictability and to improve on the efficiency in the deterministic patrolling scheme, this paper proposes random strategies to cover the areas distributed among the agents. First, a theoretical study of the stochastic process is addressed in this paper for two metrics: the \emph{idle time}, the expected time between two consecutive observations of any point of the terrain and the \emph{isolation time}, the expected time that a robot is without communication with any other robot. After that, the random strategies are experimentally compared with the deterministic strategy adding another metric: the \emph{broadcast time}, the expected time elapsed from the moment a robot emits a message until it is received by all the other robots of the team. The simulations show that theoretical results are in good agreement with the simulations and the random strategies outperform the behavior obtained with the deterministic protocol proposed in the literature.


title: Long-time solvability for the 2D inviscid Boussinesq equations with borderline regularity and dispersive effects

abstract: We are concerned with the long-time solvability for 2D inviscid Boussinesq equations for a larger class of initial data which covers the case of borderline regularity. First we show the local solvability in Besov spaces uniformly with respect to a parameter $\kappa$ associated with the stratification of the fluid. Afterwards, employing a blow-up criterion and Strichartz-type estimates, the long-time solvability is obtained for large $\kappa$ regardless of the size of initial data.


title: Generative Visual Prompt: Unifying Distributional Control of Pre-Trained Generative Models

abstract: Generative models (e.g., GANs, diffusion models) learn the underlying data distribution in an unsupervised manner. However, many applications of interest require sampling from a particular region of the output space or sampling evenly over a range of characteristics. For efficient sampling in these scenarios, we propose Generative Visual Prompt (PromptGen), a framework for distributional control over pre-trained generative models by incorporating knowledge of other off-the-shelf models. PromptGen defines control as energy-based models (EBMs) and samples images in a feed-forward manner by approximating the EBM with invertible neural networks, avoiding optimization at inference. Our experiments demonstrate how PromptGen can efficiently sample from several unconditional generative models (e.g., StyleGAN2, StyleNeRF, diffusion autoencoder, NVAE) in a controlled or/and de-biased manner using various off-the-shelf models: (1) with the CLIP model as control, PromptGen can sample images guided by text, (2) with image classifiers as control, PromptGen can de-bias generative models across a set of attributes or attribute combinations, and (3) with inverse graphics models as control, PromptGen can sample images of the same identity in different poses. (4) Finally, PromptGen reveals that the CLIP model shows a "reporting bias" when used as control, and PromptGen can further de-bias this controlled distribution in an iterative manner. The code is available at https://github.com/ChenWu98/Generative-Visual-Prompt.


title: PointACL:Adversarial Contrastive Learning for Robust Point Clouds Representation under Adversarial Attack

abstract: Despite recent success of self-supervised based contrastive learning model for 3D point clouds representation, the adversarial robustness of such pre-trained models raised concerns. Adversarial contrastive learning (ACL) is considered an effective way to improve the robustness of pre-trained models. In contrastive learning, the projector is considered an effective component for removing unnecessary feature information during contrastive pretraining and most ACL works also use contrastive loss with projected feature representations to generate adversarial examples in pretraining, while "unprojected " feature representations are used in generating adversarial inputs during inference.Because of the distribution gap between projected and "unprojected" features, their models are constrained of obtaining robust feature representations for downstream tasks. We introduce a new method to generate high-quality 3D adversarial examples for adversarial training by utilizing virtual adversarial loss with "unprojected" feature representations in contrastive learning framework. We present our robust aware loss function to train self-supervised contrastive learning framework adversarially. Furthermore, we find selecting high difference points with the Difference of Normal (DoN) operator as additional input for adversarial self-supervised contrastive learning can significantly improve the adversarial robustness of the pre-trained model. We validate our method, PointACL on downstream tasks, including 3D classification and 3D segmentation with multiple datasets. It obtains comparable robust accuracy over state-of-the-art contrastive adversarial learning methods.


title: ViscoelasticNet: A physics informed neural network framework for stress discovery and model selection

abstract: Viscoelastic fluids are a class of fluids that exhibit both viscous and elastic nature. Modelling such fluids requires constitutive equations for the stress, and choosing the most appropriate constitutive relationship can be difficult. We present viscoelasticNet, a physics-informed deep learning framework that uses the velocity flow field to select the constitutive model and learn the stress field. Our framework requires data only for the velocity field, initial \& boundary conditions for the stress tensor, and the boundary condition for the pressure field. Using this information, we learn the model parameters, the pressure field, and the stress tensor. {This work considers} three commonly used non-linear viscoelastic models: Oldroyd-B, Giesekus, and linear Phan-Thien-Tanner (PTT). We demonstrate that our framework works well with noisy and sparse data. Our framework can be combined with velocity fields acquired from experimental techniques like particle image velocimetry to get the pressure \& stress fields and model parameters for the constitutive equation. Once the model has been discovered using viscoelasticNet, the fluid can be simulated and modeled for further applications.


title: On the geometry of two state models for the colored Jones polynomial

abstract: Using the flow property of the R-matrix defining the colored Jones polynomial, we establish a natural bijection between the set of states on the part arc-graph of a link projection and the set of states on a corresponding bichromatic digraph, called arc-graph, as defined by Garoufalidis and Loebl. We use this to give a new and essentially elementary proof for a knot state-sum formula of Garoufalidis and Loebl. We will show that the state-sum contributions of states on the part arc-graph defined by the universal R-matrix of $U_q(sl(2,\mathbb{C}))$ correspond, under our bijection of sets of states, to the contributions in the formula of Garoufalidis and Loebl. This will show that the two state models are in fact not essentially distinct. Our approach will also extend the formula of Garoufalidis and Loebl to links. This requires some additional non-trivial observations concerning the geometry of states on part arc-graphs. We will discuss in detail the computation of the arc-graph state-sum, in particular for 3-braid closures.


title: AB/Push-Pull Method for Distributed Optimization in Time-Varying Directed Networks

abstract: In this paper, we study the distributed optimization problem for a system of agents embedded in time-varying directed communication networks. Each agent has its own cost function and agents cooperate to determine the global decision that minimizes the summation of all individual cost functions. We consider the so-called push-pull gradient-based algorithm (termed as AB/Push-Pull) which employs both row- and column-stochastic weights simultaneously to track the optimal decision and the gradient of the global cost while ensuring consensus and optimality. We show that the algorithm converges linearly to the optimal solution over a time-varying directed network for a constant stepsize when the agent's cost function is smooth and strongly convex. The linear convergence of the method has been shown in Saadatniaki et al. (2020), where the multi-step consensus contraction parameters for row- and column-stochastic mixing matrices are not directly related to the underlying graph structure, and the explicit range for the stepsize value is not provided. With respect to Saadatniaki et al. (2020), the novelty of this work is twofold: (1) we establish the one-step consensus contraction for both row- and column-stochastic mixing matrices with the contraction parameters given explicitly in terms of the graph diameter and other graph properties; and (2) we provide explicit upper bounds for the stepsize value in terms of the properties of the cost functions, the mixing matrices, and the graph connectivity structure.


title: Wasserstein $K$-means for clustering probability distributions

abstract: Clustering is an important exploratory data analysis technique to group objects based on their similarity. The widely used $K$-means clustering method relies on some notion of distance to partition data into a fewer number of groups. In the Euclidean space, centroid-based and distance-based formulations of the $K$-means are equivalent. In modern machine learning applications, data often arise as probability distributions and a natural generalization to handle measure-valued data is to use the optimal transport metric. Due to non-negative Alexandrov curvature of the Wasserstein space, barycenters suffer from regularity and non-robustness issues. The peculiar behaviors of Wasserstein barycenters may make the centroid-based formulation fail to represent the within-cluster data points, while the more direct distance-based $K$-means approach and its semidefinite program (SDP) relaxation are capable of recovering the true cluster labels. In the special case of clustering Gaussian distributions, we show that the SDP relaxed Wasserstein $K$-means can achieve exact recovery given the clusters are well-separated under the $2$-Wasserstein metric. Our simulation and real data examples also demonstrate that distance-based $K$-means can achieve better classification performance over the standard centroid-based $K$-means for clustering probability distributions and images.


title: Nonlocal Superposed Solutions II: Coupled Nonlinear Equations

abstract: We obtain novel periodic as well as hyperbolic solutions of an Ablowitz-Musslimani variant of the coupled nonlocal, nonlinear Schr\"odinger equation (NLS) as well as a coupled nonlocal modified Korteweg-de Vries (mKdV) equation which can be re-expressed as a linear superposition of the sum or the difference of two hyperbolic or two periodic kink or pulse solutions. Besides, we also discuss some of the other solutions admitted by these coupled equations. These results demonstrate that the notion of the superposed solutions extends to the coupled nonlocal nonlinear equations as well.


title: SQL and NoSQL Databases Software architectures performance analysis and assessments -- A Systematic Literature review

abstract: Context: The efficient processing of Big Data is a challenging task for SQL and NoSQL Databases, where competent software architecture plays a vital role. The SQL Databases are designed for structuring data and supporting vertical scalability. In contrast, horizontal scalability is backed by NoSQL Databases and can process sizeable unstructured Data efficiently. One can choose the right paradigm according to the organisation's needs; however, making the correct choice can often be challenging. The SQL and NoSQL Databases follow different architectures. Also, the mixed model is followed by each category of NoSQL Databases. Hence, data movement becomes difficult for cloud consumers across multiple cloud service providers (CSPs). In addition, each cloud platform IaaS, PaaS, SaaS, and DBaaS also monitors various paradigms. Objective: This systematic literature review (SLR) aims to study the related articles associated with SQL and NoSQL Database software architectures and tackle data portability and Interoperability among various cloud platforms. State of the art presented many performance comparison studies of SQL and NoSQL Databases by observing scaling, performance, availability, consistency and sharding characteristics. According to the research studies, NoSQL Database designed structures can be the right choice for big data analytics, while SQL Databases are suitable for OLTP Databases. The researcher proposes numerous approaches associated with data movement in the cloud. Platform-based APIs are developed, which makes users' data movement difficult. Therefore, data portability and Interoperability issues are noticed during data movement across multiple CSPs. To minimize developer efforts and Interoperability, Unified APIs are demanded to make data movement relatively more accessible among various cloud platforms.


title: Spin it as you like: the (lack of a) measurement of the spin tilt distribution with LIGO-Virgo-KAGRA binary black holes

abstract: While much has been learned about black holes by analyzing the latest LVK catalog, GWTC-3, a measurement of the astrophysical distribution of the black hole spin orientations remains elusive. This is usually probed by measuring the cosine of the tilt angle ($\cos\tau$) between each black hole spin and the orbital angular momentum, $\cos\tau=+1$ being perfect alignment. Abbott et al. has modeled the $\cos\tau$ distribution as a mixture of an isotropic component and a Gaussian component with mean fixed at +1 and width measured from the data. We want to verify if the data require the existence of such a peak at $\cos\tau=+1$. We use various alternative models for the astrophysical tilt distribution and measure their parameters using the LVK GWTC-3 catalog. We find that a) Augmenting the LVK model such that the mean $\mu$ of the Gaussian is not fixed at +1 returns results that strongly depend on priors. If we allow $\mu>+1$ then the resulting astrophysical $\cos\tau$ distribution peaks at +1 and looks linear, rather than Gaussian. If we constrain $-1\leq \mu\leq+1$ the Gaussian component peaks at $\mu=0.48^{+0.46}_{-0.99}$ (median and 90% symmetric credible interval). Two other 2-component mixture models yield $\cos\tau$ distributions that either have a broad peak centered at $0.19^{+0.22}_{-0.18}$ or a plateau that spans the range [-0.5, +1], without a clear peak at +1. b) All of the models we considered agree on the fact that there is no excess of black hole tilts at around -1. c) While yielding quite different posteriors, the models considered in this work have Bayesian evidences that are the same within error bars. We conclude that the current dataset is not sufficiently informative to draw any model-independent conclusions on the astrophysical distribution of spin tilts, except that there is no excess of spins with negatively aligned tilts.


title: Efficient Quantized Sparse Matrix Operations on Tensor Cores

abstract: The exponentially growing model size drives the continued success of deep learning, but it brings prohibitive computation and memory cost. From the algorithm perspective, model sparsification and quantization have been studied to alleviate the problem. From the architecture perspective, hardware vendors provide Tensor cores for acceleration. However, it is very challenging to gain practical speedups from sparse, low-precision matrix operations on Tensor cores, because of the strict requirements for data layout and lack of support for efficiently manipulating the low-precision integers. We propose Magicube, a high-performance sparse-matrix library for low-precision integers on Tensor cores. Magicube supports SpMM and SDDMM, two major sparse operations in deep learning with mixed precision. Experimental results on an NVIDIA A100 GPU show that Magicube achieves on average 1.44x (up to 2.37x) speedup over the vendor-optimized library for sparse kernels, and 1.43x speedup over the state-of-the-art with a comparable accuracy for end-to-end sparse Transformer inference.


title: A geometric model for mod $p$ bordism

abstract: In this note I give a positive solution to Bullett's conjecture (posed in [1]) regarding a geometric presentation of the universal mod $p$ oriented ring spectrum.


title: Sharp Fourier extension on fractional surfaces

abstract: For $\alpha\geq 2$, we investigate a class of Fourier extension operators on fractional surfaces $(\xi,|\xi|^\alpha)$. For the corresponding $\alpha$-Strichartz inequalities, by applying the missing mass method and bilinear restriction theory, we characterize the precompactness of extremal sequences. Our result is valid in any dimension. In particular for dimension two, our result implies the existence of extremals for $\alpha \in [2,\alpha_0)$ with some $\alpha_0>5$.


title: On the stability of relativistic perfect fluids with linear equations of state $p=K\rho$ where $1/3<K<1$

abstract: For $1/3<K<1$, we consider the stability of two distinct families of spatially homogeneous solutions to the relativistic Euler equations with a linear equation of state $p=K\rho$ on exponentially expanding FLRW spacetimes. The two families are distinguished by one being spatially isotropic while the other is not. We establish the future stability of nonlinear perturbations of the non-isotropic family for the full range of parameter values $1/3<K<1$, which improves a previous stability result established by the second author that required $K$ to lie in the restricted range $(1/3,1/2)$. As a first step towards understanding the behaviour of nonlinear perturbations of the isotropic family, we construct numerical solutions to the relativistic Euler equations under a $\mathbb{T}^2$-symmetry assumption. These solutions are generated from initial data at a fixed time that is chosen to be suitably close to the initial data of an isotropic solution. Our numerical results reveal that, for the full parameter range $1/3<K<1$, the density contrast $\frac{\partial_{x}\rho}{\rho}$ associated to a nonlinear perturbation of an isotropic solution develops steep gradients near a finite number of spatial points where it becomes unbounded at future timelike infinity. This behaviour, anticipated by Rendall in \cite{Rendall:2004}, is of particular interest since it is not consistent with the standard picture for inflation in cosmology.


title: Double Doubly Robust Thompson Sampling for Generalized Linear Contextual Bandits

abstract: We propose a novel contextual bandit algorithm for generalized linear rewards with an $\tilde{O}(\sqrt{\kappa^{-1} \phi T})$ regret over $T$ rounds where $\phi$ is the minimum eigenvalue of the covariance of contexts and $\kappa$ is a lower bound of the variance of rewards. In several practical cases where $\phi=O(d)$, our result is the first regret bound for generalized linear model (GLM) bandits with the order $\sqrt{d}$ without relying on the approach of Auer [2002]. We achieve this bound using a novel estimator called double doubly-robust (DDR) estimator, a subclass of doubly-robust (DR) estimator but with a tighter error bound. The approach of Auer [2002] achieves independence by discarding the observed rewards, whereas our algorithm achieves independence considering all contexts using our DDR estimator. We also provide an $O(\kappa^{-1} \phi \log (NT) \log T)$ regret bound for $N$ arms under a probabilistic margin condition. Regret bounds under the margin condition are given by Bastani and Bayati [2020] and Bastani et al. [2021] under the setting that contexts are common to all arms but coefficients are arm-specific. When contexts are different for all arms but coefficients are common, ours is the first regret bound under the margin condition for linear models or GLMs. We conduct empirical studies using synthetic data and real examples, demonstrating the effectiveness of our algorithm.


title: Frameworks for Estimating Causal Effects in Observational Settings: Comparing Confounder Adjustment and Instrumental Variables

abstract: To estimate causal effects, analysts performing observational studies in health settings utilize several strategies to mitigate bias due to confounding by indication. There are two broad classes of approaches for these purposes: use of confounders and instrumental variables (IVs). Because such approaches are largely characterized by untestable assumptions, analysts must operate under an indefinite paradigm that these methods will work imperfectly. In this tutorial, we formalize a set of general principles and heuristics for estimating causal effects in the two approaches when the assumptions are potentially violated. This crucially requires reframing the process of observational studies as hypothesizing potential scenarios where the estimates from one approach are less inconsistent than the other. While most of our discussion of methodology centers around the linear setting, we touch upon complexities in non-linear settings and flexible procedures such as target minimum loss-based estimation (TMLE) and double machine learning (DML). To demonstrate the application of our principles, we investigate the use of donepezil off-label for mild cognitive impairment (MCI). We compare and contrast results from confounder and IV methods, traditional and flexible, within our analysis and to a similar observational study and clinical trial.


title: Clinical Utility Gains from Incorporating Comorbidity and Geographic Location Information into Risk Estimation Equations for Atherosclerotic Cardiovascular Disease

abstract: Objective: There are several efforts to re-learn the 2013 ACC/AHA pooled cohort equations (PCE) for patients with specific comorbidities and geographic locations. With over 363 customized risk models in the literature, we aim to evaluate such revised models to determine if the performance improvements translate to gains in clinical utility. Methods: We re-train a baseline PCE using the ACC/AHA PCE variables and revise it to incorporate subject-level geographic location and comorbidity information. We apply fixed effects, random effects, and extreme gradient boosting models to handle the correlation and heterogeneity induced by locations. Models are trained using 2,464,522 claims records from Optum Clinformatics Data Mart and validated in the hold-out set (N=1,056,224). We evaluate models' performance overall and across subgroups defined by the presence or absence of chronic kidney disease (CKD) or rheumatoid arthritis (RA) and geographic locations. We evaluate models' expected net benefit using decision curve analysis and models' statistical properties using several discrimination and calibration metrics. Results: The baseline PCE is miscalibrated overall, in patients with CKD or RA, and locations with small populations. Our revised models improved both the overall (GND P-value=0.41) and subgroup calibration but only enhanced net benefit in the underrepresented subgroups. The gains are larger in the subgroups with comorbidities and heterogeneous across geographic locations. Conclusions: Revising the PCE with comorbidity and location information significantly enhanced models' calibration; however, such improvements do not necessarily translate to clinical gains. Thus, we recommend future works to quantify the consequences from using risk calculators to guide clinical decisions.


title: Discrete and continuous dynamics of real $3$-dimensional nilpotent polynomial vector fields

abstract: A large class of real $3$-dimensional nilpotent polynomial vector fields of arbitrary degree is considered. The aim of this work is to present general properties of the discrete and continuous dynamical systems induced by these vector fields. In the discrete case, it is proved that each dynamical system has a unique fixed point and no $2$-cycles. Moreover, either the fixed point is a global attractor or there exists a $3$-cycle which is not a repeller. In the continuous setting, it is proved that each dynamical system is polynomially integrable. In addition, for a subclass of the considered vector fields, the system is polynomially completely integrable. Furthermore, for a family of low degree vector fields, it is provided a more precise description about the global dynamics of the trajectories of the induced dynamical system. In particular, it is proved the existence of an invariant surface foliated by periodic orbits. Finally, some remarks and open questions, motivated by our results, the Markus--Yamabe Conjecture and the problem of planar limit cycles, are given.


title: Non-Parallel Voice Conversion for ASR Augmentation

abstract: Automatic speech recognition (ASR) needs to be robust to speaker differences. Voice Conversion (VC) modifies speaker characteristics of input speech. This is an attractive feature for ASR data augmentation. In this paper, we demonstrate that voice conversion can be used as a data augmentation technique to improve ASR performance, even on LibriSpeech, which contains 2,456 speakers. For ASR augmentation, it is necessary that the VC model be robust to a wide range of input speech. This motivates the use of a non-autoregressive, non-parallel VC model, and the use of a pretrained ASR encoder within the VC model. This work suggests that despite including many speakers, speaker diversity may remain a limitation to ASR quality. Finally, interrogation of our VC performance has provided useful metrics for objective evaluation of VC quality.


title: Mixing times for two classes of stochastically modeled reaction networks

abstract: The past few decades have seen robust research on questions regarding the existence, form, and properties of stationary distributions of stochastically modeled reaction networks. When a stochastic model admits a stationary distribution an important practical question is: what is the rate of convergence of the distribution of the process to the stationary distribution? With the exception of \cite{XuHansenWiuf2022} pertaining to models whose state space is restricted to the non-negative integers, there has been a notable lack of results related to this rate of convergence in the reaction network literature. This paper begins the process of filling that hole in our understanding. In this paper, we characterize this rate of convergence, via the mixing times of the processes, for two classes of stochastically modeled reaction networks. Specifically, by applying a Foster-Lyapunov criteria we establish exponential ergodicity for two classes of reaction networks introduced in \cite{anderson2018some}. Moreover, we show that for one of the classes the convergence is uniform over the initial state.


title: Electronic transport in Weyl semimetals with a uniform concentration of torsional dislocations

abstract: In this article, we consider a theoretical model for a type I Weyl semimetal, under the presence of a diluted uniform concentration of torsional dislocations. By a mathematical analysis for partial wave scattering (phase-shift) for the T-matrix, we obtain the corresponding retarded and advanced Green's functions that include the effects of multiple scattering events with the ensemble of randomly distributed dislocations. Combining this analysis with the Kubo formalism, and including vertex corrections, we calculate the electronic conductivity as a function of temperature and concentration of dislocations. We further evaluate our analytical formulas to predict the electrical conductivity of several transition metal monopnictides, i.e. TaAs, TaP, NbAs and NbP.


title: Characterizations of composition operators on Bloch and Hardy type spaces

abstract: The main purpose of this paper is to investigate characterizations of composition operators on Bloch and Hardy type spaces. Initially, we use general doubling weights to study the composition operators from harmonic Bloch type spaces on the unit disc $\mathbb{D}$ to pluriharmonic Hardy spaces on the Euclidean unit ball $\mathbb{B}^n$. Furthermore, we develop some new methods to study the composition operators from harmonic Bloch type spaces on $\mathbb{D}$ to pluriharmonic Bloch type spaces on $\mathbb{D}$. Additionally, some application to new characterizations of the composition operators between pluriharmonic Lipschitz type spaces to be bounded or compact will be presented. The obtained results of this paper provide the improvements and extensions of the corresponding known results.


title: Edge-colorings avoiding patterns in a triangle

abstract: For positive integers $n$ and $r$, we consider $n$-vertex graphs with the maximum number of $r$-edge-colorings with no copy of a triangle where exactly two colors appear. We prove that, if $2 \leq r \leq 26$ and $n$ is sufficiently large, the maximum is attained by the bipartite Tur\'{a}n graph $T_2(n)$ on $n$ vertices. This is best possible, as $T_2(n)$ is not extremal for $r \geq 27$ colors and $n \geq 3$.


title: The combinatorics of $N_\infty$ operads for $C_{qp^n}$ and $D_{p^n}$

abstract: We provide a general recursive method for constructing transfer systems on finite lattices. Using this we calculate the number of homotopically distinct $N_\infty$ operads for dihedral groups $D_{p^n}$, $p > 2$ prime, and cyclic groups $C_{qp^n}$, $p \neq q$ prime. We then further display some of the beautiful combinatorics obtained by restricting to certain homotopically meaningful $N_\infty$ operads for these groups.


title: Learning from Future: A Novel Self-Training Framework for Semantic Segmentation

abstract: Self-training has shown great potential in semi-supervised learning. Its core idea is to use the model learned on labeled data to generate pseudo-labels for unlabeled samples, and in turn teach itself. To obtain valid supervision, active attempts typically employ a momentum teacher for pseudo-label prediction yet observe the confirmation bias issue, where the incorrect predictions may provide wrong supervision signals and get accumulated in the training process. The primary cause of such a drawback is that the prevailing self-training framework acts as guiding the current state with previous knowledge, because the teacher is updated with the past student only. To alleviate this problem, we propose a novel self-training strategy, which allows the model to learn from the future. Concretely, at each training step, we first virtually optimize the student (i.e., caching the gradients without applying them to the model weights), then update the teacher with the virtual future student, and finally ask the teacher to produce pseudo-labels for the current student as the guidance. In this way, we manage to improve the quality of pseudo-labels and thus boost the performance. We also develop two variants of our future-self-training (FST) framework through peeping at the future both deeply (FST-D) and widely (FST-W). Taking the tasks of unsupervised domain adaptive semantic segmentation and semi-supervised semantic segmentation as the instances, we experimentally demonstrate the effectiveness and superiority of our approach under a wide range of settings. Code will be made publicly available.


title: PriorLane: A Prior Knowledge Enhanced Lane Detection Approach Based on Transformer

abstract: Lane detection is one of the fundamental modules in self-driving. In this paper we employ a transformer-only method for lane detection, thus it could benefit from the blooming development of fully vision transformer and achieve the state-of-the-art (SOTA) performance on both CULane and TuSimple benchmarks, by fine-tuning the weight fully pre-trained on large datasets. More importantly, this paper proposes a novel and general framework called PriorLane, which is used to enhance the segmentation performance of the fully vision transformer by introducing the low-cost local prior knowledge. Specifically, PriorLane utilizes an encoder-only transformer to fuse the feature extracted by a pre-trained segmentation model with prior knowledge embeddings. Note that a Knowledge Embedding Alignment (KEA) module is adapted to enhance the fusion performance by aligning the knowledge embedding. Extensive experiments on our Zjlab dataset show that PriorLane outperforms SOTA lane detection methods by a 2.82% mIoU when prior knowledge is employed, and the code will be released at: https://github.com/vincentqqb/PriorLane.


title: Cold-Start Data Selection for Few-shot Language Model Fine-tuning: A Prompt-Based Uncertainty Propagation Approach

abstract: Large Language Models have demonstrated remarkable few-shot performance, but the performance can be sensitive to the selection of few-shot instances. We propose PATRON, a new method that uses prompt-based uncertainty estimation for data selection for pre-trained language model fine-tuning under cold-start scenarios, i.e., no initial labeled data are available. In PATRON, we design (1) a prompt-based uncertainty propagation approach to estimate the importance of data points and (2) a partition-then-rewrite (PTR) strategy to promote sample diversity when querying for annotations. Experiments on six text classification datasets show that PATRON outperforms the strongest cold-start data selection baselines by up to 6.9%. Besides, with 128 labels only, PATRON achieves 91.0% and 92.1% of the fully supervised performance based on vanilla fine-tuning and prompt-based learning respectively. Our implementation of PATRON is available at \url{https://github.com/yueyu1030/Patron}.


title: Field-free high-frequency exchange-spring spin-torque nano-oscillators

abstract: Spin-torque nano-oscillators (STNOs) are a type of nanoscale microwave auto-oscillators utilizing spin-torque to generate magnetodynamics with great promise for applications in microwaves, magnetic memory, and neuromorphic computing. Here, we report the first demonstration of exchange-spring STNOs, with an exchange-spring ([Co/Pd]-Co) reference layer and a perpendicular ([Co/Ni]) free layer. This magnetic configuration results in high-frequency (>10 GHz) microwave emission at a zero magnetic field and exchange-spring dynamics in the reference layer and the observation of magnetic droplet solitons in the free layer at different current polarities. Our demonstration of bipolar and field-free exchange-spring-based STNOs operating over a 20 GHz frequency range greatly extends the design freedom and functionality of the current STNO technology for energy-efficient high-frequency spintronic and neuromorphic applications.


title: M^4I: Multi-modal Models Membership Inference

abstract: With the development of machine learning techniques, the attention of research has been moved from single-modal learning to multi-modal learning, as real-world data exist in the form of different modalities. However, multi-modal models often carry more information than single-modal models and they are usually applied in sensitive scenarios, such as medical report generation or disease identification. Compared with the existing membership inference against machine learning classifiers, we focus on the problem that the input and output of the multi-modal models are in different modalities, such as image captioning. This work studies the privacy leakage of multi-modal models through the lens of membership inference attack, a process of determining whether a data record involves in the model training process or not. To achieve this, we propose Multi-modal Models Membership Inference (M^4I) with two attack methods to infer the membership status, named metric-based (MB) M^4I and feature-based (FB) M^4I, respectively. More specifically, MB M^4I adopts similarity metrics while attacking to infer target data membership. FB M^4I uses a pre-trained shadow multi-modal feature extractor to achieve the purpose of data inference attack by comparing the similarities from extracted input and output features. Extensive experimental results show that both attack methods can achieve strong performances. Respectively, 72.5% and 94.83% of attack success rates on average can be obtained under unrestricted scenarios. Moreover, we evaluate multiple defense mechanisms against our attacks. The source code of M^4I attacks is publicly available at https://github.com/MultimodalMI/Multimodal-membership-inference.git.


title: Stochastic Tree Ensembles for Estimating Heterogeneous Effects

abstract: Determining subgroups that respond especially well (or poorly) to specific interventions (medical or policy) requires new supervised learning methods tailored specifically for causal inference. Bayesian Causal Forest (BCF) is a recent method that has been documented to perform well on data generating processes with strong confounding of the sort that is plausible in many applications. This paper develops a novel algorithm for fitting the BCF model, which is more efficient than the previously available Gibbs sampler. The new algorithm can be used to initialize independent chains of the existing Gibbs sampler leading to better posterior exploration and coverage of the associated interval estimates in simulation studies. The new algorithm is compared to related approaches via simulation studies as well as an empirical analysis.


title: Data Science Approach to predict the winning Fantasy Cricket Team Dream 11 Fantasy Sports

abstract: The evolution of digital technology and the increasing popularity of sports inspired the innovators to take the experience of users with a proclivity towards sports to a whole new different level, by introducing Fantasy Sports Platforms FSPs. The application of Data Science and Analytics is Ubiquitous in the Modern World. Data Science and Analytics open doors to gain a deeper understanding and help in the decision making process. We firmly believed that we could adopt Data Science to predict the winning fantasy cricket team on the FSP, Dream 11. We built a predictive model that predicts the performance of players in a prospective game. We used a combination of Greedy and Knapsack Algorithms to prescribe the combination of 11 players to create a fantasy cricket team that has the most significant statistical odds of finishing as the strongest team thereby giving us a higher chance of winning the pot of bets on the Dream 11 FSP. We used PyCaret Python Library to help us understand and adopt the best Regressor Algorithm for our problem statement to make precise predictions. Further, we used Plotly Python Library to give us visual insights into the team, and players performances by accounting for the statistical, and subjective factors of a prospective game. The interactive plots help us to bolster the recommendations of our predictive model. You either win big, win small, or lose your bet based on the performance of the players selected for your fantasy team in the prospective game, and our model increases the probability of you winning big.


title: VIPHY: Probing "Visible" Physical Commonsense Knowledge

abstract: In recent years, vision-language models (VLMs) have shown remarkable performance on visual reasoning tasks (e.g. attributes, location). While such tasks measure the requisite knowledge to ground and reason over a given visual instance, they do not, however, measure the ability of VLMs to retain and generalize such knowledge. In this work, we evaluate their ability to acquire "visible" physical knowledge -- the information that is easily accessible from images of static scenes, particularly across the dimensions of object color, size and space. We build an automatic pipeline to derive a comprehensive knowledge resource for calibrating and probing these models. Our results indicate a severe gap between model and human performance across all three tasks. Furthermore, our caption pretrained baseline (CapBERT) significantly outperforms VLMs on both size and spatial tasks -- highlighting that despite sufficient access to ground language with visual modality, they struggle to retain such knowledge. The dataset and code are available at https://github.com/Axe--/ViPhy .


title: Pose Attention-Guided Profile-to-Frontal Face Recognition

abstract: In recent years, face recognition systems have achieved exceptional success due to promising advances in deep learning architectures. However, they still fail to achieve expected accuracy when matching profile images against a gallery of frontal images. Current approaches either perform pose normalization (i.e., frontalization) or disentangle pose information for face recognition. We instead propose a new approach to utilize pose as an auxiliary information via an attention mechanism. In this paper, we hypothesize that pose attended information using an attention mechanism can guide contextual and distinctive feature extraction from profile faces, which further benefits a better representation learning in an embedded domain. To achieve this, first, we design a unified coupled profile-to-frontal face recognition network. It learns the mapping from faces to a compact embedding subspace via a class-specific contrastive loss. Second, we develop a novel pose attention block (PAB) to specially guide the pose-agnostic feature extraction from profile faces. To be more specific, PAB is designed to explicitly help the network to focus on important features along both channel and spatial dimension while learning discriminative yet pose invariant features in an embedding subspace. To validate the effectiveness of our proposed method, we conduct experiments on both controlled and in the wild benchmarks including Multi-PIE, CFP, IJBC, and show superiority over the state of the arts.


title: A 31.3 day Transient Quasiperiodic Oscillation in Gamma-ray Emission from Blazar S5 0716+714

abstract: We systematically search for quasiperiodic oscillatory (QPO) signals on the month timescale among the 1525 sources given in the Fermi Large Area Telescope Light Curve Repository. We find a transient QPO of 31.3$\pm$1.8 days in the gamma-ray band light curve of the TeV blazar S5 0716+714, which has seven cycles (MJD 55918-56137) for the first time by weighted wavelet Z-transform and Lomb-Scargle periodogram methods. Monte Carlo simulations based on the power spectral density and probability distribution function were used to evaluate the confidence level of the QPO, and the result is $\sim 4.1\sigma$. Seasonal autoregressive integrated moving average modeling of the light curve revealed it is a significant physical QPO. The physical models to explain the sporadic QPO of the month-timescale QPOs in blazar were discussed. Our studies indicate that the helical jet model and blob move helically in a curved jet model to properly explain this kind of transient QPO.


title: Vision-aided UAV navigation and dynamic obstacle avoidance using gradient-based B-spline trajectory optimization

abstract: Navigating dynamic environments requires the robot to generate collision-free trajectories and actively avoid moving obstacles. Most previous works designed path planning algorithms based on one single map representation, such as the geometric, occupancy, or ESDF map. Although they have shown success in static environments, due to the limitation of map representation, those methods cannot reliably handle static and dynamic obstacles simultaneously. To address the problem, this paper proposes a gradient-based B-spline trajectory optimization algorithm utilizing the robot's onboard vision. The depth vision enables the robot to track and represent dynamic objects geometrically based on the voxel map. The proposed optimization first adopts the circle-based guide-point algorithm to approximate the costs and gradients for avoiding static obstacles. Then, with the vision-detected moving objects, our receding-horizon distance field is simultaneously used to prevent dynamic collisions. Finally, the iterative re-guide strategy is applied to generate the collision-free trajectory. The simulation and physical experiments prove that our method can run in real-time to navigate dynamic environments safely. Our software is available on GitHub as an open-source package.


title: Emergence of polarization in a sigmoidal bounded-confidence model of opinion dynamics

abstract: We study a nonlinear bounded-confidence model (BCM) of continuous-time opinion dynamics on networks with both persuadable individuals and zealots. The model is parameterized by a scalar $\gamma$, which controls the steepness of a smooth influence function. This influence function encodes the relative weights that nodes place on the opinions of other nodes. When $\gamma = 0$, this influence function recovers Taylor's averaging model; when $\gamma \rightarrow \infty$, the influence function converges to that of a modified Hegselmann--Krause (HK) BCM. Unlike the classical HK model, however, our sigmoidal bounded-confidence model (SBCM) is smooth for any finite $\gamma$. We show that the set of steady states of our SBCM is qualitatively similar to that of the Taylor model when $\gamma$ is small and that the set of steady states approaches a subset of the set of steady states of a modified HK model as $\gamma \rightarrow \infty$. For several special graph topologies, we give analytical descriptions of important features of the space of steady states. A notable result is a closed-form relationship between the stability of a polarized state and the graph topology in a simple model of echo chambers in social networks. Because the influence function of our BCM is smooth, we are able to study it with linear stability analysis, which is difficult to employ with the usual discontinuous influence functions in BCMs.