title: Distributed and Localized Model Predictive Control. Part II: Theoretical Guarantees

abstract: Engineered cyberphysical systems are growing increasingly large and complex. These systems require scalable controllers that robustly satisfy state and input constraints in the presence of additive noise -- such controllers should also be accompanied by theoretical guarantees on feasibility and stability. In our companion paper, we introduced Distributed and Localized Model Predictive Control (DLMPC) for large-scale linear systems; DLMPC is a scalable closed-loop MPC scheme in which subsystems need only exchange local information in order to synthesize and implement local controllers. In this paper, we provide recursive feasibility and asymptotic stability guarantees for DLMPC. We leverage the System Level Synthesis framework to express the maximal positive robust invariant set for the closed-loop system and its corresponding Lyapunov function, both in terms of the closed-loop system responses. We use the invariant set as the terminal set for DLMPC, and show that this guarantees feasibility with minimal conservatism. We use the Lyapunov function as the terminal cost, and show that this guarantees stability. We provide fully distributed and localized algorithms to compute the terminal set offline, and also provide necessary additions to the online DLMPC algorithm to accommodate coupled terminal constraint and cost. In all algorithms, only local information exchanges are necessary, and computational complexity is independent of the global system size -- we demonstrate this analytically and experimentally. This is the first distributed MPC approach that provides minimally conservative yet fully distributed guarantees for recursive feasibility and asymptotic stability, for both nominal and robust settings.


title: Enhanced Nearest Neighbor Classification for Crowdsourcing

abstract: In machine learning, crowdsourcing is an economical way to label a large amount of data. However, the noise in the produced labels may deteriorate the accuracy of any classification method applied to the labelled data. We propose an enhanced nearest neighbor classifier (ENN) to overcome this issue. Two algorithms are developed to estimate the worker quality (which is often unknown in practice): one is to construct the estimate based on the denoised worker labels by applying the $k$NN classifier to the expert data; the other is an iterative algorithm that works even without access to the expert data. Other than strong numerical evidence, our proposed methods are proven to achieve the same regret as its oracle version based on high-quality expert data. As a technical by-product, a lower bound on the sample size assigned to each worker to reach the optimal convergence rate of regret is derived.


title: Connecting Gaits in Energetically Conservative Legged Systems

abstract: In this work, we present a nonlinear dynamics perspective on generating and connecting gaits for energetically conservative models of legged systems. In particular, we show that the set of conservative gaits constitutes a connected space of locally defined 1D submanifolds in the gait space. These manifolds are coordinate-free parameterized by energy level. We present algorithms for identifying such families of gaits through the use of numerical continuation methods, generating sets and bifurcation points. To this end, we also introduce several details for the numerical implementation. Most importantly, we establish the necessary condition for the Delassus' matrix to preserve energy across impacts. An important application of our work is with simple models of legged locomotion that are often able to capture the complexity of legged locomotion with just a few degrees of freedom and a small number of physical parameters. We demonstrate the efficacy of our framework on a one-legged hopper with four degrees of freedom.


title: Synthesizing Fine-Grained Synchronization Protocols for Implicit Monitors (Extended Version)

abstract: A monitor is a widely-used concurrent programming abstraction that encapsulates all shared state between threads. Monitors can be classified as being either implicit or explicit depending on the primitives they provide. Implicit monitors are much easier to program but typically not as efficient. To address this gap, there has been recent research on automatically synthesizing explicit-signal monitors from an implicit specification, but prior work does not exploit all paralellization opportunities due to the use of a single lock for the entire monitor. This paper presents a new technique for synthesizing fine-grained explicit-synchronization protocols from implicit monitors. Our method is based on two key innovations: First, we present a new static analysis for inferring safe interleavings that allow violating mutual exclusion of monitor operations without changing its semantics. Second, we use the results of this static analysis to generate a MaxSAT instance whose models correspond to correct-by-construction synchronization protocols. We have implemented our approach in a tool called Cortado and evaluate it on monitors that contain parallelization opportunities. Our evaluation shows that Cortado can synthesize synchronization policies that are competitive with, or even better than, expert-written ones on these benchmarks.


title: Bayesian adaptive and interpretable functional regression for exposure profiles

abstract: Pollutant exposure during gestation is a known and adverse factor for birth and health outcomes. However, the links between prenatal air pollution exposures and educational outcomes are less clear, in particular the critical windows of susceptibility during pregnancy. Using a large cohort of students in North Carolina, we study the link between prenatal daily $\mbox{PM}_{2.5}$ exposure and 4th end-of-grade reading scores. We develop and apply a locally adaptive and highly scalable Bayesian regression model for scalar responses with functional and scalar predictors. The proposed model pairs a B-spline basis expansion with dynamic shrinkage priors to capture both smooth and rapidly-changing features in the regression surface. The model is accompanied by a new decision analysis approach for functional regression that extracts the critical windows of susceptibility and guides the model interpretations. These tools help to identify and address broad limitations with the interpretability of functional regression models. Simulation studies demonstrate more accurate point estimation, more precise uncertainty quantification, and far superior window selection than existing approaches. Leveraging the proposed modeling, computational, and decision analysis framework, we conclude that prenatal $\mbox{PM}_{2.5}$ exposure during early and late pregnancy is most adverse for 4th end-of-grade reading scores.


title: Back to Boundaries in Billiards

abstract: We prove Poisson limit laws for open billiards where the holes are on the boundaries of billiard tables (rather than some abstract holes in the phase space of a billiard). Such holes are of the main interest for billiard systems, especially for applications. Sinai billiards with or without a finite horizon, diamond billiards, and semi-dispersing billiards, as well as focusing billiards with slow decay of correlations, are considered.


title: VVVX near-IR photometry for 99 low-mass stars in the Gaia EDR3 Catalog of Nearby Stars

abstract: Red dwarf stars, which represent 75% of stars in the Milky Way, can be studied in great detail in the solar neighborhood where the sample is more complete. We intend to better characterize red dwarf candidates selected from the Gaia Catalog of Nearby Stars using optical and near-infrared photometry from the VVVX Survey, DECaPS, Pan-STARRS, and WISE. We performed a cross-matching procedure among the positions of a color-selected sample of M dwarfs in the VVVX Survey and the Gaia EDR3 sub-catalog of nearby stars. We explored their stellar parameters and spectral types using VOSA. Radii were also obtained using the Stefan-Boltzmann equation. Masses and ages were computed for some of the objects using evolutionary tracks and isochrones. Additional mass estimations were obtained with the MKs - M* relation. We then validated our results for the stellar parameters of two of our objects with spectra obtained with the TripleSpec instrument at the SOAR telescope, as well as those of our total amount of stars through a direct comparison with an independent sample from the literature. We revised the objects in our sample and compared their proper motion vectors with other sources within 30" to identify possible companions and probed their RUWE values to identify unresolved companions. We present a catalog of physical parameters for 99 low-mass objects with distances from 43.2 to 111.3 pc. Teffs range from 2500 to 3400 K, with the majority of stars in the sample compatible with being M4 dwarfs. We obtained a good agreement between the stellar parameters computed with VOSA and the estimations from observed spectra, also when comparing with an independent sample from the literature. The distribution of masses obtained with VOSA is concentrated toward the very low-mass regime. Eight objects present values of RUWE >= 1.4 and seven are consistent with being part of a binary system.


title: Image analysis for automatic measurement of crustose lichens

abstract: Lichens, organisms resulting from a symbiosis between a fungus and an algae, are frequently used as age estimators, especially in recent geological deposits and archaeological structures, using the correlation between lichen size and age. Current non-automated manual lichen and measurement (with ruler, calipers or using digital image processing tools) is a time-consuming and laborious process, especially when the number of samples is high. This work presents a workflow and set of image acquisition and processing tools developed to efficiently identify lichen thalli in flat rocky surfaces, and to produce relevant lichen size statistics (percentage cover, number of thalli, their area and perimeter). The developed workflow uses a regular digital camera for image capture along with specially designed targets to allow for automatic image correction and scale assignment. After this step, lichen identification is done in a flow comprising assisted image segmentation and classification based on interactive foreground extraction tool (GrabCut) and automatic classification of images using Simple Linear Iterative Clustering (SLIC) for image segmentation and Support Vector Machines (SV) and Random Forest classifiers. Initial evaluation shows promising results. The manual classification of images (for training) using GrabCut show an average speedup of 4 if compared with currently used techniques and presents an average precision of 95\%. The automatic classification using SLIC and SVM with default parameters produces results with average precision higher than 70\%. The developed system is flexible and allows a considerable reduction of processing time, the workflow allows it applicability to data sets of new lichen populations.


title: Error estimates for a vorticity-based velocity-stress formulation of the Stokes eigenvalue problem

abstract: The aim of this paper is to analyze a mixed formulation for the two dimensional Stokes eigenvalue problem where the unknowns are the stress and the velocity, whereas the pressure can be recovered with a simple postprocess of the stress. The stress tensor is written in terms of the vorticity of the fluid, leading to an alternative mixed formulation that incorporates this physical feature. We propose a mixed numerical method where the stress is approximated with suitable N\'edelec finite elements, whereas the velocity is approximated with piecewise polynomials of degree $k\geq 0$. With the aid of the compact operators theory we derive convergence of the method and spectral correctness. Moreover, we propose a reliable and efficient a posteriori error estimator for our spectral problem. We report numerical tests in different domains, computing the spectrum and convergence orders, together with a computational analysis for the proposed estimator. In addition, we use the corresponding error estimator to drive an adaptive scheme, and we report the results of a numerical test, that allow us to assess the performance of this approach.


title: Unified Physical Threat Monitoring System Aided by Virtual Building Simulation

abstract: With increasing physical threats in recent years targeted at critical infrastructures, it is crucial to establish a reliable threat monitoring system integrating video surveillance and digital sensors based on cutting-edge technologies. A physical threat monitoring solution unifying the floorplan, cameras, and sensors for smart buildings has been set up in our study. Computer vision and deep learning models are used for video streams analysis. When a threat is detected by a rule engine based on the real-time analysis results combining with feedback from related digital sensors, an alert is sent to the Video Management System so that human operators can take further action. A physical threat monitoring system typically needs to address complex and even destructive incidents, such as fire, which is unrealistic to simulate in real life. Restrictions imposed during the Covid-19 pandemic and privacy concerns have added to the challenges. Our study utilises the Unreal Engine to simulate some typical suspicious and intrusion scenes with photorealistic qualities in the context of a virtual building. Add-on programs are implemented to transfer the video stream from virtual PTZ cameras to the Milestone Video Management System and enable users to control those cameras from the graphic client application. Virtual sensors such as fire alarms, temperature sensors and door access controls are implemented similarly, fulfilling the same programmatic VMS interface as real-life sensors. Thanks to this simulation system's extensibility and repeatability, we have consolidated this unified physical threat monitoring system and verified its effectiveness and user-friendliness. Both the simulated Unreal scenes and the software add-ons developed during this study are highly modulated and thereby are ready for reuse in future projects in this area.


title: Presymplectic integrators for optimal control problems via retraction maps

abstract: Retractions maps are used to define a discretization of the tangent bundle of the configuration manifold as two copies of the configuration manifold where the dynamics take place. Such discretization maps can be conveniently lifted to the cotangent bundle so that symplectic integrators are constructed for Hamilton's equations. Optimal control problems are provided with a Hamiltonian framework by Pontryagin's Maximum Principle. That is why we use discretization maps and the integrability algorithm to obtain presymplectic integrators for optimal control problems.


title: Privacy of Fitness Applications and Consent Management in Blockchain

abstract: The rapid advances in fitness wearable devices are redefining privacy around interactions. Fitness wearables devices record a considerable amount of sensitive and private details about exercise, blood oxygen level, and heart rate. Privacy concerns have emerged about the interactions between an individual's raw fitness data and data analysis by the providers of fitness apps and wearable devices. This paper describes the importance of adopting and applying legal frameworks within the fitness tracker ecosystem. In this review, we describe the studies on the current privacy policies of fitness app providers, heuristically evaluate the methods for consent management by fitness providers, summarize the gaps identified in our review of these studies, and discuss potential solutions for filling the gaps identified. We have identified four main problems related to preserving the privacy of users of fitness apps: lack of system transparency, lack of privacy policy legibility, concerns regarding one-time consent, and issues of noncompliance regarding consent management. After discussing feasible solutions, we conclude by describing how blockchain is suitable for solving these privacy issues.


title: Equivalent definitions of the preprojective algebra

abstract: Following the article of C. M. Ringel we introduce preprojective algebras of a Dynkin quiver $Q$ starting from three definitions which, despite concerning completely different algebraic structures, turn out to be equivalent. Our main result is a new version of Ringel's proofs that applies a theorem by Happel and exploits the techniques of homological algebra. Moreover we show that the definition of the preprojective algebra given with the usual notion of commutator is equivalent to the definition with the "generalised" commutator.


title: Two-Level Supervised Contrastive Learning for Response Selection in Multi-Turn Dialogue

abstract: Selecting an appropriate response from many candidates given the utterances in a multi-turn dialogue is the key problem for a retrieval-based dialogue system. Existing work formalizes the task as matching between the utterances and a candidate and uses the cross-entropy loss in learning of the model. This paper applies contrastive learning to the problem by using the supervised contrastive loss. In this way, the learned representations of positive examples and representations of negative examples can be more distantly separated in the embedding space, and the performance of matching can be enhanced. We further develop a new method for supervised contrastive learning, referred to as two-level supervised contrastive learning, and employ the method in response selection in multi-turn dialogue. Our method exploits two techniques: sentence token shuffling (STS) and sentence re-ordering (SR) for supervised contrastive learning. Experimental results on three benchmark datasets demonstrate that the proposed method significantly outperforms the contrastive learning baseline and the state-of-the-art methods for the task.


title: Comparison of the canonical transformation and energy functional formalisms for ab initio calculations of self-localized polarons

abstract: In materials with strong electron-phonon (e-ph) interactions, charge carriers can distort the surrounding lattice and become trapped, forming self-localized (small) polarons. We recently developed an ab initio approach based on canonical transformations to efficiently compute the formation and energetics of small polarons[1]. A different approach based on a Landau-Pekar energy functional has been proposed in the recent literature [2,3]. In this work, we analyze and compare these two methods in detail. We show that the small polaron energy is identical in the two formalisms when using the same polaron wave function. We also show that our canonical transformation formalism can predict polaron band structures and can properly treat zero- and finite-temperature lattice vibration effects, although at present using a fixed polaron wave function. Conversely, the energy functional approach can compute the polaron wave function, but as we show here it neglects lattice vibrations and cannot address polaron self-localization and thermal band narrowing. Taken together, this work relates two different methods developed recently to study polarons from first-principles, highlighting their merits and shortcomings and discussing them both in a unified formalism.


title: Amplitude Control for Parallel Lattices of Docked Modboats

abstract: The Modboat is a low-cost, underactuated, modular robot capable of surface swimming. It is able to swim individually, dock to other Modboats, and undock from them using only a single motor and two passive flippers. Undocking without additional actuation is achieved by causing intentional self-collision between the tails of neighboring modules; this becomes a challenge when group swimming as one connected component is desirable. In this work, we develop a control strategy to allow parallel lattices of Modboats to swim as a single unit, which conventionally requires holonomic modules. We show that the control strategy is guaranteed to avoid unintentional undocking and minimizes internal forces within the lattice. Experimental verification shows that the controller performs well and is consistent for lattices of various sizes. Controllability is maintained while swimming, but pure yaw control causes lateral movement that cannot be counteracted by the presented framework.


title: Flow-Based Control of Marine Robots in Gyre-Like Environments

abstract: We present a flow-based control strategy that enables resource-constrained marine robots to patrol gyre-like flow environments on an orbital trajectory with a periodicity in a given range. The controller does not require a detailed model of the flow field and relies only on the robot's location relative to the center of the gyre. Instead of precisely tracking a pre-defined trajectory, the robots are tasked to stay in between two bounding trajectories with known periodicity. Furthermore, the proposed strategy leverages the surrounding flow field to minimize control effort. We prove that the proposed strategy enables robots to cycle in the flow satisfying the desired periodicity requirements. Our method is tested and validated both in simulation and in experiments using a low-cost, underactuated, surface swimming robot, i.e. the Modboat.


title: Proximity Induced Chiral Quantum Light Generation in Strain-Engineered WSe2/NiPS3 Heterostructures

abstract: Quantum light emitters (QEs) capable of generating single photons of well-defined circular polarization could enable non-reciprocal single photon devices and deterministic spin-photon interfaces critical for realizing complex quantum networks. To date, emission of such chiral quantum light has been achieved via the application of intense external magnetic field electrical/optical injection of spin polarized carriers/excitons, or coupling with complex photonic/meta-structures. Here we report free-space generation of highly chiral single photons from QEs created in monolayer WSe2 - NiPS3 heterostructures at zero external magnetic field. These QEs emit in the 760-800 nm range with a degree of circular polarization and single photon purity as high as 0.71 and 80% respectively, independent of pump laser polarization. QEs are deterministically created by pressing a scanning probe microscope tip into a two-dimensional heterostructure comprising a WSe2 monolayer and a ~50 nm thick layer of the antiferromagnetic (AFM) insulator NiPS3. Temperature dependent magneto-photoluminescence studies indicate that the chiral quantum light emission arises from magnetic proximity interactions between localized excitons in the WSe2 monolayer and the out-of-plane magnetization of AFM defects in NiPS3, both of which are co-localized by the strain field arising from the nanoscale indentations.


title: TANDEM: Learning Joint Exploration and Decision Making with Tactile Sensors

abstract: Inspired by the human ability to perform complex manipulation in the complete absence of vision (like retrieving an object from a pocket), the robotic manipulation field is motivated to develop new methods for tactile-based object interaction. However, tactile sensing presents the challenge of being an active sensing modality: a touch sensor provides sparse, local data, and must be used in conjunction with effective exploration strategies in order to collect information. In this work, we focus on the process of guiding tactile exploration, and its interplay with task-related decision making. We propose TANDEM (TActile exploration aNd DEcision Making), an architecture to learn efficient exploration strategies in conjunction with decision making. Our approach is based on separate but co-trained modules for exploration and discrimination. We demonstrate this method on a tactile object recognition task, where a robot equipped with a touch sensor must explore and identify an object from a known set based on binary contact signals alone. TANDEM achieves higher accuracy with fewer actions than alternative methods and is also shown to be more robust to sensor noise.


title: Weighted domination models and randomized heuristics

abstract: We consider the minimum weight and smallest weight minimum-size dominating set problems in vertex-weighted graphs and networks. The latter problem is a two-objective optimization problem, which is different from the classic minimum weight dominating set problem that requires finding a dominating set of the smallest weight in a graph without trying to optimize its cardinality. In other words, the objective of minimizing the size of the dominating set in the two-objective problem can be considered as a constraint, i.e. a particular case of finding Pareto-optimal solutions. First, we show how to reduce the two-objective optimization problem to the minimum weight dominating set problem by using Integer Linear Programming formulations. Then, under different assumptions, the probabilistic method is applied to obtain upper bounds on the minimum weight dominating sets in graphs. The corresponding randomized algorithms for finding small-weight dominating sets in graphs are described as well. Computational experiments are used to illustrate the results for two different types of random graphs.


title: Finite-sample concentration of the empirical relative entropy around its mean

abstract: In this note, we show that the relative entropy of an empirical distribution of $n$ samples drawn from a set of size $k$ with respect to the true underlying distribution is exponentially concentrated around its expectation, with central moment generating function bounded by that of a gamma distribution with shape $2k$ and rate $n/2$. This improves on recent work of Bhatt and Pensia (arXiv 2021) on the same problem, who showed such a similar bound with an additional polylogarithmic factor of $k$ in the shape, and also confirms a recent conjecture of Mardia et al. (Information and Inference 2020). The proof proceeds by reducing the case $k>3$ of the multinomial distribution to the simpler case $k=2$ of the binomial, for which the desired bound follows from standard results on the concentration of the binomial.


title: Architectures of Compact Super-Earth Systems Shaped by Instabilities

abstract: Compact non-resonant systems of sub-Jovian planets are the most common outcome of the planet formation process. Despite exhibiting broad overall diversity, these planets also display dramatic signatures of intra-system uniformity in their masses, radii, and orbital spacings. Although the details of their formation and early evolution are poorly known, sub-Jovian planets are expected to emerge from their natal nebulae as multi-resonant chains, owing to planet-disk interactions. Within the context of this scenario, the architectures of observed exoplanet systems can be broadly replicated if resonances are disrupted through post-nebular dynamical instabilities. Here, we generate an ad-hoc sample of resonant chains and use a suite of N-body simulations to show that instabilities can not only reproduce the observed period ratio distribution, but that the resulting collisions also modify the mass uniformity in a way that is consistent with the data. Furthermore, we demonstrate that primordial mass uniformity, motivated by the sample of resonant chains coupled with dynamical sculpting, naturally generates uniformity in orbital period spacing similar to what is observed. Finally, we find that almost all collisions lead to perfect mergers, but some form of post-instability damping is likely needed to fully account for the present-day dynamically cold architectures of sub-Jovian exoplanets.


title: Accelerated Bregman Primal-Dual methods applied to Optimal Transport and Wasserstein Barycenter problems

abstract: This paper discusses the efficiency of Hybrid Primal-Dual (HPD) type algorithms to approximate solve discrete Optimal Transport (OT) and Wasserstein Barycenter (WB) problems, with and without entropic regularization. Our first contribution is an analysis showing that these methods yield state-of-the-art convergence rates, both theoretically and practically. Next, we extend the HPD algorithm with linesearch proposed by Malitsky and Pock in 2018 to the setting where the dual space has a Bregman divergence, and the dual function is relatively strongly convex to the Bregman's kernel. This extension yields a new method for OT and WB problems based on smoothing of the objective that also achieves state-of-the-art convergence rates. Finally, we introduce a new Bregman divergence based on a scaled entropy function that makes the algorithm numerically stable and reduces the smoothing, leading to sparse solutions of OT and WB problems. We complement our findings with numerical experiments and comparisons.


title: Code Smells in Machine Learning Systems

abstract: As Deep learning (DL) systems continuously evolve and grow, assuring their quality becomes an important yet challenging task. Compared to non-DL systems, DL systems have more complex team compositions and heavier data dependency. These inherent characteristics would potentially cause DL systems to be more vulnerable to bugs and, in the long run, to maintenance issues. Code smells are empirically tested as efficient indicators of non-DL systems. Therefore, we took a step forward into identifying code smells, and understanding their impact on maintenance in this comprehensive study. This is the first study on investigating code smells in the context of DL software systems, which helps researchers and practitioners to get a first look at what kind of maintenance modification made and what code smells developers have been dealing with. Our paper has three major contributions. First, we comprehensively investigated the maintenance modifications that have been made by DL developers via studying the evolution of DL systems, and we identified nine frequently occurred maintenance-related modification categories in DL systems. Second, we summarized five code smells in DL systems. Third, we validated the prevalence, and the impact of our newly identified code smells through a mixture of qualitative and quantitative analysis. We found that our newly identified code smells are prevalent and impactful on the maintenance of DL systems from the developer's perspective.


title: NESTANets: Stable, accurate and efficient neural networks for analysis-sparse inverse problems

abstract: Solving inverse problems is a fundamental component of science, engineering and mathematics. With the advent of deep learning, deep neural networks have significant potential to outperform existing state-of-the-art, model-based methods for solving inverse problems. However, it is known that current data-driven approaches face several key issues, notably hallucinations, instabilities and unpredictable generalization, with potential impact in critical tasks such as medical imaging. This raises the key question of whether or not one can construct deep neural networks for inverse problems with explicit stability and accuracy guarantees. In this work, we present a novel construction of accurate, stable and efficient neural networks for inverse problems with general analysis-sparse models, termed NESTANets. To construct the network, we first unroll NESTA, an accelerated first-order method for convex optimization. The slow convergence of this method leads to deep networks with low efficiency. Therefore, to obtain shallow, and consequently more efficient, networks we combine NESTA with a novel restart scheme. We then use compressed sensing techniques to demonstrate accuracy and stability. We showcase this approach in the case of Fourier imaging, and verify its stability and performance via a series of numerical experiments. The key impact of this work is demonstrating the construction of efficient neural networks based on unrolling with guaranteed stability and accuracy.

categories: cs.LG cs.CV cs.IT cs.NA eess.IV math.IT math.NA


title: Impurity States and Indirect Exchange Interaction in Irradiated Graphene

abstract: We theoretically investigate the impurity levels and exchange interaction between magnetic impurities in graphene driven by an off-resonant circularly polarized light field. Our analysis captures the non-perturbative effects resulting from scattering with magnetic impurities with a strong onsite potential. Under irradiation, a dynamical band gap opens up at the Dirac point, allowing impurity levels to exist inside the gap. These impurity levels are shown to give rise to a resonance feature in the exchange energy for impurities located either at the same or different sublattices. The exchange interaction also shows a wider spatial range of antiferromagnetic behavior due to irradiation. Our work demonstrates that the exchange energy of magnetic impurities in graphene is extensively tunable by light irradiation in the presence of strong potential scattering.


title: Dojo: A Differentiable Physics Engine for Robotics

abstract: We present Dojo, a differentiable physics engine for robotics that prioritizes stable simulation, accurate contact physics, and differentiability with respect to states, actions, and system parameters. Dojo achieves stable simulation at low sample rates and conserves energy and momentum by employing a variational integrator. A nonlinear complementarity problem with second-order cones for friction models hard contact, and is reliably solved using a custom primal-dual interior-point method. Special properties of the interior-point method are exploited using implicit differentiation to efficiently compute smooth gradients that provide useful information through contact events. We demonstrate Dojo with a number of examples including: planning, policy optimization, and system identification, that demonstrate the engine's unique ability to simulate hard contact while providing smooth, analytic gradients.


title: InCloud: Incremental Learning for Point Cloud Place Recognition

abstract: Place recognition is a fundamental component of robotics, and has seen tremendous improvements through the use of deep learning models in recent years. Networks can experience significant drops in performance when deployed in unseen or highly dynamic environments, and require additional training on the collected data. However naively fine-tuning on new training distributions can cause severe degradation of performance on previously visited domains, a phenomenon known as catastrophic forgetting. In this paper we address the problem of incremental learning for point cloud place recognition and introduce InCloud, a structure-aware distillation-based approach which preserves the higher-order structure of the network's embedding space. We introduce several challenging new benchmarks on four popular and large-scale LiDAR datasets (Oxford, MulRan, In-house and KITTI) showing broad improvements in point cloud place recognition performance over a variety of network architectures. To the best of our knowledge, this work is the first to effectively apply incremental learning for point cloud place recognition. Data pre-processing, training and evaluation code for this paper can be found at https://github.com/csiro-robotics/InCloud.


title: Free Bol loops of exponent two

abstract: A Bol loop is a loop that satisfies the identity $x((yz)y)=((xy)z)y$. In this paper, we give a construction of the free Bol loops of exponent two. We define a canonical form of all their elements and describe their multiplication law based on this form.


title: Instance-aware multi-object self-supervision for monocular depth prediction

abstract: This paper proposes a self-supervised monocular image-to-depth prediction framework that is trained with an end-to-end photometric loss that handles not only 6-DOF camera motion but also 6-DOF moving object instances. Self-supervision is performed by warping the images across a video sequence using depth and scene motion including object instances. One novelty of the proposed method is the use of the multi-head attention of the transformer network that matches moving objects across time and models their interaction and dynamics. This enables accurate and robust pose estimation for each object instance. Most image-to-depth predication frameworks make the assumption of rigid scenes, which largely degrades their performance with respect to dynamic objects. Only a few SOTA papers have accounted for dynamic objects. The proposed method is shown to outperform these methods on standard benchmarks and the impact of the dynamic motion on these benchmarks is exposed. Furthermore, the proposed image-to-depth prediction framework is also shown to be competitive with SOTA video-to-depth prediction frameworks.


title: Robust Seatbelt Detection and Usage Recognition for Driver Monitoring Systems

abstract: Wearing a seatbelt appropriately while driving can reduce serious crash-related injuries or deaths by about half. However, current seatbelt reminder system has multiple shortcomings, such as can be easily fooled by a "Seatbelt Warning Stopper", and cannot recognize incorrect usages for example seating in front of a buckled seatbelt or wearing a seatbelt under the arm. General seatbelt usage recognition has many challenges, to name a few, lacking of color information in Infrared (IR) cameras, strong distortion caused by wide Field of View (FoV) fisheye lens, low contrast between belt and its background, occlusions caused by hands or hair, and imaging blurry. In this paper, we introduce a novel general seatbelt detection and usage recognition framework to resolve the above challenges. Our method consists of three components: a local predictor, a global assembler, and a shape modeling process. Our approach can be applied to the driver in the Driver Monitoring System (DMS) or general passengers in the Occupant Monitoring System (OMS) for various camera modalities. Experiment results on both DMS and OMS are provided to demonstrate the accuracy and robustness of the proposed approach.


title: The quantum low-rank approximation problem

abstract: We consider a quantum version of the famous low-rank approximation problem. Specifically, we consider the distance $D(\rho,\sigma)$ between two normalized quantum states, $\rho$ and $\sigma$, where the rank of $\sigma$ is constrained to be at most $R$. For both the trace distance and Hilbert-Schmidt distance, we analytically solve for the optimal state $\sigma$ that minimizes this distance. For the Hilbert-Schmidt distance, the unique optimal state is $\sigma = \tau_R +N_R$, where $\tau_R = \Pi_R \rho \Pi_R$ is given by projecting $\rho$ onto its $R$ principal components with projector $\Pi_R$, and $N_R$ is a normalization factor given by $N_R = \frac{1- \text{Tr}(\tau_R)}{R}\Pi_R$. For the trace distance, this state is also optimal but not uniquely optimal, and we provide the full set of states that are optimal. We briefly discuss how our results have application for performing principal component analysis (PCA) via variational optimization on quantum computers.


title: Efficient Dynamic Clustering: Capturing Patterns from Historical Cluster Evolution

abstract: Clustering aims to group unlabeled objects based on similarity inherent among them into clusters. It is important for many tasks such as anomaly detection, database sharding, record linkage, and others. Some clustering methods are taken as batch algorithms that incur a high overhead as they cluster all the objects in the database from scratch or assume an incremental workload. In practice, database objects are updated, added, and removed from databases continuously which makes previous results stale. Running batch algorithms is infeasible in such scenarios as it would incur a significant overhead if performed continuously. This is particularly the case for high-velocity scenarios such as ones in Internet of Things applications. In this paper, we tackle the problem of clustering in high-velocity dynamic scenarios, where the objects are continuously updated, inserted, and deleted. Specifically, we propose a generally dynamic approach to clustering that utilizes previous clustering results. Our system, DynamicC, uses a machine learning model that is augmented with an existing batch algorithm. The DynamicC model trains by observing the clustering decisions made by the batch algorithm. After training, the DynamicC model is usedin cooperation with the batch algorithm to achieve both accurate and fast clustering decisions. The experimental results on four real-world and one synthetic datasets show that our approach has a better performance compared to the state-of-the-art method while achieving similarly accurate clustering results to the baseline batch algorithm.


title: An Accelerated Stochastic Algorithm for Solving the Optimal Transport Problem

abstract: A primal-dual accelerated stochastic gradient descent with variance reduction algorithm (PDASGD) is proposed to solve linear-constrained optimization problems. PDASGD could be applied to solve the discrete optimal transport (OT) problem and enjoys the best-known computational complexity -- $\widetilde{\mathcal{O}}(n^2/\epsilon)$, where $n$ is the number of atoms, and $\epsilon>0$ is the accuracy. In the literature, some primal-dual accelerated first-order algorithms, e.g., APDAGD, have been proposed and have the order of $\widetilde{\mathcal{O}}(n^{2.5}/\epsilon)$ for solving the OT problem. To understand why our proposed algorithm could improve the rate by a factor of $\widetilde{\mathcal{O}}(\sqrt{n})$, the conditions under which our stochastic algorithm has a lower order of computational complexity for solving linear-constrained optimization problems are discussed. It is demonstrated that the OT problem could satisfy the aforementioned conditions. Numerical experiments demonstrate superior practical performances of the proposed PDASGD algorithm for solving the OT problem.


title: Stacking Faults Assist Lithium-Ion Conduction in a Halide-Based Superionic Conductor

abstract: In the pursuit of urgently-needed, energy dense solid-state batteries for electric vehicle and portable electronics applications, halide solid electrolytes offer a promising path forward with exceptional compatibility against high-voltage oxide electrodes, tunable ionic conductivities, and facile processing. For this family of compounds, synthesis protocols strongly affect cation site disorder and modulate Li+ mobility. In this work, we reveal the presence of a high concentration of stacking faults in the superionic conductor Li3YCl6 and demonstrate a method of controlling its Li+ conductivity by tuning the defect concentration with synthesis and heat treatments at select temperatures. Leveraging complementary insights from variable temperature synchrotron X-ray diffraction, neutron diffraction, cryogenic transmission electron microscopy, solid-state nuclear magnetic resonance, density functional theory, and electrochemical impedance spectroscopy, we identify the nature of planar defects and the role of nonstoichiometry in lowering Li+ migration barriers and increasing Li site connectivity in mechanochemically-synthesized Li3YCl6. We harness paramagnetic relaxation enhancement to enable 89Y solid-state NMR, and directly contrast the Y cation site disorder resulting from different preparation methods, demonstrating a potent tool for other researchers studying Y-containing compositions. With heat treatments at temperatures as low as 333 K (60{\deg}C), we decrease the concentration of planar defects, demonstrating a simple method for tuning the Li+ conductivity. Findings from this work are expected to be generalizable to other halide solid electrolyte candidates and provide an improved understanding of defect-enabled Li+ conduction in this class of Li-ion conductors.


title: Computerization of Clinical Pathways: A Literature Review and Directions for Future Research

abstract: Clinical Pathways (CP) are medical management plans developed to standardize patient treatment activities, optimize resource usage, reduce expenses, and improve the quality of healthcare services. Most CPs currently in use are paper-based documents (i.e., not computerized). CP computerization has been an active research topic since the inception of CP use in hospitals. This literature review research aims to examine studies that focused on CP computerization and offers recommendations for future research in this important research area. Some critical research suggestions include centralizing computerized CPs in Healthcare Information Systems (HIS), CP term standardization using international medical terminology systems, developing a global CP-specific digital coding system, creating a unified CP meta-ontology, developing independent Clinical Pathway Management Systems (CPMS), and supporting CPMSs with machine learning sub-systems.


title: Mutually orthogonal cycle systems

abstract: An ${\ell}$-cycle system ${\mathcal F}$ of a graph $\Gamma$ is a set of ${\ell}$-cycles which partition the edge set of $\Gamma$. Two such cycle systems ${\mathcal F}$ and ${\mathcal F}'$ are said to be {\em orthogonal} if no two distinct cycles from ${\mathcal F}\cup {\mathcal F}'$ share more than one edge. Orthogonal cycle systems naturally arise from face $2$-colourable polyehdra and in higher genus from Heffter arrays with certain orderings. A set of pairwise orthogonal $\ell$-cycle systems of $\Gamma$ is said to be a set of mutually orthogonal cycle systems of $\Gamma$. Let $\mu(\ell,n)$ (respectively, $\mu'(\ell,n)$) be the maximum integer $\mu$ such that there exists a set of $\mu$ mutually orthogonal (cyclic) $\ell$-cycle systems of the complete graph $K_n$. We show that if $\ell\geq 4$ is even and $n\equiv 1\pmod{2\ell}$, then $\mu'(\ell,n)$, and hence $\mu(\ell,n)$, is bounded below by a constant multiple of $n/\ell^2$. In contrast, we obtain the following upper bounds: $\mu(\ell,n)\leq n-2$; $\mu(\ell,n)\leq (n-2)(n-3)/(2(\ell-3))$ when $\ell \geq 4$; $\mu(\ell,n)\leq 1$ when $\ell>n/\sqrt{2}$; and $\mu'(\ell,n)\leq n-3$ when $n \geq 4$. We also obtain computational results for small values of $n$ and $\ell$.


title: Polaronic Conductivity in Cr$_2$Ge$_2$Te$_6$ Single Crystals

abstract: Intrinsic, two-dimensional (2D) ferromagnetic semiconductors are an important class of materials for spin-charge conversion applications. Cr$_2$Ge$_2$Te$_6$ retains long-range magnetic order in bilayer at cryogenic temperatures and shows complex magnetic interactions with considerable magnetic anisotropy. Here, we performed a series of structural, magnetic, X-ray scattering, electronic, thermal transport and first-principles calculation studies which reveal that localized electronic charge carriers in Cr$_2$Ge$_2$Te$_6$ are dressed by surrounding lattice and are involved in polaronic transport via hopping that is sensitive on details of magnetocrystalline anisotropy. This opens possibility for manipulation of charge transport in Cr$_2$Ge$_2$Te$_6$ - based devices by electron-phonon- and spin-orbit coupling-based tailoring of polaron properties.


title: Emergence of insulating ferrimagnetism and perpendicular magnetic anisotropy in 3d-5d perovskite oxide composite films for insulator spintronic

abstract: Magnetic insulators with strong perpendicular magnetic anisotropy (PMA) play a key role in exploring pure spin current phenomena and developing ultralow-dissipation spintronic devices, thereby it is highly desirable to develop new material platforms. Here we report epitaxial growth of La2/3Sr1/3MnO3 (LSMO)-SrIrO3 (SIO) composite oxide films (LSMIO) with different crystalline orientations fabricated by sequential two-target ablation process using pulsed laser deposition. The LSMIO films exhibit high crystalline quality with homogeneous mixture of LSMO and SIO at atomic level. Ferrimagnetic and insulating transport characteristics are observed, with the temperature-dependent electric resistivity well fitted by Mott variable-range-hopping model. Moreover, the LSMIO films show strong PMA. Through further constructing all perovskite oxide heterostructures of the ferrimagnetic insulator LSMIO and a strong spin-orbital coupled SIO layer, pronounced spin Hall magnetoresistance (SMR) and spin Hall-like anomalous Hall effect (SH-AHE) were observed. These results illustrate the potential application of the ferrimagnetic insulator LSMIO in developing all-oxide ultralow-dissipation spintronic devices.


title: TSAM: A Two-Stream Attention Model for Causal Emotion Entailment

abstract: Causal Emotion Entailment (CEE) aims to discover the potential causes behind an emotion in a conversational utterance. Previous works formalize CEE as independent utterance pair classification problems, with emotion and speaker information neglected. From a new perspective, this paper considers CEE in a joint framework. We classify multiple utterances synchronously to capture the correlations between utterances in a global view and propose a Two-Stream Attention Model (TSAM) to effectively model the speaker's emotional influences in the conversational history. Specifically, the TSAM comprises three modules: Emotion Attention Network (EAN), Speaker Attention Network (SAN), and interaction module. The EAN and SAN incorporate emotion and speaker information in parallel, and the subsequent interaction module effectively interchanges relevant information between the EAN and SAN via a mutual BiAffine transformation. Extensive experimental results demonstrate that our model achieves new State-Of-The-Art (SOTA) performance and outperforms baselines remarkably.


title: Partial Likelihood Thompson Sampling

abstract: We consider the problem of deciding how best to target and prioritize existing vaccines that may offer protection against new variants of an infectious disease. Sequential experiments are a promising approach; however, challenges due to delayed feedback and the overall ebb and flow of disease prevalence make available methods inapplicable for this task. We present a method, partial likelihood Thompson sampling, that can handle these challenges. Our method involves running Thompson sampling with belief updates determined by partial likelihood each time we observe an event. To test our approach, we ran a semi-synthetic experiment based on 200 days of COVID-19 infection data in the US.


title: Asymptotic Normality of Log Likelihood Ratio and Fundamental Limit of the Weak Detection for Spiked Wigner Matrices

abstract: We consider the problem of detecting the presence of a signal in a rank-one spiked Wigner model. For general non-Gaussian noise, assuming that the signal is drawn from the Rademacher prior, we prove that the log likelihood ratio (LR) of the spiked model against the null model converges to a Gaussian when the signal-to-noise ratio is below a certain threshold. The threshold is optimal in the sense that the reliable detection is possible by a transformed principal component analysis (PCA) above it. From the mean and the variance of the limiting Gaussian for the log LR, we compute the limit of the sum of the Type-I error and the Type-II error of the likelihood ratio test. We also prove similar results for a rank-one spiked IID model where the noise is asymmetric but the signal is symmetric.


title: Keeping Minimal Experience to Achieve Efficient Interpretable Policy Distillation

abstract: Although deep reinforcement learning has become a universal solution for complex control tasks, its real-world applicability is still limited because lacking security guarantees for policies. To address this problem, we propose Boundary Characterization via the Minimum Experience Retention (BCMER), an end-to-end Interpretable Policy Distillation (IPD) framework. Unlike previous IPD approaches, BCMER distinguishes the importance of experiences and keeps a minimal but critical experience pool with almost no loss of policy similarity. Specifically, the proposed BCMER contains two basic steps. Firstly, we propose a novel multidimensional hyperspheres intersection (MHI) approach to divide experience points into boundary points and internal points, and reserve the crucial boundary points. Secondly, we develop a nearest-neighbor-based model to generate robust and interpretable decision rules based on the boundary points. Extensive experiments show that the proposed BCMER is able to reduce the amount of experience to 1.4%~19.1% (when the count of the naive experiences is 10k) and maintain high IPD performance. In general, the proposed BCMER is more suitable for the experience storage limited regime because it discovers the critical experience and eliminates redundant experience.


title: Nonreciprocal and chiral single-photon scattering for giant atoms

abstract: Quantum optics with giant atoms has provided a new paradigm to study photon scatterings. In this work, we investigate the nontrivial single-photon scattering properties of giant atoms being an effective platform to realize nonreciprocal and chiral quantum optics. For two-level giant atoms, we identify the condition for nonreciprocal transmission: the external atomic dissipation is further required other than the breaking of time-reversal symmetry by local coupling phases. Especially, in the non-Markovian regime, unconventional revival peaks periodically appear in the reflection spectrum. To explore more interesting scattering behaviors, we extend the two-level giant-atom system to {\Delta}-type and {\nabla}-type three-level giant atoms coupled to double waveguides with different physical mechanisms to realize nonreciprocal and chiral scatterings. Our proposed giant-atom structures have potential applications of high-efficiency targeted routers that can transport single photons to any desired port deterministically and circulators that can transport single photons between four ports in a cyclic way.


title: Signature of edge states in resonant wave scattering

abstract: Particle beam scattering is a conventional technique for detecting the nature of matter. We studied the scattering problem of a cluster connected to multiple leads. We established the connection between the eigenstate of the topological scattering center and the transmission and reflection amplitudes for the resonant scattering process. We discovered that as an application, this approach enables the detection of the edge state in the band gap for both Hermitian and non-Hermitian systems and the identification of the topology of a system. We investigated two types of Su-Schrieffer-Heeger chains as examples. In addition, we proposed a dynamic scheme through an evanescently coupled-waveguide array to detect the edge state on the basis of measured transmission intensity. Numerical simulation revealed that pattern visibility can be the signature of the edge states.


title: Towards Effective Resource Procurement in MEC: a Resource Re-selling Framework

abstract: On-demand and resource reservation pricing models have been widely used in cloud computing, catering to different user requirements. Nevertheless, in Multi-Access Edge Computing (MEC), as the edge has limited resources compared to the cloud, on-demand users may not get their jobs served on time, or at all, if too many resources were reserved by reservation plan users. Concurrently, reservation plan users may possess excess un-utilized quota. To optimize this resource mismatch scenario, we propose a Sharing Quota Model (SQM) where reservation plan users can re-sell unused resource quota to on-demand users, with the mobile network operator (MNO) taking a commission. To analyze the user's aggregate behavior at equilibrium and investigate the MNO's incentive of allowing re-selling, we formulate a 3-stage non-cooperative Stackelberg Game. Solving this game, we characterize the optimal strategies of buyers and re-sellers. We show that on aggregate, users' optimal strategies give rise to 4 disjoint regions, dependent on the MNO's prices and supply levels. Based on this, we characterise the MNO's optimal prices for on-demand users. Numerical results show that having both the sharing and on-demand pool gives the MNO an optimal revenue when the on-demand pool's supply is low, and when the MNO's commission is low.


title: Using Geographic Load Shifting to Reduce Carbon Emissions

abstract: An increasing focus on the electricity use and carbon emissions associated with computing has lead to pledges by major cloud computing companies to lower their carbon footprint. Data centers have a unique ability to shift computing load between different geographical locations, giving rise to geographic load flexibility that can be employed to reduce carbon emissions. In this paper, we present a model where data centers shift load independently of the ISOs. We first consider the impact of load shifting guided by locational marginal carbon emissions, denoted by $\lambda_{\text{CO}_2}$, a sensitivity metric that measures the impact of incremental load shifts. Relative to previous models for data center load shifting, the presented model improves accuracy and include more realistic assumptions regarding the operation of both data centers and the electricity market. Further, we introduce a new benchmark model in which data centers have access to the full information about the power system and can identify optimal shifts for the current time period. We demonstrate the efficacy of our model on the IEEE RTS GMLC system using 5 minute load and generation data for an entire year. Our results show that the proposed accuracy improvements for the shifting model based on $\lambda_{\text{CO}_2}$ are highly effective, leading to results that outperform the benchmark model.


title: $C^*$-isomorphisms associated with two projections on a Hilbert $C^*$-module

abstract: Motivated by two norm equations used to characterize the Friedrichs angle, this paper studies $C^*$-isomorphisms associated with two projections by introducing the matched triple and the semi-harmonious pair of projections. A triple $(P,Q,H)$ is said to be matched if $H$ is a Hilbert $C^*$-module, $P$ and $Q$ are projections on $H$ such that their infimum $P\wedge Q$ exists as an element of $\mathcal{L}(H)$, where $\mathcal{L}(H)$ denotes the set of all adjointable operators on $H$. The $C^*$-subalgebras of $\mathcal{L}(H)$ generated by elements in $\{P-P\wedge Q, Q-P\wedge Q, I\}$ and $\{P,Q,P\wedge Q,I\}$ are denoted by $i(P,Q,H)$ and $o(P,Q,H)$, respectively. It is proved that each faithful representation $(\pi, X)$ of $o(P,Q,H)$ can induce a faithful representation $(\widetilde{\pi}, X)$ of $i(P,Q,H)$ such that \begin{align*}&\widetilde{\pi}(P-P\wedge Q)=\pi(P)-\pi(P)\wedge \pi(Q),\\ &\widetilde{\pi}(Q-P\wedge Q)=\pi(Q)-\pi(P)\wedge \pi(Q). \end{align*} When $(P,Q)$ is semi-harmonious, that is, $\overline{\mathcal{R}(P+Q)}$ and $\overline{\mathcal{R}(2I-P-Q)}$ are both orthogonally complemented in $H$, it is shown that $i(P,Q,H)$ and $i(I-Q,I-P,H)$ are unitarily equivalent via a unitary operator in $\mathcal{L}(H)$. A counterexample is constructed, which shows that the same may be not true when $(P,Q)$ fails to be semi-harmonious. Likewise, a counterexample is constructed such that $(P,Q)$ is semi-harmonious, whereas $(P,I-Q)$ is not semi-harmonious. Some additional examples indicating new phenomena of adjointable operators acting on Hilbert $C^*$-modules are also provided.


title: 3DCTN: 3D Convolution-Transformer Network for Point Cloud Classification

abstract: Although accurate and fast point cloud classification is a fundamental task in 3D applications, it is difficult to achieve this purpose due to the irregularity and disorder of point clouds that make it challenging to achieve effective and efficient global discriminative feature learning. Lately, 3D Transformers have been adopted to improve point cloud processing. Nevertheless, massive Transformer layers tend to incur huge computational and memory costs. This paper presents a novel hierarchical framework that incorporates convolution with Transformer for point cloud classification, named 3D Convolution-Transformer Network (3DCTN), to combine the strong and efficient local feature learning ability of convolution with the remarkable global context modeling capability of Transformer. Our method has two main modules operating on the downsampling point sets, and each module consists of a multi-scale local feature aggregating (LFA) block and a global feature learning (GFL) block, which are implemented by using Graph Convolution and Transformer respectively. We also conduct a detailed investigation on a series of Transformer variants to explore better performance for our network. Various experiments on ModelNet40 demonstrate that our method achieves state-of-the-art classification performance, in terms of both accuracy and efficiency.


title: Personalized Federated Learning With Graph

abstract: Knowledge sharing and model personalization are two key components in the conceptual framework of personalized federated learning (PFL). Existing PFL methods focus on proposing new model personalization mechanisms while simply implementing knowledge sharing by aggregating models from all clients, regardless of their relation graph. This paper aims to enhance the knowledge-sharing process in PFL by leveraging the graph-based structural information among clients. We propose a novel structured federated learning (SFL) framework to learn both the global and personalized models simultaneously using client-wise relation graphs and clients' private data. We cast SFL with graph into a novel optimization problem that can model the client-wise complex relations and graph-based structural topology by a unified framework. Moreover, in addition to using an existing relation graph, SFL could be expanded to learn the hidden relations among clients. Experiments on traffic and image benchmark datasets can demonstrate the effectiveness of the proposed method. All implementation codes are available on Github


title: Fast Object Inertial Parameter Identification for Collaborative Robots

abstract: Collaborative robots (cobots) are machines designed to work safely alongside people in human-centric environments. Providing cobots with the ability to quickly infer the inertial parameters of manipulated objects will improve their flexibility and enable greater usage in manufacturing and other areas. To ensure safety, cobots are subject to kinematic limits that result in low signal-to-noise ratios (SNR) for velocity, acceleration, and force-torque data. This renders existing inertial parameter identification algorithms prohibitively slow and inaccurate. Motivated by the desire for faster model acquisition, we investigate the use of an approximation of rigid body dynamics to improve the SNR. Additionally, we introduce a mass discretization method that can make use of shape information to quickly identify plausible inertial parameters for a manipulated object. We present extensive simulation studies and real-world experiments demonstrating that our approach complements existing inertial parameter identification methods by specifically targeting the typical cobot operating regime.


title: Three-Dimensional Inhomogeneity of Electron-Temperature-Gradient Turbulence in the Edge of Tokamak Plasmas

abstract: Nonlinear multiscale gyrokinetic simulations of a Joint European Torus edge pedestal are used to show that electron-temperature-gradient (ETG) turbulence has a rich three-dimensional structure, varying strongly according to the local magnetic-field configuration. In the plane normal to the magnetic field, the steep pedestal electron temperature gradient gives rise to anisotropic turbulence with a radial (normal) wavelength much shorter than in the binormal direction. In the parallel direction, the location and parallel extent of the turbulence are determined by the variation in the magnetic drifts and finite-Larmor-radius (FLR) effects. The magnetic drift and FLR topographies have a perpendicular-wavelength dependence, which permits turbulence intensity maxima near the flux-surface top and bottom at longer binormal scales, but constrains turbulence to the outboard midplane at shorter electron-gyroradius binormal scales. Our simulations show that long-wavelength ETG turbulence does not transport heat efficiently, and significantly decreases overall ETG transport -- in our case by $\sim$40 \% -- through multiscale interactions.


title: To further understand graph signals

abstract: Graph signal processing (GSP) is a framework to analyze and process graph-structured data. Many research works focus on developing tools such as Graph Fourier transforms (GFT), filters, and neural network models to handle graph signals. Such approaches have successfully taken care of ``signal processing'' in many circumstances. In this paper, we want to put emphasis on ``graph signals'' themselves. Although there are characterizations of graph signals using the notion of bandwidth derived from GFT, we want to argue here that graph signals may contain hidden geometric information of the network, independent of (graph) Fourier theories. We shall provide a framework to understand such information, and demonstrate how new knowledge on ``graph signals'' can help with ``signal processing''.


title: Adaptive Discriminative Regularization for Visual Classification

abstract: How to improve discriminative feature learning is central in classification. Existing works address this problem by explicitly increasing inter-class separability and intra-class similarity, whether by constructing positive and negative pairs for contrastive learning or posing tighter class separating margins. These methods do not exploit the similarity between different classes as they adhere to i.i.d. assumption in data. In this paper, we embrace the real-world data distribution setting that some classes share semantic overlaps due to their similar appearances or concepts. Regarding this hypothesis, we propose a novel regularization to improve discriminative learning. We first calibrate the estimated highest likelihood of one sample based on its semantically neighboring classes, then encourage the overall likelihood predictions to be deterministic by imposing an adaptive exponential penalty. As the gradient of the proposed method is roughly proportional to the uncertainty of the predicted likelihoods, we name it adaptive discriminative regularization (ADR), trained along with a standard cross entropy loss in classification. Extensive experiments demonstrate that it can yield consistent and non-trivial performance improvements in a variety of visual classification tasks (over 10 benchmarks). Furthermore, we find it is robust to long-tailed and noisy label data distribution. Its flexible design enables its compatibility with mainstream classification architectures and losses.


title: Driver State Modeling through Latent Variable State Space Framework in the Wild

abstract: Analyzing the impact of the environment on drivers' stress level and workload is of high importance for designing human-centered driver-vehicle interaction systems and to ultimately help build a safer driving experience. However, driver's state, including stress level and workload, are psychological constructs that cannot be measured on their own and should be estimated through sensor measurements such as psychophysiological measures. We propose using a latent-variable state-space modeling framework for driver state analysis. By using latent-variable state-space models, we model drivers' workload and stress levels as latent variables estimated through multimodal human sensing data, under the perturbations of the environment in a state-space format and in a holistic manner. Through using a case study of multimodal driving data collected from 11 participants, we first estimate the latent stress level and workload of drivers from their heart rate, gaze measures, and intensity of facial action units. We then show that external contextual elements such as the number of vehicles as a proxy for traffic density and secondary task demands may be associated with changes in driver's stress levels and workload. We also show that different drivers may be impacted differently by the aforementioned perturbations. We found out that drivers' latent states at previous timesteps are highly associated with their current states. Additionally, we discuss the utility of state-space models in analyzing the possible lag between the two constructs of stress level and workload, which might be indicative of information transmission between the different parts of the driver's psychophysiology in the wild.


title: Riesz transform on exterior Lipschitz domains

abstract: Let $\mathscr{L}=-\text{div}A\nabla$ be a uniformly elliptic operator on $\mathbb{R}^n$, $n\ge 2$. Let $\Omega$ be an exterior Lipschitz domain, let $\mathscr{L}_D$ and $\mathscr{L}_N$ be the operator $\mathscr{L}$ on $\Omega$ subject to the Dirichlet and Neumann boundary values, respectively. We establish characterization for the boundedness of the Riesz transforms $\nabla\mathscr{L}_D^{-1/2}$, $\nabla \mathscr{L}_N^{-1/2}$ in the sharp range. As a byproduct, we show the reverse inequality $\|\mathscr{L}_D^{1/2}f\|_{L^p(\Omega)}\le C\|\nabla f\|_{L^p(\Omega)}$ holds for any $1<p<\infty$. As applications, we deduce the sharp range for the boundedness of the Riesz transforms, for operators with VMO coefficients, on exterior Lipschitz and $C^1$ domains. Application to inhomogeneous Dirichlet and Neumann problem is also presented. Our result is new even for the Dirichlet and Neumann Laplacian on exterior Lipschitz and $C^1$ domains.


title: CandidateDrug4Cancer: An Open Molecular Graph Learning Benchmark on Drug Discovery for Cancer

abstract: Anti-cancer drug discoveries have been serendipitous, we sought to present the Open Molecular Graph Learning Benchmark, named CandidateDrug4Cancer, a challenging and realistic benchmark dataset to facilitate scalable, robust, and reproducible graph machine learning research for anti-cancer drug discovery. CandidateDrug4Cancer dataset encompasses multiple most-mentioned 29 targets for cancer, covering 54869 cancer-related drug molecules which are ranged from pre-clinical, clinical and FDA-approved. Besides building the datasets, we also perform benchmark experiments with effective Drug Target Interaction (DTI) prediction baselines using descriptors and expressive graph neural networks. Experimental results suggest that CandidateDrug4Cancer presents significant challenges for learning molecular graphs and targets in practical application, indicating opportunities for future researches on developing candidate drugs for treating cancers.


title: Minimax rates for heterogeneous causal effect estimation

abstract: Estimation of heterogeneous causal effects - i.e., how effects of policies and treatments vary across subjects - is a fundamental task in causal inference. Many methods for estimating conditional average treatment effects (CATEs) have been proposed in recent years, but questions surrounding optimality have remained largely unanswered. In particular, a minimax theory of optimality has yet to be developed, with the minimax rate of convergence and construction of rate-optimal estimators remaining open problems. In this paper we derive the minimax rate for CATE estimation, in a Holder-smooth nonparametric model, and present a new local polynomial estimator, giving high-level conditions under which it is minimax optimal. Our minimax lower bound is derived via a localized version of the method of fuzzy hypotheses, combining lower bound constructions for nonparametric regression and functional estimation. Our proposed estimator can be viewed as a local polynomial R-Learner, based on a localized modification of higher-order influence function methods. The minimax rate we find exhibits several interesting features, including a non-standard elbow phenomenon and an unusual interpolation between nonparametric regression and functional estimation rates. The latter quantifies how the CATE, as an estimand, can be viewed as a regression/functional hybrid.


title: OmniFusion: 360 Monocular Depth Estimation via Geometry-Aware Fusion

abstract: A well-known challenge in applying deep-learning methods to omnidirectional images is spherical distortion. In dense regression tasks such as depth estimation, where structural details are required, using a vanilla CNN layer on the distorted 360 image results in undesired information loss. In this paper, we propose a 360 monocular depth estimation pipeline, OmniFusion, to tackle the spherical distortion issue. Our pipeline transforms a 360 image into less-distorted perspective patches (i.e. tangent images) to obtain patch-wise predictions via CNN, and then merge the patch-wise results for final output. To handle the discrepancy between patch-wise predictions which is a major issue affecting the merging quality, we propose a new framework with the following key components. First, we propose a geometry-aware feature fusion mechanism that combines 3D geometric features with 2D image features to compensate for the patch-wise discrepancy. Second, we employ the self-attention-based transformer architecture to conduct a global aggregation of patch-wise information, which further improves the consistency. Last, we introduce an iterative depth refinement mechanism, to further refine the estimated depth based on the more accurate geometric features. Experiments show that our method greatly mitigates the distortion issue, and achieves state-of-the-art performances on several 360 monocular depth estimation benchmark datasets.


title: Multivariate doubly truncated moments for generalized skew-elliptical distributions with application to multivariate tail conditional risk measures

abstract: In this paper, we focus on multivariate doubly truncated first two moments of generalized skew-elliptical (GSE) distributions and derive explicit expressions for them. It includes many useful distributions, for examples, generalized skew-normal (GSN), generalized skew-Laplace (GSLa), generalized skew-logistic (GSLo) and generalized skew student-$t$ (GSSt) distributions, all as special cases. We also give formulas of multivariate doubly truncated expectation and covariance for GSE distributions. As applications, we show the results of multivariate tail conditional expectation (MTCE) and multivariate tail covariance (MTCov) for GSE distributions.


title: Flood hazard model calibration using multiresolution model output

abstract: Riverine floods pose a considerable risk to many communities. Improving flood hazard projections has the potential to inform the design and implementation of flood risk management strategies. Current flood hazard projections are uncertain, especially due to uncertain model parameters. Calibration methods use observations to quantify model parameter uncertainty. With limited computational resources, researchers typically calibrate models using either relatively few expensive model runs at high spatial resolutions or many cheaper runs at lower spatial resolutions. This leads to an open question: Is it possible to effectively combine information from the high and low resolution model runs? We propose a Bayesian emulation-calibration approach that assimilates model outputs and observations at multiple resolutions. As a case study for a riverine community in Pennsylvania, we demonstrate our approach using the LISFLOOD-FP flood hazard model. The multiresolution approach results in improved parameter inference over the single resolution approach in multiple scenarios. Results vary based on the parameter values and the number of available models runs. Our method is general and can be used to calibrate other high dimensional computer models to improve projections.


title: A Zero Lyapunov Exponent in Genus $3$ Implies the Eierlegende Wollmilchsau

abstract: We prove that the closed orbit of the Eierlegende Wollmilchsau is the only $\text{SL}(2,\mathbb{R})$-orbit closure in genus three with a zero Lyapunov exponent in its Kontsevich-Zorich spectrum. The result recovers previous partial results in this direction by Bainbridge-Habegger-M\"oller and the first named author. The main new contribution is an understanding of the Forni subspace along a degeneration toward the boundary of the moduli space of curves. This results in a simple geometric criterion that excludes the existence of a Forni subspace. Another key ingredient is the solution to the jump problem from the work of Hu and the third named author.


title: Can 8-Year-Olds understand concepts of Einsteinian physics?

abstract: This paper reports the first study on the ability of Year 3 students (ages 7 to 8) to conceptualize Einsteinian concepts. This paper reports that children aged 7-8 are not too young to learn key Einsteinian concepts, and the benefits of reinforcement indicate that longer programs are needed for ideas to be consolidated.


title: X-Trans2Cap: Cross-Modal Knowledge Transfer using Transformer for 3D Dense Captioning

abstract: 3D dense captioning aims to describe individual objects by natural language in 3D scenes, where 3D scenes are usually represented as RGB-D scans or point clouds. However, only exploiting single modal information, e.g., point cloud, previous approaches fail to produce faithful descriptions. Though aggregating 2D features into point clouds may be beneficial, it introduces an extra computational burden, especially in inference phases. In this study, we investigate a cross-modal knowledge transfer using Transformer for 3D dense captioning, X-Trans2Cap, to effectively boost the performance of single-modal 3D caption through knowledge distillation using a teacher-student framework. In practice, during the training phase, the teacher network exploits auxiliary 2D modality and guides the student network that only takes point clouds as input through the feature consistency constraints. Owing to the well-designed cross-modal feature fusion module and the feature alignment in the training phase, X-Trans2Cap acquires rich appearance information embedded in 2D images with ease. Thus, a more faithful caption can be generated only using point clouds during the inference. Qualitative and quantitative results confirm that X-Trans2Cap outperforms previous state-of-the-art by a large margin, i.e., about +21 and about +16 absolute CIDEr score on ScanRefer and Nr3D datasets, respectively.


title: Photon Ring Symmetries in Simulated Linear Polarization Images of Messier 87*

abstract: The Event Horizon Telescope (EHT) recently released the first linearly polarized images of the accretion flow around the supermassive black hole Messier 87*, hereafter \m{}. The spiraling polarization pattern found in EHT images favored magnetically arrested disks (MADs) as the explanation for the EHT image. With next-generation improvements to very long baseline interferometry (VLBI) on the horizon, understanding similar polarized features in the highly lensed structure known as the "photon ring," where photons make multiple half-orbits about the black hole before reaching the observer, will be critical to analysis of future images. Recent work has indicated that this image region may be depolarized relative to more direct emission. We expand this observation by decomposing photon half-orbits in the EHT library of simulated images of the \m{} accretion system and find that images of MAD simulations show a relative depolarization of the photon ring attributable to destructive interference of oppositely spiraling electric field vectors; this antisymmetry, which arises purely from strong gravitational lensing, can produce up to ${\sim}50\%$ depolarization in the photon ring region with respect to the direct image. In systems that are not magnetically arrested and with the exception of systems with high spin and ions and electrons of equal temperature, we find that highly lensed indirect sub-images are almost completely depolarized, causing a modest depolarization of the photon ring region in the complete image. We predict that next-generation EHT observations of \m{} polarization should jointly constrain the black hole spin and the underlying emission and magnetic field geometry.


title: Can No-reference features help in Full-reference image quality estimation?

abstract: Development of perceptual image quality assessment (IQA) metrics has been of significant interest to computer vision community. The aim of these metrics is to model quality of an image as perceived by humans. Recent works in Full-reference IQA research perform pixelwise comparison between deep features corresponding to query and reference images for quality prediction. However, pixelwise feature comparison may not be meaningful if distortion present in query image is severe. In this context, we explore utilization of no-reference features in Full-reference IQA task. Our model consists of both full-reference and no-reference branches. Full-reference branches use both distorted and reference images, whereas No-reference branch only uses distorted image. Our experiments show that use of no-reference features boosts performance of image quality assessment. Our model achieves higher SRCC and KRCC scores than a number of state-of-the-art algorithms on KADID-10K and PIPAL datasets.


title: PUMA: Performance Unchanged Model Augmentation for Training Data Removal

abstract: Preserving the performance of a trained model while removing unique characteristics of marked training data points is challenging. Recent research usually suggests retraining a model from scratch with remaining training data or refining the model by reverting the model optimization on the marked data points. Unfortunately, aside from their computational inefficiency, those approaches inevitably hurt the resulting model's generalization ability since they remove not only unique characteristics but also discard shared (and possibly contributive) information. To address the performance degradation problem, this paper presents a novel approach called Performance Unchanged Model Augmentation~(PUMA). The proposed PUMA framework explicitly models the influence of each training data point on the model's generalization ability with respect to various performance criteria. It then complements the negative impact of removing marked data by reweighting the remaining data optimally. To demonstrate the effectiveness of the PUMA framework, we compared it with multiple state-of-the-art data removal techniques in the experiments, where we show the PUMA can effectively and efficiently remove the unique characteristics of marked training data without retraining the model that can 1) fool a membership attack, and 2) resist performance degradation. In addition, as PUMA estimates the data importance during its operation, we show it could serve to debug mislabelled data points more efficiently than existing approaches.


title: Berry phase in the phase space worldline representation: the axial anomaly and classical kinetic theory

abstract: The Berry phase is analyzed for Weyl and Dirac fermions in a phase space representation of the worldline formalism. Kinetic theories are constructed for both at a classical level. Whereas the Weyl fermion case reduces in dimension, resembling a theory in quantum mechanics, the Dirac fermion case takes on a manifestly Lorentz covariant form. To achieve a classical kinetic theory for the non-Abelian Dirac fermion Berry phase a spinor construction of Barut and Zanghi is utilized. The axial anomaly is also studied at a quantum level. It is found that under an adiabatic approximation, which is necessary for facilitating a classical kinetic theory, the index of the Dirac operator for massless fermions vanishes. Even so, similarities of an axial rotation to an exact non-covariant Berry phase transform are drawn by application of the Fujikawa method to the Barut and Zanghi spinors on the worldline.


title: Possible studies on generalized parton distributions and gravitational form factors in neutrino reactions

abstract: Spacelike and timelike generalized parton distributions (GPDs) have been investigated in charged-lepton scattering and electron-positron collisions via deeply virtual Compton scattering and two-photon processes, respectively. Furthermore, we expect that hadron-accelerator-facility measurements will be performed in future. The GPDs will play a crucial role in clarifying the origins of hadron spins and masses in terms of quarks and gluons. It is also possible to probe internal pressure within hadrons for understanding their stability. Gravitational form factors of hadrons used to be considered as a purely academic subject because gravitational interactions are too weak to be measured in microscopic systems. However, due to the development of hadron-tomography field, it became possible to extract the gravitational form factors from the actual GPD measurements without relying on direct gravitational interactions. Neutrino reactions can also be used for GPD studies in future, for example, by using the Long-Baseline Neutrino Facility at Fermilab. The neutrino GPD measurements are valuable especially for finding the flavor dependence of the GPDs in a complementary way to the charged-lepton experiments. We give an overview of the GPDs and discuss possible neutrino GPD measurements using the single-pion production processes $\nu + N \to \ell^- + N' + \pi$ and $\bar\nu + N \to \ell^+ + N' + \pi$.


title: Adversarially Robust Learning with Tolerance

abstract: We initiate the study of tolerant adversarial PAC-learning with respect to metric perturbation sets. In adversarial PAC-learning, an adversary is allowed to replace a test point $x$ with an arbitrary point in a closed ball of radius $r$ centered at $x$. In the tolerant version, the error of the learner is compared with the best achievable error with respect to a slightly larger perturbation radius $(1+\gamma)r$. This simple tweak helps us bridge the gap between theory and practice and obtain the first PAC-type guarantees for algorithmic techniques that are popular in practice. Our first result concerns the widely-used ``perturb-and-smooth'' approach for adversarial learning. For perturbation sets with doubling dimension $d$, we show that a variant of these approaches PAC-learns any hypothesis class $\mathcal{H}$ with VC-dimension $v$ in the $\gamma$-tolerant adversarial setting with $O\left(\frac{v(1+1/\gamma)^{O(d)}}{\varepsilon}\right)$ samples. This is in contrast to the traditional (non-tolerant) setting in which, as we show, the perturb-and-smooth approach can provably fail. Our second result shows that one can PAC-learn the same class using $\widetilde{O}\left(\frac{d.v\log(1+1/\gamma)}{\varepsilon^2}\right)$ samples even in the agnostic setting. This result is based on a novel compression-based algorithm, and achieves a linear dependence on the doubling dimension as well as the VC-dimension. This is in contrast to the non-tolerant setting where there is no known sample complexity upper bound that depend polynomially on the VC-dimension.


title: Conceptual Modeling of Events Based on One-Category Ontology

abstract: In previous works, we proposed a one-category (entitled thimac) conceptual model called a thinging machine (TM), which integrates staticity (e.g., objects) and dynamism (e.g., events) without losing valuable aspects of diagrammatic intuition in conceptual modeling. We proposed applying TM to conceptual modeling in software engineering (e.g., on or above the level of UML as a conceptual modeling language). In this paper, to show such an application in software engineering, we first present a complete high-level description of a library service system to demonstrate the TM s applicability. Furthermore, we explore the TM s features, emphasizing the realization of thimacs as events. The purpose is to develop better understanding of the TM notions by contrasting them with their uses in related fields. The notion of an event plays a prominent role in many fields of study, including philosophy, linguistics, literary theory, probability theory, artificial intelligence, physics, and history. A TM event is a static thimac with a time breath (time subthimac) that infuses dynamism into the thimac. It arises from how the TM static region is infected with time. Such a view is contrasted with some philosophical and linguistics definitions of an event (e.g., unit of experience of Whitehead). We also raise interesting issues (e.g., event movement) in this study.


title: Distributed Riemannian Optimization with Lazy Communication for Collaborative Geometric Estimation

abstract: We present the first distributed optimization algorithm with lazy communication for collaborative geometric estimation, the backbone of modern collaborative simultaneous localization and mapping (SLAM) and structure-from-motion (SfM) applications. Our method allows agents to cooperatively reconstruct a shared geometric model on a central server by fusing individual observations, but without the need to transmit potentially sensitive information about the agents themselves (such as their locations). Furthermore, to alleviate the burden of communication during iterative optimization, we design a set of communication triggering conditions that enable agents to selectively upload a targeted subset of local information that is useful to global optimization. Our approach thus achieves significant communication reduction with minimal impact on optimization performance. As our main theoretical contribution, we prove that our method converges to first-order critical points with a global sublinear convergence rate. Numerical evaluations on bundle adjustment problems from collaborative SLAM and SfM datasets show that our method performs competitively against existing distributed techniques, while achieving up to 78% total communication reduction.


title: Preserving multi-level quantum coherence by dynamical decoupling

abstract: Quantum information processing with multi-level systems (qudits) provides additional features and applications than the two-level systems. However, qudits are more prone to dephasing and dynamical decoupling for qudits has never been experimentally demonstrated. Here, as a proof-of-principle demonstration, we experimentally apply dynamical decoupling to protect superpositions with three levels of a trapped $^9\rm{Be}^+$ ion from ambient noisy magnetic field, prolonging coherence by up to approximately an order of magnitude. Our demonstration, straightforwardly scalable to more levels, may open up a path toward long coherence quantum memory, metrology and information processing with qudits.


title: Transfer Learning of High-Fidelity Opacity Spectra in Autoencoders and Surrogate Models

abstract: Simulations of high energy density physics are expensive, largely in part for the need to produce non-local thermodynamic equilibrium opacities. High-fidelity spectra may reveal new physics in the simulations not seen with low-fidelity spectra, but the cost of these simulations also scale with the level of fidelity of the opacities being used. Neural networks are capable of reproducing these spectra, but neural networks need data to to train them which limits the level of fidelity of the training data. This paper demonstrates that it is possible to reproduce high-fidelity spectra with median errors in the realm of 3\% to 4\% using as few as 50 samples of high-fidelity Krypton data by performing transfer learning on a neural network trained on many times more low-fidelity data.


title: FastFold: Reducing AlphaFold Training Time from 11 Days to 67 Hours

abstract: Protein structure prediction helps to understand gene translation and protein function, which is of growing interest and importance in structural biology. The AlphaFold model, which used transformer architecture to achieve atomic-level accuracy in protein structure prediction, was a significant breakthrough. However, training and inference of the AlphaFold model are challenging due to its high computation and memory cost. In this work, we present FastFold, an efficient implementation of AlphaFold for both training and inference. We propose Dynamic Axial Parallelism and Duality Async Operations to improve the scaling efficiency of model parallelism. Besides, AutoChunk is proposed to reduce memory cost by over 80% during inference by automatically determining the chunk strategy. Experimental results show that FastFold reduces overall training time from 11 days to 67 hours and achieves 7.5X - 9.5X speedup for long-sequence inference. Furthermore, we scale FastFold to 512 GPUs and achieve an aggregate throughput of 6.02 PetaFLOP/s with 90.1% parallel efficiency.


title: Reachability of turn sequences

abstract: A turn sequence of left and right turns is realized as a simple rectilinear chain of integral segments whose turns at its bends are the same as the turn sequence. The chain starts from the origin and ends at some point which we call a reachable point of the turn sequence. We investigate the combinatorial and geometric properties of the set of reachable points of a given turn sequence such as the shape, connectedness, and sufficient and necessary conditions on the reachability to the four signed axes. We also prove the upper and lower bounds on the maximum distance from the origin to the closest reachable point on signed axes for a turn sequence. The bounds are expressed in terms of the difference between the number of left and right turns in the sequence as well as, in certain cases, the length of the maximal monotone prefix or suffix of the turn sequence. The bounds are exactly matched or tight within additive constants for some signed axes.


title: E-Polynomials of Generic $\text{GL}_n\rtimes\!<\!\sigma\!>\!~$-Character Varieties: Unbranched Case

abstract: For any unbranched double covering of compact Riemann surfaces, we study the associated character varieties that are unitary in the global sense, which we call $\text{GL}_n\rtimes\!<\!\sigma\!>\!~$-character varieties. We introduce $k>0$ punctures on the surface, and restrict the monodromies around the punctures to generic semi-simple conjugacy classes in $\text{GL}_n$, and compute the E-polynomials of these character varieties using the character table of $\text{GL}_n(q)$. The result is expressed as the inner product of certain symmetric functions. We are then led to a conjectural formula for the mixed Hodge polynomial, which is built out of (modified) Macdonald polynomials, their self-pairings, and self-pairings of wreath Macdonald polynomials.


title: Yoneda Ext-algebras of Takeuchi smash products

abstract: We prove that the Yoneda Ext-algebra of a Takeuchi smash product is the graded Takeuchi smash product of the Yoneda Ext-algebras of the two algebras or modules involved. As an application, we prove that graded Takeuchi smash products preserve Artin-Schelter regularity, and describe the Nakayama automorphism of the product.


title: Physical Backdoor Attacks to Lane Detection Systems in Autonomous Driving

abstract: Modern autonomous vehicles adopt state-of-the-art DNN models to interpret the sensor data and perceive the environment. However, DNN models are vulnerable to different types of adversarial attacks, which pose significant risks to the security and safety of the vehicles and passengers. One prominent threat is the backdoor attack, where the adversary can compromise the DNN model by poisoning the training samples. Although lots of effort has been devoted to the investigation of the backdoor attack to conventional computer vision tasks, its practicality and applicability to the autonomous driving scenario is rarely explored, especially in the physical world. In this paper, we target the lane detection system, which is an indispensable module for many autonomous driving tasks, e.g., navigation, lane switching. We design and realize the first physical backdoor attacks to such system. Our attacks are comprehensively effective against different types of lane detection algorithms. Specifically, we introduce two attack methodologies (poison-annotation and clean-annotation) to generate poisoned samples. With those samples, the trained lane detection model will be infected with the backdoor, and can be activated by common objects (e.g., traffic cones) to make wrong detections, leading the vehicle to drive off the road or onto the opposite lane. Extensive evaluations on public datasets and physical autonomous vehicles demonstrate that our backdoor attacks are effective, stealthy and robust against various defense solutions. Our codes and experimental videos can be found in https://sites.google.com/view/lane-detection-attack/lda.


title: MixSTE: Seq2seq Mixed Spatio-Temporal Encoder for 3D Human Pose Estimation in Video

abstract: Recent transformer-based solutions have been introduced to estimate 3D human pose from 2D keypoint sequence by considering body joints among all frames globally to learn spatio-temporal correlation. We observe that the motions of different joints differ significantly. However, the previous methods cannot efficiently model the solid inter-frame correspondence of each joint, leading to insufficient learning of spatial-temporal correlation. We propose MixSTE (Mixed Spatio-Temporal Encoder), which has a temporal transformer block to separately model the temporal motion of each joint and a spatial transformer block to learn inter-joint spatial correlation. These two blocks are utilized alternately to obtain better spatio-temporal feature encoding. In addition, the network output is extended from the central frame to entire frames of the input video, thereby improving the coherence between the input and output sequences. Extensive experiments are conducted on three benchmarks (Human3.6M, MPI-INF-3DHP, and HumanEva). The results show that our model outperforms the state-of-the-art approach by 10.9% P-MPJPE and 7.6% MPJPE. The code is available at https://github.com/JinluZhang1126/MixSTE.


title: D^2ETR: Decoder-Only DETR with Computationally Efficient Cross-Scale Attention

abstract: DETR is the first fully end-to-end detector that predicts a final set of predictions without post-processing. However, it suffers from problems such as low performance and slow convergence. A series of works aim to tackle these issues in different ways, but the computational cost is yet expensive due to the sophisticated encoder-decoder architecture. To alleviate this issue, we propose a decoder-only detector called D^2ETR. In the absence of encoder, the decoder directly attends to the fine-fused feature maps generated by the Transformer backbone with a novel computationally efficient cross-scale attention module. D^2ETR demonstrates low computational complexity and high detection accuracy in evaluations on the COCO benchmark, outperforming DETR and its variants.