title: CLOSE: Curriculum Learning On the Sharing Extent Towards Better One-shot NAS

abstract: One-shot Neural Architecture Search (NAS) has been widely used to discover architectures due to its efficiency. However, previous studies reveal that one-shot performance estimations of architectures might not be well correlated with their performances in stand-alone training because of the excessive sharing of operation parameters (i.e., large sharing extent) between architectures. Thus, recent methods construct even more over-parameterized supernets to reduce the sharing extent. But these improved methods introduce a large number of extra parameters and thus cause an undesirable trade-off between the training costs and the ranking quality. To alleviate the above issues, we propose to apply Curriculum Learning On Sharing Extent (CLOSE) to train the supernet both efficiently and effectively. Specifically, we train the supernet with a large sharing extent (an easier curriculum) at the beginning and gradually decrease the sharing extent of the supernet (a harder curriculum). To support this training strategy, we design a novel supernet (CLOSENet) that decouples the parameters from operations to realize a flexible sharing scheme and adjustable sharing extent. Extensive experiments demonstrate that CLOSE can obtain a better ranking quality across different computational budget constraints than other one-shot supernets, and is able to discover superior architectures when combined with various search strategies. Code is available at https://github.com/walkerning/aw_nas.


title: CA-SpaceNet: Counterfactual Analysis for 6D Pose Estimation in Space

abstract: Reliable and stable 6D pose estimation of uncooperative space objects plays an essential role in on-orbit servicing and debris removal missions. Considering that the pose estimator is sensitive to background interference, this paper proposes a counterfactual analysis framework named CASpaceNet to complete robust 6D pose estimation of the spaceborne targets under complicated background. Specifically, conventional methods are adopted to extract the features of the whole image in the factual case. In the counterfactual case, a non-existent image without the target but only the background is imagined. Side effect caused by background interference is reduced by counterfactual analysis, which leads to unbiased prediction in final results. In addition, we also carry out lowbit-width quantization for CA-SpaceNet and deploy part of the framework to a Processing-In-Memory (PIM) accelerator on FPGA. Qualitative and quantitative results demonstrate the effectiveness and efficiency of our proposed method. To our best knowledge, this paper applies causal inference and network quantization to the 6D pose estimation of space-borne targets for the first time. The code is available at https://github.com/Shunli-Wang/CA-SpaceNet.


title: Scene Graph for Embodied Exploration in Cluttered Scenario

abstract: The ability to handle objects in cluttered environment has been long anticipated by robotic community. However, most of works merely focus on manipulation instead of rendering hidden semantic information in cluttered objects. In this work, we introduce the scene graph for embodied exploration in cluttered scenarios to solve this problem. To validate our method in cluttered scenario, we adopt the Manipulation Question Answering (MQA) tasks as our test benchmark, which requires an embodied robot to have the active exploration ability and semantic understanding ability of vision and language.As a general solution framework to the task, we propose an imitation learning method to generate manipulations for exploration. Meanwhile, a VQA model based on dynamic scene graph is adopted to comprehend a series of RGB frames from wrist camera of manipulator along with every step of manipulation is conducted to answer questions in our framework.The experiments on of MQA dataset with different interaction requirements demonstrate that our proposed framework is effective for MQA task a representative of tasks in cluttered scenario.


title: Characteristics of remnant radio galaxies detected in the deep radio continuum observations from the SKA pathfinders

abstract: The cessation of AGN activity in radio galaxies leads to a remnant phase during which jets are no longer sustained, but lobes can be detected for a period of time before they fade away due to radiative and dynamical energy losses. The time-scale of the remnant phase and AGN duty cycle are vital to understanding the evolution of radio galaxies. In this paper, we report new band-3 observations with the upgraded Giant Meterwave Radio Telescope (uGMRT) for five remnant radio galaxies. Our uGMRT observations reveal emission of low-surface-brightness in all five remnants with 400 MHz surface brightness in the range of 36$-$201 mJy arcmin$^{-2}$. With band-3 uGMRT observations, we discover wing-shaped radio morphology in one of our sample sources. Using radio observations at 150 MHz, 325 MHz, 400 MHz, and 1.5 GHz, we model the radio spectral energy distributions (SEDs) of our sample sources with the continuous injection-off model (CI$_{\rm OFF}$), that assumes an active phase with continuous injection followed by a remnant phase. We obtain total source ages ($t_{\rm s}$) in the range of 20.3 Myr to 41.4 Myr with $t_{\rm OFF}$/$t_{\rm s}$ distributed in the range of 0.16 to 0.63, which in turn suggests them to belong to different evolutionary phases. We note that, in comparison to the remnants reported in the literature, our sample sources tend to show lower spectral ages that can be explained by the combined effects of more dominant inverse Compton losses for our sources present at the relatively higher redshifts and possible rapid expansion of lobes in their less dense environments.


title: NeFSAC: Neurally Filtered Minimal Samples

abstract: Since RANSAC, a great deal of research has been devoted to improving both its accuracy and run-time. Still, only a few methods aim at recognizing invalid minimal samples early, before the often expensive model estimation and quality calculation are done. To this end, we propose NeFSAC, an efficient algorithm for neural filtering of motion-inconsistent and poorly-conditioned minimal samples. We train NeFSAC to predict the probability of a minimal sample leading to an accurate relative pose, only based on the pixel coordinates of the image correspondences. Our neural filtering model learns typical motion patterns of samples which lead to unstable poses, and regularities in the possible motions to favour well-conditioned and likely-correct samples. The novel lightweight architecture implements the main invariants of minimal samples for pose estimation, and a novel training scheme addresses the problem of extreme class imbalance. NeFSAC can be plugged into any existing RANSAC-based pipeline. We integrate it into USAC and show that it consistently provides strong speed-ups even under extreme train-test domain gaps - for example, the model trained for the autonomous driving scenario works on PhotoTourism too. We tested NeFSAC on more than 100k image pairs from three publicly available real-world datasets and found that it leads to one order of magnitude speed-up, while often finding more accurate results than USAC alone. The source code is available at https://github.com/cavalli1234/NeFSAC.


title: Mimetic Curvaton

abstract: In this paper, we investigate the primordial perturbations of inflation model induced from the multi-field mimetic gravity, where there are two field during inflation, and thus both adiabatic and isocurvature perturbation modes are generated. We show that although it is true that the original adiabatic perturbation mode loses the kinetic term due to the constraint equation, by applying the curvaton mechanism where one of the field is viewed as curvaton field, the adiabatic perturbation can actually be transferred from the isocurvature one at the end of inflation. Detailed calculations are performed for both inflationary and the consequent matter-dominant epochs. Therefore, the so-called "non-propagating problem" of the adiabatic mode will actually do no harm to the multi-field mimetic inflation models.


title: Model-Aware Contrastive Learning: Towards Escaping the Dilemmas

abstract: Contrastive learning (CL) continuously achieves significant breakthroughs across multiple domains. However, the most common InfoNCE-based methods suffer from some dilemmas, such as \textit{uniformity-tolerance dilemma} (UTD) and \textit{gradient reduction}, both of which are related to a $\mathcal{P}_{ij}$ term. It has been identified that UTD can lead to unexpected performance degradation. We argue that the fixity of temperature is to blame for UTD. To tackle this challenge, we enrich the CL loss family by presenting a Model-Aware Contrastive Learning (MACL) strategy, whose temperature is adaptive to the magnitude of alignment that reflects the basic confidence of the instance discrimination task, then enables CL loss to adjust the penalty strength for hard negatives adaptively. Regarding another dilemma, the gradient reduction issue, we derive the limits of an involved gradient scaling factor, which allows us to explain from a unified perspective why some recent approaches are effective with fewer negative samples, and summarily present a gradient reweighting to escape this dilemma. Extensive remarkable empirical results in vision, sentence, and graph modality validate our approach's general improvement for representation learning and downstream tasks.


title: On the Importance of Hyperparameters and Data Augmentation for Self-Supervised Learning

abstract: Self-Supervised Learning (SSL) has become a very active area of Deep Learning research where it is heavily used as a pre-training method for classification and other tasks. However, the rapid pace of advancements in this area comes at a price: training pipelines vary significantly across papers, which presents a potentially crucial confounding factor. Here, we show that, indeed, the choice of hyperparameters and data augmentation strategies can have a dramatic impact on performance. To shed light on these neglected factors and help maximize the power of SSL, we hyperparameterize these components and optimize them with Bayesian optimization, showing improvements across multiple datasets for the SimSiam SSL approach. Realizing the importance of data augmentations for SSL, we also introduce a new automated data augmentation algorithm, GroupAugment, which considers groups of augmentations and optimizes the sampling across groups. In contrast to algorithms designed for supervised learning, GroupAugment achieved consistently high linear evaluation accuracy across all datasets we considered. Overall, our results indicate the importance and likely underestimated role of data augmentation for SSL.


title: Anomalous universal adiabatic dynamics: The case of the Fredkin model

abstract: When a system is driven across a second-order quantum phase transition, the number of defects which are produced scales with the speed of the variation of the tuning parameter according to a universal law described by the Kibble-Zurek mechanism. We study a possible breakdown of this prediction proving that the number of defects can exhibit another universal scaling law which is still related only to the critical exponents $z$ and $\nu$, but differs from the Kibble-Zurek result. Finally we provide an example, the deformed Fredkin spin chain, where this violation of the standard adiabatic dynamics can occur.


title: Charge density wave and superconductivity in the kagome metal CsV$_3$Sb$_5$ around a pressure-induced quantum critical point

abstract: Using first-principles density functional theory calculations, we investigate the pressure-induced quantum phase transition (QPT) from the charge density wave (CDW) to the pristine phase in the layered kagome metal CsV$_3$Sb$_5$ consisting of three-atom-thick Sb$-$V$_3$Sb$-$Sb and one-atom-thick Cs layers. The CDW structure having the formation of trimeric and hexameric V atoms with buckled Sb honeycomb layers features an increase in the lattice parameter along the $c$ axis, compared to its counterpart pristine structure having the ideal V$_3$Sb kagome and planar Sb honeycomb layers. Consequently, as pressure increases, the relatively smaller volume of the pristine phase contributes to reducing the enthalpy difference between the CDW and pristine phases, yielding a pressure-induced QPT at a critical pressure $P_c$ of ${\sim}$2 GPa. Furthermore, we find that (i) the superconducting transition temperature $T_c$ increases around $P_c$ due to a phonon softening associated with the periodic lattice distortion of V trimers and hexamers and that (ii) above $P_c$, optical phonon modes are hardened with increasing pressure, leading to monotonous decreases in the electron-phonon coupling constant and $T_c$. Our findings not only demonstrate that the uniaxial strain along the $c$ axis plays an important role in the QPT observed in CsV$_3$Sb$_5$, but also provide an explanation for the observed superconductivity around $P_c$ in terms of a phonon-mediated superconducting mechanism.


title: TANSPEC: TIFR-ARIES Near Infrared Spectrometer

abstract: We present the design and performance of the TANSPEC, a medium-resolution $0.55-2.5~\mu$m cryogenic spectrometer and imager, now in operation at the 3.6-m Devasthal Optical Telescope (DOT), Nainital, India. The TANSPEC provides three modes of operation which include, photometry with broad- and narrow-band filters, spectroscopy with short slits of 20$^{\prime \prime}$ length and different widths (from 0.5$^{\prime \prime}$ to 4.0$^{\prime \prime}$) in cross-dispersed mode at a resolving power R of $\sim$2750, and spectroscopy with long slits of 60$^{\prime \prime}$ length and different widths (from 0.5$^{\prime \prime}$ to 4.0$^{\prime \prime}$) in prism mode at a resolving power R of $\sim$100-350. TANSPEC's imager mode provides a field of view of 60$^{\prime \prime} \times 60^{\prime \prime}$ with a plate scale of 0.245$^{\prime \prime}$/pixel on the 3.6-m DOT. The TANSPEC was successfully commissioned during April-May 2019 and the subsequent characterization and astronomical observations are presented here. The TANSPEC has been made available to the worldwide astronomical community for science observations from October 2020.


title: A Statistical Approach to Broken Stick Problems

abstract: Let a stick be broken at random at n-1 points to form n pieces. We consider three problems on forming k-gons with k out of these n pieces, and show how a statistical approach, through a linear transformation of variables, yields simple solutions that also allow fast computation.


title: Radio detection of an elusive millisecond pulsar in the Globular Cluster NGC 6397

abstract: We report the discovery of a new 5.78 ms-period millisecond pulsar (MSP), PSR J1740-5340B (NGC 6397B), in an eclipsing binary system discovered with the Parkes radio telescope (now also known as Murriyang), Australia, and confirmed with the MeerKAT radio telescope in South Africa. The measured orbital period, 1.97 days, is the longest among all eclipsing binaries in globular clusters (GCs) and consistent with that of the coincident X-ray source U18, previously suggested to be a 'hidden MSP'. Our XMM-Newton observations during NGC 6397B's radio quiescent epochs detected no X-ray flares. NGC 6397B is either a transitional MSP or an eclipsing binary in its initial stage of mass transfer after the companion star left the main sequence. The discovery of NGC 6397B potentially reveals a subgroup of extremely faint and heavily obscured binary pulsars, thus providing a plausible explanation to the apparent dearth of binary neutron stars in core-collapsed GCs as well as a critical constraint on the evolution of GCs.


title: NOCT: Nonlinear Observability with Constraints and Time Offset

abstract: Nonlinear systems of affine control inputs overarch many sensor fusion instances. Analyzing whether a state variable in such a nonlinear system can be estimated (i.e., observability) informs better estimator design. Among the research on local observability of nonlinear systems, approaches based on differential geometry have attracted much attention for the solid theoretic foundation and suitability to automated deduction. Such approaches usually work with a system model of unconstrained control inputs and assume that the control inputs and observation outputs are timestamped by the same clock. To our knowledge, it has not been shown how to conduct the observability analysis with additional constraints enforced on the system's observations or control inputs. To this end, we propose procedures to convert a system model of affine control inputs with linear constraints into a constraint-free standard model which is apt to be analyzed by the classic observability analysis procedure. Then, the whole analysis procedure is illustrated by applying to the well-studied visual inertial odometry (VIO) system which estimates the camera-IMU relative pose and time offset. The findings about unobservable variables under degenerate motion concur with those obtained with linearized VIO systems in other studies, whereas the findings about observability of time offset extend those in previous studies. These findings are further validated by simulation.


title: Non-Relativistic and Ultra-Relativistic Scaling Limits of Multimetric Gravity

abstract: We present a method of contraction that can be applied to re-construct the recent extended non-relativistic and ultra-relativistic algebras as well as corresponding action principles. The methodology involves the use of multiple copies of Poincar\'e algebra. Consequently, the contraction defines non-relativistic or ultra-relativistic limits of multimetric theories of gravity. In particular, we show that the non-relativistic scaling limit of bi-metric gravity corresponds to the recent formulation of an action principle for Newtonian gravity with a constant background mass density.


title: Neural modal ordinary differential equations: Integrating physics-based modeling with neural ordinary differential equations for modeling high-dimensional monitored structures

abstract: The order/dimension of models derived on the basis of data is commonly restricted by the number of observations, or in the context of monitored systems, sensing nodes. This is particularly true for structural systems (e.g., civil or mechanical structures), which are typically high-dimensional in nature. In the scope of physics-informed machine learning, this paper proposes a framework -- termed Neural Modal ODEs -- to integrate physics-based modeling with deep learning for modeling the dynamics of monitored and high-dimensional engineered systems. Neural Ordinary Differential Equations -- Neural ODEs are exploited as the deep learning operator. In this initiating exploration, we restrict ourselves to linear or mildly nonlinear systems. We propose an architecture that couples a dynamic version of variational autoencoders with physics-informed Neural ODEs (Pi-Neural ODEs). An encoder, as a part of the autoencoder, learns the abstract mappings from the first few items of observational data to the initial values of the latent variables, which drive the learning of embedded dynamics via physics-informed Neural ODEs, imposing a modal model structure on that latent space. The decoder of the proposed model adopts the eigenmodes derived from an eigen-analysis applied to the linearized portion of a physics-based model: a process implicitly carrying the spatial relationship between degrees-of-freedom (DOFs). The framework is validated on a numerical example, and an experimental dataset of a scaled cable-stayed bridge, where the learned hybrid model is shown to outperform a purely physics-based approach to modeling. We further show the functionality of the proposed scheme within the context of virtual sensing, i.e., the recovery of generalized response quantities in unmeasured DOFs from spatially sparse data.


title: Model-completeness for the lattice of finite unions of closed intervals of a dense linear order

abstract: Let I be a dense linear order with a left endpoint but no right endpoint. We consider the lattice L(I) of finite unions of closed intervals of I. This lattice arises naturally in the setting of o-minimality, as these are precisely the closed definable sets in any o-minimal expansion of I. Our main result says that L(I), the expansion of the lattice by constants for the empty set and the smallest element of I (viewed as a singleton subset) as well as four unary functions, is model-complete. The proof of the main result makes use of previous results regarding the weak monadic second order theory of I from the authors PhD thesis.


title: Clover: Towards A Unified Video-Language Alignment and Fusion Model

abstract: Building a universal Video-Language model for solving various video understanding tasks (\emph{e.g.}, text-video retrieval, video question answering) is an open challenge to the machine learning field. Towards this goal, most recent works build the model by stacking uni-modal and cross-modal feature encoders and train it with pair-wise contrastive pre-text tasks. Though offering attractive generality, the resulted models have to compromise between efficiency and performance. They mostly adopt different architectures to deal with different downstream tasks. We find this is because the pair-wise training cannot well \emph{align} and \emph{fuse} features from different modalities. We then introduce \textbf{Clover}\textemdash a Correlated Video-Language pre-training method\textemdash towards a universal Video-Language model for solving multiple video understanding tasks with neither performance nor efficiency compromise. It improves cross-modal feature alignment and fusion via a novel tri-modal alignment pre-training task. Additionally, we propose to enhance the tri-modal alignment via incorporating learning from semantic masked samples and a new pair-wise ranking loss. Clover establishes new state-of-the-arts on multiple downstream tasks, including three retrieval tasks for both zero-shot and fine-tuning settings, and eight video question answering tasks. Codes and pre-trained models will be released at \url{https://github.com/LeeYN-43/Clover}.


title: An Experimental Evaluation of Machine Learning Training on a Real Processing-in-Memory System

abstract: Training machine learning (ML) algorithms is a computationally intensive process, which is frequently memory-bound due to repeatedly accessing large training datasets. As a result, processor-centric systems (e.g., CPU, GPU) suffer from costly data movement between memory units and processing units, which consumes large amounts of energy and execution cycles. Memory-centric computing systems, i.e., with processing-in-memory (PIM) capabilities, can alleviate this data movement bottleneck. Our goal is to understand the potential of modern general-purpose PIM architectures to accelerate ML training. To do so, we (1) implement several representative classic ML algorithms (namely, linear regression, logistic regression, decision tree, K-Means clustering) on a real-world general-purpose PIM architecture, (2) rigorously evaluate and characterize them in terms of accuracy, performance and scaling, and (3) compare to their counterpart implementations on CPU and GPU. Our evaluation on a real memory-centric computing system with more than 2500 PIM cores shows that general-purpose PIM architectures can greatly accelerate memory-bound ML workloads, when the necessary operations and datatypes are natively supported by PIM hardware. For example, our PIM implementation of decision tree is $27\times$ faster than a state-of-the-art CPU version on an 8-core Intel Xeon, and $1.34\times$ faster than a state-of-the-art GPU version on an NVIDIA A100. Our K-Means clustering on PIM is $2.8\times$ and $3.2\times$ than state-of-the-art CPU and GPU versions, respectively. To our knowledge, our work is the first one to evaluate ML training on a real-world PIM architecture. We conclude with key observations, takeaways, and recommendations that can inspire users of ML workloads, programmers of PIM architectures, and hardware designers & architects of future memory-centric computing systems.


title: Approximation of semistable bundles on smooth algebraic varieties

abstract: We prove some strong results on approximation of strongly semistable bundles with vanishing numerical Chern classes by filtrations, whose quotients are line bundles of similar slope. This generalizes some earlier results of Parameswaran-Subramanian in the curve case and Koley-Parameswaran in the surface case and it confirms the conjecture posed by Koley and Parameswaran.


title: SizeShiftReg: a Regularization Method for Improving Size-Generalization in Graph Neural Networks

abstract: In the past few years, graph neural networks (GNNs) have become the de facto model of choice for graph classification. While, from the theoretical viewpoint, most GNNs can operate on graphs of any size, it is empirically observed that their classification performance degrades when they are applied on graphs with sizes that differ from those in the training data. Previous works have tried to tackle this issue in graph classification by providing the model with inductive biases derived from assumptions on the generative process of the graphs, or by requiring access to graphs from the test domain. The first strategy is tied to the quality of the assumptions made for the generative process, and requires the use of specific models designed after the explicit definition of the generative process of the data, leaving open the question of how to improve the performance of generic GNN models in general settings. On the other hand, the second strategy can be applied to any GNN, but requires access to information that is not always easy to obtain. In this work we consider the scenario in which we only have access to the training data, and we propose a regularization strategy that can be applied to any GNN to improve its generalization capabilities from smaller to larger graphs without requiring access to the test data. Our regularization is based on the idea of simulating a shift in the size of the training graphs using coarsening techniques, and enforcing the model to be robust to such a shift. Experimental results on standard datasets show that popular GNN models, trained on the 50% smallest graphs in the dataset and tested on the 10% largest graphs, obtain performance improvements of up to 30% when trained with our regularization strategy.


title: You Should Look at All Objects

abstract: Feature pyramid network (FPN) is one of the key components for object detectors. However, there is a long-standing puzzle for researchers that the detection performance of large-scale objects are usually suppressed after introducing FPN. To this end, this paper first revisits FPN in the detection framework and reveals the nature of the success of FPN from the perspective of optimization. Then, we point out that the degraded performance of large-scale objects is due to the arising of improper back-propagation paths after integrating FPN. It makes each level of the backbone network only has the ability to look at the objects within a certain scale range. Based on these analysis, two feasible strategies are proposed to enable each level of the backbone to look at all objects in the FPN-based detection frameworks. Specifically, one is to introduce auxiliary objective functions to make each backbone level directly receive the back-propagation signals of various-scale objects during training. The other is to construct the feature pyramid in a more reasonable way to avoid the irrational back-propagation paths. Extensive experiments on the COCO benchmark validate the soundness of our analysis and the effectiveness of our methods. Without bells and whistles, we demonstrate that our method achieves solid improvements (more than 2%) on various detection frameworks: one-stage, two-stage, anchor-based, anchor-free and transformer-based detectors.


title: Covariate Adjustment in Randomized Clinical Trials with Missing Covariate and Outcome Data

abstract: When analyzing data from randomized clinical trials, covariate adjustment can be used to account for chance imbalance in baseline covariates and to increase precision of the treatment effect estimate. A practical barrier to covariate adjustment is the presence of missing data. In this paper, in the light of recent theoretical advancement, we first review several covariate adjustment methods with incomplete covariate data. We investigate the implications of the missing data mechanism on estimating the average treatment effect in randomized clinical trials with continuous or binary outcomes. In parallel, we consider settings where the outcome data are fully observed or are missing at random; in the latter setting, we propose a full weighting approach that combines inverse probability weighting for adjusting missing outcomes and overlap weighting for covariate adjustment. We highlight the importance of including the interaction terms between the missingness indicators and covariates as predictors in the models. We conduct comprehensive simulation studies to examine the finite-sample performance of the proposed methods and compare with a range of common alternatives. We find that conducting the proposed adjustment methods generally improves the precision of treatment effect estimates regardless of the imputation methods when the adjusted covariate is associated with the outcome. We apply the methods to the Childhood Adenotonsillectomy Trial to assess the effect of adenotonsillectomy on neurocognitive functioning scores.


title: Accurate simulations of nonlinear dynamic shear ruptures on pre-existing faults in 3D elastic solids with dual-pairing SBP methods

abstract: In this paper we derive and analyse efficient and stable numerical methods for accurate numerical simulations of nonlinear dynamic shear ruptures on non-planar faults embedded in 3D elastic solids using dual-paring (DP) summation by parts (SBP) finite difference (FD) methods. Specifically, for nonlinear dynamic earthquake ruptures, we demonstrate that the DP SBP FD operators [K. Mattsson. J. Comput. Phys., 335:283-310, 2017] generate spurious catastrophic high frequency wave modes that do not diminish with mesh refinement. Meanwhile our new dispersion relation preserving (DRP) SBP FD operators [C. Williams and K Duru, arXiv:2110.04957, 2021] have more accurate numerical dispersion relation properties and do not support poisonous spurious high frequency wave modes. Numerical simulations are performed in 3D with geometrically complex fault surfaces verifying the efficacy of the method. Our method accurately reproduces community developed dynamic rupture benchmark problems, proposed by Southern California Earthquake Center, with less computational effort than standard methods based on traditional SBP FD operators.

categories: math.NA cs.NA physics.comp-ph physics.geo-ph


title: Abstract Key Polynomials and MacLane-Vaqui\'e chains

abstract: In this paper, for a valued field $(K, v)$ of arbitrary rank and an extension $w$ of $v$ to $K(X),$ a relation between induced complete sequences of abstract key polynomials and MacLane-Vaqui\'e chains is given.


title: Hypothetical Treatment Accelerations: Estimating Causal Effects of Kidney Transplants from Observational Data

abstract: Patients with end-stage kidney disease can expect to wait for several years before they receive a transplant, all the while their health deteriorates. How would the survival change if we managed to reduce these waiting times? To provide an answer, we present a continuous-time marginal structural model (MSM) of hypothetical scenarios in which the time until treatment is changed. In these scenarios, the treatment process is defined on a hypothetical time scale where time passes at a different rate compared to the time actually observed. Changing the time of the treatment process corresponds to changing the joint probability distribution, thereby making it possible to identify and estimate hypothetical parameters from observational data using previously developed methodology. We demonstrate this treatment-accelerated MSM using observational data from a Norwegian cohort of elderly patients with kidney failure. This model can potentially be useful to health authorities looking to assess the impacts of reducing the waiting times for organ transplantation in a given patient population.


title: Multi-Modal Unsupervised Pre-Training for Surgical Operating Room Workflow Analysis

abstract: Data-driven approaches to assist operating room (OR) workflow analysis depend on large curated datasets that are time consuming and expensive to collect. On the other hand, we see a recent paradigm shift from supervised learning to self-supervised and/or unsupervised learning approaches that can learn representations from unlabeled datasets. In this paper, we leverage the unlabeled data captured in robotic surgery ORs and propose a novel way to fuse the multi-modal data for a single video frame or image. Instead of producing different augmentations (or 'views') of the same image or video frame which is a common practice in self-supervised learning, we treat the multi-modal data as different views to train the model in an unsupervised manner via clustering. We compared our method with other state of the art methods and results show the superior performance of our approach on surgical video activity recognition and semantic segmentation.


title: JPerceiver: Joint Perception Network for Depth, Pose and Layout Estimation in Driving Scenes

abstract: Depth estimation, visual odometry (VO), and bird's-eye-view (BEV) scene layout estimation present three critical tasks for driving scene perception, which is fundamental for motion planning and navigation in autonomous driving. Though they are complementary to each other, prior works usually focus on each individual task and rarely deal with all three tasks together. A naive way is to accomplish them independently in a sequential or parallel manner, but there are many drawbacks, i.e., 1) the depth and VO results suffer from the inherent scale ambiguity issue; 2) the BEV layout is directly predicted from the front-view image without using any depth-related information, although the depth map contains useful geometry clues for inferring scene layouts. In this paper, we address these issues by proposing a novel joint perception framework named JPerceiver, which can simultaneously estimate scale-aware depth and VO as well as BEV layout from a monocular video sequence. It exploits the cross-view geometric transformation (CGT) to propagate the absolute scale from the road layout to depth and VO based on a carefully-designed scale loss. Meanwhile, a cross-view and cross-modal transfer (CCT) module is devised to leverage the depth clues for reasoning road and vehicle layout through an attention mechanism. JPerceiver can be trained in an end-to-end multi-task learning way, where the CGT scale loss and CCT module promote inter-task knowledge transfer to benefit feature learning of each task. Experiments on Argoverse, Nuscenes and KITTI show the superiority of JPerceiver over existing methods on all the above three tasks in terms of accuracy, model size, and inference speed. The code and models are available at~\href{https://github.com/sunnyHelen/JPerceiver}{https://github.com/sunnyHelen/JPerceiver}.


title: Cross Vision-RF Gait Re-identification with Low-cost RGB-D Cameras and mmWave Radars

abstract: Human identification is a key requirement for many applications in everyday life, such as personalized services, automatic surveillance, continuous authentication, and contact tracing during pandemics, etc. This work studies the problem of cross-modal human re-identification (ReID), in response to the regular human movements across camera-allowed regions (e.g., streets) and camera-restricted regions (e.g., offices) deployed with heterogeneous sensors. By leveraging the emerging low-cost RGB-D cameras and mmWave radars, we propose the first-of-its-kind vision-RF system for cross-modal multi-person ReID at the same time. Firstly, to address the fundamental inter-modality discrepancy, we propose a novel signature synthesis algorithm based on the observed specular reflection model of a human body. Secondly, an effective cross-modal deep metric learning model is introduced to deal with interference caused by unsynchronized data across radars and cameras. Through extensive experiments in both indoor and outdoor environments, we demonstrate that our proposed system is able to achieve ~92.5% top-1 accuracy and ~97.5% top-5 accuracy out of 56 volunteers. We also show that our proposed system is able to robustly reidentify subjects even when multiple subjects are present in the sensors' field of view.


title: Transfer learning for time series classification using synthetic data generation

abstract: In this paper, we propose an innovative Transfer learning for Time series classification method. Instead of using an existing dataset from the UCR archive as the source dataset, we generated a 15,000,000 synthetic univariate time series dataset that was created using our unique synthetic time series generator algorithm which can generate data with diverse patterns and angles and different sequence lengths. Furthermore, instead of using classification tasks provided by the UCR archive as the source task as previous studies did,we used our own 55 regression tasks as the source tasks, which produced better results than selecting classification tasks from the UCR archive


title: SPSN: Superpixel Prototype Sampling Network for RGB-D Salient Object Detection

abstract: RGB-D salient object detection (SOD) has been in the spotlight recently because it is an important preprocessing operation for various vision tasks. However, despite advances in deep learning-based methods, RGB-D SOD is still challenging due to the large domain gap between an RGB image and the depth map and low-quality depth maps. To solve this problem, we propose a novel superpixel prototype sampling network (SPSN) architecture. The proposed model splits the input RGB image and depth map into component superpixels to generate component prototypes. We design a prototype sampling network so that the network only samples prototypes corresponding to salient objects. In addition, we propose a reliance selection module to recognize the quality of each RGB and depth feature map and adaptively weight them in proportion to their reliability. The proposed method makes the model robust to inconsistencies between RGB images and depth maps and eliminates the influence of non-salient objects. Our method is evaluated on five popular datasets, achieving state-of-the-art performance. We prove the effectiveness of the proposed method through comparative experiments.


title: Adiabatic theory in Kerr spacetimes

abstract: We present the main aspects of the adiabatic theory and show that it can be used to study the motion of test particles in general relativity. The theory is based upon the use of vector elements of the orbits and adiabatic invariants. To prove the applicability of the adiabatic theory in Einstein's gravity, we derive a particular representation of the Kerr metric in harmonic coordinates, which allows us to obtain a general formula for the perihelion shift of test particles orbiting on the non-equatorial plane of a rotating central object. We show that the principle of superposition is fulfilled for the individual effects of the gravitational source mass and angular momentum up to the second order. We demonstrate that the adiabatic theory, along with its simplicity, leads to correct results, which in the limiting cases correspond to the ones reported in the literature.


title: Mutual Adaptive Reasoning for Monocular 3D Multi-Person Pose Estimation

abstract: Inter-person occlusion and depth ambiguity make estimating the 3D poses of monocular multiple persons as camera-centric coordinates a challenging problem. Typical top-down frameworks suffer from high computational redundancy with an additional detection stage. By contrast, the bottom-up methods enjoy low computational costs as they are less affected by the number of humans. However, most existing bottom-up methods treat camera-centric 3D human pose estimation as two unrelated subtasks: 2.5D pose estimation and camera-centric depth estimation. In this paper, we propose a unified model that leverages the mutual benefits of both these subtasks. Within the framework, a robust structured 2.5D pose estimation is designed to recognize inter-person occlusion based on depth relationships. Additionally, we develop an end-to-end geometry-aware depth reasoning method that exploits the mutual benefits of both 2.5D pose and camera-centric root depths. This method first uses 2.5D pose and geometry information to infer camera-centric root depths in a forward pass, and then exploits the root depths to further improve representation learning of 2.5D pose estimation in a backward pass. Further, we designed an adaptive fusion scheme that leverages both visual perception and body geometry to alleviate inherent depth ambiguity issues. Extensive experiments demonstrate the superiority of our proposed model over a wide range of bottom-up methods. Our accuracy is even competitive with top-down counterparts. Notably, our model runs much faster than existing bottom-up and top-down methods.


title: Computer Science

abstract: Possible for science itself, conceptually, to have and will understand differently, let alone science also seen as technology, such as computer science. After all, science and technology are viewpoints diverse by either individual, community, or social. Generally, it depends on socioeconomic capabilities. So it is with computer science has become a phenomenon and fashionable, where based on the stream of documents, various issues arise in either its theory or implementation, adapting different communities, or designing curriculum holds in the education system.


title: Linear stability of the slowly-rotating Kerr-de Sitter family

abstract: In this paper, we prove that the slowly-rotating Kerr-de Sitter family of black holes are linearly stable as a family of solutions to the Einstein vacuum equations with $\Lambda>0$ in harmonic (wave) gauge. This article is part of a series that provides a novel proof of the full nonlinear stability of the slowly-rotating Kerr-de Sitter family. This paper and its follow-up offer a self-contained alternative approach to nonlinear stability of the Kerr-de Sitter family from the original work of Hintz and Vasy by interpreting quasinormal modes as $H^k$ eigenvalues of an operator on a Hilbert space, and using integrated local energy decay estimates to prove the existence of a spectral gap. In particular, we avoid the construction of a meromorphic continuation of the resolvent. We also do not compactify the spacetime, thus avoiding the use of $b$-calculus and instead only use standard pseudo-differential arguments in a neighborhood of the trapped set; and avoid constraint damping altogether. The methods in the current paper offer an explicit example of how to use the vectorfield method to achieve resolvent estimates on a trapping background.


title: Unsupervised Ensemble Based Deep Learning Approach for Attack Detection in IoT Network

abstract: The Internet of Things (IoT) has altered living by controlling devices/things over the Internet. IoT has specified many smart solutions for daily problems, transforming cyber-physical systems (CPS) and other classical fields into smart regions. Most of the edge devices that make up the Internet of Things have very minimal processing power. To bring down the IoT network, attackers can utilise these devices to conduct a variety of network attacks. In addition, as more and more IoT devices are added, the potential for new and unknown threats grows exponentially. For this reason, an intelligent security framework for IoT networks must be developed that can identify such threats. In this paper, we have developed an unsupervised ensemble learning model that is able to detect new or unknown attacks in an IoT network from an unlabelled dataset. The system-generated labelled dataset is used to train a deep learning model to detect IoT network attacks. Additionally, the research presents a feature selection mechanism for identifying the most relevant aspects in the dataset for detecting attacks. The study shows that the suggested model is able to identify the unlabelled IoT network datasets and DBN (Deep Belief Network) outperform the other models with a detection accuracy of 97.5% and a false alarm rate of 2.3% when trained using labelled dataset supplied by the proposed approach.


title: Dimension reduction of noisy interacting systems

abstract: We consider a class of models describing an ensemble of identical interacting agents subject to multiplicative noise. In the thermodynamic limit, these systems exhibit continuous and discontinuous phase transitions in a, generally, nonequilibrium setting. We provide a systematic dimension reduction methodology for constructing low dimensional, reduced-order dynamics based on the cumulants of the probability distribution of the infinite system. We show that the low dimensional dynamics returns the correct diagnostic properties since it produces a quantitatively accurate representation of the stationary phase diagram of the system that we compare with exact analytical results and numerical simulations. Moreover, we prove that the reduced order dynamics yields also the prognostic, i.e., time dependent properties, as it provides the correct response of the system to external perturbations. On the one hand, this validates the use of our complexity reduction methodology since it retains information not only of the invariant measure of the system but also of the transition probabilities and time dependent correlation properties of the stochastic dynamics. On the other hand, the breakdown of linear response properties is a key signature of the occurrence of a phase transition. We show that the reduced response operators capture the correct diverging resonant behaviour by quantitatively assessing the singular nature of the susceptibility of the system and the appearance of a pole for real value of frequencies. Hence, this methodology can be interpreted as a low dimensional, reduced order approach to the investigation and detection of critical phenomena in high dimensional interacting systems in settings where order parameters are not known.

categories: cond-mat.stat-mech math-ph math.MP nlin.CD


title: Alternative entropies and consistent black hole thermodynamics

abstract: While the Bekenstein-Hawking entropy is the unique notion of entropy that makes classical black hole thermodynamics consistent, alternative entropy notions (R\'enyi, Tsallis, and generalized constructs) abound in the literature. We explore conditions under which they are part of a consistent horizon thermodynamics for certain classes of modified gravity black holes. We provide examples in which black hole masses and temperatures going hand-in-hand with these alternative entropies coincide with their usual counterparts associated with the Bekenstein-Hawking entropy.


title: Exploring stellar and ionized gas non--circular motions in barred galaxies with MUSE

abstract: We present MUSE integral field stellar and ionized velocity maps for a sample of 14 barred galaxies. Most of these objects exhibit "S"-shape iso-velocities in the bar region indicative of the presence of streaming motions in the velocity fields. % By applying circular rotation models we observe that bars leave symmetric structures in the residual maps of the stellar velocity. %which demonstrates the capabilities of the MUSE instrument for detecting kinematic bar signatures. % We built non-circular rotation models using the \xs~tool to characterize the observed velocity fields. In particular we adopt bisymmetric models and a harmonic decomposition for a bar potential for describing the non-axisymmetric velocities. We find that both models reproduce the observed kinematic features. % The position angle of the oval distortion estimated from the bisymmetric model correlates with the photometric bar position angle $(\rho_{pearson} = 0.95)$, which suggest that non-circular velocities are caused by the bar. However because of the low amplitudes of the $s_3$ harmonic we can not rule out radial flows as possible source. % Because of the weak detection of \ha~in our objects we are not able to compare gas to stellar non-circular motions in our sample, although we show that when galaxies are gas rich the oval distortion is also observed but with larger amplitudes. % Finally, we do not find evidence that the amplitude of the non-circular motions is dependent on the bar size, stellar mass or the global SFR.


title: Muon-Spin Motion at the Crossover Regime between Gaussian and Lorentzian Distribution of Magnetic Fields

abstract: The muon spin relaxation method ({\mu}SR) is a powerful microscopic tool to probe electronic states of materials observing local magnetic field distributions on the muon. It often happens that a distribution of local magnetic fields shows intermediate state between Gaussian and Lorentzian shapes. In order to generally describe intermediate field distributions, we dealt the convolution of two isotropic distributions in the three dimension and derived exact muon-spin relaxation functions which can be applied to all crossover regimes between the Gaussian and Lorentzian.


title: Multiscale Causal Structure Learning

abstract: The inference of causal structures from observed data plays a key role in unveiling the underlying dynamics of the system. This paper exposes a novel method, named Multiscale-Causal Structure Learning (MS-CASTLE), to estimate the structure of linear causal relationships occurring at different time scales. Differently from existing approaches, MS-CASTLE takes explicitly into account instantaneous and lagged inter-relations between multiple time series, represented at different scales, hinging on stationary wavelet transform and non-convex optimization. MS-CASTLE incorporates, as a special case, a single-scale version named SS-CASTLE, which compares favorably in terms of computational efficiency, performance and robustness with respect to the state of the art onto synthetic data. We used MS-CASTLE to study the multiscale causal structure of the risk of 15 global equity markets, during covid-19 pandemic, illustrating how MS-CASTLE can extract meaningful information thanks to its multiscale analysis, outperforming SS-CASTLE. We found that the most persistent and strongest interactions occur at mid-term time resolutions. Moreover, we identified the stock markets that drive the risk during the considered period: Brazil, Canada and Italy. The proposed approach can be exploited by financial investors who, depending to their investment horizon, can manage the risk within equity portfolios from a causal perspective.


title: Autonomous quantum clocks using athermal resources

abstract: Here we explore the possibility of precise time-keeping in quantum systems using athermal resources. We show that quantum measurement engineered reservoirs can be used as athermal resources to drive the ticks of a quantum clock. Two and three level quantum systems act as transducers in our model, converting the quantum measurement induced noise to produce a series of ticks. The ticking rate of the clock is maximized when the measured observable maximally non-commutes with the clock's Hamiltonian. We use the large deviation principle to characterize the statistics of observed ticks within a given time-period and show that it can be sub-Poissonian -- quantified by Mandel's Q parameter -- alluding to the quantum nature of the clock. We discuss the accuracy and efficiency of the clock, and extend our framework to include hybrid quantum clocks fueled by both measurements, and thermal resources. We make comparisons to relatable recent proposals for quantum clocks, and discuss alternate device implementations harvesting the quantum measurement engineered non-equilibrium conditions, beyond the clock realization.


title: Improving Multi-Interest Network with Stable Learning

abstract: Modeling users' dynamic preferences from historical behaviors lies at the core of modern recommender systems. Due to the diverse nature of user interests, recent advances propose the multi-interest networks to encode historical behaviors into multiple interest vectors. In real scenarios, the corresponding items of captured interests are usually retrieved together to get exposure and collected into training data, which produces dependencies among interests. Unfortunately, multi-interest networks may incorrectly concentrate on subtle dependencies among captured interests. Misled by these dependencies, the spurious correlations between irrelevant interests and targets are captured, resulting in the instability of prediction results when training and test distributions do not match. In this paper, we introduce the widely used Hilbert-Schmidt Independence Criterion (HSIC) to measure the degree of independence among captured interests and empirically show that the continuous increase of HSIC may harm model performance. Based on this, we propose a novel multi-interest network, named DEep Stable Multi-Interest Learning (DESMIL), which tries to eliminate the influence of subtle dependencies among captured interests via learning weights for training samples and make model concentrate more on underlying true causation. We conduct extensive experiments on public recommendation datasets, a large-scale industrial dataset and the synthetic datasets which simulate the out-of-distribution data. Experimental results demonstrate that our proposed DESMIL outperforms state-of-the-art models by a significant margin. Besides, we also conduct comprehensive model analysis to reveal the reason why DESMIL works to a certain extent.


title: Few-shot bioacoustic event detection at the DCASE 2022 challenge

abstract: Few-shot sound event detection is the task of detecting sound events, despite having only a few labelled examples of the class of interest. This framework is particularly useful in bioacoustics, where often there is a need to annotate very long recordings but the expert annotator time is limited. This paper presents an overview of the second edition of the few-shot bioacoustic sound event detection task included in the DCASE 2022 challenge. A detailed description of the task objectives, dataset, and baselines is presented, together with the main results obtained and characteristics of the submitted systems. This task received submissions from 15 different teams from which 13 scored higher than the baselines. The highest F-score was of 60% on the evaluation set, which leads to a huge improvement over last year's edition. Highly-performing methods made use of prototypical networks, transductive learning, and addressed the variable length of events from all target classes. Furthermore, by analysing results on each of the subsets we can identify the main difficulties that the systems face, and conclude that few-show bioacoustic sound event detection remains an open challenge.


title: A Reservoir Model of Explicit Human Intelligence

abstract: A fundamental feature of human intelligence is that we accumulate and transfer knowledge as a society and across generations. We describe here a network architecture for the human brain that may support this feature and suggest that two key innovations were the ability to consider an offline model of the world, and the use of language to record and communicate knowledge within this model. We propose that these two innovations, together with pre-existing mechanisms for associative learning, allowed us to develop a conceptually simple associative network that operates like a reservoir of attractors and can learn in a rapid, flexible, and robust manner. We hypothesize that explicit human intelligence is based primarily on this type of network, which works in conjunction with older and likely more complex deep networks that perform sensory, motor, and other implicit forms of processing.


title: Dual-branch Hybrid Learning Network for Unbiased Scene Graph Generation

abstract: The current studies of Scene Graph Generation (SGG) focus on solving the long-tailed problem for generating unbiased scene graphs. However, most de-biasing methods overemphasize the tail predicates and underestimate head ones throughout training, thereby wrecking the representation ability of head predicate features. Furthermore, these impaired features from head predicates harm the learning of tail predicates. In fact, the inference of tail predicates heavily depends on the general patterns learned from head ones, e.g., "standing on" depends on "on". Thus, these de-biasing SGG methods can neither achieve excellent performance on tail predicates nor satisfying behaviors on head ones. To address this issue, we propose a Dual-branch Hybrid Learning network (DHL) to take care of both head predicates and tail ones for SGG, including a Coarse-grained Learning Branch (CLB) and a Fine-grained Learning Branch (FLB). Specifically, the CLB is responsible for learning expertise and robust features of head predicates, while the FLB is expected to predict informative tail predicates. Furthermore, DHL is equipped with a Branch Curriculum Schedule (BCS) to make the two branches work well together. Experiments show that our approach achieves a new state-of-the-art performance on VG and GQA datasets and makes a trade-off between the performance of tail predicates and head ones. Moreover, extensive experiments on two downstream tasks (i.e., Image Captioning and Sentence-to-Graph Retrieval) further verify the generalization and practicability of our method.


title: Monolithic Integration of Embedded III-V Lasers on SOI

abstract: Silicon photonic integration has gained great success in many application fields owing to the excellent optical device properties and complementary metal-oxide semiconductor (CMOS) compatibility. Realizing monolithic integration of III-V lasers and silicon photonic components on single silicon wafer is recognized as a long-standing obstacle for ultra-dense photonic integration, which can provide considerable economical, energy efficient and foundry-scalable on-chip light sources, that has not been reported yet. Here, we demonstrate embedded InAs/GaAs quantum dot (QD) lasers directly grown on trenched silicon-on-insulator (SOI) substrate, enabling monolithic integration with butt-coupled silicon waveguides. By utilizing the patterned grating structures inside pre-defined SOI trenches and unique epitaxial method via molecular beam epitaxy (MBE), high-performance embedded InAs QD lasers with out-coupled silicon waveguide are achieved on such template. By resolving the epitaxy and fabrication challenges in such monolithic integrated architecture, embedded III-V lasers on SOI with continuous-wave lasing up to 85 oC are obtained. The maximum output power of 6.8 mW can be measured from the end tip of the butt-coupled silicon waveguides, with estimated coupling efficiency of approximately -7.35 dB. The results presented here provide a scalable and low-cost epitaxial method for realization of on-chip light sources directly coupling to the silicon photonic components for future high-density photonic integration.


title: On Curating Responsible and Representative Healthcare Video Recommendations for Patient Education and Health Literacy: An Augmented Intelligence Approach

abstract: Studies suggest that one in three US adults use the Internet to diagnose or learn about a health concern. However, such access to health information online could exacerbate the disparities in health information availability and use. Health information seeking behavior (HISB) refers to the ways in which individuals seek information about their health, risks, illnesses, and health-protective behaviors. For patients engaging in searches for health information on digital media platforms, health literacy divides can be exacerbated both by their own lack of knowledge and by algorithmic recommendations, with results that disproportionately impact disadvantaged populations, minorities, and low health literacy users. This study reports on an exploratory investigation of the above challenges by examining whether responsible and representative recommendations can be generated using advanced analytic methods applied to a large corpus of videos and their metadata on a chronic condition (diabetes) from the YouTube social media platform. The paper focusses on biases associated with demographic characters of actors using videos on diabetes that were retrieved and curated for multiple criteria such as encoded medical content and their understandability to address patient education and population health literacy needs. This approach offers an immense opportunity for innovation in human-in-the-loop, augmented-intelligence, bias-aware and responsible algorithmic recommendations by combining the perspectives of health professionals and patients into a scalable and generalizable machine learning framework for patient empowerment and improved health outcomes.


title: Efficient One Sided Kolmogorov Approximation

abstract: We present an efficient algorithm that, given a discrete random variable $X$ and a number $m$, computes a random variable whose support is of size at most $m$ and whose Kolmogorov distance from $X$ is minimal, also for the one-sided Kolmogorov approximation. We present some variants of the algorithm, analyse their correctness and computational complexity, and present a detailed empirical evaluation that shows how they performs in practice. The main application that we examine, which is our motivation for this work, is estimation of the probability missing deadlines in series-parallel schedules. Since exact computation of these probabilities is NP-hard, we propose to use the algorithms described in this paper to obtain an approximation.


title: Chimera: A Hybrid Machine Learning Driven Multi-Objective Design Space Exploration Tool for FPGA High-Level Synthesis

abstract: In recent years, hardware accelerators based on field-programmable gate arrays (FPGAs) have been widely adopted, thanks to FPGAs' extraordinary flexibility. However, with the high flexibility comes the difficulty in design and optimization. Conventionally, these accelerators are designed with low-level hardware descriptive languages, which means creating large designs with complex behavior is extremely difficult. Therefore, high-level synthesis (HLS) tools were created to simplify hardware designs for FPGAs. They enable the user to create hardware designs using high-level languages and provide various optimization directives to help to improve the performance of the synthesized hardware. However, applying these optimizations to achieve high performance is time-consuming and usually requires expert knowledge. To address this difficulty, we present an automated design space exploration tool for applying HLS optimization directives, called Chimera, which significantly reduces the human effort and expertise needed for creating high-performance HLS designs. It utilizes a novel multi-objective exploration method that seamlessly integrates active learning, evolutionary algorithm, and Thompson sampling, making it capable of finding a set of optimized designs on a Pareto curve with only a small number of design points evaluated during the exploration. In the experiments, in less than 24 hours, this hybrid method explored design points that have the same or superior performance compared to highly optimized hand-tuned designs created by expert HLS users from the Rosetta benchmark suite. In addition to discovering the extreme points, it also explores a Pareto frontier, where the elbow point can potentially save up to 26\% of Flip-Flop resource with negligibly higher latency.


title: Discriminative Kernel Convolution Network for Multi-Label Ophthalmic Disease Detection on Imbalanced Fundus Image Dataset

abstract: It is feasible to recognize the presence and seriousness of eye disease by investigating the progressions in retinal biological structure. Fundus examination is a diagnostic procedure to examine the biological structure and anomaly of the eye. Ophthalmic diseases like glaucoma, diabetic retinopathy, and cataract are the main reason for visual impairment around the world. Ocular Disease Intelligent Recognition (ODIR-5K) is a benchmark structured fundus image dataset utilized by researchers for multi-label multi-disease classification of fundus images. This work presents a discriminative kernel convolution network (DKCNet), which explores discriminative region-wise features without adding extra computational cost. DKCNet is composed of an attention block followed by a squeeze and excitation (SE) block. The attention block takes features from the backbone network and generates discriminative feature attention maps. The SE block takes the discriminative feature maps and improves channel interdependencies. Better performance of DKCNet is observed with InceptionResnet backbone network for multi-label classification of ODIR-5K fundus images with 96.08 AUC, 94.28 F1-score and 0.81 kappa score. The proposed method splits the common target label for an eye pair based on the diagnostic keyword. Based on these labels oversampling and undersampling is done to resolve class imbalance. To check the biasness of proposed model towards training data, the model trained on ODIR dataset is tested on three publicly available benchmark datasets. It is found to give good performance on completely unseen fundus images also.


title: Explainable vision transformer enabled convolutional neural network for plant disease identification: PlantXViT

abstract: Plant diseases are the primary cause of crop losses globally, with an impact on the world economy. To deal with these issues, smart agriculture solutions are evolving that combine the Internet of Things and machine learning for early disease detection and control. Many such systems use vision-based machine learning methods for real-time disease detection and diagnosis. With the advancement in deep learning techniques, new methods have emerged that employ convolutional neural networks for plant disease detection and identification. Another trend in vision-based deep learning is the use of vision transformers, which have proved to be powerful models for classification and other problems. However, vision transformers have rarely been investigated for plant pathology applications. In this study, a Vision Transformer enabled Convolutional Neural Network model called "PlantXViT" is proposed for plant disease identification. The proposed model combines the capabilities of traditional convolutional neural networks with the Vision Transformers to efficiently identify a large number of plant diseases for several crops. The proposed model has a lightweight structure with only 0.8 million trainable parameters, which makes it suitable for IoT-based smart agriculture services. The performance of PlantXViT is evaluated on five publicly available datasets. The proposed PlantXViT network performs better than five state-of-the-art methods on all five datasets. The average accuracy for recognising plant diseases is shown to exceed 93.55%, 92.59%, and 98.33% on Apple, Maize, and Rice datasets, respectively, even under challenging background conditions. The efficiency in terms of explainability of the proposed model is evaluated using gradient-weighted class activation maps and Local Interpretable Model Agnostic Explanation.


title: Physics Embedded Neural Network Vehicle Model and Applications in Risk-Aware Autonomous Driving Using Latent Features

abstract: Non-holonomic vehicle motion has been studied extensively using physics-based models. Common approaches when using these models interpret the wheel/ground interactions using a linear tire model and thus may not fully capture the nonlinear and complex dynamics under various environments. On the other hand, neural network models have been widely employed in this domain, demonstrating powerful function approximation capabilities. However, these black-box learning strategies completely abandon the existing knowledge of well-known physics. In this paper, we seamlessly combine deep learning with a fully differentiable physics model to endow the neural network with available prior knowledge. The proposed model shows better generalization performance than the vanilla neural network model by a large margin. We also show that the latent features of our model can accurately represent lateral tire forces without the need for any additional training. Lastly, We develop a risk-aware model predictive controller using proprioceptive information derived from the latent features. We validate our idea in two autonomous driving tasks under unknown friction, outperforming the baseline control framework.


title: CNN-based Euler's Elastica Inpainting with Deep Energy and Deep Image Prior

abstract: Euler's elastica constitute an appealing variational image inpainting model. It minimises an energy that involves the total variation as well as the level line curvature. These components are transparent and make it attractive for shape completion tasks. However, its gradient flow is a singular, anisotropic, and nonlinear PDE of fourth order, which is numerically challenging: It is difficult to find efficient algorithms that offer sharp edges and good rotation invariance. As a remedy, we design the first neural algorithm that simulates inpainting with Euler's Elastica. We use the deep energy concept which employs the variational energy as neural network loss. Furthermore, we pair it with a deep image prior where the network architecture itself acts as a prior. This yields better inpaintings by steering the optimisation trajectory closer to the desired solution. Our results are qualitatively on par with state-of-the-art algorithms on elastica-based shape completion. They combine good rotation invariance with sharp edges. Moreover, we benefit from the high efficiency and effortless parallelisation within a neural framework. Our neural elastica approach only requires 3x3 central difference stencils. It is thus much simpler than other well-performing algorithms for elastica inpainting. Last but not least, it is unsupervised as it requires no ground truth training data.


title: Learning Quality-aware Dynamic Memory for Video Object Segmentation

abstract: Recently, several spatial-temporal memory-based methods have verified that storing intermediate frames and their masks as memory are helpful to segment target objects in videos. However, they mainly focus on better matching between the current frame and the memory frames without explicitly paying attention to the quality of the memory. Therefore, frames with poor segmentation masks are prone to be memorized, which leads to a segmentation mask error accumulation problem and further affect the segmentation performance. In addition, the linear increase of memory frames with the growth of frame number also limits the ability of the models to handle long videos. To this end, we propose a Quality-aware Dynamic Memory Network (QDMN) to evaluate the segmentation quality of each frame, allowing the memory bank to selectively store accurately segmented frames to prevent the error accumulation problem. Then, we combine the segmentation quality with temporal consistency to dynamically update the memory bank to improve the practicability of the models. Without any bells and whistles, our QDMN achieves new state-of-the-art performance on both DAVIS and YouTube-VOS benchmarks. Moreover, extensive experiments demonstrate that the proposed Quality Assessment Module (QAM) can be applied to memory-based methods as generic plugins and significantly improves performance. Our source code is available at https://github.com/workforai/QDMN.


title: Composite Fermion Mass

abstract: Composite fermions (CFs), exotic quasi-particles formed by pairing an electron and an even number of magnetic flux quanta emerge at high magnetic fields in an interacting electron system, and can explain phenomena such as the fractional quantum Hall state (FQHS) and other many-body phases. CFs possess an effective mass ($m_{CF}$) whose magnitude is inversely related to the most fundamental property of a FQHS, namely its energy gap. We present here experimental measurements of $m_{CF}$ in ultra-high quality two-dimensional electron systems confined to GaAs quantum wells of varying thickness. An advantage of measuring $m_{CF}$ over gap measurements is that mass values are insensitive to disorder and are therefore ideal for comparison with theoretical calculations, especially for high-order FQHS. Our data reveal that $m_{CF}$ increases with increasing well width, reflecting a decrease in the energy gap as the electron layer becomes thicker and the in-plane Coulomb energy softens. Comparing our measured masses with available theoretical results, we find significant quantitative discrepancies, highlighting that more rigorous and accurate calculations are needed to explain the experimental data.


title: Quantum Noise-Induced Reservoir Computing

abstract: Quantum computing has been moving from a theoretical phase to practical one, presenting daunting challenges in implementing physical qubits, which are subjected to noises from the surrounding environment. These quantum noises are ubiquitous in quantum devices and generate adverse effects in the quantum computational model, leading to extensive research on their correction and mitigation techniques. But do these quantum noises always provide disadvantages? We tackle this issue by proposing a framework called quantum noise-induced reservoir computing and show that some abstract quantum noise models can induce useful information processing capabilities for temporal input data. We demonstrate this ability in several typical benchmarks and investigate the information processing capacity to clarify the framework's processing mechanism and memory profile. We verified our perspective by implementing the framework in a number of IBM quantum processors and obtained similar characteristic memory profiles with model analyses. As a surprising result, information processing capacity increased with quantum devices' higher noise levels and error rates. Our study opens up a novel path for diverting useful information from quantum computer noises into a more sophisticated information processor.


title: Three-dimensional numerical simulations of structured GRB jets

abstract: After the detection of GRB 170817A, the first unambiguous off-axis gamma-ray burst (GRB), several studies tried to understand the structure of GRB jets. The initial jet structure (directly produced by the central engine) can be partially preserved, or can be completely modified by the interaction with the environment. In this study, we perform three-dimensional, special relativistic hydrodynamics simulations of long GRB jets evolving through a massive progenitor star. Different jet scenarios were considered: Top-hat, Gaussian jets dominated by pressure or by kinetic energy, as well as a model of a supernova (SN) plus a jet both propagating through the progenitor. We found that, while propagating inside the progenitor star, jets with different initial structures are nearly indistinguishable. Kinetic dominated jets are faster and more collimated than pressure dominated jets. The dynamics of jets inside the progenitor star strongly depends on the presence of an associated SN, which can substantially decelerate the jet propagation. We show that the initial structure of GRB jets is preserved, or not, mainly depending on the jet collimation. The initial structure is preserved in uncollimated jets, i.e. jets which move through low density environments. Meanwhile, jets which move through dense environments are shaped by the interaction with the medium and remain collimated.


title: Estimation of the on-site Coulomb potential 1 and covalent state in La2CuO4 by muon spin rotation 2 and density functional theory calculations

abstract: The on-site Coulomb potential, U, and the covalent state of electronic orbitals play key roles for the Cooper pair symmetry and exotic electromagnetic properties of high-Tc superconducting cuprates. In this paper, we demonstrate a way to determine the value of U and present the whole picture of the covalent state of Cu spins in the mother system of the La-based high-Tc superconducting cuprate, La2CuO4, by combining the muon spin rotation ({\mu}SR) and the density functional theory (DFT) calculation. We reveal local deformations of the CuO6 octahedron followed by changes in Cu-spin distributions caused by the injected muon. Adjusting the DFT and muSR results, U and the minimum charge-transfer energy between the upper Hubbard band and the O 2p band were optimized to be 4.87(4) and 1.24(1) eV, respectively.


title: Delamination from an adhesive sphere: Curvature-induced dewetting versus buckling

abstract: Everyday experience confirms the tendency of adhesive films to detach from spheroidal regions of rigid substrates -- what is a petty frustration when placing a sticky bandage onto an elbow or knee is a more serious matter in the coating and painting industries. Irrespective of their resistance to bending, a key driver of such phenomena is Gauss' \textit{Theorema Egregium}, which implies that naturally flat sheets cannot conform to doubly-curved surfaces without developing a strain whose magnitude grows sharply with the curved area. Previous attempts to characterize the onset of curvature-induced delamination, and the complex patterns it gives rise to, assumed a dewetting-like mechanism in which the propensity of two materials to form contact through interfacial energy is modified by an elastic energy penalty. We show that this approach may characterize moderately bendable adhesive sheets, but fails qualitatively to describe the curvature-induced delamination of ultrathin films, whose mechanics is governed by their propensity to buckle under minute levels of compression. Combining mechanical and geometrical considerations, we introduce a minimal model for curvature-induced delamination that accounts for two elementary buckling motifs, shallow "rucks" and localized "folds". We predict nontrivial scaling rules for the onset of curvature-induced delamination and various features of the emerging patterns, which compare well with experimental observations. Beyond gaining control on the use of ultrathin adhesives in cutting edge technologies such as stretchable electronics, our analysis is a significant step towards quantifying the multiscale morphological complexity that emerges upon imposing geometrical and mechanical constraints on highly bendable solid objects.


title: Elastocapillary Worthington jets

abstract: The retraction of an impacting droplet on a non-wetting substrate is often associated with the formation of a Worthington jet, which is fed by the retracting liquid. A non-Newtonian rheology of the liquid is known to affect the retraction of the impacting droplet. Here we present a novel phenomenon related to the impact of viscoelastic droplets on non-wettable substrates. We reveal that the viscoelasticity of the liquid results in an \emph{elastocapillary} regime in the stretching Worthington jet, distinguished by a pinned contact line and a slender jet that does not detach from the droplet. We identify the impact conditions, in the Weber number -- Deborah number phase space, for observing these \emph{elastocapillary} Worthington jets. Such jets exhibit an effectively nearly linear (in time) variation of the strain rate. Upon further extension, the jet exhibits beads-on-a-string structures, characteristic of the \emph{elastocapillary} thinning of slender viscoelastic liquid filaments. The \emph{elastocapillary} Worthington jet is not only relevant for a droplet impact on a solid substrate scenario, but can also be expected in other configurations where a Worthington jet is observed for viscoelastic liquids, such as drop impact on a liquid pool and bubble bursting at an interface.


title: Towards Lightweight Super-Resolution with Dual Regression Learning

abstract: Deep neural networks have exhibited remarkable performance in image super-resolution (SR) tasks by learning a mapping from low-resolution (LR) images to high-resolution (HR) images. However, the SR problem is typically an ill-posed problem and existing methods would come with several limitations. First, the possible mapping space of SR can be extremely large since there may exist many different HR images that can be super-resolved from the same LR image. As a result, it is hard to directly learn a promising SR mapping from such a large space. Second, it is often inevitable to develop very large models with extremely high computational cost to yield promising SR performance. In practice, one can use model compression techniques to obtain compact models by reducing model redundancy. Nevertheless, it is hard for existing model compression methods to accurately identify the redundant components due to the extremely large SR mapping space. To alleviate the first challenge, we propose a dual regression learning scheme to reduce the space of possible SR mappings. Specifically, in addition to the mapping from LR to HR images, we learn an additional dual regression mapping to estimate the downsampling kernel and reconstruct LR images. In this way, the dual mapping acts as a constraint to reduce the space of possible mappings. To address the second challenge, we propose a dual regression compression (DRC) method to reduce model redundancy in both layer-level and channel-level based on channel pruning. Specifically, we first develop a channel number search method that minimizes the dual regression loss to determine the redundancy of each layer. Given the searched channel numbers, we further exploit the dual regression manner to evaluate the importance of channels and prune the redundant ones. Extensive experiments show the effectiveness of our method in obtaining accurate and efficient SR models.


title: Spatial and temporal correlations in neural networks with structured connectivity

abstract: Correlated fluctuations in the activity of neural populations reflect the network's dynamics and connectivity. The temporal and spatial dimensions of neural correlations are interdependent. However, prior theoretical work mainly analyzed correlations in either spatial or temporal domains, oblivious to their interplay. We show that the network dynamics and connectivity jointly define the spatiotemporal profile of neural correlations. We derive analytical expressions for pairwise correlations in networks of binary units with spatially arranged connectivity in one and two dimensions. We find that spatial interactions among units generate multiple timescales in auto- and cross-correlations. Each timescale is associated with fluctuations at a particular spatial frequency, making a hierarchical contribution to the correlations. External inputs can modulate the correlation timescales when spatial interactions are nonlinear, and the modulation effect depends on the operating regime of network dynamics. These theoretical results open new ways to relate connectivity and dynamics in cortical networks via measurements of spatiotemporal neural correlations.


title: Learnable Mixed-precision and Dimension Reduction Co-design for Low-storage Activation

abstract: Recently, deep convolutional neural networks (CNNs) have achieved many eye-catching results. However, deploying CNNs on resource-constrained edge devices is constrained by limited memory bandwidth for transmitting large intermediated data during inference, i.e., activation. Existing research utilizes mixed-precision and dimension reduction to reduce computational complexity but pays less attention to its application for activation compression. To further exploit the redundancy in activation, we propose a learnable mixed-precision and dimension reduction co-design system, which separates channels into groups and allocates specific compression policies according to their importance. In addition, the proposed dynamic searching technique enlarges search space and finds out the optimal bit-width allocation automatically. Our experimental results show that the proposed methods improve 3.54%/1.27% in accuracy and save 0.18/2.02 bits per value over existing mixed-precision methods on ResNet18 and MobileNetv2, respectively.


title: Semi-Supervised Keypoint Detector and Descriptor for Retinal Image Matching

abstract: For retinal image matching (RIM), we propose SuperRetina, the first end-to-end method with jointly trainable keypoint detector and descriptor. SuperRetina is trained in a novel semi-supervised manner. A small set of (nearly 100) images are incompletely labeled and used to supervise the network to detect keypoints on the vascular tree. To attack the incompleteness of manual labeling, we propose Progressive Keypoint Expansion to enrich the keypoint labels at each training epoch. By utilizing a keypoint-based improved triplet loss as its description loss, SuperRetina produces highly discriminative descriptors at full input image size. Extensive experiments on multiple real-world datasets justify the viability of SuperRetina. Even with manual labeling replaced by auto labeling and thus making the training process fully manual-annotation free, SuperRetina compares favorably against a number of strong baselines for two RIM tasks, i.e. image registration and identity verification. SuperRetina will be open source.


title: Consistency of Implicit and Explicit Features Matters for Monocular 3D Object Detection

abstract: Low-cost autonomous agents including autonomous driving vehicles chiefly adopt monocular 3D object detection to perceive surrounding environment. This paper studies 3D intermediate representation methods which generate intermediate 3D features for subsequent tasks. For example, the 3D features can be taken as input for not only detection, but also end-to-end prediction and/or planning that require a bird's-eye-view feature representation. In the study, we found that in generating 3D representation previous methods do not maintain the consistency between the objects' implicit poses in the latent space, especially orientations, and the explicitly observed poses in the Euclidean space, which can substantially hurt model performance. To tackle this problem, we present a novel monocular detection method, the first one being aware of the poses to purposefully guarantee that they are consistent between the implicit and explicit features. Additionally, we introduce a local ray attention mechanism to efficiently transform image features to voxels at accurate 3D locations. Thirdly, we propose a handcrafted Gaussian positional encoding function, which outperforms the sinusoidal encoding function while retaining the benefit of being continuous. Results show that our method improves the state-of-the-art 3D intermediate representation method by 3.15%. We are ranked 1st among all the reported monocular methods on both 3D and BEV detection benchmark on KITTI leaderboard as of th result's submission time.


title: Multimodal Dialog Systems with Dual Knowledge-enhanced Generative Pretrained Language Model

abstract: Text response generation for multimodal task-oriented dialog systems, which aims to generate the proper text response given the multimodal context, is an essential yet challenging task. Although existing efforts have achieved compelling success, they still suffer from two pivotal limitations: 1) overlook the benefit of generative pre-training, and 2) ignore the textual context related knowledge. To address these limitations, we propose a novel dual knowledge-enhanced generative pretrained language model for multimodal task-oriented dialog systems (DKMD), consisting of three key components: dual knowledge selection, dual knowledge-enhanced context learning, and knowledge-enhanced response generation. To be specific, the dual knowledge selection component aims to select the related knowledge according to both textual and visual modalities of the given context. Thereafter, the dual knowledge-enhanced context learning component targets seamlessly integrating the selected knowledge into the multimodal context learning from both global and local perspectives, where the cross-modal semantic relation is also explored. Moreover, the knowledge-enhanced response generation component comprises a revised BART decoder, where an additional dot-product knowledge-decoder attention sub-layer is introduced for explicitly utilizing the knowledge to advance the text response generation. Extensive experiments on a public dataset verify the superiority of the proposed DKMD over state-of-the-art competitors.


title: Visually-aware Acoustic Event Detection using Heterogeneous Graphs

abstract: Perception of auditory events is inherently multimodal relying on both audio and visual cues. A large number of existing multimodal approaches process each modality using modality-specific models and then fuse the embeddings to encode the joint information. In contrast, we employ heterogeneous graphs to explicitly capture the spatial and temporal relationships between the modalities and represent detailed information about the underlying signal. Using heterogeneous graph approaches to address the task of visually-aware acoustic event classification, which serves as a compact, efficient and scalable way to represent data in the form of graphs. Through heterogeneous graphs, we show efficiently modelling of intra- and inter-modality relationships both at spatial and temporal scales. Our model can easily be adapted to different scales of events through relevant hyperparameters. Experiments on AudioSet, a large benchmark, shows that our model achieves state-of-the-art performance.


title: Lagrangian extensions of multi-dimensional integrable equations. I. The five-dimensional Mart{\'{\i}}nez Alonso--Shabat equation

abstract: We study a Lagrangian extension of the 5d Mart\'inez Alonso--Shabat equation $\mathcal{E}$ \begin{equation*} u_{yz}=u_{tx}+u_y\,u_{xs}-u_x\,u_{ys} \end{equation*} that coincides with the cotangent equation $\mathcal{T^*E}$ to the latter. We describe the Lie algebra structure of its symmetries (which happens to be quite nontrivial and is described in terms of deformations) and construct two families of recursion operators for symmetries. Each family depends on two parameters. We prove that all the operators from the first family are hereditary, but not compatible in the sense of the Nijenhuis bracket. We also construct two new parametric Lax pairs that depend on higher-order derivatives of the unknown functions.


title: From Curious Hashtags to Polarized Effect: Profiling Coordinated Actions in Indonesian Twitter Discourse

abstract: Coordinated campaigns in the digital realm have become an increasingly important area of study due to their potential to cause political polarization and threats to security through real-world protests and riots. In this paper, we introduce a methodology to profile two case studies of coordinated actions in Indonesian Twitter discourse. Combining network and narrative analysis techniques, this six-step pipeline begins with DISCOVERY of coordinated actions through hashtag-hijacking; identifying WHO are involved through the extraction of discovered agents; framing of what these actors did (DID WHAT) in terms of information manipulation maneuvers; TO WHOM these actions were targeted through correlation analysis; understanding WHY through narrative analysis and description of IMPACT through analysis of the observed conversation polarization. We describe two case studies, one international and one regional, in the Indonesian Twittersphere. Through these case studies, we unearth two seemingly related coordinated activities, discovered by deviating hashtags that do not fit the discourse, characterize the coordinated group profile and interaction, and describe the impact of their activity on the online conversation.


title: Generic properties of l_p-contractions and similar operator topologies

abstract: If $X$ is a separable reflexive Banach space, there are several natural Polish topologies on $\mathcal{B}(X)$, the set of contraction operators on $X$ (none of which being clearly ``more natural'' than the others), and hence several a priori different notions of genericity -- in the Baire category sense -- for properties of contraction operators. So it makes sense to investigate to which extent the generic properties, i.e. the comeager sets, really depend on the chosen topology on $\mathcal{B}(X)$. In this paper, we focus on $\ell_p\,$-$\,$spaces, $1<p\neq 2<\infty$. We show that for some pairs of natural Polish topologies on $\mathcal B_1(\ell_p)$, the comeager sets are in fact the same; and our main result asserts that for $p=3$ or $3/2$ and in the real case, all topologies on $\mathcal B_1(\ell_p)$ lying between the Weak Operator Topology and the Strong$^*$ Operator Topology share the same comeager sets. Our study relies on the consideration of continuity points of the identity map for two different topologies on $\mathcal{B}_1 (\ell_p)$. The other essential ingredient in the proof of our main result is a careful examination of norming vectors for finite-dimensional contractions of a special type.


title: Two Comments on the Derivation of the Time-Dependent Hartree-Fock Equation

abstract: We revisit the derivation of the time-dependent Hartree-Fock equation for interacting fermions in a regime coupling a mean-field and a semiclassical scaling, contributing two comments to the result obtained in 2014 by Benedikter, Porta, and Schlein. First, the derivation holds in arbitrary space dimension. Second, by using an explicit formula for the unitary implementation of particle-hole transformations, we cast the proof in a form similar to the coherent state method of Rodnianski and Schlein for bosons.


title: HQANN: Efficient and Robust Similarity Search for Hybrid Queries with Structured and Unstructured Constraints

abstract: The in-memory approximate nearest neighbor search (ANNS) algorithms have achieved great success for fast high-recall query processing, but are extremely inefficient when handling hybrid queries with unstructured (i.e., feature vectors) and structured (i.e., related attributes) constraints. In this paper, we present HQANN, a simple yet highly efficient hybrid query processing framework which can be easily embedded into existing proximity graph-based ANNS algorithms. We guarantee both low latency and high recall by leveraging navigation sense among attributes and fusing vector similarity search with attribute filtering. Experimental results on both public and in-house datasets demonstrate that HQANN is 10x faster than the state-of-the-art hybrid ANNS solutions to reach the same recall quality and its performance is hardly affected by the complexity of attributes. It can reach 99\% recall@10 in just around 50 microseconds On GLOVE-1.2M with thousands of attribute constraints.


title: MixTailor: Mixed Gradient Aggregation for Robust Learning Against Tailored Attacks

abstract: Implementations of SGD on distributed systems create new vulnerabilities, which can be identified and misused by one or more adversarial agents. Recently, it has been shown that well-known Byzantine-resilient gradient aggregation schemes are indeed vulnerable to informed attackers that can tailor the attacks (Fang et al., 2020; Xie et al., 2020b). We introduce MixTailor, a scheme based on randomization of the aggregation strategies that makes it impossible for the attacker to be fully informed. Deterministic schemes can be integrated into MixTailor on the fly without introducing any additional hyperparameters. Randomization decreases the capability of a powerful adversary to tailor its attacks, while the resulting randomized aggregation scheme is still competitive in terms of performance. For both iid and non-iid settings, we establish almost sure convergence guarantees that are both stronger and more general than those available in the literature. Our empirical studies across various datasets, attacks, and settings, validate our hypothesis and show that MixTailor successfully defends when well-known Byzantine-tolerant schemes fail.


title: Observation of magnetism induced topological edge state in antiferromagnetic topological insulator MnBi4Te7

abstract: Breaking time reversal symmetry in a topological insulator may lead to quantum anomalous Hall effect and axion insulator phase. MnBi4Te7 is a recently discovered antiferromagnetic topological insulator with TN ~12.5 K, which is constituted of alternatively stacked magnetic layer (MnBi2Te4) and non-magnetic layer (Bi2Te3). By means of scanning tunneling spectroscopy, we clearly observe the electronic state present at a step edge of a magnetic MnBi2Te4 layer but absent at non-magnetic Bi2Te3 layers at 4.5 K. Furthermore, we find that as the temperature rises above TN, the edge state vanishes, while the point defect induced state persists upon temperature increasing. These results confirm the observation of magnetism induced edge states. Our analysis based on an axion insulator theory reveals that the nontrivial topological nature of the observed edge state.


title: The 3-loop anomalous dimensions from off-shell operator matrix elements

abstract: We report on the calculation of the three-loop polarized and unpolarized flavor non-singlet and the polarized singlet anomalous dimensions using massless off-shell operator matrix elements in a gauge-variant framework. We also reconsider the unpolarized two-loop singlet anomalous dimensions and correct errors in the foregoing literature.


title: On a lower bound of Hausdorff dimension of weighted singular vectors

abstract: Let $w=(w_1,\dots,w_d)$ be a $d$-tuple of positive real numbers such that $\sum_{i}w_i =1$ and $w_1\geq \cdots \geq w_d$. A $d$-dimensional vector $x=(x_1,\dots,x_d)\in\mathbb{R}^d$ is said to be $w$-singular if for every $\epsilon>0$ there exists $T_0>1$ such that for all $T>T_0$ the system of inequalities \[ \max_{1\leq i\leq d}|qx_i - p_i|^{\frac{1}{w_i}} < \frac{\epsilon}{T} \quad\text{and}\quad 0<q<T \] have an integer solution $(\mathbf{p},q)=(p_1,\dots,p_d,q)\in \mathbb{Z}^d \times \mathbb{Z}$. We prove that the Hausdorff dimension of the set of $w$-singular vectors in $\mathbb{R}^d$ is bounded below by $d-\frac{1}{1+w_1}$. Our result partially extends the previous result of Liao et al. [Hausdorff dimension of weighted singular vectors in $\mathbb{R}^2$, J. Eur. Math. Soc. 22 (2020), 833-875].