title: Degrade is Upgrade: Learning Degradation for Low-light Image Enhancement

abstract: Low-light image enhancement aims to improve an image's visibility while keeping its visual naturalness. Different from existing methods tending to accomplish the relighting task directly by ignoring the fidelity and naturalness recovery, we investigate the intrinsic degradation and relight the low-light image while refining the details and color in two steps. Inspired by the color image formulation (diffuse illumination color plus environment illumination color), we first estimate the degradation from low-light inputs to simulate the distortion of environment illumination color, and then refine the content to recover the loss of diffuse illumination color. To this end, we propose a novel Degradation-to-Refinement Generation Network (DRGN). Its distinctive features can be summarized as 1) A novel two-step generation network for degradation learning and content refinement. It is not only superior to one-step methods, but also capable of synthesizing sufficient paired samples to benefit the model training; 2) A multi-resolution fusion network to represent the target information (degradation or contents) in a multi-scale cooperative manner, which is more effective to address the complex unmixing problems. Extensive experiments on both the enhancement task and joint detection task have verified the effectiveness and efficiency of our proposed method, surpassing the SOTA by \textit{0.70dB on average and 3.18\% in mAP}, respectively. The code is available at \url{https://github.com/kuijiang0802/DRGN}.


abstract: In this paper, we mainly show that Euler sums of generalized hyperharmonic numbers can be expressed in terms of linear combinations of the classical Euler sums.


title: An Ontological Analysis of a Proposed Theory for Software Development

abstract: There is growing acknowledgement within the software engineering community that a theory of software development is needed to integrate the myriad methodologies that are currently popular, some of which are based on opposing perspectives. We have been developing such a theory for a number of years. In this paper, we overview our theory and report on a recent ontological analysis of the theory constructs. We suggest that, once fully developed, this theory, or one similar to it, may be applied to support situated software development, by providing an overarching model within which software initiatives might be categorised and understood. Such understanding would inevitably lead to greater predictability with respect to outcomes.


title: Model-based Reconstruction for Enhanced X-ray CT of Tri-structural Isotropic (TRISO) Particles

abstract: Tri-Structural Isotropic (TRISO) fuel particles are a key component of next generation nuclear fuels. Using X-ray computed tomography (CT) to characterize TRISO particles is challenging because of the strong attenuation of the X-ray beam by the uranium core leading to severe photon starvation in a substantial fraction of the measurements. Furthermore, the overall acquisition time for a high-resolution CT scan can be very long when using conventional lab-based X-ray systems and reconstruction algorithms. Specifically, when analytic methods like the Feldkamp-Davis-Kress (FDK) algorithm is used for reconstruction, it results in severe streaks artifacts and noise in the corresponding 3D volume which make subsequent analysis of the particles challenging. In this article, we develop and apply model-based image reconstruction (MBIR) algorithms for improving the quality of CT reconstructions for TRISO particles in order to facilitate better characterization. We demonstrate that the proposed MBIR algorithms can significantly suppress artifacts with minimal pre-processing compared to the conventional approaches. Furthermore, we demonstrate the proposed MBIR approach can obtain high-quality reconstruction compared to the FDK approach even when using a fraction of the typically acquired measurements, thereby enabling dramatically faster measurement times for TRISO particles.


title: On the Value of Preview Information For Safety Control

abstract: Incorporating predictions of external inputs, which can otherwise be treated as disturbances, has been widely studied in control and computer science communities. These predictions are commonly referred to as preview in optimal control and lookahead in temporal logic synthesis. However, little work has been done for analyzing the value of preview information for safety control for systems with continuous state spaces. In this work, we start from showing general properties for discrete-time nonlinear systems with preview and strategies on how to determine a good preview time, and then we study a special class of linear systems, called systems in Brunovsky canonical form, and show special properties for this class of systems. In the end, we provide two numerical examples to further illustrate the value of preview in safety control.


title: Cluster-to-Conquer: A Framework for End-to-End Multi-Instance Learning for Whole Slide Image Classification

abstract: In recent years, the availability of digitized Whole Slide Images (WSIs) has enabled the use of deep learning-based computer vision techniques for automated disease diagnosis. However, WSIs present unique computational and algorithmic challenges. WSIs are gigapixel-sized ($\sim$100K pixels), making them infeasible to be used directly for training deep neural networks. Also, often only slide-level labels are available for training as detailed annotations are tedious and can be time-consuming for experts. Approaches using multiple-instance learning (MIL) frameworks have been shown to overcome these challenges. Current state-of-the-art approaches divide the learning framework into two decoupled parts: a convolutional neural network (CNN) for encoding the patches followed by an independent aggregation approach for slide-level prediction. In this approach, the aggregation step has no bearing on the representations learned by the CNN encoder. We have proposed an end-to-end framework that clusters the patches from a WSI into ${k}$-groups, samples ${k}'$ patches from each group for training, and uses an adaptive attention mechanism for slide level prediction; Cluster-to-Conquer (C2C). We have demonstrated that dividing a WSI into clusters can improve the model training by exposing it to diverse discriminative features extracted from the patches. We regularized the clustering mechanism by introducing a KL-divergence loss between the attention weights of patches in a cluster and the uniform distribution. The framework is optimized end-to-end on slide-level cross-entropy, patch-level cross-entropy, and KL-divergence loss (Implementation: https://github.com/YashSharma/C2C).


title: Higher order Poincare inequalities and Minkowski-type inequalities

abstract: We observe some higher order Poincare-type inequalities on a closed manifold, which is inspired by Hurwitz's proof of the Wirtinger's inequality using Fourier theory. We then give some geometric implication of these inequalities by applying them on the sphere. More specifically, by applying them to the support function of a convex hypersurface in the Euclidean space, we obtain some sharp Minkowski-type inequalities, such as a stability inequality for the classical Minkowski inequality and the Alexandrov-Fenchel inequality.


title: Fisher zeros and persistent temporal oscillations in non-unitary quantum circuits

abstract: We present a quantum circuit with measurements and post-selection that exhibits a panoply of space- and/or time-ordered phases, from ferromagnetic order to spin-density waves to time crystals. Unlike the time crystals that have been found in unitary models, those that occur here are \emph{incommensurate} with the drive frequency. The period of the incommensurate time-crystal phase may be tuned by adjusting the circuit parameters. We demonstrate that the phases of our quantum circuit, including the inherently non-equilibrium dynamical ones, correspond to complex-temperature equilibrium phases of the exactly solvable square-lattice anisotropic Ising model.


title: Cascade Weight Shedding in Deep Neural Networks: Benefits and Pitfalls for Network Pruning

abstract: We report, for the first time, on the cascade weight shedding phenomenon in deep neural networks where in response to pruning a small percentage of a network's weights, a large percentage of the remaining is shed over a few epochs during the ensuing fine-tuning phase. We show that cascade weight shedding, when present, can significantly improve the performance of an otherwise sub-optimal scheme such as random pruning. This explains why some pruning methods may perform well under certain circumstances, but poorly under others, e.g., ResNet50 vs. MobileNetV3. We provide insight into why the global magnitude-based pruning, i.e., GMP, despite its simplicity, provides a competitive performance for a wide range of scenarios. We also demonstrate cascade weight shedding's potential for improving GMP's accuracy, and reduce its computational complexity. In doing so, we highlight the importance of pruning and learning-rate schedules. We shed light on weight and learning-rate rewinding methods of re-training, showing their possible connections to the cascade weight shedding and reason for their advantage over fine-tuning. We also investigate cascade weight shedding's effect on the set of kept weights, and its implications for semi-structured pruning. Finally, we give directions for future research.


title: Model-based Reconstruction for Single Particle Cryo-Electron Microscopy

abstract: Single particle cryo-electron microscopy is a vital tool for 3D characterization of protein structures. A typical workflow involves acquiring projection images of a collection of randomly oriented particles, picking and classifying individual particle projections by orientation, and finally using the individual particle projections to reconstruct a 3D map of the electron density profile. The reconstruction is challenging because of the low signal-to-noise ratio of the data, the unknown orientation of the particles, and the sparsity of data especially when dealing with flexible proteins where there may not be sufficient data corresponding to each class to obtain an accurate reconstruction using standard algorithms. In this paper we present a model-based image reconstruction technique that uses a regularized cost function to reconstruct the 3D density map by assuming known orientations for the particles. Our method casts the reconstruction as minimizing a cost function involving a novel forward model term that accounts for the contrast transfer function of the microscope, the orientation of the particles and the center of rotation offsets. We combine the forward model term with a regularizer that enforces desirable properties in the volume to be reconstructed. Using simulated data, we demonstrate how our method can significantly improve upon the typically used approach.


title: EXSCLAIM! -- An automated pipeline for the construction of labeled materials imaging datasets from literature

abstract: Due to recent improvements in image resolution and acquisition speed, materials microscopy is experiencing an explosion of published imaging data. The standard publication format, while sufficient for traditional data ingestion scenarios where a select number of images can be critically examined and curated manually, is not conducive to large-scale data aggregation or analysis, hindering data sharing and reuse. Most images in publications are presented as components of a larger figure with their explicit context buried in the main body or caption text, so even if aggregated, collections of images with weak or no digitized contextual labels have limited value. To solve the problem of curating labeled microscopy data from literature, this work introduces the EXSCLAIM! Python toolkit for the automatic EXtraction, Separation, and Caption-based natural Language Annotation of IMages from scientific literature. We highlight the methodology behind the construction of EXSCLAIM! and demonstrate its ability to extract and label open-source scientific images at high volume.


title: Generalized 2HDM with wrong-sign lepton Yukawa coupling, in light of $g_{\mu}-2$ and lepton flavor violation at the future LHC

abstract: To explain the observed muon anomaly and simultaneously evade bounds from lepton flavor violation in the same model parameter space is a long cherished dream. In view of a generalized Two Higgs Doublet Model, with a Yukawa structure as a perturbation of Type-X, we are able to get substantial parameter space satisfying this criteria. We are focusing on a region with "{\bf wrong-sign}" lepton-Yukawa coupling which gives rise to an interesting phenomenological consequences. We found that in the "wrong-sign" region, it is possible to probe the low-mass pseudoscalar in flavor-violating decay mode with considerably better significance compared to the "right-sign" region. Performing a simple cut-based analysis we show that at 14 TeV run of the LHC with $300 fb^{-1}$ integrated luminosity, part of the model parameter space can be probed with significance $\geq 5\sigma$ which further improves with Artificial Neural Network analysis.


title: Ultrahigh convergent thermal conductivity of carbon nanotubes from comprehensive atomistic modeling

abstract: Anomalous heat transport in one-dimensional nanostructures, such as nanotubes and nanowires, is a widely debated problem in condensed matter and statistical physics, with contradicting pieces of evidence from experiments and simulations. Using a comprehensive modeling approach, comprised of lattice dynamics and molecular dynamics simulations, we proved that the infinite length limit of the thermal conductivity of a (10,0) single-wall carbon nanotube is finite but this limit is reached only for macroscopic lengths due to thermal phonon mean free path of several millimeters. Our calculations showed that the extremely high thermal conductivity of this system at room temperature is dictated by quantum effects. Modal analysis showed that the divergent nature of thermal conductivity, observed in one-dimensional model systems, is suppressed in carbon nanotubes by anharmonic scattering channels provided by the flexural and optical modes with polarization in the plane orthogonal to the transport direction.


title: Spin-orbit torque characterization in a nutshell

abstract: Spin current and spin torque generation through the spin-orbit interactions in solids, of bulk or interfacial origin, is at the heart of spintronics research. The realization of spin-orbit torque (SOT) driven magnetic dynamics and switching in diverse magnetic heterostructures also pave the way for developing SOT magnetoresistive random access memory and other novel SOT memory and logic devices. Of scientific and technological importance are accurate and efficient SOT quantification techniques, which have been abundantly developed in the last decade. In this article, we summarize popular techniques to experimentally quantify SOTs in magnetic heterostructures at micro- and nano-scale. For each technique, we give an overview of its principle, variations, strengths, shortcomings, error sources, and any cautions in usage. Finally, we discuss the remaining challenges in understanding and quantifying the SOTs in heterostructures.


title: PPT-SASMM: Scalable Analytical Shared Memory Model: Predicting the Performance of Multicore Caches from a Single-Threaded Execution Trace

abstract: Performance modeling of parallel applications on multicore processors remains a challenge in computational co-design due to multicore processors' complex design. Multicores include complex private and shared memory hierarchies. We present a Scalable Analytical Shared Memory Model (SASMM). SASMM can predict the performance of parallel applications running on a multicore. SASMM uses a probabilistic and computationally-efficient method to predict the reuse distance profiles of caches in multicores. SASMM relies on a stochastic, static basic block-level analysis of reuse profiles. The profiles are calculated from the memory traces of applications that run sequentially rather than using multi-threaded traces. The experiments show that our model can predict private L1 cache hit rates with 2.12% and shared L2 cache hit rates with about 1.50% error rate.


title: From Kadanoff--Baym to Boltzmann equations for massive spin-1/2 fermions

abstract: We derive Boltzmann equations for massive spin-1/2 fermions with local and nonlocal collision terms from the Kadanoff--Baym equation in the Schwinger--Keldysh formalism, properly accounting for the spin degrees of freedom. The Boltzmann equations are expressed in terms of matrix-valued spin distribution functions, which are the building blocks for the quasi-classical parts of the Wigner functions. Nonlocal collision terms appear at next-to-leading order in $\hbar$ and are sources for the polarization part of the matrix-valued spin distribution functions. The Boltzmann equations for the matrix-valued spin distribution functions pave the way for simulating spin-transport processes involving spin-vorticity couplings from first principles.


title: Symmetry properties and widths of the filamentary structures in the Orion A giant molecular cloud

abstract: We identify 225 filaments from an H$_2$ column density map constructed using simultaneous $^{12}$CO, $^{13}$CO, and C$^{18}$O (J=1-0) observations carried out as a part of the MWISP project. We select 46 long filaments with lengths above 1.2 pc to analyze the filament column density profiles. We divide the selected filaments into 397 segments and calculate the column density profiles for each segment. The symmetries of the profiles are investigated. The proportion of intrinsically asymmetrical segments is 65.3$\%$, and that of intrinsically symmetrical ones is 21.4$\%$. The typical full width at half maximum (FWHM) of the intrinsically symmetrical filament segments is $\sim$ 0.67 pc with the Plummer-like fitting, and $\sim$ 0.50 pc with the Gaussian fitting, respectively. The median FWHM widths derived from the second-moment method for intrinsically symmetrical and asymmetrical profiles are $\sim$ 0.44 and 0.46 pc, respectively. Close association exists between the filamentary structures and the YSOs in the region.


title: $\mathbb{Z}_2^3$-Graded Extensions of Lie Superalgebras and Superconformal Quantum Mechanics

abstract: Quantum mechanical systems whose symmetry is given by $\mathbb{Z}_2^3$-graded version of superconformal algebra are introduced. This is done by finding a realization of a $\mathbb{Z}_2^3$-graded Lie superalgebra in terms of a standard Lie superalgebra and the Clifford algebra. The realization allows us to map many models of superconformal quantum mechanics (SCQM) to their $\mathbb{Z}_2^3$-graded extensions. It is observed that for the simplest SCQM with $\mathfrak{osp}(1|2)$ symmetry there exist two inequivalent $\mathbb{Z}_2^3$-graded extensions. Applying the standard prescription of conformal quantum mechanics, spectrum of the SCQMs with the $\mathbb{Z}_2^3$-graded $\mathfrak{osp}(1|2)$ symmetry is analyzed. It is shown that many models of SCQM can be extended to $\mathbb{Z}_2^n$-graded setting.


title: Unified approach to secondary effects on the CMB B-mode polarization

abstract: We develop a systematic and unified approach to estimate all possible secondary (i.e. non-primordial) nonlinear effects to the cosmic microwave background (CMB) polarization, named curve-of-sight integration approach. In this approach, the Boltzmann equation for polarized photons is rewritten in a line-of-sight integral along an exact geodesic in the perturbed universe, rather than a geodesic in the background universe used in the linear-order CMB calculation. This approach resolves the difficulty to solve the Boltzmann hierarchy with the nonlinear gravitational effects in the photon free-streaming regime and thus unifies the standard remapping approach for CMB lensing into the direct approach solving the Boltzmann equation for the nonlinear collisional effects. In this paper, we derive formulae that: (i) include all the nonlinear effects; (ii) can treat extended sources such as the contributions after the reionization. It offers a solid framework to discuss possible systematics in the standard estimation of CMB lensing by the remapping approach. As an explicit demonstration, we estimate the secondary B-mode power spectrum induced by all foreground gravitational effects: lensing, redshift, time-delay, emission-angle, and polarization-rotation effects. We define these effects properly so that they do not have any overlap, also without overlooking any effect. Then, we show that these effects only give corrections of the order of 0.001-0.01% to the standard lensing-induced B-mode power spectrum in the concordance $\Lambda$ cold dark matter model. Our result confirms the reliability of using the remapping approach in upcoming CMB experiments aiming to detect the primordial gravitational waves with the tensor-to-scalar ratio of $r \sim 10^{-3}$.


title: Order selection with confidence for finite mixture models

abstract: The determination of the number of mixture components (the order) of a finite mixture model has been an enduring problem in statistical inference. We prove that the closed testing principle leads to a sequential testing procedure (STP) that allows for confidence statements to be made regarding the order of a finite mixture model. We construct finite sample tests, via data splitting and data swapping, for use in the STP, and we prove that such tests are consistent against fixed alternatives. Simulation studies and real data examples are used to demonstrate the performance of the finite sample tests-based STP, yielding practical recommendations of their use as confidence estimators in combination with point estimates such as the Akaike information or Bayesian information criteria. In addition, we demonstrate that a modification of the STP yields a method that consistently selects the order of a finite mixture model, in the asymptotic sense. Our STP is not only applicable for order selection of finite mixture models, but is also useful for making confidence statements regarding any sequence of nested models.


title: Biomedical Convergence Facilitated by the Emergence of Technological and Informatic Capabilities

abstract: We analyzed Medical Subject Headings (MeSH) from 21.6 million research articles indexed by PubMed to map this vast space of entities and their relations, providing insights into the origins and future of biomedical convergence. Detailed analysis of MeSH co-occurrence networks identifies three robust knowledge clusters: the vast universe of microscopic biological entities and structures; systems, disease and diagnostics; and emergent biological and social phenomena underlying the complex problems driving the health, behavioral and brain science frontiers. These domains integrated from the 1990s onward by way of technological and informatic capabilities that introduced highly controllable, scalable and permutable research processes and invaluable imaging techniques for illuminating fundamental structure-function-behavior questions. Article-level analysis confirms a positive relationship between team size and topical diversity, and shows convergence to be increasing in prominence but with recent saturation. Together, our results invite additional policy support for cross-disciplinary team assembly to harness transdisciplinary convergence.


title: Knowledge-Based Hierarchical POMDPs for Task Planning

abstract: The main goal in task planning is to build a sequence of actions that takes an agent from an initial state to a goal state. In robotics, this is particularly difficult because actions usually have several possible results, and sensors are prone to produce measurements with error. Partially observable Markov decision processes (POMDPs) are commonly employed, thanks to their capacity to model the uncertainty of actions that modify and monitor the state of a system. However, since solving a POMDP is computationally expensive, their usage becomes prohibitive for most robotic applications. In this paper, we propose a task planning architecture for service robotics. In the context of service robot design, we present a scheme to encode knowledge about the robot and its environment, that promotes the modularity and reuse of information. Also, we introduce a new recursive definition of a POMDP that enables our architecture to autonomously build a hierarchy of POMDPs, so that it can be used to generate and execute plans that solve the task at hand. Experimental results show that, in comparison to baseline methods, by following a recursive hierarchical approach the architecture is able to significantly reduce the planning time, while maintaining (or even improving) the robustness under several scenarios that vary in uncertainty and size.


title: CE-FPN: Enhancing Channel Information for Object Detection

abstract: Feature pyramid network (FPN) has been an effective framework to extract multi-scale features in object detection. However, current FPN-based methods mostly suffer from the intrinsic flaw of channel reduction, which brings about the loss of semantical information. And the miscellaneous fused feature maps may cause serious aliasing effects. In this paper, we present a novel channel enhancement feature pyramid network (CE-FPN) with three simple yet effective modules to alleviate these problems. Specifically, inspired by sub-pixel convolution, we propose a sub-pixel skip fusion method to perform both channel enhancement and upsampling. Instead of the original 1x1 convolution and linear upsampling, it mitigates the information loss due to channel reduction. Then we propose a sub-pixel context enhancement module for extracting more feature representations, which is superior to other context methods due to the utilization of rich channel information by sub-pixel convolution. Furthermore, a channel attention guided module is introduced to optimize the final integrated features on each level, which alleviates the aliasing effect only with a few computational burdens. Our experiments show that CE-FPN achieves competitive performance compared to state-of-the-art FPN-based detectors on MS COCO benchmark.


title: Non-Clifford gate on optical qubits by nonlinear feedforward

abstract: In a continuous-variable optical system, the Gottesman-Kitaev-Preskill (GKP) qubit is a promising candidate for fault-tolerant quantum computation. To implement non-Clifford operations on GKP qubits, non-Gaussian operations are required. In this context, the implementation of a cubic phase gate by combining nonlinear feedforward with ancillary states has been widely researched. Recently, however, it is pointed out that the cubic phase gate is not the most suitable for non-Clifford operations on GKP qubits. In this work, we show that we can achieve linear optical implementation of non-Clifford operations on GKP qubit with high fidelity by applying the nonlinear feedforward originally developed for the cubic phase gate and using a GKP-encoded ancillary state. Our work shows the versatility of nonlinear feedforward technique important for optical implementation of the fault-tolerant continuous-variable quantum computation.


title: Topological parafermion corner states in clock-symmetric non-Hermitian second-order topological insulator

abstract: Parafermions are a natural generalization of Majorana fermions. We consider a breathing Kagome lattice with complex hoppings by imposing $\mathbb{Z}_{3}$ clock symmetry in the complex energy plane. It is a non-Hermitian generalization of the second-order topological insulator characterized by the emergence of topological corner states. We demonstrate that the topological corner states are parafermions in the present $\mathbb{Z}_{3}$ clock-symmetric model. It is also shown that the model is realized in electric circuits properly designed, where the parafermion corner states are observed by impedance resonance. We also construct $\mathbb{Z}_{4}$ and $\mathbb{Z}_{6}$ parafermions on breathing square and honeycomb lattices, respectively.

categories: cond-mat.mes-hall cond-mat.str-el cond-mat.supr-con quant-ph


title: Characterization of the Gittins index for sequential multistage jobs

abstract: The optimal scheduling problem in single-server queueing systems is a classic problem in queueing theory. The Gittins index policy is known to be the optimal preemptive nonanticipating policy (both for the open version of the problem with Poisson arrivals and the closed version without arrivals) minimizing the expected holding costs. While the Gittins index is thoroughly characterized for ordinary jobs whose state is described by the attained service, it is not at all the case with jobs that have more complex structure. Recently, a class of such jobs, the multistage jobs, were introduced, and it was shown that the computation of Gittins index of a multistage job reduces into separable computations for the individual stages. The characterization is, however, indirect in the sense that it relies on the recursion for an auxiliary function (so called SJP function) and not for the Gittins index itself. In this paper, we answer the natural question: Is it possible to compute the Gittins index for a multistage job more directly by recursively combining the Gittins indexes of its individual stages? According to our results, it seems to be possible, at least, for sequential multistage jobs that have a fixed (deterministic) sequence of stages. We prove this for sequential two-stage jobs that have monotonous hazard rates in both stages, but our numerical experiments give an indication that the result could possibly be generalized to any sequential multistage jobs. Our approach, in this paper, is based on the Whittle index originally developed in the context of restless bandits.


title: Topological spin crystals by itinerant frustration

abstract: Spin textures with nontrivial topology, such as vortices and skyrmions, have attracted attention as a source of unconventional magnetic, transport, and optical phenomena. Recently, a new generation of topological spin textures has been extensively studied in itinerant magnets; in contrast to the conventional ones induced, e.g., by the Dzyaloshinskii-Moriya interaction in noncentrosymmetric systems, they are characterized by extremely short magnetic periods and stable even in centrosymmetric systems. Here we review such new types of topological spin textures with particular emphasis on their stabilization mechanism. Focusing on the interplay between charge and spin degrees of freedom in itinerant electron systems, we show that itinerant frustration, which is the competition among electron-mediated interactions, plays a central role in stabilizing a variety of topological spin crystals including a skyrmion crystal with unconventional high skyrmion number, meron crystals, and hedgehog crystals. We also show that the essential ingredients in the itinerant frustration are represented by bilinear and biquadratic spin interactions in momentum space. This perspective not only provides a unified understanding of the unconventional topological spin crystals but also stimulates further exploration of exotic topological phenomena in itinerant magnets.


title: Being Cayley automatic is closed under taking wreath product with virtually cyclic groups

abstract: We extend work of the first author and Khoussainov to show that being Cayley automatic is closed under taking the restricted wreath product with a virtually infinite cyclic group. This adds to the list of known examples of Cayley automatic groups.


title: Iterative solutions for the gravitational lens equation in the strong deflection limit

abstract: Two exact lens equations have been recently shown to be equivalent to each other, being consistent with the gravitational deflection angle of light from a source to an observer, both of which can be within a finite distance from a lens object [Phys. Rev. D 102, 064060 (2020)]. We examine methods for iterative solutions of the gravitational lens equations in the strong deflection limit. It has been so far unclear whether a convergent series expansion can be provided by the gravitational lens approach based on the geometrical optics for obtaining approximate solutions in the strong deflection limit in terms of a small offset angle. By using the ratio of the lens mass to the lens distance, we discuss a slightly different method for iterative solutions and the behavior of the convergence. Finite distance effects begin at the third order in the iterative method. The iterative solutions in the strong deflection limit are estimated for Sgr $A^{*}$ and M87. These results suggest that only the linear order solution can be relevant with current observations, while the finite distance effects at the third order may be negligible in the Schwarzschild lens model for these astronomical objects.


title: Low-Complexity Dynamic Resource Scheduling for Downlink MC-NOMA Over Fading Channels

abstract: In this paper, we investigate dynamic resource scheduling (i.e., joint user, subchannel, and power scheduling) for downlink multi-channel non-orthogonal multiple access (MC-NOMA) systems over time-varying fading channels. Specifically, we address the weighted average sum rate maximization problem with quality-of-service (QoS) constraints. In particular, to facilitate fast resource scheduling, we focus on developing a very low-complexity algorithm. To this end, by leveraging Lagrangian duality and the stochastic optimization theory, we first develop an opportunistic MC-NOMA scheduling algorithm whereby the original problem is decomposed into a series of subproblems, one for each time slot. Accordingly, resource scheduling works in an online manner by solving one subproblem per time slot, making it more applicable to practical systems. Then, we further develop a heuristic joint subchannel assignment and power allocation (Joint-SAPA) algorithm with very low computational complexity, called Joint-SAPA-LCC, that solves each subproblem. Finally, through simulation, we show that our Joint-SAPA-LCC algorithm provides good performance comparable to the existing Joint-SAPA algorithms despite requiring much lower computational complexity. We also demonstrate that our opportunistic MC-NOMA scheduling algorithm in which the Joint-SAPA-LCC algorithm is embedded works well while satisfying given QoS requirements.


title: SoK: A Modularized Approach to Study the Security of Automatic Speech Recognition Systems

abstract: With the wide use of Automatic Speech Recognition (ASR) in applications such as human machine interaction, simultaneous interpretation, audio transcription, etc., its security protection becomes increasingly important. Although recent studies have brought to light the weaknesses of popular ASR systems that enable out-of-band signal attack, adversarial attack, etc., and further proposed various remedies (signal smoothing, adversarial training, etc.), a systematic understanding of ASR security (both attacks and defenses) is still missing, especially on how realistic such threats are and how general existing protection could be. In this paper, we present our systematization of knowledge for ASR security and provide a comprehensive taxonomy for existing work based on a modularized workflow. More importantly, we align the research in this domain with that on security in Image Recognition System (IRS), which has been extensively studied, using the domain knowledge in the latter to help understand where we stand in the former. Generally, both IRS and ASR are perceptual systems. Their similarities allow us to systematically study existing literature in ASR security based on the spectrum of attacks and defense solutions proposed for IRS, and pinpoint the directions of more advanced attacks and the directions potentially leading to more effective protection in ASR. In contrast, their differences, especially the complexity of ASR compared with IRS, help us learn unique challenges and opportunities in ASR security. Particularly, our experimental study shows that transfer learning across ASR models is feasible, even in the absence of knowledge about models (even their types) and training data.


title: Analytic integration methods in quantum field theory: an Introduction

abstract: A survey is given on the present status of analytic calculation methods and the mathematical structures of zero- and single scale Feynman amplitudes which emerge in higher order perturbative calculations in the Standard Model of elementary particles, its extensions and associated model field theories, including effective field theories of different kind.


title: Adoption and Suitability of Software Development Methods and Practices

abstract: In seeking to complement consultants' and tool vendors' reports, there has been an increasing academic focus on understanding the adoption and use of software development methods and practices. We surveyed practitioners working in Brazil, Finland, and New Zealand in a transnational study to contribute to these efforts. Among our findings we observed that most of the 184 practitioners in our sample focused on a small portfolio of projects that were of short duration. In addition, Scrum and Kanban were used most; however, some practitioners also used conventional methods. Coding Standards, Simple Design and Refactoring were used most by practitioners, and these practices were held to be largely suitable for project and process management. Our evidence points to the need to properly understand and support a wide range of software methods.


title: Atiyah-Patodi-Singer index theorem from axial anomaly

abstract: We give a very simple derivation of the Atiyah-Patodi-Singer (APS) index theorem and its small generalization by using the path integral of massless Dirac fermions. It is based on the Fujikawa's argument for the relation between the axial anomaly and the Atiyah-Singer index theorem, and only a minor modification of that argument is sufficient to show the APS index theorem. The key ingredient is the identification of the APS boundary condition and its generalization as physical state vectors in the Hilbert space of the massless fermion theory. The APS $\eta$-invariant appears as the axial charge of the physical states.


title: Looking for a vectorlike B quark at LHC using jet substructure

abstract: Vectorlike quarks have been shown to resolve certain long-standing discrepancies pertaining to the bottom sector. We investigate, here, the prospects of identifying the existence of a topless vectorlike doublet $(B,~Y)$, as is preferred by the electroweak precision measurements. Concentrating on single production, $viz.$ $B \bar b$ with $B \to b + Z/H$ subsequently, we find that the fully hadronic decay-channel is susceptible to discovery provided jet substructure observables are used. At the 13 TeV LHC with an integrated luminosity of 300 fb$^{-1}$, a modest value of the chromomagnetic transition moments allows for the exclusion of $M \lesssim 1.8(2.2)$ TeV in the $Z$ and $H$ channels respectively.


title: Beyond Linear Subspace Clustering: A Comparative Study of Nonlinear Manifold Clustering Algorithms

abstract: Subspace clustering is an important unsupervised clustering approach. It is based on the assumption that the high-dimensional data points are approximately distributed around several low-dimensional linear subspaces. The majority of the prominent subspace clustering algorithms rely on the representation of the data points as linear combinations of other data points, which is known as a self-expressive representation. To overcome the restrictive linearity assumption, numerous nonlinear approaches were proposed to extend successful subspace clustering approaches to data on a union of nonlinear manifolds. In this comparative study, we provide a comprehensive overview of nonlinear subspace clustering approaches proposed in the last decade. We introduce a new taxonomy to classify the state-of-the-art approaches into three categories, namely locality preserving, kernel based, and neural network based. The major representative algorithms within each category are extensively compared on carefully designed synthetic and real-world data sets. The detailed analysis of these approaches unfolds potential research directions and unsolved challenges in this field.


title: Feynman diagram approach to dynamical Casimir effect in optimechanical cavity

abstract: In this paper we study an optomechnical system enclosed by an optical cavity with one mirror attached to a spring as a closed quantum system. We provide a different angle of studying the phenomenons related to the dynamical Casimir effect via Feynman diagram technique. Dressing effects of phonon, photon and coupling strength are discussed. The energy shift of ground state is obtained. The dynamical Casimir effect is modeled by the scattering processes converting phonons to photons and the corresponding scattering amplitudes are computed. The force-force correlation function of the radiation pressure is derived, whose non-Gaussian probability distribution is revealed.


title: Summation formulas of hyperharmonic numbers with their generalizations II

abstract: In 1990, Spie\ss \, gave some identities of harmonic numbers including the types of $\sum_{\ell=1}^n\ell^k H_\ell$, $\sum_{\ell=1}^n\ell^k H_{n-\ell}$ and $\sum_{\ell=1}^n\ell^k H_\ell H_{n-\ell}$. In this paper, we derive several formulas of hyperharmonic numbers including $\sum_{\ell=0}^{n} {\ell}^{p} h_{\ell}^{(r)} h_{n-\ell}^{(s)}$ and $\sum_{\ell=0}^n \ell^{p}(h_{\ell}^{(r)})^{2}$. Some more formulas of generalized hyperharmonic numbers are also shown.


title: Quasinormal modes and shadow of noncommutative black hole

abstract: In this paper we investigate quasinormal modes (QNM) for a scalar field around a noncommutative Schwarzschild black hole. We verify the effect of noncommutativity on quasinormal frequencies by applying two procedures widely used in the literature. The first is the Wentzel-Kramers-Brillouin (WKB) approximation up to sixth order. In the second case we use the continuous fraction method developed by Leaver. Besides, we also show that due to noncommutativity, the shadow radius is reduced when we increase the noncommutative parameter. In addition, we find that the shadow radius is nonzero even at the zero mass limit for finite noncommutative parameter.


title: The reference distributions of Maurer's universal statistical test and its improved tests

abstract: Maurer's universal statistical test can widely detect non-randomness of given sequences. Coron proposed an improved test, and further Yamamoto and Liu proposed a new test based on Coron's test. These tests use normal distributions as their reference distributions, but the soundness has not been theoretically discussed so far. Additionally, Yamamoto and Liu's test uses an experimental value as the variance of its reference distribution. In this paper, we theoretically derive the variance of the reference distribution of Yamamoto and Liu's test and prove that the true reference distribution of Coron's test converges to a normal distribution in some sense. We can apply the proof to the other tests with small changes.


title: USTC-NELSLIP System Description for DIHARD-III Challenge

abstract: This system description describes our submission system to the Third DIHARD Speech Diarization Challenge. Besides the traditional clustering based system, the innovation of our system lies in the combination of various front-end techniques to solve the diarization problem, including speech separation and target-speaker based voice activity detection (TS-VAD), combined with iterative data purification. We also adopted audio domain classification to design domain-dependent processing. Finally, we performed post processing to do system fusion and selection. Our best system achieved DERs of 11.30% in track 1 and 16.78% in track 2 on evaluation set, respectively.


title: Ermakov-Pinney equation for time-varying mass systems

abstract: We extend Fring-Tenney approach of constructing invariants of constant mass time-dependent system to the case of a time-dependent mass particle. From a coupled set of equations described in terms of guiding parameter functions, we track down a modified Ermakov-Pinney equation involving a time-dependent mass function. As a concrete example we focus on an exponential choice of the mass function.


title: XProtoNet: Diagnosis in Chest Radiography with Global and Local Explanations

abstract: Automated diagnosis using deep neural networks in chest radiography can help radiologists detect life-threatening diseases. However, existing methods only provide predictions without accurate explanations, undermining the trustworthiness of the diagnostic methods. Here, we present XProtoNet, a globally and locally interpretable diagnosis framework for chest radiography. XProtoNet learns representative patterns of each disease from X-ray images, which are prototypes, and makes a diagnosis on a given X-ray image based on the patterns. It predicts the area where a sign of the disease is likely to appear and compares the features in the predicted area with the prototypes. It can provide a global explanation, the prototype, and a local explanation, how the prototype contributes to the prediction of a single image. Despite the constraint for interpretability, XProtoNet achieves state-of-the-art classification performance on the public NIH chest X-ray dataset.


title: Inhomogeneous Travelling-Wave Accelerating Sections and WKB Approach

abstract: The paper presents the results of a study of the possibility of using the WKB approach to describe Inhomogeneous Travelling-Wave Accelerating Sections (ITWAS). This possibility not only simplifies the calculation, but also allows the use of simpler physical models of transient processes. Using the traveling wave concept simplifies the understanding of pulsed-excited ITWAS transients and the development of methods to mitigate their effect on beam parameters.


title: Quantum emission assisted by energy landscape modification in pentacene-decorated carbon nanotubes

abstract: Photoluminescent carbon nanotubes are expected to become versatile room-temperature single-photon sources that have applications in quantum information processing. Quantum emission from carbon nanotubes is often induced by localization of excitons or exciton-exciton annihilation. Here, we modify the local energy landscape of excitons by decorating nanoscale pentacene particles onto air-suspended single-walled carbon nanotubes. Directional exciton diffusion from the undecorated region to the decorated site is demonstrated, suggesting exciton trapping induced by local dielectric screening from pentacene particles. Photoluminescence and photon correlation measurements on a representative carbon nanotube reveal enhanced exciton-exciton annihilation and single-photon emission at room temperature. Pentacene particles are shown to promote strong photon antibunching at the decorated site, indicating that noncovalent functionalization using molecules can be an effective approach for energy landscape modification and quantum emission in carbon nanotubes.


title: Dressing operators in equivariant Gromov-Witten theory of $\mathbb{CP}^1$

abstract: Okounkov and Pandharipande proved that the equivariant Toda hierarchy governs the equivariant Gromov-Witten theory of $\mathbb{CP}^1$. A technical clue of their method is a pair of dressing operators on the Fock space of 2D charged free fermion fields. We reformulate these operators as difference operators in the Lax formalism of the 2D Toda hierarchy. This leads to a new explanation to the question of why the equivariant Toda hierarchy emerges in the equivariant Gromov-Witten theory of $\mathbb{CP}^1$. Moreover, the non-equivariant limit of these operators turns out to capture the integrable structure of the non-equivariant Gromov-Witten theory correctly.


title: Search and localization dynamics of the CRISPR/Cas9 system

abstract: The CRISPR/Cas9 system acts as the prokaryotic immune system and has important applications in gene editing. The protein Cas9 is one of its crucial components. The role of Cas9 is to search for specific target sequences on the DNA and cleave them. In this Letter, we introduce a model of facilitated diffusion for Cas9 and fit its parameters to single-molecule experiments. Our model confirms that Cas9 search for targets by sliding, but shows that its sliding length is rather short. We then investigate how Cas9 explores a long stretch of DNA containing randomly placed targets. We solve this problem by mapping it into the theory of Anderson localization in condensed matter physics. Our theoretical approach rationalizes experimental evidences on the distribution of Cas9 molecules along the DNA.


title: API2Com: On the Improvement of Automatically Generated Code Comments Using API Documentations

abstract: Code comments can help in program comprehension and are considered as important artifacts to help developers in software maintenance. However, the comments are mostly missing or are outdated, specially in complex software projects. As a result, several automatic comment generation models are developed as a solution. The recent models explore the integration of external knowledge resources such as Unified Modeling Language class diagrams to improve the generated comments. In this paper, we propose API2Com, a model that leverages the Application Programming Interface Documentations (API Docs) as a knowledge resource for comment generation. The API Docs include the description of the methods in more details and therefore, can provide better context in the generated comments. The API Docs are used along with the code snippets and Abstract Syntax Trees in our model. We apply the model on a large Java dataset of over 130,000 methods and evaluate it using both Transformer and RNN-base architectures. Interestingly, when API Docs are used, the performance increase is negligible. We therefore run different experiments to reason about the results. For methods that only contain one API, adding API Docs improves the results by 4% BLEU score on average (BLEU score is an automatic evaluation metric used in machine translation). However, as the number of APIs that are used in a method increases, the performance of the model in generating comments decreases due to long documentations used in the input. Our results confirm that the API Docs can be useful in generating better comments, but, new techniques are required to identify the most informative ones in a method rather than using all documentations simultaneously.


title: Parallel detection and spatial mapping of large nuclear spin clusters

abstract: Nuclear magnetic resonance imaging (MRI) at the atomic scale offers exciting prospects for determining the structure and function of individual molecules and proteins. Quantum defects in diamond have recently emerged as a promising platform towards reaching this goal, and allowed for the detection and localization of single nuclear spins under ambient conditions. We present an efficient strategy for extending imaging to large nuclear spin clusters, fulfilling an important requirement towards a single-molecule MRI technique. Our method combines the concepts of weak quantum measurements, phase encoding and simulated annealing to detect three-dimensional positions from many nuclei in parallel. Detection is spatially selective, allowing us to probe nuclei at a chosen target radius while avoiding interference from strongly-coupled proximal nuclei. We demonstrate our strategy by imaging clusters containing more than 20 carbon-13 nuclear spins within a radius of 2.4 nm from single, near-surface nitrogen--vacancy centers at room temperature. The radius extrapolates to 7-8 nm for protons. Beside taking an important step in nanoscale MRI, our experiment also provides an efficient tool for the characterization of large nuclear spin registers in the context of quantum simulators and quantum network nodes.


title: Improving Image co-segmentation via Deep Metric Learning

abstract: Deep Metric Learning (DML) is helpful in computer vision tasks. In this paper, we firstly introduce DML into image co-segmentation. We propose a novel Triplet loss for Image Segmentation, called IS-Triplet loss for short, and combine it with traditional image segmentation loss. Different from the general DML task which learns the metric between pictures, we treat each pixel as a sample, and use their embedded features in high-dimensional space to form triples, then we tend to force the distance between pixels of different categories greater than of the same category by optimizing IS-Triplet loss so that the pixels from different categories are easier to be distinguished in the high-dimensional feature space. We further present an efficient triple sampling strategy to make a feasible computation of IS-Triplet loss. Finally, the IS-Triplet loss is combined with 3 traditional image segmentation losses to perform image segmentation. We apply the proposed approach to image co-segmentation and test it on the SBCoseg dataset and the Internet dataset. The experimental result shows that our approach can effectively improve the discrimination of pixels' categories in high-dimensional space and thus help traditional loss achieve better performance of image segmentation with fewer training epochs.


title: Wisecr: Secure Simultaneous Code Disseminationto Many Batteryless Computational RFID Devices

abstract: Emerging ultra-low-power tiny scale computing devices in Cyber-Physical Systems %and Internet of Things (IoT) run on harvested energy, are intermittently powered, have limited computational capability, and perform sensing and actuation functions under the control of a dedicated firmware operating without the supervisory control of an operating system. Wirelessly updating or patching the firmware of such devices is inevitable. We consider the challenging problem of simultaneous and secure firmware updates or patching for a typical class of such devices -- Computational Radio Frequency Identification (CRFID) devices. We propose Wisecr, the first secure and simultaneous wireless code dissemination mechanism to multiple devices that prevent malicious code injection attacks and intellectual property (IP) theft, whilst enabling remote attestation of code installation. Importantly, Wisecr is engineered to comply with existing ISO compliant communication protocol standards employed by CRFID devices and systems. We comprehensively evaluate Wisecr's overhead, demonstrate its implementation over standards-compliant protocols, analyze its security and implement an end-to-end realization with popular CRFID devices -- the open-source code is released on GitHub.


title: Remarks on type I blow up for the 3D Euler equations and the 2D Boussinesq equations

abstract: In this paper we derive kinematic relations for quantities involving the rate of strain tensor and the Hessian of the pressure for solutions of the 3D Euler equations and the 2D Boussinesq equations. Using these kinematic relations, we prove new blow up criteria and obtain conditions for the absence of type I singularity for these equations. We obtain both global and localized versions of the results. Some of the new blow up criteria and type I conditions improve previous results of [3].


title: Cost-effective Deployment of BERT Models in Serverless Environment

abstract: In this study we demonstrate the viability of deploying BERT-style models to serverless environments in a production setting. Since the freely available pre-trained models are too large to be deployed in this way, we utilize knowledge distillation and fine-tune the models on proprietary datasets for two real-world tasks: sentiment analysis and semantic textual similarity. As a result, we obtain models that are tuned for a specific domain and deployable in serverless environments. The subsequent performance analysis shows that this solution results in latency levels acceptable for production use and that it is also a cost-effective approach for small-to-medium size deployments of BERT models, all without any infrastructure overhead.


title: Learning Multiscale Correlations for Human Motion Prediction

abstract: In spite of the great progress in human motion prediction, it is still a challenging task to predict those aperiodic and complicated motions. We believe that to capture the correlations among human body components is the key to understand the human motion. In this paper, we propose a novel multiscale graph convolution network (MGCN) to address this problem. Firstly, we design an adaptive multiscale interactional encoding module (MIEM) which is composed of two sub modules: scale transformation module and scale interaction module to learn the human body correlations. Secondly, we apply a coarse-to-fine decoding strategy to decode the motions sequentially. We evaluate our approach on two standard benchmark datasets for human motion prediction: Human3.6M and CMU motion capture dataset. The experiments show that the proposed approach achieves the state-of-the-art performance for both short-term and long-term prediction especially in those complicated action category.


title: Locating Faulty Methods with a Mixed RNN and Attention Model

abstract: IR-based fault localization approaches achieves promising results when locating faulty files by comparing a bug report with source code. Unfortunately, they become less effective to locate faulty methods. We conduct a preliminary study to explore its challenges, and identify three problems: the semantic gap problem, the representation sparseness problem, and the single revision problem. To tackle these problems, we propose MRAM, a mixed RNN and attention model, which combines bug-fixing features and method structured features to explore both implicit and explicit relevance between methods and bug reports for method level fault localization task. The core ideas of our model are: (1) constructing code revision graphs from code, commits and past bug reports, which reveal the latent relations among methods to augment short methods and as well provide all revisions of code and past fixes to train more accurate models; (2) embedding three method structured features (token sequences, API invocation sequences, and comments) jointly with RNN and soft attention to represent source methods and obtain their implicit relevance with bug reports; and (3) integrating multirevision bug-fixing features, which provide the explicit relevance between bug reports and methods, to improve the performance. We have implemented MRAM and conducted a controlled experiment on five open-source projects. Comparing with stateof-the-art approaches, our MRAM improves MRR values by 3.8- 5.1% (3.7-5.4%) when the dataset contains (does not contain) localized bug reports. Our statistics test shows that our improvements are significant


title: HD molecules at high redshift: cosmic-ray ionization rate in the diffuse interstellar medium

abstract: We present a systematic study of deuterated molecular hydrogen (HD) at high redshift, detected in absorption in the spectra of quasars. We present four new identifications of HD lines associated with known $\rm H_2$-bearing Damped Lyman-$\alpha$ systems. In addition, we measure upper limits on the $\rm HD$ column density in twelve recently identified $\rm H_2$-bearing DLAs. We find that the new $\rm HD$ detections have similar $N({\rm HD})/N(\rm H_2)$ ratios as previously found, further strengthening a marked difference with measurements through the Galaxy. This is likely due to differences in physical conditions and metallicity between the local and the high-redshift interstellar media. Using the measured $N({\rm HD})/N({\rm H_2})$ ratios together with priors on the UV flux ($\chi$) and number densities ($n$), obtained from analysis of $\rm H_2$ and associated CI lines, we are able to constrain the cosmic-ray ionization rate (CRIR, $\zeta$) for the new $\rm HD$ detections and for eight known HD-bearing systems where priors on $n$ and $\chi$ are available. We find significant dispersion in $\zeta$, from a few $\times 10^{-18}$ s$^{-1}$ to a few $\times 10^{-15}$ s$^{-1}$. We also find that $\zeta$ strongly correlates with $\chi$ -- showing almost quadratic dependence, slightly correlates with $Z$, and does not correlate with $n$, which probably reflects a physical connection between cosmic rays and star-forming regions.


title: Ultra-Low Noise L-Band Cryogenic Astronomical Receiver for FAST Telescope

abstract: This paper presents an ultra-low noise L-band radio astronomical cryogenic receiver for FAST telescope. The development of key low noise microwave parts of Coupling-LNA and conical quad-ridge OMT and reasonable system integration achieve outstanding performance of receiver.It covers the frequency range of 1.2 GHz to 1.8 GHz. Novel cryogenic Coupling-LNAs with low noise, large return loss, high dynamic range and the function of coupling calibration signals are developed for the proposed receiver.Amplification and coupling function circuits are integrated as a single Coupling-LNA with full noise temperature of 4 K at the physical temperature of 15 K. And its return loss is more than 18 dB, and output 1 dB compression power is +5 dBm. A cryogenic dewar is fabricated to provide 55 K and 15 K cryogenic environment for OMT and Coupling-LNAs, respectively. The receiver's system noise temperature is below 9 K referred to feed aperture plane. Benefiting from optimal design and precise mechanical treatment, good scattering performance of OMT and equalized radiation patterns of horn are achieved with an antenna efficiency above 75%.


title: 6-DOF Feature based LIDAR SLAM using ORB Features from Rasterized Images of 3D LIDAR Point Cloud

abstract: An accurate and computationally efficient SLAM algorithm is vital for modern autonomous vehicles. To make a lightweight the algorithm, most SLAM systems rely on feature detection from images for vision SLAM or point cloud for laser-based methods. Feature detection through a 3D point cloud becomes a computationally challenging task. In this paper, we propose a feature detection method by projecting a 3D point cloud to form an image and apply the vision-based feature detection technique. The proposed method gives repeatable and stable features in a variety of environments. Based on such features, we build a 6-DOF SLAM system consisting of tracking, mapping, and loop closure threads. For loop detection, we employ a 2-step approach i.e. nearest key-frames detection and loop candidate verification by matching features extracted from rasterized LIDAR images. Furthermore, we utilize a key-frame structure to achieve a lightweight SLAM system. The proposed system is evaluated with implementation on the KITTI dataset and the University of Michigan Ford Campus dataset. Through experimental results, we show that the algorithm presented in this paper can substantially reduce the computational cost of feature detection from the point cloud and the whole SLAM system while giving accurate results.


title: Divide bounded sets into sets having smaller diameters

abstract: For each positive integer $m$ and each real finite dimensional Banach space $X$, we set $\beta(X,m)$ to be the infimum of $\delta\in (0,1]$ such that each set $A\subset X$ having diameter $1$ can be represented as the union of $m$ subsets of $A$ whose diameters are at most $\delta$. Elementary properties of $\beta(X,m)$, including its stability with respect to $X$ in the sense of Banach-Mazur metric, are presented. Two methods for estimating $\beta(X,m)$ are introduced. The first one estimates $\beta(X,m)$ using the knowledge of $\beta(Y,m)$, where $Y$ is a Banach space sufficiently close to $X$. The second estimation uses the information about $\beta_X(K,m)$, the infimum of $\delta\in(0,1]$ such that $K\subset X$ is the union of $m$ subsets having diameters not greater than $\delta$ times the diameter of $K$, for certain classes of convex bodies $K$ in $X$. In particular, we show that $\beta(l_p^3,8)\leq 0.925$ holds for each $p\in [1,+\infty]$ by applying the first method, and we proved that $\beta(X,8)<1$ whenever $X$ is a three-dimensional Banach space satisfying $\beta_X(B_X,8)<\frac{221}{328}$, where $B_X$ is the unit ball of $X$, by applying the second method. These results and methods are closely related to the extension of Borsuk's problem in finite dimensional Banach spaces and to C. Zong's computer program for Borsuk's conjecture.


title: SO(5) critical point in a spin-flavor Kondo device -- Bosonization and refermionization solution

abstract: We investigate a well studied system of a quantum dot coupled to a Coulomb box and leads, realizing a spin-flavor Kondo model. It exhibits a recently discovered non-Fermi liquid (NFL) behavior with emergent SO(5) symmetry. Here, through a detailed bosonization and refermionization solution, we push forward our previous work and provide a consistent and complete description of the various exotic properties and phase diagram. A unique NFL phase emerges from the presence of an uncoupled Majorana fermion from the flavor sector, whereas FL-like susceptibilities result from the gapping out of a pair of Majroana fermions from the spin and flavor sectors. Other properties, such as a $T^{3/2}$ scaling of the conductance, stability under channel or spin symmetry breaking and a re-appearance of NFL behavior upon breaking the particle-hole symmetry, are all accounted for by a renormalization group treatment of the refermionized Majorana model.


title: Learning the Superpixel in a Non-iterative and Lifelong Manner

abstract: Superpixel is generated by automatically clustering pixels in an image into hundreds of compact partitions, which is widely used to perceive the object contours for its excellent contour adherence. Although some works use the Convolution Neural Network (CNN) to generate high-quality superpixel, we challenge the design principles of these networks, specifically for their dependence on manual labels and excess computation resources, which limits their flexibility compared with the traditional unsupervised segmentation methods. We target at redefining the CNN-based superpixel segmentation as a lifelong clustering task and propose an unsupervised CNN-based method called LNS-Net. The LNS-Net can learn superpixel in a non-iterative and lifelong manner without any manual labels. Specifically, a lightweight feature embedder is proposed for LNS-Net to efficiently generate the cluster-friendly features. With those features, seed nodes can be automatically assigned to cluster pixels in a non-iterative way. Additionally, our LNS-Net can adapt the sequentially lifelong learning by rescaling the gradient of weight based on both channel and spatial context to avoid overfitting. Experiments show that the proposed LNS-Net achieves significantly better performance on three benchmarks with nearly ten times lower complexity compared with other state-of-the-art methods.


title: Masked Conditional Random Fields for Sequence Labeling

abstract: Conditional Random Field (CRF) based neural models are among the most performant methods for solving sequence labeling problems. Despite its great success, CRF has the shortcoming of occasionally generating illegal sequences of tags, e.g. sequences containing an "I-" tag immediately after an "O" tag, which is forbidden by the underlying BIO tagging scheme. In this work, we propose Masked Conditional Random Field (MCRF), an easy to implement variant of CRF that impose restrictions on candidate paths during both training and decoding phases. We show that the proposed method thoroughly resolves this issue and brings consistent improvement over existing CRF-based models with near zero additional cost.


title: Discovering Redundant Activities in Event Logs for the Simplification of Process Models

abstract: Process mining acts as a valuable tool to analyse the behaviour of an organisation by offering techniques to discover, monitor and enhance real processes. The key to process mining is to discovery understandable process models. However, real-life logs can be complex with redundant activities, which share similar behaviour but have different syntax. We show that the existence of such redundant activities heavily affects the quality of discovered process models. Existing approaches filter activities by frequency, which cannot solve problems caused by redundant activities. In this paper, we propose first to discover redundant activities in the log level and, then, use the discovery results to simplify event logs. Two publicly available data sets are used to evaluate the usability of our approach in real-life processes. Our approach can be adopted as a preprocessing step before applying any discovery algorithms to produce simplify models.


title: On a recolouring version of Hadwiger's conjecture

abstract: We prove that for any $\varepsilon>0$, for any large enough $t$, there is a graph $G$ that admits no $K_t$-minor but admits a $(\frac32-\varepsilon)t$-colouring that is "frozen" with respect to Kempe changes, i.e. any two colour classes induce a connected component. This disproves three conjectures of Las Vergnas and Meyniel from 1981.


title: Controllable Generation from Pre-trained Language Models via Inverse Prompting

abstract: Large-scale pre-trained language models have demonstrated strong capabilities of generating realistic text. However, it remains challenging to control the generation results. Previous approaches such as prompting are far from sufficient, which limits the usage of language models. To tackle this challenge, we propose an innovative method, inverse prompting, to better control text generation. The core idea of inverse prompting is to use generated text to inversely predict the prompt during beam search, which enhances the relevance between the prompt and the generated text and provides better controllability. Empirically, we pre-train a large-scale Chinese language model to perform a systematic study using human evaluation on the tasks of open-domain poem generation and open-domain long-form question answering. Our results show that our proposed method substantially outperforms the baselines and that our generation quality is close to human performance on some of the tasks. Narrators can try our poem generation demo at https://pretrain.aminer.cn/apps/poetry.html, while our QA demo can be found at https://pretrain.aminer.cn/app/qa. For researchers, the code is provided in https://github.com/THUDM/InversePrompting.


title: A Self-adaptive SAC-PID Control Approach based on Reinforcement Learning for Mobile Robots

abstract: Proportional-integral-derivative (PID) control is the most widely used in industrial control, robot control and other fields. However, traditional PID control is not competent when the system cannot be accurately modeled and the operating environment is variable in real time. To tackle these problems, we propose a self-adaptive model-free SAC-PID control approach based on reinforcement learning for automatic control of mobile robots. A new hierarchical structure is developed, which includes the upper controller based on soft actor-critic (SAC), one of the most competitive continuous control algorithms, and the lower controller based on incremental PID controller. Soft actor-critic receives the dynamic information of the mobile robot as input, and simultaneously outputs the optimal parameters of incremental PID controllers to compensate for the error between the path and the mobile robot in real time. In addition, the combination of 24-neighborhood method and polynomial fitting is developed to improve the adaptability of SAC-PID control method to complex environments. The effectiveness of the SAC-PID control method is verified with several different difficulty paths both on Gazebo and real mecanum mobile robot. Futhermore, compared with fuzzy PID control, the SAC-PID method has merits of strong robustness, generalization and real-time performance.


title: Low differentially uniform permutations from Dobbertin APN function over $\mathbb{F}_{2^n}$

abstract: Block ciphers use S-boxes to create confusion in the cryptosystems. Such S-boxes are functions over $\mathbb{F}_{2^{n}}$. These functions should have low differential uniformity, high nonlinearity, and high algebraic degree in order to resist differential attacks, linear attacks, and higher order differential attacks, respectively. In this paper, we construct new classes of differentially $4$ and $6$-uniform permutations by modifying the image of the Dobbertin APN function $x^{d}$ with $d=2^{4k}+2^{3k}+2^{2k}+2^{k}-1$ over a subfield of $\mathbb{F}_{2^{n}}$. Furthermore, the algebraic degree and the lower bound of the nonlinearity of the constructed functions are given.


title: Production cross sections and angular distributions of neutron-rich rare isotopes from 15 MeV/nucleon Kr-induced collisions: toward the r-process path

abstract: We present our recent study of cross sections and angular distributions of projectile fragments from heavy-ion reactions at beam energy of 15 MeV/nucleon. We studied the production cross sections and the angular distributions of neutron-rich nuclides from collisions of a 86 Kr (15 MeV/nucleon) beam with heavy targets ( 64 Ni, 124 Sn and 238 U). Experimental data from our previous work at Texas A & M were compared with model calculations. Our calculations were based on a two-step approach: the dynamical stage of the collision was described with, first, the phenomenological Deep-Inelastic Transfer model (DIT) and, alternatively, with the microscopic Constrained Molecular Dynamics model (CoMD). The de-excitation of the hot heavy projectile fragments was performed with the Statistical Multifragmentation Model (SMM). An overall good discription of the available data was obtained with the models employed. Furthermore, we performed calculations with a radioactive beam of 92 Kr (15 MeV/nucleon) interacting with a target of 238 U. We observed that the multinucleon transfer mechanism leads to extremely neutron-rich nuclides toward and beyond the astrophysical r-process path.


title: Interpretable Deep Learning: Interpretation, Interpretability, Trustworthiness, and Beyond

abstract: Deep neural networks have been well-known for their superb handling of various machine learning and artificial intelligence tasks. However, due to their over-parameterized black-box nature, it is often difficult to understand the prediction results of deep models. In recent years, many interpretation tools have been proposed to explain or reveal how deep models make decisions. In this paper, we review this line of research and try to make a comprehensive survey. Specifically, we first introduce and clarify two basic concepts -- interpretations and interpretability -- that people usually get confused about. To address the research efforts in interpretations, we elaborate the designs of a number of interpretation algorithms, from different perspectives, by proposing a new taxonomy. Then, to understand the interpretation results, we also survey the performance metrics for evaluating interpretation algorithms. Further, we summarize the current works in evaluating models' interpretability using "trustworthy" interpretation algorithms. Finally, we review and discuss the connections between deep models' interpretations and other factors, such as adversarial robustness and learning from interpretations, and we introduce several open-source libraries for interpretation algorithms and evaluation approaches.


title: Efficient Deep Reinforcement Learning with Imitative Expert Priors for Autonomous Driving

abstract: Deep reinforcement learning (DRL) is a promising way to achieve human-like autonomous driving. However, the low sample efficiency and difficulty of designing reward functions for DRL would hinder its applications in practice. In light of this, this paper proposes a novel framework to incorporate human prior knowledge in DRL, in order to improve the sample efficiency and save the effort of designing sophisticated reward functions. Our framework consists of three ingredients, namely expert demonstration, policy derivation, and reinforcement learning. In the expert demonstration step, a human expert demonstrates their execution of the task, and their behaviors are stored as state-action pairs. In the policy derivation step, the imitative expert policy is derived using behavioral cloning and uncertainty estimation relying on the demonstration data. In the reinforcement learning step, the imitative expert policy is utilized to guide the learning of the DRL agent by regularizing the KL divergence between the DRL agent's policy and the imitative expert policy. To validate the proposed method in autonomous driving applications, two simulated urban driving scenarios (unprotected left turn and roundabout) are designed. The strengths of our proposed method are manifested by the training results as our method can not only achieve the best performance but also significantly improve the sample efficiency in comparison with the baseline algorithms (particularly 60\% improvement compared to soft actor-critic). In testing conditions, the agent trained by our method obtains the highest success rate and shows diverse and human-like driving behaviors as demonstrated by the human expert.


title: Momentum Distributions of Projectile Fragments from Heavy-ion Peripheral Collisions at 15 MeV/nucleon with Emphasis on Trans-Projectile Isotopes

abstract: This paper presents our recent efforts to study the momentum distributions as well as the production of neutron-rich rare isotopes with heavy-ion beams in the energy region of 15 MeV/nucleon. Experimental cross sections of neutron-rich nuclides from collisions of a 86 Kr (15 MeV/nucleon) beam with 64 Ni and 58 Ni targets are presented. Experimental data were obtained from the previous work of our group with the MARS mass spectrometer at the Cyclotron Institute of Texas A&M University. On that note, detailed calculations of yields and momentum distributions of neutron-rich projectile-like fragments are presented for the interaction of 86 Kr with 64 Ni and compared with the aforementioned experimental data. The calculations were based on a two-step general approach: the dynamical stage of the primary interaction was described with the phenomenological deep-inelastic transfer model (DIT) and the microscopic constrained molecular dynamics model (CoMD); the deexcitation stage of the excited projectile fragments was described with the statistical binary-decay model GEMINI. The experimental data show an enhancement in the production of neutron-rich isotopes close to the projectile, and interestingly of heavier than the projectile neutron-rich nuclei. The behaviour of the data is relative to the predictions of the CoMD/GEMINI calculation. The study of the momentum distributions offers a novel route to study the reaction mechanism that dominates the production of the fragments of interest in peripheral heavy-ion collisions at intermediate energies. In the future, we plan to analyze experimental data that were obtained from the MAGNEX spectometer at the INFN-LNS in Catania, Italy.


title: Selectively Delaying Instructions to Prevent Microarchitectural Replay Attacks

abstract: MicroScope, and microarchitectural replay attacks in general, take advantage of the characteristics of speculative execution to trap the execution of the victim application in an infinite loop, enabling the attacker to amplify a side-channel attack by executing it indefinitely. Due to the nature of the replay, it can be used to effectively attack security critical trusted execution environments (secure enclaves), even under conditions where a side-channel attack would not be possible. At the same time, unlike speculative side-channel attacks, MicroScope can be used to amplify the correct path of execution, rendering many existing speculative side-channel defences ineffective. In this work, we generalize microarchitectural replay attacks beyond MicroScope and present an efficient defence against them. We make the observation that such attacks rely on repeated squashes of so-called "replay handles" and that the instructions causing the side-channel must reside in the same reorder buffer window as the handles. We propose Delay-on-Squash, a technique for tracking squashed instructions and preventing them from being replayed by speculative replay handles. Our evaluation shows that it is possible to achieve full security against microarchitectural replay attacks with very modest hardware requirements, while still maintaining 97% of the insecure baseline performance.


title: Adversarial and Contrastive Variational Autoencoder for Sequential Recommendation

abstract: Sequential recommendation as an emerging topic has attracted increasing attention due to its important practical significance. Models based on deep learning and attention mechanism have achieved good performance in sequential recommendation. Recently, the generative models based on Variational Autoencoder (VAE) have shown the unique advantage in collaborative filtering. In particular, the sequential VAE model as a recurrent version of VAE can effectively capture temporal dependencies among items in user sequence and perform sequential recommendation. However, VAE-based models suffer from a common limitation that the representational ability of the obtained approximate posterior distribution is limited, resulting in lower quality of generated samples. This is especially true for generating sequences. To solve the above problem, in this work, we propose a novel method called Adversarial and Contrastive Variational Autoencoder (ACVAE) for sequential recommendation. Specifically, we first introduce the adversarial training for sequence generation under the Adversarial Variational Bayes (AVB) framework, which enables our model to generate high-quality latent variables. Then, we employ the contrastive loss. The latent variables will be able to learn more personalized and salient characteristics by minimizing the contrastive loss. Besides, when encoding the sequence, we apply a recurrent and convolutional structure to capture global and local relationships in the sequence. Finally, we conduct extensive experiments on four real-world datasets. The experimental results show that our proposed ACVAE model outperforms other state-of-the-art methods.


title: Semantic Contextual Reasoning to Provide Human Behavior

abstract: In recent years, the world has witnessed various primitives pertaining to the complexity of human behavior. Identifying an event in the presence of insufficient, incomplete, or tentative premises along with the constraints on resources such as time, data and memory is a vital aspect of an intelligent system. Data explosion presents one of the most challenging research issues for intelligent systems; to optimally represent and store this heterogeneous and voluminous data semantically to provide human behavior. There is a requirement of intelligent but personalized human behavior subject to constraints on resources and priority of the user. Knowledge, when represented in the form of an ontology, procures an intelligent response to a query posed by users; but it does not offer content in accordance with the user context. To this aim, we propose a model to quantify the user context and provide semantic contextual reasoning. A diagnostic belief algorithm (DBA) is also presented that identifies a given event and also computes the confidence of the decision as a function of available resources, premises, exceptions, and desired specificity. We conduct an empirical study in the domain of day-to-day routine queries and the experimental results show that the answer to queries and also its confidence varies with user context.


title: QROSS: QUBO Relaxation Parameter Optimisation via Learning Solver Surrogates

abstract: An increasingly popular method for solving a constrained combinatorial optimisation problem is to first convert it into a quadratic unconstrained binary optimisation (QUBO) problem, and solve it using a standard QUBO solver. However, this relaxation introduces hyper-parameters that balance the objective and penalty terms for the constraints, and their chosen values significantly impact performance. Hence, tuning these parameters is an important problem. Existing generic hyper-parameter tuning methods require multiple expensive calls to a QUBO solver, making them impractical for performance critical applications when repeated solutions of similar combinatorial optimisation problems are required. In this paper, we propose the QROSS method, in which we build surrogate models of QUBO solvers via learning from solver data on a collection of instances of a problem. In this way, we are able capture the common structure of the instances and their interactions with the solver, and produce good choices of penalty parameters with fewer number of calls to the QUBO solver. We take the Traveling Salesman Problem (TSP) as a case study, where we demonstrate that our method can find better solutions with fewer calls to QUBO solver compared with conventional hyper-parameter tuning techniques. Moreover, with simple adaptation methods, QROSS is shown to generalise well to out-of-distribution datasets and different types of QUBO solvers.


title: Robust state and protection-level estimation within tightly coupled GNSS/INS navigation system

abstract: In autonomous applications for mobility and transport, a high-rate and highly accurate vehicle-state estimation is achieved by fusing measurements of global navigation satellite systems (GNSS) and inertial sensors. The state estimation and its protection-level generation often suffer from satellite-signal disturbances in urban environments and subsequent poor parametrization of the satellite observables. Thus, we propose an innovative scheme involving an extended H_infinity filter (EHF) for robust state estimation and zonotope for the protection-level generation. This scheme is shown as part of a tightly coupled navigation system based on an inertial navigation system and aided by the GPS/Galileo dual-constellation satellite navigation system. Specifically, GNSS pseudorange and deltarange observables are utilized. The experimental results of post-processing a real-world dataset show significant advantages of EHF against a conventional extended Kalman filter regarding the navigation accuracy and robustness under various GNSS-measurement parametrizations and environmental circumstances. The zonotope-based protection-level calculation is proven valid, computationally affordable, and feasible for real-time implementations.


title: ConViT: Improving Vision Transformers with Soft Convolutional Inductive Biases

abstract: Convolutional architectures have proven extremely successful for vision tasks. Their hard inductive biases enable sample-efficient learning, but come at the cost of a potentially lower performance ceiling. Vision Transformers (ViTs) rely on more flexible self-attention layers, and have recently outperformed CNNs for image classification. However, they require costly pre-training on large external datasets or distillation from pre-trained convolutional networks. In this paper, we ask the following question: is it possible to combine the strengths of these two architectures while avoiding their respective limitations? To this end, we introduce gated positional self-attention (GPSA), a form of positional self-attention which can be equipped with a ``soft" convolutional inductive bias. We initialise the GPSA layers to mimic the locality of convolutional layers, then give each attention head the freedom to escape locality by adjusting a gating parameter regulating the attention paid to position versus content information. The resulting convolutional-like ViT architecture, ConViT, outperforms the DeiT on ImageNet, while offering a much improved sample efficiency. We further investigate the role of locality in learning by first quantifying how it is encouraged in vanilla self-attention layers, then analysing how it is escaped in GPSA layers. We conclude by presenting various ablations to better understand the success of the ConViT. Our code and models are released publicly at https://github.com/facebookresearch/convit.


title: AutoTune: Controller Tuning for High-Speed Flight

abstract: Due to noisy actuation and external disturbances, tuning controllers for high-speed flight is very challenging. In this paper, we ask the following questions: How sensitive are controllers to tuning when tracking high-speed maneuvers? What algorithms can we use to automatically tune them? To answer the first question, we study the relationship between parameters and performance and find out that the faster the maneuver, the more sensitive a controller becomes to its parameters. To answer the second question, we review existing methods for controller tuning and discover that prior works often perform poorly on the task of high-speed flight. Therefore, we propose AutoTune, a sampling-based tuning algorithm specifically tailored to high-speed flight. In contrast to previous work, our algorithm does not assume any prior knowledge of the drone or its optimization function and can deal with the multi-modal characteristics of the parameters' optimization space. We thoroughly evaluate AutoTune both in simulation and in the physical world. In our experiments, we outperform existing tuning algorithms by up to 90% in trajectory completion. The resulting controllers are tested in the AirSim Game of Drones competition, where we outperform the winner by up to 25% in lap-time. Finally, we show that AutoTune improves tracking error when flying a physical platform with respect to parameters tuned by a human expert.


title: MDMMT: Multidomain Multimodal Transformer for Video Retrieval

abstract: We present a new state-of-the-art on the text to video retrieval task on MSRVTT and LSMDC benchmarks where our model outperforms all previous solutions by a large margin. Moreover, state-of-the-art results are achieved with a single model on two datasets without finetuning. This multidomain generalisation is achieved by a proper combination of different video caption datasets. We show that training on different datasets can improve test results of each other. Additionally we check intersection between many popular datasets and found that MSRVTT has a significant overlap between the test and the train parts, and the same situation is observed for ActivityNet.


title: Proper time reparametrization in cosmology: Mobius symmetry and Kodama charges

abstract: It has been noticed that for a large class of cosmological models, the gauge fixing of the time-reparametrization invariance does not completely fix the clock. Instead, the system enjoys a surprising residual Noether symmetry under a M\"{o}bius reparametrization of the proper time, which maps gauge-inequivalent solutions to the Friedman equations onto each other. In this work, we provide a unified treatment of this hidden conformal symmetry and its realization in the homogeneous and isotropic sector of the Einstein-Scalar-$\Lambda$ system. We consider the flat Friedmann-Robertson-Walker (FRW) model, the (A)dS cosmology and provide a first treatment of the model with spatial constant curvature. We derive the general condition relating the choice of proper time and the conformal weight of the scale factor, and give a detailed analysis of the conserved Noether charges generating this physical symmetry. Our approach allows us to identify new realizations of this symmetry while recovering previous results in a unified manner. We also present the general mapping onto the conformal particle and discuss the solution-generating nature of the transformations beyond the M\"{o}bius symmetry. Finally, we show that, at least in a restricted context, this hidden conformal symmetry is intimately related to the Kodama charges of spherically symmetric gravity. This new connection suggests that the M\"{o}bius invariance of cosmology is only the corner of a larger symmetry structure which could be relevant beyond cosmological models.


title: Weakly Complete Semantics Based on Undecidedness Blocking

abstract: In this paper we introduce a novel family of semantics called weakly complete semantics. Differently from Dung's complete semantics, weakly complete semantics employs a mechanism called undecidedness blocking by which the label undecided of an attacking argument is not always propagated to an otherwise accepted attacked argument. The new semantics are conflict-free, non-admissible but employing a weaker notion of admissibility; they allow reinstatement and they retain the majority of properties of complete semantics. We show how both weakly complete and Dung's complete semantics can be generated by applying different undecidedness blocking strategies, making undecidedness blocking a unifying mechanism underlying argumentation semantics. The semantics are also an example of ambiguity blocking Dunganian semantics and the first semantics to tackle the problem of self-defeating attacking arguments. In the last part of the paper we compare weakly complete semantics with the recent work of Baumann et al. on weakly admissible semantics. Since the two families of semantics do not coincide, a principle-based analysis of the two approaches is provided. The analysis shows how our semantics satisfy a number of principles satisfied by Dung's complete semantics but not by Baumann et al. semantics, including directionality, abstention, SCC-decomposability and cardinality of extensions, making them a more faithful non-admissible version of Dung' semantics.


title: ClawCraneNet: Leveraging Object-level Relation for Text-based Video Segmentation

abstract: Text-based video segmentation is a challenging task that segments out the natural language referred objects in videos. It essentially requires semantic comprehension and fine-grained video understanding. Existing methods introduce language representation into segmentation models in a bottom-up manner, which merely conducts vision-language interaction within local receptive fields of ConvNets. We argue that such interaction is not fulfilled since the model can barely construct region-level relationships given partial observations, which is contrary to the description logic of natural language/referring expressions. In fact, people usually describe a target object using relations with other objects, which may not be easily understood without seeing the whole video. To address the issue, we introduce a novel top-down approach by imitating how we human segment an object with the language guidance. We first figure out all candidate objects in videos and then choose the refereed one by parsing relations among those high-level objects. Three kinds of object-level relations are investigated for precise relationship understanding, i.e., positional relation, text-guided semantic relation, and temporal relation. Extensive experiments on A2D Sentences and J-HMDB Sentences show our method outperforms state-of-the-art methods by a large margin. Qualitative results also show our results are more explainable.


title: Lessons Learned from Educating AI Engineers

abstract: Over the past three years we have built a practice-oriented, bachelor level, educational programme for software engineers to specialize as AI engineers. The experience with this programme and the practical assignments our students execute in industry has given us valuable insights on the profession of AI engineer. In this paper we discuss our programme and the lessons learned for industry and research.


title: First-principles study of defects at $\Sigma3$ grain boundaries in CuGaSe$_2$

abstract: We present a first-principles computational study of cation-Se $\Sigma$3 (112) grain boundaries in CuGaSe$_2$. We discuss the structure of these grain boundaries, as well as the effect of native defects and Na impurities on their electronic properties. The formation energies show that the defects will tend to form preferentially at the grain boundaries, rather than in the grain interiors. We find that in Ga-rich growth conditions Cu vacancies as well as Ga at Cu and Cu at Ga antisites are mainly responsible for having the equilibrium Fermi level pinned toward the middle of the gap, resulting in carrier depletion. The Na at Cu impurity in its +1 charge state contributes to this. In Ga-poor growth conditions, on the other hand, the formation energies of Cu vacancies and Ga at Cu antisites are comparatively too high for any significant influence on carrier density or on the equilibrium Fermi level position. Thus, under these conditions, the Cu at Ga antisites give rise to a $p$-type grain boundary. Also, their formation energy is lower than the formation energy of Na at Cu impurities. Thus, the latter will fail to act as a hole barrier preventing recombination at the grain boundary, in contrast to what occurs in CuInSe$_2$ grain boundaries. We also discuss the effect of the defects on the electronic properties of bulk CuGaSe$_2$, which we assume reflect the properties of the grain interiors.


title: Continuous iterative algorithms for anti-Cheeger cut

abstract: As a judicious correspondence to the classical maxcut, the anti-Cheeger cut has more balanced structure, but few numerical results on it have been reported so far. In this paper, we propose a continuous iterative algorithm for the anti-Cheeger cut problem through fully using an equivalent continuous formulation. It does not need rounding at all and has advantages that all subproblems have explicit analytic solutions, the objection function values are monotonically updated and the iteration points converge to a local optima in finite steps via an appropriate subgradient selection. It can also be easily combined with the maxcut iterations for breaking out of local optima and improving the solution quality thanks to the similarity between the anti-Cheeger cut problem and the maxcut problem. Numerical experiments on G-set demonstrate the performance.