title: Uncertainty-Aware Adaptation for Self-Supervised 3D Human Pose Estimation

abstract: The advances in monocular 3D human pose estimation are dominated by supervised techniques that require large-scale 2D/3D pose annotations. Such methods often behave erratically in the absence of any provision to discard unfamiliar out-of-distribution data. To this end, we cast the 3D human pose learning as an unsupervised domain adaptation problem. We introduce MRP-Net that constitutes a common deep network backbone with two output heads subscribing to two diverse configurations; a) model-free joint localization and b) model-based parametric regression. Such a design allows us to derive suitable measures to quantify prediction uncertainty at both pose and joint level granularity. While supervising only on labeled synthetic samples, the adaptation process aims to minimize the uncertainty for the unlabeled target images while maximizing the same for an extreme out-of-distribution dataset (backgrounds). Alongside synthetic-to-real 3D pose adaptation, the joint-uncertainties allow expanding the adaptation to work on in-the-wild images even in the presence of occlusion and truncation scenarios. We present a comprehensive evaluation of the proposed approach and demonstrate state-of-the-art performance on benchmark datasets.


title: Hydrogenation induced magnetic and electronic transitions in monolayer electride Gd$_2$C: A first-principles study

abstract: The recently synthesized two-dimensional electride Gd$_2$C was proposed to be a ferromagnetic metal that possesses multiple pairs of Weyl points and may display a large anomalous Hall conductivity [Liu \textit{et al.}, Phys. Rev. Lett. \textbf{125}, 187203 (2020)]. In view of its layered structure, here we carry out first-principles studies on the magnetic and electronic properties of Gd$_2$C in the ultrathin monolayer limit. We find that monolayer Gd$_2$C remains ferromagnetic like the bulk form and the hydrogenation can effectively tune its magnetism and electronic structure. With one-sided coverage of hydrogen atoms, monolayer Gd$_2$C becomes a half-metal with one spin channel around the Fermi level. For two-sided hydrogenation, monolayer Gd$_2$C transforms to an antiferromagnetic insulator with a band gap of 0.8 eV. Our studies show that monolayer electride Gd$_2$C can perform multiple magnetic and electronic transitions with different levels of hydrogenation and may be also adopted to construct a planar heterojunction with selective area adsorption of hydrogen atoms, which has promising applications in future electronic and spintronic devices.


title: A mathematical model for planning oil products distribution via pipeline

abstract: Compared to other transportation modes, road, railroad and vessel, multiproduct pipelines are the safest and most economical way of conveying petroleum products over long distances day and night. During the last two decades, the operational multiproduct pipeline scheduling has gained increasing attention, where most of the contributions are based on continuous time representation. In this paper, we present a new discrete-time mixed integer linear programming model for the shortterm scheduling of multiproduct pipelines featuring multiple refineries and distribution centers. The model optimally determines the sequence and planning of product injections at input nodes, the sequence of product deliveries to output nodes, and traces the size and the products location along the pipeline at any time. The proposed model also allows to execute simultaneous injections at the input nodes and to tackle simultaneous injections and deliveries at an intermediate node that can act as both the input and output node. Solutions to two benchmark example problems illustrate that the proposed model presents significant reductions in the pipeline operational cost.


title: Frequency Dynamic Convolution: Frequency-Adaptive Pattern Recognition for Sound Event Detection

abstract: 2D convolution is widely used in sound event detection (SED) to recognize two dimensional time-frequency patterns of sound events. However, 2D convolution enforces translation equivariance on sound events along both time and frequency axis while frequency is not shift-invariant dimension. In order to improve physical consistency of 2D convolution on SED, we propose frequency dynamic convolution which applies kernel that adapts to frequency components of input. Frequency dynamic convolution outperforms the baseline by 6.3% in DESED validation dataset in terms of polyphonic sound detection score (PSDS). It also significantly outperforms other pre-existing content-adaptive methods on SED. In addition, by comparing class-wise F1 scores of baseline and frequency dynamic convolution, we showed that frequency dynamic convolution is especially more effective for detection of non-stationary sound events with intricate time-frequency patterns. From this result, we verified that frequency dynamic convolution is superior in recognizing frequency-dependent patterns.


title: Kernel Modulation: A Parameter-Efficient Method for Training Convolutional Neural Networks

abstract: Deep Neural Networks, particularly Convolutional Neural Networks (ConvNets), have achieved incredible success in many vision tasks, but they usually require millions of parameters for good accuracy performance. With increasing applications that use ConvNets, updating hundreds of networks for multiple tasks on an embedded device can be costly in terms of memory, bandwidth, and energy. Approaches to reduce this cost include model compression and parameter-efficient models that adapt a subset of network layers for each new task. This work proposes a novel parameter-efficient kernel modulation (KM) method that adapts all parameters of a base network instead of a subset of layers. KM uses lightweight task-specialized kernel modulators that require only an additional 1.4% of the base network parameters. With multiple tasks, only the task-specialized KM weights are communicated and stored on the end-user device. We applied this method in training ConvNets for Transfer Learning and Meta-Learning scenarios. Our results show that KM delivers up to 9% higher accuracy than other parameter-efficient methods on the Transfer Learning benchmark.


title: A Wavelet, AR and SVM based hybrid method for short-term wind speed prediction

abstract: Wind speed modelling and prediction has been gaining importance because of its significant roles in various stages of wind energy management. In this paper, we propose a hybrid model, based on wavelet transform to improve the accuracy of the short-term forecast. The wind speed time series are split into various frequency components using wavelet decomposition technique, and each frequency components are modelled separately. Since the components associated with the high- frequency range shows stochastic nature, we modelled them with autoregressive (AR) method and rest of low-frequency components modelled with support vector machine (SVM). The results of the hybrid method show a promising improvement in accuracy of wind speed prediction compared to that of stand-alone AR or SVM model.


title: A new experiment to detect dark matter in sub-MeV range using semiconductor superlattice superstructures (SSS)

abstract: About $26\%$ of the matter in our Universe is made up of Dark Matter (DM), which interacts with Standard Model (SM) matter only through gravitational or weak interactions. Many proposals have been made by scientists about the possible candidates of DM - WIMPs, axions, ALPs, black holes etc. And range of its mass could be extremely broad - from Planck scale to as light as $10^{-22}$ eV. Experiments to detect DM are extremely challenging, as DM does not exhibit appreciable interactions with ordinary matter. May be due to such elusive nature, so far it has not been possible to detect DM, though many experiments are going on worldwide to do so. With about 40 orders of magnitude variation in their mass, it is possible that their gravitational interaction too is very weak, and many creative proposals have been made to detect possible DM candidates, with vast variation of techniques and target materials. In this work, we propose a new experiment to detect sub-MeV range DM particles, using the semiconductor superlattice superstructure (SSS) as the target material. Such materials have band gap of the order of few hundreds of milli eV, and are suitable for detecting sub-MeV range particles scattering off electrons. The photons emitted as a result of excitation of SSS lie in the micrometer range and may be detected via quantum cascade lasers (QCL).


title: Mesoscopic System: Semiclassical vs Quantum

abstract: We explain a hierarchy of Friedel sum rule like formulas that help us understand response of mesoscopic systems to applied electric and magnetic fields. The formulas can be derived fully quantum mechanically and then there is a mathematical way to argue a semiclassical limit which may make the formulas practically relevant. But the mathematical prescription is not physically relevant in presence of a Fano resonance. A proper understanding of what exactly is the physical semiclassical limit is therefor not known and require future work.


title: Pointwise Assouad dimension for measures

abstract: We introduce a pointwise variant of the Assouad dimension for measures on metric spaces, and study its properties in relation to the global Assouad dimension. We show that, in general, the value of the pointwise Assouad dimension differs from the global counterpart, but in many classical cases, it exhibits similar exact dimensionality properties as the classical local dimension, namely it equals the global Assouad dimension at almost every point. We also compute the Assouad dimension of invariant measures with place dependent probabilities supported on strongly separated self-conformal sets.


title: Eigenlanes: Data-Driven Lane Descriptors for Structurally Diverse Lanes

abstract: A novel algorithm to detect road lanes in the eigenlane space is proposed in this paper. First, we introduce the notion of eigenlanes, which are data-driven descriptors for structurally diverse lanes, including curved, as well as straight, lanes. To obtain eigenlanes, we perform the best rank-M approximation of a lane matrix containing all lanes in a training set. Second, we generate a set of lane candidates by clustering the training lanes in the eigenlane space. Third, using the lane candidates, we determine an optimal set of lanes by developing an anchor-based detection network, called SIIC-Net. Experimental results demonstrate that the proposed algorithm provides excellent detection performance for structurally diverse lanes. Our codes are available at https://github.com/dongkwonjin/Eigenlanes.


title: Pseudodifferential operators on Mixed-Norm $\alpha$-modulation spaces

abstract: Mixed-norm $\alpha$-modulation spaces were introduced recently by Cleanthous and Georgiadis [Trans.\ Amer.\ Math.\ Soc.\ 373 (2020), no. 5, 3323-3356]. The mixed-norm spaces $M^{s,\alpha}_{\vec{p},q}(\mathbb{R}^n)$, $\alpha\in [0,1]$, form a family of smoothness spaces that contain the mixed-norm Besov spaces as special cases. In this paper we prove that a pseudodifferential operator $\sigma(x,D)$ with symbol in the H\"ormander class $S^b_{\rho}$ extends to a bounded operator $\sigma(x,D)\colon M^{s,\alpha}_{\vec{p},q}(\mathbb{R}^n) \rightarrow M^{s-b,\alpha}_{\vec{p},q}(\mathbb{R}^n)$ provided $0<\alpha\leq \rho\leq 1$, $\vec{p}\in (0,\infty)^n$, and $0<q<\infty$. The result extends the known result that pseudodifferential operators with symbol in the class $S^b_{1}$ maps the mixed-norm Besov space $B^s_{\vec{p},q}(\mathbb{R}^n)$ into $B^{s-b}_{\vec{p},q}(\mathbb{R}^n)$.


title: A Practical and Scalable Decoder for Topological Quantum Error Correction with Digital Annealer

abstract: Quantum error correction is one of the most important milestones for realization of large-scale quantum computation. To achieve this, it is essential not only to integrate a large number of qubits with high fidelity, but also to build a scalable classical system that can perform error correction. Here, we propose an efficient and scalable decoder for quantum error correction using Fujitsu Digital Annealer (DA). Specifically, the error correction problem of stabilizer codes is mapped into an Ising-type optimization problem, so-called quadratic unconstrained binary optimization (QUBO) problem, which is solved by DA. In particular, we implement the proposed DA decoder for the surface code and perform detailed numerical experiments for various code distances to see its performance and scalability. We observe that computational scaling for the DA decoder has a lower order of polynomial than the decoding methods using simulated annealing (SA) and minimum-weight perfect matching (MWPM) algorithm under all tested conditions. It is also shown that the DA decoder has advantages over the Union-Find (UF) decoder from a variety of perspectives including hardware implementation. Furthermore, the threshold behavior of the logical error probability for the DA decoder is analyzed and the resultant threshold lies between 9.4% and 9.8%, which is very close to that obtained by the MWPM decoder. This result clearly shows the high potential of the DA decoder for quantum error correction.


title: Suboptimal Safety-Critical Control for Continuous Systems Using Prediction-Correction Online Optimization

abstract: This paper investigates the control barrier function (CBF) based safety-critical control for continuous nonlinear control affine systems using the more efficient online algorithms through time-varying optimization. The idea lies in that when quadratic programming (QP) or other convex optimization algorithms needed in the CBF-based method is not computation affordable, the alternative suboptimal feasible solutions can be obtained more economically. By using the barrier-based interior point method, the constrained CBF-QP problems are converted into the unconstrained ones with suboptimal solutions tracked by two continuous descent-based algorithms. Considering the lag effect of tracking and exploiting the system information, the prediction method is added to the algorithms which thereby achieves a exponential convergence rate to the time-varying suboptimal solutions. The convergence and robustness of the designed methods as well as the safety criteria of the algorithms are analyzed theoretically. In the end, the effectiveness is illustrated by simulations on the anti-swing and obstacle avoidance tasks.


title: Better Integrators for Functional Renormalization Group Calculations

abstract: We analyze a variety of integration schemes for the momentum space functional renormalization group calculation with the goal of finding an optimized scheme. Using the square lattice $t-t'$ Hubbard model as a testbed we define and benchmark the quality. Most notably we define an error estimate of the solution for the ordinary differential equation circumventing the issues introduced by the divergences at the end of the FRG flow. Using this measure to control for accuracy we find a threefold reduction in number of required integration steps achievable by choice of integrator. We herewith publish a set of recommended choices for the functional renormalization group, shown to decrease the computational cost for FRG calculations and representing a valuable basis for further investigations.


title: Higher order moments for SPDE with monotone nonlinearities

abstract: This paper introduces a new $p$-dependent coercivity condition through which $L^p$-moments for solutions can be obtained for a large class of SPDEs in the variational framework. If $p=2$, our condition reduces to the classically coercivity condition, which only yields second moments for the solution. The abstract result is shown to be optimal. Moreover, the results are applied to obtain $L^p$-moments of solutions for several classical SPDEs such as stochastic heat equations with Dirichlet and Neumann boundary conditions, Burgers' equation and the Navier-Stokes equations in two spatial dimensions. Furthermore, we can recover recent results for systems of SPDEs and higher order SPDEs using our unifying coercivity condition.


title: Information criteria for sparse methods in causal inference

abstract: For propensity score analysis and sparse estimation, we develop an information criterion for determining the regularization parameters needed in variable selection. First, for Gaussian distribution-based causal inference models, we extend Stein's unbiased risk estimation theory, which leads to a generalized Cp criterion that has almost no weakness in conventional sparse estimation, and derive an inverse-probability-weighted sparse estimation version of the criterion without resorting to asymptotics. Next, for general causal inference models that are not necessarily Gaussian distribution-based, we extend the asymptotic theory on LASSO for propensity score analysis, with the intention of implementing doubly robust sparse estimation. From the asymptotic theory, an AIC-type information criterion for inverse-probability-weighted sparse estimation is given, and then a criterion with double robustness in itself is derived for doubly robust sparse estimation. Numerical experiments compare the proposed criterion with the existing criterion derived from a formal argument and verify that the proposed criterion is superior in almost all cases, that the difference is not negligible in many cases, and that the results of variable selection differ significantly. Real data analysis confirms that the difference between variable selection and estimation by these criteria is actually large. Finally, generalizations to general sparse estimation using group LASSO, elastic net, and non-convex regularization are made in order to indicate that the proposed criterion is highly extensible.


title: MatchNorm: Learning-based Point Cloud Registration for 6D Object Pose Estimation in the Real World

abstract: In this work, we tackle the task of estimating the 6D pose of an object from point cloud data. While recent learning-based approaches to addressing this task have shown great success on synthetic datasets, we have observed them to fail in the presence of real-world data. We thus analyze the causes of these failures, which we trace back to the difference between the feature distributions of the source and target point clouds, and the sensitivity of the widely-used SVD-based loss function to the range of rotation between the two point clouds. We address the first challenge by introducing a new normalization strategy, Match Normalization, and the second via the use of a loss function based on the negative log likelihood of point correspondences. Our two contributions are general and can be applied to many existing learning-based 3D object registration frameworks, which we illustrate by implementing them in two of them, DCP and IDAM. Our experiments on the real-scene TUD-L, LINEMOD and Occluded-LINEMOD datasets evidence the benefits of our strategies. They allow for the first time learning-based 3D object registration methods to achieve meaningful results on real-world data. We therefore expect them to be key to the future development of point cloud registration methods.


title: Hybrid Routing Transformer for Zero-Shot Learning

abstract: Zero-shot learning (ZSL) aims to learn models that can recognize unseen image semantics based on the training of data with seen semantics. Recent studies either leverage the global image features or mine discriminative local patch features to associate the extracted visual features to the semantic attributes. However, due to the lack of the necessary top-down guidance and semantic alignment for ensuring the model attending to the real attribute-correlation regions, these methods still encounter a significant semantic gap between the visual modality and the attribute modality, which makes their prediction on unseen semantics unreliable. To solve this problem, this paper establishes a novel transformer encoder-decoder model, called hybrid routing transformer (HRT). In HRT encoder, we embed an active attention, which is constructed by both the bottom-up and the top-down dynamic routing pathways to generate the attribute-aligned visual feature. While in HRT decoder, we use static routing to calculate the correlation among the attribute-aligned visual features, the corresponding attribute semantics, and the class attribute vectors to generate the final class label predictions. This design makes the presented transformer model a hybrid of 1) top-down and bottom-up attention pathways and 2) dynamic and static routing pathways. Comprehensive experiments on three widely-used benchmark datasets, namely CUB, SUN, and AWA2, are conducted. The obtained experimental results demonstrate the effectiveness of the proposed method.


title: Bulk charge density wave and electron-phonon coupling in superconducting copper oxychlorides

abstract: Bulk charge density waves are now reported in nearly all high-temperature superconducting cuprates, with the noticeable exception of one particular family: the copper oxychlorides. Here, we used resonant inelastic X-ray scattering to reveal a bulk charge density waves in these materials. Combining resonant inelastic X-ray scattering with non-resonant inelastic X-ray scattering, we investigate the interplay between the lattice excitations and the charge density wave, and evidence the phonon anomalies of the Cu-O bond-stretching mode at the charge density wave wave-vector. We propose that such electron-phonon anomalies occur in the presence of dispersive charge excitations emanating from the charge density wave and interacting with the Cu-O bond-stretching phonon. Our results pave the way for future studies, combining both bulk and surface probes, to investigate the static and dynamical properties of the charge density wave in the copper oxychloride family.


title: In-N-Out Generative Learning for Dense Unsupervised Video Segmentation

abstract: In this paper, we focus on unsupervised learning for Video Object Segmentation (VOS) which learns visual correspondence (i.e., the similarity between pixel-level features) from unlabeled videos. Previous methods are mainly based on the contrastive learning paradigm, which optimize either in image level or pixel level. Image-level optimization (e.g., the spatially pooled feature of ResNet) learns robust high-level semantics but is sub-optimal since the pixel-level features are optimized implicitly. By contrast, pixel-level optimization is more explicit, however, it is sensitive to the visual quality of training data and is not robust to object deformation. To complementarily perform these two levels of optimization in a unified framework, we propose the In-aNd-Out (INO) generative learning from a purely generative perspective with the help of naturally designed class tokens and patch tokens in Vision Transformer (ViT). Specifically, for image-level optimization, we force the out-view imagination from local to global views on class tokens, which helps capture high-level semantics, and we name it as out-generative learning. As to pixel-level optimization, we perform in-view masked image modeling on patch tokens, which recovers the corrupted parts of an image via inferring its fine-grained structure, and we term it as in-generative learning. To discover the temporal information better, we additionally force the inter-frame consistency from both feature and affinity matrix levels. Extensive experiments on DAVIS-2017 val and YouTube-VOS 2018 val show that our INO outperforms previous state-of-the-art methods by significant margins. Code is available: https://github.com/pansanity666/INO_VOS


title: Initial stability estimates for Ricci flow and three dimensional Ricci-pinched manifolds

abstract: This paper investigates the question of stability for a class of Ricci flows which start at possibly non-smooth metric spaces. We show that if the initial metric space is Reifenberg and locally bi-Lipschitz to Euclidean space, then two solutions to the Ricci flow whose Ricci curvature is uniformly bounded from below and whose curvature is bounded by $c\cdot t^{-1}$ converge to one another at an exponential rate once they have been appropriately gauged. As an application, we show that smooth three dimensional, complete, uniformly Ricci-pinched Riemannian manifolds with bounded curvature are either compact or flat, thus confirming a conjecture of Hamilton and Lott.


title: Cross-Modality High-Frequency Transformer for MR Image Super-Resolution

abstract: Improving the resolution of magnetic resonance (MR) image data is critical to computer-aided diagnosis and brain function analysis. Higher resolution helps to capture more detailed content, but typically induces to lower signal-to-noise ratio and longer scanning time. To this end, MR image super-resolution has become a widely-interested topic in recent times. Existing works establish extensive deep models with the conventional architectures based on convolutional neural networks (CNN). In this work, to further advance this research field, we make an early effort to build a Transformer-based MR image super-resolution framework, with careful designs on exploring valuable domain prior knowledge. Specifically, we consider two-fold domain priors including the high-frequency structure prior and the inter-modality context prior, and establish a novel Transformer architecture, called Cross-modality high-frequency Transformer (Cohf-T), to introduce such priors into super-resolving the low-resolution (LR) MR images. Experiments on two datasets indicate that Cohf-T achieves new state-of-the-art performance.


title: Box-counting dimension in one-dimensional random geometry of multiplicative cascades

abstract: We investigate the box-counting dimension of the image of a set $E \subset \mathbb{R}$ under a random multiplicative cascade function $f$. The corresponding result for Hausdorff dimension was established by Benjamini and Schramm in the context of random geometry, and for sufficiently regular sets, the same formula holds for the box-counting dimension. However, we show that this is far from true in general, and we compute explicitly a formula of a very different nature that gives the almost sure box-counting dimension of the random image $f(E)$ when the set $E$ comprises a convergent sequence. In particular, the box-counting dimension of $f(E)$ depends more subtly on $E$ than just on its dimensions. We also obtain lower and upper bounds for the box-counting dimension of the random images for general sets $E$.


title: Systematically Evaluation of Challenge Obfuscated APUFs

abstract: As a well-known physical unclonable function that can provide huge number of challenge response pairs (CRP) with a compact design and fully compatibility with current electronic fabrication process, the arbiter PUF (APUF) has attracted great attention. To improve its resilience against modeling attacks, many APUF variants have been proposed so far. Though the modeling resilience of response obfuscated APUF variants such as XOR-APUF and lightweight secure APUF (LSPUF) have been well studied, the challenge obfuscated APUFs (CO-APUFs) such as feed-forward APUF (FF-APUF), and XOR-FF-APUF are less elucidated, especially, with the deep learning (DL) methods. This work systematically evaluates five CO-APUFs including three influential designs of FF-APUF, XOR-FF-APUF, iPUF, one very recently design and our newly optimized design (dubbed as OAX-FF-APUF), in terms of their reliability, uniformity (related to uniqueness), and modeling resilience. Three DL techniques of GRU, TCN and MLP are employed to examine these CO-APUFs' modeling resilience -- the first two are newly explored. With computation resource of a common personal computer, we show that all five CO-APUFs with relatively large scale can be successfully modeled -- attacking accuracy higher or close to its reliability. The hyper-parameter tuning of DL technique is crucial for implementing efficient attacks. Increasing the scale of the CO-APUF is validated to be able to improve the resilience but should be done with minimizing the reliability degradation. As the powerful capability of DL technique affirmed by us, we recommend the DL, specifically the MLP technique always demonstrating best efficacy, to be always considered for examining the modeling resilience when newly composited APUFs are devised or to a large extent, other strong PUFs are constructed.


title: Agreement or Disagreement in Noise-tolerant Mutual Learning?

abstract: Deep learning has made many remarkable achievements in many fields but suffers from noisy labels in datasets. The state-of-the-art learning with noisy label method Co-teaching and Co-teaching+ confronts the noisy label by mutual-information between dual-network. However, the dual network always tends to convergent which would weaken the dual-network mechanism to resist the noisy labels. In this paper, we proposed a noise-tolerant framework named MLC in an end-to-end manner. It adjusts the dual-network with divergent regularization to ensure the effectiveness of the mechanism. In addition, we correct the label distribution according to the agreement between dual-networks. The proposed method can utilize the noisy data to improve the accuracy, generalization, and robustness of the network. We test the proposed method on the simulate noisy dataset MNIST, CIFAR-10, and the real-world noisy dataset Clothing1M. The experimental result shows that our method outperforms the previous state-of-the-art method. Besides, our method is network-free thus it is applicable to many tasks. Our code can be found at https://github.com/JiarunLiu/MLC.


title: Evolving Multi-Label Fuzzy Classifier

abstract: Multi-label classification has attracted much attention in the machine learning community to address the problem of assigning single samples to more than one class at the same time. We propose an evolving multi-label fuzzy classifier (EFC-ML) which is able to self-adapt and self-evolve its structure with new incoming multi-label samples in an incremental, single-pass manner. It is based on a multi-output Takagi-Sugeno type architecture, where for each class a separate consequent hyper-plane is defined. The learning procedure embeds a locally weighted incremental correlation-based algorithm combined with (conventional) recursive fuzzily weighted least squares and Lasso-based regularization. The correlation-based part ensures that the interrelations between class labels, a specific well-known property in multi-label classification for improved performance, are preserved properly; the Lasso-based regularization reduces the curse of dimensionality effects in the case of a higher number of inputs. Antecedent learning is achieved by product-space clustering and conducted for all class labels together, which yields a single rule base, allowing a compact knowledge view. Furthermore, our approach comes with an online active learning (AL) strategy for updating the classifier on just a number of selected samples, which in turn makes the approach applicable for scarcely labelled streams in applications, where the annotation effort is typically expensive. Our approach was evaluated on several data sets from the MULAN repository and showed significantly improved classification accuracy compared to (evolving) one-versus-rest or classifier chaining concepts. A significant result was that, due to the online AL method, a 90\% reduction in the number of samples used for classifier updates had little effect on the accumulated accuracy trend lines compared to a full update in most data set cases.


title: Can NMT Understand Me? Towards Perturbation-based Evaluation of NMT Models for Code Generation

abstract: Neural Machine Translation (NMT) has reached a level of maturity to be recognized as the premier method for the translation between different languages and aroused interest in different research areas, including software engineering. A key step to validate the robustness of the NMT models consists in evaluating the performance of the models on adversarial inputs, i.e., inputs obtained from the original ones by adding small amounts of perturbation. However, when dealing with the specific task of the code generation (i.e., the generation of code starting from a description in natural language), it has not yet been defined an approach to validate the robustness of the NMT models. In this work, we address the problem by identifying a set of perturbations and metrics tailored for the robustness assessment of such models. We present a preliminary experimental evaluation, showing what type of perturbations affect the model the most and deriving useful insights for future directions.


title: Dressing in the Wild by Watching Dance Videos

abstract: While significant progress has been made in garment transfer, one of the most applicable directions of human-centric image generation, existing works overlook the in-the-wild imagery, presenting severe garment-person misalignment as well as noticeable degradation in fine texture details. This paper, therefore, attends to virtual try-on in real-world scenes and brings essential improvements in authenticity and naturalness especially for loose garment (e.g., skirts, formal dresses), challenging poses (e.g., cross arms, bent legs), and cluttered backgrounds. Specifically, we find that the pixel flow excels at handling loose garments whereas the vertex flow is preferred for hard poses, and by combining their advantages we propose a novel generative network called wFlow that can effectively push up garment transfer to in-the-wild context. Moreover, former approaches require paired images for training. Instead, we cut down the laboriousness by working on a newly constructed large-scale video dataset named Dance50k with self-supervised cross-frame training and an online cycle optimization. The proposed Dance50k can boost real-world virtual dressing by covering a wide variety of garments under dancing poses. Extensive experiments demonstrate the superiority of our wFlow in generating realistic garment transfer results for in-the-wild images without resorting to expensive paired datasets.


title: Noise-robust Speech Recognition with 10 Minutes Unparalleled In-domain Data

abstract: Noise-robust speech recognition systems require large amounts of training data including noisy speech data and corresponding transcripts to achieve state-of-the-art performances in face of various practical environments. However, such plenty of in-domain data is not always available in the real-life world. In this paper, we propose a generative adversarial network to simulate noisy spectrum from the clean spectrum (Simu-GAN), where only 10 minutes of unparalleled in-domain noisy speech data is required as labels. Furthermore, we also propose a dual-path speech recognition system to improve the robustness of the system under noisy conditions. Experimental results show that the proposed speech recognition system achieves 7.3% absolute improvement with simulated noisy data by Simu-GAN over the best baseline in terms of word error rate (WER).


title: Time Reversal Precoding at SubTHz Frequencies: Experimental Results on Spatiotemporal Focusing

abstract: Due to availability of large spectrum chunks, the sub-TeraHertz (subTHz) frequency band can support Ultra-WideBand (UWB) wireless communications, paving the way for unprecedented increase in the wireless network capacity. This fact is expected to be the next breakthrough for the upcoming sixth Generation (6G) standards. However, the technology of subTHz transceivers is not yet mature enough to apply the advanced signal processing currently being implemented for millimeter wave wireless communications. In this paper, we consider the Time Reversal (TR) precoding technique, which provides simple and robust processing capable to offer highly focalized in time and space UWB waveforms, exploiting the spatial diversity of wireless channels. We first investigate experimentally the performance of subTHz TR focusing in complex media inside a leaking reverberation cavity. We then combine TR with received spatial modulation to realize data communication using a simple non-coherent receiver with two antennas. Our results showcase the capability of TR to offer focusing in time in the order of few nanoseconds and in space in the order of less than 1 mm.


title: Improving Persian Relation Extraction Models by Data Augmentation

abstract: Relation extraction that is the task of predicting semantic relation type between entities in a sentence or document is an important task in natural language processing. Although there are many researches and datasets for English, Persian suffers from sufficient researches and comprehensive datasets. The only available Persian dataset for this task is PERLEX, which is a Persian expert-translated version of the SemEval-2010-Task-8 dataset. In this paper, we present our augmented dataset and the results and findings of our system, participated in the Persian relation Extraction shared task of NSURL 2021 workshop. We use PERLEX as the base dataset and enhance it by applying some text preprocessing steps and by increasing its size via data augmentation techniques to improve the generalization and robustness of applied models. We then employ two different models including ParsBERT and multilingual BERT for relation extraction on the augmented PERLEX dataset. Our best model obtained 64.67% of Macro-F1 on the test phase of the contest and it achieved 83.68% of Macro-F1 on the test set of PERLEX.


title: syslrn: Learning What to Monitor for Efficient Anomaly Detection

abstract: While monitoring system behavior to detect anomalies and failures is important, existing methods based on log-analysis can only be as good as the information contained in the logs, and other approaches that look at the OS-level software state introduce high overheads. We tackle the problem with syslrn, a system that first builds an understanding of a target system offline, and then tailors the online monitoring instrumentation based on the learned identifiers of normal behavior. While our syslrn prototype is still preliminary and lacks many features, we show in a case study for the monitoring of OpenStack failures that it can outperform state-of-the-art log-analysis systems with little overhead.


title: Robust Single Image Dehazing Based on Consistent and Contrast-Assisted Reconstruction

abstract: Single image dehazing as a fundamental low-level vision task, is essential for the development of robust intelligent surveillance system. In this paper, we make an early effort to consider dehazing robustness under variational haze density, which is a realistic while under-studied problem in the research filed of singe image dehazing. To properly address this problem, we propose a novel density-variational learning framework to improve the robustness of the image dehzing model assisted by a variety of negative hazy images, to better deal with various complex hazy scenarios. Specifically, the dehazing network is optimized under the consistency-regularized framework with the proposed Contrast-Assisted Reconstruction Loss (CARL). The CARL can fully exploit the negative information to facilitate the traditional positive-orient dehazing objective function, by squeezing the dehazed image to its clean target from different directions. Meanwhile, the consistency regularization keeps consistent outputs given multi-level hazy images, thus improving the model robustness. Extensive experimental results on two synthetic and three real-world datasets demonstrate that our method significantly surpasses the state-of-the-art approaches.


title: Speech Emotion Recognition with Co-Attention based Multi-level Acoustic Information

abstract: Speech Emotion Recognition (SER) aims to help the machine to understand human's subjective emotion from only audio information. However, extracting and utilizing comprehensive in-depth audio information is still a challenging task. In this paper, we propose an end-to-end speech emotion recognition system using multi-level acoustic information with a newly designed co-attention module. We firstly extract multi-level acoustic information, including MFCC, spectrogram, and the embedded high-level acoustic information with CNN, BiLSTM and wav2vec2, respectively. Then these extracted features are treated as multimodal inputs and fused by the proposed co-attention mechanism. Experiments are carried on the IEMOCAP dataset, and our model achieves competitive performance with two different speaker-independent cross-validation strategies. Our code is available on GitHub.


title: Exact convergence rate in the central limit theorem for a branching process with immigration in a random environment

abstract: Let (Zn) be a branching process with immigration in an independent and identically distributed random environment. Under necessary moment conditions, we show the exact convergence rate in the central limit theorem on logZn by using the convergence rates of the logarithm of submartingale and the result of the corresponding random walk on the Berry-Esseen bound.


title: Compact Token Representations with Contextual Quantization for Efficient Document Re-ranking

abstract: Transformer based re-ranking models can achieve high search relevance through context-aware soft matching of query tokens with document tokens. To alleviate runtime complexity of such inference, previous work has adopted a late interaction architecture with pre-computed contextual token representations at the cost of a large online storage. This paper proposes contextual quantization of token embeddings by decoupling document-specific and document-independent ranking contributions during codebook-based compression. This allows effective online decompression and embedding composition for better search relevance. This paper presents an evaluation of the above compact token representation model in terms of relevance and space efficiency.


title: The Fox-Hatcher cycle and a Vassiliev invariant of order three

abstract: We show that the integration of a 1-cocycle I(X) of the space of long knots in R^3 over the Fox-Hatcher 1-cycles gives rise to a Vassiliev invariant of order exactly three. This result can be seen as a continuation of the previous work of the second named author, proving that the integration of I(X) over the Gramain 1-cycles is the Casson invariant, the unique nontrivial Vassiliev invariant of order two (up to scalar multiplications). The result in the present paper is also analogous to part of Mortier's result. Our result differs from, but is motivated by, Mortier's one in that the 1-cocycle I(X) is given by the configuration space integrals associated with graphs while Mortier's cocycle is obtained in a combinatorial way.


title: Amplitudes meet Cosmology: A (Scalar) Primer

abstract: We review the most recent progress in our understanding of quantum mechanical observables in cosmology in the perturbative regime. It relies on an approach that considers them directly as functions of the data at the space-like boundary at future infinity prescinding from the explicit time evolution. It takes inspiration from the on-shell formulation of perturbative scattering amplitudes developed in the past 20 years: starting with the requirement of consistency with some fundamental principles such as causality, unitarity and locality, it provides different ways of phrasing and extracting predictions. In this review, we aim to provide a pedagogical treatment of the most recent insights about the analytic structure of the perturbative quantum mechanical observables in cosmology, its relation to fundamental principles as well as physical processes, and how such observables and their features emerge from novel well-defined mathematical objects with their own first principle definition. The review is divided in three parts: Part 0 discusses the definition of quantum mechanical observables in cosmology and some general principles; Part I reviews the boundary approach to the analysis and computation of the perturbative wavefunction of the universe; Part II provides an introduction to the combinatorial-geometrical description of cosmological processes in terms of cosmological polytopes.


title: CNN Filter DB: An Empirical Investigation of Trained Convolutional Filters

abstract: Currently, many theoretical as well as practically relevant questions towards the transferability and robustness of Convolutional Neural Networks (CNNs) remain unsolved. While ongoing research efforts are engaging these problems from various angles, in most computer vision related cases these approaches can be generalized to investigations of the effects of distribution shifts in image data. In this context, we propose to study the shifts in the learned weights of trained CNN models. Here we focus on the properties of the distributions of dominantly used 3x3 convolution filter kernels. We collected and publicly provide a dataset with over 1.4 billion filters from hundreds of trained CNNs, using a wide range of datasets, architectures, and vision tasks. In a first use case of the proposed dataset, we can show highly relevant properties of many publicly available pre-trained models for practical applications: I) We analyze distribution shifts (or the lack thereof) between trained filters along different axes of meta-parameters, like visual category of the dataset, task, architecture, or layer depth. Based on these results, we conclude that model pre-training can succeed on arbitrary datasets if they meet size and variance conditions. II) We show that many pre-trained models contain degenerated filters which make them less robust and less suitable for fine-tuning on target applications. Data & Project website: https://github.com/paulgavrikov/cnn-filter-db


title: Balanced Multimodal Learning via On-the-fly Gradient Modulation

abstract: Multimodal learning helps to comprehensively understand the world, by integrating different senses. Accordingly, multiple input modalities are expected to boost model performance, but we actually find that they are not fully exploited even when the multimodal model outperforms its uni-modal counterpart. Specifically, in this paper we point out that existing multimodal discriminative models, in which uniform objective is designed for all modalities, could remain under-optimized uni-modal representations, caused by another dominated modality in some scenarios, e.g., sound in blowing wind event, vision in drawing picture event, etc. To alleviate this optimization imbalance, we propose on-the-fly gradient modulation to adaptively control the optimization of each modality, via monitoring the discrepancy of their contribution towards the learning objective. Further, an extra Gaussian noise that changes dynamically is introduced to avoid possible generalization drop caused by gradient modulation. As a result, we achieve considerable improvement over common fusion methods on different multimodal tasks, and this simple strategy can also boost existing multimodal methods, which illustrates its efficacy and versatility. The source code is available at \url{https://github.com/GeWu-Lab/OGM-GE_CVPR2022}.


title: On Affine Policies for Wasserstein Distributionally Robust Unit Commitment

abstract: This paper proposes a unit commitment (UC) model based on data-driven Wasserstein distributionally robust optimization (WDRO) for power systems under uncertainty of renewable generation as well as its tractable exact reformulation. The proposed model is formulated as a WDRO problem relying on an affine policy, which nests an infinite-dimensional worst-case expectation problem and satisfies the non-anticipativity constraint. To reduce conservativeness, we develop a novel technique that defines a subset of the uncertainty set with a probabilistic guarantee. Subsequently, the proposed model is recast as a semi-infinite programming problem that can be efficiently solved using existing algorithms. Notably, the scale of this reformulation is invariant with the sample size. As a result, a number of samples are easily incorporated without using sophisticated decomposition algorithms. Numerical simulations on 6- and 24-bus test systems demonstrate the economic and computational efficiency of the proposed model.


title: AnyFace: Free-style Text-to-Face Synthesis and Manipulation

abstract: Existing text-to-image synthesis methods generally are only applicable to words in the training dataset. However, human faces are so variable to be described with limited words. So this paper proposes the first free-style text-to-face method namely AnyFace enabling much wider open world applications such as metaverse, social media, cosmetics, forensics, etc. AnyFace has a novel two-stream framework for face image synthesis and manipulation given arbitrary descriptions of the human face. Specifically, one stream performs text-to-face generation and the other conducts face image reconstruction. Facial text and image features are extracted using the CLIP (Contrastive Language-Image Pre-training) encoders. And a collaborative Cross Modal Distillation (CMD) module is designed to align the linguistic and visual features across these two streams. Furthermore, a Diverse Triplet Loss (DT loss) is developed to model fine-grained features and improve facial diversity. Extensive experiments on Multi-modal CelebA-HQ and CelebAText-HQ demonstrate significant advantages of AnyFace over state-of-the-art methods. AnyFace can achieve high-quality, high-resolution, and high-diversity face synthesis and manipulation results without any constraints on the number and content of input captions.


title: Iranian Modal Music (Dastgah) detection using deep neural networks

abstract: Music classification and genre detection are topics in music information retrieval (MIR) that many articles have been published regarding their utilities in the modern world. However, this contribution is insufficient in non-western music, such as Iranian modal music. In this work, we have implemented several deep neural networks to recognize Iranian modal music in seven highly correlated categories. The best model, BiLGNet, which achieved 92 percent overall accuracy, uses an architecture inspired by autoencoders, including bidirectional LSTM and GRU layers. We trained the models using the Nava dataset, which includes 1786 records and up to 55 hours of music played solo by Kamanche, Tar, Setar, Reed, and Santoor (Dulcimer). We considered Multiple features such as MFCC, Chroma CENS, and Mel spectrogram as input. The results indicate that MFCC carries more valuable information for detecting Iranian modal music (Dastgah) than other sound representations. Moreover, the architecture inspired by autoencoders is robust in distinguishing highly correlated data like Dastgahs. It also shows that because of the precise order in Iranian Dastgah Music, Bidirectional Recurrent networks are more efficient than any other networks that have been implemented in this study.


title: End-to-End Compressed Video Representation Learning for Generic Event Boundary Detection

abstract: Generic event boundary detection aims to localize the generic, taxonomy-free event boundaries that segment videos into chunks. Existing methods typically require video frames to be decoded before feeding into the network, which demands considerable computational power and storage space. To that end, we propose a new end-to-end compressed video representation learning for event boundary detection that leverages the rich information in the compressed domain, i.e., RGB, motion vectors, residuals, and the internal group of pictures (GOP) structure, without fully decoding the video. Specifically, we first use the ConvNets to extract features of the I-frames in the GOPs. After that, a light-weight spatial-channel compressed encoder is designed to compute the feature representations of the P-frames based on the motion vectors, residuals and representations of their dependent I-frames. A temporal contrastive module is proposed to determine the event boundaries of video sequences. To remedy the ambiguities of annotations and speed up the training process, we use the Gaussian kernel to preprocess the ground-truth event boundaries. Extensive experiments conducted on the Kinetics-GEBD dataset demonstrate that the proposed method achieves comparable results to the state-of-the-art methods with $4.5\times$ faster running speed.


title: Infrared and Visible Image Fusion via Interactive Compensatory Attention Adversarial Learning

abstract: The existing generative adversarial fusion methods generally concatenate source images and extract local features through convolution operation, without considering their global characteristics, which tends to produce an unbalanced result and is biased towards the infrared image or visible image. Toward this end, we propose a novel end-to-end mode based on generative adversarial training to achieve better fusion balance, termed as \textit{interactive compensatory attention fusion network} (ICAFusion). In particular, in the generator, we construct a multi-level encoder-decoder network with a triple path, and adopt infrared and visible paths to provide additional intensity and gradient information. Moreover, we develop interactive and compensatory attention modules to communicate their pathwise information, and model their long-range dependencies to generate attention maps, which can more focus on infrared target perception and visible detail characterization, and further increase the representation power for feature extraction and feature reconstruction. In addition, dual discriminators are designed to identify the similar distribution between fused result and source images, and the generator is optimized to produce a more balanced result. Extensive experiments illustrate that our ICAFusion obtains superior fusion performance and better generalization ability, which precedes other advanced methods in the subjective visual description and objective metric evaluation. Our codes will be public at \url{https://github.com/Zhishe-Wang/ICAFusion}


title: Dynamic-subarray with Fixed Phase Shifters for Energy-efficient Terahertz Hybrid Beamforming under Partial CSI

abstract: Terahertz (THz) communications are regarded as a pillar technology for the 6G systems, by offering multi-ten-GHz bandwidth. To overcome the huge propagation loss while reducing the hardware complexity, THz ultra-massive (UM) MIMO systems with hybrid beamforming are proposed to offer high array gain. Notably, the adjustable-phase-shifters considered in most existing hybrid beamforming studies are power-hungry and difficult to realize in the THz band. Moreover, due to the ultra-massive antennas, full channel-state-information (CSI) is challenging to obtain. To address these practical concerns, in this paper, an energy-efficient dynamic-subarray with fixed-phase-shifters (DS-FPS) architecture is proposed for THz hybrid beamforming. To compensate for the spectral efficiency loss caused by the fixed-phase of FPS, a switch network is inserted to enable dynamic connections. In addition, by considering the partial CSI, we propose a row-successive-decomposition (RSD) algorithm to design the hybrid beamforming matrices for DS-FPS. A row-by-row (RBR) algorithm is further proposed to reduce computational complexity. Extensive simulation results show that, the proposed DS-FPS architecture with the RSD and RBR algorithms achieves much higher energy efficiency than the existing architectures. Moreover, the DS-FPS architecture with partial CSI achieves 97% spectral efficiency of that with full CSI.


title: Spectra of weighted uniform hypertrees

abstract: Let $T$ be a $k$-tree equipped with a weighting function $\w: V(T)\cup E(T)\rightarrow \C$, where $k \geq 3$. The weighted matching polynomial of the weighted $k$-tree $(T,\w)$ is defined to be $$ \mu(T,\w,x)= \sum_{M \in \mathcal{M}(T)}(-1)^{|M|}\prod_{e \in E(M)}\mathbf{w}(e)^k \prod_{v \in V(T)\backslash V(M)}(x-\w(v)), $$ where $\mathcal{M}(T)$ denotes the set of matchings (including empty set) of $T$. In this paper, we investigate the eigenvalues of the adjacency tensor $\A(T,\w)$ of the weighted $k$-tree $(T,\w)$. The main result provides that $\w(v)$ is an eigenvalue of $\A(T,\w)$ for every $v\in V(T)$, and if $\lambda\neq \w(v)$ for every $v\in V(T)$, then $\lambda$ is an eigenvalue of $\A(T,\w)$ if and only if there exists a subtree $T'$ of $T$ such that $\lambda$ is a root of $\mu(T',\w,x)$. Moreover, the spectral radius of $\A(T,\w)$ is equal to the largest root of $\mu(T,\w,x)$ when $\w$ is real and nonnegative. The result extends a work by Clark and Cooper ({\em On the adjacency spectra of hypertrees, Electron. J. Combin., 25 (2)(2018) $\#$P2.48}) to weighted $k$-trees. As applications, two analogues of the above work for the Laplacian and the signless Laplacian tensors of $k$-trees are obtained.


title: Splitting-based randomized iterative methods for solving indefinite least squares problem

abstract: The indefinite least squares (ILS) problem is a generalization of the famous linear least squares problem. It minimizes an indefinite quadratic form with respect to a signature matrix. For this problem, we first propose an impressively simple and effective splitting (SP) method according to its own structure and prove that it converges 'unconditionally' for any initial value. Further, to avoid implementing some matrix multiplications and calculating the inverse of large matrix and considering the acceleration and efficiency of the randomized strategy, we develop two randomized iterative methods on the basis of the SP method as well as the randomized Kaczmarz, Gauss-Seidel and coordinate descent methods, and describe their convergence properties. Numerical results show that our three methods all have quite decent performance in both computing time and iteration numbers compared with the latest iterative method of the ILS problem, and also demonstrate that the two randomized methods indeed yield significant acceleration in term of computing time.


title: Invariance of cosmological number counts under disformal transformations

abstract: We investigate whether true physical observables associated with the measurements of large scale structure in the universe are frame-independent. In particular, we study if cosmological observables such as the galaxy number counts are invariant under the disformal transformations. In a previous work, it was shown that this frame-invariance holds true for the case of conformal transformations. In this work, we find that the invariance also holds true for the case of a simple disformal transformation. We further briefly comment on the disformal invariance of other cosmological observables.


title: Systematics of E2 strength in the sd-shell with the valence-space in-medium similarity renormalization group

abstract: Background: Recent developments in {\it ab initio} nuclear theory demonstrate promising results in medium- to heavy-mass nuclei. A particular challenge for many of the many-body methodologies, however, is an accurate treatment of the electric-quadrupole, $E2$, strength associated with collectivity. Purpose: The valence-space in-medium similarity renormalization group (VS-IMSRG) is a particularly powerful method for accessing medium- and high-mass nuclei but has been found to underpredict $E2$ strengths. The purpose of this work is to evaluate the isospin dependence of this underprediction. Methods: We perform a systematic comparison of valence-space in-medium similarity renormalization group (VS-IMSRG) calculations with available literature. We make use of isoscalar and isovector contributions to the $E2$ matrix elements to assess isoscalar and isovector contributions to the missing strength. Results: It is found that the $E2$ strength is consistent throughout $T_z=\left|\frac{1}{2}\right|$, $T_z=\left|1\right|$, $T_z=\left|\frac{3}{2}\right|$ and $T_z=2$ pairs within the $sd$-shell. Furthermore, no isovector contribution to the deficiency is identified. Conclusions: A comparison with toy-models and coupled-cluster calculations is used to discuss potential origins of the missing strength, which arises from missing many-particle, many-hole excitations out of the model space. The absence of any significant isovector contribution to the missing $E2$ strength indicates that the $E2$ strength discrepancy, and therefore any correction, is largely independent of the isospin of the nuclei in question.


title: Coupled frustrated ferromagnetic and antiferromagnetic quantum spin chains in the quasi-one-dimensional mineral antlerite, Cu$_3$SO$_4$(OH)$_4$

abstract: Magnetic frustration, the competition among exchange interactions, often leads to novel magnetic ground states with unique physical properties which can hinge on details of interactions that are otherwise difficult to observe. Such states are particularly interesting when it is possible to tune the balance among the interactions to access multiple types of magnetic order. We present antlerite, Cu$_3$SO$_4$(OH)$_4$, as a potential platform for tuning frustration. Contrary to previous reports, the low-temperature magnetic state of its three-leg zigzag ladders is a quasi-one-dimensional analog of the magnetic state recently proposed to exhibit spinon-magnon mixing in botallackite. Density functional theory calculations indicate that antlerite's magnetic ground state is exquisitely sensitive to fine details of the atomic positions, with each chain independently on the cusp of a phase transition, indicating an excellent potential for tunability.


title: An upper bound on topological entropy of the Bunimovich stadium billiard map

abstract: We show that the topological entropy of the billiard map in a Bunimovich stadium is at most log(3.49066).


title: Task-specific Inconsistency Alignment for Domain Adaptive Object Detection

abstract: Detectors trained with massive labeled data often exhibit dramatic performance degradation in some particular scenarios with data distribution gap. To alleviate this problem of domain shift, conventional wisdom typically concentrates solely on reducing the discrepancy between the source and target domains via attached domain classifiers, yet ignoring the difficulty of such transferable features in coping with both classification and localization subtasks in object detection. To address this issue, in this paper, we propose Task-specific Inconsistency Alignment (TIA), by developing a new alignment mechanism in separate task spaces, improving the performance of the detector on both subtasks. Specifically, we add a set of auxiliary predictors for both classification and localization branches, and exploit their behavioral inconsistencies as finer-grained domain-specific measures. Then, we devise task-specific losses to align such cross-domain disagreement of both subtasks. By optimizing them individually, we are able to well approximate the category- and boundary-wise discrepancies in each task space, and therefore narrow them in a decoupled manner. TIA demonstrates superior results on various scenarios to the previous state-of-the-art methods. It is also observed that both the classification and localization capabilities of the detector are sufficiently strengthened, further demonstrating the effectiveness of our TIA method. Code and trained models are publicly available at https://github.com/MCG-NJU/TIA.


title: Enumeration of extended irreducible binary Goppa codes

abstract: The family of Goppa codes is one of the most interesting subclasses of linear codes. As the McEliece cryptosystem often chooses a random Goppa code as its key,knowledge of the number of inequivalent Goppa codes for fixed parameters may facilitate in the evaluation of the security of such a cryptosystem. In this paper we present a new approach to give an upper bound on the number of inequivalent extended irreducible binary Goppa codes. To be more specific, let $n>3$ be an odd prime number and $q=2^n$; let $r\geq3$ be a positive integer satisfying $\gcd(r,n)=1$ and $\gcd\big(r,q(q^2-1)\big)=1$. We obtain an upper bound for the number of inequivalent extended irreducible binary Goppa codes of length $q+1$ and degree $r$.


title: Harmonizing Pathological and Normal Pixels for Pseudo-healthy Synthesis

abstract: Synthesizing a subject-specific pathology-free image from a pathological image is valuable for algorithm development and clinical practice. In recent years, several approaches based on the Generative Adversarial Network (GAN) have achieved promising results in pseudo-healthy synthesis. However, the discriminator (i.e., a classifier) in the GAN cannot accurately identify lesions and further hampers from generating admirable pseudo-healthy images. To address this problem, we present a new type of discriminator, the segmentor, to accurately locate the lesions and improve the visual quality of pseudo-healthy images. Then, we apply the generated images into medical image enhancement and utilize the enhanced results to cope with the low contrast problem existing in medical image segmentation. Furthermore, a reliable metric is proposed by utilizing two attributes of label noise to measure the health of synthetic images. Comprehensive experiments on the T2 modality of BraTS demonstrate that the proposed method substantially outperforms the state-of-the-art methods. The method achieves better performance than the existing methods with only 30\% of the training data. The effectiveness of the proposed method is also demonstrated on the LiTS and the T1 modality of BraTS. The code and the pre-trained model of this study are publicly available at https://github.com/Au3C2/Generator-Versus-Segmentor.


title: SIGLE: a valid procedure for Selective Inference with the Generalized Linear Lasso

abstract: This article investigates uncertainty quantification of the generalized linear lasso~(GLL), a popular variable selection method in high-dimensional regression settings. In many fields of study, researchers use data-driven methods to select a subset of variables that are most likely to be associated with a response variable. However, such variable selection methods can introduce bias and increase the likelihood of false positives, leading to incorrect conclusions. In this paper, we propose a post-selection inference framework that addresses these issues and allows for valid statistical inference after variable selection using GLL. We show that our method provides accurate $p$-values and confidence intervals, while maintaining high statistical power. In a second stage, we focus on the sparse logistic regression, a popular classifier in high-dimensional statistics. We show with extensive numerical simulations that SIGLE is more powerful than state-of-the-art PSI methods. SIGLE relies on a new method to sample states from the distribution of observations conditional on the selection event. This method is based on a simulated annealing strategy whose energy is given by the first order conditions of the logistic lasso.


title: LDKP: A Dataset for Identifying Keyphrases from Long Scientific Documents

abstract: Identifying keyphrases (KPs) from text documents is a fundamental task in natural language processing and information retrieval. Vast majority of the benchmark datasets for this task are from the scientific domain containing only the document title and abstract information. This limits keyphrase extraction (KPE) and keyphrase generation (KPG) algorithms to identify keyphrases from human-written summaries that are often very short (approx 8 sentences). This presents three challenges for real-world applications: human-written summaries are unavailable for most documents, the documents are almost always long, and a high percentage of KPs are directly found beyond the limited context of title and abstract. Therefore, we release two extensive corpora mapping KPs of ~1.3M and ~100K scientific articles with their fully extracted text and additional metadata including publication venue, year, author, field of study, and citations for facilitating research on this real-world problem.


title: End-to-End Transformer Based Model for Image Captioning

abstract: CNN-LSTM based architectures have played an important role in image captioning, but limited by the training efficiency and expression ability, researchers began to explore the CNN-Transformer based models and achieved great success. Meanwhile, almost all recent works adopt Faster R-CNN as the backbone encoder to extract region-level features from given images. However, Faster R-CNN needs a pre-training on an additional dataset, which divides the image captioning task into two stages and limits its potential applications. In this paper, we build a pure Transformer-based model, which integrates image captioning into one stage and realizes end-to-end training. Firstly, we adopt SwinTransformer to replace Faster R-CNN as the backbone encoder to extract grid-level features from given images; Then, referring to Transformer, we build a refining encoder and a decoder. The refining encoder refines the grid features by capturing the intra-relationship between them, and the decoder decodes the refined features into captions word by word. Furthermore, in order to increase the interaction between multi-modal (vision and language) features to enhance the modeling capability, we calculate the mean pooling of grid features as the global feature, then introduce it into refining encoder to refine with grid features together, and add a pre-fusion process of refined global feature and generated words in decoder. To validate the effectiveness of our proposed model, we conduct experiments on MSCOCO dataset. The experimental results compared to existing published works demonstrate that our model achieves new state-of-the-art performances of 138.2% (single model) and 141.0% (ensemble of 4 models) CIDEr scores on `Karpathy' offline test split and 136.0% (c5) and 138.3% (c40) CIDEr scores on the official online test server. Trained models and source code will be released.


title: Random Geometric Graph: Some recent developments and perspectives

abstract: The Random Geometric Graph (RGG) is a random graph model for network data with an underlying spatial representation. Geometry endows RGGs with a rich dependence structure and often leads to desirable properties of real-world networks such as the small-world phenomenon and clustering. Originally introduced to model wireless communication networks, RGGs are now very popular with applications ranging from network user profiling to protein-protein interactions in biology. RGGs are also of purely theoretical interest since the underlying geometry gives rise to challenging mathematical questions. Their resolutions involve results from probability, statistics, combinatorics or information theory, placing RGGs at the intersection of a large span of research communities. This paper surveys the recent developments in RGGs from the lens of high dimensional settings and non-parametric inference. We also explain how this model differs from classical community based random graph models and we review recent works that try to take the best of both worlds. As a by-product, we expose the scope of the mathematical tools used in the proofs.


title: CUBES Phase A design overview -- The Cassegrain U-Band Efficient Spectrograph for the Very Large Telescope

abstract: We present the baseline conceptual design of the Cassegrain U-Band Efficient Spectrograph (CUBES) for the Very Large Telescope. CUBES will provide unprecedented sensitivity for spectroscopy on a 8 - 10 m class telescope in the ground ultraviolet (UV), spanning a bandwidth of > 100 nm that starts at 300 nm, the shortest wavelength accessible from the ground. The design has been optimized for end-to-end efficiency and provides a spectral resolving power of R > 20000, that will unlock a broad range of new topics across solar system, Galactic and extraglactic astronomy. The design also features a second, lower-resolution (R \sim 7000) mode and has the option of a fiberlink to the UVES instrument for simultaneous observations at longer wavelengths. Here we present the optical, mechanical and software design of the various subsystems of the instrument after the Phase A study of the project. We discuss the expected performances for the layout choices and highlight some of the performance trade-offs considered to best meet the instrument top-level requirements. We also introduce the model-based system engineering approach used to organize and manage the project activities and interfaces, in the context that it is increasingly necessary to integrate such tools in the development of complex astronomical projects.


title: SIOD: Single Instance Annotated Per Category Per Image for Object Detection

abstract: Object detection under imperfect data receives great attention recently. Weakly supervised object detection (WSOD) suffers from severe localization issues due to the lack of instance-level annotation, while semi-supervised object detection (SSOD) remains challenging led by the inter-image discrepancy between labeled and unlabeled data. In this study, we propose the Single Instance annotated Object Detection (SIOD), requiring only one instance annotation for each existing category in an image. Degraded from inter-task (WSOD) or inter-image (SSOD) discrepancies to the intra-image discrepancy, SIOD provides more reliable and rich prior knowledge for mining the rest of unlabeled instances and trades off the annotation cost and performance. Under the SIOD setting, we propose a simple yet effective framework, termed Dual-Mining (DMiner), which consists of a Similarity-based Pseudo Label Generating module (SPLG) and a Pixel-level Group Contrastive Learning module (PGCL). SPLG firstly mines latent instances from feature representation space to alleviate the annotation missing problem. To avoid being misled by inaccurate pseudo labels, we propose PGCL to boost the tolerance to false pseudo labels. Extensive experiments on MS COCO verify the feasibility of the SIOD setting and the superiority of the proposed method, which obtains consistent and significant improvements compared to baseline methods and achieves comparable results with fully supervised object detection (FSOD) methods with only 40% instances annotated.


title: Signing at Scale: Learning to Co-Articulate Signs for Large-Scale Photo-Realistic Sign Language Production

abstract: Sign languages are visual languages, with vocabularies as rich as their spoken language counterparts. However, current deep-learning based Sign Language Production (SLP) models produce under-articulated skeleton pose sequences from constrained vocabularies and this limits applicability. To be understandable and accepted by the deaf, an automatic SLP system must be able to generate co-articulated photo-realistic signing sequences for large domains of discourse. In this work, we tackle large-scale SLP by learning to co-articulate between dictionary signs, a method capable of producing smooth signing while scaling to unconstrained domains of discourse. To learn sign co-articulation, we propose a novel Frame Selection Network (FS-Net) that improves the temporal alignment of interpolated dictionary signs to continuous signing sequences. Additionally, we propose SignGAN, a pose-conditioned human synthesis model that produces photo-realistic sign language videos direct from skeleton pose. We propose a novel keypoint-based loss function which improves the quality of synthesized hand images. We evaluate our SLP model on the large-scale meineDGS (mDGS) corpus, conducting extensive user evaluation showing our FS-Net approach improves co-articulation of interpolated dictionary signs. Additionally, we show that SignGAN significantly outperforms all baseline methods for quantitative metrics, human perceptual studies and native deaf signer comprehension.


title: Online Continual Learning on a Contaminated Data Stream with Blurry Task Boundaries

abstract: Learning under a continuously changing data distribution with incorrect labels is a desirable real-world problem yet challenging. A large body of continual learning (CL) methods, however, assumes data streams with clean labels, and online learning scenarios under noisy data streams are yet underexplored. We consider a more practical CL task setup of an online learning from blurry data stream with corrupted labels, where existing CL methods struggle. To address the task, we first argue the importance of both diversity and purity of examples in the episodic memory of continual learning models. To balance diversity and purity in the episodic memory, we propose a novel strategy to manage and use the memory by a unified approach of label noise aware diverse sampling and robust learning with semi-supervised learning. Our empirical validations on four real-world or synthetic noise datasets (CIFAR10 and 100, mini-WebVision, and Food-101N) exhibit that our method significantly outperforms prior arts in this realistic and challenging continual learning scenario. Code and data splits are available in https://github.com/clovaai/puridiver.


title: Magnetohydrostatic Modeling of the Solar Atmosphere

abstract: Understanding structures and evolutions of the magnetic fields and plasma in multiple layers on the Sun is very important. A force-free magnetic field which is an accurate approximation of the solar corona due to the low plasma $\beta$ has been widely studied and used to model the coronal magnetic structure. While the force-freeness assumption is well satisfied in the solar corona, the lower atmosphere is not force-free given the high plasma $\beta$. Therefore, a magnetohydrostatic (MHS) equilibrium which takes into account plasma forces, such as pressure gradient and gravitational force, is considered to be more appropriate to describe the lower atmosphere. This paper reviews both analytical and numerical extrapolation methods based on the MHS assumption for calculating the magnetic fields and plasma in the solar atmosphere from measured magnetograms.


title: Measurement of the electric quadrupole amplitude in atomic thallium $6P_{1/2}\rightarrow6P_{3/2}$ transition using electromagnetically induced transparency

abstract: We report a measurement of the transition amplitude ratio $\chi$ of an electric quadrupole ($E2$) to a magnetic dipole ($M1$) of the $6P_{1/2}\rightarrow6P_{3/2}$ transition in atomic thallium. We utilized the electromagnetically induced transparency (EIT) mechanism and the sideband-bridging technique to resolve the isotopic transitions and their hyperfine manifold. Our measurement gave $\chi_{205}~=~0.2550(20)(7)$ for $^{205}$Tl, and $\chi_{203}=0.2532(73)(7)$ for $^{203}$Tl, which was measured for the first time. Our result provides a reference point for the theoretical calculation of atomic structure and new input for the long dispute on the atomic thallium PNC measurements.


title: On the influence of the nonlinear term in the numerical approximation of Incompressible Flows by means of proper orthogonal decomposition methods

abstract: We consider proper orthogonal decomposition (POD) methods to approximate the incompressible Navier-Stokes equations. We study the case in which one discretization for the nonlinear term is used in the snapshots (that are computed with a full order method (FOM)) and a different discretization of the nonlinear term is applied in the POD method. We prove that an additional error term appears in this case, compared with the case in which the same discretization of the nonlinear term is applied for both the FOM and the POD methods. However, the added term has the same size as the error coming from the FOM so that the rate of convergence of the POD method is barely affected. We analyze the case in which we add grad-div stabilization to both the FOM and the POD methods because it allows to get error bounds with constants independent of inverse powers of the viscosity. We also study the case in which no stabilization is added. Some numerical experiments support the theoretical analysis.


title: Nested Collaborative Learning for Long-Tailed Visual Recognition

abstract: The networks trained on the long-tailed dataset vary remarkably, despite the same training settings, which shows the great uncertainty in long-tailed learning. To alleviate the uncertainty, we propose a Nested Collaborative Learning (NCL), which tackles the problem by collaboratively learning multiple experts together. NCL consists of two core components, namely Nested Individual Learning (NIL) and Nested Balanced Online Distillation (NBOD), which focus on the individual supervised learning for each single expert and the knowledge transferring among multiple experts, respectively. To learn representations more thoroughly, both NIL and NBOD are formulated in a nested way, in which the learning is conducted on not just all categories from a full perspective but some hard categories from a partial perspective. Regarding the learning in the partial perspective, we specifically select the negative categories with high predicted scores as the hard categories by using a proposed Hard Category Mining (HCM). In the NCL, the learning from two perspectives is nested, highly related and complementary, and helps the network to capture not only global and robust features but also meticulous distinguishing ability. Moreover, self-supervision is further utilized for feature enhancement. Extensive experiments manifest the superiority of our method with outperforming the state-of-the-art whether by using a single model or an ensemble.


title: Time-optimal control of cranes subject to container height constraints

abstract: The productivity and efficiency of port operations strongly depend on how fast a ship can be unloaded and loaded again. With this in mind, ship-to-shore cranes perform the critical task of transporting containers into and onto a ship and must do so as fast as possible. Though the problem of minimizing the time spent in moving the payload has been addressed in previous studies, the different heights of the container stacks have not been the focus. In this paper, we perform a change of variable and reformulate the optimization problem to deal with the constraints on the stack heights. As consequence, these constraints become trivial and easy to represent since they turn into bound constraints when the problem is discretized for the numerical solver. To validate the idea, we simulate a small-scale scenario where different stack heights are used. The results confirm our idea and the representation of the stack constraints become indeed trivial. This approach is promising to be applied in real crane operations and has the potential to enhance their automation.


title: Self-Supervised Image Representation Learning with Geometric Set Consistency

abstract: We propose a method for self-supervised image representation learning under the guidance of 3D geometric consistency. Our intuition is that 3D geometric consistency priors such as smooth regions and surface discontinuities may imply consistent semantics or object boundaries, and can act as strong cues to guide the learning of 2D image representations without semantic labels. Specifically, we introduce 3D geometric consistency into a contrastive learning framework to enforce the feature consistency within image views. We propose to use geometric consistency sets as constraints and adapt the InfoNCE loss accordingly. We show that our learned image representations are general. By fine-tuning our pre-trained representations for various 2D image-based downstream tasks, including semantic segmentation, object detection, and instance segmentation on real-world indoor scene datasets, we achieve superior performance compared with state-of-the-art methods.


title: Domain Invariant Siamese Attention Mask for Small Object Change Detection via Everyday Indoor Robot Navigation

abstract: The problem of image change detection via everyday indoor robot navigation is explored from a novel perspective of the self-attention technique. Detecting semantically non-distinctive and visually small changes remains a key challenge in the robotics community. Intuitively, these small non-distinctive changes may be better handled by the recent paradigm of the attention mechanism, which is the basic idea of this work. However, existing self-attention models require significant retraining cost per domain, so it is not directly applicable to robotics applications. We propose a new self-attention technique with an ability of unsupervised on-the-fly domain adaptation, which introduces an attention mask into the intermediate layer of an image change detection model, without modifying the input and output layers of the model. Experiments, in which an indoor robot aims to detect visually small changes in everyday navigation, demonstrate that our attention technique significantly boosts the state-of-the-art image change detection model.


title: Nonlinear dynamics of topological helicity wave in a frustrated skyrmion string

abstract: A skyrmion in frustrated magnetic system has the helicity degree of freedom. A skyrmion string is formed in a frustrated layered system, which is well described by the $XY$ model owing to the exchange coupling between adjacent layers. We consider a system where the interlayer exchange couplings are alternating, where the dimerized $XY$ model is materialized, whose linear limit is the Su-Schrieffer-Heeger model. We argue that it is a nonlinear topological system. We study the quench dynamics of the helicity wave under the initial condition that the helicity of the skyrmion in the bottommost layer is rotated. It yields a good signal to detect whether the system is topological or trivial. Our results show that the helicity dynamics of the skyrmion string have a rich physics in the modulated exchange-coupled system.


title: The Inefficiency of Language Models in Scholarly Retrieval: An Experimental Walk-through

abstract: Language models are increasingly becoming popular in AI-powered scientific IR systems. This paper evaluates popular scientific language models in handling (i) short-query texts and (ii) textual neighbors. Our experiments showcase the inability to retrieve relevant documents for a short-query text even under the most relaxed conditions. Additionally, we leverage textual neighbors, generated by small perturbations to the original text, to demonstrate that not all perturbations lead to close neighbors in the embedding space. Further, an exhaustive categorization yields several classes of orthographically and semantically related, partially related, and completely unrelated neighbors. Retrieval performance turns out to be more influenced by the surface form rather than the semantics of the text.


title: High-mass pulsators in eclipsing binaries observed using TESS

abstract: Pulsations and binarity are both common features of massive stars. The study of pulsating massive stars in eclipsing binary systems hold great potential for constraining stellar structure and evolution theory. However, prior to the all-sky Transiting Exoplanet Survey Satellite (TESS) mission, few such systems had been discovered or studied in detail. We have inspected the TESS light curves of a large number of eclipsing binaries known to contain high-mass stars, and compiled a list of 18 objects which show intrinsic variability. The light curves were modelled both to determine the physical properties of the systems, and to remove the effects of binarity in order to leave residual light curves suitable for asteroseismic analysis. Precise mass and radius measurements were obtained for delta Cir, CC Cas, SZ Cam, V436 Per and V539 Ara. We searched the residual light curves for pulsation signatures and, within our sample of 18 objects, we find six definite and eight possible cases of beta Cephei pulsation, seven cases of stochastic low-frequency (SLF) variability, and eight instances of possible slowly pulsating B (SPB) star pulsation. The large number of pulsating eclipsing systems we have identified makes asteroseismology of high-mass stars in eclipsing binaries a feasible avenue to constrain the interior physics of a large sample of massive stars for the first time.


title: Face segmentation: A comparison between visible and thermal images

abstract: Face segmentation is a first step for face biometric systems. In this paper we present a face segmentation algorithm for thermographic images. This algorithm is compared with the classic Viola and Jones algorithm used for visible images. Experimental results reveal that, when segmenting a multispectral (visible and thermal) face database, the proposed algorithm is more than 10 times faster, while the accuracy of face segmentation in thermal images is higher than in case of Viola-Jones


title: On factorising twists in AdS_3 and AdS_2

abstract: In this paper we study factorising twists of the massless AdS_3 and AdS_2 integrable R-matrices, and explore the programme of analysis of form factors which Maillet et al developed for ordinary spin-chains. We derive the factorising twists from the universal R-matrix of the gl(1|1) Yangian double, and discuss the RTT relations for the two- and three-site monodromy matrix. We show how the twist can be used to compute a simple scalar product. We then implement our construction in the language of free fermions. Finally, we show how to obtain the massless AdS_2 quantum R-matrix from the Yangian universal R-matrix, and compute a peculiar factorising twist for this case as well.


title: Multiclass classification using quantum convolutional neural networks with hybrid quantum-classical learning

abstract: Multiclass classification is of great interest for various applications, for example, it is a common task in computer vision, where one needs to categorize an image into three or more classes. Here we propose a quantum machine learning approach based on quantum convolutional neural networks for solving the multiclass classification problem. The corresponding learning procedure is implemented via TensorFlowQuantum as a hybrid quantum-classical (variational) model, where quantum output results are fed to the softmax activation function with the subsequent minimization of the cross entropy loss via optimizing the parameters of the quantum circuit. Our conceptional improvements here include a new model for a quantum perceptron and an optimized structure of the quantum circuit. We use the proposed approach to solve a 4-class classification problem for the case of the MNIST dataset using eight qubits for data encoding and four ancilla qubits; previous results have been obtained for 3-class classification problems. Our results show that accuracies of our solution are similar to classical convolutional neural networks with comparable numbers of trainable parameters. We expect that our finding provide a new step towards the use of quantum neural networks for solving relevant problems in the NISQ era and beyond.


title: Geographic Diversity in Public Code Contributions

abstract: We conduct an exploratory, large-scale, longitudinal study of 50 years of commits to publicly available version control system repositories, in order to characterize the geographic diversity of contributors to public code and its evolution over time. We analyze in total 2.2 billion commits collected by Software Heritage from 160 million projects and authored by 43 million authors during the 1971-2021 time period. We geolocate developers to 12 world regions derived from the United Nation geoscheme, using as signals email top-level domains, author names compared with names distributions around the world, and UTC offsets mined from commit metadata.We find evidence of the early dominance of North America in open source software, later joined by Europe. After that period, the geographic diversity in public code has been constantly increasing. We also identify relevant historical shifts related to the UNIX wars, the increase of coding literacy in Central and South Asia, and broader phenomena like colonialism and people movement across countries (immigration/emigration).


title: A Principles-based Ethics Assurance Argument Pattern for AI and Autonomous Systems

abstract: An assurance case is a structured argument, typically produced by safety engineers, to communicate confidence that a critical or complex system, such as an aircraft, will be acceptably safe within its intended context. Assurance cases often inform third party approval of a system. One emerging proposition within the trustworthy AI and autonomous systems (AI/AS) research community is to use assurance cases to instil justified confidence that specific AI/AS will be ethically acceptable when operational in well-defined contexts. This paper substantially develops the proposition and makes it concrete. It brings together the assurance case methodology with a set of ethical principles to structure a principles-based ethics assurance argument pattern. The principles are justice, beneficence, non-maleficence, and respect for human autonomy, with the principle of transparency playing a supporting role. The argument pattern, shortened to the acronym PRAISE, is described. The objective of the proposed PRAISE argument pattern is to provide a reusable template for individual ethics assurance cases, by which engineers, developers, operators, or regulators could justify, communicate, or challenge a claim about the overall ethical acceptability of the use of a specific AI/AS in a given socio-technical context. We apply the pattern to the hypothetical use case of an autonomous robo-taxi service in a city centre.


title: mc-BEiT: Multi-choice Discretization for Image BERT Pre-training

abstract: Image BERT pre-training with masked image modeling (MIM) becomes a popular practice to cope with self-supervised representation learning. A seminal work, BEiT, casts MIM as a classification task with a visual vocabulary, tokenizing the continuous visual signals into discrete vision tokens using a pre-learned dVAE. Despite a feasible solution, the improper discretization hinders further improvements of image pre-training. Since image discretization has no ground-truth answers, we believe that the masked patch should not be assigned with a unique token id even if a better tokenizer can be obtained. In this work, we introduce an improved BERT-style image pre-training method, namely mc-BEiT, which performs MIM proxy tasks towards eased and refined multi-choice training objectives. Specifically, the multi-choice supervision for the masked image patches is formed by the soft probability vectors of the discrete token ids, which are predicted by the off-the-shelf image tokenizer and further refined by high-level inter-patch perceptions resorting to the observation that similar patches should share their choices. Extensive experiments on classification, segmentation, and detection tasks demonstrate the superiority of our method, e.g., the pre-trained ViT-B achieves 84.1% top-1 fine-tuning accuracy on ImageNet-1K classification, 49.2% AP^b and 44.0% AP^m of object detection and instance segmentation on COCO, 50.8% mIOU on ADE20K semantic segmentation, outperforming the competitive counterparts. The code will be available at https://github.com/lixiaotong97/mc-BEiT.


title: Schur-Nevanlinna parameters, Riesz bases, and compact Hankel operators on the model space

abstract: We study Riesz bases/Riesz sequences of reproducing kernels in the model space $K_\theta$ in connection with the corresponding Schur--Nevanlinna parameters and functions. In particular, we construct inner functions with given Schur--Nevanlinna parameters at a given sequence $\Lambda$ such that the corresponding systems of projections of reproducing kernels in the model space are complete/non complete. Furthermore, we give a compactness criterion for Hankel operators with symbol $\theta\overline B$, where $\theta$ is an inner function and $B$ is an interpolating Blaschke product and use this criterion to describe Riesz bases $\mathcal K_{\Lambda, \theta}$, with $\lim_{\lambda \in \Lambda, |\lambda| \to 1} \theta(\lambda) =0$.


title: Photon-pair blockade in a Josephson-photonics circuit with two nondegenerate microwave resonators

abstract: We propose to generate photon-pair blockade in a Josephson-photonics circuit that consists of a dc voltage-biased Josephson junction in series with a superconducting charge qubit and two nondegenerate microwave resonators. The two-level charge qubit is utilized to create anticorrelations of the charge transport; that is, the simultaneous Cooper pair tunneling events are inhibited. When the Josephson frequency matches the sum of resonance frequencies of the charge qubit and the two resonators, we demonstrate that the two resonators can release their energies in the form of antibunched pairs of two strongly correlated photons. The present work provides a practical way for producing a bright microwave source of antibunched photon pairs, with potential applications ranging from spectroscopy and metrology to quantum information processing.


title: A detailed study on novel metamaterial absorber at WR3 band

abstract: Frequency band of 30 to 300 GHz, which is termed as mm wave band offers 100 times bandwidth as compared to sub 6 GHz band. In this study, we propose a novel design which acts as a near unity absorber at 258 GHz or 0.258 THz in Y polarization and 292 GHz or 0.292 THz in X polarization. The study also includes effect of change in parameters on resonance frequency in both X and Y polarization which allows us to use same design with modified parameters to get near unity absorptivity in frequency of 205 to 345 GHz. Further, we also discuss on higher frequency mode which particularly appears in Y polarization and on changing the inner square dimension of the design.


title: A Style-aware Discriminator for Controllable Image Translation

abstract: Current image-to-image translations do not control the output domain beyond the classes used during training, nor do they interpolate between different domains well, leading to implausible results. This limitation largely arises because labels do not consider the semantic distance. To mitigate such problems, we propose a style-aware discriminator that acts as a critic as well as a style encoder to provide conditions. The style-aware discriminator learns a controllable style space using prototype-based self-supervised learning and simultaneously guides the generator. Experiments on multiple datasets verify that the proposed model outperforms current state-of-the-art image-to-image translation methods. In contrast with current methods, the proposed approach supports various applications, including style interpolation, content transplantation, and local image translation.