title: Classifying In-Place Gestures with End-to-End Point Cloud Learning

abstract: Walking in place for moving through virtual environments has attracted noticeable attention recently. Recent attempts focused on training a classifier to recognize certain patterns of gestures (e.g., standing, walking, etc) with the use of neural networks like CNN or LSTM. Nevertheless, they often consider very few types of gestures and/or induce less desired latency in virtual environments. In this paper, we propose a novel framework for accurate and efficient classification of in-place gestures. Our key idea is to treat several consecutive frames as a "point cloud". The HMD and two VIVE trackers provide three points in each frame, with each point consisting of 12-dimensional features (i.e., three-dimensional position coordinates, velocity, rotation, angular velocity). We create a dataset consisting of 9 gesture classes for virtual in-place locomotion. In addition to the supervised point-based network, we also take unsupervised domain adaptation into account due to inter-person variations. To this end, we develop an end-to-end joint framework involving both a supervised loss for supervised point learning and an unsupervised loss for unsupervised domain adaptation. Experiments demonstrate that our approach generates very promising outcomes, in terms of high overall classification accuracy (95.0%) and real-time performance (192ms latency). Our code will be publicly available at: https://github.com/ZhaoLizz/PCT-MCD.


title: DenseTNT: End-to-end Trajectory Prediction from Dense Goal Sets

abstract: Due to the stochasticity of human behaviors, predicting the future trajectories of road agents is challenging for autonomous driving. Recently, goal-based multi-trajectory prediction methods are proved to be effective, where they first score over-sampled goal candidates and then select a final set from them. However, these methods usually involve goal predictions based on sparse pre-defined anchors and heuristic goal selection algorithms. In this work, we propose an anchor-free and end-to-end trajectory prediction model, named DenseTNT, that directly outputs a set of trajectories from dense goal candidates. In addition, we introduce an offline optimization-based technique to provide multi-future pseudo-labels for our final online model. Experiments show that DenseTNT achieves state-of-the-art performance, ranking 1st on the Argoverse motion forecasting benchmark and being the 1st place winner of the 2021 Waymo Open Dataset Motion Prediction Challenge.


title: Deep survival analysis with longitudinal X-rays for COVID-19

abstract: Time-to-event analysis is an important statistical tool for allocating clinical resources such as ICU beds. However, classical techniques like the Cox model cannot directly incorporate images due to their high dimensionality. We propose a deep learning approach that naturally incorporates multiple, time-dependent imaging studies as well as non-imaging data into time-to-event analysis. Our techniques are benchmarked on a clinical dataset of 1,894 COVID-19 patients, and show that image sequences significantly improve predictions. For example, classical time-to-event methods produce a concordance error of around 30-40% for predicting hospital admission, while our error is 25% without images and 20% with multiple X-rays included. Ablation studies suggest that our models are not learning spurious features such as scanner artifacts. While our focus and evaluation is on COVID-19, the methods we develop are broadly applicable.


title: Real-complex transition driven by quasiperiodicity: a new universality class beyond $\mathcal{PT}$ symmetric one

abstract: We study a one-dimensional lattice model subject to non-Hermitian quasiperiodic potentials. Firstly, we strictly demonstrate that there exists an interesting dual mapping relation between $|a|<1$ and $|a|>1$ with regard to the potential tuning parameter $a$. The localization property of $|a|<1$ can be directly mapping to that of $|a|>1$, the analytical expression of the mobility edge of $|a|>1$ is therefore obtained through spectral properties of $|a|<1$. More impressive, we prove rigorously that even if the phase $\theta \neq 0$ in quasiperiodic potentials, the model becomes non-$\mathcal{PT}$ symmetric, however, there still exists a new type of real-complex transition driven by non-Hermitian disorder, which is a new universality class beyond $\mathcal{PT}$ symmetric class.


title: Bias for the Trace of the Resolvent and Its Application on Non-Gaussian and Non-centered MIMO Channels

abstract: The mutual information (MI) of Gaussian multi-input multi-output (MIMO) channels has been evaluated by utilizing random matrix theory (RMT) and shown to asymptotically follow Gaussian distribution, where the ergodic mutual information (EMI) converges to a deterministic quantity. However, with non-Gaussian channels, there is a bias between the EMI and its deterministic equivalent (DE), whose evaluation is not available in the literature. This bias of the EMI is related to the bias for the trace of the resolvent in large RMT. In this paper, we first derive the bias for the trace of the resolvent, which is further extended to compute the bias for the linear spectral statistics (LSS). Then, we apply the above results on non-Gaussian MIMO channels to determine the bias for the EMI. It is also proved that the bias for the EMI is $-0.5$ times of that for the variance of the MI. Finally, the derived bias is utilized to modify the central limit theory (CLT) and calculate the outage probability. Numerical results show that the modified CLT significantly outperforms previous methods in approximating the distribution of the MI and improves the accuracy for the outage probability evaluation.


title: Femtoscopic study of coupled-channel $N\Xi$ and $\Lambda\Lambda$ interactions

abstract: The momentum correlation functions of S = -2 baryon pairs (p Xi^- and Lambda Lambda) produced in high-energy pp and pA collisions are investigated on the basis of the coupled-channel formalism. The strong interaction is described by the coupled-channel HAL QCD potential obtained by the lattice QCD simulations near physical quark masses, while the hadronic source function is taken to be a static Gaussian form. The coupled-channel effect, the threshold difference, the realistic strong interaction, and the Coulomb interaction are fully taken into account for the first time in the femtoscopic analysis of baryon-baryon correlations. The characteristic features of the experimental data for the p Xi^- and Lambda Lambda pairs at LHC are reproduced quantitatively with a suitable choice of non-femtoscopic parameters and the source size. The agreement between theory and experiment indicates that the N Xi (Lambda Lambda) interaction is moderately (weakly) attractive without having a quasi-bound (bound) state.


title: Improving Mini-batch Optimal Transport via Partial Transportation

abstract: Mini-batch optimal transport (m-OT) has been widely used recently to deal with the memory issue of OT in large-scale applications. Despite their practicality, m-OT suffers from misspecified mappings, namely, mappings that are optimal on the mini-batch level but are partially wrong in the comparison with the optimal transportation plan between the original measures. Motivated by the misspecified mappings issue, we propose a novel mini-batch method by using partial optimal transport (POT) between mini-batch empirical measures, which we refer to as mini-batch partial optimal transport (m-POT). Leveraging the insight from the partial transportation, we explain the source of misspecified mappings from the m-OT and motivate why limiting the amount of transported masses among mini-batches via POT can alleviate the incorrect mappings. Finally, we carry out extensive experiments on various applications such as deep domain adaptation, partial domain adaptation, deep generative model, color transfer, and gradient flow to demonstrate the favorable performance of m-POT compared to current mini-batch methods.


title: A Systematic Review of Automated Query Reformulations in Source Code Search

abstract: Fixing software bugs and adding new features are two of the major maintenance tasks. Software bugs and features are reported as change requests. Developers consult these requests and often choose a few keywords from them as an ad hoc query. Then they execute the query with a search engine to find the exact locations within software code that need to be changed. Unfortunately, even experienced developers often fail to choose appropriate queries, which leads to costly trials and errors during a code search. Over the years, many studies attempt to reformulate the ad hoc queries from developers to support them. In this systematic literature review, we carefully select 70 primary studies on query reformulations from 2,970 candidate studies, perform an in-depth qualitative analysis (e.g., Grounded Theory), and then answer seven research questions with major findings. First, to date, eight major methodologies (e.g., term weighting, term co-occurrence analysis, thesaurus lookup) have been adopted to reformulate queries. Second, the existing studies suffer from several major limitations (e.g., lack of generalizability, vocabulary mismatch problem, subjective bias) that might prevent their wide adoption. Finally, we discuss the best practices and future opportunities to advance the state of research in search query reformulations.


title: Chiral phases for massive fermions and spinor classifications

abstract: We explore the physics of regular spinors in the Lounesto classification. These spinors are constructed by introducing two chiral phases. One is a degree of freedom present in choosing the $\gamma^{\mu}$ matrices that leaves the Lorentz generators invariant. Another is a degree of freedom allowed by the massive spin-half field that is unconstrained by Poincar\'{e} symmetry and locality. By choosing appropriate values of the two phases, we obtain all the classes of regular spinors. For the Dirac fermions, both phases are equal. We argue that the chiral phase of the Standard Model fermions is a new set of physical parameter. We find, the lepton chiral phases cannot be measured within the weak interaction. For quarks, their phases are conjectured to be identical. In general, to measure the phases between different fermionic generations would require interactions beyond the Standard Model.


title: Non-inductive plasma current sustainment with stochastic electron cyclotron in EXL-50 spherical torus

abstract: The start-up and sustainment of a stochastic wave non-inductive current on a spherical torus was experimentally demonstrated for the first time using only electron cyclotron waves. The plasma current is insensitive to the injection angle of ECWs and approximately linearly correlated with the slope of the X-ray spectrum. Its direction is determined by the vertical magnetic field (BV). The temporal development in the number of X-ray bremsstrahlung photons with a specified energy is consistent with the stochastic heating model. Moreover, the ratio of Amps to Watts of the ECW is generally >1 kA/kW under normal conditions (maximum plasma current: 150 kA, ECW: 140 kW). The experimental results are explained using the stochastic heating model of the asymmetric electron velocity distribution in stochastic electromagnetic waves.


title: The Exploitation of Distance Distributions for Clustering

abstract: Although distance measures are used in many machine learning algorithms, the literature on the context-independent selection and evaluation of distance measures is limited in the sense that prior knowledge is used. In cluster analysis, current studies evaluate the choice of distance measure after applying unsupervised methods based on error probabilities, implicitly setting the goal of reproducing predefined partitions in data. Such studies use clusters of data that are often based on the context of the data as well as the custom goal of the specific study. Depending on the data context, different properties for distance distributions are judged to be relevant for appropriate distance selection. However, if cluster analysis is based on the task of finding similar partitions of data, then the intrapartition distances should be smaller than the interpartition distances. By systematically investigating this specification using distribution analysis through a mirrored-density plot, it is shown that multimodal distance distributions are preferable in cluster analysis. As a consequence, it is advantageous to model distance distributions with Gaussian mixtures prior to the evaluation phase of unsupervised methods. Experiments are performed on several artificial datasets and natural datasets for the task of clustering.


title: Domain Adaptation for Underwater Image Enhancement

abstract: Recently, learning-based algorithms have shown impressive performance in underwater image enhancement. Most of them resort to training on synthetic data and achieve outstanding performance. However, these methods ignore the significant domain gap between the synthetic and real data (i.e., interdomain gap), and thus the models trained on synthetic data often fail to generalize well to real underwater scenarios. Furthermore, the complex and changeable underwater environment also causes a great distribution gap among the real data itself (i.e., intra-domain gap). However, almost no research focuses on this problem and thus their techniques often produce visually unpleasing artifacts and color distortions on various real images. Motivated by these observations, we propose a novel Two-phase Underwater Domain Adaptation network (TUDA) to simultaneously minimize the inter-domain and intra-domain gap. Concretely, a new dual-alignment network is designed in the first phase, including a translation part for enhancing realism of input images, followed by an enhancement part. With performing image-level and feature-level adaptation in two parts by jointly adversarial learning, the network can better build invariance across domains and thus bridge the inter-domain gap. In the second phase, we perform an easy-hard classification of real data according to the assessed quality of enhanced images, where a rank-based underwater quality assessment method is embedded. By leveraging implicit quality information learned from rankings, this method can more accurately assess the perceptual quality of enhanced images. Using pseudo labels from the easy part, an easy-hard adaptation technique is then conducted to effectively decrease the intra-domain gap between easy and hard samples.


title: Radiation Reaction Enhancement in Flying Focus Pulses

abstract: Radiation reaction (RR) is the oldest still-unsolved problem in electrodynamics. In addition to conceptual difficulties in its theoretical formulation, the requirement of exceedingly large charge accelerations has thus far prevented its unambiguous experimental identification. Here, we show how measurable RR effects in a laser-electron interaction can be achieved through the use of flying focus pulses (FFPs). By allowing the focus to counterpropagate with respect to the pulse phase velocity, a FFP overcomes the intrinsic limitation of a conventional laser Gaussian pulse (GP) that limits its focus to a Rayleigh range. For an electron initially also counterpropagating with respect to the pulse phase velocity, an extended interaction length with the laser peak intensity is achieved in a FFP. As a result, the same RR deceleration factors are obtained, but at FFP laser powers orders of magnitude lower than for ultrashort GPs with the same energy. This renders the proposed setup much more stable than those using GPs and allows for more accurate \emph{in situ} diagnostics. Using the Landau-Lifshitz equation of motion, we show numerically and analytically that the capability of emerging laser systems to deliver focused FFPs will allow for a clear experimental identification of RR.


title: Stable and scalable multistage terahertz-driven particle accelerator

abstract: Particle accelerators that use electromagnetic fields to increase a charged particle's energy have greatly advanced the development of science and industry since invention. However, the enormous cost and size of conventional radio-frequency accelerators have limited their accessibility. Here we demonstrate a mini-accelerator powered by terahertz pulses with wavelengths 100 times shorter than radio-frequency pulses. By injecting a short relativistic electron bunch to a 30-mm-long dielectric-lined waveguide and tuning the frequency of a 20-period terahertz pulse to the phase-velocity-matched value, precise and sustained acceleration for nearly 100% of the electrons is achieved with the beam energy spread essentially unchanged. Furthermore, by accurately controlling the phase of two terahertz pulses, the beam is stably accelerated successively in two dielectric waveguides with close to 100% charge coupling efficiency. Our results demonstrate stable and scalable beam acceleration in a multistage mini-accelerator and pave the way for functioning terahertz-driven high-energy accelerators.


title: Spectral compression by phase doubling in second harmonic generation

abstract: In second harmonic generation, the phase of the optical field is doubled which has important implication. Here the phase doubling effect is utilized to solve a long-standing challenge in power scaling of single frequency laser. When a (-{\pi}/2, {\pi}/2) binary phase modulation is applied to a single frequency seed laser to broaden the spectrum and suppress the stimulated Brillouin scattering in high power fiber amplifier, the second harmonic of the phase-modulated laser will return to single frequency, because the (-{\pi}/2, {\pi}/2) modulation is doubled to (-{\pi}, {\pi}) for the second harmonic. A compression rate as high as 95% is demonstrated in the experiment limited by the electronic bandwidth of the setup, which can be improved with optimized devices.


title: Continuum percolation in stochastic homogenization and the effective viscosity problem

abstract: This contribution is concerned with the effective viscosity problem, that is, the homogenization of the steady Stokes system with a random array of rigid particles, for which the main difficulty is the treatment of close particles. Standard approaches in the literature have addressed this issue by making moment assumptions on interparticle distances. Such assumptions however prevent clustering of particles, which is not compatible with physically-relevant particle distributions. In this contribution, we take a different perspective and consider moment bounds on the size of clusters of close particles. On the one hand, assuming such bounds, we construct correctors and prove homogenization (using a variational formulation and $\Gamma$-convergence to avoid delicate pressure issues). On the other hand, based on subcritical percolation techniques, these bounds are shown to hold for various mixing particle distributions with nontrivial clustering. As a by-product of the analysis, we also obtain similar homogenization results for compressible and incompressible linear elasticity with unbounded random stiffness.


title: $SO(10)$ models with $A_4$ modular symmetry

abstract: We combine $SO(10)$ Grand Unified Theories (GUTs) with $A_4$ modular symmetry and present a comprehensive analysis of the resulting quark and lepton mass matrices for all the simplest cases. We focus on the case where the three fermion families in the 16 dimensional spinor representation form a triplet of $\Gamma_3\simeq A_4$, with a Higgs sector comprising a single Higgs multiplet $H$ in the ${\mathbf{10}}$ fundamental representation and one Higgs field $\overline{\Delta}$ in the ${\mathbf{\overline{126}}}$ for the minimal models, plus and one Higgs field $\Sigma$ in the ${\mathbf{120}}$ for the non-minimal models, all with specified modular weights. The neutrino masses are generated by the type-I and/or type II seesaw mechanisms and results are presented for each model following an intensive numerical analysis where we have optimized the free parameters of the models in order to match the experimental data. For the phenomenologically successful models, we present the best fit results in numerical tabular form as well as showing the most interesting graphical correlations between parameters, including leptonic CP phases and neutrinoless double beta decay, which have yet to be measured, leading to definite predictions for each of the models.


title: ExamGAN and Twin-ExamGAN for Exam Script Generation

abstract: Nowadays, the learning management system (LMS) has been widely used in different educational stages from primary to tertiary education for student administration, documentation, tracking, reporting, and delivery of educational courses, training programs, or learning and development programs. Towards effective learning outcome assessment, the exam script generation problem has attracted many attentions and been investigated recently. But the research in this field is still in its early stage. There are opportunities to further improve the quality of generated exam scripts in various aspects. In particular, two essential issues have been ignored largely by existing solutions. First, given a course, it is unknown yet how to generate an exam script which can result in a desirable distribution of student scores in a class (or across different classes). Second, while it is frequently encountered in practice, it is unknown so far how to generate a pair of high quality exam scripts which are equivalent in assessment (i.e., the student scores are comparable by taking either of them) but have significantly different sets of questions. To fill the gap, this paper proposes ExamGAN (Exam Script Generative Adversarial Network) to generate high quality exam scripts, and then extends ExamGAN to T-ExamGAN (Twin-ExamGAN) to generate a pair of high quality exam scripts. Based on extensive experiments on three benchmark datasets, it has verified the superiority of proposed solutions in various aspects against the state-of-the-art. Moreover, we have conducted a case study which demonstrated the effectiveness of proposed solution in a real teaching scenario.


title: On energy gap phenomena of the Whitney spheres in $\mathbb{C}^n$ or $\mathbb{CP}^n$

abstract: In \cite{Zh} \cite{LY} Zhang, Luo and Yin initiated the study of Lagrangian submanifolds satisfying ${\rm \nabla^*} T=0$ or ${\rm \nabla^*\nabla^*}T=0$ in $\mathbb{C}^n$ or $\mathbb{CP}^n$, where $T ={\rm \nabla^*}\tilde{h}$ and $\tilde{h}$ is the Lagrangian trace-free second fundamental form. They proved several rigidity theorems for Lagrangian surfaces satisfying ${\rm \nabla^*} T=0$ or ${\rm \nabla^*\nabla^*}T=0$ in $\mathbb{C}^2$ under proper small energy assumption and gave new characterization of the Whitney spheres in $\mathbb{C}^2$. In this paper we extend these results to Lagrangian submanifolds in $\mathbb{C}^n$ of dimension $n\geq3$ and to Lagrangian submanifolds in $\mathbb{CP}^n$.


title: Kapitza resistance at a domain boundary in linear and nonlinear chains

abstract: We explore Kapitza thermal resistance on the boundary between two homogeneous chain fragments with different characteristics. For a linear model, an exact expression for the resistance is derived, and well-defined in the thermodynamic limit. However, the resistance in this case depends on the thermostat properties and therefore is not a local property of the considered domain boundary. If the domains are nonlinear, but integrable - Toda lattice, elastically colliding particles - the anomalies are similar to the case of the linear chain, besides well-articulated thermal dependence of the resistance. For the case of elastically colliding particles, this dependence follows a simple scaling law - the resistance is proportional to the inverse square root of the temperature. For Fermi-Pasta-Ulam domains, both the temperature drop and the heat flux decrease with the chain length, but with different exponents, so the resistance vanishes in the thermodynamic limit. For the domains comprised of rotators, the thermal resistance exhibits the expected normal behavior.


title: Evolutionary Ensemble Learning for Multivariate Time Series Prediction

abstract: Multivariate time series (MTS) prediction plays a key role in many fields such as finance, energy and transport, where each individual time series corresponds to the data collected from a certain data source, so-called channel. A typical pipeline of building an MTS prediction model (PM) consists of selecting a subset of channels among all available ones, extracting features from the selected channels, and building a PM based on the extracted features, where each component involves certain optimization tasks, i.e., selection of channels, feature extraction (FE) methods, and PMs as well as configuration of the selected FE method and PM. Accordingly, pursuing the best prediction performance corresponds to optimizing the pipeline by solving all of its involved optimization problems. This is a non-trivial task due to the vastness of the solution space. Different from most of the existing works which target at optimizing certain components of the pipeline, we propose a novel evolutionary ensemble learning framework to optimize the entire pipeline in a holistic manner. In this framework, a specific pipeline is encoded as a candidate solution and a multi-objective evolutionary algorithm is applied under different population sizes to produce multiple Pareto optimal sets (POSs). Finally, selective ensemble learning is designed to choose the optimal subset of solutions from the POSs and combine them to yield final prediction by using greedy sequential selection and least square methods. We implement the proposed framework and evaluate our implementation on two real-world applications, i.e., electricity consumption prediction and air quality prediction. The performance comparison with state-of-the-art techniques demonstrates the superiority of the proposed approach.


title: A novel method for monitoring proton beam spot using back-streaming secondary neutrons from the target

abstract: The power of the proton beam of a high-power spallation neutron source generally ranges from 100 kW to several MW. The distribution of the power density of the beam on the target is critical for the stable operation of the high-power spallation target. This study proposes a beam monitoring method that involves restoring the image of a high-power proton beam spot on a target based on the principle of pinhole imaging by using the back-streaming of secondary neutrons from the spallation target. Fast and indirect imaging of the beam spot can be achieved at a distance of tens of meters from the target. The proposed method of beam monitoring can flexibly adjust the size of the pinhole and the measurement distance to control the intensity of flux of the secondary neutrons according to the demands of the detection system, which is far from the high-radiation target area. The results of simulations showed that the proposed method can be used to restore the beam spot of the incident proton by using the point response function and images of the secondary neutrons. Based on the target and the Back-n beamline in the CSNS, the effectiveness of this method has also been confirmed.


title: From Two to One: A New Scene Text Recognizer with Visual Language Modeling Network

abstract: In this paper, we abandon the dominant complex language model and rethink the linguistic learning process in the scene text recognition. Different from previous methods considering the visual and linguistic information in two separate structures, we propose a Visual Language Modeling Network (VisionLAN), which views the visual and linguistic information as a union by directly enduing the vision model with language capability. Specially, we introduce the text recognition of character-wise occluded feature maps in the training stage. Such operation guides the vision model to use not only the visual texture of characters, but also the linguistic information in visual context for recognition when the visual cues are confused (e.g. occlusion, noise, etc.). As the linguistic information is acquired along with visual features without the need of extra language model, VisionLAN significantly improves the speed by 39% and adaptively considers the linguistic information to enhance the visual features for accurate recognition. Furthermore, an Occlusion Scene Text (OST) dataset is proposed to evaluate the performance on the case of missing character-wise visual cues. The state of-the-art results on several benchmarks prove our effectiveness. Code and dataset are available at https://github.com/wangyuxin87/VisionLAN.


title: Sequence Reconstruction for Limited-Magnitude Errors

abstract: Motivated by applications to DNA storage, we study reconstruction and list-reconstruction schemes for integer vectors that suffer from limited-magnitude errors. We characterize the asymptotic size of the intersection of error balls in relation to the code's minimum distance. We also devise efficient reconstruction algorithms for various limited-magnitude error parameter ranges. We then extend these algorithms to the list-reconstruction scheme, and show the trade-off between the asymptotic list size and the number of required channel outputs. These results apply to all codes, without any assumptions on the code structure. Finally, we also study linear reconstruction codes with small intersection, as well as show a connection to list-reconstruction codes for the tandem-duplication channel.


title: SIDE: Center-based Stereo 3D Detector with Structure-aware Instance Depth Estimation

abstract: 3D detection plays an indispensable role in environment perception. Due to the high cost of commonly used LiDAR sensor, stereo vision based 3D detection, as an economical yet effective setting, attracts more attention recently. For these approaches based on 2D images, accurate depth information is the key to achieve 3D detection, and most existing methods resort to a preliminary stage for depth estimation. They mainly focus on the global depth and neglect the property of depth information in this specific task, namely, sparsity and locality, where exactly accurate depth is only needed for these 3D bounding boxes. Motivated by this finding, we propose a stereo-image based anchor-free 3D detection method, called structure-aware stereo 3D detector (termed as SIDE), where we explore the instance-level depth information via constructing the cost volume from RoIs of each object. Due to the information sparsity of local cost volume, we further introduce match reweighting and structure-aware attention, to make the depth information more concentrated. Experiments conducted on the KITTI dataset show that our method achieves the state-of-the-art performance compared to existing methods without depth map supervision.


title: New Trends in Quantum Machine Learning

abstract: Here we will give a perspective on new possible interplays between Machine Learning and Quantum Physics, including also practical cases and applications. We will explore the ways in which machine learning could benefit from new quantum technologies and algorithms to find new ways to speed up their computations by breakthroughs in physical hardware, as well as to improve existing models or devise new learning schemes in the quantum domain. Moreover, there are lots of experiments in quantum physics that do generate incredible amounts of data and machine learning would be a great tool to analyze those and make predictions, or even control the experiment itself. On top of that, data visualization techniques and other schemes borrowed from machine learning can be of great use to theoreticians to have better intuition on the structure of complex manifolds or to make predictions on theoretical models. This new research field, named as Quantum Machine Learning, is very rapidly growing since it is expected to provide huge advantages over its classical counterpart and deeper investigations are timely needed since they can be already tested on the already commercially available quantum machines.


title: Non-redundant optical phased array

abstract: Optical phased array (OPA) is a promising beam-steering device for various applications such as light detection and ranging (LiDAR), optical projection, free-space optical communication and switching. However, the previously reported OPAs suffer from either an insufficiently small number of resolvable points, or a complicated control requirement due to an extremely large number of phase shifters. This work introduces a novel array configuration for OPA devices based on the non-redundant array (NRA) concept. Based on this design, we can realize high-resolution OPA whose number of resolvable points scales with N2. In contrast, that of traditional OPAs scales only with N. Thus, a significant reduction in the number of required phase shifters can be attained without sacrificing the number of resolvable points. We first investigate the impact of employing the NRA theoretically by considering the autocorrelation function of the array layout. We then develop a Costas-array-based silicon OPA and experimentally demonstrate 2D beam steering with ~19,000 resolvable points using only 127 phase shifters. This corresponds to the largest number of resolvable points achieved by an OPA without sweeping the wavelength to the best of our knowledge.


title: Relational Embedding for Few-Shot Classification

abstract: We propose to address the problem of few-shot classification by meta-learning "what to observe" and "where to attend" in a relational perspective. Our method leverages relational patterns within and between images via self-correlational representation (SCR) and cross-correlational attention (CCA). Within each image, the SCR module transforms a base feature map into a self-correlation tensor and learns to extract structural patterns from the tensor. Between the images, the CCA module computes cross-correlation between two image representations and learns to produce co-attention between them. Our Relational Embedding Network (RENet) combines the two relational modules to learn relational embedding in an end-to-end manner. In experimental evaluation, it achieves consistent improvements over state-of-the-art methods on four widely used few-shot classification benchmarks of miniImageNet, tieredImageNet, CUB-200-2011, and CIFAR-FS.


title: Moduli Space of Factorized Ramified Connections and Generalized Isomonodromic Deformation

abstract: We introduce the notion of factorized ramified structure on a generic ramified irregular singular connection on a smooth projective curve. By using the deformation theory of connections with factorized ramified structure, we construct a canonical 2-form on the moduli space of ramified connections. Since the factorized ramified structure provides a duality on the tangent space of the moduli space, the 2-form becomes nondegenerate. We prove that the 2-form on the moduli space of ramified connections is d-closed via constructing an unfolding of the moduli space. Based on the Stokes data, we introduce the notion of local generalized isomonodromic deformation for generic unramified irregular singular connections on a unit disk. Applying the Jimbo-Miwa-Ueno theory to generic unramified connections, the local generalized isomonodromic deformationis equivalent to the extendability of the family of connections to an integrable connection. We give the same statement for ramified connections. Based on this principle of Jimbo-Miwa-Ueno theory, we construct a global generalized isomonodromic deformation on the moduli space of generic ramified connections by constructing a horizontal lift of a universal family of connections. As a consequence of the global generalized isomonodromic deformation, we can lift the relative symplectic form on the moduli space to a total closed form, which is called a generalized isomonodromic 2-form.


title: Learning of Visual Relations: The Devil is in the Tails

abstract: Significant effort has been recently devoted to modeling visual relations. This has mostly addressed the design of architectures, typically by adding parameters and increasing model complexity. However, visual relation learning is a long-tailed problem, due to the combinatorial nature of joint reasoning about groups of objects. Increasing model complexity is, in general, ill-suited for long-tailed problems due to their tendency to overfit. In this paper, we explore an alternative hypothesis, denoted the Devil is in the Tails. Under this hypothesis, better performance is achieved by keeping the model simple but improving its ability to cope with long-tailed distributions. To test this hypothesis, we devise a new approach for training visual relationships models, which is inspired by state-of-the-art long-tailed recognition literature. This is based on an iterative decoupled training scheme, denoted Decoupled Training for Devil in the Tails (DT2). DT2 employs a novel sampling approach, Alternating Class-Balanced Sampling (ACBS), to capture the interplay between the long-tailed entity and predicate distributions of visual relations. Results show that, with an extremely simple architecture, DT2-ACBS significantly outperforms much more complex state-of-the-art methods on scene graph generation tasks. This suggests that the development of sophisticated models must be considered in tandem with the long-tailed nature of the problem.


title: Using Large Pre-Trained Models with Cross-Modal Attention for Multi-Modal Emotion Recognition

abstract: Recently, self-supervised pre-training has shown significant improvements in many areas of machine learning, including speech and NLP. We propose using large self-supervised pre-trained models for both audio and text modality with cross-modality attention for multimodal emotion recognition. We use Wav2Vec2.0 [1] as an audio encoder base for robust speech features extraction and the BERT model [2] as a text encoder base for better contextual representation of text. These high capacity models trained on large amounts of unlabeled data contain rich feature representations and improve the downstream task's performance. We use the cross-modal attention [3] mechanism to learn alignment between audio and text representations from self-supervised models. Cross-modal attention also helps in extracting interactive information between audio and text features. We obtain utterance-level feature representation from frame-level features using statistics pooling for both audio and text modality and combine them using the early fusion technique. Our experiments show that the proposed approach obtains a 1.88% absolute improvement in accuracy compared to the previous state-of-the-art method [3] on the IEMOCAP dataset [35]. We also conduct unimodal experiments for both audio and text modalities and compare them with previous best methods.


title: Exploring the role of cosmological shock waves in the Dianoga simulations of galaxy clusters

abstract: Cosmological shock waves are ubiquitous to cosmic structure formation and evolution. As a consequence, they play a major role in the energy distribution and thermalization of the intergalactic medium (IGM). We analyze the Mach number distribution in the Dianoga simulations of galaxy clusters performed with the SPH code GADGET-3. The simulations include the effects of radiative cooling, star formation, metal enrichment, supernova and active galactic nuclei feedback. A grid-based shock-finding algorithm is applied in post-processing to the outputs of the simulations. This procedure allows us to explore in detail the distribution of shocked cells and their strengths as a function of cluster mass, redshift and baryonic physics. We also pay special attention to the connection between shock waves and the cool-core/non-cool core (CC/NCC) state and the global dynamical status of the simulated clusters. In terms of general shock statistics, we obtain a broad agreement with previous works, with weak (low-Mach number) shocks filling most of the volume and processing most of the total thermal energy flux. As a function of cluster mass, we find that massive clusters seem more efficient in thermalising the IGM and tend to show larger external accretion shocks than less massive systems. We do not find any relevant difference between CC and NCC clusters. However, we find a mild dependence of the radial distribution of the shock Mach number on the cluster dynamical state, with disturbed systems showing stronger shocks than regular ones throughout the cluster volume.


title: Pi-NAS: Improving Neural Architecture Search by Reducing Supernet Training Consistency Shift

abstract: Recently proposed neural architecture search (NAS) methods co-train billions of architectures in a supernet and estimate their potential accuracy using the network weights detached from the supernet. However, the ranking correlation between the architectures' predicted accuracy and their actual capability is incorrect, which causes the existing NAS methods' dilemma. We attribute this ranking correlation problem to the supernet training consistency shift, including feature shift and parameter shift. Feature shift is identified as dynamic input distributions of a hidden layer due to random path sampling. The input distribution dynamic affects the loss descent and finally affects architecture ranking. Parameter shift is identified as contradictory parameter updates for a shared layer lay in different paths in different training steps. The rapidly-changing parameter could not preserve architecture ranking. We address these two shifts simultaneously using a nontrivial supernet-Pi model, called Pi-NAS. Specifically, we employ a supernet-Pi model that contains cross-path learning to reduce the feature consistency shift between different paths. Meanwhile, we adopt a novel nontrivial mean teacher containing negative samples to overcome parameter shift and model collision. Furthermore, our Pi-NAS runs in an unsupervised manner, which can search for more transferable architectures. Extensive experiments on ImageNet and a wide range of downstream tasks (e.g., COCO 2017, ADE20K, and Cityscapes) demonstrate the effectiveness and universality of our Pi-NAS compared to supervised NAS. See Codes: https://github.com/Ernie1/Pi-NAS.


title: Direct observation of zero modes in a non-Hermitian nanocavity array

abstract: Zero modes are symmetry protected ones whose energy eigenvalues have zero real parts. In Hermitian arrays, they arise as a consequence of the sublattice symmetry, implying that they are dark modes. In non-Hermitian systems, that naturally emerge in gain/loss optical cavities, particle-hole symmetry prevails instead; the resulting zero modes are no longer dark but feature ${\pi}/2$ phase jumps between adjacent cavities. Here we report on the direct observation of zero modes in a non-Hermitian three coupled photonic crystal nanocavity array containing quantum wells. Unlike the Hermitian counterparts, the non-Hermitian zero modes can only be observed for small sublattice detuning, and they can be identified through far-field imaging and spectral filtering of the photoluminescence at selected pump locations. We explain the zero mode coalescence as a parity-time phase transition for small coupling. These zero modes are robust against coupling disorder, and can be used for laser mode engineering and photonic computing.


title: A Unified Framework for Hopsets and Spanners

abstract: Given an undirected graph $G=(V,E)$, an {\em $(\alpha,\beta)$-spanner} $H=(V,E')$ is a subgraph that approximately preserves distances; for every $u,v\in V$, $d_H(u,v)\le \alpha\cdot d_G(u,v)+\beta$. An $(\alpha,\beta)$-hopset is a graph $H=(V,E")$, so that adding its edges to $G$ guarantees every pair has an $\alpha$-approximate shortest path that has at most $\beta$ edges (hops), that is, $d_G(u,v)\le d_{G\cup H}^{(\beta)}(u,v)\le \alpha\cdot d_G(u,v)$. Given the usefulness of spanners and hopsets for fundamental algorithmic tasks, several different algorithms and techniques were developed for their construction, for various regimes of the stretch parameter $\alpha$. In this work we develop a single algorithm that can attain all state-of-the-art spanners and hopsets for general graphs, by choosing the appropriate input parameters. In fact, in some cases it also improves upon the previous best results. We also show a lower bound on our algorithm. In \cite{BP20}, given a parameter $k$, a $(O(k^{\epsilon}),O(k^{1-\epsilon}))$-hopset of size $\tilde{O}(n^{1+1/k})$ was shown for any $n$-vertex graph and parameter $0<\epsilon<1$, and they asked whether this result is best possible. We resolve this open problem, showing that any $(\alpha,\beta)$-hopset of size $O(n^{1+1/k})$ must have $\alpha\cdot \beta\ge\Omega(k)$.


title: Detection and Localization of Multiple Image Splicing Using MobileNet V1

abstract: In modern society, digital images have become a prominent source of information and medium of communication. They can, however, be simply altered using freely available image editing software. Two or more images are combined to generate a new image that can transmit information across social media platforms to influence the people in the society. This information may have both positive and negative consequences. Hence there is a need to develop a technique that will detect and locates a multiple image splicing forgery in an image. This research work proposes multiple image splicing forgery detection using Mask R-CNN, with a backbone as a MobileNet V1. It also calculates the percentage score of a forged region of multiple spliced images. The comparative analysis of the proposed work with the variants of ResNet is performed. The proposed model is trained and tested using our MISD (Multiple Image Splicing Dataset), and it is observed that the proposed model outperforms the variants of ResNet models (ResNet 51,101 and 151).


title: Stress Topology Analysis for Porous Infill Optimization

abstract: The optimization of porous infill structures via local volume constraints has become a popular approach in topology optimization. In some design settings, however, the iterative optimization process converges only slowly, or not at all even after several hundreds or thousands of iterations. This leads to regions in which a distinct binary design is difficult to achieve. Interpreting intermediate density values by applying a threshold results in large solid or void regions, leading to sub-optimal structures. We find that this convergence issue relates to the topology of the stress tensor field that is simulated when applying the same external forces on the solid design domain. In particular, low convergence is observed in regions around so-called trisector degenerate points. Based on this observation, we propose an automatic initialization process that prescribes the topological skeleton of the stress field into the material field as solid simulation elements. These elements guide the material deposition around the degenerate points, but can also be remodelled or removed during the optimization. We demonstrate significantly improved convergence rates in a number of use cases with complex stress topologies. The improved convergence is demonstrated for infill optimization under homogeneous as well as spatially varying local volume constraints.


title: Efficient Gaussian Neural Processes for Regression

abstract: Conditional Neural Processes (CNP; Garnelo et al., 2018) are an attractive family of meta-learning models which produce well-calibrated predictions, enable fast inference at test time, and are trainable via a simple maximum likelihood procedure. A limitation of CNPs is their inability to model dependencies in the outputs. This significantly hurts predictive performance and renders it impossible to draw coherent function samples, which limits the applicability of CNPs in down-stream applications and decision making. Neural Processes (NPs; Garnelo et al., 2018) attempt to alleviate this issue by using latent variables, relying on these to model output dependencies, but introduces difficulties stemming from approximate inference. One recent alternative (Bruinsma et al., 2021), which we refer to as the FullConvGNP, models dependencies in the predictions while still being trainable via exact maximum-likelihood. Unfortunately, the FullConvGNP relies on expensive 2D-dimensional convolutions, which limit its applicability to only one-dimensional data. In this work, we present an alternative way to model output dependencies which also lends itself maximum likelihood training but, unlike the FullConvGNP, can be scaled to two- and three-dimensional data. The proposed models exhibit good performance in synthetic experiments.


title: The defocusing NLS equation with nonzero background: Large-time asymptotics in the solitonless region

abstract: We consider the Cauchy problem for the defocusing Schr$\ddot{\text{o}}$dinger (NLS) equation with a nonzero background $$\begin{align} &iq_t+q_{xx}-2(|q|^2-1)q=0, \nonumber\\ &q(x,0)=q_0(x), \quad \lim_{x \to \pm \infty}q_0(x)=\pm 1. \end{align}$$ Recently, for the space-time region $|x/(2t)|<1$ which is a solitonic region without stationary phase points on the jump contour, Cuccagna and Jenkins presented the asymptotic stability of the $N$-soliton solutions for the NLS equation by using the $\bar{\partial}$ generalization of the Deift-Zhou nonlinear steepest descent method. Their large-time asymptotic expansion takes the form \begin{align} q(x,t)= T(\infty)^{-2} q^{sol,N}(x,t) + \mathcal{O}(t^{-1 }),\label{res1} \end{align} whose leading term is N-soliton and the second term $\mathcal{O}(t^{-1})$ is a residual error from a $\overline\partial$-equation. In this paper, we are interested in the large-time asymptotics in the space-time region $ |x/(2t)|>1$ which is outside the soliton region, but there will be two stationary points appearing on the jump contour $\mathbb{R}$. We found a asymptotic expansion that is different from (\ref{res1}) $$\begin{align} q(x,t)= e^{-i\alpha(\infty)} \left(1 +t^{-1/2} h(x,t) \right)+\mathcal{O}\left(t^{-3/4}\right),\label{res2} \end{align}$$ whose leading term is a nonzero background, the second $t^{-1/2}$ order term is from continuous spectrum and the third term $\mathcal{O}(t^{-3/4})$ is a residual error from a $\overline\partial$-equation.The above two asymptotic results (\ref{res1}) and (\ref{res2}) imply that the region $ |x/(2t)|<1$ considered by Cuccagna and Jenkins is a fast decaying soliton solution region, while the region $ |x/(2t)|>1$ considered by us is a slow decaying nonzero background region.


title: Von Neumann Stability Analysis of DG-like and PNPM-like Schemes for PDEs that have Globally Curl-Preserving Evolution of Vector Fields

abstract: This paper examines a class of PDEs where some part of the PDE system evolves a vector field whose curl remains zero or grows in proportion to specified source terms. Such PDEs are referred to as curl-free or curl-preserving respectively. In this paper we catalogue a class of DG-like schemes for such PDEs. To retain the globally curl-free or curl-preserving constraints, the components of the vector field, as well as their higher moments, have to be collocated at the edges of the mesh. They are updated by using potentials that are collocated at the vertices of the mesh. The resulting schemes : 1) do not blow up even after very long integration times, 2) do not need any special cleaning treatment, 3) can operate with large explicit timesteps, 4) do not require the solution of an elliptic system and 5) can be extended to higher orders using DG-like methods. The methods rely on a special curl-preserving reconstruction and they also rely on multidimensional upwinding. The Galerkin projection, so crucial to the design of a DG method, is now carried out in the edges of the mesh and yields a weak form update that uses potentials that are obtained at the vertices of the mesh with the help of a multidimensional Riemann solver. A von Neumann stability analysis of the curl-preserving methods is carried out and the limiting CFL numbers of this entire family of methods is catalogued in this work. The stability analysis confirms that with increasing order of accuracy, our novel curl-free methods have superlative phase accuracy while substantially reducing dissipation. We also show that PNPM-like methods retain much of the excellent wave propagation characteristics of the DG-like methods while offering a much larger CFL number and lower computational complexity.


title: Metastable antiphase boundary ordering in CaFe$_{2}$O$_{4}$

abstract: CaFe$_{2}$O$_{4}$ is an $S=5/2$ antiferromagnet exhibiting two magnetic orders which shows regions of coexistence at some temperatures. Using a Green's function formalism, we model neutron scattering data of the spin wave excitations in this material, ellucidating the microscopic spin Hamiltonian. In doing so, we suggest that the low temperature A phase order $(\uparrow\uparrow\downarrow\downarrow)$ finds its origins in the freezing of antiphase boundaries created by thermal fluctuations in a parent B phase order $(\uparrow\downarrow\uparrow\downarrow)$. The low temperature magnetic order observed in CaFe$_{2}$O$_{4}$ is thus the result of a competition between the exchange coupling along $c$, which favors the B phase, and the single-ion anisotropy which stabilizes thermally-generated antiphase boundaries, leading to static metastable A phase order at low temperatures.


title: The third- and fourth-order orbital angular momentum multiplexed amplification with ultra-low differential mode gain

abstract: In this Letter, a ring-core erbium-doped fiber (RC-EDF), with two-layer erbium-doped structure, supporting up to the fourth-order orbital angular momentum (OAM) mode is designed and fabricated for OAM mode multiplexed amplification. Using the RC-EDF, the third- and fourth-order OAM modes amplification with ultra-low differential mode gain (DMG) is demonstrated by observing both the modal intensity and phase distribution and measuring the modal gain under the fundamental mode core-pumping. The measured average gain of four modes (l=+3, -3, +4, -4) multiplexed amplification is higher than 19dB cover the C-band and the DMG is less than 1dB. Additionally, the gain of two conjugate OAM modes are almost the same under different pump power no matter they are amplified simultaneously or separately.


title: Electronic Properties of Tetraazaperopyrene Derivatives on Au(111): Energy Level Alignment and Interfacial Band Formation

abstract: N-Heteropolycyclic aromatic compounds are promising organic electron-transporting semiconductors for applications in field effect transistors. Here, we investigated the electronic properties of 1,3,8,10-tetraazaperopyrene derivatives adsorbed on Au(111) using a complementary experimental approach, namely scanning tunneling spectroscopy and two-photon photoemission combined with state-of-the-art density functional calculations. We find signatures of weak physisorption of the molecular layers, such as the absence of charge transfer, a nearly unperturbed surface state and an intact herringbone reconstruction underneath the molecular layer. Interestingly, molecular states in the energy region of the \emph{sp}- and \emph{d}-bands of the Au(111) substrate exhibit hole-like dispersive character. We ascribe this band character to hybridization with the delocalized states of the substrate. We suggest that such bands, which effectively leave the molecular frontier orbitals largely unperturbed, to be a promising lead for the design of organic-metal interfaces with a low charge injection barrier.


title: Uncertainty-aware Clustering for Unsupervised Domain Adaptive Object Re-identification

abstract: Unsupervised Domain Adaptive (UDA) object re-identification (Re-ID) aims at adapting a model trained on a labeled source domain to an unlabeled target domain. State-of-the-art object Re-ID approaches adopt clustering algorithms to generate pseudo-labels for the unlabeled target domain. However, the inevitable label noise caused by the clustering procedure significantly degrades the discriminative power of Re-ID model. To address this problem, we propose an uncertainty-aware clustering framework (UCF) for UDA tasks. First, a novel hierarchical clustering scheme is proposed to promote clustering quality. Second, an uncertainty-aware collaborative instance selection method is introduced to select images with reliable labels for model training. Combining both techniques effectively reduces the impact of noisy labels. In addition, we introduce a strong baseline that features a compact contrastive loss. Our UCF method consistently achieves state-of-the-art performance in multiple UDA tasks for object Re-ID, and significantly reduces the gap between unsupervised and supervised Re-ID performance. In particular, the performance of our unsupervised UCF method in the MSMT17$\to$Market1501 task is better than that of the fully supervised setting on Market1501. The code of UCF is available at https://github.com/Wang-pengfei/UCF.


title: Hyperchaos in a Bose-Hubbard chain with Rydberg-dressed interactions

abstract: We study chaos and hyperchaos of Rydberg-dressed Bose-Einstein condensates (BECs) in a one-dimensional optical lattice. Due to the long-range soft-core interaction between the dressed atoms, the dynamics of the BECs are described by the extended Bose-Hubbard model. In the mean-field regime, we analyze the dynamical stability of the BEC by focusing on the groundstate and localized state configuration. Lyapunov exponents of the two configurations are calculated by varying the soft-core interaction strength, potential bias and length of the lattice. Both configurations can have multiple positive Lyapunov exponents, exhibiting hyperchaotic dynamics. We show the dependence of the number of the positive Lyapunov exponents and the largest Lyapunov exponent on the length of the optical lattice. The largest Lyapunov exponent is directly proportional to areas of phase space encompassed by the associated Poincar\'e sections. We demonstrate that linear and hysteresis quenches of the lattice potential and the dressed interaction lead to distinct dynamics due to the chaos and hyperchaos. Our work is relevant to current research on chaos, and collective and emergent nonlinear dynamics of BECs with long-range interactions.


title: Rainfall-runoff prediction using a Gustafson-Kessel clustering based Takagi-Sugeno Fuzzy model

abstract: A rainfall-runoff model predicts surface runoff either using a physically-based approach or using a systems-based approach. Takagi-Sugeno (TS) Fuzzy models are systems-based approaches and a popular modeling choice for hydrologists in recent decades due to several advantages and improved accuracy in prediction over other existing models. In this paper, we propose a new rainfall-runoff model developed using Gustafson-Kessel (GK) clustering-based TS Fuzzy model. We present comparative performance measures of GK algorithms with two other clustering algorithms: (i) Fuzzy C-Means (FCM), and (ii)Subtractive Clustering (SC). Our proposed TS Fuzzy model predicts surface runoff using: (i) observed rainfall in a drainage basin and (ii) previously observed precipitation flow in the basin outlet. The proposed model is validated using the rainfall-runoff data collected from the sensors installed on the campus of the Indian Institute of Technology, Kharagpur. The optimal number of rules of the proposed model is obtained by different validation indices. A comparative study of four performance criteria: RootMean Square Error (RMSE), Coefficient of Efficiency (CE), Volumetric Error (VE), and Correlation Coefficient of Determination(R) have been quantitatively demonstrated for each clustering algorithm.


title: Almost Monotonicity Formula for H-minimal Legendrian Surfaces in the Heisenberg Group

abstract: We prove an almost monotonicity formula for H-minimal Legendrian Surfaces (also called {\it contact stationary legendrian immersions}) in the Heisenberg Group ${\mathbb H}^2$ . From this formula we deduce a Bernstein-Liouville type theorem for H-minimal Legendrian Surfaces. This last result happens to be in particular a central ingredient in the analysis part of the proof of the Willmore conjecture given by the author in arXiv:2007.05467


title: Exploring the string shoving model in PYTHIA8 for collective behaviors in $pp$ collisions

abstract: Two-particle correlations have been used to study property of a produced medium called Quark-Gluon Plasma (QGP) in relativistic heavy-ion collisions, and a long-range correlation among produced particles has been considered as a strong evidence of strongly interacting QGP. Strikingly, clear long-range correlations have been also observed in small collision systems like $pp$ and $p$+$A$ at a wide range of collision energies. A model introducing a repulsive force between flux tubes called string shoving can qualitatively describe the long-range near-side correlations in high multiplicity $pp$ collisions. This model implemented in the PYTHIA Monte Carlo event generator allows us to perform detailed study. In this work, a full data analysis to calculate associated yields and flow coefficients is performed with PYTHIA events, and the results are compared with experimental results. We find that the string shoving model overestimates long-range near-side correlations particularly in low multiplicity events. We also introduce a method to subtract such overestimated correlations in low multiplicity to have a more relevant comparison with the data.


title: The complex zeros of random orthogonal polynomials

abstract: We utilize Cauchy's argument principle in combination with the Jacobian of a holomorphic function in several complex variables and the first moment of a ratio of two correlated complex normal random variables to prove explicit formulas for the density and the mean distribution of complex zeros of random polynomials spanned by orthogonal polynomials on the unit circle and on the unit disk. We then inquire into the consequences of their asymptotical evaluations.


title: Uniformization and Internal Absoluteness

abstract: Measurability with respect to ideals is tightly connected with absoluteness principles for certain forcing notions. We study a uniformization principle that postulates the existence of a uniformizing function on a large set, relative to a given ideal. We prove that for all $\sigma$-ideals $I$ such that the ideal forcing $\mathbb{P}_I$ of Borel sets modulo $I$ is proper, this uniformization principle is equivalent to an absoluteness principle for projective formulas with respect to $\mathbb{P}_I$ that we call internal absoluteness. In addition, we show that it is equivalent to measurability with respect to $I$ together with $1$-step absoluteness for the poset $\mathbb{P}_I$. These equivalences are new even for Cohen and random forcing and they are, to the best of our knowledge, the first precise equivalences between regularity and absoluteness beyond the second level of the projective hierarchy.


title: Improving Distantly Supervised Relation Extraction with Self-Ensemble Noise Filtering

abstract: Distantly supervised models are very popular for relation extraction since we can obtain a large amount of training data using the distant supervision method without human annotation. In distant supervision, a sentence is considered as a source of a tuple if the sentence contains both entities of the tuple. However, this condition is too permissive and does not guarantee the presence of relevant relation-specific information in the sentence. As such, distantly supervised training data contains much noise which adversely affects the performance of the models. In this paper, we propose a self-ensemble filtering mechanism to filter out the noisy samples during the training process. We evaluate our proposed framework on the New York Times dataset which is obtained via distant supervision. Our experiments with multiple state-of-the-art neural relation extraction models show that our proposed filtering mechanism improves the robustness of the models and increases their F1 scores.


title: The changing dynamics of HIV/AIDS during the Covid-19 pandemic in the Rohingya refugee camps in Bangladesh a call for action

abstract: COVID-19 pandemic has affected each and every country's health service and plunged refugees into the most desperate conditions. The plight of Rohingya refugees is among the harshest. It has severely affected their existing HIV/STI prevention and management services and further increased the risk of violence and onward HIV transmission within the camps. In this commentary, we discuss the context and the changing dynamics of HIV/AIDS during COVID-19 among the Rohingya refugee community in Bangladesh. What we currently observe is the worst crisis in the Rohingya refugee camps thus far. Firstly, because of being displaced, Rohingya refugees have increased vulnerability to HIV, as well as to STIs and other poor health outcomes. Secondly, for the same reason, they have inadequate access to HIV testing treatment and care. Not only because of their refugee status but also because of the poor capacity of the host country to provide services. Thirdly, a host of complex economic, socio-cultural and behavioural factors exacerbate their dire situation with access to HIV testing, treatment and care. And finally, the advent of the COVID-19 pandemic has changed priorities in all societies, including the refugee camps. In the context of the unfolding COVID-19 crisis, more emphasis is placed on COVID-19 rather than other health issues, which exacerbates the dire situation with HIV detection, management, and prevention among Rohingya refugees. Despite the common crisis experienced by most countries around the world, the international community has an obligation to work together to improve the life, livelihood, and health of those who are most vulnerable. Rohingya refugees are among them.


title: Guiding Query Position and Performing Similar Attention for Transformer-Based Detection Heads

abstract: After DETR was proposed, this novel transformer-based detection paradigm which performs several cross-attentions between object queries and feature maps for predictions has subsequently derived a series of transformer-based detection heads. These models iterate object queries after each cross-attention. However, they don't renew the query position which indicates object queries' position information. Thus model needs extra learning to figure out the newest regions that query position should express and need more attention. To fix this issue, we propose the Guided Query Position (GQPos) method to embed the latest location information of object queries to query position iteratively. Another problem of such transformer-based detection heads is the high complexity to perform attention on multi-scale feature maps, which hinders them from improving detection performance at all scales. Therefore we propose a novel fusion scheme named Similar Attention (SiA): besides the feature maps is fused, SiA also fuse the attention weights maps to accelerate the learning of high-resolution attention weight map by well-learned low-resolution attention weight map. Our experiments show that the proposed GQPos improves the performance of a series of models, including DETR, SMCA, YoloS, and HoiTransformer and SiA consistently improve the performance of multi-scale transformer-based detection heads like DETR and HoiTransformer.


title: Plasma engineering of microstructured piezo and triboelectric hybrid nanogenerators for wide bandwidth vibration energy harvesting

abstract: We introduce herein the advanced application of low pressure plasma procedures for the development of piezo and triboelectric mode I hybrid nanogenerators. Thus, plasma assisted deposition and functionalization methods are presented as key enabling technologies for the nanoscale design of ZnO polycrystalline shells, the formation of conducting metallic cores in core@shell nanowires, and for the solventless surface modification of polymeric coatings and matrixes. We show how the perfluorinated chains grafting of PDMS provides a reliable approach to increase the hydrophobicity and surface charges at the same time that keeping the PDMS mechanical properties. In this way, we produce efficient Ag/ZnO convoluted piezoelectric nanogenerators supported on flexible substrates and embedded in PDMS compatible with a contact separation triboelectric architecture. Factors like crystal-line texture, ZnO thickness, nanowires aspect ratio, and surface chemical modification of the PDMS are explored to optimize the power output of the nanogenerators aimed for harvesting from low-frequency vibrations. Just by manual trigger-ing, the hybrid device can charge a microcapacitor to switch on an array of color LEDs. Outstandingly, this simple three-layer architecture allows for harvesting vibration energy in a wide bandwidth, thus, we show the performance characteristics for frequencies between 1 Hz to 50 Hz and demonstrate the successful activation of the system up to ca. 800 Hz


title: Effects of the Crystalline Electric Field in the $KErTe_{2}$ Quantum Spin Liquid Candidate

abstract: In this paper, we performed thermodynamic and electron spin resonance (ESR) measurements to study low-energy magnetic excitations, which were significantly affected by crystalline electric field (CEF) excitations due to relatively small gaps between the CEF ground state and the excited states. Based on the CEF and mean-field (MF) theories, we analyzed systematically and consistently the ESR experiments and thermodynamic measurements including susceptibility, magnetization, and heat capacity. The CEF parameters were successfully extracted by fitting high-temperature (> 20 K) susceptibilities in the ab-plane and along the c-axis, allowing to determine the Lande factors ($g_{ab,calc}$ = 5.98(7) and $g_{c,calc}$ = 2.73(3)). These values were consistent with the values of Lande factors determined by ESR experiments ($g_{ab,exp}$ = 5.69 and $g_{c,exp}$ = 2.75). By applying the CEF and MF theories to the susceptibility and magnetization results, we estimated the anisotropic spin-exchange energies and found that the CEF excitations in \ce{KErTe2} played a decisive role in the magnetism above 3 K, while the low-temperature magnetism below 10 K was gradually correlated with the anisotropic spin-exchange interactions. The CEF excitations were demonstrated in the low-temperature heat capacity, where both the positions of two broad peaks and their magnetic field dependence well corroborated our calculations. The present study provides a basis to explore the enriched magnetic and electronic properties of the QSL family.


title: Foliations from left orders

abstract: We describe a construction which takes as an input a left order of the fundamental group of a manifold, and outputs a (singular) foliation of this manifold which is analogous to a taut foliation. We investigate this construction in detail in dimension $2$, and exhibit connections to various problems in dimension $3$.


title: Multistationarity of Reaction Networks with One-Dimensional Stoichiometric Subspaces

abstract: We study the multistationarity for the reaction networks with one-dimensional stoichiometric subspaces, and we focus on the networks admitting finitely many positive steady states. We prove that if a network admits multistationarity, then network has an embedded one-species network with arrow diagram (->,<-) and another with arrow diagram (<-,->). The inverse is also true if there exist two reactions in the network such that the subnetwork consisting of the two reactions admits at least one and finitely many positive steady states. We also prove that if a network admits at least three positive steady states, then it contains at least three bi-arrow diagrams. More than that, we completely characterize the bi-reaction networks that admit at least three positive steady states.


title: Spatial Transformer Networks for Curriculum Learning

abstract: Curriculum learning is a bio-inspired training technique that is widely adopted to machine learning for improved optimization and better training of neural networks regarding the convergence rate or obtained accuracy. The main concept in curriculum learning is to start the training with simpler tasks and gradually increase the level of difficulty. Therefore, a natural question is how to determine or generate these simpler tasks. In this work, we take inspiration from Spatial Transformer Networks (STNs) in order to form an easy-to-hard curriculum. As STNs have been proven to be capable of removing the clutter from the input images and obtaining higher accuracy in image classification tasks, we hypothesize that images processed by STNs can be seen as easier tasks and utilized in the interest of curriculum learning. To this end, we study multiple strategies developed for shaping the training curriculum, using the data generated by STNs. We perform various experiments on cluttered MNIST and Fashion-MNIST datasets, where on the former, we obtain an improvement of $3.8$pp in classification accuracy compared to the baseline.


title: Observation of a strong correlation between the positive floating potential near the edge and plasma current on EXL-50 ECW plasma

abstract: Fully non-inductive plasma current start-up without the central solenoid in ECW plasma was used on EXL-50 Spherical Torus with a weak external vertical field (Bv). Generally, the number of electrons leaving to the vessel wall by the gradient Bt is larger than ions, and the positive potential was built up in plasma. The relationship between floating potential and the plasma current was studied using the Langmuir probes near the boundary. The results show that the floating potential is positive (about 200V) and has a strong correlation with plasma current. In open magnetic field, the plasma current is driven by the high energy electrons in preferential confinement, the plasma current and potential approximately positively correlated with total electron density. After forming the closed flux surface, the plasma current consists mainly of the ECW driven current, and potential is negatively correlated with plasma current. By actively adjusting the Bv, it demonstrated that the positive voltage is approximately inversely correlated with the Bv and plasma current (Ip). Considering that the plasma temperature near the boundary is quite low (~eV), the positive voltage near the boundary caused by the high-energy electron loss. Therefore, the measurements of the boundary potential are important for the study of high-energy electron confinement performance, noninductive plasma current start-up and current driven.


title: The tabulation of prime knot projections with their mirror images up to eight double points

abstract: This paper provides the complete table of prime knot projections with their mirror images, without redundancy, up to eight double points systematically thorough a finite procedure by flypes. In this paper, we show how to tabulate the knot projections up to eight double points by listing tangles with at most four double points by an approach with respect to rational tangles of J. H. Conway. In other words, for a given prime knot projection of an alternating knot, we show how to enumerate possible projections of the alternating knot. Also to tabulate knot projections up to ambient isotopy, we introduce arrow diagrams (oriented Gauss diagrams) of knot projections having no over/under information of each crossing, which were originally introduced as arrow diagrams of knot diagrams by M. Polyak and O. Viro. Each arrow diagram of a knot projection completely detects the difference between the knot projection and its mirror image.


title: Dynamics of Colloidal Cubes and Cuboids in Cylindrical Nanopores

abstract: Understanding how colloidal suspensions behave in confined environments has a striking relevance in practical applications. Despite the fact that the behaviour of colloids in the bulk is key to identify the main elements affecting their equilibrium and dynamics, it is only by studying their response under confinement that one can ponder the use of colloids in formulation technology. In particular, confining fluids of anisotropic particles in nanopores provides the opportunity to control their phase behaviour and stabilise a spectrum of morphologies that cannot form in the bulk. By properly selecting pore geometry, particle architecture and system packing, it is possible to tune thermodynamic, structural and dynamical properties for ad hoc applications. In the present contribution, we report Grand Canonical and Dynamic Monte Carlo simulations of suspensions of colloidal cubes and cuboids constrained into cylindrical nanopores of different size. We first study their phase behaviour, calculate the chemical potential vs density equation of state and characterise the effect of the pore walls on particle anchoring and layering. In particular, at large enough concentrations, we observe the formation of concentric nematic-like coronas of oblate or prolate particles surrounding an isotropic core, whose features resemble those typically detected in the bulk. We then analyse the main characteristics of their dynamics and discover that these are dramatically determined by the ability of particles to diffuse in the longitudinal and radial direction of the nanopore.


title: The Bounded Isomorphism Conjecture for Spaces of Graphs with Large Girth

abstract: In this article we study a coarse version of the K-theoretic Farrell-Jones conjecture we call coarse or bounded isomorphism conjecture. With techniques that have already been used to prove the Farrell-Jones conjecture for hyperbolic groups we are able to verify the bounded isomorphism conjecture for spaces of graphs with large girth and bounded geometry.


title: Interpolating sequences for some subsets of analytic Besov type spaces

abstract: Let $B_p(s)$ be an analytic Besov type space. Let $M(B_p(s))$ be the class of multipliers of $B_p(s)$ and let $F(p, p-2, s)$ be the M\"obius invariant subspace generated by $B_p(s)$. In this paper, when $0<s<1$ and $\max\{s, 1-s\}<p\leq 1$, we give a completed description of interpolating sequences for $M(B_p(s))$ and $F(p, p-2, s)\cap H^\infty$. We also consider certain condition appeared in this description by an $L^p$ characterization and the closure of $F(p, p-2, s)$ in the Bloch space.


title: Self-Regulation for Semantic Segmentation

abstract: In this paper, we seek reasons for the two major failure cases in Semantic Segmentation (SS): 1) missing small objects or minor object parts, and 2) mislabeling minor parts of large objects as wrong classes. We have an interesting finding that Failure-1 is due to the underuse of detailed features and Failure-2 is due to the underuse of visual contexts. To help the model learn a better trade-off, we introduce several Self-Regulation (SR) losses for training SS neural networks. By "self", we mean that the losses are from the model per se without using any additional data or supervision. By applying the SR losses, the deep layer features are regulated by the shallow ones to preserve more details; meanwhile, shallow layer classification logits are regulated by the deep ones to capture more semantics. We conduct extensive experiments on both weakly and fully supervised SS tasks, and the results show that our approach consistently surpasses the baselines. We also validate that SR losses are easy to implement in various state-of-the-art SS models, e.g., SPGNet and OCRNet, incurring little computational overhead during training and none for testing.


title: Pairwise Node Localization From Differences in Their UWB Channels to Observer Nodes

abstract: We consider the problem of localization and distance estimation between a pair of wireless nodes in a multipath propagation environment, but not the usual way of processing a channel measurement between them. We propose a novel paradigm which compares the two nodes' ultra-wideband (UWB) channels to other nodes, called observers. The main idea is that the dissimilarity between the channel impulse responses (CIRs) increases with $d$ and allows for an estimate $\hat{d}$. Our approach relies on extracting common multipath components (MPCs) from the CIRs. This is realistic in indoor or urban scenarios and if $d$ is considerably smaller than the observer distances. We present distance estimators which utilize the rich location information contained in MPC delay differences. Likewise, we present estimators for the relative position vector which process both MPC delays and MPC directions. We do so for various important cases: with and without time synchronization, delay measurement errors, and knowledge of the MPC association between the CIRs. The estimators exhibit great technological advantages: they do not require line-of-sight conditions, observer location knowledge, or environment knowledge. We study the estimation accuracy with a numerical evaluation based on random sampling and, additionally, with an experimental evaluation based on measurements in an indoor environment. The proposal shows the potential for great accuracy in theory and practice. We describe how the paradigm could incorporate novel measurements into cooperative localization frameworks for spatio-temporal tracking. This could enable affordable wireless network localization in dynamic multipath settings.


title: Sorting OAM modes with metasurfaces based on raytracing improved optical coordinate transformation

abstract: Optical coordinate transformation (OCT) has attracted widespread attention in the field of orbital angular momentum (OAM) (de)multiplexing or manipulation, but the performance of OCT would suffer from its distortion. In this paper, we quantitatively analyze the distortion of OCT from the perspective of ray optics, and explain its rationality to work under non-normal incident light. For the special case of log-polar coordinate transformation (LPCT), we use a raytracing assisted optimization scheme to improve its distortion, which is related to a Zernike polynomial based phase compensation. After raytracing optimization, the root mean square error (RMSE) of the focused rays is reduced to 1/5 of the original value and the physical optic simulation also shows great improvement. In the experiment, we use three phase masks which are realized by metasurfaces, the measured results show well consistency with the simulation. Results in this paper have great potential to improve the performance of OCT related applications.


title: Observations of cold gas and star formation in dwarf S0 galaxies

abstract: Very little work has been done on star formation in dwarf lenticular galaxies (S0s). We present 2D-spectroscopic and millimetre observations made by Centro Astronomico Hispano Aleman (CAHA) 3.5 m optical and the IRAM-30 m millimetre telescopes, respectively, for a sample of four dwarf S0 galaxies with multiple star formation regions in the field environment. We find that although most of the sources deviate from the star forming main sequence relation, they all follow the Kennicutt-Schmidt law. After comparing the stellar and Halpha kinematics, we find that the velocity fields of both stars and ionized gas do not show regular motion and the velocity dispersions of stars and ionized gas are low in the regions with high star formation, suggesting these star-forming S0 galaxies still have significant rotation. This view can be supported by the result that most of these dwarf S0 galaxies are classified as fast rotators. The ratio of average atomic gas mass to stellar mass (~ 47%) is much greater than that of molecular gas mass to stellar mass (~ 1%). In addition, the gas-phase metallicities in the star-forming regions are lower than that of the non-star-forming regions. These results indicate that the extended star formation may originate from the combination of abundant atomic hydrogen, long dynamic time scale and low-density environment.


title: Magnetism of competing high-spin/low-spin states in Ba$_2$NiO$_2$(AgSe)$_2$ and related two-orbital two-electron systems

abstract: We discuss the thermodynamic and magnetic properties of a competing high-spin/low-spin two-orbital two-electron model on a square-lattice possibly relevant to the nickelates such as Ba$_2$NiO$_2$(AgSe)$_2$ (BNOAS). We focus on parameter regimes where a high-spin ($S=1$) and a low-spin ($S=0$) state are energetically close to each other and discuss various exchange processes in such a system. The model we study is a variant of, but different from the Kondo-necklace model proposed for the system by Jin et al (H. S. Jin, W. E. Pickett and K. W. Lee, Phys. Rev. Research 2, 033197 (2020)). Although there are similarities between the two models in terms of the ground-state phases and their symmetries, the detailed properties of the different phases and the phase transitions are entirely different and should be easy to distinguish from an experimental point of view.


title: High energy beam energy measurement with microwave-electron Compton backscattering

abstract: The uncertainty of the energy measurement of the electron beam on circular electron positron collider (CEPC) must be smaller than 10$\mathrm{MeV}$ to make sure the accurate measurement of the mass of the Higgs boson. In order to simplify the energy measurement system, a new method is proposed by fitting the Compton edge of the energy distribution of the gamma ray from a microwave-electron Compton scattering. With our method, the uncertainty of the energy measurement is 6$\mathrm{MeV}$ for the electron energy of $120\mathrm{GeV}$ in the Higgs mode. In this system, the energy resolution of the gamma detection needs to reach $10^{-4}$. Therefore, only the high-purity germanium (HPGe) detector can meet the critical requirement. In a head-on collision mode, the initial photons should be microwave photons with the wavelength of 3.04 centimeters. A cylindrical resonant cavity with selected ${TM_{010}}$ mode is used to transmit microwaves. After the microwave-electron Compton backscattering, the scattered photons and the synchrotron-radiation background transmit a shielding structure and then are detected by a HPGe detector at the end of the beam line of the synchrotron-radiation applications. The hole radius in the side wall of the cavity is about $1.5\mathrm{mm}$ to allow the electron beam passing through. The results of the computer simulation technology (CST) software shows that the influence of the hole radius on the cavity field is negligible. The change of the resonance frequency can be easily corrected by fine-tuning the cavity size.


title: Axiomatizing AECs and applications

abstract: For any abstract elementary class (AEC) ${\bf K}$ with $\lambda=LS({\bf K})$, the following holds: 1. $K$ has an axiomatization in $L_{(2^\lambda)^+,\lambda^+}$, allowing game quantification. If ${\bf K}$ has arbitrarily large models, the $\lambda$-amalgamation property and is categorical both in $\lambda$ and $\lambda^+$, then it has an axiomatization in $L_{\lambda^{+},\lambda^{+}}$ with game quantification. These extend Kueker's result which assumes finite character and $\lambda=\aleph_0$. 2. If $K$ is universal and categorical in $\lambda$, then it is axiomatizable in $L_{\lambda^+,\lambda^+}$. 3. Shelah's celebrated presentation theorem asserts that for any AEC ${\bf K}$ there is a first-order theory in an expansion of $L({\bf K})$, and a set $\Gamma$ of $2^\lambda$ many $T$-types such that $K=PC(T,\Gamma,L({\bf K}))$. We provide a better bound on $|\Gamma|$ in terms of $I_2(\lambda,{\bf K})$. 4. We present additional applications which extend, simplify and generalize results of Shelah and Shelah-Vasey. Some of our main results generalize to $\mu$-AECs.


title: Testing the Galactic Centre potential with S-stars

abstract: Two groups of astronomers used the large telescopes Keck and VLT for decades to observe trajectories of bright stars near the Galactic Centre. Based on results of their observations the astronomers concluded that trajectories of the stars are roughly elliptical and foci of the orbits are approximately coincide with the Galactic Centre position. In a last few years a self-gravitating dark matter core--halo distribution was suggested by Ruffini, Arguelles, Rueda (RAR) and this model was actively used in consequent studies. In particular, recently it has been claimed that the RAR-model provides a better fit of trajectories of bright stars in comparison to the conventional model with a supermassive black hole. The dark matter distribution with a dense core having a constant density as it was suggested in the RAR-model leaves trajectories of stars elliptical like in Kepler's two-body problem. However, in this case not the foci of the ellipses coincide with the Galactic Center but their centers while the orbital periods do not depend on semi-major axes. These properties are not consistent with the observational data for trajectories of bright stars.


title: Global well-posedness and large time behavior for compressible non-isothermal nematic liquid crystal flows with vacuum at infinity

abstract: We investigate the Cauchy problem of three-dimensional compressible non-isothermal nematic liquid crystal flows in $\mathbb{R}^3$. We derive the global existence and uniqueness of strong solutions with both interior and far field vacuum states provided that the initial data are of small total energy. This improves our previous work in the sense that the initial data allow possibly large oscillations. The key analysis is based on delicate energy estimates and the structural characteristic of the system under consideration. Moreover, we also show the algebraic decay estimates of the solution. The results could be viewed as an extension of the studies in Li-Xu-Zhang for the isothermal case to the non-isothermal situation.


title: FEDI: Few-shot learning based on Earth Mover's Distance algorithm combined with deep residual network to identify diabetic retinopathy

abstract: Diabetic retinopathy(DR) is the main cause of blindness in diabetic patients. However, DR can easily delay the occurrence of blindness through the diagnosis of the fundus. In view of the reality, it is difficult to collect a large amount of diabetic retina data in clinical practice. This paper proposes a few-shot learning model of a deep residual network based on Earth Mover's Distance algorithm to assist in diagnosing DR. We build training and validation classification tasks for few-shot learning based on 39 categories of 1000 sample data, train deep residual networks, and obtain experience maximization pre-training models. Based on the weights of the pre-trained model, the Earth Mover's Distance algorithm calculates the distance between the images, obtains the similarity between the images, and changes the model's parameters to improve the accuracy of the training model. Finally, the experimental construction of the small sample classification task of the test set to optimize the model further, and finally, an accuracy of 93.5667% on the 3way10shot task of the diabetic retina test set. For the experimental code and results, please refer to: https://github.com/panliangrui/few-shot-learning-funds.


title: Resilient ICT4D: Building and Sustaining our Community in Pandemic Times

abstract: The impacts of the COVID-19 pandemic, disproportionally affecting vulnerable people and deepening pre-existing inequalities (Dreze, 2020; Qureshi, 2021), have interested the very same "development" processes that the IFIP Working Group 9.4 on the Implications of Information and Digital Technologies for Development has dealt with over time. A global development paradigm (Oldekop et al., 2020) has emerged in response to the global nature of the crisis, infusing new meaning in the spirit of "making a better world" with ICTs (Walsham, 2012) that always have characterised ICT4D research. Such a new meaning contextualises our research in the landscape of the first pandemic of the datafied society (Milan & Trere, 2020), coming to terms with the silencing of narratives from the margins within the pandemic (Milan et al., 2021) - in Qureshi's (2021) words, a "pandemics within the pandemic" producing new socio-economic inequities in a state of global emergency.


title: Robustness-via-Synthesis: Robust Training with Generative Adversarial Perturbations

abstract: Upon the discovery of adversarial attacks, robust models have become obligatory for deep learning-based systems. Adversarial training with first-order attacks has been one of the most effective defenses against adversarial perturbations to this day. The majority of the adversarial training approaches focus on iteratively perturbing each pixel with the gradient of the loss function with respect to the input image. However, the adversarial training with gradient-based attacks lacks diversity and does not generalize well to natural images and various attacks. This study presents a robust training algorithm where the adversarial perturbations are automatically synthesized from a random vector using a generator network. The classifier is trained with cross-entropy loss regularized with the optimal transport distance between the representations of the natural and synthesized adversarial samples. Unlike prevailing generative defenses, the proposed one-step attack generation framework synthesizes diverse perturbations without utilizing gradient of the classifier's loss. Experimental results show that the proposed approach attains comparable robustness with various gradient-based and generative robust training techniques on CIFAR10, CIFAR100, and SVHN datasets. In addition, compared to the baselines, the proposed robust training framework generalizes well to the natural samples. Code and trained models will be made publicly available.


title: SDSS J154751.94+025550 with double-peaked broad H\beta but single-peaked broad H\alpha: a candidate for central binary black hole system?

abstract: In this manuscript, an interesting blue Active Galactic Nuclei (AGN) SDSS J154751.94+025550 (=SDSS J1547) is reported with very different line profiles of broad Balmer emission lines: double-peaked broad H$\beta$ but single-peaked broad H$\alpha$. SDSS J1547 is the first AGN with detailed discussions on very different line profiles of the broad Balmer emission lines, besides the simply mentioned different broad lines in the candidate for a binary black hole (BBH) system in SDSS J0159+0105. The very different line profiles of the broad Balmer emission lines can be well explained by different physical conditions to two central BLRs in a central BBH system in SDSS J1547. Furthermore, the long-term light curve from CSS can be well described by a sinusoidal function with a periodicity about 2159days, providing further evidence to support the expected central BBH system in SDSS J1547. Therefore, it is interesting to treat different line profiles of broad Balmer emission lines as intrinsic indicators of central BBH systems in broad line AGN. Under assumptions of BBH systems, 0.125\% of broad line AGN can be expected to have very different line profiles of broad Balmer emission lines. Future study on more broad line AGN with very different line profiles of broad Balmer emission lines could provide further clues on the different line profiles of broad Balmer emission lines as indicator of BBH systems.


title: Kadomtsev-Petviashvili equation: one-constraint method and lump pattern

abstract: The Kadomtsev-Petviashvili reduction method is a crucial method to derive the solitonic solutions of (1+1) dimensional integrable system from high dimensional system. In this work, we explore to use the solutions of lower dimensional system to construct the solutions in the high dimensional one with the Darboux transformation. Especially, we utilize this method to disclose the relationship between the rogue wave and lump solutions. Under one-constraint method, the asymptotic analysis to the lump pattern of Kadomtsev-Petviashvili equation is given


title: Geometrical properties of mechanically annealed systems near the jamming transition

abstract: Geometrical properties of two-dimensional mixtures near the jamming transition point are numerically investigated using harmonic particles under mechanical training. The configurations generated by the quasi-static compression and oscillatory shear deformations exhibit anomalous suppression of the density fluctuations, known as hyperuniformity, below and above the jamming transition. For the jammed system trained by compression above the transition point, the hyperuniformity exponent increases. For the system below the transition point under oscillatory shear, the hyperuniformity exponent also increases until the shear amplitude reaches the threshold value. The threshold value matches with the transition point from the point-reversible phase where the particles experience no collision to the loop-reversible phase where the particles' displacements are non-affine during a shear-cycle before coming back to an original position. The results demonstrated in this paper are explained in terms of neither of universal criticality of the jamming transition nor the nonequilibrium phase transitions.


title: EKTVQA: Generalized use of External Knowledge to empower Scene Text in Text-VQA

abstract: The open-ended question answering task of Text-VQA often requires reading and reasoning about rarely seen or completely unseen scene-text content of an image. We address this zero-shot nature of the problem by proposing the generalized use of external knowledge to augment our understanding of the scene text. We design a framework to extract, validate, and reason with knowledge using a standard multimodal transformer for vision language understanding tasks. Through empirical evidence and qualitative results, we demonstrate how external knowledge can highlight instance-only cues and thus help deal with training data bias, improve answer entity type correctness, and detect multiword named entities. We generate results comparable to the state-of-the-art on three publicly available datasets, under the constraints of similar upstream OCR systems and training data.