title: Using GAN-based models to sentimental analysis on imbalanced datasets in education domain

abstract: While the whole world is still struggling with the COVID-19 pandemic, online learning and home office become more common. Many schools transfer their courses teaching to the online classroom. Therefore, it is significant to mine the students' feedback and opinions from their reviews towards studies so that both schools and teachers can know where they need to improve. This paper trains machine learning and deep learning models using both balanced and imbalanced datasets for sentiment classification. Two SOTA category-aware text generation GAN models: CatGAN and SentiGAN, are utilized to synthesize text used to balance the highly imbalanced dataset. Results on three datasets with different imbalance degree from distinct domains show that when using generated text to balance the dataset, the F1-score of machine learning and deep learning model on sentiment classification increases 2.79% ~ 9.28%. Also, the results indicate that the average growth degree for CR100k is higher than CR23k, the average growth degree for deep learning is more increased than machine learning algorithms, and the average growth degree for more complex deep learning models is more increased than simpler deep learning models in experiments.


title: Predicting Stable Configurations for Semantic Placement of Novel Objects

abstract: Human environments contain numerous objects configured in a variety of arrangements. Our goal is to enable robots to repose previously unseen objects according to learned semantic relationships in novel environments. We break this problem down into two parts: (1) finding physically valid locations for the objects and (2) determining if those poses satisfy learned, high-level semantic relationships. We build our models and training from the ground up to be tightly integrated with our proposed planning algorithm for semantic placement of unknown objects. We train our models purely in simulation, with no fine-tuning needed for use in the real world. Our approach enables motion planning for semantic rearrangement of unknown objects in scenes with varying geometry from only RGB-D sensing. Our experiments through a set of simulated ablations demonstrate that using a relational classifier alone is not sufficient for reliable planning. We further demonstrate the ability of our planner to generate and execute diverse manipulation plans through a set of real-world experiments with a variety of objects.


title: A White Noise Approach to Stochastic Currents of Brownian Motion

abstract: In this paper we study stochastic currents of Brownian motion $\xi(x)$, $x\in\mathbb{R}^{d}$, by using white noise analysis. For $x\in\mathbb{R}^{d}\backslash\{0\}$ and for $x=0\in\mathbb{R}$ we prove that the stochastic current $\xi(x)$ is a Hida distribution. Moreover for $x=0\in\mathbb{R}^{d}$ with $d>1$ we show that the stochastic current is not a Hida distribution.


title: Coupling of magnetic and optomechanical structuring in cold atoms

abstract: Self-organized phases in cold atoms as a result of light-mediated interactions can be induced by coupling to internal or external degrees of the atoms. There has been growing interest in the interaction of internal spin degrees of freedom with the optomechanical dynamics of the external centre-of-mass motion. We present a model for the coupling between magnetic and optomechanical structuring in a $J=1/2 \to J'=3/2$ system in a single-mirror feedback scheme, being representative for a larger class of diffractively coupled systems such as longitudinally pumped cavities and counter-propagating beam schemes. For negative detunings, a linear stability analysis demonstrates that optical pumping and optomechanical driving cooperate to create magnetic ordering. However, for long-period transmission gratings the magnetic driving will strongly dominate the optomechanical driving, unless one operates very close to the existence range of the magnetic instability. At small lattice periods, in particular at wavelength-scale periods, the optomechanical driving will dominate.

categories: quant-ph nlin.PS physics.atom-ph physics.optics


title: XMP gas-rich dwarfs in nearby voids: results of BTA spectroscopy

abstract: We present the second part of results of the on-going project of searching for and studying eXtremely Metal-Poor (XMP, adopted as those with Z(gas) <~ Zo/30, or with 12+log(O/H) <~ 7.21~dex) very gas-rich blue dwarfs in voids.They were first identified in course of the 'unbiased' study of galaxy population in the nearby Lynx-Cancer void. These very rare and unusual galaxies seem to be the best proxies of so-called Very Young Galaxies (VYGs) defined recently in model simulations by Tweed et al. To date, for 16 preselected void XMP candidates, we obtained with the SAO 6-m telescope (BTA) spectra suitable for determination of O/H. For majority of the observed galaxies, the principal line [OIII]4363 used for the direct classical T_e method of O/H determination, is undetected. Therefore, to estimate O/H, we use a new 'Strong-lines' method by Izotov et al. This appears the most accurate empirical O/H estimator for the range of 12+log(O/H) < 7.4-7.5. For higher O/H objects, we use the semi-empirical method by Izotov and Thuan with our modification accounting for variance of the excitation parameter O32. Six of those 16 candidates are found to be the confident XMP dwarfs. In addition, eight studied galaxies are somewhat less metal-poor, with 12+log(O/H) = 7.24-7.33. They also can fall into the category of VYG candidates. With account of the recently published by us and previously known (9 prototype galaxies) XMP gas-rich void objects, the new findings increase the number of this type galaxies to the total of 19.


title: Ion Heat and Parallel Momentum Transport by Stochastic Magnetic Fields and Turbulence

abstract: The theory of turbulent transport of parallel momentum and ion heat by the interaction of stochastic magnetic fields and turbulence is presented. Attention is focused on determining the kinetic stress and the compressive energy flux. A critical parameter is identified as the ratio of the turbulent scattering rate to the rate of parallel acoustic dispersion. For the parameter large, the kinetic stress takes the form of a viscous stress. For the parameter small, the quasilinear residual stress is recovered. In practice, the viscous stress is the relevant form, and the quasilinear limit is not observable. This is the principal prediction of this paper. A simple physical picture is developed and shown to recover the results of the detailed analysis.


title: The critical Liouville quantum gravity metric induces the Euclidean topology

abstract: We show that every possible metric associated with critical ($\gamma=2$) Liouville quantum gravity (LQG) induces the same topology on the plane as the Euclidean metric. More precisely, we show that the optimal modulus of continuity of the critical LQG metric with respect to the Euclidean metric is a power of $1/\log(1/|\cdot|)$. Our result applies to every possible subsequential limit of critical Liouville first passage percolation, a natural approximation scheme for the LQG metric which was recently shown to be tight.


title: An Automatic Image Content Retrieval Method for better Mobile Device Display User Experiences

abstract: A growing number of commercially available mobile phones come with integrated high-resolution digital cameras. That enables a new class of dedicated applications to image analysis such as mobile visual search, image cropping, object detection, content-based image retrieval, image classification. In this paper, a new mobile application for image content retrieval and classification for mobile device display is proposed to enrich the visual experience of users. The mobile application can extract a certain number of images based on the content of an image with visual saliency methods aiming at detecting the most critical regions in a given image from a perceptual viewpoint. First, the most critical areas from a perceptual perspective are extracted using the local maxima of a 2D saliency function. Next, a salient region is cropped using the bounding box centred on the local maxima of the thresholded Saliency Map of the image. Then, each image crop feds into an Image Classification system based on SVM and SIFT descriptors to detect the class of object present in the image. ImageNet repository was used as the reference for semantic category classification. Android platform was used to implement the mobile application on a client-server architecture. A mobile client sends the photo taken by the camera to the server, which processes the image and returns the results (image contents such as image crops and related target classes) to the mobile client. The application was run on thousands of pictures and showed encouraging results towards a better user visual experience with mobile displays.


title: Molecular spectra calculations using an optimized quasi-regular Gaussian basis and the collocation method

abstract: We revisit the collocation method of Manzhos and Carrington (J. Chem. Phys. 145, 224110, 2016) in which a distributed localized (e.g., Gaussian) basis is used to set up a generalized eigenvalue problem to compute the eigenenergies and eigenfunctions of a molecular vibrational Hamiltonian. Although the resulting linear algebra problem involves full matrices, the method provides a number of important advantages. Namely: (i) it is very simple both conceptually and numerically, (ii) it can be formulated using any set of internal molecular coordinates, (iii) it is flexible with respect to the choice of the basis, and (iv) it has the potential to significantly reduce the basis size through optimizing the placement and the shapes of the basis functions. In the present paper we explore the latter aspect of the method using the recently introduced, and here further improved, quasi-regular grids (QRGs). By computing the eigenenergies of the four-atom molecule of formaldehyde, we demonstrate that a QRG-based distributed Gaussian basis is superior to the previously used choices.


title: Mirror frameworks for relatively Lipschitz and monotone-like variational inequalities

abstract: Nonconvex-nonconcave saddle-point optimization in machine learning has triggered lots of research for studying non-monotone variational inequalities (VI). In this work, we introduce two mirror frameworks, called mirror extragradient method and mirror extrapolation method, for approximating solutions to relatively Lipschitz and monotone-like VIs. The former covers the well-known Nemirovski's mirror prox method and Nesterov's dual extrapolation method, and the recently proposed Bregman extragradient method; all of them can be reformulated into a scheme that is very similar to the original form of extragradient method. The latter includes the operator extrapolation method and the Bregman extrapolation method as its special cases. The proposed mirror frameworks allow us to present a unified and improved convergence analysis for all these existing methods under relative Lipschitzness and monotone-like conditions that may be the currently weakest assumptions.


title: Identifying Non-Control Security-Critical Data through Program Dependence Learning

abstract: As control-flow protection gets widely deployed, it is difficult for attackers to corrupt control-data and achieve control-flow hijacking. Instead, data-oriented attacks, which manipulate non-control data, have been demonstrated to be feasible and powerful. In data-oriented attacks, a fundamental step is to identify non-control, security-critical data. However, critical data identification processes are not scalable in previous works, because they mainly rely on tedious human efforts to identify critical data. To address this issue, we propose a novel approach that combines traditional program analysis with deep learning. At a higher level, by examining how analysts identify critical data, we first propose dynamic analysis algorithms to identify the program semantics (and features) that are correlated with the impact of a critical data. Then, motivated by the unique challenges in the critical data identification task, we formalize the distinguishing features and use customized program dependence graphs (PDG) to embed the features. Different from previous works using deep learning to learn basic program semantics, this paper adopts a special neural network architecture that can capture the long dependency paths (in the PDG), through which a critical variable propagates its impact. We have implemented a fully-automatic toolchain and conducted comprehensive evaluations. According to the evaluations, our model can achieve 90% accuracy. The toolchain uncovers 80 potential critical variables in Google FuzzBench. In addition, we demonstrate the harmfulness of the exploits using the identified critical variables by simulating 7 data-oriented attacks through GDB.


title: Matching Underwater Sonar Images by the Learned Descriptor Based on Style Transfer Method

abstract: This paper proposes a method that combines the style transfer technique and the learned descriptor to enhance the matching performances of underwater sonar images. In the field of underwater vision, sonar is currently the most effective long-distance detection sensor, it has excellent performances in map building and target search tasks. However, the traditional image matching algorithms are all developed based on optical images. In order to solve this contradiction, the style transfer method is used to convert the sonar images into optical styles, and at the same time, the learned descriptor with excellent expressiveness for sonar images matching is introduced. Experiments show that this method significantly enhances the matching quality of sonar images. In addition, it also provides new ideas for the preprocessing of underwater sonar images by using the style transfer approach.


title: Solving incompressible Navier--Stokes equations on irregular domains and quadtrees by monolithic approach

abstract: We present a second-order monolithic method for solving incompressible Navier--Stokes equations on irregular domains with quadtree grids. A semi-collocated grid layout is adopted, where velocity variables are located at cell vertices, and pressure variables are located at cell centers. Compact finite difference methods with ghost values are used to discretize the advection and diffusion terms of the velocity. A pressure gradient and divergence operator on the quadtree that use compact stencils are developed. Furthermore, the proposed method is extended to cubical domains with octree grids. Numerical results demonstrate that the method is second-order convergent in $L^\infty$ norms and can handle irregular domains for various Reynolds numbers.


title: 4-bit Quantization of LSTM-based Speech Recognition Models

abstract: We investigate the impact of aggressive low-precision representations of weights and activations in two families of large LSTM-based architectures for Automatic Speech Recognition (ASR): hybrid Deep Bidirectional LSTM - Hidden Markov Models (DBLSTM-HMMs) and Recurrent Neural Network - Transducers (RNN-Ts). Using a 4-bit integer representation, a na\"ive quantization approach applied to the LSTM portion of these models results in significant Word Error Rate (WER) degradation. On the other hand, we show that minimal accuracy loss is achievable with an appropriate choice of quantizers and initializations. In particular, we customize quantization schemes depending on the local properties of the network, improving recognition performance while limiting computational time. We demonstrate our solution on the Switchboard (SWB) and CallHome (CH) test sets of the NIST Hub5-2000 evaluation. DBLSTM-HMMs trained with 300 or 2000 hours of SWB data achieves $<$0.5% and $<$1% average WER degradation, respectively. On the more challenging RNN-T models, our quantization strategy limits degradation in 4-bit inference to 1.3%.


title: HyperGI: Automated Detection and Repair of Information Flow Leakage

abstract: Maintaining confidential information control in software is a persistent security problem where failure means secrets can be revealed via program behaviors. Information flow control techniques traditionally have been based on static or symbolic analyses -- limited in scalability and specialized to particular languages. When programs do leak secrets there are no approaches to automatically repair them unless the leak causes a functional test to fail. We present our vision for HyperGI, a genetic improvement framework tha detects, localizes and repairs information leakage. Key elements of HyperGI include (1) the use of two orthogonal test suites, (2) a dynamic leak detection approach which estimates and localizes potential leaks, and (3) a repair component that produces a candidate patch using genetic improvement. We demonstrate the successful use of HyperGI on several programs which have no failing functional tests. We manually examine the resulting patches and identify trade-offs and future directions for fully realizing our vision.


title: Stationary Multi-source AI-powered Real-time Tomography (SMART)

abstract: Over the past decades, the development of CT technologies has been largely driven by the needs for cardiac imaging but the temporal resolution remains insufficient for clinical CT in difficult cases and rather challenging for preclinical micro-CT since small animals, as human cardiac disease models, have much higher heart rates than human. To address this challenge, here we report a Stationary Multi-source AI-based Real-time Tomography (SMART) micro-CT system. This unique scanner is featured by 29 source-detector pairs fixed on a circular track to collect x-ray signals in parallel, enabling instantaneous tomography in principle. Given the multi-source architecture, the field-of-view only covers a cardiac region. To solve this interior problem, an AI-empowered interior tomography approach is developed to synergize sparsity-based regularization and learning-based reconstruction. To demonstrate the performance and utilities of the SMART system, extensive results are obtained in physical phantom experiments and animal studies, including dead and live rats as well as live rabbits. The reconstructed volumetric images convincingly demonstrate the merits of the SMART system using the AI-empowered interior tomography approach, enabling cardiac micro-CT with the unprecedented temporal resolution of 30ms, which is an order of magnitude higher than the state of the art.


title: Backus problem in geophysics: a resolution near the dipole in fractional Sobolev spaces

abstract: We consider Backus's problem in geophysics. This consists in reconstructing a harmonic potential outside the Earth when the intensity of the related field is measured on the Earth's surface. Thus, the boundary condition is (severely) nonlinear. The gravitational case is quite understood. It consists in the local resolution near a monopole, i.e. the potential generated by a point mass. In this paper, we consider the geomagnetic case. This consists in linearizing the field's intensity near the so-called dipole, a harmonic function which models the solenoidal potential of a magnet. The problem is quite difficult, because the resolving operator related to the linearized problem is generally unbounded. Indeed, existence results for Backus's problem in this framework are not present in the literature. In this work, we locally solve the geomagnetic version of Backus's problem in the axially symmetric case. In mathematical terms, we show the existence of harmonic functions in the exterior of a sphere, with given (boundary) field's intensity sufficiently close to that of a dipole and which have the same axial symmetry of a dipole. We also show that unique solutions can be selected by prescribing the average of the potential on the equatorial circle of the sphere. We obtain those solutions as series of spherical harmonics. The functional framework entails the use of fractional Sobolev Hilbert spaces on the sphere, endowed with a spectral norm. A crucial ingredient is the algebra structure of suitable subspaces.


title: A Comparative Study of Vulnerability Reporting by Software Composition Analysis Tools

abstract: Background: Modern software uses many third-party libraries and frameworks as dependencies. Known vulnerabilities in these dependencies are a potential security risk. Software composition analysis (SCA) tools, therefore, are being increasingly adopted by practitioners to keep track of vulnerable dependencies. Aim: The goal of this study is to understand the difference in vulnerability reporting by various SCA tools. Understanding if and how existing SCA tools differ in their analysis may help security practitioners to choose the right tooling and identify future research needs. Method: We present an in-depth case study by comparing the analysis reports of 9 industry-leading SCA tools on a large web application, OpenMRS, composed of Maven (Java) and npm (JavaScript) projects. Results: We find that the tools vary in their vulnerability reporting. The count of reported vulnerable dependencies ranges from 17 to 332 for Maven and from 32 to 239 for npm projects across the studied tools. Similarly, the count of unique known vulnerabilities reported by the tools ranges from 36 to 313 for Maven and from 45 to 234 for npm projects. Our manual analysis of the tools' results suggest that accuracy of the vulnerability database is a key differentiator for SCA tools. Conclusion: We recommend that practitioners should not rely on any single tool at the present, as that can result in missing known vulnerabilities. We point out two research directions in the SCA space: i) establishing frameworks and metrics to identify false positives for dependency vulnerabilities; and ii) building automation technologies for continuous monitoring of vulnerability data from open source package ecosystems.


title: Dimming Down LED: An Open-source Threshold Implementation on Light Encryption Device (LED) Block Cipher

abstract: Lightweight block ciphers have been widely used in applications such as RFID tags, IoTs, and network sensors. Among them, with comparable parameters, the Light Encryption Device (LED) block cipher achieves the smallest area. However, implementation of encryption algorithms manifest side-channel leakage, therefore, it is crucial to protect their design against side-channel analyses. In this paper, we present a threshold implementation of the LED cipher which has 64-bit data input and 128-bit key. The presented design splits secret information among multiple shares to achieve a higher security level. We demonstrate that our implementation can protect against first-order power side-channel attacks. As a cost, the design area is almost doubled and the maximum operating frequency is degraded by 30%. To make our design verifiable, we have also open-sourced our design online.


title: Angle-dependent Phononic Dynamics for Deep Learning and Source Localization

abstract: In this work, a parameterized eigenvalue problem is analyzed for a phononic array in a 2D stress wave scattering setup, and a corresponding sensing application of this system is proposed to achieve source angle localization. The phononic domain consists of a periodic micro-structured medium, of which the eigen-wavevector band structure and the eigen-modes are exploited. The eigen-modes are naturally angle dependent due to changes in phases and periodic mode shapes determined by the incident angle. Intriguingly, the band exhibits angle-dependent transitions at the exceptional points (EPs) and critical angles (CAs), where the eigenvalues coincide or vanish. Coupled with these transitions, it is found that the eigen-modes switch their energy characteristics and symmetry patterns at these branch points, leading to enhanced angle dependence. Moreover, these eigen-modes also serve as the basis functions of the scattered waves. Therefore, the scattering response of the medium inherently possesses the angle-dependent properties, making this system naturally suitable for sensing applications. An artificial neural network (ANN) is trained with randomly weighted eigen-modes to achieve deep learning of the eigen features and angle dependence. The training data is derived only based on the eigen-modes of the unit cells. Nevertheless, the trained ANN can accurately identify the incident angle of an unknown scattering signal, with minimal side lobe levels and suppressed main lobe width. The ANN shows superior performance in comparison with standard delay-and-sum technique of estimating angle of arrival. The proposed application of ANN and micro-structured media highlights the physical importance of band structure topology and eigen-modes to a technological application, adds extra strength to the existing localization methods, and can be easily enhanced with the fast-growing data-driven techniques.


title: Detection and Continual Learning of Novel Face Presentation Attacks

abstract: Advances in deep learning, combined with availability of large datasets, have led to impressive improvements in face presentation attack detection research. However, state-of-the-art face antispoofing systems are still vulnerable to novel types of attacks that are never seen during training. Moreover, even if such attacks are correctly detected, these systems lack the ability to adapt to newly encountered attacks. The post-training ability of continually detecting new types of attacks and self-adaptation to identify these attack types, after the initial detection phase, is highly appealing. In this paper, we enable a deep neural network to detect anomalies in the observed input data points as potential new types of attacks by suppressing the confidence-level of the network outside the training samples' distribution. We then use experience replay to update the model to incorporate knowledge about new types of attacks without forgetting the past learned attack types. Experimental results are provided to demonstrate the effectiveness of the proposed method on two benchmark datasets as well as a newly introduced dataset which exhibits a large variety of attack types.


title: Phase transition in the diffusion and bootstrap percolation models on regular random and Erd\H{o}s-R\'{e}nyi networks

abstract: The diffusion and bootstrap percolation models were studied in regular random and Erd\H{o}s-R\'{e}nyi networks using the modified Newman-Ziff algorithms. We calculated the percolation threshold and the order parameter of the percolation transition (strength of the giant cluster) and its derivatives. The percolation transitions are classified by the results. The diffusion percolation with a small $k$ has a double transition, and the bootstrap percolation with $m\geq3$ has the first-order percolation transition. The diffusion percolation with a large $k$ and the bootstrap percolation with a small $m$ show the second-order percolation transition. Particularly, third-order percolation transitions were discovered in the bootstrap percolation of $m=2$ in regular random networks.


title: Deep Denoising Method for Side Scan Sonar Images without High-quality Reference Data

abstract: Subsea images measured by the side scan sonars (SSSs) are necessary visual data in the process of deep-sea exploration by using the autonomous underwater vehicles (AUVs). They could vividly reflect the topography of the seabed, but usually accompanied by complex and severe noise. This paper proposes a deep denoising method for SSS images without high-quality reference data, which uses one single noise SSS image to perform self-supervised denoising. Compared with the classical artificially designed filters, the deep denoising method shows obvious advantages. The denoising experiments are performed on the real seabed SSS images, and the results demonstrate that our proposed method could effectively reduce the noise on the SSS image while minimizing the image quality and detail loss.


title: Harms of Gender Exclusivity and Challenges in Non-Binary Representation in Language Technologies

abstract: Gender is widely discussed in the context of language tasks and when examining the stereotypes propagated by language models. However, current discussions primarily treat gender as binary, which can perpetuate harms such as the cyclical erasure of non-binary gender identities. These harms are driven by model and dataset biases, which are consequences of the non-recognition and lack of understanding of non-binary genders in society. In this paper, we explain the complexity of gender and language around it, and survey non-binary persons to understand harms associated with the treatment of gender as binary in English language technologies. We also detail how current language representations (e.g., GloVe, BERT) capture and perpetuate these harms and related challenges that need to be acknowledged and addressed for representations to equitably encode gender information.


title: Equivalent conditions of complete convergence for weighted sums of sequences of i. i. d. random variables under sublinear expectations

abstract: The complete convergence for weighted sums of sequences of independent, identically distributed random variables under sublinear expectations space was studied. By moment inequality and truncation methods, we establish the equivalent conditions of complete convergence for weighted sums of sequences of independent, identically distributed random variables under sublinear expectations space. The results extend the corresponding results obtained by Guo (2012) to those for sequences of independent, identically distributed random variables under sublinear expectations space.


title: Some new results on bar visibility of digraphs

abstract: Visibility representation of digraphs was introduced by Axenovich, Beveridge, Hutch\-inson, and West (\emph{SIAM J. Discrete Math.} {\bf 27}(3) (2013) 1429--1449) as a natural generalization of $t$-bar visibility representation of undirected graphs. A {\it $t$-bar visibility representation} of a digraph $G$ assigns each vertex at most $t$ horizontal bars in the plane so that there is an arc $xy$ in the digraph if and only if some bar for $x$ "sees" some bar for $y$ above it along an unblocked vertical strip with positive width. The {\it visibility number} $b(G)$ is the least $t$ such that $G$ has a $t$-bar visibility representation. In this paper, we solve several problems about $b(G)$ posed by Axenovich et al.\ and prove that determining whether the bar visibility number of a digraph is $2$ is NP-complete.


title: Nucleon momentum distribution of $^{56}\text{Fe}$ from the axially deformed relativistic mean-field model with nucleon--nucleon correlations

abstract: Nucleon momentum distribution (NMD), particularly its high-momentum components, is essential for understanding the nucleon--nucleon ($ NN $) correlations in nuclei. Herein, we develop the studies of NMD of $^{56}\text{Fe}$ from the axially deformed relativistic mean-field (RMF) model. Moreover, we introduce the effects of $ NN $ correlation into the RMF model from phenomenological models based on deuteron and nuclear matter. For the region $ k<k_{\text{F}} $, the effects of deformation on the NMD of the RMF model are investigated using the total and single-particle NMDs. For the region $ k>k_{\text{F}} $, the high-momentum components of the RMF model are modified by the effects of $ NN $ correlation, which agree with the experimental data. Comparing the NMD of relativistic and non-relativistic mean-field models, the relativistic effects on nuclear structures in momentum space are analyzed. Finally, by analogizing the tensor correlations in deuteron and Jastrow-type correlations in nuclear matter, the behaviors and contributions of $ NN $ correlations in $^{56}\text{Fe}$ are further analyzed, which helps clarify the effects of the tensor force on the NMD of heavy nuclei.


title: Unbalanced-basis-misalignment tolerant measurement-device-independent quantum key distribution

abstract: Measurement-device-independent quantum key distribution (MDIQKD) is a revolutionary protocol since it is physically immune to all attacks on the detection side. However, the protocol still keeps the strict assumptions on the source side that the four BB84-states must be perfectly prepared to ensure security. Some protocols release part of the assumptions in the encoding system to keep the practical security, but the performance would be dramatically reduced. In this work, we present a MDIQKD protocol that requires less knowledge of encoding system to combat the troublesome modulation errors and fluctuations. We have also experimentally demonstrated the protocol. The result indicates the high-performance and good security for its practical applications. Besides, its robustness and flexibility exhibit a good value for complex scenarios such as the QKD networks.


title: Exact Boundary Controllability for the Ideal Magneto-hydrodynamic Equations

abstract: We address the problem of controllability of the MHD system in a rectangular domain with a control prescribed on the side boundary. We identify a necessary and sufficient condition on the data to be null controllable, i.e., can be driven to the zero state. We also show that the validity of this condition allows the states to be stirred to each other. If the condition is not satisfied, one can move from one state to another with the help of a simple shear external magnetic force.


title: Finite-$N$ superconformal index via the AdS/CFT correspondence

abstract: We propose a prescription to calculate the superconformal index of the ${\cal N}=4$ $U(N)$ supersymmetric Yang-Mills theory with finite $N$ on the AdS side. The finite $N$ corrections are included as contributions of D3-branes wrapped around three-cycles in $\boldsymbol{S}^5$, which are calculated as the index of the gauge theories realized on the wrapped branes. The single-wrapping contribution has been studied in a previous work, and we further confirm that the inclusion of multiple-wrapping contributions correctly reproduces the higher order terms as far as we have checked numerically.


title: A Three-terminal Non-Volatile Ferroelectric Switch with an Insulator-Metal Transition Channel

abstract: Ferroelectrics offer a promising materials platform to realize energy-efficient non-volatile memory technology with the FeFET-based implementations being one of the most area-efficient ferroelectric memory architectures. However, the FeFET operation entails a fundamental trade-off between the read and the program operations. To overcome this trade-off, we propose in this work, a novel device, Mott-FeFET, that aims to replace the Silicon channel of the FeFET with VO2- a material that exhibits an electrically driven insulator-metal phase transition. The Mott-FeFET design, which demonstrates a (ferroelectric) polarization-dependent threshold voltage, enables the read current distinguishability (i.e., the ratio of current sensed when the Mott-FeFET is in state 1 and 0, respectively) to be independent of the program voltage. This enables the device to be programmed at low voltages without affecting the ability to sense/read the state of the device. Our work provides a pathway to realize low-voltage and energy-efficient non-volatile memory solutions.


title: Replaying Archived Twitter: When your bird is broken, will it bring you down?

abstract: Historians and researchers trust web archives to preserve social media content that no longer exists on the live web. However, what we see on the live web and how it is replayed in the archive are not always the same. In this paper, we document and analyze the problems in archiving Twitter ever since Twitter forced the use of its new UI in June 2020. Most web archives were unable to archive the new UI, resulting in archived Twitter pages displaying Twitter's "Something went wrong" error. The challenges in archiving the new UI forced web archives to continue using the old UI. To analyze the potential loss of information in web archival data due to this change, we used the personal Twitter account of the 45th President of the United States, @realDonaldTrump, which was suspended by Twitter on January 8, 2021. Trump's account was heavily labeled by Twitter for spreading misinformation, however we discovered that there is no evidence in web archives to prove that some of his tweets ever had a label assigned to them. We also studied the possibility of temporal violations in archived versions of the new UI, which may result in the replay of pages that never existed on the live web. Our goal is to educate researchers who may use web archives and caution them when drawing conclusions based on archived Twitter pages.


title: Anomaly Detection on IT Operation Series via Online Matrix Profile

abstract: Anomaly detection on time series is a fundamental task in monitoring the Key Performance Indicators (KPIs) of IT systems. Many of the existing approaches in the literature show good performance while requiring a lot of training resources. In this paper, the online matrix profile, which requires no training, is proposed to address this issue. The anomalies are detected by referring to the past subsequence that is the closest to the current one. The distance significance is introduced based on the online matrix profile, which demonstrates a prominent pattern when an anomaly occurs. Another training-free approach spectral residual is integrated into our approach to further enhance the detection accuracy. Moreover, the proposed approach is sped up by at least four times for long time series by the introduced cache strategy. In comparison to the existing approaches, the online matrix profile makes a good trade-off between accuracy and efficiency. More importantly, it is generic to various types of time series in the sense that it works without the constraint from any trained model.


title: A Numerical Verification Framework for Differential Privacy in Estimation

abstract: This work proposes an algorithmic method to verify differential privacy for estimation mechanisms with performance guarantees. Differential privacy makes it hard to distinguish outputs of a mechanism produced by adjacent inputs. While obtaining theoretical conditions that guarantee differential privacy may be possible, evaluating these conditions in practice can be hard. This is especially true for estimation mechanisms that take values in continuous spaces, as this requires checking for an infinite set of inequalities. Instead, our verification approach consists of testing the differential privacy condition for a suitably chosen finite collection of events at the expense of some information loss. More precisely, our data-driven, test framework for continuous range mechanisms first finds a highly-likely, compact event set, as well as a partition of this event, and then evaluates differential privacy wrt this partition. This results into a type of differential privacy with high confidence, which we are able to quantify precisely. This approach is then used to evaluate the differential-privacy properties of the recently proposed $W_2$ Moving Horizon Estimator. We confirm its properties, while comparing its performance with alternative approaches in simulation.


title: Relational Hypersequent S4 and B are Cut-Free Hypersequent Incomplete

abstract: We show that relational hypersequent K4, S4, KB and RB, investigated in Parisi (2020) and Burns and Zach (2020) are cut-free hypersequent incomplete. In addition, the former two are also cut-free sequent and formula incomplete.


title: JT Gravity Limit of Liouville CFT and Matrix Model

abstract: In this paper we study a connection between Jackiw-Teitelboim (JT) gravity on two-dimensional anti de-Sitter spaces and a semiclassical limit of $c<1$ two-dimensional string theory. The world-sheet theory of the latter consists of a space-like Liouville CFT coupled to a non-rational CFT defined by a time-like Liouville CFT. We show that their actions, disk partition functions and annulus amplitudes perfectly agree with each other, where the presence of boundary terms plays a crucial role. We also reproduce the boundary Schwarzian theory from the Liouville theory description. Then, we identify a matrix model dual of our two-dimensional string theory with a specific time-dependent background in $c=1$ matrix quantum mechanics. Finally, we also explain the corresponding relation for the two-dimensional de-Sitter JT gravity.


title: A novel class of energy-preserving Runge-Kutta methods for the Korteweg-de Vries equation

abstract: In this paper, we present a quadratic auxiliary variable approach to develop a new class of energy-preserving Runge-Kutta methods for the Korteweg-de Vries equation. The quadratic auxiliary variable approach is first proposed to reformulate the original model into an equivalent system, which transforms the energy conservation law of the Korteweg-de Vries equation into two quadratic invariants of the reformulated system. Then the symplectic Runge-Kutta methods are directly employed for the reformulated model to arrive at a new kind of time semi-discrete schemes for the original problem. Under the consistent initial condition, the proposed methods are rigorously proved to maintain the original energy conservation law of the Korteweg-de Vries equation. In addition, the Fourier pseudo-spectral method is used for spatial discretization, resulting in fully discrete energy-preserving schemes. To implement the proposed methods effectively, we present a very efficient iterative technique, which not only greatly saves the calculation cost, but also achieves the purpose of practically preserving structure. Ample numerical results are addressed to confirm the expected order of accuracy, conservative property and efficiency of the proposed algorithms.


title: Birkhoff Normal Form and Twist Coefficients of Periodic Orbits of Billiards

abstract: In this paper we study the Birkhoff Normal Form around elliptic periodic points for a variety of dynamical billiards. We give an explicit construction of the Birkhoff transformation and obtain explicit formulas for the first two twist coefficients in terms of the geometric parameters of the billiard table. As an application, we obtain characterizations of the nonlinear stability and local analytic integrability of the billiards around the elliptic periodic points.


title: Learning to Give Checkable Answers with Prover-Verifier Games

abstract: Our ability to know when to trust the decisions made by machine learning systems has not kept up with the staggering improvements in their performance, limiting their applicability in high-stakes domains. We introduce Prover-Verifier Games (PVGs), a game-theoretic framework to encourage learning agents to solve decision problems in a verifiable manner. The PVG consists of two learners with competing objectives: a trusted verifier network tries to choose the correct answer, and a more powerful but untrusted prover network attempts to persuade the verifier of a particular answer, regardless of its correctness. The goal is for a reliable justification protocol to emerge from this game. We analyze variants of the framework, including simultaneous and sequential games, and narrow the space down to a subset of games which provably have the desired equilibria. We develop instantiations of the PVG for two algorithmic tasks, and show that in practice, the verifier learns a robust decision rule that is able to receive useful and reliable information from an untrusted prover. Importantly, the protocol still works even when the verifier is frozen and the prover's messages are directly optimized to convince the verifier.


title: A framework for massive scale personalized promotion

abstract: Technology companies building consumer-facing platforms may have access to massive-scale user population. In recent years, promotion with quantifiable incentive has become a popular approach for increasing active users on such platforms. On one hand, increased user activities can introduce network effect, bring in advertisement audience, and produce other benefits. On the other hand, massive-scale promotion causes massive cost. Therefore making promotion campaigns efficient in terms of return-on-investment (ROI) is of great interest to many companies. This paper proposes a practical two-stage framework that can optimize the ROI of various massive-scale promotion campaigns. In the first stage, users' personal promotion-response curves are modeled by machine learning techniques. In the second stage, business objectives and resource constraints are formulated into an optimization problem, the decision variables of which are how much incentive to give to each user. In order to do effective optimization in the second stage, counterfactual prediction and noise-reduction are essential for the first stage. We leverage existing counterfactual prediction techniques to correct treatment bias in data. We also introduce a novel deep neural network (DNN) architecture, the deep-isotonic-promotion-network (DIPN), to reduce noise in the promotion response curves. The DIPN architecture incorporates our prior knowledge of response curve shape, by enforcing isotonicity and smoothness. It out-performed regular DNN and other state-of-the-art shape-constrained models in our experiments.


title: Relativistic nucleon-nucleon potentials in a spin-dependent three-dimensional approach

abstract: The matrix elements of relativistic nucleon-nucleon $(NN)$ potentials are calculated directly from the nonrelativistic potentials as a function of relative $NN$ momentum vectors, without using a partial wave decomposition. To this aim, the quadratic operator relation between the relativistic and nonrelativistic $NN$ potentials is formulated in momentum-helicity basis states. It leads to a single integral equation for the two-nucleon $(2N)$ spin-singlet state and four coupled integral equations for two-nucleon spin-triplet states, which are solved by an iterative method. Our numerical analysis indicates that the relativistic $NN$ potential obtained using CD-Bonn potential reproduces the deuteron binding energy and neutron-proton elastic scattering differential and total cross-sections with high accuracy.


title: FOVEA: Foveated Image Magnification for Autonomous Navigation

abstract: Efficient processing of high-res video streams is safety-critical for many robotics applications such as autonomous driving. To maintain real-time performance, many practical systems downsample the video stream. But this can hurt downstream tasks such as (small) object detection. Instead, we take inspiration from biological vision systems that allocate more foveal "pixels" to salient parts of the scene. We introduce FOVEA, an approach for intelligent downsampling that ensures salient image regions remain "magnified" in the downsampled output. Given a high-res image, FOVEA applies a differentiable resampling layer that outputs a small fixed-size image canvas, which is then processed with a differentiable vision module (e.g., object detection network), whose output is then differentiably backward mapped onto the original image size. The key idea is to resample such that background pixels can make room for salient pixels of interest. In order to ensure the overall pipeline remains efficient, FOVEA makes use of cheap and readily available cues for saliency, including dataset-specific spatial priors or temporal priors computed from object predictions in the recent past. On the autonomous driving datasets Argoverse-HD and BDD100K, our proposed method boosts the detection AP over standard Faster R-CNN, both with and without finetuning. Without any noticeable increase in compute, we improve accuracy on small objects by over 2x without degrading performance on large objects. Finally, FOVEA sets a new record for streaming AP (from 17.8 to 23.0 on a GTX 1080 Ti GPU), a metric designed to capture both accuracy and latency.


title: Einstein flow with matter sources: stability and convergence

abstract: Two recent articles \cite{ashtekar2015general, moncrief2019could} suggested an interesting dynamical mechanism within the framework of the vacuum Einstein flow (or Einstein-$\Lambda$ flow if a positive cosmological constant $\Lambda$ is included) which suggests that many closed (compact without boundary) manifolds that do not support homogeneous and isotropic metrics \textit{at all} will nevertheless evolve to be asymptotically compatible with the observed approximate homogeneity and isotropy of the physical universe. These studies however did not include matter sources. Therefore the aim of the present study is to include suitable matter sources and investigate whether one is able to draw a similar conclusion.

categories: gr-qc astro-ph.CO math-ph math.DG math.MP


title: Binocular Mutual Learning for Improving Few-shot Classification

abstract: Most of the few-shot learning methods learn to transfer knowledge from datasets with abundant labeled data (i.e., the base set). From the perspective of class space on base set, existing methods either focus on utilizing all classes under a global view by normal pretraining, or pay more attention to adopt an episodic manner to train meta-tasks within few classes in a local view. However, the interaction of the two views is rarely explored. As the two views capture complementary information, we naturally think of the compatibility of them for achieving further performance gains. Inspired by the mutual learning paradigm and binocular parallax, we propose a unified framework, namely Binocular Mutual Learning (BML), which achieves the compatibility of the global view and the local view through both intra-view and cross-view modeling. Concretely, the global view learns in the whole class space to capture rich inter-class relationships. Meanwhile, the local view learns in the local class space within each episode, focusing on matching positive pairs correctly. In addition, cross-view mutual interaction further promotes the collaborative learning and the implicit exploration of useful knowledge from each other. During meta-test, binocular embeddings are aggregated together to support decision-making, which greatly improve the accuracy of classification. Extensive experiments conducted on multiple benchmarks including cross-domain validation confirm the effectiveness of our method.


title: Full Attention Bidirectional Deep Learning Structure for Single Channel Speech Enhancement

abstract: As the cornerstone of other important technologies, such as speech recognition and speech synthesis, speech enhancement is a critical area in audio signal processing. In this paper, a new deep learning structure for speech enhancement is demonstrated. The model introduces a "full" attention mechanism to a bidirectional sequence-to-sequence method to make use of latent information after each focal frame. This is an extension of the previous attention-based RNN method. The proposed bidirectional attention-based architecture achieves better performance in terms of speech quality (PESQ), compared with OM-LSA, CNN-LSTM, T-GSA and the unidirectional attention-based LSTM baseline.


title: Sharp embedding between Besov-Triebel-Sobolev spaces and modulation spaces

abstract: The embedding relations between Besov-Triebel-Sobolev spaces and modulation spaces are determined explicitly. We extend the results of Sugimoto[2007]; Wang[2007] and Kobayashi[2011] to the most general cases. And we give the sharp embedding between Fourier $L^{p}$ spaces and modulation spaces.


title: An Introduction to Hamiltonian Monte Carlo Method for Sampling

abstract: The goal of this article is to introduce the Hamiltonian Monte Carlo (HMC) method -- a Hamiltonian dynamics-inspired algorithm for sampling from a Gibbs density $\pi(x) \propto e^{-f(x)}$. We focus on the "idealized" case, where one can compute continuous trajectories exactly. We show that idealized HMC preserves $\pi$ and we establish its convergence when $f$ is strongly convex and smooth.


title: Lingxi: A Diversity-aware Chinese Modern Poetry Generation System

abstract: Poetry generation has been a difficult task in natural language processing. Unlike plain neural text generation tasks, poetry has a high requirement for novelty, since an easily-understood sentence with too many high frequency words might not be considered as poetic, while adequately ambiguous sentences with low frequency words can possibly be novel and creative. Inspired by this, we present Lingxi, a diversity-aware Chinese modern poetry generation system. We propose nucleus sampling with randomized head (NS-RH) algorithm, which randomizes the high frequency part ("head") of the predicted distribution, in order to emphasize on the "comparatively low frequency" words. The proposed algorithm can significantly increase the novelty of generated poetry compared with traditional sampling methods. The permutation of distribution is controllable by tuning the filtering parameter that determines the "head" to permutate, achieving diversity-aware sampling. We find that even when a large portion of filtered vocabulary is randomized, it can actually generate fluent poetry but with notably higher novelty. We also propose a semantic-similarity-based rejection sampling algorithm, which creates longer and more informative context on the basis of the short input poetry title while maintaining high semantic similarity to the title, alleviating the off-topic issue.


title: Large $N$ phenomena and quantization of the Loday-Quillen-Tsygan theorem

abstract: We offer a new approach to large $N$ limits using the Batalin-Vilkovisky formalism, both commutative and noncommutative, and we exhibit how the Loday-Quillen-Tsygan Theorem admits BV quantizations in that setting. Matrix integrals offer a key example: we demonstrate how this formalism leads to a recurrence relation that in principle allows us to compute all multi-point correlation functions. We also explain how the Harer-Zagier relations may be expressed in terms of this noncommutative geometry derived from the BV formalism. As another application, we consider the problem of quantization in the large $N$ limit and demonstrate how the Loday-Quillen-Tsygan Theorem leads us to a solution in terms of noncommutative geometry. These constructions are relevant to open topological field theories and string field theory, providing a mechanism that relates moduli of categories of branes to moduli of brane gauge theories.


title: A Morphological Classification of 18190 Molecular Clouds Identified in $^{12}$CO Data from the MWISP Survey

abstract: We attempt to visually classify the morphologies of 18190 molecular clouds, which are identified in the $^{12}$CO(1-0) spectral line data over $\sim$ 450 deg$^{2}$ of the second Galactic quadrant from the Milky Way Imaging Scroll Painting project (MWISP). Using the velocity-integrated intensity maps of the $^{12}$CO(1-0) emission, molecular clouds are first divided into unresolved and resolved ones. The resolved clouds are further classified as non-filaments or filaments. Among the 18190 molecular clouds, $\sim$ 25 $\%$ are unresolved, $\sim$ 64$\%$ are non-filaments, and $\sim$ 11$\%$ are filaments. In the terms of the integrated flux of $^{12}$CO(1-0) spectra of the whole 18190 molecular clouds, $\sim$ 90$\%$ are from filaments, $\sim$ 9$\%$ are from non-filaments, and the rest $\sim$ 1$\%$ are from unresolved sources. Although non-filaments are dominant in the number of the discrete molecular clouds, filaments are the main contributor of $^{12}$CO emission flux. We also present the number distributions of physical parameters of the molecular clouds in our catalog, including their angular sizes, velocity spans, peak intensities of $^{12}$CO(1-0) emission, and $^{12}$CO(1-0) total fluxes. We find that there is a systematic difference between the angular sizes of the non-filaments and filaments, with the filaments tending to have larger angular scales. The H$_{2}$ column densities of them are not significantly different. We also discuss the observational effects, such as those induced by the finite spatial resolution, beam dilution and line-of-sight projection, on the morphological classification of molecular clouds in our sample.


title: Gigantic current control of coercive field and magnetic memory based on nm-thin ferromagnetic van der Waals Fe3GeTe2

abstract: Controlling magnetic states by a small current is essential for the next-generation of energy-efficient spintronic devices. However, it invariably requires considerable energy to change a magnetic ground state of intrinsically quantum nature governed by fundamental Hamiltonian, once stabilized below a phase transition temperature. We report that surprisingly an in-plane current can tune the magnetic state of nm-thin van der Waals ferromagnet Fe3GeTe2 from a hard magnetic state to a soft magnetic state. It is the direct demonstration of the current-induced substantial reduction of the coercive field. This surprising finding is possible because the in-plane current produces a highly unusual type of gigantic spin-orbit torque for Fe3GeTe2. And we further demonstrate a working model of a new nonvolatile magnetic memory based on the principle of our discovery in Fe3GeTe2, controlled by a tiny current. Our findings open up a new window of exciting opportunities for magnetic van der Waals materials with potentially huge impacts on the future development of spintronic and magnetic memory.


title: Targeting Underrepresented Populations in Precision Medicine: A Federated Transfer Learning Approach

abstract: The limited representation of minorities and disadvantaged populations in large-scale clinical and genomics research has become a barrier to translating precision medicine research into practice. Due to heterogeneity across populations, risk prediction models are often found to be underperformed in these underrepresented populations, and therefore may further exacerbate known health disparities. In this paper, we propose a two-way data integration strategy that integrates heterogeneous data from diverse populations and from multiple healthcare institutions via a federated transfer learning approach. The proposed method can handle the challenging setting where sample sizes from different populations are highly unbalanced. With only a small number of communications across participating sites, the proposed method can achieve performance comparable to the pooled analysis where individual-level data are directly pooled together. We show that the proposed method improves the estimation and prediction accuracy in underrepresented populations, and reduces the gap of model performance across populations. Our theoretical analysis reveals how estimation accuracy is influenced by communication budgets, privacy restrictions, and heterogeneity across populations. We demonstrate the feasibility and validity of our methods through numerical experiments and a real application to a multi-center study, in which we construct polygenic risk prediction models for Type II diabetes in AA population.


title: Subjective Learning for Open-Ended Data

abstract: Conventional supervised learning typically assumes that the learning task can be solved by learning a single function since the data is sampled from a fixed distribution. However, this assumption is invalid in open-ended environments where no task-level data partitioning is available. In this paper, we present a novel supervised learning framework of learning from open-ended data, which is modeled as data implicitly sampled from multiple domains with the data in each domain obeying a domain-specific target function. Since different domains may possess distinct target functions, open-ended data inherently requires multiple functions to capture all its input-output relations, rendering training a single global model problematic. To address this issue, we devise an Open-ended Supervised Learning (OSL) framework, of which the key component is a subjective function that allocates the data among multiple candidate models to resolve the "conflict" between the data from different domains, exhibiting a natural hierarchy. We theoretically analyze the learnability and the generalization error of OSL, and empirically validate its efficacy in both open-ended regression and classification tasks.


title: Identification of Vehicle Dynamics Parameters Using Simulation-based Inference

abstract: Identifying tire and vehicle parameters is an essential step in designing control and planning algorithms for autonomous vehicles. This paper proposes a new method: Simulation-Based Inference (SBI), a modern interpretation of Approximate Bayesian Computation methods (ABC) for parameter identification. The simulation-based inference is an emerging method in the machine learning literature and has proven to yield accurate results for many parameter sets in complex problems. We demonstrate in this paper that it can handle the identification of highly nonlinear vehicle dynamics parameters and gives accurate estimates of the parameters for the governing equations.


title: Recognition Awareness: An Application of Latent Cognizance to Open-Set Recognition

abstract: This study investigates an application of a new probabilistic interpretation of a softmax output to Open-Set Recognition (OSR). Softmax is a mechanism wildly used in classification and object recognition. However, a softmax mechanism forces a model to operate under a closed-set paradigm, i.e., to predict an object class out of a set of pre-defined labels. This characteristic contributes to efficacy in classification, but poses a risk of non-sense prediction in object recognition. Object recognition is often operated under a dynamic and diverse condition. A foreign object -- an object of any unprepared class -- can be encountered at any time. OSR is intended to address an issue of identifying a foreign object in object recognition. Based on Bayes theorem and the emphasis of conditioning on the context, softmax inference has been re-interpreted. This re-interpretation has led to a new approach to OSR, called Latent Cognizance (LC). Our investigation employs various scenarios, using Imagenet 2012 dataset as well as fooling and open-set images. The findings support LC hypothesis and show its effectiveness on OSR.


title: Transverse Momentum and Transverse Momentum Distributions in the MIT Bag Model

abstract: The typical transverse momentum of a quark in the proton is a basic property of any QCD based model of nucleon structure. However, calculations in phenomenological models typically give rather small values of transverse momenta, which are difficult to reconcile with the larger values observed in high energy experiments such as Drell-Yan reactions and Semi-inclusive deep inelastic scattering. In this letter we calculate the leading twist transverse momentum dependent distribution functions (TMDs) using a generalization of the Adelaide group's relativistic formalism that has previously given good fits to the parton distributions. This enables us to examine the $k_{T}$ dependence of the TMDs in detail, and determine typical widths of these distributions. These are found to be significantly larger than those of previous calculations. We then use TMD factorization in order to evolve these distributions up to experimental scales where we can compare with data on $\langle k_{T} \rangle$ and $\langle k^{2}_{T} \rangle$. Our distributions agree well with this data.


title: Thermophotovoltaic energy conversion in far-to-near-field transition regime

abstract: Recent experimental studies on near-field thermophotovoltaic (TPV) energy conversion have mainly focused on enhancing performance via photon tunneling of evanescent waves. In the sub-micron gap, however, there exist peculiar phenomena caused by the interference of propagating waves, which is seldom observed due to the dramatic increase of the radiation by evanescent waves in full spectrum range. Here, we experimentally demonstrate the oscillatory nature of near-field TPV energy conversion in the far-to-near-field transition regime (250-2600 nm), where evanescent and propagating modes are comparable due to the selective spectral response by the PV cell. Noticeably, it was possible to produce the same amount of photocurrent at different vacuum gaps of 870 and 322 nm, which is 10\% larger than the far-field value. Considering the great challenges in maintaining nanoscale vacuum gap in practical devices, this study suggests an alternative approach to the design of a TPV system that will outperform conventional far-field counterparts.


title: Densely-Populated Traffic Detection using YOLOv5 and Non-Maximum Suppression Ensembling

abstract: Vehicular object detection is the heart of any intelligent traffic system. It is essential for urban traffic management. R-CNN, Fast R-CNN, Faster R-CNN and YOLO were some of the earlier state-of-the-art models. Region based CNN methods have the problem of higher inference time which makes it unrealistic to use the model in real-time. YOLO on the other hand struggles to detect small objects that appear in groups. In this paper, we propose a method that can locate and classify vehicular objects from a given densely crowded image using YOLOv5. The shortcoming of YOLO was solved my ensembling 4 different models. Our proposed model performs well on images taken from both top view and side view of the street in both day and night. The performance of our proposed model was measured on Dhaka AI dataset which contains densely crowded vehicular images. Our experiment shows that our model achieved mAP@0.5 of 0.458 with inference time of 0.75 sec which outperforms other state-of-the-art models on performance. Hence, the model can be implemented in the street for real-time traffic detection which can be used for traffic control and data collection.


title: Reservoir-assisted energy migration through multiple spin-domains

abstract: The transfer of energy through a network of nodes is fundamental to both how nature and current technology operates. Traditionally we think of the nodes in a network being coupled to channels that connect them and then energy is passed from node to channel to node until it reaches its targeted site. Here we introduce an alternate approach to this where our channels are replaced by collective environments (or actually reservoirs) which interact with pairs of nodes. We show how energy initially located at a specific node can arrive at a target node - even though that environment may be at zero temperate. Further we show that such a migration occurs on much faster time scales than the damping rate associated with a single spin coupled to the reservoir. Our approach shows the power of being able to tailor both the system & environment and the symmetries associated with them to provide new directions for future quantum technologies.


title: Cosmogenic gamma-ray and neutrino fluxes from blazars associated with IceCube events

abstract: Blazars constitute the vast majority of extragalactic $\gamma$-ray sources. They can also contribute a sizable fraction of the diffuse astrophysical neutrinos detected by IceCube. In the past few years, the real-time alert system of IceCube has led to multiwavelength follow-up of very high-energy neutrino events of plausible astrophysical origin. Spatial and temporal coincidences of these neutrino events with the high-activity state of $\gamma$-ray blazars can provide a unique opportunity to decipher cosmic-ray interactions in the relativistic jets. Assuming that blazars accelerate cosmic rays up to ultrahigh energies ($E>10^{17}$ eV), we calculate the "guaranteed" contribution to the line-of-sight cosmogenic $\gamma$-ray and neutrino fluxes from four blazars associated with IceCube neutrino events. Detection of these fluxes by upcoming $\gamma$-ray imaging telescopes like CTA and/or by planned neutrino detectors like IceCube-Gen2 may lead to the first direct signature(s) of ultrahigh-energy cosmic-ray (UHECR) sources. We find that detection of the cosmogenic neutrino fluxes from the blazars TXS~0506+056, PKS~1502+106 and GB6~J1040+0617 would require UHECR luminosity $\gtrsim 10$ times the inferred neutrino luminosity from the associated IceCube events. Blazars TXS~0506+056, 3HSP~J095507.9+355101 and GB6~J1040+0617 can be detected by CTA if the UHECR luminosity is $\gtrsim 10$ times the neutrino luminosity inferred from the associated IceCube events. Given their relatively low redshifts and hence total energetics, TXS~0506+056 and 3HSP~J095507.9+355101 should be the prime targets for upcoming large neutrino and $\gamma$-ray telescopes.


title: Reinforcement Learning-powered Semantic Communication via Semantic Similarity

abstract: We introduce a new semantic communication mechanism - SemanticRL, whose key idea is to preserve the semantic information instead of strictly securing the bit-level precision. Unlike previous methods that mainly concentrate on the network or structure design, we revisit the learning process and point out the semantic blindness of commonly used objective functions. To address this semantic gap, we introduce a schematic shift that learns from semantic similarity, instead of relying on conventional paired bit-level supervisions like cross entropy and bit error rate. However, developing such a semantic communication system is indeed a nontrivial task considering the non-differentiability of most semantic metrics as well as the instability from noisy channels. To further resolve these issues, we put forward a self-critic reinforcement learning (RL) solution which allows an efficient and stable learning on any user-defined semantic measurement, and take a step further to simultaneously tackle the non-differentiable semantic channel optimization problem via self-critic stochastic iterative updating (SCSIU) training on the decoupled semantic transceiver. We have firstly tested the proposed method in the challenging European-parliament dataset, which confirms the superiority of our method in revealing the semantic meanings, and better handling the semantic noise. Apart from the experimental results, we further provide an in-depth look at how the semantic model behaves, along with its superb generalization ability in real-life examples. An RL-based image transmission extension is also exemplified, so as to prove the generalization ability and motivate future discussion.


title: A Local Universe Host for the Repeating Fast Radio Burst FRB 20181030A

abstract: We report on the host association of FRB 20181030A, a repeating fast radio burst (FRB) with a low dispersion measure (DM, 103.5 pc cm$^{-3}$) discovered by CHIME/FRB Collaboration et al. (2019a). Using baseband voltage data saved for its repeat bursts, we localize the FRB to a sky area of 5.3 sq. arcmin (90% confidence). Within the FRB localization region, we identify NGC 3252 as the most promising host, with an estimated chance coincidence probability $< 2.5 \times 10^{-3}$. Moreover, we do not find any other galaxy with M$_{r} < -15$ AB mag within the localization region to the maximum estimated FRB redshift of 0.05. This rules out a dwarf host 5 times less luminous than any FRB host discovered to date. NGC 3252 is a star-forming spiral galaxy, and at a distance of $\approx$ 20 Mpc, it is one of the closest FRB hosts discovered thus far. From our archival radio data search, we estimate a 3$\sigma$ upper limit on the luminosity of a persistent compact radio source (source size $<$ 0.3 kpc at 20 Mpc) at 3 GHz to be ${\rm 2 \times 10^{26} erg~s^{-1} Hz^{-1}}$, at least 1500 times smaller than that of the FRB 20121102A persistent radio source. We also argue that a population of young millisecond magnetars alone cannot explain the observed volumetric rate of repeating FRBs. Finally, FRB 20181030A is a promising source for constraining FRB emission models due to its proximity, and we strongly encourage its multi-wavelength follow-up.


title: Generalized local ansatz for scale-dependent primordial non-Gaussianities and future galaxy surveys

abstract: We revisit a possible scale-dependence of local-type primordial non-Gaussianities induced by super-horizon evolution of scalar field perturbations. We develop the formulation based on $\delta N$ formalism and derive the generalized form of the local-type bispectrum and also trispectrum which allows us to implement the scale-dependence and suitably compare model prediction with observational data. We propose simple but phenomenologically meaningful expressions, which encompass the information of a wide range of physically motivated models. We also formulate large-scale power spectrum and bispectrum of biased objects in the presence of the scale-dependent primordial non-Gaussianities. We perform the Fisher analysis for future galaxy surveys and give the projected constraints on the parameters of the generalized local-form of primordial non-Gaussianities.


title: Canoe : A System for Collaborative Learning for Neural Nets

abstract: For highly distributed environments such as edge computing, collaborative learning approaches eschew the dependence on a global, shared model, in favor of models tailored for each location. Creating tailored models for individual learning contexts reduces the amount of data transfer, while collaboration among peers provides acceptable model performance. Collaboration assumes, however, the availability of knowledge transfer mechanisms, which are not trivial for deep learning models where knowledge isn't easily attributed to precise model slices. We present Canoe - a framework that facilitates knowledge transfer for neural networks. Canoe provides new system support for dynamically extracting significant parameters from a helper node's neural network and uses this with a multi-model boosting-based approach to improve the predictive performance of the target node. The evaluation of Canoe with different PyTorch and TensorFlow neural network models demonstrates that the knowledge transfer mechanism improves the model's adaptiveness to changes up to 3.5X compared to learning in isolation, while affording several magnitudes reduction in data movement costs compared to federated learning.


title: Temperedness criterion of the tensor product of parabolic induction for $GL_n$

abstract: We give a necessary and sufficient condition for a pair of parabolic subgroups $P$ and $Q$ of $G=GL_n(\mathbb{R})$ such that the tensor product of any two unitarily induced representations from $P$ and $Q$ are tempered. We also give an $L^p$-estimate of matrix coefficients of the regular representations on $L^2(G/L)$ when $L$ is a Levi subgroup of $G$.


title: Automated Generation of Accurate \& Fluent Medical X-ray Reports

abstract: Our paper focuses on automating the generation of medical reports from chest X-ray image inputs, a critical yet time-consuming task for radiologists. Unlike existing medical re-port generation efforts that tend to produce human-readable reports, we aim to generate medical reports that are both fluent and clinically accurate. This is achieved by our fully differentiable and end-to-end paradigm containing three complementary modules: taking the chest X-ray images and clinical his-tory document of patients as inputs, our classification module produces an internal check-list of disease-related topics, referred to as enriched disease embedding; the embedding representation is then passed to our transformer-based generator, giving rise to the medical reports; meanwhile, our generator also pro-duces the weighted embedding representation, which is fed to our interpreter to ensure consistency with respect to disease-related topics.Our approach achieved promising results on commonly-used metrics concerning language fluency and clinical accuracy. Moreover, noticeable performance gains are consistently ob-served when additional input information is available, such as the clinical document and extra scans of different views.


title: Towards model predictive control of supercritical CO2 cycles

abstract: Control of non-condensing non-ideal-gas power cycles is challenging because their output power dynamics depend on complex system interactions, non-ideal-gas effects complicate turbomachinery behavior, and state constraints must be respected. This article presents a control methodology for these systems, comprising a control modeling approach and model predictive control (MPC) strategy. This methodology is demonstrated on the high-pressure side of a simple supercritical CO2 cycle power block, composed of a variable-speed compressor, heat exchanger, and fixed-speed turbine. The control model is developed by applying timescale-separation arguments to a high-fidelity simulation model and locally linearizing non-ideal-gas turbomachinery performance maps. MPC is implemented by linearizing the control model online at each sampling instant. Closed-loop simulations with a full-order gas-dynamics truth model demonstrate the effectiveness of the proposed control methodology. In response to load changes, the controller maintains high turbine inlet temperatures while achieving net power output ramp rates in excess of 100% of nameplate output per minute. The controller often acts at the intersection of motor torque, compressor surge, and turbine inlet temperature constraints, and performs well from 35 to 105% of nameplate capacity with no parameter scheduling. Good performance and fast update rates are obtained via online linearization. The results demonstrate the suitability of MPC for the supercritical CO2 cycle, and the proposed methodology is extensible to more complex cycle variants such as the recuperated and recompression cycle.


title: Task-aware Warping Factors in Mask-based Speech Enhancement

abstract: This paper proposes the use of two task-aware warping factors in mask-based speech enhancement (SE). One controls the balance between speech-maintenance and noise-removal in training phases, while the other controls SE power applied to specific downstream tasks in testing phases. Our intention is to alleviate the problem that SE systems trained to improve speech quality often fail to improve other downstream tasks, such as automatic speaker verification (ASV) and automatic speech recognition (ASR), because they do not share the same objects. It is easy to apply the proposed dual-warping factors approach to any mask-based SE method, and it allows a single SE system to handle multiple tasks without task-dependent training. The effectiveness of our proposed approach has been confirmed on the SITW dataset for ASV evaluation and the LibriSpeech dataset for ASR and speech quality evaluations of 0-20dB. We show that different warping values are necessary for a single SE to achieve optimal performance w.r.t. the three tasks. With the use of task-dependent warping factors, speech quality was improved by an 84.7% PESQ increase, ASV had a 22.4% EER reduction, and ASR had a 52.2% WER reduction, on 0dB speech. The effectiveness of the task-dependent warping factors were also cross-validated on VoxCeleb-1 test set for ASV and LibriSpeech dev-clean set for ASV and quality evaluations. The proposed method is highly effective and easy to apply in practice.


title: Parallel Machine Learning for Forecasting the Dynamics of Complex Networks

abstract: Forecasting the dynamics of large complex networks from previous time-series data is important in a wide range of contexts. Here we present a machine learning scheme for this task using a parallel architecture that mimics the topology of the network of interest. We demonstrate the utility and scalability of our method implemented using reservoir computing on a chaotic network of oscillators. Two levels of prior knowledge are considered: (i) the network links are known; and (ii) the network links are unknown and inferred via a data-driven approach to approximately optimize prediction.


title: Super- and hyper-deformation in $^{60}$Zn, $^{62}$Zn, and $^{64}$Ge at high spins

abstract: Background: The observation of the superdeformed (SD) bands in $^{60,62}$Zn indicates that the particle number 30 is a magic particle number, where two and four neutron single-particles are considered to be promoted to the intruder $1g_{9/2}$ shell. However, the SD-yrast band in $^{62}$Zn is assigned negative parity. Purpose: I investigate various SD configurations in the rapidly rotating $^{60,62}$Zn and $^{64}$Ge, and attempt elucidating the different roles of the energy gaps at particle numbers 30 and 32. Method: I employ a nuclear energy-density functional (EDF) method: the configuration-constrained cranked Skyrme-Kohn-Sham approach is used to describe the rotational bands near the yrast line. Results: The negative-parity SD bands appear higher in energy than the positive-parity SD-yrast band in $^{60}$Zn by about 4 MeV, which is indicative of the SD doubly-magic nucleus. However, the energy gap in $^{64}$Ge is smaller $\sim 2\text{-}3$ MeV, though the quadrupole deformation of the SD states in $^{64}$Ge is greater than that of $^{60}$Zn. The present calculation predicts the occurrence of the hyperdeformed state in $^{60}$Zn and $^{64}$Ge at a high rotational frequency $\sim 2.0$ MeV$/\hbar$ due to the occupation of the $h_{11/2}$ shell. Conclusions: An SD-shell gap at particle number 30 and 32 appears at different deformations and the energy gap at particle number 32 is low, which make the SD structures of $^{62}$Zn unique, where the negative-parity SD states appear lower in energy than the positive-parity one.


title: Quantum reservoir computation utilising scale-free networks

abstract: Today's quantum processors composed of fifty or more qubits have allowed us to enter a computational era where the output results are not easily simulatable on the world's biggest supercomputers. What we have not seen yet, however, is whether or not such quantum complexity can be ever useful for any practical applications. A fundamental question behind this lies in the non-trivial relation between the complexity and its computational power. If we find a clue for how and what quantum complexity could boost the computational power, we might be able to directly utilize the quantum complexity to design quantum computation even with the presence of noise and errors. In this work we introduce a new reservoir computational model for pattern recognition showing a quantum advantage utilizing scale-free networks. This new scheme allows us to utilize the complexity inherent in the scale-free networks, meaning we do not require programing nor optimization of the quantum layer even for other computational tasks. The simplicity in our approach illustrates the computational power in quantum complexity as well as provide new applications for such processors.


title: Machine learning-based aerosol characterization using OCO-2 O2 A-band observations

abstract: Aerosol scattering influences the retrieval of the column-averaged dry-air mole fraction of CO2 (XCO2) from the Orbiting Carbon Observatory-2 (OCO-2). This is especially true for surfaces with reflectance close to a critical value where there is very low sensitivity to aerosol loading. A spectral sorting approach was introduced to improve the characterization of aerosols over coastal regions. Here, we generalize this procedure to land surfaces and use a two-step neural network to retrieve aerosol parameters from OCO-2 measurements. We show that, by using a combination of radiance measurements in the continuum and inside the absorption band, both the aerosol optical depth and layer height, as well as their uncertainties, can be accurately predicted. Using the improved aerosol estimates as a priori, we demonstrate that the accuracy of the XCO2 retrieval can be significantly improved compared to the OCO-2 Level-2 Standard product. Furthermore, using simulated observations, we obtain estimates of the error in the retrieved XCO2. These simulations indicate that the bias-corrected OCO-2 Lite data, which is used for flux inversions, may have remaining biases due to misinterpretation of aerosol effects.


title: Multicriticality of Two-dimensional Class D Disordered Topological Superconductors

abstract: A generic two-dimensional disordered topological superconductor in symmetry class D exhibits rich phenomenology and multiple phases: diffusive thermal metal (DTM), Anderson insulator (AI), and thermal quantum Hall (TQH) phase (a topological superconductor). We numerically investigate the phase diagram of a lattice model of such class D superconductor, specifically focusing on transitions between the phases and the associated universal critical behaviors. We confirm the existence of a tricritical point and its repulsive nature at the point on the phase diagram where the three phases meet. We characterize the critical behaviors at various critical points and the tricritical point using numerical evaluation of the localization length, the conductance (or conductivity), and the density of states. We conclude that the two metal-insulator transitions (DTM-TQH and DTM-AI) belong to the same universality class, whereas the tricritical point (TCP) represents a distinct universality class.


title: WAD: A Deep Reinforcement Learning Agent for Urban Autonomous Driving

abstract: Urban autonomous driving is an open and challenging problem to solve as the decision-making system has to account for several dynamic factors like multi-agent interactions, diverse scene perceptions, complex road geometries, and other rarely occurring real-world events. On the other side, with deep reinforcement learning (DRL) techniques, agents have learned many complex policies. They have even achieved super-human-level performances in various Atari Games and Deepmind's AlphaGo. However, current DRL techniques do not generalize well on complex urban driving scenarios. This paper introduces the DRL driven Watch and Drive (WAD) agent for end-to-end urban autonomous driving. Motivated by recent advancements, the study aims to detect important objects/states in high dimensional spaces of CARLA and extract the latent state from them. Further, passing on the latent state information to WAD agents based on TD3 and SAC methods to learn the optimal driving policy. Our novel approach utilizing fewer resources, step-by-step learning of different driving tasks, hard episode termination policy, and reward mechanism has led our agents to achieve a 100% success rate on all driving tasks in the original CARLA benchmark and set a new record of 82% on further complex NoCrash benchmark, outperforming the state-of-the-art model by more than +30% on NoCrash benchmark.


title: Optimized two-dimensional Networks with edge crossing cost: frustrated anti-ferromagnetic spin system

abstract: We consider a quasi two-dimensional network connection growth model that minimizes the wiring cost while maximizing the network connections, but at the same time edge crossings are penalized or forbidden. This model is mapped to a dilute anti-ferromagnetic Ising spin system with frustrations. We obtain analytic results for the order-parameter or mean degree of the optimized network using mean field theories. The cost landscape is analyzed in detail showing complex structures due to frustration as the crossing penalty increases. For the case of strictly no edge crossing is allowed, the mean-field equations lead to a new algorithm that can effectively find the (near) optimal solution even for this strongly frustrated system. All these results are also verified by Monte Carlo simulations and numerical solution of the mean-field equations. Possible applications and relation to the planar triangulation problem is also discussed.


title: Distributed Mirror Descent Algorithm with Bregman Damping for Nonsmooth Constrained Optimization

abstract: To solve distributed optimization efficiently with various constraints and nonsmooth functions, we propose a distributed mirror descent algorithm with embedded Bregman damping, as a generalization of conventional distributed projection-based algorithms. In fact, our continuous-time algorithm well inherits good capabilities of mirror descent approaches to rapidly compute explicit solutions to the problems with some specific constraint structures. Moreover, we rigorously prove the convergence of our algorithm, along with the boundedness of the trajectory and the accuracy of the solution.


title: Secoco: Self-Correcting Encoding for Neural Machine Translation

abstract: This paper presents Self-correcting Encoding (Secoco), a framework that effectively deals with input noise for robust neural machine translation by introducing self-correcting predictors. Different from previous robust approaches, Secoco enables NMT to explicitly correct noisy inputs and delete specific errors simultaneously with the translation decoding process. Secoco is able to achieve significant improvements over strong baselines on two real-world test sets and a benchmark WMT dataset with good interpretability. We will make our code and dataset publicly available soon.


title: Crystal-to-Crystal Transitions in Binary Mixtures of Soft Colloids

abstract: In this article, we demonstrate a method for inducing reversible crystal-to-crystal transitions in binary mixtures of soft colloidal particles. Through a controlled decrease of salinity and increasingly dominating electrostatic interactions, a single sample is shown to reversibly organize into entropic crystals, electrostatic attraction-dominated crystals or aggregated gels, which we quantify using microscopy and image analysis. We furthermore analyze crystalline structures with bond order analysis to discern between two crystal phases. We observe the different phases using a sample holder geometry that allows both in situ salinity control and imaging through Confocal Laser Scanning Microscopy, and apply a synthesis method producing particles with high resolvability in microscopy with control over particle size. The particle softness provides for an enhanced crystallization speed, while altering the re-entrant melting behavior as compared to hard sphere systems. This work thus provides several tools for use in the reproducible manufacture and analysis of binary colloidal crystals.


title: Dealing with Typos for BERT-based Passage Retrieval and Ranking

abstract: Passage retrieval and ranking is a key task in open-domain question answering and information retrieval. Current effective approaches mostly rely on pre-trained deep language model-based retrievers and rankers. These methods have been shown to effectively model the semantic matching between queries and passages, also in presence of keyword mismatch, i.e. passages that are relevant to a query but do not contain important query keywords. In this paper we consider the Dense Retriever (DR), a passage retrieval method, and the BERT re-ranker, a popular passage re-ranking method. In this context, we formally investigate how these models respond and adapt to a specific type of keyword mismatch -- that caused by keyword typos occurring in queries. Through empirical investigation, we find that typos can lead to a significant drop in retrieval and ranking effectiveness. We then propose a simple typos-aware training framework for DR and BERT re-ranker to address this issue. Our experimental results on the MS MARCO passage ranking dataset show that, with our proposed typos-aware training, DR and BERT re-ranker can become robust to typos in queries, resulting in significantly improved effectiveness compared to models trained without appropriately accounting for typos.


title: Quantum frequency conversion of vacuum squeezed light to bright tunable blue squeezed light and higher-order spatial modes

abstract: Quantum frequency conversion, the process of shifting the frequency of an optical quantum state while preserving quantum coherence, can be used to produce non-classical light at otherwise unapproachable wavelengths. We present experimental results based on highly efficient sum-frequency generation (SFG) between a vacuum squeezed state at 1064 nm and a tunable pump source at 850 nm $\pm$ 50 nm for the generation of bright squeezed light at 472~nm $\pm$ 4~nm, currently limited by the phase-matching of the used nonlinear crystal. We demonstrate that the SFG process conserves part of the quantum coherence as a 4.2($\pm0.2$)~dB 1064 nm vacuum squeezed state is converted to a 1.6($\pm$0.2)~dB tunable bright blue squeezed state. We furthermore demonstrate simultaneous frequency- and spatial-mode conversion of the 1064-nm vacuum squeezed state, and measure 1.1($\pm$0.2)~dB and 0.4($\pm$0.2)~dB of squeezing in the TEM$_{01}$ and TEM$_{02}$ modes, respectively. With further development, we foresee that the source may find use within fields such as sensing, metrology, spectroscopy, and imaging.


title: DAE-GAN: Dynamic Aspect-aware GAN for Text-to-Image Synthesis

abstract: Text-to-image synthesis refers to generating an image from a given text description, the key goal of which lies in photo realism and semantic consistency. Previous methods usually generate an initial image with sentence embedding and then refine it with fine-grained word embedding. Despite the significant progress, the 'aspect' information (e.g., red eyes) contained in the text, referring to several words rather than a word that depicts 'a particular part or feature of something', is often ignored, which is highly helpful for synthesizing image details. How to make better utilization of aspect information in text-to-image synthesis still remains an unresolved challenge. To address this problem, in this paper, we propose a Dynamic Aspect-awarE GAN (DAE-GAN) that represents text information comprehensively from multiple granularities, including sentence-level, word-level, and aspect-level. Moreover, inspired by human learning behaviors, we develop a novel Aspect-aware Dynamic Re-drawer (ADR) for image refinement, in which an Attended Global Refinement (AGR) module and an Aspect-aware Local Refinement (ALR) module are alternately employed. AGR utilizes word-level embedding to globally enhance the previously generated image, while ALR dynamically employs aspect-level embedding to refine image details from a local perspective. Finally, a corresponding matching loss function is designed to ensure the text-image semantic consistency at different levels. Extensive experiments on two well-studied and publicly available datasets (i.e., CUB-200 and COCO) demonstrate the superiority and rationality of our method.


title: Efficient algorithm for approximating Nash equilibrium of distributed aggregative games

abstract: In this paper, we aim to design a distributed approximate algorithm for seeking Nash equilibria of an aggregative game. Due to the local set constraints of each player, projectionbased algorithms have been widely employed for solving such problems actually. Since it may be quite hard to get the exact projection in practice, we utilize inscribed polyhedrons to approximate local set constraints, which yields a related approximate game model. We first prove that the Nash equilibrium of the approximate game is the $\epsilon$-Nash equilibrium of the original game, and then propose a distributed algorithm to seek the $\epsilon$-Nash equilibrium, where the projection is then of a standard form in quadratic programming. With the help of the existing developed methods for solving quadratic programming, we show the convergence of the proposed algorithm, and also discuss the computational cost issue related to the approximation. Furthermore, based on the exponential convergence of the algorithm, we estimate the approximation accuracy related to $\epsilon$. Additionally, we investigate the computational cost saved by approximation on numerical examples.


title: Stability of hypothetical AgIICl2 polymorphs under high pressure, revisited : a computational study

abstract: A comparative computational study of stability of candidate structures for an as yet unknown silver dichloride AgCl2 is presented. It is found that all considered candidates have a negative enthalpy of formation, but are unstable towards charge transfer and decomposition into silver(I) chloride and chlorine within the DFT and hybrid DFT approaches in the entire studied pressure range. Within SCAN approach, several of the true AgIICl2 polymorphs (i.e. containing Ag(II) species) exhibit a region of stability below ca. 20 GPa. However, their stability with respect to aforementioned decomposition decreases with pressure by account of all three DFT methods, which suggests a limited possibility of high pressure synthesis of AgCl2. Some common patterns in pressure induced structural transitions observed in the studied systems also emerge, which further testify to an instability of hypothetical AgCl2 towards charge transfer and phase separation.


title: Lyra: A Benchmark for Turducken-Style Code Generation

abstract: Recently, neural techniques have been used to generate source code automatically. While promising for declarative languages, these approaches achieve much poorer performance on datasets for imperative languages. Since a declarative language is typically embedded in an imperative language (i.e., the turducken-style programming) in real-world software development, the promising results on declarative languages can hardly lead to significant reduction of manual software development efforts. In this paper, we define a new code generation task: given a natural language comment, this task aims to generate a program in a base imperative language with an embedded declarative language. To our knowledge, this is the first turducken-style code generation task. For this task, we present Lyra: a dataset in Python with embedded SQL. This dataset contains 2,000 carefully annotated database manipulation programs from real-world projects. Each program is paired with both a Chinese comment and an English comment. In our experiment, we adopted Transformer, BERT-style, and GPT-style models as baselines. In the best setting, the generation performance of GPT-style models is better than others, where the AST exact matching accuracy is 24% and 25.5% when using Chinese and English comments, respectively. Therefore, we believe that Lyra provides a new challenge for code generation. Yet, overcoming this challenge may significantly boost the applicability of code generation techniques for real-world software development.