title: An Improved Benders Decomposition Algorithm for Steady-State Dispatch Problem in an Integrated Electricity-Gas System

abstract: Optimally operating an integrated electricity-gas system (IEGS) is significant for the energy sector. However, the IEGS operation model's nonconvexity makes it challenging to solve the optimal dispatch problem in the IEGS. This letter proposes an improved Benders decomposition (IBD) algorithm catering to a commonly used steady-state dispatch model of the IEGS. This IBD algorithm leverages a refined decomposition structure where the subproblems become linear and ready to be solved in parallel. We analytically compare our IBD algorithm with an existing Benders decomposition algorithm and a typical piecewise linearization method. Case studies have substantiated the higher computational efficiency of our IBD algorithm.


title: Variational Autoencoders for Learning Nonlinear Dynamics of Physical Systems

abstract: We develop data-driven methods for incorporating physical information for priors to learn parsimonious representations of nonlinear systems arising from parameterized PDEs and mechanics. Our approach is based on Variational Autoencoders (VAEs) for learning from observations nonlinear state space models. We develop ways to incorporate geometric and topological priors through general manifold latent space representations. We investigate the performance of our methods for learning low dimensional representations for the nonlinear Burgers equation and constrained mechanical systems.

categories: cs.LG cs.AI cs.SY eess.SY math.DG math.DS


title: Efficient Heuristic Generation for Robot Path Planning with Recurrent Generative Model

abstract: Robot path planning is difficult to solve due to the contradiction between optimality of results and complexity of algorithms, even in 2D environments. To find an optimal path, the algorithm needs to search all the state space, which costs a lot of computation resource. To address this issue, we present a novel recurrent generative model (RGM) which generates efficient heuristic to reduce the search efforts of path planning algorithm. This RGM model adopts the framework of general generative adversarial networks (GAN), which consists of a novel generator that can generate heuristic by refining the outputs recurrently and two discriminators that check the connectivity and safety properties of heuristic. We test the proposed RGM module in various 2D environments to demonstrate its effectiveness and efficiency. The results show that the RGM successfully generates appropriate heuristic in both seen and new unseen maps with a high accuracy, demonstrating the good generalization ability of this model. We also compare the rapidly-exploring random tree star (RRT*) with generated heuristic and the conventional RRT* in four different maps, showing that the generated heuristic can guide the algorithm to find both initial and optimal solution in a faster and more efficient way.


title: Hermitian Sums of Squares Modulo Hermitian Ideals

abstract: In this work we study the problem of writing a Hermitian polynomial as a Hermitian sum of squares modulo a Hermitian ideal. We investigate a novel idea of Putinar-Scheiderer to obtain necessary matrix positivity conditions for Hermitian polynomials to be Hermitian sums of squares modulo Hermitian ideals. We show that the conditions are sufficient for a class of examples making a connection to the operator-valued Riesz-Fejer theorem and block Toeplitz forms. The work fits into the larger themes of Hermitian versions of Hilbert's 17-th problem and characterizations of positivity.


title: Consistent and robust inference in hazard probability and odds models with discrete-time survival data

abstract: For discrete-time survival data, conditional likelihood inference in Cox's hazard odds model is theoretically desirable but exact calculation is numerical intractable with a moderate to large number of tied events. Unconditional maximum likelihood estimation over both regression coefficients and baseline hazard probabilities can be problematic with a large number of time intervals. We develop new methods and theory using numerically simple estimating functions, along with model-based and model-robust variance estimation, in hazard probability and odds models. For the probability hazard model, we derive as a consistent estimator the Breslow-Peto estimator, previously known as an approximation to the conditional likelihood estimator in the hazard odds model. For the odds hazard model, we propose a weighted Mantel-Haenszel estimator, which satisfies conditional unbiasedness given the numbers of events in addition to the risk sets and covariates, similarly to the conditional likelihood estimator. Our methods are expected to perform satisfactorily in a broad range of settings, with small or large numbers of tied events corresponding to a large or small number of time intervals. The methods are implemented in the R package dSurvival.


title: Data-Driven Predictive Control for Continuous-Time Industrial Processes with Completely Unknown Dynamics

abstract: This paper investigates the data-driven predictive control problems for a class of continuous-time industrial processes with completely unknown dynamics. The proposed approach employs the data-driven technique to get the system matrices online, using input-output measurements. Then, a model-free predictive control approach is designed to implement the receding-horizon optimization and realize the reference tracking. Feasibility of the proposed algorithm and stability of the closed-loop control systems are analyzed, respectively. Finally, a simulation example is provided to demonstrate the effectiveness of the proposed approach.


title: A Tool to Extract Structured Data from GitHub

abstract: GitHub repositories consist of various detailed information about the project contributors, the number of commits and its contributors, releases, pull requests, programming languages, and issues. However, no systematic dataset of open source projects exists which features detailed information about the repositories on GitHub for knowledge acquisition and mining. In this paper, we developed tool support, named GitRepository, which helps in creating a data-set of repositories based on the proposed schema. Out of initial 1680 repositories, the dataset hosts 620 repositories (with applied basic filters of stars and forks), and 247 repositories (after applying all pre-defined filters). The tool extracts the information of GitHub repositories and saves the data in the form of CSV. files and a database (.DB) file.


title: Stronger Calibration Lower Bounds via Sidestepping

abstract: We consider an online binary prediction setting where a forecaster observes a sequence of $T$ bits one by one. Before each bit is revealed, the forecaster predicts the probability that the bit is $1$. The forecaster is called well-calibrated if for each $p \in [0, 1]$, among the $n_p$ bits for which the forecaster predicts probability $p$, the actual number of ones, $m_p$, is indeed equal to $p \cdot n_p$. The calibration error, defined as $\sum_p |m_p - p n_p|$, quantifies the extent to which the forecaster deviates from being well-calibrated. It has long been known that an $O(T^{2/3})$ calibration error is achievable even when the bits are chosen adversarially, and possibly based on the previous predictions. However, little is known on the lower bound side, except an $\Omega(\sqrt{T})$ bound that follows from the trivial example of independent fair coin flips. In this paper, we prove an $\Omega(T^{0.528})$ bound on the calibration error, which is the first super-$\sqrt{T}$ lower bound for this setting to the best of our knowledge. The technical contributions of our work include two lower bound techniques, early stopping and sidestepping, which circumvent the obstacles that have previously hindered strong calibration lower bounds. We also propose an abstraction of the prediction setting, termed the Sign-Preservation game, which may be of independent interest. This game has a much smaller state space than the full prediction setting and allows simpler analyses. The $\Omega(T^{0.528})$ lower bound follows from a general reduction theorem that translates lower bounds on the game value of Sign-Preservation into lower bounds on the calibration error.


title: TP-TIO: A Robust Thermal-Inertial Odometry with Deep ThermalPoint

abstract: To achieve robust motion estimation in visually degraded environments, thermal odometry has been an attraction in the robotics community. However, most thermal odometry methods are purely based on classical feature extractors, which is difficult to establish robust correspondences in successive frames due to sudden photometric changes and large thermal noise. To solve this problem, we propose ThermalPoint, a lightweight feature detection network specifically tailored for producing keypoints on thermal images, providing notable anti-noise improvements compared with other state-of-the-art methods. After that, we combine ThermalPoint with a novel radiometric feature tracking method, which directly makes use of full radiometric data and establishes reliable correspondences between sequential frames. Finally, taking advantage of an optimization-based visual-inertial framework, a deep feature-based thermal-inertial odometry (TP-TIO) framework is proposed and evaluated thoroughly in various visually degraded environments. Experiments show that our method outperforms state-of-the-art visual and laser odometry methods in smoke-filled environments and achieves competitive accuracy in normal environments.


title: Integrable systems: From the inverse spectral transform to zero curvature condition

abstract: This \textquoteleft research-survey' is meant for beginners in the studies of integrable systems. Here we outline some analytical methods for dealing with a class of nonlinear partial differential equations. We pay special attention to \textquoteleft inverse spectral transform', \textquoteleft Lax pair representation', and \textquoteleft zero-curvature condition' as applied to these equations. We provide a number of interesting examples to gain some physico-mathematical feeling for the methods presented.


title: VideoMix: Rethinking Data Augmentation for Video Classification

abstract: State-of-the-art video action classifiers often suffer from overfitting. They tend to be biased towards specific objects and scene cues, rather than the foreground action content, leading to sub-optimal generalization performances. Recent data augmentation strategies have been reported to address the overfitting problems in static image classifiers. Despite the effectiveness on the static image classifiers, data augmentation has rarely been studied for videos. For the first time in the field, we systematically analyze the efficacy of various data augmentation strategies on the video classification task. We then propose a powerful augmentation strategy VideoMix. VideoMix creates a new training video by inserting a video cuboid into another video. The ground truth labels are mixed proportionally to the number of voxels from each video. We show that VideoMix lets a model learn beyond the object and scene biases and extract more robust cues for action recognition. VideoMix consistently outperforms other augmentation baselines on Kinetics and the challenging Something-Something-V2 benchmarks. It also improves the weakly-supervised action localization performance on THUMOS'14. VideoMix pretrained models exhibit improved accuracies on the video detection task (AVA).


title: Deep Neural Network Training without Multiplications

abstract: Is multiplication really necessary for deep neural networks? Here we propose just adding two IEEE754 floating-point numbers with an integer-add instruction in place of a floating-point multiplication instruction. We show that ResNet can be trained using this operation with competitive classification accuracy. Our proposal did not require any methods to solve instability and decrease in accuracy, which is common in low-precision training. In some settings, we may obtain equal accuracy to the baseline FP32 result. This method will enable eliminating the multiplications in deep neural-network training and inference.


title: PFA-GAN: Progressive Face Aging with Generative Adversarial Network

abstract: Face aging is to render a given face to predict its future appearance, which plays an important role in the information forensics and security field as the appearance of the face typically varies with age. Although impressive results have been achieved with conditional generative adversarial networks (cGANs), the existing cGANs-based methods typically use a single network to learn various aging effects between any two different age groups. However, they cannot simultaneously meet three essential requirements of face aging -- including image quality, aging accuracy, and identity preservation -- and usually generate aged faces with strong ghost artifacts when the age gap becomes large. Inspired by the fact that faces gradually age over time, this paper proposes a novel progressive face aging framework based on generative adversarial network (PFA-GAN) to mitigate these issues. Unlike the existing cGANs-based methods, the proposed framework contains several sub-networks to mimic the face aging process from young to old, each of which only learns some specific aging effects between two adjacent age groups. The proposed framework can be trained in an end-to-end manner to eliminate accumulative artifacts and blurriness. Moreover, this paper introduces an age estimation loss to take into account the age distribution for an improved aging accuracy, and proposes to use the Pearson correlation coefficient as an evaluation metric measuring the aging smoothness for face aging methods. Extensively experimental results demonstrate superior performance over existing (c)GANs-based methods, including the state-of-the-art one, on two benchmarked datasets. The source code is available at~\url{https://github.com/Hzzone/PFA-GAN}.


title: Reprogramming Language Models for Molecular Representation Learning

abstract: Recent advancements in transfer learning have made it a promising approach for domain adaptation via transfer of learned representations. This is especially when relevant when alternate tasks have limited samples of well-defined and labeled data, which is common in the molecule data domain. This makes transfer learning an ideal approach to solve molecular learning tasks. While Adversarial reprogramming has proven to be a successful method to repurpose neural networks for alternate tasks, most works consider source and alternate tasks within the same domain. In this work, we propose a new algorithm, Representation Reprogramming via Dictionary Learning (R2DL), for adversarially reprogramming pretrained language models for molecular learning tasks, motivated by leveraging learned representations in massive state of the art language models. The adversarial program learns a linear transformation between a dense source model input space (language data) and a sparse target model input space (e.g., chemical and biological molecule data) using a k-SVD solver to approximate a sparse representation of the encoded data, via dictionary learning. R2DL achieves the baseline established by state of the art toxicity prediction models trained on domain-specific data and outperforms the baseline in a limited training-data setting, thereby establishing avenues for domain-agnostic transfer learning for tasks with molecule data.


title: Seeking Consensus on Subspaces in Federated Principal Component Analysis

abstract: In this paper, we develop an algorithm for federated principal component analysis (PCA) with emphases on both communication efficiency and data privacy. Generally speaking, federated PCA algorithms based on direct adaptations of classic iterative methods, such as simultaneous subspace iterations (SSI), are unable to preserve data privacy, while algorithms based on variable-splitting and consensus-seeking, such as alternating direction methods of multipliers (ADMM), lack in communication-efficiency. In this work, we propose a novel consensus-seeking formulation by equalizing subspaces spanned by splitting variables instead of equalizing variables themselves, thus greatly relaxing feasibility restrictions and allowing much faster convergence. Then we develop an ADMM-like algorithm with several special features to make it practically efficient, including a low-rank multiplier formula and techniques for treating subproblems. We establish that the proposed algorithm can better protect data privacy than classic methods adapted to the federated PCA setting. We derive convergence results, including a worst-case complexity estimate, for the proposed ADMM-like algorithm in the presence of the nonlinear equality constraints. Extensive empirical results are presented to show that the new algorithm, while enhancing data privacy, requires far fewer rounds of communication than existing peer algorithms for federated PCA.


title: Excitation energy and angular momentum dependence of the nuclear level density parameter around A$\approx $110

abstract: Neutron kinetic energy spectra in coincidence with low-energy $\gamma $-ray multiplicities have been measured around $A\approx $ 110 in the $^{16}$O, $^{20}$Ne + $^{93}$Nb reactions in a compound nuclear excitation energy range of $\approx $ 90 - 140 MeV. The excitation energy (temperature) and angular momentum (spin) dependence of the inverse level density parameter $k$ has been investigated by comparing the experimental data with statistical Hauser-Feshbach calculation. In contrast to the available systematic in this mass region, the inverse level density parameter showed an appreciable increase as a function of the excitation energy. The extracted $k$-values at different angular momentum regions, corresponding to different $\gamma $-multiplicities also showed an overall increase with the average nuclear spins. The experimental results have been compared with a microscopic statistical-model calculation and found to be in reasonable agreement with the data. The results provide useful information to understand the variation of nuclear level density at high temperature and spins.


title: Two Populations of Carbon-Enhanced Metal-Poor Stars in the Disk System of the Milky Way

abstract: We present a chemo-dynamical analysis of low-resolution ($R \sim 1300$) spectroscopy of stars from the AAOmega Evolution of Galactic Structure (AEGIS) survey, focusing on two key populations of carbon-enhanced metal-poor (CEMP) stars within the disk system of the Milky Way: a mildly prograde population ($L_z < 1000\,$kpc$\,$km$\,$s$^{-1}$) and a strongly prograde ($L_z > 1000\,$kpc$\,$km$\,$s$^{-1}$) population. Based on their chemical and kinematic characteristics, and on comparisons with similar populations found in the recent literature, we tentatively associate the former with an ex-situ inner-halo population originating from either the $Gaia$ Sausage or $Gaia$-Enceladus. The latter population is linked to the metal-weak thick-disk (MWTD). We discuss their implications in the context of the formation history of the Milky Way.


title: Weak Anti-localization in thin films of the Topological Semimetal Candidate Pd$_{3}$Bi$_{2}$S$_{2}$

abstract: We report the growth and magneto-transport studies of Pd$_{3}$Bi$_{2}$S$_{2}$ (PBS) thin films synthesized by pulsed laser deposition (PLD) technique. The magneto-transport study on pristine and post annealed films show the presence of more than one type of charge carrier with a carrier concentration in the range $0.6$ - $2.26~\times$ 10$^{21}$ cm$^{-3}$ and mobility in the range 0.96 - 1.73 $\times$ 10$^{2}$ cm$^{2}$/Vs. At low temperatures a logarithmic increase in conductivity is observed which indicates the presence of weak anti-localization (WAL). The magnetotransport data is analysed within the Hikami-Larkin-Nagaoka (HLN) theory. It is found that temperature dependence of the dephasing length can't be explained only by electron-electron scattering and that electron-phonon scattering also contributes to the phase relaxation mechanism in PBS films.


title: Nuclear level density and thermal properties of $^{115}$Sn from neutron evaporation

abstract: The nuclear level density of $^{115}$Sn has been measured in an excitation energy range of $\sim $2 - 9 MeV using the experimental neutron evaporation spectra from the $^{115}$In($p,n$)$^{115}$Sn reaction. The experimental level densities were compared with the microscopic Hartree-Fock BCS (HFBCS), Hartree-Fock-Bogoliubov plus combinatorial (HFB+C), and an exact pairing plus independent particle model (EP+IPM) calculations. It is observed that the EP+IPM provides the most accurate description of the experimental data. The thermal properties (entropy and temperature) of $^{115}$Sn have been investigated from the measured level densities. The experimental temperature profile as well as the calculated heat capacity show distinct signatures of a transition from the strongly-paired nucleonic phase to the weakly paired one in this nucleus.


title: Attention-based Saliency Hashing for Ophthalmic Image Retrieval

abstract: Deep hashing methods have been proved to be effective for the large-scale medical image search assisting reference-based diagnosis for clinicians. However, when the salient region plays a maximal discriminative role in ophthalmic image, existing deep hashing methods do not fully exploit the learning ability of the deep network to capture the features of salient regions pointedly. The different grades or classes of ophthalmic images may be share similar overall performance but have subtle differences that can be differentiated by mining salient regions. To address this issue, we propose a novel end-to-end network, named Attention-based Saliency Hashing (ASH), for learning compact hash-code to represent ophthalmic images. ASH embeds a spatial-attention module to focus more on the representation of salient regions and highlights their essential role in differentiating ophthalmic images. Benefiting from the spatial-attention module, the information of salient regions can be mapped into the hash-code for similarity calculation. In the training stage, we input the image pairs to share the weights of the network, and a pairwise loss is designed to maximize the discriminability of the hash-code. In the retrieval stage, ASH obtains the hash-code by inputting an image with an end-to-end manner, then the hash-code is used to similarity calculation to return the most similar images. Extensive experiments on two different modalities of ophthalmic image datasets demonstrate that the proposed ASH can further improve the retrieval performance compared to the state-of-the-art deep hashing methods due to the huge contributions of the spatial-attention module.


title: Hyperbolic Radial Spanning Tree

abstract: We define and analyze an extension to the $d$-dimensional hyperbolic space of the Radial Spanning Tree (RST) introduced by Baccelli and Bordenave in the two-dimensional Euclidean space (2007). In particular, we will focus on the description of the infinite branches of the tree. The properties of the two-dimensional Euclidean RST are extended to the hyperbolic case in every dimension: almost surely, every infinite branch admits an asymptotic direction and each asymptotic direction is reached by at least one infinite branch. Moreover, the branch converging to any deterministic asymptotic direction is unique almost surely. To obtain results for any dimension, a completely new approach is considered here. \tvc{Our strategy mainly involves the two following ingredients, that rely on the hyperbolic Directed Spanning Forest (DSF) introduced and studied in Flammant (2019).} First, the hyperbolic metric allows us to obtain fine control of the branches' fluctuations in the hyperbolic DSF without using planarity arguments. Then, we couple the hyperbolic RST with the hyperbolic DSF and conclude.


title: An Empirical Survey of Unsupervised Text Representation Methods on Twitter Data

abstract: The field of NLP has seen unprecedented achievements in recent years. Most notably, with the advent of large-scale pre-trained Transformer-based language models, such as BERT, there has been a noticeable improvement in text representation. It is, however, unclear whether these improvements translate to noisy user-generated text, such as tweets. In this paper, we present an experimental survey of a wide range of well-known text representation techniques for the task of text clustering on noisy Twitter data. Our results indicate that the more advanced models do not necessarily work best on tweets and that more exploration in this area is needed.


title: Formation of multiple-planet systems in resonant chains around M dwarfs

abstract: Recent observations have revealed the existence of multiple-planet systems composed of Earth-mass planets around late M dwarfs. Most of their orbits are close to commensurabilities, which suggests that planets were commonly trapped in resonant chains in their formation around low-mass stars. We investigate the formation of multiple-planet systems in resonant chains around low-mass stars. A time-evolution model of the multiple-planet formation via pebble accretion in the early phase of the disk evolution is constructed based on the formation model for the TRAPPIST-1 system by Ormel et al. (2017). Our simulations show that knowing the protoplanet appearance timescale is important for determining the number of planets and their trapped resonances: as the protoplanet appearance timescale increases, fewer planets are formed, which are trapped in more widely separated resonances. We find that there is a range of the protoplanet appearance timescale for forming the stable multiple-planet systems in resonant chains. This range depends on the stellar mass and disk size. We suggest that the protoplanet appearance timescale is a key parameter for studying the formation of multiple-planet systems with planets in resonant chains around low-mass stars. The composition of the planets in our model is also discussed.


title: Center for Astrophysics Optical Infrared Science Archive. I. FAST Spectrograph

abstract: We announce the public release of 141,531 moderate-dispersion optical spectra of 72,247 objects acquired over the past 25 years with the FAST Spectrograph on the Fred L. Whipple Observatory 1.5-meter Tillinghast telescope. We describe the data acquisition and processing so that scientists can understand the spectra. We highlight some of the largest FAST survey programs, and make recommendations for use. The spectra have been placed in a Virtual Observatory accessible archive and are ready for download.


title: Spin Hall effect generated by fluctuating vortices in type-II superconductors

abstract: We theoretically investigate the vortex spin Hall effect, i.e., a novel spin Hall effect driven by the motion of superconducting vortices, by focusing on the role of superconducting fluctuations. Within the BCS-Gor'kov microscopic approach combined with the Kubo formula, we find a strong similarity between the vortex spin Hall effect and the vortex Nernst/Ettingshausen effect. Calculated temperature dependence of the voltage signal due to the inverse vortex spin Hall effect exhibits a strong enhancement by vortex fluctuations. This result not only provides a possible explanation for a prominent peak found in the spin Seebeck effect in a NbN/Y$_3$Fe$_5$O$_{12}$ system, but also leads to a proposal of new experiments using other superconductors with strong fluctuations, such as cuprate or iron-based superconductors.


title: Quantum-Enhanced Machine Learning for Covid-19 and Anderson Insulator Predictions

abstract: Quantum Machine Learning (QML) algorithms to solve classifications problems have been made available thanks to recent advancements in quantum computation. While the number of qubits are still relatively small, they have been used for "quantum enhancement" of machine learning. An important question is related to the efficacy of such protocols. We evaluate this efficacy using common baseline data sets, in addition to recent coronavirus spread data as well as the quantum metal-insulator transition in three dimensions. For the computation, we used the 16 qubit IBM quantum computer. We find that the "quantum enhancement" is not generic and fails for more complex machine learning tasks.


title: Renormalization group analysis of superradiant growth of self-interacting axion cloud

abstract: There are strong interests in considering ultra-light scalar fields (especially axion) around a rapidly rotating black hole because of the possibility of observing gravitational waves from axion condensate (axion cloud) around black holes. Motivated by this consideration, we propose a new method to study the dynamics of an ultra-light scalar field with self-interaction around a rapidly rotating black hole, which uses the dynamical renormalization group method. We find that for relativistic clouds, saturation of the superradiant instability by the scattering of the axion due to the self-interaction does not occur in the weakly non-linear regime when we consider the adiabatic growth of the cloud from a single superradiant mode. This may suggest that for relativistic axion clouds, an explosive phenomenon called the Bosenova may inevitably happen, at least once in its evolutionary history.


title: Convergence and Efficiency of Different Methods to Compute the Diffraction Integral for Gravitational Lensing of Gravitational Waves

abstract: Wave optics may need to be considered when studying the lensed waveforms of gravitational waves (GWs). However, the computation of the diffraction integral (amplification factor) in wave optics is challenging and time-consuming. It is vital to develop an accurate and efficient method to calculate the amplification factor for detecting lensed GW systems. In this paper, we investigate the convergence of the diffraction integral for gravitational lensing of GWs and analyze the accuracy and efficiency of a number of numerical methods that can be used to calculate this integral, including the integral mean method, asymptotic expansion method, Levin's method, zero points integral method, etc. We further introduce a new method by combining the zero points integral and the asymptotic expansion methods to calculate the diffraction integral, which provides an efficient and accurate way to calculate the lensed waveform of GWs.


title: A modified maximum contrast method for unequal sample sizes in pharmacogenomic studies

abstract: In pharmacogenomic studies, biomedical researchers commonly analyze the association between genotype and biological response by using the Kruskal--Wallis test or one-way analysis of variance (ANOVA) after logarithmic transformation of the obtained data. However, because these methods detect unexpected biological response patterns, the power for detecting the expected pattern is reduced. Previously, we proposed a combination of the maximum contrast method and the permuted modified maximum contrast method for unequal sample sizes in pharmacogenomic studies. However, we noted that the distribution of the permuted modified maximum contrast statistic depends on a nuisance parameter $\sigma^2$, which is the population variance. In this paper, we propose a modified maximum contrast method with a statistic that does not depend on the nuisance parameter. Furthermore, we compare the performance of these methods via simulation studies. The simulation results showed that the modified maximum contrast method gave the lowest false-positive rate; therefore, this method is powerful for detecting the true response patterns in some conditions. Further, it is faster and more accurate than the permuted modified maximum contrast method. On the basis of these results, we suggest a rule of thumb to select the appropriate method in a given situation.


title: NCGNN: Node-Level Capsule Graph Neural Network for Semisupervised Classification

abstract: Message passing has evolved as an effective tool for designing Graph Neural Networks (GNNs). However, most existing methods for message passing simply sum or average all the neighboring features to update node representations. They are restricted by two problems, i.e., (i) lack of interpretability to identify node features significant to the prediction of GNNs, and (ii) feature over-mixing that leads to the over-smoothing issue in capturing long-range dependencies and inability to handle graphs under heterophily or low homophily. In this paper, we propose a Node-level Capsule Graph Neural Network (NCGNN) to address these problems with an improved message passing scheme. Specifically, NCGNN represents nodes as groups of node-level capsules, in which each capsule extracts distinctive features of its corresponding node. For each node-level capsule, a novel dynamic routing procedure is developed to adaptively select appropriate capsules for aggregation from a subgraph identified by the designed graph filter. NCGNN aggregates only the advantageous capsules and restrains irrelevant messages to avoid over-mixing features of interacting nodes. Therefore, it can relieve the over-smoothing issue and learn effective node representations over graphs with homophily or heterophily. Furthermore, our proposed message passing scheme is inherently interpretable and exempt from complex post-hoc explanations, as the graph filter and the dynamic routing procedure identify a subset of node features that are most significant to the model prediction from the extracted subgraph. Extensive experiments on synthetic as well as real-world graphs demonstrate that NCGNN can well address the over-smoothing issue and produce better node representations for semisupervised node classification. It outperforms the state of the arts under both homophily and heterophily.


title: Document Graph for Neural Machine Translation

abstract: Previous works have shown that contextual information can improve the performance of neural machine translation (NMT). However, most existing document-level NMT methods only consider a few number of previous sentences. How to make use of the whole document as global contexts is still a challenge. To address this issue, we hypothesize that a document can be represented as a graph that connects relevant contexts regardless of their distances. We employ several types of relations, including adjacency, syntactic dependency, lexical consistency, and coreference, to construct the document graph. Then, we incorporate both source and target graphs into the conventional Transformer architecture with graph convolutional networks. Experiments on various NMT benchmarks, including IWSLT English--French, Chinese-English, WMT English--German and Opensubtitle English--Russian, demonstrate that using document graphs can significantly improve the translation quality. Extensive analysis verifies that the document graph is beneficial for capturing discourse phenomena.


title: Multi-Instrumentalist Net: Unsupervised Generation of Music from Body Movements

abstract: We propose a novel system that takes as an input body movements of a musician playing a musical instrument and generates music in an unsupervised setting. Learning to generate multi-instrumental music from videos without labeling the instruments is a challenging problem. To achieve the transformation, we built a pipeline named 'Multi-instrumentalistNet' (MI Net). At its base, the pipeline learns a discrete latent representation of various instruments music from log-spectrogram using a Vector Quantized Variational Autoencoder (VQ-VAE) with multi-band residual blocks. The pipeline is then trained along with an autoregressive prior conditioned on the musician's body keypoints movements encoded by a recurrent neural network. Joint training of the prior with the body movements encoder succeeds in the disentanglement of the music into latent features indicating the musical components and the instrumental features. The latent space results in distributions that are clustered into distinct instruments from which new music can be generated. Furthermore, the VQ-VAE architecture supports detailed music generation with additional conditioning. We show that a Midi can further condition the latent space such that the pipeline will generate the exact content of the music being played by the instrument in the video. We evaluate MI Net on two datasets containing videos of 13 instruments and obtain generated music of reasonable audio quality, easily associated with the corresponding instrument, and consistent with the music audio content.


title: Integration of Few Body Celestial Systems Implementing Explicit Numerical Methods

abstract: The $N$-body problem is of historical significance because it was the first implementation of the Newtonian dynamical laws for the description of our Solar System. Motivated by this, the project's goal is to revisit this problem for small $N$ and find a solution for the trajectories of specific two-body and three-body configurations as well as the planetary orbits of our Solar System using a fourth order Runge-Kutta explicit iterative method. We find an adequate agreement in our results with planetary trajectories found online.


title: Meta Ordinal Regression Forest For Learning with Unsure Lung Nodules

abstract: Deep learning-based methods have achieved promising performance in early detection and classification of lung nodules, most of which discard unsure nodules and simply deal with a binary classification -- malignant vs benign. Recently, an unsure data model (UDM) was proposed to incorporate those unsure nodules by formulating this problem as an ordinal regression, showing better performance over traditional binary classification. To further explore the ordinal relationship for lung nodule classification, this paper proposes a meta ordinal regression forest (MORF), which improves upon the state-of-the-art ordinal regression method, deep ordinal regression forest (DORF), in three major ways. First, MORF can alleviate the biases of the predictions by making full use of deep features while DORF needs to fix the composition of decision trees before training. Second, MORF has a novel grouped feature selection (GFS) module to re-sample the split nodes of decision trees. Last, combined with GFS, MORF is equipped with a meta learning-based weighting scheme to map the features selected by GFS to tree-wise weights while DORF assigns equal weights for all trees. Experimental results on the LIDC-IDRI dataset demonstrate superior performance over existing methods, including the state-of-the-art DORF.


title: BinArray: A Scalable Hardware Accelerator for Binary Approximated CNNs

abstract: Deep Convolutional Neural Networks (CNNs) have become state-of-the art for computer vision and other signal processing tasks due to their superior accuracy. In recent years, large efforts have been made to reduce the computational costs of CNNs in order to achieve real-time operation on low-power embedded devices. Towards this goal we present BinArray, a custom hardware accelerator for CNNs with binary approximated weights. The binary approximation used in this paper is an improved version of a network compression technique initially suggested in [1]. It drastically reduces the number of multiplications required per inference with no or very little accuracy degradation. BinArray easily scales and allows to compromise between hardware resource usage and throughput by means of three design parameters transparent to the user. Furthermore, it is possible to select between high accuracy or throughput dynamically during runtime. BinArray has been optimized at the register transfer level and operates at 400 MHz as instruction-set processor within a heterogenous XC7Z045-2 FPGA-SoC platform. Experimental results show that BinArray scales to match the performance of other accelerators like EdgeTPU [2] for different network sizes. Even for the largest MobileNet only 50% of the target device and only 96 DSP blocks are utilized.


title: Rethinking Learnable Tree Filter for Generic Feature Transform

abstract: The Learnable Tree Filter presents a remarkable approach to model structure-preserving relations for semantic segmentation. Nevertheless, the intrinsic geometric constraint forces it to focus on the regions with close spatial distance, hindering the effective long-range interactions. To relax the geometric constraint, we give the analysis by reformulating it as a Markov Random Field and introduce a learnable unary term. Besides, we propose a learnable spanning tree algorithm to replace the original non-differentiable one, which further improves the flexibility and robustness. With the above improvements, our method can better capture long-range dependencies and preserve structural details with linear complexity, which is extended to several vision tasks for more generic feature transform. Extensive experiments on object detection/instance segmentation demonstrate the consistent improvements over the original version. For semantic segmentation, we achieve leading performance (82.1% mIoU) on the Cityscapes benchmark without bells-and-whistles. Code is available at https://github.com/StevenGrove/LearnableTreeFilterV2.


title: Learning to Separate Clusters of Adversarial Representations for Robust Adversarial Detection

abstract: Although deep neural networks have shown promising performances on various tasks, they are susceptible to incorrect predictions induced by imperceptibly small perturbations in inputs. A large number of previous works proposed to detect adversarial attacks. Yet, most of them cannot effectively detect them against adaptive whitebox attacks where an adversary has the knowledge of the model and the defense method. In this paper, we propose a new probabilistic adversarial detector motivated by a recently introduced non-robust feature. We consider the non-robust features as a common property of adversarial examples, and we deduce it is possible to find a cluster in representation space corresponding to the property. This idea leads us to probability estimate distribution of adversarial representations in a separate cluster, and leverage the distribution for a likelihood based adversarial detector.


title: Detailed investigation on the possibility of using EJ-299-33A plastic scintillator for fast neutron spectroscopy in large scale experiments

abstract: Detailed characterization of the newly available plastic scintillator (EJ-299-33A) having the pulse shape discrimination (PSD) property has been carried out in case of a large-sized detector (5 in.$\times$5 in.). The pulse height response of the scintillator for nearly mono-energetic neutrons has been reported in case of neutron energies E$_n$ =3, 6 and 9 MeV. Important properties (figure-of-merit (FOM), time resolution, detection efficiency) of the detector has been compared with a commonly used liquid organic scintillator based detector of the same size coupled to the same PMT for uniformity in comparison. The results show that the plastic scintillator detector has about 12$\%$ better time resolution. However, the FOM and detection efficiency were found to be lower than that of the liquid scintillator detector by 40 - 50$\%$ and $\sim $25$\%$, respectively. The possibility of using the new plastic scintillator in large-scale nuclear physics experiments has been pointed out.


title: A multi-agent evolutionary robotics framework to train spiking neural networks

abstract: A novel multi-agent evolutionary robotics (ER) based framework, inspired by competitive evolutionary environments in nature, is demonstrated for training Spiking Neural Networks (SNN). The weights of a population of SNNs along with morphological parameters of bots they control in the ER environment are treated as phenotypes. Rules of the framework select certain bots and their SNNs for reproduction and others for elimination based on their efficacy in capturing food in a competitive environment. While the bots and their SNNs are given no explicit reward to survive or reproduce via any loss function, these drives emerge implicitly as they evolve to hunt food and survive within these rules. Their efficiency in capturing food as a function of generations exhibit the evolutionary signature of punctuated equilibria. Two evolutionary inheritance algorithms on the phenotypes, Mutation and Crossover with Mutation, are demonstrated. Performances of these algorithms are compared using ensembles of 100 experiments for each algorithm. We find that Crossover with Mutation promotes 40% faster learning in the SNN than mere Mutation with a statistically significant margin.


title: Asymptotic Normality for Multivariate Random Forest Estimators

abstract: Regression trees and random forests are popular and effective non-parametric estimators in practical applications. A recent paper by Athey and Wager shows that the random forest estimate at any point is asymptotically Gaussian; in this paper, we extend this result to the multivariate case and show that the vector of estimates at multiple points is jointly normal. Specifically, the covariance matrix of the limiting normal distribution is diagonal, so that the estimates at any two points are independent in sufficiently deep trees. Moreover, the off-diagonal term is bounded by quantities capturing how likely two points belong to the same partition of the resulting tree. Our results relies on certain a certain stability property when constructing splits, and we give examples of splitting rules for which this assumption is and is not satisfied. We test our proposed covariance bound and the associated coverage rates of confidence intervals in numerical simulations.


title: An Approach to Intelligent Pneumonia Detection and Integration

abstract: Each year, over 2.5 million people, most of them in developed countries, die from pneumonia [1]. Since many studies have proved pneumonia is successfully treatable when timely and correctly diagnosed, many of diagnosis aids have been developed, with AI-based methods achieving high accuracies [2]. However, currently, the usage of AI in pneumonia detection is limited, in particular, due to challenges in generalizing a locally achieved result. In this report, we propose a roadmap for creating and integrating a system that attempts to solve this challenge. We also address various technical, legal, ethical, and logistical issues, with a blueprint of possible solutions.


title: Multi-agent Policy Optimization with Approximatively Synchronous Advantage Estimation

abstract: Cooperative multi-agent tasks require agents to deduce their own contributions with shared global rewards, known as the challenge of credit assignment. General methods for policy based multi-agent reinforcement learning to solve the challenge introduce differentiate value functions or advantage functions for individual agents. In multi-agent system, polices of different agents need to be evaluated jointly. In order to update polices synchronously, such value functions or advantage functions also need synchronous evaluation. However, in current methods, value functions or advantage functions use counter-factual joint actions which are evaluated asynchronously, thus suffer from natural estimation bias. In this work, we propose the approximatively synchronous advantage estimation. We first derive the marginal advantage function, an expansion from single-agent advantage function to multi-agent system. Further more, we introduce a policy approximation for synchronous advantage estimation, and break down the multi-agent policy optimization problem into multiple sub-problems of single-agent policy optimization. Our method is compared with baseline algorithms on StarCraft multi-agent challenges, and shows the best performance on most of the tasks.


title: The estimate of lifespan and local well-posedness for the non-resistive MHD equations in homogeneous Besov spaces

abstract: In this paper, we mainly investigate the Cauchy problem of the non-resistive MHD equation. We first establish the local existence in the homogeneous Besov space $\dot{B}^{\frac{d}{p}-1}_{p,1}\times \dot{B}^{\frac{d}{p}}_{p,1}$ with $p<\infty$, and give a lifespan $T$ of the solution which depends on the norm of the Littlewood-Paley decomposition of the initial data. Then, we prove that if the initial data $(u^n_0,b^n_0)\rightarrow (u_0,b_0)$ in $\dot{B}^{\frac{d}{p}-1}_{p,1}\times \dot{B}^{\frac{d}{p}}_{p,1}$, then the corresponding existence times $T_n\rightarrow T$, which implies that they have a common lower bound of the lifespan. Finally, we prove that the data-to-solutions map depends continuously on the initial data when $p\leq 2d$. Therefore the non-resistive MHD equation is local well-posedness in the homogeneous Besov space in the Hadamard sense. Our obtained result improves considerably the recent results in \cite{Li1,chemin1,Feffer2}.


title: Generative Adversarial Network based Heuristics for Sampling-based Path Planning

abstract: Sampling-based path planning is a popular methodology for robot path planning. With a uniform sampling strategy to explore the state space, a feasible path can be found without the complex geometric modeling of the configuration space. However, the quality of initial solution is not guaranteed and the convergence speed to the optimal solution is slow. In this paper, we present a novel image-based path planning algorithm to overcome these limitations. Specifically, a generative adversarial network (GAN) is designed to take the environment map (denoted as RGB image) as the input without other preprocessing works. The output is also an RGB image where the promising region (where a feasible path probably exists) is segmented. This promising region is utilized as a heuristic to achieve nonuniform sampling for the path planner. We conduct a number of simulation experiments to validate the effectiveness of the proposed method, and the results demonstrate that our method performs much better in terms of the quality of initial solution and the convergence speed to the optimal solution. Furthermore, apart from the environments similar to the training set, our method also works well on the environments which are very different from the training set.


title: AI-enabled Prediction of eSports Player Performance Using the Data from Heterogeneous Sensors

abstract: The emerging progress of eSports lacks the tools for ensuring high-quality analytics and training in Pro and amateur eSports teams. We report on an Artificial Intelligence (AI) enabled solution for predicting the eSports player in-game performance using exclusively the data from sensors. For this reason, we collected the physiological, environmental, and the game chair data from Pro and amateur players. The player performance is assessed from the game logs in a multiplayer game for each moment of time using a recurrent neural network. We have investigated that attention mechanism improves the generalization of the network and provides the straightforward feature importance as well. The best model achieves ROC AUC score 0.73. The prediction of the performance of particular player is realized although his data are not utilized in the training set. The proposed solution has a number of promising applications for Pro eSports teams and amateur players, such as a learning tool or a performance monitoring system.


title: Causal Posterior Matching and its Applications

abstract: We consider the problem of communication over the binary symmetric channel with feedback, where the information sequence is made available in a causal, possibly random, fashion. We develop a real-time variant of the renowned Horstein scheme and provide analytical guarantees for its error-probability exponential decay rate. We further use the scheme to stabilize an unstable control plant over a binary symmetric channel and compare the analytical guarantees with its empirical performance as well as with those of anytime-reliable codes.


title: Tip-induced nano-engineering of strain, bandgap, and exciton dynamics in 2D semiconductors

abstract: The tunability of the bandgap, absorption and emission energies, photoluminescence (PL) quantum yield, exciton transport, and energy transfer in transition metal dichalcogenide (TMD) monolayers provides a new class of functions for a wide range of ultrathin photonic devices. Recent strain-engineering approaches have enabled us to tune some of these properties, yet dynamic control at the nanoscale with real-time and -space characterizations remains a challenge. Here, we demonstrate a dynamic nano-mechanical strain-engineering of naturally-formed wrinkles in a WSe2 monolayer, with real-time investigation of nano-spectroscopic properties using hyperspectral adaptive tip-enhanced PL (a-TEPL) spectroscopy. First, we characterize nanoscale wrinkles through hyperspectral a-TEPL nano-imaging with <15 nm spatial resolution which reveals the modified nano-excitonic properties by the induced tensile strain at the wrinkle apex, e.g., an increase in the quantum yield due to the exciton funneling, decrease in PL energy up to ~10 meV, and a symmetry change in the TEPL spectra caused by the reconfigured electronic bandstructure. We then dynamically engineer the local strain by pressing and releasing the wrinkle apex through an atomic force tip control. This nano-mechanical strain-engineering allows us to tune the exciton dynamics and emission properties at the nanoscale in a reversible fashion. In addition, we demonstrate a systematic switching and modulation platform of the wrinkle emission, which provides a new strategy for robust, tunable, and ultracompact nano-optical sources in atomically thin semiconductors.


title: Cancellation of One-loop Corrections to Scalar Masses in Flux Compactification with Higher Dimensional Operators

abstract: We further study the cancellation of the one-loop corrections to the scalar mass in a six dimensional SU(2) gauge theory with higher dimensional operators, which is compactified on a torus with magnetic flux. Higher dimensional operators also contribute to the corrections to the scalar mass nontrivially. We explicitly show by the diagrammatic calculations that the corrections are exactly cancelled even with the leading terms of the higher dimensional operators.


title: On/off switching of adhesion in gecko-inspired adhesives

abstract: In this study, the adhesion-detachment behaviour of a gecko-inspired adhesive pad was investigated to understand the on/off switching mechanisms of adhesion in gecko feet. A macroscopic spatula model was fabricated using silicone rubber, and adhesion tests combining lateral sliding and vertical debonding were conducted. It was observed that the contact state and the adhesion force of the pad vary considerably with the direction of lateral sliding prior to debonding, and that the pad achieves adhesion during debonding even when it loses contact due to excess lateral sliding. These results explain the mechanisms behind the on/off switching and stable adhesion of gecko feet, and suggest the possibility of developing new-generation adhesives capable of switchable adhesion.


title: Reachability in Controlled Markovian Quantum Systems: An Operator-Theoretic Approach

abstract: In quantum systems theory one of the fundamental problems boils down to: Given an initial state, which final states can be reached by the dynamic system in question? Formulated in the framework of bilinear control systems, the evolution shall be governed by an inevitable Hamiltonian drift term, finitely many control Hamiltonians allowing for (at least) piecewise constant control amplitudes, plus a (possibly bang-bang switchable) noise term in Kossakowski-Lindblad form. Now assuming switchable coupling of finite-dimensional systems to a thermal bath of arbitrary temperature, the core problem of reachability boils down to studying points in the standard simplex amenable to two types of controls that can be used interleaved: Permutations within the simplex, and contractions by a dissipative one-parameter semigroup. We illustrate how the solutions of the core problem pertain to the reachable set of the original controlled Markovian quantum system. This allows us to show that for global as well as local switchable coupling to a temperature-zero bath one can generate every quantum state from every initial state up to arbitrary precision. Moreover we present an inclusion for non-zero temperatures as a consequence of our results on d-majorization. Then we consider infinite-dimensional open quantum-dynamical systems following a unital Kossakowski-Lindblad master equation extended by controls. Here the drift Hamiltonian can be arbitrary, the finitely many control Hamiltonians are bounded, and the switchable noise term is generated by a single compact normal operator. Via new majorization results of ours, we show that such bilinear quantum control systems allow to approximately reach any target state majorized by the initial one, as up to now only has been known in finite-dimensional analogues.

categories: quant-ph math-ph math.FA math.MP math.OC


title: Dynamic structure factors of a strongly interacting Fermi superfluid near an orbital Feshbach resonance across the phase transition from BCS to Sarma superfluid

abstract: We theoretically investigate dynamic structure factors of a strongly interacting Fermi superfluid near an orbital Feshbach resonance with random phase approximation, and find their dynamical characters during the phase transition between a balanced conventional Bardeen-Cooper-Schrieffer superfluid and a polarized Sarma superfluid by continuously varying the chemical potential difference of two spin components. In a BEC-like regime of the BCS superfluid, dynamic structure factors can do help to distinguish the in-phase ground state from the out-of-phase metastable state by the relative location of molecular excitation and Leggett mode, or the minimum energy to break a Cooper pair. In the phase transition between BCS and Sarma superfluid, we find the dynamic structure factor of Sarma superfluid has its own specific gapless excitation at a small transferred momentum which is mixed with the collective phonon excitation, and also a relatively strong atomic excitation at a large transferred momentum because of the existence of unpaired Fermi atoms, these signals can be used to differentiate Sarma superfluid from BCS superfluid.


title: Cross-correlations as a Diagnostic Tool for Primordial Gravitational Waves

abstract: We explore and corroborate, by working out explicit examples, the effectiveness of cross-correlating stochastic gravitational wave background anisotropies with CMB temperature fluctuations as a way to establish the primordial nature of a given gravitational wave signal. We consider the case of gravitational wave anisotropies induced by scalar-tensor-tensor primordial non-Gaussianity. Our analysis spans anisotropies exhibiting different angular behaviours, including a quadrupolar dependence. We calculate the expected uncertainty on the non-linearity parameter $F_{\rm NL}$ obtained as a result of cross-correlation measurements for several proposed experiments such as the ground-based Einstein Telescope, Cosmic Explorer, and the space-based Big-Bang Observer. As a benchmark for future survey planning, we also calculate the theoretical, cosmic-variance-limited, error on the non-linearity parameter.


title: Interpretation of the quasiparticle plus triaxial rotor model

abstract: We discuss in depth the application of the classical concepts for interpreting the quantal results from the triaxial rotor core without and with odd-particle. The corresponding limitations caused by the discreteness and finiteness of the angular momentum Hilbert space and the extraction of the relevant features from the complex wave function and distributions of various angular momentum components are discussed in detail. New methods based on spin coherent states and spin squeezed states are introduced. It is demonstrated that the spin coherent state map is a powerful tool to visualize the angular momentum geometry of rotating nuclei. The topological nature of the concepts of transverse and longitudinal wobbling is clarified and the transitional axis-flipregime is analysed for the first time.


title: EfficientTTS: An Efficient and High-Quality Text-to-Speech Architecture

abstract: In this work, we address the Text-to-Speech (TTS) task by proposing a non-autoregressive architecture called EfficientTTS. Unlike the dominant non-autoregressive TTS models, which are trained with the need of external aligners, EfficientTTS optimizes all its parameters with a stable, end-to-end training procedure, while allowing for synthesizing high quality speech in a fast and efficient manner. EfficientTTS is motivated by a new monotonic alignment modeling approach (also introduced in this work), which specifies monotonic constraints to the sequence alignment with almost no increase of computation. By combining EfficientTTS with different feed-forward network structures, we develop a family of TTS models, including both text-to-melspectrogram and text-to-waveform networks. We experimentally show that the proposed models significantly outperform counterpart models such as Tacotron 2 and Glow-TTS in terms of speech quality, training efficiency and synthesis speed, while still producing the speeches of strong robustness and great diversity. In addition, we demonstrate that proposed approach can be easily extended to autoregressive models such as Tacotron 2.


title: Adaptive Local Bayesian Optimization Over Multiple Discrete Variables

abstract: In the machine learning algorithms, the choice of the hyperparameter is often an art more than a science, requiring labor-intensive search with expert experience. Therefore, automation on hyperparameter optimization to exclude human intervention is a great appeal, especially for the black-box functions. Recently, there have been increasing demands of solving such concealed tasks for better generalization, though the task-dependent issue is not easy to solve. The Black-Box Optimization challenge (NeurIPS 2020) required competitors to build a robust black-box optimizer across different domains of standard machine learning problems. This paper describes the approach of team KAIST OSI in a step-wise manner, which outperforms the baseline algorithms by up to +20.39%. We first strengthen the local Bayesian search under the concept of region reliability. Then, we design a combinatorial kernel for a Gaussian process kernel. In a similar vein, we combine the methodology of Bayesian and multi-armed bandit,(MAB) approach to select the values with the consideration of the variable types; the real and integer variables are with Bayesian, while the boolean and categorical variables are with MAB. Empirical evaluations demonstrate that our method outperforms the existing methods across different tasks.


title: Dialogue Discourse-Aware Graph Model and Data Augmentation for Meeting Summarization

abstract: Meeting summarization is a challenging task due to its dynamic interaction nature among multiple speakers and lack of sufficient training data. Existing methods view the meeting as a linear sequence of utterances while ignoring the diverse relations between each utterance. Besides, the limited labeled data further hinders the ability of data-hungry neural models. In this paper, we try to mitigate the above challenges by introducing dialogue-discourse relations. First, we present a Dialogue Discourse-Dware Meeting Summarizer (DDAMS) to explicitly model the interaction between utterances in a meeting by modeling different discourse relations. The core module is a relational graph encoder, where the utterances and discourse relations are modeled in a graph interaction manner. Moreover, we devise a Dialogue Discourse-Aware Data Augmentation (DDADA) strategy to construct a pseudo-summarization corpus from existing input meetings, which is 20 times larger than the original dataset and can be used to pretrain DDAMS. Experimental results on AMI and ICSI meeting datasets show that our full system can achieve SOTA performance. Our codes will be available at: https://github.com/xcfcode/DDAMS.


title: Block majorization-minimization with diminishing radius for constrained nonconvex optimization

abstract: Block majorization-minimization (BMM) is a simple iterative algorithm for nonconvex constrained optimization that sequentially minimizes majorizing surrogates of the objective function in each block coordinate while the other coordinates are held fixed. BMM entails a large class of optimization algorithms such as block coordinate descent and its proximal-point variant, expectation-minimization, and block projected gradient descent. We establish that for general constrained nonconvex optimization, BMM with strongly convex surrogates can produce an $\epsilon$-stationary point within $O(\epsilon^{-2}(\log \epsilon^{-1})^{2})$ iterations and asymptotically converges to the set of stationary points. Furthermore, we propose a trust-region variant of BMM that can handle surrogates that are only convex and still obtain the same iteration complexity and asymptotic stationarity. These results hold robustly even when the convex sub-problems are inexactly solved as long as the optimality gaps are summable. As an application, we show that a regularized version of the celebrated multiplicative update algorithm for nonnegative matrix factorization by Lee and Seung has iteration complexity of $O(\epsilon^{-2}(\log \epsilon^{-1})^{2})$. The same result holds for a wide class of regularized nonnegative tensor decomposition algorithms as well as the classical block projected gradient descent algorithm. These theoretical results are validated through various numerical experiments.


title: All-optical helicity-independent switching state diagram in GdFeCo alloys

abstract: Ultra-fast magnetization switching induced by a single femtosecond laser pulse, under no applied magnetic field has attracted a lot of attention during the last 10 years because of its high potential for low energy and ultra-fast memory applications. Single-pulse helicity-independent switching has mostly been demonstrated for Gd based materials. It is now important to optimize the pulse duration and the energy needed to switch a GdFeCo magnet depending on the alloy thickness, concentration. Here we experimentally report state diagrams showing the magnetic state obtained after one single pulse depending on the laser pulse duration and fluence for various GdFeCo thin films with different compositions and thicknesses. We demonstrate that these state diagrams share similar characteristics: the fluence window for switching narrows for longer pulse duration and for the considered pulse duration range the critical fluence for single pulse switching increases linearly as a function of the pulse duration while the critical fluence required for creating a multidomain state remains almost constant. Calculations based on the atomistic spin model qualitatively reproduce the experimental state diagrams and their evolution. By studying the effect of the composition and the thickness on the state diagram, we demonstrated that the best energy efficiency and the longest pulse duration for switching are obtained for concentration around the magnetic compensation.


title: An update on the development of ASPIRED

abstract: We are reporting the updates in version 0.2.0 of the Automated SpectroPhotometric REDuction (ASPIRED) pipeline, designed for common use on different instruments. The default settings support many typical long-slit spectrometer configurations, whilst it also offers a flexible set of functions for users to refine and tailor-make their automated pipelines to an instrument's individual characteristics. Such automation provides near real-time data reduction to allow adaptive observing strategies, which is particularly important in the Time Domain Astronomy. Over the course of last year, significant improvement was made in the internal data handling as well as data I/O, accuracy and repeatability in the wavelength calibration.


title: Dynamic Structure Learning through Graph Neural Network for Forecasting Soil Moisture in Precision Agriculture

abstract: Soil moisture is an important component of precision agriculture as it directly impacts the growth and quality of vegetation. Forecasting soil moisture is essential to schedule the irrigation and optimize the use of water. Physics based soil moisture models need rich features and heavy computation which is not scalable. In recent literature, conventional machine learning models have been applied for this problem. These models are fast and simple, but they often fail to capture the spatio-temporal correlation that soil moisture exhibits over a region. In this work, we propose a novel graph neural network based solution that learns temporal graph structures and forecast soil moisture in an end-to-end framework. Our solution is able to handle the problem of missing ground truth soil moisture which is common in practice. We show the merit of our algorithm on real-world soil moisture data.


title: Design of an EEG-based Drone Swarm Control System using Endogenous BCI Paradigms

abstract: Non-invasive brain-computer interface (BCI) has been developed for understanding users' intentions by using electroencephalogram (EEG) signals. With the recent development of artificial intelligence, there have been many developments in the drone control system. BCI characteristic that can reflect the users' intentions led to the BCI-based drone control system. When using drone swarm, we can have more advantages, such as mission diversity, than using a single drone. In particular, BCI-based drone swarm control could provide many advantages to various industries such as military service or industry disaster. BCI Paradigms consist of the exogenous and endogenous paradigms. The endogenous paradigms can operate with the users' intentions independently of any stimulus. In this study, we designed endogenous paradigms (i.e., motor imagery (MI), visual imagery (VI), and speech imagery (SI)) specialized in drone swarm control, and EEG-based various task classifications related to drone swarm control were conducted. Five subjects participated in the experiment and the performance was evaluated using the basic machine learning algorithm. The grand-averaged accuracies were 51.1%, 53.2%, and 41.9% in MI, VI, and SI, respectively. Hence, we confirmed the feasibility of increasing the degree of freedom for drone swarm control using various endogenous paradigms.


title: Characteristic Sensitivity of Turbulent Flow within a Porous Medium under Initial Conditions

abstract: Flows within porous media play important roles in many scientific and industrial systems. However, the case wherein such flows become turbulent has not been completely understood, particularly, from a mathematical viewpoint. In this study, the $k-\varepsilon$ model (the variable $k$ denotes the turbulent kinetic energy per unit mass and $\varepsilon$ the dissipation rate for the turbulent kinetic energy), which has been widely used for the usual turbulent flow in a clear fluid, was applied to a turbulent flow through porous media. If a homogeneous, averaged flow and homogeneous isotropic turbulence are assumed, the governing equations for the variables $k$ and $\varepsilon$ describe a straight line as a nullcline common to both the variables. The nullcline was shown to be a line attractor. A temporal evolution of the eddy viscosity was also obtained, and the initial and final values of the eddy viscosity were observed to be related to a power law, indicating universal sensitivity. This sensitivity originates from the common nullcline and is not observed for the usual turbulent flow. Finally, nonlinear mathematical and seismological implications were provided using based on the results obtained.


title: STSIR: Spatial Temporal Pandemic Model with Mobility Data

abstract: With the outbreak of COVID-19, how to mitigate and suppress its spread is a big issue to the government. Department of public health need powerful models to model and predict the trend and scale of such pandemic. And models that could evaluate the effect of the public policy are also essential to the fight with the COVID-19. A main limitation of existing models is that they can only evaluate the policy by calculating $R_0$ after infection happens instead of giving observable index. To tackle this, based on the transmission character of the COVID-19, we preposed a novel framework Spatial-Temporal-Susceptible-Infected-Removed (STSIR) model. In particular, we merged both intra-city and inter-city mobility index with the traditional SIR dynamics and make it a dynamic system. And we proved that the STSIR system is a closed system which makes the system self-consistent. And finally we proposed a Multi-Stage Simulated Annealing (MSSA) algorithm to find optimal parameter of the system. In our experiments, based on Baidu Mobility dataset, and China pandemic dataset provided by Dingxiangyuan, our model can effectively predict the total scale of the pandemic and also gives clear policy analysis with observable index.


title: Predicting the Transition from Short-term to Long-term Memory based on Deep Neural Network

abstract: Memory is an essential element in people's daily life based on experience. So far, many studies have analyzed electroencephalogram (EEG) signals at encoding to predict later remembered items, but few studies have predicted long-term memory only with EEG signals of successful short-term memory. Therefore, we aim to predict long-term memory using deep neural networks. In specific, the spectral power of the EEG signals of remembered items in short-term memory was calculated and inputted to the multilayer perceptron (MLP) and convolutional neural network (CNN) classifiers to predict long-term memory. Seventeen participants performed visuo-spatial memory task consisting of picture and location memory in the order of encoding, immediate retrieval (short-term memory), and delayed retrieval (long-term memory). We applied leave-one-subject-out cross-validation to evaluate the predictive models. As a result, the picture memory showed the highest kappa-value of 0.19 on CNN, and location memory showed the highest kappa-value of 0.32 in MLP. These results showed that long-term memory can be predicted with measured EEG signals during short-term memory, which improves learning efficiency and helps people with memory and cognitive impairments.


title: Identification of Cosmic Voids as Massive Cluster Counterparts

abstract: We develop a method to identify cosmic voids from the matter density field by adopting a physically-motivated concept that voids are the counterpart of massive clusters. To prove the concept we use a pair of $\Lambda$CDM simulations, a reference and its initial density-inverted mirror simulation, and study the relation between the effective size of voids and the mass of corresponding clusters. Galaxy cluster-scale dark matter halos are identified in the Mirror simulation at $z=0$ by linking dark matter particles. The void corresponding to each cluster is defined in the Reference simulation as the region occupied by the member particles of the cluster. We study the voids corresponding to the halos more massive than $10^{13}h^{-1}M_{\odot}$. We find a power-law scaling relation between the void size and the corresponding cluster mass. Voids with corresponding cluster mass above $10^{15}h^{-1}M_{\odot}$ occupy $\sim1\%$ of the total simulated volume, whereas this fraction increases to $\sim54\%$ for voids with corresponding cluster mass above $10^{13}h^{-1}M_{\odot}$. It is also found that the density profile of the identified voids follows a universal functional form. Based on these findings, we propose a method to identify cluster-counterpart voids directly from the matter density field without their mirror information by utilizing three parameters such as the smoothing scale, density threshold, and minimum core fraction. We recover voids corresponding to clusters more massive than $3\times10^{14}h^{-1}M_{\odot}$ at 70--74 \% level of completeness and reliability. Our results suggest that we are able to identify voids in a way to associate them with clusters of a particular mass-scale.


title: The Fictitious Domain Method Based on Navier Slip Boundary Condition for Simulation of Flow-Particle Interaction

abstract: In this article, we develop a least--squares/fictitious domain method for direct simulation of fluid particle motion with Navier slip boundary condition at the fluid--particle interface. Let $\Omega$ and $B$ be two bounded domains of $\mathbb{R}^{d}$ such that $\overline{B} \subset \Omega$. The motion of solid particle $B$ is governed by Newton's equations. Our goal here is to develop a fictitious domain method where one solves a variant of the original problem on the full $\Omega$, followed by a well--chosen correction over $B$ and corrections related to translation velocity and angular velocity of the particle. This method is of the virtual control type and relies on a least--squares formulation making the problem solvable by a conjugate gradient algorithm operating in a well chosen control space. Since the fully explicit scheme to update the particle motion using Newton's equation is unstable, we propose and implement an explicit--implicit scheme in which, at each time step, the position of the particle is updated explicitly, and the solution of Navier-Stokes equations and particle velocities are solved by the the least--squares/fictitious domain method implicitly. Numerical results are given to verify our numerical method.


title: Adaptive Deep Learning for Entity Resolution by Risk Analysis

abstract: The state-of-the-art performance on entity resolution (ER) has been achieved by deep learning. However, deep models are usually trained on large quantities of accurately labeled training data, and can not be easily tuned towards a target workload. Unfortunately, in real scenarios, there may not be sufficient labeled training data, and even worse, their distribution is usually more or less different from the target workload even when they come from the same domain. To alleviate the said limitations, this paper proposes a novel risk-based approach to tune a deep model towards a target workload by its particular characteristics. Built on the recent advances on risk analysis for ER, the proposed approach first trains a deep model on labeled training data, and then fine-tunes it by minimizing its estimated misprediction risk on unlabeled target data. Our theoretical analysis shows that risk-based adaptive training can correct the label status of a mispredicted instance with a fairly good chance. We have also empirically validated the efficacy of the proposed approach on real benchmark data by a comparative study. Our extensive experiments show that it can considerably improve the performance of deep models. Furthermore, in the scenario of distribution misalignment, it can similarly outperform the state-of-the-art alternative of transfer learning by considerable margins. Using ER as a test case, we demonstrate that risk-based adaptive training is a promising approach potentially applicable to various challenging classification tasks.


title: Wormholes and holographic decoherence

abstract: We study a class of decoherence process which admits a 3 dimensional holographic bulk. Starting from a thermo-field double dual to a wormhole, we prepare another thermo-field double which plays the role of environment. By allowing the energy flow between the original and environment thermo-field double, the entanglement of the original thermo-field double eventually decoheres. We model this decoherence by four-boundary wormhole geometries, and study the time-evolution of the moduli parameters to see the change of the entanglement pattern among subsystems. A notable feature of this holographic decoherence processes is that at the end point of the processes, the correlations of the original thermo-field double are lost completely both classically and also quantum mechanically. We also discuss distinguishability between thermo-field double state and thermo mixed double state, which contains only classical correlations, and construct a code subspace toy model for that.


title: Fine-grained Angular Contrastive Learning with Coarse Labels

abstract: Few-shot learning methods offer pre-training techniques optimized for easier later adaptation of the model to new classes (unseen during training) using one or a few examples. This adaptivity to unseen classes is especially important for many practical applications where the pre-trained label space cannot remain fixed for effective use and the model needs to be "specialized" to support new categories on the fly. One particularly interesting scenario, essentially overlooked by the few-shot literature, is Coarse-to-Fine Few-Shot (C2FS), where the training classes (e.g. animals) are of much `coarser granularity' than the target (test) classes (e.g. breeds). A very practical example of C2FS is when the target classes are sub-classes of the training classes. Intuitively, it is especially challenging as (both regular and few-shot) supervised pre-training tends to learn to ignore intra-class variability which is essential for separating sub-classes. In this paper, we introduce a novel 'Angular normalization' module that allows to effectively combine supervised and self-supervised contrastive pre-training to approach the proposed C2FS task, demonstrating significant gains in a broad study over multiple baselines and datasets. We hope that this work will help to pave the way for future research on this new, challenging, and very practical topic of C2FS classification.


title: A Singular Value Perspective on Model Robustness

abstract: Convolutional Neural Networks (CNNs) have made significant progress on several computer vision benchmarks, but are fraught with numerous non-human biases such as vulnerability to adversarial samples. Their lack of explainability makes identification and rectification of these biases difficult, and understanding their generalization behavior remains an open problem. In this work we explore the relationship between the generalization behavior of CNNs and the Singular Value Decomposition (SVD) of images. We show that naturally trained and adversarially robust CNNs exploit highly different features for the same dataset. We demonstrate that these features can be disentangled by SVD for ImageNet and CIFAR-10 trained networks. Finally, we propose Rank Integrated Gradients (RIG), the first rank-based feature attribution method to understand the dependence of CNNs on image rank.


title: Cosmological solutions in Einstein-Gauss-Bonnet gravity with static curved extra dimensions

abstract: In this paper we perform systematic investigation of all possible solutions with static compact extra dimensions and expanding three-dimensional subspace (``our Universe''). Unlike previous papers, we consider extra-dimensional subspace to be constant-curvature manifold with both signs of spatial curvature. We provide a scheme how to build solutions in all possible number of extra dimensions and perform stability analysis for the solutions found. Our study suggests that the solutions with negative spatial curvature of extra dimensions are always stable while those with positive curvature are stable for a narrow range of the parameters and the width of this range shrinks with growth of the number of extra dimensions. This explains why in the previous papers we detected compactification in the case of negative curvature but the case of positive curvature remained undiscovered. Another interesting feature which distinguish cases with positive and negative curvatures is that the latter do not coexist with maximally-symmetric solutions (leading to ``geometric frustration'' of a sort) while the former could -- this difference is noted and discussed.


title: Generation and propagation of an open vortex beam

abstract: We theoretically and experimentally studied a novel class of vortex beams named open vortex beams (OVBs). Such beams are generated using Gaussian beams diffracted by partially blocked fork-shaped gratings (PB-FSGs).The analytical model of OVBs in the near field and far field is given by superpositions of Hypergeometric (HyG) modes. Unlike conventional integer and fractional vortex beams, the OVBs can have both an open ring structure and an integer topological charge (TC). The TC is decided by the circumference covered by the open ring. It is also quantitatively shown that a $\pi/2$ rotation of the open ring occurs in the propagation of an OVB due to the Gouy phase shift. Futhermore, we demonstrate experimental generation and detection of OVBs. Our experimental results are in very good agreement with the theory. We believe that the OVB can be the potential candidate for numerous applications, such as particle manipulation, quantum information and optical metrology.


title: Fine-Grained Dynamic Head for Object Detection

abstract: The Feature Pyramid Network (FPN) presents a remarkable approach to alleviate the scale variance in object representation by performing instance-level assignments. Nevertheless, this strategy ignores the distinct characteristics of different sub-regions in an instance. To this end, we propose a fine-grained dynamic head to conditionally select a pixel-level combination of FPN features from different scales for each instance, which further releases the ability of multi-scale feature representation. Moreover, we design a spatial gate with the new activation function to reduce computational complexity dramatically through spatially sparse convolutions. Extensive experiments demonstrate the effectiveness and efficiency of the proposed method on several state-of-the-art detection benchmarks. Code is available at https://github.com/StevenGrove/DynamicHead.


title: Functional Connectivity of Imagined Speech and Visual Imagery based on Spectral Dynamics

abstract: Recent advances in brain-computer interface technology have shown the potential of imagined speech and visual imagery as a robust paradigm for intuitive brain-computer interface communication. However, the internal dynamics of the two paradigms along with their intrinsic features haven't been revealed. In this paper, we investigated the functional connectivity of the two paradigms, considering various frequency ranges. The dataset of sixteen subjects performing thirteen-class imagined speech and visual imagery were used for the analysis. The phase-locking value of imagined speech and visual imagery was analyzed in seven cortical regions with four frequency ranges. We compared the functional connectivity of imagined speech and visual imagery with the resting state to investigate the brain alterations during the imagery. The phase-locking value in the whole brain region exhibited a significant decrease during both imagined speech and visual imagery. Broca and Wernicke's area along with the auditory cortex mainly exhibited a significant decrease in the imagined speech, and the prefrontal cortex and the auditory cortex have shown a significant decrease in the visual imagery paradigm. Further investigation on the brain connectivity along with the decoding performance of the two paradigms may play a crucial role as a performance predictor.


title: Engaging Software Engineering Students in Grading: The effects of peer assessment on self-evaluation, motivation, and study time

abstract: Peer assessment is a popular technique for a more fine-grained evaluation of individual students in group projects. Its effect on the evaluation is well studied. However, its effects on the learning abilities of students are often overlooked. In this paper, we explore self-evaluation, motivation, and study time of students in relation to peer assessment, as part of an ongoing project at our local Faculty of Engineering Technology. The aggregated measurements of two years so far show that: (1) students get much better at evaluating their own project on some, but not all, of the evaluation criteria after a peer assessment session, (2) students report in a follow-up survey that they are more motivated to work on their project, and (3) the relation between motivation and time spent on the project increases. These results suggest that peer grading could have positive long-term effects on the reflective, and therefore lifelong learning, skills of students. A better understanding of the evaluation criteria results in more accurate self and peer grades, emphasizing the importance of properly defining and communicating these criteria throughout the semester.


title: Online Model Selection: a Rested Bandit Formulation

abstract: Motivated by a natural problem in online model selection with bandit information, we introduce and analyze a best arm identification problem in the rested bandit setting, wherein arm expected losses decrease with the number of times the arm has been played. The shape of the expected loss functions is similar across arms, and is assumed to be available up to unknown parameters that have to be learned on the fly. We define a novel notion of regret for this problem, where we compare to the policy that always plays the arm having the smallest expected loss at the end of the game. We analyze an arm elimination algorithm whose regret vanishes as the time horizon increases. The actual rate of convergence depends in a detailed way on the postulated functional form of the expected losses. Unlike known model selection efforts in the recent bandit literature, our algorithm exploits the specific structure of the problem to learn the unknown parameters of the expected loss function so as to identify the best arm as quickly as possible. We complement our analysis with a lower bound, indicating strengths and limitations of the proposed solution.


title: Wro\'nskian algebra and Broadhurst-Roberts quadratic relations

abstract: Through algebraic manipulations on Wro\'nskian matrices whose entries are reducible to Bessel moments, we present a new analytic proof of the quadratic relations conjectured by Broadhurst and Roberts, along with some generalizations. In the Wro\'nskian framework, we reinterpret the de Rham intersection pairing through polynomial coefficients in Vanhove's differential operators, and compute the Betti intersection pairing via linear sum rules for on-shell and off-shell Feynman diagrams at threshold momenta. From the ideal generated by Broadhurst--Roberts quadratic relations, we derive new non-linear sum rules for on-shell Feynman diagrams, including an infinite family of determinant identities that are compatible with Deligne's conjectures for critical values of motivic $L$-functions.


title: The Hausdorff measure of the range and level sets of Gaussian random fields with sectorial local nondeterminism

abstract: We determine the exact Hausdorff measure functions for the range and level sets of a class of Gaussian random fields satisfying sectorial local nondeterminism and other assumptions. We also establish a Chung-type law of the iterated logarithm. The results can be applied to the Brownian sheet, fractional Brownian sheets whose Hurst indices are the same in all directions, and systems of linear stochastic wave equations in one spatial dimension driven by space-time white noise or colored noise.


title: Towards the simplest simulation of incompressible viscous flows inspired by the lattice Boltzmann method

abstract: The lattice Boltzmann method (LBM) has gained increasing popularity in incompressible viscous flow simulations, but it uses many more variables than necessary. This defect was overcome by a recent approach that solves the more actual macroscopic equations obtained through Taylor series expansion analysis of the lattice Boltzmann equations [Lu et al., J. Comp. Phys., 415, 109546 (2020)]. The key is to keep some small additional terms (SATs) to stabilize the numerical solution of the weakly compressible Navier-Stokes equations. However, there are many SATs that complicate the implementation of their method. Based on some analyses and numerous tests, we ultimately pinpoint two essential ingredients for stable simulations: (1) suitable density (pressure) diffusion added to the continuity equation; (2) proper numerical dissipation related to the velocity divergence added to the momentum equations. Then, we propose a simplified method that is not only easier to implement but noticeably faster than the original method and the LBM. It contains much simpler SATs that only involve the density (pressure) derivatives and it requires no intermediate steps or variables. Besides, it is extended for two-phase flows with uniform density and viscosity. Several test cases, including some two-phase problems under two dimensional, axisymmetric and three dimensional geometries, are presented to demonstrate its capability. This work may help pave the way for the simplest simulation of incompressible viscous flows on collocated grids based on the artificial compressibility methodology.


title: Core-Level Photoelectron Spectroscopy Study of UTe$_2$

abstract: The valence state of UTe$_2$ was studied by core-level photoelectron spectroscopy. The main peak position of the U $4f$ core-level spectrum of UTe$_2$ coincides with that of UB$_2$, which is an itinerant compound with a nearly $5f^3$ configuration. However, the main peak of UTe$_2$ is broader than that of UB$_2$, and satellite structures are observed in the higher binding energy side of the main peak, which are characteristics of mixed-valence uranium compounds. These results suggest that the U 5$f$ state in UTe$_2$ is in a mixed valence state with a dominant contribution from the itinerant $5f^3$ configuration.


title: Estimation of Gas Turbine Shaft Torque and Fuel Flow of a CODLAG Propulsion System Using Genetic Programming Algorithm

abstract: In this paper, the publicly available dataset of condition based maintenance of combined diesel-electric and gas (CODLAG) propulsion system for ships has been utilized to obtain symbolic expressions which could estimate gas turbine shaft torque and fuel flow using genetic programming (GP) algorithm. The entire dataset consists of 11934 samples that was divided into training and testing portions of dataset in an 80:20 ratio. The training dataset used to train the GP algorithm to obtain symbolic expressions for gas turbine shaft torque and fuel flow estimation consisted of 9548 samples. The best symbolic expressions obtained for gas turbine shaft torque and fuel flow estimation were obtained based on their $R^2$ score generated as a result of the application of the testing portion of the dataset on the aforementioned symbolic expressions. The testing portion of the dataset consisted of 2386 samples. The three best symbolic expressions obtained for gas turbine shaft torque estimation generated $R^2$ scores of 0.999201, 0.999296, and 0.999374, respectively. The three best symbolic expressions obtained for fuel flow estimation generated $R^2$ scores of 0.995495, 0.996465, and 0.996487, respectively.


title: Backpropagating Linearly Improves Transferability of Adversarial Examples

abstract: The vulnerability of deep neural networks (DNNs) to adversarial examples has drawn great attention from the community. In this paper, we study the transferability of such examples, which lays the foundation of many black-box attacks on DNNs. We revisit a not so new but definitely noteworthy hypothesis of Goodfellow et al.'s and disclose that the transferability can be enhanced by improving the linearity of DNNs in an appropriate manner. We introduce linear backpropagation (LinBP), a method that performs backpropagation in a more linear fashion using off-the-shelf attacks that exploit gradients. More specifically, it calculates forward as normal but backpropagates loss as if some nonlinear activations are not encountered in the forward pass. Experimental results demonstrate that this simple yet effective method obviously outperforms current state-of-the-arts in crafting transferable adversarial examples on CIFAR-10 and ImageNet, leading to more effective attacks on a variety of DNNs.


title: Fermi-liquid state in $T$*-type La$_{1-x/2}$Eu$_{1-x/2}$Sr$_x$CuO$_4$ revealed via element substitution effects on magnetism

abstract: Despite its unique structural features, the magnetism of single-layered cuprate with five oxygen coordination ($T$*-type structure) has not been investigated thus far. Here, we report the results of muon spin relaxation and magnetic susceptibility measurements to elucidate the magnetism of $T$*-type La$_{1-x/2}$Eu$_{1-x/2}$Sr$_x$CuO$_4$ (LESCO) via magnetic Fe- and non-magnetic Zn-substitution. We clarified the inducement of the spin-glass (SG)-like magnetically ordered state in La$_{1-x/2}$Eu$_{1-x/2}$Sr$_x$Cu$_y$Fe$_{1-y}$O$_4$ with $x = 0.24 + y$, and the non-magnetic state in La$_{1-x/2}$Eu$_{1-x/2}$Sr$_x$Cu$_y$Zn$_{1-y}$O$_4$ with $x$ = 0.24 after the suppression of superconductivity for $y$ $\geq$ 0.025. The SG state lies below $\sim$7 K in a wide Sr concentration range between 0.19 and 0.34 in 5$\%$ Fe-substituted LESCO. The short-range SG state is consistent with that originating from the Ruderman-Kittel-Kasuya-Yosida interaction in a metallic state. Thus, the results provide the first evidence for Fermi liquid (FL) state in the pristine $T$*-type LESCO. Taking into account the results of an oxygen $K$-edge X-ray absorption spectroscopy measurement $[$J. Phys. Soc. Jpn. 89, 075002 (2020)$]$ reporting the actual hole concentrations in LESCO, our results demonstrate the existence of the FL state in a lower hole-concentration region, compared to that in $T$-type La$_{2-x}$Sr$_x$CuO$_4$. The emergence of the FL state in a lower hole-concentration region is possibly associated with a smaller charge transfer gap energy in the parent material with five oxygen coordination.