title: Multi-View Fusion for Multi-Level Robotic Scene Understanding

abstract: We present a system for multi-level scene awareness for robotic manipulation. Given a sequence of camera-in-hand RGB images, the system calculates three types of information: 1) a point cloud representation of all the surfaces in the scene, for the purpose of obstacle avoidance; 2) the rough pose of unknown objects from categories corresponding to primitive shapes (e.g., cuboids and cylinders); and 3) full 6-DoF pose of known objects. By developing and fusing recent techniques in these domains, we provide a rich scene representation for robot awareness. We demonstrate the importance of each of these modules, their complementary nature, and the potential benefits of the system in the context of robotic manipulation.


title: Activity of TRAPPIST-1 analogue stars observed with TESS

abstract: As more exoplanets are being discovered around ultracool dwarfs, understanding their magnetic activity -- and the implications for habitability -- is of prime importance. To find stellar flares and photometric signatures related to starspots, continuous monitoring is necessary, which can be achieved with spaceborn observatories like the Transiting Exoplanet Survey Satellite (TESS). We present an analysis of TRAPPIST-1 like ultracool dwarfs with TESS full-frame image photometry from the first two years of the primary mission. A volume-limited sample up to 50 pc is constructed consisting of 339 stars closer than 0.5 mag to TRAPPIST-1 on the Gaia colour-magnitude diagram. The 30-min cadence TESS light curves of 248 stars were analysed, searching for flares and rotational modulation caused by starspots. The composite flare frequency distribution of the 94 identified flares shows a power law index similar to TRAPPIST-1, and contains flares up to $E_\mathrm{TESS} = 3 \times 10^{33}$ erg. Rotational periods shorter than 5 days were determined for 42 stars, sampling the regime of fast rotators. The ages of 88 stars from the sample were estimated using kinematic information. A weak correlation between rotational period and age is observed, which is consistent with magnetic braking.


title: Low-energy subband wave-functions and effective $g$-factor of one-dimensional hole gas

abstract: One-dimensional (1D) hole gas confined in a cylindrical Ge nanowire has potential applications in quantum information technologies. Here, we analytically study the low-energy properties of this 1D hole gas. The subbands of the hole gas are two-fold degenerate. The low-energy subband wave-functions are obtained exactly, and the degenerate pairs are related to each other via a combination of the time-reversal and the spin-rotation transformations. In evaluating the effective $g$-factor of these low-energy subbands, the orbital effects of the magnetic field are shown to contribute as strongly as the Zeeman term. Also, near the center of the $k_{z}$ space, there is a sharp dip or a sharp peak in the effective $g$-factor. At the site $k_{z}=0$, the longitudinal $g$-factor $g_{l}$ is much less than the transverse $g$-factor $g_{t}$ for the lowest subband, while away from the site $k_{z}=0$, $g_{l}$ can be comparable to $g_{t}$.


title: Moments of the Hurwitz zeta function on the critical line

abstract: We study the moments $M_k(T;\alpha) = \int_T^{2T} |\zeta(s,\alpha)|^{2k}\,dt$ of the Hurwitz zeta function $\zeta(s,\alpha)$ on the critical line, $s = 1/2 + it$ with a rational shift $\alpha \in \mathbb Q$. We conjecture, in analogy with the Riemann zeta function, that $M_k(T;\alpha) \sim c_k(\alpha) T (\log T)^{k^2}$ . Using heuristics from analytic number theory and random matrix theory, we conjecturally compute $c_k(\alpha)$. In the process, we investigate moments of products of Dirichlet $L$-functions on the critical line. We prove our conjectures for the cases $k = 1,2$.


title: Homotopical presentations of braid groups via reduced lifts

abstract: In 1997, Deligne showed that the reduced lift presentation of a finite type generalized braid group remains correct if it is (suitably) interpreted as a presentation of a topological monoid. In this expository paper, we point out that Deligne's argument does not require the 'finite type' hypothesis, so it gives a different proof of a theorem proved by Dobrinskaya in 2006. We also review how to use this result to construct an action of the braid group on the finite or affine Hecke $\infty$-category via intertwining functors.


title: Evidential fully convolutional network for semantic segmentation

abstract: We propose a hybrid architecture composed of a fully convolutional network (FCN) and a Dempster-Shafer layer for image semantic segmentation. In the so-called evidential FCN (E-FCN), an encoder-decoder architecture first extracts pixel-wise feature maps from an input image. A Dempster-Shafer layer then computes mass functions at each pixel location based on distances to prototypes. Finally, a utility layer performs semantic segmentation from mass functions and allows for imprecise classification of ambiguous pixels and outliers. We propose an end-to-end learning strategy for jointly updating the network parameters, which can make use of soft (imprecise) labels. Experiments using three databases (Pascal VOC 2011, MIT-scene Parsing and SIFT Flow) show that the proposed combination improves the accuracy and calibration of semantic segmentation by assigning confusing pixels to multi-class sets.


title: Emergent ferromagnetism with Fermi-liquid behavior in proton intercalated CaRuO3

abstract: The evolution between Fermi liquid and non-Fermi-liquid states in correlated electron systems has been a central subject in condensed matter physics because of the coupled intriguing magnetic and electronic states. An effective pathway to explore the nature of non-Fermi liquid behavior is to approach its phase boundary. Here we report a crossover from non-Fermi liquid to Fermi-liquid state in metallic CaRuO3 through ionic liquid gating induced protonation with electric field. This electronic transition subsequently triggers a reversible magnetic transition with the emergence of an exotic ferromagnetic state from this paramagnetic compound. Our theoretical analysis reveals that hydrogen incorporation plays a critical role in both the electronic and magnetic phase transitions via structural distortion and electron doping. These observations not only help understand the correlated magnetic and electronic transitions in perovskite ruthenate systems, but also provide novel pathways to design electronic phases in correlated materials.


title: Benchmarking Modern Named Entity Recognition Techniques for Free-text Health Record De-identification

abstract: Electronic Health Records (EHRs) have become the primary form of medical data-keeping across the United States. Federal law restricts the sharing of any EHR data that contains protected health information (PHI). De-identification, the process of identifying and removing all PHI, is crucial for making EHR data publicly available for scientific research. This project explores several deep learning-based named entity recognition (NER) methods to determine which method(s) perform better on the de-identification task. We trained and tested our models on the i2b2 training dataset, and qualitatively assessed their performance using EHR data collected from a local hospital. We found that 1) BiLSTM-CRF represents the best-performing encoder/decoder combination, 2) character-embeddings and CRFs tend to improve precision at the price of recall, and 3) transformers alone under-perform as context encoders. Future work focused on structuring medical text may improve the extraction of semantic and syntactic information for the purposes of EHR de-identification.


title: Quality Gatekeepers: Investigating the Effects ofCode Review Bots on Pull Request Activities

abstract: Software bots have been facilitating several development activities in Open Source Software (OSS) projects, including code review. However, these bots may bring unexpected impacts to group dynamics, as frequently occurs with new technology adoption. Understanding and anticipating such effects is important for planning and management. To analyze these effects, we investigate how several activity indicators change after the adoption of a code review bot. We employed a regression discontinuity design on 1,194 software projects from GitHub. We also interviewed 12 practitioners, including open-source maintainers and contributors. Our results indicate that the adoption of code review bots increases the number of monthly merged pull requests, decreases monthly non-merged pull requests, and decreases communication among developers. From the developers' perspective, these effects are explained by the transparency and confidence the bot comments introduce, in addition to the changes in the discussion focused on pull requests. Practitioners and maintainers may leverage our results to understand, or even predict, bot effects on their projects.


title: A Better Approach to Track the Evolution of Static Code Warnings

abstract: Static bug detection tools help developers detect code problems. However, it is known that they remain underutilized due to various reasons. Recent advances to incorporate static bug detectors in modern software development workflows can better motivate developers to fix the reported warnings on the fly. In this paper, we study the effectiveness of the state-of-the-art (SOA) solution in tracking warnings by static bug detectors and propose a better solution based on our analysis of the insufficiencies of the SOA solution. In particular, we examined four large-scale open-source systems and crafted a data set of 3,452 static code warnings by two static bug detectors. We manually uncover the ground-truth evolution status of the selected warnings: persistent, resolved, or newly-introduced. Moreover, upon manual analysis, we identified the critical reasons behind the insufficiencies of the SOA matching algorithm. Finally, we propose a better approach to improve the tracking of static warnings over software development history. Our evaluation shows that our proposed approach provides a significant improvement in the precision of the tracking, i.e., from 66.9% to 90.0%.


title: An evidential classifier based on Dempster-Shafer theory and deep learning

abstract: We propose a new classifier based on Dempster-Shafer (DS) theory and a convolutional neural network (CNN) architecture for set-valued classification. In this classifier, called the evidential deep-learning classifier, convolutional and pooling layers first extract high-dimensional features from input data. The features are then converted into mass functions and aggregated by Dempster's rule in a DS layer. Finally, an expected utility layer performs set-valued classification based on mass functions. We propose an end-to-end learning strategy for jointly updating the network parameters. Additionally, an approach for selecting partial multi-class acts is proposed. Experiments on image recognition, signal processing, and semantic-relationship classification tasks demonstrate that the proposed combination of deep CNN, DS layer, and expected utility layer makes it possible to improve classification accuracy and to make cautious decisions by assigning confusing patterns to multi-class sets.


title: Term-community-based topic detection with variable resolution

abstract: Network-based procedures for topic detection in huge text collections offer an intuitive alternative to probabilistic topic models. We present in detail a method that is especially designed with the requirements of domain experts in mind. Like similar methods, it employs community detection in term co-occurrence graphs, but it is enhanced by including a resolution parameter that can be used for changing the targeted topic granularity. We also establish a term ranking and use semantic word-embedding for presenting term communities in a way that facilitates their interpretation. We demonstrate the application of our method with a widely used corpus of general news articles and show the results of detailed social-sciences expert evaluations of detected topics at various resolutions. A comparison with topics detected by Latent Dirichlet Allocation is also included. Finally, we discuss factors that influence topic interpretation.


title: Sublacunary sets and interpolation sets for nilsequences

abstract: A set $E \subset \mathbb{N}$ is an interpolation set for nilsequences if every bounded function on $E$ can be extended to a nilsequence on $\mathbb{N}$. Following a theorem of Strzelecki, every lacunary set is an interpolation set for nilsequences. We show that sublacunary sets are not interpolation sets for nilsequences. Furthermore, we prove that the union of an interpolation set for nilsequences and a finite set is an interpolation set for nilsequences. Lastly, we provide a new class of interpolation sets for Bohr almost periodic sequences, and as the result, obtain a new example of interpolation set for $2$-step nilsequences which is not an interpolation set for Bohr almost periodic sequences.


title: Reading and Acting while Blindfolded: The Need for Semantics in Text Game Agents

abstract: Text-based games simulate worlds and interact with players using natural language. Recent work has used them as a testbed for autonomous language-understanding agents, with the motivation being that understanding the meanings of words or semantics is a key component of how humans understand, reason, and act in these worlds. However, it remains unclear to what extent artificial agents utilize semantic understanding of the text. To this end, we perform experiments to systematically reduce the amount of semantic information available to a learning agent. Surprisingly, we find that an agent is capable of achieving high scores even in the complete absence of language semantics, indicating that the currently popular experimental setup and models may be poorly designed to understand and leverage game texts. To remedy this deficiency, we propose an inverse dynamics decoder to regularize the representation space and encourage exploration, which shows improved performance on several games including Zork I. We discuss the implications of our findings for designing future agents with stronger semantic understanding.


title: The Role of Differentiation in Tolling of Traffic Networks with Mixed Autonomy

abstract: With autonomous vehicles now sharing roads with human drivers, the era of mixed autonomy brings new challenges in dealing with congestion. One cause of congestion is when vehicle users choose their routes selfishly to minimize their personal travel delay rather than a global travel delay, and prior works address this phenomenon using tolling to influence routing choices, but do not address the setting of mixed autonomy. Tolls may be differentiated, meaning different users of a road experience different tolls, or they may be anonymous; the latter is desirable to allay concerns of fairness and privacy, as well as logistical challenges. In this work we examine the role of differentiation in traffic networks with mixed autonomy. Specifically, we first establish differentiated tolls which completely eliminate inefficiency due to selfish routing. We then show the fundamental limitations of anonymous tolls in our setting, and we provide anonymous tolls with mild performance guarantees. We show that in parallel networks, an infinitesimal differentiation in tolls is enough to guarantee optimality, and finally we establish a lower bound on the inefficiency of variable marginal cost tolling in the mixed autonomy setting.


title: A novel measurement approach for near-edge x-ray absorption fine structure: continuous 2$\pi$ angular rotation of linear polarization

abstract: A new technical method is developed for soft x-ray spectroscopy of near-edge x-ray absorption fine structure (NEXAFS). The measurement is performed with continuously rotating linearly polarized light over 2$\pi$, generated by a segmented undulator. A demonstration of the rotational NEXAFS experiment was successfully made with a 2D film, showing detailed polarization-dependence in intensity of the molecular orbitals. The present approach provides varieties of technical opportunities that are compatible with the state-of-the-art experiments in nano-space and under the $operando$ condition.


title: Prediction in the presence of response-dependent missing labels

abstract: In a variety of settings, limitations of sensing technologies or other sampling mechanisms result in missing labels, where the likelihood of a missing label in the training set is an unknown function of the data. For example, satellites used to detect forest fires cannot sense fires below a certain size threshold. In such cases, training datasets consist of positive and pseudo-negative observations where pseudo-negative observations can be either true negatives or undetected positives with small magnitudes. We develop a new methodology and non-convex algorithm P(ositive) U(nlabeled) - O(ccurrence) M(agnitude) M(ixture) which jointly estimates the occurrence and detection likelihood of positive samples, utilizing prior knowledge of the detection mechanism. Our approach uses ideas from positive-unlabeled (PU)-learning and zero-inflated models that jointly estimate the magnitude and occurrence of events. We provide conditions under which our model is identifiable and prove that even though our approach leads to a non-convex objective, any local minimizer has optimal statistical error (up to a log term) and projected gradient descent has geometric convergence rates. We demonstrate on both synthetic data and a California wildfire dataset that our method out-performs existing state-of-the-art approaches.


title: Nocturnal Seizure Detection Using Off-the-Shelf WiFi

abstract: Detection of nocturnal seizures in epilepsy patients is essential, both for the quick management of the seizure complications, and for the assessment of the ongoing seizure treatment. Traditional seizure detection products (e.g., wearables), however, are either very costly, uncomfortable, or unreliable. In this paper, we then propose to utilize everyday WiFi signals for robust, fast, and non-invasive detection of nocturnal seizures. We first present a new and rigorous mathematical characterization for the spectral content/bandwidth of the WiFi signal, measured on a WiFi device placed near a sleeping patient, during different kinds of sleep motions: seizures, normal movements (e.g. posture adjustments), and breathing. Based on this mathematical modeling, we propose a novel pipeline for processing the received WiFi signals to robustly detect all nocturnal non-breathing movements, and then classify them into normal body movements or seizures. In order to validate this, we carry out extensive experiments in 7 different typical bedroom locations, where a set of 20 actors simulate the state of having seizures (total of 260 instances), as well as normal sleep movements (total of 410 instances). Our proposed system detects 93.85% of the seizures with a mean response time of only 5.69 seconds since the onset of the seizure. Moreover, our proposed system achieves a probability of false alarm of only 0.0097, when classifying normal sleep movements. Overall, our new mathematical modeling and experimental results show the great potential the ubiquitous WiFi signals have for detecting nocturnal seizures, which can provide better support for epilepsy patients and their caregivers.


title: Task-Oriented Low-Dose CT Image Denoising

abstract: The extensive use of medical CT has raised a public concern over the radiation dose to the patient. Reducing the radiation dose leads to increased CT image noise and artifacts, which can adversely affect not only the radiologists judgement but also the performance of downstream medical image analysis tasks. Various low-dose CT denoising methods, especially the recent deep learning based approaches, have produced impressive results. However, the existing denoising methods are all downstream-task-agnostic and neglect the diverse needs of the downstream applications. In this paper, we introduce a novel Task-Oriented Denoising Network (TOD-Net) with a task-oriented loss leveraging knowledge from the downstream tasks. Comprehensive empirical analysis shows that the task-oriented loss complements other task agnostic losses by steering the denoiser to enhance the image quality in the task related regions of interest. Such enhancement in turn brings general boosts on the performance of various methods for the downstream task. The presented work may shed light on the future development of context-aware image denoising methods.


title: Efficient Feature Transformations for Discriminative and Generative Continual Learning

abstract: As neural networks are increasingly being applied to real-world applications, mechanisms to address distributional shift and sequential task learning without forgetting are critical. Methods incorporating network expansion have shown promise by naturally adding model capacity for learning new tasks while simultaneously avoiding catastrophic forgetting. However, the growth in the number of additional parameters of many of these types of methods can be computationally expensive at larger scales, at times prohibitively so. Instead, we propose a simple task-specific feature map transformation strategy for continual learning, which we call Efficient Feature Transformations (EFTs). These EFTs provide powerful flexibility for learning new tasks, achieved with minimal parameters added to the base architecture. We further propose a feature distance maximization strategy, which significantly improves task prediction in class incremental settings, without needing expensive generative models. We demonstrate the efficacy and efficiency of our method with an extensive set of experiments in discriminative (CIFAR-100 and ImageNet-1K) and generative (LSUN, CUB-200, Cats) sequences of tasks. Even with low single-digit parameter growth rates, EFTs can outperform many other continual learning methods in a wide range of settings.


title: Rethinking Self-Supervised Learning: Small is Beautiful

abstract: Self-supervised learning (SSL), in particular contrastive learning, has made great progress in recent years. However, a common theme in these methods is that they inherit the learning paradigm from the supervised deep learning scenario. Current SSL methods are often pretrained for many epochs on large-scale datasets using high resolution images, which brings heavy computational cost and lacks flexibility. In this paper, we demonstrate that the learning paradigm for SSL should be different from supervised learning and the information encoded by the contrastive loss is expected to be much less than that encoded in the labels in supervised learning via the cross entropy loss. Hence, we propose scaled-down self-supervised learning (S3L), which include 3 parts: small resolution, small architecture and small data. On a diverse set of datasets, SSL methods and backbone architectures, S3L achieves higher accuracy consistently with much less training cost when compared to previous SSL learning paradigm. Furthermore, we show that even without a large pretraining dataset, S3L can achieve impressive results on small data alone. Our code has been made publically available at https://github.com/CupidJay/Scaled-down-self-supervised-learning.


title: Distributed and Asynchronous Algorithms for N-block Convex Optimization with Coupling Constraints

abstract: This paper first proposes an N-block PCPM algorithm to solve N-block convex optimization problems with both linear and nonlinear constraints, with global convergence established. A linear convergence rate under the strong second-order conditions for optimality is observed in the numerical experiments. Next, for a starting point, an asynchronous N-block PCPM algorithm is proposed to solve linearly constrained N-block convex optimization problems. The numerical results demonstrate the sub-linear convergence rate under the bounded delay assumption, as well as the faster convergence with more short-time iterations than a synchronous iterative scheme.


title: On Evolving Attention Towards Domain Adaptation

abstract: Towards better unsupervised domain adaptation (UDA). Recently, researchers propose various domain-conditioned attention modules and make promising progresses. However, considering that the configuration of attention, i.e., the type and the position of attention module, affects the performance significantly, it is more generalized to optimize the attention configuration automatically to be specialized for arbitrary UDA scenario. For the first time, this paper proposes EvoADA: a novel framework to evolve the attention configuration for a given UDA task without human intervention. In particular, we propose a novel search space containing diverse attention configurations. Then, to evaluate the attention configurations and make search procedure UDA-oriented (transferability + discrimination), we apply a simple and effective evaluation strategy: 1) training the network weights on two domains with off-the-shelf domain adaptation methods; 2) evolving the attention configurations under the guide of the discriminative ability on the target domain. Experiments on various kinds of cross-domain benchmarks, i.e., Office-31, Office-Home, CUB-Paintings, and Duke-Market-1510, reveal that the proposed EvoADA consistently boosts multiple state-of-the-art domain adaptation approaches, and the optimal attention configurations help them achieve better performance.


title: Degradiation of $\beta$-Ga$_2$O$_3$ Schottky barrier diode under swift heavy ion irradiation

abstract: The electrical characteristics and microstructures of $\beta$-Ga$_2$O$_3$ Schottky barrier diode (SBD) devices irradiated with swift heavy ions (2096 MeV Ta ions) have been studied. It was found that $\beta$-Ga$_2$O$_3$ SBD devices showed the reliability degradation after irradiation, including turn-on voltage Von, on-resistance Ron, ideality factor n and the reverse leakage current density Jr. In addition, the carrier concentration of the drift layer was decreased significantly and the calculated carrier removal rates were 5*106 - 1.3*107 cm-1. Latent tracks induced by swift heavy ions were observed visually in the whole $\beta$-Ga$_2$O$_3$ matrix. Furthermore, crystal structure of tracks was amorphized completely. The latent tracks induced by Ta ions bombardments were found to be the reason for the decrease in carrier mobility and carrier concentration. Eventually, these defects caused the degradation of electrical characteristics of the devices. By comparing the carrier removal rates, the $\beta$-Ga$_2$O$_3$ SBD devices were more sensitive to swift heavy ions irradiation than SiC and GaN devices.


title: Degeneration of 7-dimensional minimal hypersurfaces which are stable or have bounded index

abstract: A 7-dimensional area-minimizing embedded hypersurface $M$ will in general have a discrete singular set. The same is true if $M$ is stable, or has bounded index, provided $H^6(sing M) = 0$. We show that if $M_i$ are a sequence of such minimal hypersurfaces which are minimizing, stable, or have bounded index, then $M_i$ can limit to a singular $M$ with only very controlled geometry, topology, and singular set. We show one can always "parameterize" a subsequence $i'$ with controlled bi-Lipschitz maps $\phi_{i'}$ taking $\phi_{i'}(M_{1'}) = M_{i'}$. As a consequence, we prove the space of smooth, closed, embedded minimal hypersurfaces $M$ in a closed Riemannian 8-manifold $(N, g)$ with a priori bounds $H^7(M) \leq \Lambda$ and $index(M) \leq I$ divides into finitely-many diffeomorphism types, and this finiteness continues to hold (in a suitable sense) if one allows the metric g to vary, or M to be singular.


title: Marangoni Convection-Driven Laser Fountains and Waves on Free Surfaces of Liquids

abstract: It is well accepted that an outward Marangoni convection from a low surface tension region will make the surface depressed. Here, we report that this established perception is only valid for thin liquid films. Using surface laser heating, we show that in deep liquids a laser beam actually pulls up the fluid above the free surface generating fountains with different shapes. Whereas with decreasing liquid depth a transition from fountain to indentation with fountain in-indentation is observed. Further, high-speed imaging reveals a transient surface process before steady elevation is formed, and this dynamic deformation is subsequently utilized to resonantly excite giant surface waves by a modulated laser beam. Computational fluid dynamics models reveal the underlying flow patterns and quantify the depth-dependent and time-resolved surface deformations. Our discoveries and techniques have upended the century-old perception and opened up a new regime of interdisciplinary research and applications of Marangoni-induced interface phenomena and optocapillary fluidic surfaces-the control of fluids with light.


title: Jointly Modeling Heterogeneous Student Behaviors and Interactions Among Multiple Prediction Tasks

abstract: Prediction tasks about students have practical significance for both student and college. Making multiple predictions about students is an important part of a smart campus. For instance, predicting whether a student will fail to graduate can alert the student affairs office to take predictive measures to help the student improve his/her academic performance. With the development of information technology in colleges, we can collect digital footprints which encode heterogeneous behaviors continuously. In this paper, we focus on modeling heterogeneous behaviors and making multiple predictions together, since some prediction tasks are related and learning the model for a specific task may have the data sparsity problem. To this end, we propose a variant of LSTM and a soft-attention mechanism. The proposed LSTM is able to learn the student profile-aware representation from heterogeneous behavior sequences. The proposed soft-attention mechanism can dynamically learn different importance degrees of different days for every student. In this way, heterogeneous behaviors can be well modeled. In order to model interactions among multiple prediction tasks, we propose a co-attention mechanism based unit. With the help of the stacked units, we can explicitly control the knowledge transfer among multiple tasks. We design three motivating behavior prediction tasks based on a real-world dataset collected from a college. Qualitative and quantitative experiments on the three prediction tasks have demonstrated the effectiveness of our model.


title: A Nitsche Hybrid multiscale method with non-matching grids

abstract: We propose a Nitsche method for multiscale partial differential equations, which retrieves the macroscopic information and the local microscopic information at one stroke. We prove the convergence of the method for second order elliptic problem with bounded and measurable coefficients. The rate of convergence may be derived for coefficients with further structures such as periodicity and ergodicity. Extensive numerical results confirm the theoretical predictions.


title: Deepfake Forensics via An Adversarial Game

abstract: With the progress in AI-based facial forgery (i.e., deepfake), people are increasingly concerned about its abuse. Albeit effort has been made for training classification (also known as deepfake detection) models to recognize such forgeries, existing models suffer from poor generalization to unseen forgery technologies and high sensitivity to changes in image/video quality. In this paper, we advocate adversarial training for improving the generalization ability to both unseen facial forgeries and unseen image/video qualities. We believe training with samples that are adversarially crafted to attack the classification models improves the generalization ability considerably. Considering that AI-based face manipulation often leads to high-frequency artifacts that can be easily spotted by models yet difficult to generalize, we further propose a new adversarial training method that attempts to blur out these specific artifacts, by introducing pixel-wise Gaussian blurring models. With adversarial training, the classification models are forced to learn more discriminative and generalizable features, and the effectiveness of our method can be verified by plenty of empirical evidence. Our code will be made publicly available.


title: CHIMERA: A Hybrid Estimation Approach to Limit the Effects of False Data Injection Attacks

abstract: The reliable operation of power grid is supported by energy management systems (EMS) that provide monitoring and control functionalities. Contingency analysis is a critical application of EMS to evaluate the impacts of outages and prepare for system failures. However, false data injection attacks (FDIAs) have demonstrated the possibility of compromising sensor measurements and falsifying the estimated power system states. As a result, FDIAs may mislead system operations and other EMS applications including contingency analysis and optimal power flow. In this paper, we assess the effect of FDIAs and demonstrate that such attacks can affect the resulted number of contingencies. In order to mitigate the FDIA impact, we propose CHIMERA, a hybrid attack-resilient state estimation approach that integrates model-based and data-driven methods. CHIMERA combines the physical grid information with a Long Short Term Memory (LSTM)-based deep learning model by considering a static loss of weighted least square errors and a dynamic loss of the difference between the temporal variations of the actual and the estimated active power. Our simulation experiments based on the load data from New York state demonstrate that CHIMERA can effectively mitigate 91.74% of the cases in which FDIAs can maliciously modify the contingencies.


title: Approximating Instance-Dependent Noise via Instance-Confidence Embedding

abstract: Label noise in multiclass classification is a major obstacle to the deployment of learning systems. However, unlike the widely used class-conditional noise (CCN) assumption that the noisy label is independent of the input feature given the true label, label noise in real-world datasets can be aleatory and heavily dependent on individual instances. In this work, we investigate the instance-dependent noise (IDN) model and propose an efficient approximation of IDN to capture the instance-specific label corruption. Concretely, noting the fact that most columns of the IDN transition matrix have only limited influence on the class-posterior estimation, we propose a variational approximation that uses a single-scalar confidence parameter. To cope with the situation where the mapping from the instance to its confidence value could vary significantly for two adjacent instances, we suggest using instance embedding that assigns a trainable parameter to each instance. The resulting instance-confidence embedding (ICE) method not only performs well under label noise but also can effectively detect ambiguous or mislabeled instances. We validate its utility on various image and text classification tasks.


title: Quantifying the efficacy of childcare services on women employment

abstract: Women are set back in the labor market after becoming mother. Intuitively, childcare services are able to promote women employment as they may reconciliate the motherhood penalty. However, most known studies concentrated on the effects of childcare services on fertility rate, instead of quantitative analyses about the effects on women employment. Using worldwide panel data and Chinese data at province level, this paper unfolds the quantitative relationship between childcare services and women employment, that is, the attendance rate of childcare services is positively correlated with the relative employment rate of women to men. Further analysis suggests that such a positive impact may largely resulted from breaking the vulnerable employment dilemma.


title: Shadows of 3-uniform hypergraphs under a minimum degree condition

abstract: We prove a minimum degree version of the Kruskal--Katona theorem: given $d\ge 1/4$ and a triple system $F$ on $n$ vertices with minimum degree at least $d\binom n2$, we obtain asymptotically tight lower bounds for the size of its shadow. Equivalently, for $t\ge n/2-1$, we asymptotically determine the minimum size of a graph on $n$ vertices, in which every vertex is contained in at least $\binom t2$ triangles. This can be viewed as a variant of the Rademacher--Tur\'an problem.


title: Thermodynamic Analysis of Titanium Removal from Molten iron Smelted with Large Amounts of Sodium Additives

abstract: High purity iron is obtained from vanadium-titanium magnetite (VTM) by one-step coal-based direct reduction-smelting process with coal as reductant and sodium carbonate (Na2CO3) as additives. Industrial experiments show that the process of treating molten iron with a large amount of Na2CO3 is effective in removing titanium from molten iron. However, the studies are rarely conducted in thermodynamic relationship between titanium and other components of molten iron, under the condition of a large amount of Na2CO3 additives. In this study, through the thermodynamic database software Factsage8.0, the effects of melting temperature, sodium content and oxygen content on the removal of titanium from molten iron are studied. The results of thermodynamic calculation show that the removal of titanium from molten iron needs to be under the condition of oxidation, and the temperature should be below the critical temperature of titanium removal (the highest temperature at which titanium can be removed). Relatively low temperature and high oxygen content contribute to the removal of titanium from molten iron. The high oxygen content is conducive to the simultaneous removal of titanium and phosphorus from molten iron. In addition, from a thermodynamic point of view, excessive sodium addition inhibits the removal of titanium from molten iron.


title: Computationally-Efficient Roadmap-based Inspection Planning via Incremental Lazy Search

abstract: The inspection-planning problem calls for computing motions for a robot that allow it to inspect a set of points of interest (POIs) while considering plan quality (e.g., plan length). This problem has applications across many domains where robots can help with inspection, including infrastructure maintenance, construction, and surgery. Incremental Random Inspection-roadmap Search (IRIS) is an asymptotically-optimal inspection planner that was shown to compute higher-quality inspection plans orders of magnitudes faster than the prior state-of-the-art method. In this paper, we significantly accelerate the performance of IRIS to broaden its applicability to more challenging real-world applications. A key computational challenge that IRIS faces is effectively searching roadmaps for inspection plans -- a procedure that dominates its running time. In this work, we show how to incorporate lazy edge-evaluation techniques into \iris's search algorithm and how to reuse search efforts when a roadmap undergoes local changes. These enhancements, which do not compromise IRIS's asymptotic optimality, enable us to compute inspection plans much faster than the original IRIS. We apply IRIS with the enhancements to simulated bridge inspection and surgical inspection tasks and show that our new algorithm for some scenarios can compute similar-quality inspection plans 570x faster than prior work.


title: Quark-Gluon Plasma and Nucleons a la Laughlin

abstract: Inspired by Laughlin's theory of the fractional quantum Hall effect, we explore the topological nature of the quark-gluon plasma and the nucleons in the context of the Clifford algebra. In our model, each quark is transformed into a composite particle via the simultaneous attachment of a spin monopole and an isospin monopole. This is induced by a novel kind of meson endowed with both spin and isospin degrees of freedom. The interactions in the strongly coupled quark-gluon system are governed by the topological winding number of the monopoles, which is an odd integer to ensure that the overall wave function is antisymmetric. The states of the quark-gluon plasma and the nucleons are thus uniquely determined by the combination of the monopole winding number m and the total quark number N. The radius squared of the quark-gluon plasma droplet is expected to be proportional to mN. We anticipate the observation of such proportionality in the heavy ion collision experiments.


title: MetaAlign: Coordinating Domain Alignment and Classification for Unsupervised Domain Adaptation

abstract: For unsupervised domain adaptation (UDA), to alleviate the effect of domain shift, many approaches align the source and target domains in the feature space by adversarial learning or by explicitly aligning their statistics. However, the optimization objective of such domain alignment is generally not coordinated with that of the object classification task itself such that their descent directions for optimization may be inconsistent. This will reduce the effectiveness of domain alignment in improving the performance of UDA. In this paper, we aim to study and alleviate the optimization inconsistency problem between the domain alignment and classification tasks. We address this by proposing an effective meta-optimization based strategy dubbed MetaAlign, where we treat the domain alignment objective and the classification objective as the meta-train and meta-test tasks in a meta-learning scheme. MetaAlign encourages both tasks to be optimized in a coordinated way, which maximizes the inner product of the gradients of the two tasks during training. Experimental results demonstrate the effectiveness of our proposed method on top of various alignment-based baseline approaches, for tasks of object classification and object detection. MetaAlign helps achieve the state-of-the-art performance.


title: First Principle QCD QED Potentials, Quark Confinement and Electron-Positron Pair Annihilation

abstract: The mystery of the origin of the mass of the elementary particles persists despite the success of quantum field theories to the highest level of accuracy. Renormalization program has been the essential part of the calculation of the scattering amplitudes where the infinities of the calculated mass of the elementary particles are subtracted for progressive calculation of higher order terms. The mathematical structure of the mass from quantum field theories expressed in the form of infinities suggests that there exists finite dynamical mass in the limit the input mass parameter becomes zero. The Lagrangian recovers symmetry at while the self energy diagrams acquire finite dynamical mass. The first principle QCD and QED potentials are obtained by replacing the fixed mass and coupling constant in Yukawa potential with the scale dependent running coupling constant and the corresponding mass.


title: ButterFly BFS -- An Efficient Communication Pattern for Multi Node Traversals

abstract: Breadth-First Search (BFS) is a building block used in a wide array of graph analytics and is used in various network analysis domains: social, road, transportation, communication, and much more. Over the last two decades, network sizes have continued to grow. The popularity of BFS has brought with it a need for significantly faster traversals. Thus, BFS algorithms have been designed to exploit shared-memory and shared-nothing systems -- this includes algorithms for accelerators such as the GPU. GPUs offer extremely fast traversals at the cost of processing smaller graphs due to their limited memory size. In contrast, CPU shared-memory systems can scale to graphs with several billion edges but do not have enough compute resources needed for fast traversals. This paper introduces ButterFly BFS, a multi-GPU traversal algorithm that allows analyzing significantly larger networks at high rates. ButterFly BFS scales to the similar-sized graphs processed by shared-memory systems while improving performance by more than 10X compared to CPUs. We evaluate our new algorithm on an NVIDIA DGX-2 server with 16 V100 GPUS and show that our algorithm scales with an increase in the number of GPUS. We show that we can achieve a roughly $70\%$ performance linear speedup, which is non-trivial for BFS. For a scale 29 Kronecker graph and edge factor of 8, our new algorithm traverses the graph at a rate of over 300 GTEP/s. That is a high traversal rate for a single server.


title: Test-Time Training for Deformable Multi-Scale Image Registration

abstract: Registration is a fundamental task in medical robotics and is often a crucial step for many downstream tasks such as motion analysis, intra-operative tracking and image segmentation. Popular registration methods such as ANTs and NiftyReg optimize objective functions for each pair of images from scratch, which are time-consuming for 3D and sequential images with complex deformations. Recently, deep learning-based registration approaches such as VoxelMorph have been emerging and achieve competitive performance. In this work, we construct a test-time training for deep deformable image registration to improve the generalization ability of conventional learning-based registration model. We design multi-scale deep networks to consecutively model the residual deformations, which is effective for high variational deformations. Extensive experiments validate the effectiveness of multi-scale deep registration with test-time training based on Dice coefficient for image segmentation and mean square error (MSE), normalized local cross-correlation (NLCC) for tissue dense tracking tasks. Two videos are in https://www.youtube.com/watch?v=NvLrCaqCiAE and https://www.youtube.com/watch?v=pEA6ZmtTNuQ


title: On the Convexity of Discrete Time Covariance Steering in Stochastic Linear Systems with Wasserstein Terminal Cost

abstract: In this work, we analyze the properties of the solution to the covariance steering problem for discrete time Gaussian linear systems with a squared Wasserstein distance terminal cost. In our previous work, we have shown that by utilizing the state feedback control policy parametrization, this stochastic optimal control problem can be associated with a difference of convex functions program. Here, we revisit the same covariance control problem but this time we focus on the analysis of the problem. Specifically, we establish the existence of solutions to the optimization problem and derive the first and second order conditions for optimality. We provide analytic expressions for the gradient and the Hessian of the performance index by utilizing specialized tools from matrix calculus. Subsequently, we prove that the optimization problem always admits a global minimizer, and finally, we provide a sufficient condition for the performance index to be a strictly convex function (under the latter condition, the problem admits a unique global minimizer). In particular, we show that when the terminal state covariance is upper bounded, with respect to the L\"{o}wner partial order, by the covariance matrix of the desired terminal normal distribution, then our problem admits a unique global minimizing state feedback gain. The results of this paper set the stage for the development of specialized control design tools that exploit the structure of the solution to the covariance steering problem with a squared Wasserstein distance terminal cost.

categories: math.OC cs.LG cs.SY eess.SY math-ph math.MP


title: STA-VPR: Spatio-temporal Alignment for Visual Place Recognition

abstract: Recently, the methods based on Convolutional Neural Networks (CNNs) have gained popularity in the field of visual place recognition (VPR). In particular, the features from the middle layers of CNNs are more robust to drastic appearance changes than handcrafted features and high-layer features. Unfortunately, the holistic mid-layer features lack robustness to large viewpoint changes. Here we split the holistic mid-layer features into local features, and propose an adaptive dynamic time warping (DTW) algorithm to align local features from the spatial domain while measuring the distance between two images. This realizes viewpoint-invariant and condition-invariant place recognition. Meanwhile, a local matching DTW (LM-DTW) algorithm is applied to perform image sequence matching based on temporal alignment, which achieves further improvements and ensures linear time complexity. We perform extensive experiments on five representative VPR datasets. The results show that the proposed method significantly improves the CNN-based methods. Moreover, our method outperforms several state-of-the-art methods while maintaining good run-time performance. This work provides a novel way to boost the performance of CNN methods without any re-training for VPR. The code is available at https://github.com/Lu-Feng/STA-VPR.


title: EfficientTDNN: Efficient Architecture Search for Speaker Recognition

abstract: Convolutional neural networks (CNNs), such as the time-delay neural network (TDNN), have shown their remarkable capability in learning speaker embedding. However, they meanwhile bring a huge computational cost in storage size, processing, and memory. Discovering the specialized CNN that meets a specific constraint requires a substantial effort of human experts. Compared with hand-designed approaches, neural architecture search (NAS) appears as a practical technique in automating the manual architecture design process and has attracted increasing interest in spoken language processing tasks such as speaker recognition. In this paper, we propose EfficientTDNN, an efficient architecture search framework consisting of a TDNN-based supernet and a TDNN-NAS algorithm. The proposed supernet introduces temporal convolution of different ranges of the receptive field and feature aggregation of various resolutions from different layers to TDNN. On top of it, the TDNN-NAS algorithm quickly searches for the desired TDNN architecture via weight-sharing subnets, which surprisingly reduces computation while handling the vast number of devices with various resources requirements. Experimental results on the VoxCeleb dataset show the proposed EfficientTDNN enables approximate $10^{13}$ architectures concerning depth, kernel, and width. Considering different computation constraints, it achieves a 2.20% equal error rate (EER) with 204M multiply-accumulate operations (MACs), 1.41% EER with 571M MACs as well as 0.94% EER with 1.45G MACs. Comprehensive investigations suggest that the trained supernet generalizes subnets not sampled during training and obtains a favorable trade-off between accuracy and efficiency.


title: Learning Dynamic Alignment via Meta-filter for Few-shot Learning

abstract: Few-shot learning (FSL), which aims to recognise new classes by adapting the learned knowledge with extremely limited few-shot (support) examples, remains an important open problem in computer vision. Most of the existing methods for feature alignment in few-shot learning only consider image-level or spatial-level alignment while omitting the channel disparity. Our insight is that these methods would lead to poor adaptation with redundant matching, and leveraging channel-wise adjustment is the key to well adapting the learned knowledge to new classes. Therefore, in this paper, we propose to learn a dynamic alignment, which can effectively highlight both query regions and channels according to different local support information. Specifically, this is achieved by first dynamically sampling the neighbourhood of the feature position conditioned on the input few shot, based on which we further predict a both position-dependent and channel-dependent Dynamic Meta-filter. The filter is used to align the query feature with position-specific and channel-specific knowledge. Moreover, we adopt Neural Ordinary Differential Equation (ODE) to enable a more accurate control of the alignment. In such a sense our model is able to better capture fine-grained semantic context of the few-shot example and thus facilitates dynamical knowledge adaptation for few-shot learning. The resulting framework establishes the new state-of-the-arts on major few-shot visual recognition benchmarks, including miniImageNet and tieredImageNet.


title: Bonding nature and optical contrast of $TiTe_2$/$Sb_2Te_3$ phase-change heterostructure

abstract: Chalcogenide phase-change materials (PCMs) are regarded as the leading candidate for storage-class non-volatile memory and neuro-inspired computing. Recently, using the $TiTe_2$/$Sb_2Te_3$ material combination, a new framework - phase-change heterostructure (PCH), has been developed and proved to effectively suppress the noise and drift in electrical resistance upon memory programming, largely reducing the inter-device variability. However, the atomic-scale structural and chemical nature of PCH remains to be fully understood. In this work, we carry out thorough ab initio simulations to assess the bonding characteristics of the PCH. We show that the $TiTe_2$ crystalline nanolayers do not chemically interact with the surrounding $Sb_2Te_3$, and are stabilized by strong covalent and electrostatic Ti-Te interactions, which create a prohibitively high barrier for atomic migrations along the pulsing direction. We also find significant contrast in computed dielectric functions in the PCH, suggesting possible optical applications of this class of devices. With the more confined space and therefore constrained phase transition compared to traditional PCM devices, the recently introduced class of PCH-based devices may lead to improvements in phase-change photonic and optoelectronic applications with much lower stochasticity during programming.


title: BERT4SO: Neural Sentence Ordering by Fine-tuning BERT

abstract: Sentence ordering aims to arrange the sentences of a given text in the correct order. Recent work frames it as a ranking problem and applies deep neural networks to it. In this work, we propose a new method, named BERT4SO, by fine-tuning BERT for sentence ordering. We concatenate all sentences and compute their representations by using multiple special tokens and carefully designed segment (interval) embeddings. The tokens across multiple sentences can attend to each other which greatly enhances their interactions. We also propose a margin-based listwise ranking loss based on ListMLE to facilitate the optimization process. Experimental results on five benchmark datasets demonstrate the effectiveness of our proposed method.


title: Improving the Signal-to-Noise Ratio of Atomic Transition Peaks in LIBS Using Two-dimensional Correlation Analysis

abstract: In this stu dy, two dimensional ( 2D correlation analysis wa s utilized for achieving a significant improvement in the signal to noise (S/N) ratio of laser induced breakdown spectroscopy (LIBS) data . Time resolved LIBS spectra of metallic, bimetal lic targets and the normal LIBS spectra of bimetallic targets with varying compositions were used for the detailed analysis . The diagonal of the matrix in the synchronous spectra was used to demonstrate the improvement in the S/N ratio. An improvemen t in the peak intensities by few order s of magnitude accompanied by suppression in the noise was observed. The correlations between LIBS peaks were also visualized using 2 D plots. Correlation strengths of atomic transitions were visualized in Aluminum (Al), Copper (Cu), and Brass whereas correlation strengths of atomic, atomic, and ionic transitions were visualized in Au Ag bimetallic targets with different compositions (Au30Ag70, Au50Ag50, Au80 Ag20). The improved spectra were subsequently used in the principal component analysis for classification studies of four compositions of bimetallic targets Au20Ag80, Au30Ag70, Au50 Ag50, and Au80Ag20 The variance of the first three principal components were found to be improved from the analysis. The accumulated percentage of explained variance of 95 was achieved with the first three components from improved spectra whereas only ~ 80 was achieved with the regular LIBS spectra from PCA studies


title: Temporal networks as a modeling framework

abstract: To understand large, connected systems, we cannot only zoom into the details. We also need to see the large-scale features from afar. One way to take a step back and get the whole picture is to model the systems as a network. However, many systems are not static, but consisting of contacts that are off and on as time progresses. This Chapter introduces the mathematical and computational modeling of such systems and thus an introduction to the rest of the book. We will cover some of the earlier developments that form the foundation for the more specialized topics of the other Chapters.


title: Improving Online Forums Summarization via Hierarchical Unified Deep Neural Network

abstract: Online discussion forums are prevalent and easily accessible, thus allowing people to share ideas and opinions by posting messages in the discussion threads. Forum threads that significantly grow in length can become difficult for participants, both newcomers and existing, to grasp main ideas. To mitigate this problem, this study aims to create an automatic text summarizer for online forums. We present Hierarchical Unified Deep Neural Network to build sentence and thread representations for the forum summarization. In this scheme, Bi-LSTM derives a representation that comprises information of the whole sentence and whole thread; whereas, CNN captures most informative features with respect to context from sentence and thread. Attention mechanism is applied on top of CNN to further highlight high-level representations that carry important information contributing to a desirable summary. Extensive performance evaluation has been conducted on three datasets, two of which are real-life online forums and one is news dataset. The results reveal that the proposed model outperforms several competitive baselines.


title: Artificial Intelligence in Tumor Subregion Analysis Based on Medical Imaging: A Review

abstract: Medical imaging is widely used in cancer diagnosis and treatment, and artificial intelligence (AI) has achieved tremendous success in various tasks of medical image analysis. This paper reviews AI-based tumor subregion analysis in medical imaging. We summarize the latest AI-based methods for tumor subregion analysis and their applications. Specifically, we categorize the AI-based methods by training strategy: supervised and unsupervised. A detailed review of each category is presented, highlighting important contributions and achievements. Specific challenges and potential AI applications in tumor subregion analysis are discussed.


title: Reentrant Melting of Lanes of Rough Circular Discs

abstract: We consider binary suspension of rough, circular particles in two dimensions under athermal conditions. The mean density of the system is kept constant. The suspension is subject to a time-independent external drive in response to which one half of the particles are pulled along the field direction whereas the other half is pushed in the opposite direction. Simulating the system with different magnitude of external drive in steady state, we obtain oppositely moving macroscopic lanes only for a moderate range of external drive. Below as well as above the range we obtain states with no lane. Hence we find that no-lane state re-enters along the axis of the external drive in the non-equilibrium phase diagram corresponding to the laning transition, with varying roughness of individual particles and external drive. Inter-particle friction (contact dissipation) due to the roughness of the individual particle is the main player behind the re-entrance of no-lane state at high external drives.


title: Engineering an Intelligent Essay Scoring and Feedback System: An Experience Report

abstract: Artificial Intelligence (AI) / Machine Learning (ML)-based systems are widely sought-after commercial solutions that can automate and augment core business services. Intelligent systems can improve the quality of services offered and support scalability through automation. In this paper we describe our experience in engineering an exploratory system for assessing the quality of essays supplied by customers of a specialized recruitment support service. The problem domain is challenging because the open-ended customer-supplied source text has considerable scope for ambiguity and error, making models for analysis hard to build. There is also a need to incorporate specialized business domain knowledge into the intelligent processing systems. To address these challenges, we experimented with and exploited a number of cloud-based machine learning models and composed them into an application-specific processing pipeline. This design allows for modification of the underlying algorithms as more data and improved techniques become available. We describe our design, and the main challenges we faced, namely keeping a check on the quality control of the models, testing the software and deploying the computationally expensive ML models on the cloud.


title: Directed Data-Processing Inequalities for Systems with Feedback

abstract: We present novel data-processing inequalities relating the mutual information and the directed information in systems with feedback. The internal blocks within such systems are restricted only to be causal mappings, but are allowed to be non-linear, stochastic and time varying. These blocks can for example represent source encoders, decoders or even communication channels. Moreover, the involved signals can be arbitrarily distributed. Our first main result relates mutual and directed informations and can be interpreted as a law of conservation of information flow. Our second main result is a pair of data-processing inequalities (one the conditional version of the other) between nested pairs of random sequences entirely within the closed loop. Our third main result is introducing and characterizing the notion of in-the-loop (ITL) transmission rate for channel coding scenarios in which the messages are internal to the loop. Interestingly, in this case the conventional notions of transmission rate associated with the entropy of the messages and of channel capacity based on maximizing the mutual information between the messages and the output turn out to be inadequate. Instead, as we show, the ITL transmission rate is the unique notion of rate for which a channel code attains zero error probability if and only if such ITL rate does not exceed the corresponding directed information rate from messages to decoded messages. We apply our data-processing inequalities to show that the supremum of achievable (in the usual channel coding sense) ITL transmission rates is upper bounded by the supremum of the directed information rate across the communication channel. Moreover, we present an example in which this upper bound is attained. Finally, ...


title: Machine-learning-enabled vectorial opto-magnetization orientation

abstract: Manipulation of light-induced magnetization has become a fundamentally hot topic with a potentially high impact for atom trapping, confocal and magnetic resonance microscopy, and data storage. The control of the magnetization orientation mainly relies on the direct methods composed of amplitude, phase and polarization modulations of the incident light under the tight focusing condition, leaving the achievement of arbitrary desirable three-dimensional (3D) magnetization orientation complicated, inflexible and inefficient. Here, we propose a facile approach called machine learning inverse design to achieve expected vectorial opto-magnetization orientation. This pathway is time-efficient and accurate to produce the demanded incident beam for arbitrary prescribed 3D magnetization orientation. It is highlighted that the machine learning method is not only applied for magnetization orientations, but also widely used in the control of magnetization structures.


title: An analytical model for electronic noise in a cryogenic bolometer detector readout circuit

abstract: This paper presents an analytical model to quantify the measured noise in a cryogenic bolometer readout circuit. The model includes the contributions from the bias resistors and sensor resistors, voltage and current noise of amplifier, and cable capacitance. The model parameters are empirically estimated using frequency domain analysis of the measured noise data of indigenously developed Neutron Transmutation Doped (NTD) Ge sensors. The model is shown to describe noise data for NTD Ge sensors over a wide range of resistances corresponding to temperatures in the range 20 - 70 mK. Relative contributions of different components are discussed and it is shown that the contribution to the overall noise from the differential amplifier at 300 K is the dominant source. It is observed that the amplifier flicker noise is significantly lower than that specified in the amplifier datasheet. The present study also indicates that a desirable value of resistance of NTD sensor (R$_{NTD}$) from noise considerations is $\leq$ 1 G$\Omega$ at $sim$ 20 mK.


title: Parabolic induction and the Harish-Chandra D-module

abstract: Let G be a reductive group and L a Levi subgroup. Parabolic induction and restriction are a pair of adjoint functors between Ad-equivariant derived categories of either constructible sheaves or (not necessarily holonomic) D-modules on G and L, respectively. Bezrukavnikov and Yom Din proved, generalizing a classic result of Lusztig, that these functors are exact. In this paper, we consider a special case where L=T is a maximal torus. We give explicit formulas for parabolic induction and restriction in terms of the Harish-Chandra D-module on G x T. We show that this module is flat over D(T), which easily implies that parabolic induction and restriction are exact functors between the corresponding abelian categories of D-modules.


title: A short review of the recent progresses in the study of the cuprate superconductivity

abstract: The last 15 years have witnessed important progresses in our understanding of the mechanism of superconductivity in the high-$T_{c}$ cuprates. There is now strong evidence that the strange metal behavior is induced by the quantum critical fluctuation at the pseudogap end point, where the Fermi surface changes its topology from hole-like to electron-like. However, experiments show that the quantum critical behavior in the high-$T_{c}$ cuprates is qualitatively different from that observed in the heavy Fermion systems and the iron-based superconductors, in both of which the quantum critical behavior can be attributed to the quantum phase transition toward a symmetry breaking phase. The fact that the pseudogap exists as a spectral gap without a corresponding symmetry breaking order, together with the fact that the strange metal behavior occurs as a quantum critical behavior without a corresponding symmetry breaking phase transition, exposes the central difficulty of the field: the lack of a universal low energy effective theory description of the high-$T_{c}$ phenomenology beyond the Landau paradigm. Recent experiments imply that the dualism between the local moment and the itinerant quasiparticle character of the electron in the high-$T_{c}$ cuprates may serve as an organizing principle to go beyond the Landau paradigm and may hold the key to the mystery of the pseudogap phenomena and the strange metal behavior.


title: Spanning tree enumeration via triangular rank-one perturbations of graph Laplacians

abstract: We present new short proofs of known spanning tree enumeration formulae for threshold and Ferrers graphs by showing that the Laplacian matrices of such graphs admit triangular rank-one perturbations. We then characterize the set of graphs whose Laplacian matrices admit triangular rank-one perturbations as the class of special 2-threshold graphs, introduced by Hung, Kloks, and Villaamil. Our work introduces (1) a new characterization of special 2-threshold graphs that generalizes the characterization of threshold graphs in terms of isolated and dominating vertices, and (2) a spanning tree enumeration formula for special 2-threshold graphs that reduces to the aforementioned formulae for threshold and Ferrers graphs. We consider both unweighted and weighted spanning tree enumeration.


title: Mask Attention Networks: Rethinking and Strengthen Transformer

abstract: Transformer is an attention-based neural network, which consists of two sublayers, namely, Self-Attention Network (SAN) and Feed-Forward Network (FFN). Existing research explores to enhance the two sublayers separately to improve the capability of Transformer for text representation. In this paper, we present a novel understanding of SAN and FFN as Mask Attention Networks (MANs) and show that they are two special cases of MANs with static mask matrices. However, their static mask matrices limit the capability for localness modeling in text representation learning. We therefore introduce a new layer named dynamic mask attention network (DMAN) with a learnable mask matrix which is able to model localness adaptively. To incorporate advantages of DMAN, SAN, and FFN, we propose a sequential layered structure to combine the three types of layers. Extensive experiments on various tasks, including neural machine translation and text summarization demonstrate that our model outperforms the original Transformer.


title: Recent Advances in Large Margin Learning

abstract: This paper serves as a survey of recent advances in large margin training and its theoretical foundations, mostly for (nonlinear) deep neural networks (DNNs) that are probably the most prominent machine learning models for large-scale data in the community over the past decade. We generalize the formulation of classification margins from classical research to latest DNNs, summarize theoretical connections between the margin, network generalization, and robustness, and introduce recent efforts in enlarging the margins for DNNs comprehensively. Since the viewpoint of different methods is discrepant, we categorize them into groups for ease of comparison and discussion in the paper. Hopefully, our discussions and overview inspire new research work in the community that aim to improve the performance of DNNs, and we also point to directions where the large margin principle can be verified to provide theoretical evidence why certain regularizations for DNNs function well in practice. We managed to shorten the paper such that the crucial spirit of large margin learning and related methods are better emphasized.


title: Dynamical charged black hole spontaneous scalarization in Anti-de Sitter spacetimes

abstract: We study the fully nonlinear dynamics of black hole spontaneous scalarizations in Einstein-Maxwell scalar theory with coupling function $f(\phi)=e^{-b\phi^{2}}$, which can transform usual Reissner-Nordstr\"om Anti-de Sitter (RN-AdS) black holes into hairy black holes. Fixing the Arnowitt-Deser-Misner mass of the system, the initial scalar perturbation will destroy the original RN-AdS black hole and turn it into a hairy black hole provided that the constant $-b$ in the coupling function and the charge of the original black hole are sufficiently large, while the cosmological constant is small enough. In the scalarization process, we observe that the black hole irreducible mass initially increases exponentially, then it approaches to and finally saturates at a finite value. Choosing stronger coupling and larger black hole charge, we find that the black hole mass exponentially grows earlier and it takes a longer time for a hairy black hole to be developed and stabilized. We further examine phase structure properties in the scalarization process and confirm the observations in the non-linear dynamical study.


title: Modeling the optical properties of Twisted Bilayer Photonic Crystals

abstract: We demonstrate a photonic analog of twisted bilayer graphene that has ultra-flat photonic bands and exhibits extreme slow light behavior. Our twisted bilayer photonic device, which has an operating wavelength in C-band of the telecom window, uses two crystalline silicon photonic crystal slabs separated by a methyl methacrylate tunneling layer. We numerically determine the magic angle using a finite-element method and the corresponding photonic band structure, which exhibits a flat band over the entire Brillouin zone. This flat band causes the group velocity to approach zero and introduces light localization in a linear periodic photonic system. Using a plane-wave continuum model we find that photonic modes in twisted bilayer photonic crystals are not as tightly bound as their electronic counterparts in twisted bilayer graphene. In addition, the photonic system has a larger band asymmetry. The band structure can easily be engineered by adjusting the device geometry, giving significant freedom in the design of devices. Our work provides a fundamental understanding of the photonic properties of twisted bilayer photonic crystals and opens the door to nanoscale-based non-linear enhancement and superradiance.


title: Coexisting superconductivity and ferromagnetism in the (V$_{0.60}$Ti$_{0.40}$)-Gd alloys

abstract: We present here, the effect of microstructure on the magnetic, electrical and thermal properties of (V$_{0.60}$Ti$_{0.40}$)-Gd alloys. The gadolinium is found to be immiscible and precipitates with a size $<$1.2~$\mu$m in the (V$_{0.60}$Ti$_{0.40}$)-Gd alloys. These precipitates enhance the grain boundary density. The (V$_{0.60}$Ti$_{0.40}$)-Gd alloys become ferromagnetic below $T_{mc}$ = 295~K with an increase in the superconducting transition temperature ($T_{sc}$). Though the disorder increases with increasing Gd content, the electronic thermal conductivity ($\kappa_{e} (H = 0)$) reduces by at most 15\% which is in contrast with the 80\% decrease of the phononic thermal conductivity ($\kappa_{l} (H = 0)$). Our analysis suggests that the magnetic moments of Gd precipitates polarize the conduction electrons along and around the grain boundaries leading to increase in the mean free path of the electrons. The partial suppression of spin fluctuations in the (V$_{0.60}$Ti$_{0.40}$)-Gd alloy by the conduction electron polarization enhances the $T_{sc}$.


title: Handle decompositions for a class of closed orientable PL 4-manifolds

abstract: In this article, we study a class of closed connected orientable PL $4$-manifolds admitting a semi-simple crystallization and which have an infinite cyclic fundamental group. We show that the manifold in the class admits a handle decomposition in which the number of $2$-handles depends upon its second Betti number and other $h$-handles ($h \leq 4$) are at most $2$. More precisely, our main result is the following. For a closed connected orientable PL $4$-manifold having a semi-simple crystallization with the fundamental group as $\mathbb{{Z}}$, we have constructed a handle decomposition for $M$ as one of the following types: $(1)$ one $0$-handle, two $1$-handles, $1+\beta_2(M)$ $2$-handles, one $3$-handle and one $4$-handle, $(2)$ one $0$-handle, one $1$-handle, $\beta_2(M)$ $2$-handles, one $3$-handle and one $4$-handle, where $\beta_2(M)$ denotes the second Betti number of manifold $M$ with $\mathbb{Z}$ coefficients.


title: Photometric and kinematical analysis of Koposov 12 and Koposov 43 open clusters

abstract: We present a photometric and kinematical analysis of two and poorly studied open clusters; Koposov 12 (FSR 802) and Koposov 43 (FSR 848) by using cross-matched data from PPMXL and Gaia DR2 catalog. We use astrometric parameters to identify 285 and 310 cluster members for Koposov 12 and Koposov 43, respectively. Using the extracted member candidates and isochrone fitting to near-infrared (J, H, Ks) and Gaia DR2 bands (G, GBP, GRP), and Color Magnitude Diagrams (CMDs), we have estimated ages: log (age/yr) = 9.00 +/- 0.20 and 9.50 +/- 0.20, and distances d = 1850 +/- 43 pc and 2500 +/- 50 pc for Koposov 12 and Koposov 43, respectively, assuming Solar metallicity (Z=0.019). The estimated masses of the cluster derived using initial mass function and synthetic CMD are 364 +/- 19 M_sun and 352 +/- 19 M_sun. We have also computed their velocity ellipsoid parameters based on (3x3) matrix elements (mu_ij).


title: A temporal network version of Watts's cascade model

abstract: Threshold models of cascades in the social sciences and economics explain the spread of opinion and innovation due to social influence. In threshold cascade models, fads or innovations spread between agents as determined by their interactions with other agents and their personal threshold of resistance. Typically, these models do not account for structure in the timing of interaction between the units. In this work, we extend a model of social cascades by Duncan Watts to temporal interaction networks. In our model, we assume friends and acquaintances influence agents for a certain time into the future. That is the influence of the past ages and becomes unimportant. Thus, our modified cascade model has an effective time window of influence. We explore two types of thresholds -- thresholds to fractions of the neighbors or absolute numbers. We try our model on six empirical datasets and compare them with null models.


title: Equation-of-State Constraints on the Neutron-Star Binding Energy and Tests of Binary Formation Scenarios

abstract: The second supernova that forms double-neutron-star systems is expected to occur in a progenitor that is ultra-stripped due to binary interactions. Thus, the secondary neutron star's mass as well as the post-supernova binary's orbital parameters will depend on the nature of the collapsing progenitor core. Since neutron stars are in the strong-gravity regime, their binding energy makes up a significant fraction of their total mass-energy budget. The second neutron star's binding energy may thus provide a unique insight as to whether its progenitor was a low-mass iron core or an oxygen-neon-magnesium core. I obtain relations for the baryonic mass and binding energy incorporating both a hadronic equation-of-state catalog as well as recent multi-messenger neutron-star observations. With these relations, I obtain the first tight constraints on the baryonic mass and binding energy of three neutron stars that are thought to have formed from an ultra-stripped progenitor. With these constraints, I test if each neutron star is consistent with forming from an ONeMg core that undergoes an electron-capture supernova. From these tests, I find that this scenario can be ruled out for one of three neutron stars. Neutron-star properties and the dense-matter equation of state can thus help distinguish binary formation scenarios.


title: Predicting Directionality in Causal Relations in Text

abstract: In this work, we test the performance of two bidirectional transformer-based language models, BERT and SpanBERT, on predicting directionality in causal pairs in the textual content. Our preliminary results show that predicting direction for inter-sentence and implicit causal relations is more challenging. And, SpanBERT performs better than BERT on causal samples with longer span length. We also introduce CREST which is a framework for unifying a collection of scattered datasets of causal relations.


title: Exploiting Class Similarity for Machine Learning with Confidence Labels and Projective Loss Functions

abstract: Class labels used for machine learning are relatable to each other, with certain class labels being more similar to each other than others (e.g. images of cats and dogs are more similar to each other than those of cats and cars). Such similarity among classes is often the cause of poor model performance due to the models confusing between them. Current labeling techniques fail to explicitly capture such similarity information. In this paper, we instead exploit the similarity between classes by capturing the similarity information with our novel confidence labels. Confidence labels are probabilistic labels denoting the likelihood of similarity, or confusability, between the classes. Often even after models are trained to differentiate between classes in the feature space, the similar classes' latent space still remains clustered. We view this type of clustering as valuable information and exploit it with our novel projective loss functions. Our projective loss functions are designed to work with confidence labels with an ability to relax the loss penalty for errors that confuse similar classes. We use our approach to train neural networks with noisy labels, as we believe noisy labels are partly a result of confusability arising from class similarity. We show improved performance compared to the use of standard loss functions. We conduct a detailed analysis using the CIFAR-10 dataset and show our proposed methods' applicability to larger datasets, such as ImageNet and Food-101N.


title: Arbitrarily high-order conservative schemes for the generalized Korteweg-de Vries equation

abstract: This paper proposes a new class of arbitrarily high-order conservative numerical schemes for the generalized Korteweg-de Vries (KdV) equation. This approach is based on the scalar auxiliary variable (SAV) method. The equation is reformulated into an equivalent system by introducing a scalar auxiliary variable, and the energy is reformulated into a sum of two quadratic terms. Therefore, the quadratic preserving Runge-Kutta method will preserve all the three invariants (momentum, mass and the reformulated energy) in the discrete time flow (assuming the spatial variable is continuous). With the Fourier pseudo-spectral spatial discretization, the scheme conserves the first and third invariant quantities (momentum and energy) exactly in the space-time full discrete sense. The discrete mass possesses the precision of the spectral accuracy. Our numerical experiment shows the great efficiency of this scheme in simulating the breathers for the mKdV equation.


title: On the boundedness of canonical models

abstract: It is conjectured that the canonical models of varieties (not of general type) are bounded when the Iitaka volume is fixed. We confirm this conjecture when the general fibers of the corresponding Iitaka fibration are in a fixed bounded family of polarized Calabi-Yau pairs.


title: An Approach to Improve Robustness of NLP Systems against ASR Errors

abstract: Speech-enabled systems typically first convert audio to text through an automatic speech recognition (ASR) model and then feed the text to downstream natural language processing (NLP) modules. The errors of the ASR system can seriously downgrade the performance of the NLP modules. Therefore, it is essential to make them robust to the ASR errors. Previous work has shown it is effective to employ data augmentation methods to solve this problem by injecting ASR noise during the training process. In this paper, we utilize the prevalent pre-trained language model to generate training samples with ASR-plausible noise. Compare to the previous methods, our approach generates ASR noise that better fits the real-world error distribution. Experimental results on spoken language translation(SLT) and spoken language understanding (SLU) show that our approach effectively improves the system robustness against the ASR errors and achieves state-of-the-art results on both tasks.


title: Tomography in the presence of stray inter-qubit coupling

abstract: Tomography is an indispensable part of quantum computation as it enables diagnosis of a quantum process through state reconstruction. Existing tomographic protocols are based on determining expectation values of various Pauli operators which typically require single-qubit rotations. However, in realistic systems, qubits often develop some form of unavoidable stray coupling making it difficult to manipulate one qubit independent of its partners. Consequently, standard protocols applied to those systems result in unfaithful reproduction of the true quantum state. We have developed a protocol, called coupling compensated tomography, that can correct for errors due to parasitic couplings completely in software and accurately determine the quantum state. We demonstrate the performance of our scheme on a system of two transmon qubits with always-on $\textit{ZZ}$ coupling. Our technique is a generic tomography tool that can be applied to large systems with different types of stray inter-qubit couplings and facilitates the use of arbitrary tomography pulses and even non-orthogonal axes of rotation.


title: THAT: Two Head Adversarial Training for Improving Robustness at Scale

abstract: Many variants of adversarial training have been proposed, with most research focusing on problems with relatively few classes. In this paper, we propose Two Head Adversarial Training (THAT), a two-stream adversarial learning network that is designed to handle the large-scale many-class ImageNet dataset. The proposed method trains a network with two heads and two loss functions; one to minimize feature-space domain shift between natural and adversarial images, and one to promote high classification accuracy. This combination delivers a hardened network that achieves state of the art robust accuracy while maintaining high natural accuracy on ImageNet. Through extensive experiments, we demonstrate that the proposed framework outperforms alternative methods under both standard and "free" adversarial training settings.


title: Gaussian Guided IoU: A Better Metric for Balanced Learning on Object Detection

abstract: For most of the anchor-based detectors, Intersection over Union(IoU) is widely utilized to assign targets for the anchors during training. However, IoU pays insufficient attention to the closeness of the anchor's center to the truth box's center. This results in two problems: (1) only one anchor is assigned to most of the slender objects which leads to insufficient supervision information for the slender objects during training and the performance on the slender objects is hurt; (2) IoU can not accurately represent the alignment degree between the receptive field of the feature at the anchor's center and the object. Thus during training, some features whose receptive field aligns better with objects are missing while some features whose receptive field aligns worse with objects are adopted. This hurts the localization accuracy of models. To solve these problems, we firstly design Gaussian Guided IoU(GGIoU) which focuses more attention on the closeness of the anchor's center to the truth box's center. Then we propose GGIoU-balanced learning method including GGIoU-guided assignment strategy and GGIoU-balanced localization loss. The method can assign multiple anchors for each slender object and bias the training process to the features well-aligned with objects. Extensive experiments on the popular benchmarks such as PASCAL VOC and MS COCO demonstrate GGIoU-balanced learning can solve the above problems and substantially improve the performance of the object detection model, especially in the localization accuracy.


title: Towards improving architectural diagram consistency using system descriptors

abstract: Communication between practitioners is essential for the system's quality in the DevOps context. To improve this communication, practitioners often use informal diagrams to represent the components of a system. However, as systems evolve, it is a challenge to synchronize diagrams with production environments consistently. Hence, the inconsistency of architectural diagrams can affect communication between practitioner and their understanding of systems. In this paper, we propose the use of system descriptors to improve deployment diagram consistency. We state two main hypotheses: (1) if an architectural diagram is generated from a valid system descriptor, then the diagram is consistent; (2) if a valid system descriptor is generated from an architectural diagram, then the diagram is consistent. We report a case study to explore our hypotheses. Furthermore, we constructed a system descriptor from the Netflix deployment diagram, and we applied our tool to generate a new architectural diagram. Finally, we compare the original and generated diagrams to evaluate our proposal. Our case study shows all Docker compose description elements can be graphically represented in the generated architectural diagram, and the generated diagram does not present inconsistent aspects of the original diagram. Thus, our preliminary results lead to further evaluation in controlled and empirical experiments to test our hypotheses.


title: A map of approaches to temporal networks

abstract: The study of temporal networks is motivated by the simple and important observation that just as network structure can affect dynamics, so can structure in time. Just as network topology can teach us about the system in question, so can its temporal characteristics. In many cases, leaving out either one of these components would lead to an incomplete understanding of the system or poor predictions. We argue that including time into network modeling inevitably leads researchers away from the trodden paths of network science. Temporal network theory requires something different -- new methods, new concepts, new questions -- compared to static networks. In this introductory chapter, we overview the ideas that the field of temporal networks has brought forward in the last decade. We also place the contributions to the current volume on this map of temporal-network approaches.


title: Linear growth of translation lengths of random isometries on Gromov hyperbolic spaces and Teichm\"uller spaces

abstract: We investigate the translation lengths of group elements that arise in random walks on the isometry groups of Gromov hyperbolic spaces. In particular, without any moment condition, we prove that non-elementary random walks exhibit at least linear growth of translation lengths. As a corollary, almost every random walk on mapping class groups eventually becomes pseudo-Anosov and almost every random walk on $\mathrm{Out}(F_n)$ eventually becomes fully irreducible. If the underlying measure further has finite first moment, then the growth rate of translation lengths is equal to the drift, the escape rate of the random walk. We then apply our technique to investigate the random walks induced by the action of mapping class groups on Teichm{\"u}ller spaces. In particular, we prove the spectral theorem under finite first moment condition, generalizing a result of Dahmani and Horbez.


title: Exotic Image Formation in Strong Gravitational Lensing by Clusters of Galaxies -- II: Uncertainties

abstract: Due to the finite amount of observational data, the best-fit parameters corresponding to the reconstructed cluster mass have uncertainties. In turn, these uncertainties affect the inferences made from these mass models. Following our earlier work, we have studied the effect of such uncertainties on the singularity maps in simulated and actual galaxy clusters. The mass models for both simulated and real clusters have been constructed using grale. The final best-fit mass models created using grale give the simplest singularity maps and a lower limit on the number of point singularities that a lens has to offer. The simple nature of these singularity maps also puts a lower limit on the number of three image (tangential and radial) arcs that a cluster lens has. Hence, we estimate the number of galaxy sources giving rise to the three image arcs, which can be observed with the James Webb Space Telescope (JWST). We find that we expect to observe at least 20-30 tangential and 5-10 radial three-image arcs in the Hubble Frontier Fields cluster lenses with the JWST.


title: Constraints on $\Lambda$CDM Extensions from the SPT-3G 2018 $EE$ and $TE$ Power Spectra

abstract: We present constraints on extensions to the $\Lambda$CDM cosmological model from measurements of the $E$-mode polarization auto-power spectrum and the temperature-$E$-mode cross-power spectrum of the cosmic microwave background (CMB) made using 2018 SPT-3G data. The extensions considered vary the primordial helium abundance, the effective number of relativistic degrees of freedom, the sum of neutrino masses, the relativistic energy density and mass of a sterile neutrino, and the mean spatial curvature. We do not find clear evidence for any of these extensions, from either the SPT-3G 2018 dataset alone or in combination with baryon acoustic oscillation and \textit{Planck} data. None of these model extensions significantly relax the tension between Hubble-constant, $H_0$, constraints from the CMB and from distance-ladder measurements using Cepheids and supernovae. The addition of the SPT-3G 2018 data to \textit{Planck} reduces the square-root of the determinants of the parameter covariance matrices by factors of $1.3 - 2.0$ across these models, signaling a substantial reduction in the allowed parameter volume. We also explore CMB-based constraints on $H_0$ from combined SPT, \textit{Planck}, and ACT DR4 datasets. While individual experiments see some indications of different $H_0$ values between the $TT$, $TE$, and $EE$ spectra, the combined $H_0$ constraints are consistent between the three spectra. For the full combined datasets, we report $H_0 = 67.49 \pm 0.53\,\mathrm{km\,s^{-1}\,Mpc^{-1}}$, which is the tightest constraint on $H_0$ from CMB power spectra to date and in $4.1\,\sigma$ tension with the most precise distance-ladder-based measurement of $H_0$. The SPT-3G survey is planned to continue through at least 2023, with existing maps of combined 2019 and 2020 data already having $\sim3.5\times$ lower noise than the maps used in this analysis.


title: Asymptotic formula for balanced words

abstract: We give asymptotic formulas for the number of balanced words whose slope $\alpha$ and intercept $\rho$ lie in a prescribed rectangle. They are related to uniform distribution of Farey fractions and Riemann Hypothesis. In the general case, the error term is deduced using an inequality of large sieve type.


title: SubSpectral Normalization for Neural Audio Data Processing

abstract: Convolutional Neural Networks are widely used in various machine learning domains. In image processing, the features can be obtained by applying 2D convolution to all spatial dimensions of the input. However, in the audio case, frequency domain input like Mel-Spectrogram has different and unique characteristics in the frequency dimension. Thus, there is a need for a method that allows the 2D convolution layer to handle the frequency dimension differently. In this work, we introduce SubSpectral Normalization (SSN), which splits the input frequency dimension into several groups (sub-bands) and performs a different normalization for each group. SSN also includes an affine transformation that can be applied to each group. Our method removes the inter-frequency deflection while the network learns a frequency-aware characteristic. In the experiments with audio data, we observed that SSN can efficiently improve the network's performance.


title: The source of the major solar energetic particle events from super active region 11944

abstract: Shock waves associated with fast coronal mass ejections (CMEs) accelerate solar energetic particles (SEPs) in the long duration, gradual events that pose hazards to crewed spaceflight and near-Earth technological assets, but the source of the CME shock-accelerated plasma is still debated. Here, we use multi-messenger observations from the Heliophysics System Observatory to identify plasma confined at the footpoints of the hot, core loops of active region 11944 as the source of major gradual SEP events in January 2014. We show that the elemental composition signature detected spectroscopically at the footpoints explains the measurements made by particle counting techniques near Earth. Our results localize the elemental fractionation process to the top of the chromosphere. The plasma confined closest to that region, where the coronal magnetic field strength is high (a few hundred Gauss), develops the SEP composition signature. This source material is continually released from magnetic confinement and accelerated as SEPs following M-, C-, and X-class flares.


title: Contextual Information Enhanced Convolutional Neural Networks for Retinal Vessel Segmentation in Color Fundus Images

abstract: Accurate retinal vessel segmentation is a challenging problem in color fundus image analysis. An automatic retinal vessel segmentation system can effectively facilitate clinical diagnosis and ophthalmological research. Technically, this problem suffers from various degrees of vessel thickness, perception of details, and contextual feature fusion. For addressing these challenges, a deep learning based method has been proposed and several customized modules have been integrated into the well-known encoder-decoder architecture U-net, which is mainly employed in medical image segmentation. Structurally, cascaded dilated convolutional modules have been integrated into the intermediate layers, for obtaining larger receptive field and generating denser encoded feature maps. Also, the advantages of the pyramid module with spatial continuity have been taken, for multi-thickness perception, detail refinement, and contextual feature fusion. Additionally, the effectiveness of different normalization approaches has been discussed in network training for different datasets with specific properties. Experimentally, sufficient comparative experiments have been enforced on three retinal vessel segmentation datasets, DRIVE, CHASEDB1, and the unhealthy dataset STARE. As a result, the proposed method outperforms the work of predecessors and achieves state-of-the-art performance in Sensitivity/Recall, F1-score and MCC.