title: THz emission from a Bi2Sr2CaCu2O8+{\delta} cross-whisker junction

abstract: Cuprate superconductor Bi2Sr2CaCu2O8+{\delta} (BSCCO) has been a promising candidate of a coherent, continuous, and compact THz light source owing to its intrinsic Josephson junction inside the crystal structure. In this paper, we utilized BSCCO cross-whisker junctions to produce THz emitter device using the whisker crystals which can be easily obtained compared with single crystals. As a result, we have successfully observed the emission from the cross-whisker intrinsic Josephson junction, with frequency of ~0.7 THz. Our findings might enlarge the applicability of BSCCO superconductors for the THz emission source.


title: Quantum Annealed Criticality: A Scaling Description

abstract: Experimentally there exist many materials with first-order phase transitions at finite temperature that display quantum criticality. Classically, a strain-energy density coupling is known to drive first-order transitions in compressible systems, and here we generalize this Larkin-Pikin mechanism to the quantum case. We show that if the T=0 system lies above its upper critical dimension, the line of first-order transitions ends in a "quantum annealed critical point" where zero-point fluctuations restore the underlying criticality of the order parameter. The generalized Larkin-Pikin phase diagram is presented and experimental consequences are discussed.


title: Margin-Based Transfer Bounds for Meta Learning with Deep Feature Embedding

abstract: By transferring knowledge learned from seen/previous tasks, meta learning aims to generalize well to unseen/future tasks. Existing meta-learning approaches have shown promising empirical performance on various multiclass classification problems, but few provide theoretical analysis on the classifiers' generalization ability on future tasks. In this paper, under the assumption that all classification tasks are sampled from the same meta-distribution, we leverage margin theory and statistical learning theory to establish three margin-based transfer bounds for meta-learning based multiclass classification (MLMC). These bounds reveal that the expected error of a given classification algorithm for a future task can be estimated with the average empirical error on a finite number of previous tasks, uniformly over a class of preprocessing feature maps/deep neural networks (i.e. deep feature embeddings). To validate these bounds, instead of the commonly-used cross-entropy loss, a multi-margin loss is employed to train a number of representative MLMC models. Experiments on three benchmarks show that these margin-based models still achieve competitive performance, validating the practical value of our margin-based theoretical analysis.


title: SChME at SemEval-2020 Task 1: A Model Ensemble for Detecting Lexical Semantic Change

abstract: This paper describes SChME (Semantic Change Detection with Model Ensemble), a method usedin SemEval-2020 Task 1 on unsupervised detection of lexical semantic change. SChME usesa model ensemble combining signals of distributional models (word embeddings) and wordfrequency models where each model casts a vote indicating the probability that a word sufferedsemantic change according to that feature. More specifically, we combine cosine distance of wordvectors combined with a neighborhood-based metric we named Mapped Neighborhood Distance(MAP), and a word frequency differential metric as input signals to our model. Additionally,we explore alignment-based methods to investigate the importance of the landmarks used in thisprocess. Our results show evidence that the number of landmarks used for alignment has a directimpact on the predictive performance of the model. Moreover, we show that languages that sufferless semantic change tend to benefit from using a large number of landmarks, whereas languageswith more semantic change benefit from a more careful choice of landmark number for alignment.


title: Going Beyond Classification Accuracy Metrics in Model Compression

abstract: With the rise in edge-computing devices, there has been an increasing demand to deploy energy and resource-efficient models. A large body of research has been devoted to developing methods that can reduce the size of the model considerably without affecting the standard metrics such as top-1 accuracy. However, these pruning approaches tend to result in a significant mismatch in other metrics such as fairness across classes and explainability. To combat such misalignment, we propose a novel multi-part loss function inspired by the knowledge-distillation literature. Through extensive experiments, we demonstrate the effectiveness of our approach across different compression algorithms, architectures, tasks as well as datasets. In particular, we obtain up to $4.1\times$ reduction in the number of prediction mismatches between the compressed and reference models, and up to $5.7\times$ in cases where the reference model makes the correct prediction; all while making no changes to the compression algorithm, and minor modifications to the loss function. Furthermore, we demonstrate how inducing simple alignment between the predictions of the models naturally improves the alignment on other metrics including fairness and attributions. Our framework can thus serve as a simple plug-and-play component for compression algorithms in the future.


title: A disturbance corrected point-particle approach for two-way coupled particle-laden flows on arbitrary shaped grids

abstract: A general, two-way coupled, point-particle formulation that accounts for the disturbance created by the dispersed particles in obtaining the undisturbed fluid flow field needed for accurate computation of the force closure models is presented. Specifically, equations for the disturbance field created by the presence of particles are first derived based on the inter-phase momentum coupling force in a finite-volume formulation. Solution to the disturbance field is obtained using two approaches: (i) direct computation of the disturbance velocity and pressure using the reaction force due to particles at computational control volumes, and (ii) a linearized, approximate computation of the disturbance velocity field, specifically applicable for low Reynolds number flows. In both approaches, the computed disturbance field is used to obtain the undisturbed fluid velocity necessary to model the aerodynamic forces on the particle. The two approaches are thoroughly evaluated for a single particle in an unbounded and wall-bounded flow on uniform, anisotropic, as well as unstructured grids to show accurate computation of the particle motion and inter-phase coupling. The approach is straightforward and can be applied to any numerical formulation for particle-laden flows including Euler-Lagrange as well as Euler-Euler formulations.


title: Domain Adaptation with Incomplete Target Domains

abstract: Domain adaptation, as a task of reducing the annotation cost in a target domain by exploiting the existing labeled data in an auxiliary source domain, has received a lot of attention in the research community. However, the standard domain adaptation has assumed perfectly observed data in both domains, while in real world applications the existence of missing data can be prevalent. In this paper, we tackle a more challenging domain adaptation scenario where one has an incomplete target domain with partially observed data. We propose an Incomplete Data Imputation based Adversarial Network (IDIAN) model to address this new domain adaptation challenge. In the proposed model, we design a data imputation module to fill the missing feature values based on the partial observations in the target domain, while aligning the two domains via deep adversarial adaption. We conduct experiments on both cross-domain benchmark tasks and a real world adaptation task with imperfect target domains. The experimental results demonstrate the effectiveness of the proposed method.


title: On the Near-Critical Behavior of Continuous Polymers

abstract: The aim of this paper is to investigate the distribution of a continuous polymer in the presence of an attractive finitely supported potential. The most intricate behavior can be observed if we simultaneously and independently vary two parameters: the temperature, which approaches the critical value, and the length of the polymer chain, which tends to infinity. We describe how the typical size of the polymer depends on the two parameters.


title: Obstacle Avoidance Using a Monocular Camera

abstract: A collision avoidance system based on simple digital cameras would help enable the safe integration of small UAVs into crowded, low-altitude environments. In this work, we present an obstacle avoidance system for small UAVs that uses a monocular camera with a hybrid neural network and path planner controller. The system is comprised of a vision network for estimating depth from camera images, a high-level control network, a collision prediction network, and a contingency policy. This system is evaluated on a simulated UAV navigating an obstacle course in a constrained flight pattern. Results show the proposed system achieves low collision rates while maintaining operationally relevant flight speeds.


title: Overview and Reassessment of Noise Budget of Starshade Exoplanet Imaging

abstract: High-contrast imaging enabled by a starshade in formation flight with a space telescope can provide a near-term pathway to search for and characterize temperate and small planets of nearby stars. NASA's Starshade Technology Development Activity to TRL5 (S5) is rapidly maturing the required technologies to the point at which starshades could be integrated into potential future missions. Here we reappraise the noise budget of starshade-enabled exoplanet imaging to incorporate the experimentally demonstrated optical performance of the starshade and its optical edge. Our analyses of stray light sources - including the leakage through micrometeoroid damage and the reflection of bright celestial bodies - indicate that sunlight scattered by the optical edge (i.e., the solar glint) is by far the dominant stray light. With telescope and observation parameters that approximately correspond to Starshade Rendezvous with Roman and HabEx, we find that the dominating noise source would be exozodiacal light for characterizing a temperate and Earth-sized planet around Sun-like and earlier stars and the solar glint for later-type stars. Further reducing the brightness of solar glint by a factor of 10 with a coating would prevent it from becoming the dominant noise for both Roman and HabEx. With an instrument contrast of 1E-10, the residual starlight is not a dominant noise; and increasing the contrast level by a factor 10 would not lead to any appreciable change in the expected science performance. If unbiased calibration of the background to the photon-noise limit can be achieved, Starshade Rendezvous with Roman could provide nearly photon-limited spectroscopy of temperate and Earth-sized planets of F, G, and K stars <4 parsecs away, and HabEx could extend this capability to many more stars <8 parsecs. (Abridged)


title: Structure of wavefunction for interacting bosons in mean-field with random $k$-body interactions

abstract: Wavefunction structure is analyzed for dense interacting many-boson systems using Hamiltonian $H$, which is a sum of one-body $h(1)$ and an embedded GOE of $k$-body interaction $V(k)$ with strength $\lambda$. In the first analysis, a complete analytical description of the variance of the strength function as a function of $\lambda$ and $k$ is derived and the marker $\lambda_t$ defining thermalization region is obtained. In the strong coupling limit ($\lambda > \lambda_t$), the conditional $q$-normal density describes Gaussian to semi-circle transition in strength functions as body rank $k$ of the interaction increases. In the second analysis, this interpolating form of the strength function is utilized to describe the fidelity decay after $k$-body interaction quench and also to obtain the smooth form for the number of principal components, a measure of chaos in finite interacting many-particle systems. The smooth form very well describes embedded ensemble results for all $k$ values.


title: Equation of state from symmetry

abstract: Equation of state (EOS) describes the thermodynamic properties of substances. It has important applications in many fields such as power mechanics, geophysics, astrophysics, and detonation physics. Currently, most EOSs have been constructed using the ideal gas EOS as the base framework. However, this is inappropriate for the substances with high pressures or low temperatures that are far from the ideal gas state. Here we extract a concept of "ideal solid" that is symmetrical with ideal gas and propose its EOS. We verify that the ideal solid EOS represents the thermodynamic properties of the high-pressure and low-temperature limiting state. It indicates that the thermodynamic properties of substances have symmetrical characteristic. Then we develop a universal model by interpolation of the ideal gas and the ideal solid limits. We verify that the universal EOS has high description accuracy in a wide region. The concept of ideal solid and its EOS potentially provides a new direction for the development of the EOS theory.


title: Phase field model for self-climb of prismatic dislocation loops by vacancy pipe diffusion

abstract: In this paper, we present a phase field model for the self-climb motion of prismatic dislocation loops via vacancy pipe diffusion driven by elastic interactions. This conserved dynamics model is developed under the framework of the Cahn-Hilliard equation with incorporation of the climb force on dislocations, and is based on the dislocation self-climb velocity formulation established in Ref.[1]. The phase field model has the advantage of being able to handle the topological and geometrical changes automatically during the simulations. Asymptotic analysis shows that the proposed phase field model gives the dislocation self-climb velocity accurately in the sharp interface limit. Numerical simulations of evolution, translation, coalescence and repelling of prismatic loops by self-climb show excellent agreement with discrete dislocation dynamics simulation results and the experimental observation.


title: Investigating climate tipping points under various emission reduction and carbon capture scenarios with a stochastic climate model

abstract: We study the mitigation of climate tipping point transitions using an energy balance model. The evolution of the global mean surface temperature is coupled with the CO2 concentration through the green house effect. We model the CO2 concentration with a stochastic delay differential equation (SDDE), accounting for various carbon emission and capture scenarios. The resulting coupled system of SDDEs exhibits a tipping point phenomena: if CO2 concentration exceeds a critical threshold (around 478ppm), the temperature experiences an abrupt increase of about six degrees Celsius. We show that the CO2 concentration exhibits a transient growth which may cause a climate tipping point, even if the concentration decays asymptotically. We derive a rigorous upper bound for the CO2 evolution which quantifies its transient and asymptotic growths, and provides sufficient conditions for evading the climate tipping point. Combining this upper bound with Monte Carlo simulations of the stochastic climate model, we investigate the emission reduction and carbon capture scenarios that would avert the tipping point.


title: Explainable AI for Software Engineering

abstract: Artificial Intelligence/Machine Learning techniques have been widely used in software engineering to improve developer productivity, the quality of software systems, and decision-making. However, such AI/ML models for software engineering are still impractical, not explainable, and not actionable. These concerns often hinder the adoption of AI/ML models in software engineering practices. In this article, we first highlight the need for explainable AI in software engineering. Then, we summarize three successful case studies on how explainable AI techniques can be used to address the aforementioned challenges by making software defect prediction models more practical, explainable, and actionable.


title: Multiply robust estimation of causal effects under principal ignorability

abstract: Causal inference concerns not only the average effect of the treatment on the outcome but also the underlying mechanism through an intermediate variable of interest. Principal stratification characterizes such a mechanism by targeting subgroup causal effects within principal strata, which are defined by the joint potential values of an intermediate variable. Due to the fundamental problem of causal inference, principal strata are inherently latent, rendering it challenging to identify and estimate subgroup effects within them. A line of research leverages the principal ignorability assumption that the latent principal strata are mean independent of the potential outcomes conditioning on the observed covariates. Under principal ignorability, we derive various nonparametric identification formulas for causal effects within principal strata in observational studies, which motivate estimators relying on the correct specifications of different parts of the observed-data distribution. Appropriately combining these estimators yields triply robust estimators for the causal effects within principal strata. These triply robust estimators are consistent if two of the treatment, intermediate variable, and outcome models are correctly specified, and moreover, they are locally efficient if all three models are correctly specified. We show that these estimators arise naturally from either the efficient influence functions in the semiparametric theory or the model-assisted estimators in the survey sampling theory. We evaluate different estimators based on their finite-sample performance through simulation and apply them to two observational studies.


title: Compositional Effects in Thermal, Compositional and Reactive Simulation

abstract: This work studies the influence of several compositional effects on thermal and reactive processes. First, the impact of using a fully compositional model in the context of thermal simulations is considered. Detailed phase behavior models rely on compositional descriptions of the oil using up to tens of components. Lumping a large number of components into a smaller number of pseudo-components in order to reduce the computational cost is standard practice for thermal simulations. Lumping schemes are typically calibrated using experimental data, in order to achieve a good approximation of the phase behavior of the initial oil. Due to the evaporation and condensation of components under thermal stimulation, the oil composition will widely vary in time and space. This works illustrates that even if the lumped schemes were able to capture the phase behavior of the initial oil, the lack of resolution can lead to modeling artefacts and/or fail to capture the relevant displacement processes. Then, the effects of different compositional interpretations of the lumped pseudo-species appearing in typical reaction schemes are investigated. A constant, mass-based fraction of the oil is allowed to react, and the reactive components are modified. Due to molecular weight effects, the reaction rate is larger when light and medium components are allowed to react. Those effects result in an increased displacement, leading to faster fronts, larger oil banks and more pressurization of the system.


title: Symbolic Rees algebras

abstract: We survey old and new approaches to the study of symbolic powers of ideals. Our focus is on the symbolic Rees algebra of an ideal, viewed both as a tool to investigate its symbolic powers and as a source of challenging problems in its own right. We provide an invitation to this area of investigation by stating several open questions.


title: Matrix Completion Methods for the Total Electron Content Video Reconstruction

abstract: The total electron content (TEC) maps can be used to estimate the signal delay of GPS due to the ionospheric electron content between a receiver and satellite. This delay can result in GPS positioning error. Thus it is important to monitor the TEC maps. The observed TEC maps have big patches of missingness in the ocean and scattered small areas of missingness on the land. In this paper, we propose several extensions of existing matrix completion algorithms to achieve TEC map reconstruction, accounting for spatial smoothness and temporal consistency while preserving important structures of the TEC maps. We call the proposed method Video Imputation with SoftImpute, Temporal smoothing and Auxiliary data (VISTA). Numerical simulations that mimic patterns of real data are given. We show that our proposed method achieves better reconstructed TEC maps as compared to existing methods in literature. Our proposed computational algorithm is general and can be readily applied for other problems besides TEC map reconstruction.


title: brolgar: An R package to BRowse Over Longitudinal Data Graphically and Analytically in R

abstract: Longitudinal (panel) data provide the opportunity to examine temporal patterns of individuals, because measurements are collected on the same person at different, and often irregular, time points. The data is typically visualised using a "spaghetti plot", where a line plot is drawn for each individual. When overlaid in one plot, it can have the appearance of a bowl of spaghetti. With even a small number of subjects, these plots are too overloaded to be read easily. The interesting aspects of individual differences are lost in the noise. Longitudinal data is often modelled with a hierarchical linear model to capture the overall trends, and variation among individuals, while accounting for various levels of dependence. However, these models can be difficult to fit, and can miss unusual individual patterns. Better visual tools can help to diagnose longitudinal models, and better capture the individual experiences. This paper introduces the R package, brolgar (BRowse over Longitudinal data Graphically and Analytically in R), which provides tools to identify and summarise interesting individual patterns in longitudinal data.


title: An obstacle to sub-AdS holography for SYK-like models

abstract: We argue that "stringy" effects in a putative gravity-dual picture for SYK-like models are related to the branching time, a kinetic coefficient defined in terms of the retarded kernel. A bound on the branching time is established assuming that the leading diagrams are ladders with thin rungs. Thus, such models are unlikely candidates for sub-AdS holography. In the weak coupling limit, we derive a relation between the branching time, the Lyapunov exponent, and the quasiparticle lifetime using two different approximations.


title: On Huber's type theorems in general dimensions

abstract: In this paper we present some extensions of the celebrated finite point conformal compactification theorem of Huber \cite{Hu57} for complete open surfaces to general dimensions based on the n-Laplace equations in conformal geometry. We are able to conclude a domain in the round sphere has to be the sphere deleted finitely many points if it can be endowed with a complete conformal metric with the negative part of the smallest Ricci curvature satisfying some integrable conditions. Our proof is based on the strengthened version of the Arsove-Huber's type theorem on n-superharmonic functions in our earlier work \cite{MQ18}. Moreover, using p-parabolicity, we push the injectivity theorem of Schoen-Yau to allow some negative curvature and therefore establish the finite point conformal compactification theorem for manifolds that have a conformal immersion into the round sphere. As a side product we establish the injectivity of conformal immersions from n-parabolicity alone, which is interesting by itself in conformal geometry.


title: The evolution of magnetic dipole strength in $^{100-140}$ Sn isotope chain and quenching of nucleon g factors

abstract: The evolution of electromagnetic transitions along isotope chains is of particular importance for the nuclear structure and dynamics, as well as for the r-process nucleosynthesis. Recent measurement of inelastic proton scattering on even-even $^{112-124}$Sn isotopes provides a novel insight into the isotopic dependence of E1 and M1 strength distributions. We investigate M1 transitions in even-even $^{100-140}$Sn isotopes from a theoretical perspective, based on relativistic nuclear energy density functional. The M1 transition strength distribution is characterized by an interplay between single and double-peak structures, that can be understood from the evolution of single-particle states, their occupations governed by the pairing correlations, and two-quasiparticle transitions involved. It is shown that discrepancy between model calculations and experiment on B(M1) transition strength is considerably reduced than previously known, and the quenching of the g-factors for the free nucleons needed to reproduce the experimental data on M1 transition strength amounts $g_{eff}/g_{free}$=0.80-0.93. Since some of the B(M1) strength above the neutron threshold may be missing in the inelastic proton scattering measurement, further experimental studies are required to confirm if only small modifications of the bare g-factors are actually needed when applied in finite nuclei.


title: Bull and Bear Markets During the COVID-19 Pandemic

abstract: The COVID-19 pandemic has caused severe disruption to economic and financial activity worldwide. We assess what happened to the aggregate U.S. stock market during this period, including implications for both short and long-horizon investors. Using the model of Maheu, McCurdy and Song (2012), we provide smoothed estimates and out-of-sample forecasts associated with stock market dynamics during the pandemic. We identify bull and bear market regimes including their bull correction and bear rally components, demonstrate the model's performance in capturing periods of significant regime change, and provide forecasts that improve risk management and investment decisions. The paper concludes with out-of-sample forecasts of market states one year ahead.


title: Quantum block lookahead adders and the wait for magic states

abstract: We improve the Toffoli count of low depth quantum adders, and analyze how their spacetime cost reacts to having a limited number of magic state factories. We present a block lookahead adder that parallelizes across blocks of bits of size $b$, instead of over all bits. The block lookahead adder achieves a Toffoli count of $3n + 5n/b$ for out of place addition (vs $4n$ in previous work by Thapliyal et al) and $5n + 8n/b$ for in place addition (vs $7n$ in previous work by Thapliyal et al). The tradeoff is that the reaction depth of these circuits depends linearly on $b$, and they use additional workspace. We estimate the spacetime volume of these adders, and adders from previous work, for various register sizes and factory counts under plausible assumptions for a large scale quantum computer based on the surface code and superconducting qubits.


title: Quantum computational advantage using photons

abstract: Gaussian boson sampling exploits squeezed states to provide a highly efficient way to demonstrate quantum computational advantage. We perform experiments with 50 input single-mode squeezed states with high indistinguishability and squeezing parameters, which are fed into a 100-mode ultralow-loss interferometer with full connectivity and random transformation, and sampled using 100 high-efficiency single-photon detectors. The whole optical set-up is phase-locked to maintain a high coherence between the superposition of all photon number states. We observe up to 76 output photon-clicks, which yield an output state space dimension of $10^{30}$ and a sampling rate that is $10^{14}$ faster than using the state-of-the-art simulation strategy and supercomputers. The obtained samples are validated against various hypotheses including using thermal states, distinguishable photons, and uniform distribution.


title: Rigid-profile input scheduling under constrained dynamics with a water network application

abstract: The motivation for this work stems from the problem of scheduling requests for flow at supply points along an automated network of open-water channels. The off-take flows are rigid-profile inputs to the system dynamics. In particular, the channel operator can only shift orders in time to satisfy constraints on the automatic response to changes in the load. This leads to a non-convex semi-infinite programming problem, with sum-separable cost that encodes the collective sensitivity of end users to scheduling delays. The constraints encode the linear time-invariant continuous-time dynamics and limits on the state across a \al{continuous} scheduling horizon. Discretization is used to arrive at a more manageable approximation of the semi-infinite program. A method for parsimoniously refining the discretization is applied to ensure continuous-time feasibility for solutions of the approximate problem. It is then shown how to improve cost without loss of feasibility. Supporting analysis is provided, along with simulation results for a realistic irrigation channel setup to illustrate the approach.


title: A combinatorial formula for the nabla operator

abstract: We present an LLT-type formula for a general power of the nabla operator applied to the Cauchy product for the modified Macdonald polynomials, and use it to deduce a new proof of the generalized shuffle theorem describing $\nabla^k e_n$, and the Elias-Hogancamp formula for $(\nabla^k p_1^n,e_n)$ as corollaries. We give a direct proof of the theorem by verifying that the LLT expansion satisfies the defining properties of $\nabla^k$, such as triangularity in the dominance order, as well as a geometric proof based on a method for counting bundles on $\mathbb{P}^1$ due to the second author. These formulas are related to an affine paving of the type A unramified affine Springer fiber studied by Goresky, Kottwitz, and MacPherson, and also to Stanley's chromatic symmetric functions.


title: Multivariate Difference Gon\v{c}arov Polynomials

abstract: Univariate delta Gon\v{c}arov polynomials arise when the classical Gon\v{c}arov interpolation problem in numerical analysis is modified by replacing derivatives with delta operators. When the delta operator under consideration is the backward difference operator, we acquire the univariate difference Gon\v{c}arov polynomials, which have a combinatorial relation to lattice paths in the plane with a given right boundary. In this paper, we extend several algebraic and analytic properties of univariate difference Gon\v{c}arov polynomials to the multivariate case. We then establish a combinatorial interpretation of multivariate difference Gon\v{c}arov polynomials in terms of certain constraints on $d$-tuples of non-decreasing integer sequences. This motivates a connection between multivariate difference Gon\v{c}arov polynomials and a higher-dimensional generalized parking function, the $\boldsymbol{U}$-parking function, from which we derive several enumerative results based on the theory of multivariate delta Gon\v{c}arov polynomials.


title: Design and verification of the HXI collimator onboard the ASO-S mission

abstract: A space-borne hard X-ray collimator, comprising 91 pairs of grids, has been developed for the Hard X-ray Imager (HXI). The HXI is one of the three scientific instruments onboard the first Chinese solar mission: the Advanced Space-based Solar Observatory (ASO-S). The HXI collimator (HXI-C) is a spatial modulation X-ray telescope designed to observe hard X-rays emitted by energetic electrons in solar flares. This paper presents the detailed design of the HXI-C for the qualification model that will be inherited by the flight model. Series tests on the HXI-C qualification model are reported to verify the ability of the HXI-C to survive the launch and to operate normally in on-orbit environments. Furthermore, results of the X-ray beam test for the HXI-C are presented to indirectly identify the working performance of the HXI-C.


title: A Single Sensor Based Multispectral Imaging Camera using a Narrow Spectral Band Colour Mosaic Integrated on the Monochrome CMOS Image Sensor

abstract: A multispectral image camera captures image data within specific wavelength ranges in narrow wavelength bands across the electromagnetic spectrum. Images from a multispectral camera can extract additional information that the human eye or a normal camera fails to capture and thus may have important applications in precision agriculture, forestry, medicine and object identification. Conventional multispectral cameras are made up of multiple image sensors each fitted with a narrow passband wavelength filter and optics, which makes them heavy, bulky, power hungry and very expensive. The multiple optics also create image co-registration problem. Here, we demonstrate a single sensor based three band multispectral camera using a narrow spectral band RGB colour mosaic in a Bayer pattern integrated on a monochrome CMOS sensor. The narrow band colour mosaic is made of a hybrid combination of plasmonic colour filters and heterostructured dielectric multilayer. The demonstrated camera technology has reduced cost, weight, size and power by almost n times (where n is the number of bands) compared to a conventional multispectral camera.


title: Circles are like Ellipses, or Ellipses are like Circles? Measuring the Degree of Asymmetry of Static and Contextual Embeddings and the Implications to Representation Learning

abstract: Human judgments of word similarity have been a popular method of evaluating the quality of word embedding. But it fails to measure the geometry properties such as asymmetry. For example, it is more natural to say "Ellipses are like Circles" than "Circles are like Ellipses". Such asymmetry has been observed from a psychoanalysis test called word evocation experiment, where one word is used to recall another. Although useful, such experimental data have been significantly understudied for measuring embedding quality. In this paper, we use three well-known evocation datasets to gain insights into asymmetry encoding of embedding. We study both static embedding as well as contextual embedding, such as BERT. Evaluating asymmetry for BERT is generally hard due to the dynamic nature of embedding. Thus, we probe BERT's conditional probabilities (as a language model) using a large number of Wikipedia contexts to derive a theoretically justifiable Bayesian asymmetry score. The result shows that contextual embedding shows randomness than static embedding on similarity judgments while performing well on asymmetry judgment, which aligns with its strong performance on "extrinsic evaluations" such as text classification. The asymmetry judgment and the Bayesian approach provides a new perspective to evaluate contextual embedding on intrinsic evaluation, and its comparison to similarity evaluation concludes our work with a discussion on the current state and the future of representation learning.


title: Single-shot Path Integrated Panoptic Segmentation

abstract: Panoptic segmentation, which is a novel task of unifying instance segmentation and semantic segmentation, has attracted a lot of attention lately. However, most of the previous methods are composed of multiple pathways with each pathway specialized to a designated segmentation task. In this paper, we propose to resolve panoptic segmentation in single-shot by integrating the execution flows. With the integrated pathway, a unified feature map called Panoptic-Feature is generated, which includes the information of both things and stuffs. Panoptic-Feature becomes more sophisticated by auxiliary problems that guide to cluster pixels that belong to the same instance and differentiate between objects of different classes. A collection of convolutional filters, where each filter represents either a thing or stuff, is applied to Panoptic-Feature at once, materializing the single-shot panoptic segmentation. Taking the advantages of both top-down and bottom-up approaches, our method, named SPINet, enjoys high efficiency and accuracy on major panoptic segmentation benchmarks: COCO and Cityscapes.


title: What Makes a Star Teacher? A Hierarchical BERT Model for Evaluating Teacher's Performance in Online Education

abstract: Education has a significant impact on both society and personal life. With the development of technology, online education has been growing rapidly over the past decade. While there are several online education studies on student behavior analysis, the course concept mining, and course recommendations (Feng, Tang, and Liu 2019; Pan et al. 2017), there is little research on evaluating teachers' performance in online education. In this paper, we conduct a systematic study to understand and effectively predict teachers' performance using the subtitles of 1,085 online courses. Our model-free analysis shows that teachers' verbal cues (e.g., question strategy, emotional appealing, and hedging) and their course structure design are both significantly correlated with teachers' performance evaluation. Based on these insights, we then propose a hierarchical course BERT model to predict teachers' performance in online education. Our proposed model can capture the hierarchical structure within each course as well as the deep semantic features extracted from the course content. Experiment results show that our proposed method achieves significant gain over several state-of-the-art methods. Our study provides a significant social impact in helping teachers improve their teaching style and enhance their instructional material design for more effective online teaching in the future.


title: Rel3D: A Minimally Contrastive Benchmark for Grounding Spatial Relations in 3D

abstract: Understanding spatial relations (e.g., "laptop on table") in visual input is important for both humans and robots. Existing datasets are insufficient as they lack large-scale, high-quality 3D ground truth information, which is critical for learning spatial relations. In this paper, we fill this gap by constructing Rel3D: the first large-scale, human-annotated dataset for grounding spatial relations in 3D. Rel3D enables quantifying the effectiveness of 3D information in predicting spatial relations on large-scale human data. Moreover, we propose minimally contrastive data collection -- a novel crowdsourcing method for reducing dataset bias. The 3D scenes in our dataset come in minimally contrastive pairs: two scenes in a pair are almost identical, but a spatial relation holds in one and fails in the other. We empirically validate that minimally contrastive examples can diagnose issues with current relation detection models as well as lead to sample-efficient training. Code and data are available at https://github.com/princeton-vl/Rel3D.


title: Unify Local and Global Information for Top-$N$ Recommendation

abstract: Knowledge graph (KG), integrating complex information and containing rich semantics, is widely considered as side information to enhance the recommendation systems. However, most of the existing KG-based methods concentrate on encoding the structural information in the graph, without utilizing the collaborative signals in user-item interaction data, which are important for understanding user preferences. Therefore, the representations learned by these models are insufficient for representing semantic information of users and items in the recommendation environment. The combination of both kinds of data provides a good chance to solve this problem. To tackle this research gap, we propose a novel duet representation learning framework named \sysname to fuse local information (user-item interaction data) and global information (external knowledge graph) for the top-$N$ recommendation, which is composed of two separate sub-models. One learns the local representations by discovering the inner correlations in local information with a knowledge-aware co-attention mechanism, and another learns the global representations by encoding the knowledge associations in global information with a relation-aware attention network. The two sub-models are jointly trained as part of the semantic fusion network to compute the user preferences, which discriminates the contribution of the two sub-models under the special context. We conduct experiments on two real-world datasets, and the evaluations show that KADM significantly outperforms state-of-art methods. Further ablation studies confirm that the duet architecture performs significantly better than either sub-model on the recommendation tasks.


title: EBFT: Simplifying BFT Consensus Through Egalitarianism

abstract: We present Egalitarian BFT (EBFT), a simple and high-performance framework of BFT consensus protocols for decentralized systems like blockchains. The key innovation in EBFT is egalitarian block generation: nodes randomly and non-interactively propose blocks containing client transactions, rather than relying on a leader to do so. Apart from deterministic safety and liveness guarantees standard in BFT protocols, the egalitarian design provides two novel features: (i) EBFT is resilient to attacks targeting the leader, such as bribery and targeted DoS attacks, and (ii) EBFT does not require any fail-over protocol to detect and replace the faulty leader. EBFT consists of three protocols: EBFT-Syn for synchronous networks, EBFT-PSyn for partially synchronous networks, and EBFT-Turbo that builds on EBFT for high performance. We implement EBFT and evaluate its performance on AWS. To compare EBFT with state-of-the-art BFT protocols, we build EBFT-PSyn based on Bamboo, an open-source platform for prototyping partially synchronous BFT protocols. We evaluate EBFT-PSyn and HotStuff on EC2 with up to 16 nodes. The evaluation shows that EBFT-PSyn achieves better throughput and latency than HotStuff. To demonstrate its simplicity and practicality, we build EBFT on the Go version of Bitcoin, btcd. We implemented EBFT-Syn, EBFT-PSyn and EBFT-Turbo in about 920 LoCs in total. This indicates that EBFT can be built on top of existing blockchains with relatively little effort. We evaluate these protocols on EC2 instances with up to 256 nodes. Our evaluation shows that EBFT-Syn (resp. EBFT-PSyn) achieves a latency of 6 (resp. 1) seconds, and an optimized version of EBFT-PSyn processes up to 3.6k transactions per second and has a latency of 8 seconds.


title: Paradoxical phase response of gamma rhythms facilitates their entrainment in heterogeneous networks

abstract: The synchronization of different $\gamma$-rhythms arising in different brain areas has been implicated in various cognitive functions. Here, we focus on the effect of the ubiquitous neuronal heterogeneity on the synchronization of PING (pyramidal-interneuronal network gamma) and ING (interneuronal network gamma) rhythms. The synchronization properties of rhythms depends on the response of their collective phase to external input. We therefore determined the macroscopic phase-response curve for finite-amplitude perturbations (fmPRC), using numerical simulation of all-to-all coupled networks of integrate-and-fire (IF) neurons exhibiting either PING or ING rhythms. We show that the intrinsic neuronal heterogeneity can qualitatively modify the fmPRC. While the phase-response curve for the individual IF-neurons is strictly positive (type I), the fmPRC can be biphasic and exhibit both signs (type II). Thus, for PING rhythms, an external excitation to the excitatory cells can, in fact, delay the collective oscillation of the network, even though the same excitation would lead to an advance when applied to uncoupled neurons. This paradoxical delay arises when the external excitation modifies the internal dynamics of the network by causing additional spikes of inhibitory neurons, whose delaying within-network inhibition outweighs the immediate advance caused by the external excitation. These results explain how intrinsic heterogeneity allows the PING rhythm to become synchronized with a periodic forcing or another PING rhythm for a wider range in the mismatch of their frequencies. We demonstrate a similar mechanism for the synchronization of ING rhythms. Our results identify a potential function of neuronal heterogeneity in the synchronization of coupled $\gamma$-rhythms, which may play a role in neural information transfer via communication through coherence.


title: Deviations from tidal torque theory: evolution of the halo spin-filament alignment

abstract: The alignment between halo spins and the cosmic web is still poorly understood despite being a widely studied topic. Here, we study this alignment within the context of tidal torque theory (TTT) and deviations from it. To this end, we analyze the evolution of the shape and spin direction of proto-haloes, i.e. of all the volume elements associated to a $z=0$ halo, with respect to the present-day filaments. We find that the major axis of proto-haloes undergoes a major change, from being strongly perpendicular to the filament spine in the initial conditions, to being preferentially aligned at the present time. In comparison, the spin orientation shows only a mild evolution: it starts slightly parallel to the filament spine, but the subsequent evolution, up to $z{\sim}1$, gradually changes its orientation to preferentially perpendicular. In order to analyze these signals in the TTT framework, we split the haloes according to their net spin growth with respect to the median TTT expectation, finding a clear correlation with the spin--filament alignment. At the present time, haloes whose spin grew the most are the ones most perpendicular to the filament spine, while haloes whose spin grew below the median TTT expectation are typically more aligned. The dependence of spin directions on net spin growth is already present in the initial conditions, and gets further modified by late-time, $z<2$, evolution. Also, spin directions mildly deviate from the TTT predictions even at high redshift, indicating the need for extensions to the model.


title: Self-Assembly of Isostatic Self-Dual Colloidal Crystals

abstract: Self-dual structures whose dual counterparts are themselves possess unique hidden symmetry, beyond the description of classical spatial symmetry groups. Here we propose a strategy based on { a nematic monolayer of} attractive half-cylindrical colloids to self-assemble these exotic structures. { This system can be seen as a 2D system of semi-disks.} By using Monte Carlo simulations, we discover two isostatic self-dual crystals, i.e., an unreported crystal with pmg {space-group} symmetry and the twisted Kagome crystal. For the pmg crystal approaching the critical point, we find the double degeneracy of the {full} phononic spectrum at the self-dual point, and the merging of two tilted Weyl nodes into one \emph{critically-tilted} Dirac node. The latter is `accidentally' located on the high-symmetry line. The formation of this unconventional Dirac node is due to the emergence of the critical flat bands at the self-dual point, which are linear combinations of \emph{finite-frequency} floppy modes. These modes can be understood as mechanically-coupled self-dual rhomb chains vibrating in some unique uncoupled ways. Our work paves the way for designing and fabricating self-dual materials with exotic mechanical or phononic properties.


title: Existence of equilibrium in an abstract economy without $SS$-convexity

abstract: In this paper, we introduce the concept of $\Delta$-convexity in an abstract economy with all choice sets being general topological spaces. We give a new generalization of the classical Yannelis-Prabhakar equilibrium existence theorem in abstract economies by relaxing $SS$-convexity to $\Delta$-convexity.


title: Meta-Generating Deep Attentive Metric for Few-shot Classification

abstract: Learning to generate a task-aware base learner proves a promising direction to deal with few-shot learning (FSL) problem. Existing methods mainly focus on generating an embedding model utilized with a fixed metric (eg, cosine distance) for nearest neighbour classification or directly generating a linear classier. However, due to the limited discriminative capacity of such a simple metric or classifier, these methods fail to generalize to challenging cases appropriately. To mitigate this problem, we present a novel deep metric meta-generation method that turns to an orthogonal direction, ie, learning to adaptively generate a specific metric for a new FSL task based on the task description (eg, a few labelled samples). In this study, we structure the metric using a three-layer deep attentive network that is flexible enough to produce a discriminative metric for each task. Moreover, different from existing methods that utilize an uni-modal weight distribution conditioned on labelled samples for network generation, the proposed meta-learner establishes a multi-modal weight distribution conditioned on cross-class sample pairs using a tailored variational autoencoder, which can separately capture the specific inter-class discrepancy statistics for each class and jointly embed the statistics for all classes into metric generation. By doing this, the generated metric can be appropriately adapted to a new FSL task with pleasing generalization performance. To demonstrate this, we test the proposed method on four benchmark FSL datasets and gain surprisingly obvious performance improvement over state-of-the-art competitors, especially in the challenging cases, eg, improve the accuracy from 26.14% to 46.69% in the 20-way 1-shot task on miniImageNet, while improve the accuracy from 45.2% to 68.72% in the 5-way 1-shot task on FC100. Code is available: https://github.com/NWPUZhoufei/DAM.


title: Learning to Transfer Visual Effects from Videos to Images

abstract: We study the problem of animating images by transferring spatio-temporal visual effects (such as melting) from a collection of videos. We tackle two primary challenges in visual effect transfer: 1) how to capture the effect we wish to distill; and 2) how to ensure that only the effect, rather than content or artistic style, is transferred from the source videos to the input image. To address the first challenge, we evaluate five loss functions; the most promising one encourages the generated animations to have similar optical flow and texture motions as the source videos. To address the second challenge, we only allow our model to move existing image pixels from the previous frame, rather than predicting unconstrained pixel values. This forces any visual effects to occur using the input image's pixels, preventing unwanted artistic style or content from the source video from appearing in the output. We evaluate our method in objective and subjective settings, and show interesting qualitative results which demonstrate objects undergoing atypical transformations, such as making a face melt or a deer bloom.


title: Forecast with Forecasts: Diversity Matters

abstract: Forecast combinations have been widely applied in the last few decades to improve forecasting. Estimating optimal weights that can outperform simple averages is not always an easy task. In recent years, the idea of using time series features for forecast combination has flourished. Although this idea has been proved to be beneficial in several forecasting competitions, it may not be practical in many situations. For example, the task of selecting appropriate features to build forecasting models is often challenging. Even if there was an acceptable way to define the features, existing features are estimated based on the historical patterns, which are likely to change in the future. Other times, the estimation of the features is infeasible due to limited historical data. In this work, we suggest a change of focus from the historical data to the produced forecasts to extract features. We use out-of-sample forecasts to obtain weights for forecast combinations by amplifying the diversity of the pool of methods being combined. A rich set of time series is used to evaluate the performance of the proposed method. Experimental results show that our diversity-based forecast combination framework not only simplifies the modelling process but also achieves superior forecasting performance in terms of both point forecasts and prediction intervals. The value of our proposition lies on its simplicity, transparency, and computational efficiency, elements that are important from both an optimisation and a decision analysis perspective.


title: Capturing implicit hierarchical structure in 3D biomedical images with self-supervised hyperbolic representations

abstract: We consider the task of representation learning for unsupervised segmentation of 3D voxel-grid biomedical images. We show that models that capture implicit hierarchical relationships between subvolumes are better suited for this task. To that end, we consider encoder-decoder architectures with a hyperbolic latent space, to explicitly capture hierarchical relationships present in subvolumes of the data. We propose utilizing a 3D hyperbolic variational autoencoder with a novel gyroplane convolutional layer to map from the embedding space back to 3D images. To capture these relationships, we introduce an essential self-supervised loss -- in addition to the standard VAE loss -- which infers approximate hierarchies and encourages implicitly related subvolumes to be mapped closer in the embedding space. We present experiments on both synthetic data and biomedical data to validate our hypothesis.


title: Temperature evolution of quasiparticle dispersion dynamics in semimetallic 1T-TiTe2 via high-resolution angle-resolved photoemission spectroscopy and ultrafast optical pump-probe spectroscopy

abstract: High-resolution angle-resolved photoemission spectroscopy and ultrafast optical pump-probe spectroscopy were used to study semimetallic 1T - TiTe2 quasiparticle dispersion and dynamics. A kink and a flat band, having the same energy scale and temperature-dependent behaviors along the G-M direction, were detected. Both manifested at low temperatures but blurred as temperature increased. The kink was formed by an electron-phonon coupling. And the localized flat band might be closely related to an electron-phonon coupling. Ultrafast optical spectroscopy identified multiple distinct time scales in the 10-300 K range. Quantitative analysis of the fastest decay process evidenced a significant lifetime temperature dependence at high temperatures, while this starts to change slowly below ~ 100 K where an anomalous Hall coefficient occurred. At low temperature, a coherent A1g phonon mode with a frequency of ~ 4.36 THz was extracted. Frequency temperature dependence suggests that phonon hardening occurs as temperature falls and anharmonic effects can explain it. Frequency fluence dependence indicates that the phonons soften as fluence increases.


title: Nonlinear-supersymmetric General Relativity Theory I

abstract: The geometrical argument of the general relativity principle of Einstein is formulated in unstable Riemann space-time just inspired by the nonlinear representation of supersymmetry, which produces new Einstein-Hilbert type action.


title: How to Formally Model Human in Collaborative Robotics

abstract: Human-robot collaboration (HRC) is an emerging trend of robotics that promotes the co-presence and cooperation of humans and robots in common workspaces. Physical vicinity and interaction between humans and robots, combined with the uncertainty of human behaviour, could lead to undesired situations where humans are injured. Thus, safety is a priority for HRC applications. Safety analysis via formal modelling and verification techniques could considerably avoid dangerous consequences, but only if the models of HRC systems are comprehensive and realistic, which requires reasonably realistic models of human behaviour. This paper explores state-of-the-art solutions for modelling human and discusses which ones are suitable for HRC scenarios.


title: Towards Compositional Verification for Modular Robotic Systems

abstract: Software engineering of modular robotic systems is a challenging task, however, verifying that the developed components all behave as they should individually and as a whole presents its own unique set of challenges. In particular, distinct components in a modular robotic system often require different verification techniques to ensure that they behave as expected. Ensuring whole system consistency when individual components are verified using a variety of techniques and formalisms is difficult. This paper discusses how to use compositional verification to integrate the various verification techniques that are applied to modular robotic software, using a First-Order Logic (FOL) contract that captures each component's assumptions and guarantees. These contracts can then be used to guide the verification of the individual components, be it by testing or the use of a formal method. We provide an illustrative example of an autonomous robot used in remote inspection. We also discuss a way of defining confidence for the verification associated with each component.


title: YAP: Tool Support for Deriving Safety Controllers from Hazard Analysis and Risk Assessments

abstract: Safety controllers are system or software components responsible for handling risk in many machine applications. This tool paper describes a use case and a workflow for YAP, a research tool for risk modelling and discrete-event safety controller design. The goal of this use case is to derive a safety controller from hazard analysis and risk assessment, to define a design space for this controller, and to select a verified optimal controller instance from this design space. We represent this design space as a stochastic model and use YAP for risk modelling and generation of parts of this stochastic model. For the controller verification and selection step, we use a stochastic model checker. The approach is illustrated by an example of a collaborative robot operated in a manufacturing work cell.


title: Phenomenological QCD equations of state for neutron star dynamics: Nuclear-2SC continuity and evolving effective couplings

abstract: We delineate the quark-hadron continuity by constructing QCD equations of state for neutron star dynamics, covering the wide range of charge chemical potential ($\mu_Q$) and temperatures ($T$). Based on the nuclear-2SC continuity scenario, we match equations of state for nuclear and two-flavor color-superconducting (2SC) quark matter, where the matching baryon density is $n_B\simeq 1.5n_0$ ($n_0\simeq 0.16\, {\rm fm^{-3}}$: nuclear saturation density). The effective vector and diquark couplings in a quark matter model evolve as functions of $n_B, \mu_Q, T$, whose low density values are constrained by the nuclear matter properties and neutron star radii, with the high density behavior by the two-solar mass ($2M_\odot$) constraint. With couplings dependent on $n_B$, we examined how smooth the nuclear-2SC continuity can be, and found problems in matching nuclear and 2SC entropies at low temperatures. To proceed with the continuity scenario, we enforce smooth matching by making the couplings ($n_B, \mu_Q, T$)-dependent. In effect, this adds phenomenological contributions which we call "X". After the phenomenological matching, we take the rest as our predictions. The 2SC and color-flavor-locked (CFL) phases computed with these evolving couplings are called 2SCX and CFLX. The CFLX appears around $n_B\simeq 2$-$4n_0$ and, in contrast to the conventional CFL, has non-negligible dependence on $(\mu_Q,T)$. To examine the astrophysical consequences of our modeling, we add charged leptons and neutrinos, and study the composition of matter for lepton fractions relevant for protoneutron stars and neutron star mergers. The abundance of neutrinos and thermal effects reduce the strangeness fraction and stiffen equations of state. For a neutrino trapped neutron star at $T\simeq 30 $ MeV with a lepton fraction $Y_L\simeq 0.05$, the mass is larger than its cold static counterpart by $\sim 0.1M_\odot$.


title: A Formal Model for Quality-Driven Decision Making in Self-Adaptive Systems

abstract: Maintaining an acceptable level of quality of service in modern complex systems is challenging, particularly in the presence of various forms of uncertainty caused by changing execution context, unpredicted events, etc. Although self-adaptability is a well-established approach for modelling such systems, and thus enabling them to achieve functional and/or quality of service objectives by autonomously modifying their behavior at runtime, guaranteeing a continuous satisfaction of quality objectives is still challenging and needs a rigorous definition and analysis of system behavioral properties. Formal methods constitute a promising and effective solution in this direction in order to rigorously specify mathematical models of a software system and to analyze its behavior. They are also largely adopted to analyze and provide guarantees on the required functional/non-functional properties of self-adaptive systems. Therefore, we introduce a formal model for quality-driven self-adaptive systems under uncertainty. We combine high-level Petri nets and plausible Petri nets in order to model complex data structures enabling system quality attributes quantification and to improve the decision-making process through selecting the most plausible plans with regard to the system's actual context.


title: A Spectral Estimation Framework for Phase Retrieval via Bregman Divergence Minimization

abstract: In this paper, we develop a novel framework to optimally design spectral estimators for phase retrieval given measurements realized from an arbitrary model. We begin by deconstructing spectral methods, and identify the fundamental mechanisms that inherently promote the accuracy of estimates. We then propose a general formalism for spectral estimation as approximate Bregman loss minimization in the range of the lifted forward model that is tractable by a search over rank-1, PSD matrices. Essentially, by the Bregman loss approach we transcend the Euclidean sense alignment based similarity measure between phaseless measurements in favor of appropriate divergence metrics over $\mathbb{R}^M_+$. To this end, we derive spectral methods that perform approximate minimization of KL-divergence, and the Itakura-Saito distance over phaseless measurements by using element-wise sample processing functions. As a result, our formulation relates and extends existing results on model dependent design of optimal sample processing functions in the literature to a model independent sense of optimality. Numerical simulations confirm the effectiveness of our approach in problem settings under synthetic and real data sets.


title: Deep Spectral CNN for Laser Induced Breakdown Spectroscopy

abstract: This work proposes a spectral convolutional neural network (CNN) operating on laser induced breakdown spectroscopy (LIBS) signals to learn to (1) disentangle spectral signals from the sources of sensor uncertainty (i.e., pre-process) and (2) get qualitative and quantitative measures of chemical content of a sample given a spectral signal (i.e., calibrate). Once the spectral CNN is trained, it can accomplish either task through a single feed-forward pass, with real-time benefits and without any additional side information requirements including dark current, system response, temperature and detector-to-target range. Our experiments demonstrate that the proposed method outperforms the existing approaches used by the Mars Science Lab for pre-processing and calibration for remote sensing observations from the Mars rover, 'Curiosity'.


title: Towards Defending Multiple $\ell_p$-norm Bounded Adversarial Perturbations via Gated Batch Normalization

abstract: There has been extensive evidence demonstrating that deep neural networks are vulnerable to adversarial examples, which motivates the development of defenses against adversarial attacks. Existing adversarial defenses typically improve model robustness against individual specific perturbation types (\eg, $\ell_{\infty}$-norm bounded adversarial examples). However, adversaries are likely to generate multiple types of perturbations in practice (\eg, $\ell_1$, $\ell_2$, and $\ell_{\infty}$ perturbations). Some recent methods improve model robustness against adversarial attacks in multiple $\ell_p$ balls, but their performance against each perturbation type is still far from satisfactory. In this paper, we observe that different $\ell_p$ bounded adversarial perturbations induce different statistical properties that can be separated and characterized by the statistics of Batch Normalization (BN). We thus propose Gated Batch Normalization (GBN) to adversarially train a perturbation-invariant predictor for defending multiple $\ell_p$ bounded adversarial perturbations. GBN consists of a multi-branch BN layer and a gated sub-network. Each BN branch in GBN is in charge of one perturbation type to ensure that the normalized output is aligned towards learning perturbation-invariant representation. Meanwhile, the gated sub-network is designed to separate inputs added with different perturbation types. We perform an extensive evaluation of our approach on commonly-used dataset including MNIST, CIFAR-10, and Tiny-ImageNet, and demonstrate that GBN outperforms previous defense proposals against multiple perturbation types (\ie, $\ell_1$, $\ell_2$, and $\ell_{\infty}$ perturbations) by large margins.


title: VICToRy: Visual Interactive Consistency Management in Tolerant Rule-based Systems

abstract: In the field of Model-Driven Engineering, there exist numerous tools that support various consistency management operations including model transformation, synchronisation and consistency checking. The supported operations, however, typically run completely in the background with only input and output made visible to the user. We argue that this often reduces both understandability and controllability. As a step towards improving this situation, we present VICToRy, a debugger for model generation and transformation based on Triple Graph Grammars, a well-known rule-based approach to bidirectional transformation. In addition to a fine-grained, step-by-step, interactive visualisation, VICToRy enables the user to actively explore and choose between multiple valid rule applications thus improving control and understanding.


title: Graph Repair and its Application to Meta-Modeling

abstract: Model repair is an essential topic in model-driven engineering. We present typed graph-repair programs for specific conditions; application to any typed graph yields a typed graph satisfying the condition. A model graph based on the Eclipse Modeling Framework (EMF), short EMF-model graph, is a typed graph satisfying some structural EMF-constraints. Application of the results to the EMF-world yields model-repair programs for EMFk constraints, a first-order variant of EMF constraints; application to any typed graph yields an EMFk model graph. From these results, we derive results for EMF model repair.


title: Modeling Adverse Conditions in the Framework of Graph Transformation Systems

abstract: The concept of adverse conditions addresses systems interacting with an adversary environment and finds use also in the development of new technologies. We present an approach for modeling adverse conditions by graph transformation systems. In contrast to other approaches for graph-transformational interacting systems, the presented main constructs are graph transformation systems. We introduce joint graph transformation systems which involve a system, an interfering environment, and an automaton modeling their interaction. For joint graph transformation systems, we introduce notions of (partial) correctness under adverse conditions, which contain the correctness of the system and a recovery condition. As main result, we show that two instances of correctness, namely k-step correctness (recovery in at most k steps after an environment intervention) and last-minute correctness (recovery until next environment intervention) are expressible in LTL (linear temporal logic), and that a weaker notion of k-step correctness is expressible in CTL (computation tree logic).


title: An Algebraic Graph Transformation Approach for RDF and SPARQL

abstract: We consider the recommendations of the World Wide Web Consortium (W3C) about RDF framework and its associated query language SPARQL. We propose a new formal framework based on category theory which provides clear and concise formal definitions of the main basic features of RDF and SPARQL. We define RDF graphs as well as SPARQL basic graph patterns as objects of some nested categories. This allows one to clarify, in particular, the role of blank nodes. Furthermore, we consider basic SPARQL CONSTRUCT and SELECT queries and formalize their operational semantics following a novel algebraic graph transformation approach called POIM.


title: Graph Surfing in Reaction Systems from a Categorial Perspective

abstract: Graph-based reaction systems were recently introduced as a generalization of the intensely studied set-based reaction systems. They deal with simple edge-labeled directed graphs, and dynamic semantics of graph-based reaction systems is defined by graph surfing as a novel kind of graph transformation where, in a single surf step, reactions are applied to a subgraph of a given background graph yielding a successor subgraph. In this paper, we propose a categorical approach to reaction systems so that a wider spectrum of data structures becomes available on which reaction systems can be based. In this way, many types of graphs, hypergraphs, and graph-like structures are covered.


title: Weak Greibach Normal Form for Hyperedge Replacement Grammars

abstract: It is known that hyperedge replacement grammars are similar to string context-free grammars in the sense of definitions and properties. Therefore, we expect that there is a generalization of the well-known Greibach normal form from string grammars to hypergraph grammars. Such generalized normal forms are presented in several papers; however, they do not cover a large class of hypergraph languages (e.g. languages consisting of star graphs). In this paper, we introduce a weak Greibach normal form, whose definition corresponds to the lexicalized normal form for string grammars, and prove that every context-free hypergraph language (with nonsubstantial exceptions) can be generated by a grammar in this normal form. The proof presented in this paper generalizes a corresponding one for string grammars with a few more technicalities.


title: Reversibility and Composition of Rewriting in Hierarchies

abstract: In this paper, we study how graph transformations based on sesqui-pushout rewriting can be reversed and how the composition of rewrites can be constructed. We illustrate how such reversibility and composition can be used to design an audit trail system for individual graphs and graph hierarchies. This provides us with a compact way to maintain the history of updates of an object, including its multiple versions. The main application of the designed framework is an audit trail of updates to knowledge represented by hierarchies of graphs. Therefore, we introduce the notion of rule hierarchy that represents a transformation of the entire hierarchy, study how rule hierarchies can be applied to hierarchies and analyse the conditions under which this application is reversible. We then present a theory for constructing the composition of consecutive hierarchy rewrites. The prototype audit trail system for transformations in hierarchies of simple graphs with attributes is implemented as part of the ReGraph Python library.


title: Verifying Graph Programs with First-Order Logic

abstract: We consider Hoare-style verification for the graph programming language GP 2. In previous work, graph properties were specified by so-called E-conditions which extend nested graph conditions. However, this type of assertions is not easy to comprehend by programmers that are used to formal specifications in standard first-order logic. In this paper, we present an approach to verify GP 2 programs with a standard first-order logic. We show how to construct a strongest liberal postcondition with respect to a rule schema and a precondition. We then extend this construction to obtain strongest liberal postconditions for arbitrary loop-free programs. Compared with previous work, this allows to reason about a vastly generalised class of graph programs. In particular, many programs with nested loops can be verified with the new calculus.


title: The Fake News Effect: Experimentally Identifying Motivated Reasoning Using Trust in News

abstract: Motivated reasoning posits that people distort how they process information in the direction of beliefs they find attractive. This paper creates a novel experimental design to identify motivated reasoning from Bayesian updating when people have preconceived beliefs. It analyzes how subjects assess the veracity of information sources that tell them the median of their belief distribution is too high or too low. Bayesians infer nothing about the source veracity, but motivated beliefs are evoked. Evidence supports politically-motivated reasoning about immigration, income mobility, crime, racial discrimination, gender, climate change, and gun laws. Motivated reasoning helps explain belief biases, polarization, and overconfidence.


title: The diameter of the minimum spanning tree of the complete graph with inhomogeneous random weights

abstract: We study a new type of random minimum spanning trees. It is built on the complete graph where each vertex is given a weight, which is a positive real number. Then, each edge is given a capacity which is a random variable that only depends on the product of the weights of its endpoints. We then study the minimum spanning tree corresponding to the edge capacities. Under a condition of finite moments on the node weights, we show that the expected diameter and typical distances of this minimum spanning tree are of order $n^{1/3}$. This is a generalization of the results of Addario-Berry, Broutin, and Reed [2009]. We then use our result to answer a conjecture in statistical physics about typical distances on a closely related object. This work also sets the ground for proving the existence of a non-trivial scaling limit of this spanning tree (a generalization of the result of Addario-Berry, Broutin, Goldschmidt, and Miermont [2017])). Our proof is based on a detailed study of rank-1 critical inhomogeneous random graphs, done in Safsafi [2020], and novel couplings between exploration trees related to those graphs and Galton-Watson trees.


title: Dual-Branch Network with Dual-Sampling Modulated Dice Loss for Hard Exudate Segmentation from Colour Fundus Images

abstract: Automated segmentation of hard exudates in colour fundus images is a challenge task due to issues of extreme class imbalance and enormous size variation. This paper aims to tackle these issues and proposes a dual-branch network with dual-sampling modulated Dice loss. It consists of two branches: large hard exudate biased learning branch and small hard exudate biased learning branch. Both of them are responsible for their own duty separately. Furthermore, we propose a dual-sampling modulated Dice loss for the training such that our proposed dual-branch network is able to segment hard exudates in different sizes. In detail, for the first branch, we use a uniform sampler to sample pixels from predicted segmentation mask for Dice loss calculation, which leads to this branch naturally be biased in favour of large hard exudates as Dice loss generates larger cost on misidentification of large hard exudates than small hard exudates. For the second branch, we use a re-balanced sampler to oversample hard exudate pixels and undersample background pixels for loss calculation. In this way, cost on misidentification of small hard exudates is enlarged, which enforces the parameters in the second branch fit small hard exudates well. Considering that large hard exudates are much easier to be correctly identified than small hard exudates, we propose an easy-to-difficult learning strategy by adaptively modulating the losses of two branches. We evaluate our proposed method on two public datasets and results demonstrate that ours achieves state-of-the-art performances.


title: Condition numbers of the mixed least squares-total least squares problem: revisited

abstract: A new closed formula for the first order perturbation estimate of the mixed least squares-total least squares (MTLS) solution is presented. It is mathematically equivalent to the one by Zheng and Yang(Numer. Linear Algebra Appl. 2019; 26(4):e2239). With this formula, general and structured normwise, mixed and componentwise condition numbers of the MTLS problem are derived. Perturbation bounds based on the normwise condition number, and compact forms for the upper bounds of mixed and componentwise condition numbers are also given in order for economic storage and efficient computation. It is shown that the condition numbers and perturbation bound of the TLS problem are unified in the ones of the MTLS problem.


title: Computing the matrix fractional power with the double exponential formula

abstract: Two quadrature-based algorithms for computing the matrix fractional power $A^\alpha$ are presented in this paper. These algorithms are based on the double exponential (DE) formula, which is well-known for its effectiveness in computing improper integrals as well as in treating nearly arbitrary endpoint singularities. The DE formula transforms a given integral into another integral that is suited for the trapezoidal rule; in this process, the integral interval is transformed to the infinite interval. Therefore, it is necessary to truncate the infinite interval into an appropriate finite interval. In this paper, a truncation method, which is based on a truncation error analysis specialized to the computation of $A^\alpha$, is proposed. Then, two algorithms are presented -- one computes $A^\alpha$ with a fixed number of abscissas, and the other computes $A^\alpha$ adaptively. Subsequently, the convergence rate of the DE formula for Hermitian positive definite matrices is analyzed. The convergence rate analysis shows that the DE formula converges faster than the Gaussian quadrature when $A$ is ill-conditioned and $\alpha$ is a non-unit fraction. Numerical results show that our algorithms achieved the required accuracy and were faster than other algorithms in several situations.


title: Online Forgetting Process for Linear Regression Models

abstract: Motivated by the EU's "Right To Be Forgotten" regulation, we initiate a study of statistical data deletion problems where users' data are accessible only for a limited period of time. This setting is formulated as an online supervised learning task with \textit{constant memory limit}. We propose a deletion-aware algorithm \texttt{FIFD-OLS} for the low dimensional case, and witness a catastrophic rank swinging phenomenon due to the data deletion operation, which leads to statistical inefficiency. As a remedy, we propose the \texttt{FIFD-Adaptive Ridge} algorithm with a novel online regularization scheme, that effectively offsets the uncertainty from deletion. In theory, we provide the cumulative regret upper bound for both online forgetting algorithms. In the experiment, we showed \texttt{FIFD-Adaptive Ridge} outperforms the ridge regression algorithm with fixed regularization level, and hopefully sheds some light on more complex statistical models.


title: Total Moment Sum Rule for Magnets in the Vicinity of Quantum Critical Point

abstract: It is known that the longitudinal and transverse excitation modes can exist in the vicinity of a quantum critical point in the ordered phase of quantum magnetic systems. The total moment sum rule for such systems is derived on the basis of the extended spin-wave theory, where both longitudinal and transverse magnetic excitations are taken into account. The sum rule is resolved into elastic, one-magnon, and two-magnon components. The formulation is applicable to spin systems with the longitudinal mode, such as $S=1$ systems with single-ion anisotropy of easy-plane type and spin dimer systems. The result helps us analyze and understand measured data of inelastic neutron scattering.


title: Kronecker theta function and a decomposition theorem for theta functions I

abstract: The Kronecker theta function is a quotient of the Jacobi theta functions, which is also a special case of Ramanujan's $_1\psi_1$ summation. Using the Kronecker theta function as building blocks, we prove a decomposition theorem for theta functions. This decomposition theorem is the common source of a large number of theta function identities. Many striking theta function identities, both classical and new, are derived from this decomposition theorem with ease. A new addition formula for theta functions is established. Several known results in the theory of elliptic theta functions due to Ramanujan, Weierstrass, Kiepert, Winquist and Shen among others are revisited. A curious trigonometric identities is proved.


title: ResPerfNet: Deep Residual Learning for Regressional Performance Modeling of Deep Neural Networks

abstract: The rapid advancements of computing technology facilitate the development of diverse deep learning applications. Unfortunately, the efficiency of parallel computing infrastructures varies widely with neural network models, which hinders the exploration of the design space to find high-performance neural network architectures on specific computing platforms for a given application. To address such a challenge, we propose a deep learning-based method, ResPerfNet, which trains a residual neural network with representative datasets obtained on the target platform to predict the performance for a deep neural network. Our experimental results show that ResPerfNet can accurately predict the execution time of individual neural network layers and full network models on a variety of platforms. In particular, ResPerfNet achieves 8.4% of mean absolute percentage error for LeNet, AlexNet and VGG16 on the NVIDIA GTX 1080Ti, which is substantially lower than the previously published works.


title: Rigidity of superdense coding

abstract: The famous superdense coding protocol of Bennett and Wiesner demonstrates that it is possible to communicate two bits of classical information by sending only one qubit and using a shared EPR pair. Our first result is that an arbitrary protocol for achieving this task (where there are no assumptions on the sender's encoding operations or the dimension of the shared entangled state) is locally equivalent to the canonical Bennett-Wiesner protocol. In other words, the superdense coding task is rigid. In particular, we show that the sender and receiver only use additional entanglement (beyond the EPR pair) as a source of classical randomness. We also investigate several questions about higher-dimensional superdense coding, where the goal is to communicate one of $d^2$ possible messages by sending a $d$-dimensional quantum state, for general dimensions $d$. Unlike the $d=2$ case (i.e. sending a single qubit), there can be inequivalent superdense coding protocols for higher $d$. We present concrete constructions of inequivalent protocols, based on constructions of inequivalent orthogonal unitary bases for all $d > 2$. Finally, we analyze the performance of superdense coding protocols where the encoding operators are independently sampled from the Haar measure on the unitary group. Our analysis involves bounding the distinguishability of random maximally entangled states, which may be of independent interest.


title: Effective structure of a system with continuous polydispersity

abstract: In a system of N particles, with continuous size polydispersity there exists N(N-1) number of partial structure factors making it analytically less tractable. A common practice is to treat the system as an effective one component system which is known to exhibit an artificial softening of the structure. The aim of this study is to describe the system in terms of M pseudo species such that we can avoid this artificial softening but at the same time have a value of M << N. We use potential energy and pair excess entropy to estimate an optimum number of species, M_{0}. We find that systems with polydispersity width, {\Delta}{\sigma}_{0} can be treated as a monodisperse system. We show that M_{0} depends on the degree and type of polydispersity and also on the nature of the interaction potential, whereas, {\Delta}{\sigma}_{0} weakly depends on the type of the polydispersity, but shows a stronger dependence on the type of interaction potential. Systems with softer interaction potential have a higher tolerance with respect to polydispersity. Interestingly, M_{0} is independent of system size, making this study more relevant for bigger systems. Our study reveals that even 1% polydispersity cannot be treated as an effective monodisperse system. Thus while studying the role of polydispersity by using the structure of an effective one component system care must be taken in decoupling the role of polydispersity from that of the artificial softening of the structure.

categories: cond-mat.soft cond-mat.dis-nn cond-mat.mtrl-sci cond-mat.stat-mech


title: Interpretable Graph Capsule Networks for Object Recognition

abstract: Capsule Networks, as alternatives to Convolutional Neural Networks, have been proposed to recognize objects from images. The current literature demonstrates many advantages of CapsNets over CNNs. However, how to create explanations for individual classifications of CapsNets has not been well explored. The widely used saliency methods are mainly proposed for explaining CNN-based classifications; they create saliency map explanations by combining activation values and the corresponding gradients, e.g., Grad-CAM. These saliency methods require a specific architecture of the underlying classifiers and cannot be trivially applied to CapsNets due to the iterative routing mechanism therein. To overcome the lack of interpretability, we can either propose new post-hoc interpretation methods for CapsNets or modifying the model to have build-in explanations. In this work, we explore the latter. Specifically, we propose interpretable Graph Capsule Networks (GraCapsNets), where we replace the routing part with a multi-head attention-based Graph Pooling approach. In the proposed model, individual classification explanations can be created effectively and efficiently. Our model also demonstrates some unexpected benefits, even though it replaces the fundamental part of CapsNets. Our GraCapsNets achieve better classification performance with fewer parameters and better adversarial robustness, when compared to CapsNets. Besides, GraCapsNets also keep other advantages of CapsNets, namely, disentangled representations and affine transformation robustness.


title: Federated Learning for Personalized Humor Recognition

abstract: Computational understanding of humor is an important topic under creative language understanding and modeling. It can play a key role in complex human-AI interactions. The challenge here is that human perception of humorous content is highly subjective. The same joke may receive different funniness ratings from different readers. This makes it highly challenging for humor recognition models to achieve personalization in practical scenarios. Existing approaches are generally designed based on the assumption that users have a consensus on whether a given text is humorous or not. Thus, they cannot handle diverse humor preferences well. In this paper, we propose the FedHumor approach for the recognition of humorous content in a personalized manner through Federated Learning (FL). Extending a pre-trained language model, FedHumor guides the fine-tuning process by considering diverse distributions of humor preferences from individuals. It incorporates a diversity adaptation strategy into the FL paradigm to train a personalized humor recognition model. To the best of our knowledge, FedHumor is the first text-based personalized humor recognition model through federated learning. Extensive experiments demonstrate the advantage of FedHumor in recognizing humorous texts compared to nine state-of-the-art humor recognition approaches with superior capability for handling the diversity in humor labels produced by users with diverse preferences.


title: Recycling qubits in near-term quantum computers

abstract: Quantum computers are capable of efficiently contracting unitary tensor networks, a task that is likely to remain difficult for classical computers. For instance, networks based on matrix product states or the multi-scale entanglement renormalization ansatz (MERA) can be contracted on a small quantum computer to aid the simulation of a large quantum system. However, without the ability to selectively reset qubits, the associated spatial cost can be exorbitant. In this paper, we propose a protocol that can unitarily reset qubits when the circuit has a common convolutional form, thus dramatically reducing the spatial cost for implementing the contraction algorithm on general near-term quantum computers. This protocol generates fresh qubits from used ones by partially applying the time-reversed quantum circuit over qubits that are no longer in use. In the absence of noise, we prove that the state of a subset of these qubits becomes $|0\ldots 0\rangle$, up to an error exponentially small in the number of gates applied. We also provide a numerical evidence that the protocol works in the presence of noise. We also provide a numerical evidence that the protocol works in the presence of noise, and formulate a condition under which the noise-resilience follows rigorously.


title: On the critical exponent for $k$-primitive sets

abstract: A set of positive integers is primitive (or 1-primitive) if no member divides another. Erd\H{o}s proved in 1935 that the weighted sum $\sum1/(n \log n)$ for $n$ ranging over a primitive set $A$ is universally bounded over all choices for $A$. In 1988 he asked if this universal bound is attained by the set of prime numbers. One source of difficulty in this conjecture is that $\sum n^{-\lambda}$ over a primitive set is maximized by the primes if and only if $\lambda$ is at least the critical exponent $\tau_1 \approx 1.14$. A set is $k$-primitive if no member divides any product of up to $k$ other distinct members. One may similarly consider the critical exponent $\tau_k$ for which the primes are maximal among $k$-primitive sets. In recent work the authors showed that $\tau_2 < 0.8$, which directly implies the Erd\H{o}s conjecture for 2-primitive sets. In this article we study the limiting behavior of the critical exponent, proving that $\tau_k$ tends to zero as $k\to\infty$.


title: Unmasking the resolution$-$throughput tradespace of focused-ion-beam machining

abstract: Focused-ion-beam machining is a powerful process to fabricate complex nanostructures, often through a sacrificial mask that enables milling beyond the resolution limit of the ion beam. However, current understanding of this super-resolution effect is empirical in the spatial domain and nonexistent in the temporal domain. This article reports the primary study of this fundamental tradespace of resolution and throughput. Chromia functions well as a masking material due to its smooth, uniform, and amorphous structure. An efficient method of in-line metrology enables characterization of ion-beam focus by scanning electron microscopy. Fabrication and characterization of complex test-structures through chromia and into silica probe the response of the bilayer to a focused beam of gallium cations, demonstrating super-resolution factors of up to 6 $\pm$ 2 and improvements to volume throughput of at least factors of 42 $\pm$ 2, with uncertainties denoting 95 % coverage intervals. Tractable theory models the essential aspects of the super-resolution effect for various nanostructures. Application of the new tradespace increases the volume throughput of machining Fresnel lenses by a factor of 75, which we introduce as projection standards for optical microscopy. These results enable paradigm shifts of sacrificial masking from empirical to engineering design, and from prototyping to manufacturing.


title: The graph minor theorem in topological combinatorics

abstract: We study a variety of natural constructions from topological combinatorics, including matching complexes as well as other graph complexes, from the perspective of the graph minor category of \parencite{MiProRa}. We prove that these complexes must have universally bounded torsion in their homology across all graphs of bounded genus. One may think of these results as arising from an algebraic version of the graph minor theorem of Robertson and Seymour \parencite{RSXX,RSXXIII}.


title: Thermoelectric effects in selfsimilar multibarrier structure based on monolayer graphene

abstract: Thermoelectric effects have attracted wide attention in recent years from physicists and engineers. In this work, we explore the selfsimilar patterns in the thermoelectric effects of monolayer graphene based structures, by using the quantum relativistic Dirac equation. The transfer matrix method has been used to calculate the transmission coefficient. The Landauer Buttiker formalism and the Cutler Mott formula were used to calculate the conductance, the Seebeck coefficient, and the power factor. We find selfsimilar behavior and the scale factors between generations in the transport and thermoelectric properties. Furthermore, we implement these scale invariances as general scaling rules. We present a new analytical demonstration of selfsimilarity in the Seebeck coefficient. These findings can open outstanding perspectives for experimentalists to develop thermoelectric devices.


title: On geometric Brauer groups and Tate-Shafarevich groups

abstract: Let $X$ be a smooth projective variety over a finitely generated field $K$ of characteristic $p>0$. We proved that the finiteness of the $\ell$-primary part of $\mathrm{Br}(X_{K^s})^{G_K}$ for a single prime $\ell\neq p$ will imply the finiteness of the prime-to-$p$ part of $\mathrm{Br}(X_{K^s})^{G_K}$, generalizing a theorem of Tate and Lichtenbaum for varieties over finite fields. For an abelian variety $A$ over $K$, we proved a similar result for the Tate-Shafarevich group of $A$, generalizing a theorem of Schneider for abelian varieties over global function fields.


title: Construction of varieties of low codimension with applications to moduli spaces of varieties of general type

abstract: In this article we develop a new way of systematically constructing infinitely many families of smooth subvarieties $X$ of any given dimension $m$, $m \geq 3$, and any given codimension in $\mathbb P^N$, embedded by complete subcanonical linear series, and, in particular, in the range of Hartshorne's conjecture. We accomplish this by showing the existence of everywhere non--reduced schemes called ropes, embedded in $\mathbb P^N$, and by smoothing them. In the range $3 \leq m < N/2$, we construct smooth subvarieties, embedded by complete subcanonical linear series, that are not complete intersections. We also go beyond a question of Enriques on constructing simple canonical surfaces in projective spaces, and construct simple canonical varieties in all dimensions. The canonical map of infinitely many of these simple canonical varieties is finite birational but not an embedding. Finally, we show the existence of components of moduli spaces of varieties of general type (in all dimensions $m$, $m \geq 3$) that are analogues of the moduli space of curves of genus $g > 2$ with respect to the behavior of the canonical map and its deformations. In many cases, the general elements of these components are canonically embedded and their codimension is in the range of Hartshorne's conjecture.


title: Predictions for the FAST telescope's CRAFTS Extra-Galactic HI Survey

abstract: The Five-hundred-meter Aperture Spherical radio Telescope (FAST) has started the Commensal Radio Astronomy FasT Survey (CRAFTS). In this paper, we use the technical parameters of FAST derived from commissioning observations to simulate the completeness function for extragalactic HI survey of CRAFTS, HI galaxies from two kinds of mock catalogues are selected. One is generated by Monte-Carlo simulation based on the interpolated mass-velocity width function of the ALFALFA $100\%$ (a.k.a. $\alpha$ .100) catalogue. The other is constructed by semi-analytical N-body simulation based on the $\Lambda$CDM model. Our results suggest that a two-pass extragalactic HI survey will be able to detect nearly $4.8\times10^{5}$ galaxies, from which the 'faint end' slope of the HI Mass Function (HIMF) can be recovered to $\mathrm{10^{7}\, M_{\odot}}$ and the 'knee mass' of the HIMF can be measured to a redshift of 0.1. Considering the radio frequency interference status and sensitivity limitation, CRAFTS will be efficient in detecting HI galaxies at redshifts below 0.1, which implies a tremendous potential in exploring the galaxy interactions in different environments and the spatial distribution of HI galaxies in the local universe.


title: MelGlow: Efficient Waveform Generative Network Based on Location-Variable Convolution

abstract: Recent neural vocoders usually use a WaveNet-like network to capture the long-term dependencies of the waveform, but a large number of parameters are required to obtain good modeling capabilities. In this paper, an efficient network, named location-variable convolution, is proposed to model the dependencies of waveforms. Different from the use of unified convolution kernels in WaveNet to capture the dependencies of arbitrary waveforms, location-variable convolutions utilizes a kernel predictor to generate multiple sets of convolution kernels based on the mel-spectrum, where each set of convolution kernels is used to perform convolution operations on the associated waveform intervals. Combining WaveGlow and location-variable convolutions, an efficient vocoder, named MelGlow, is designed. Experiments on the LJSpeech dataset show that MelGlow achieves better performance than WaveGlow at small model sizes, which verifies the effectiveness and potential optimization space of location-variable convolutions.