title: Subpulse Drifting and Periodic Nulling in single pulse emission of PSR B2000+40

abstract: We have carried out a detailed study of single pulse emission from the pulsar B2000+40 (J2002+4050), observed at 1.6 GHz frequencies using the Effelsberg radio telescope. The pulsar has three components which are not well separated, with the central component resembling core emission. We have investigated modulations in single pulse behaviour using the fluctuation spectral analysis which showed presence of two prominent periodicities, around 2.5$P$ and 40$P$, respectively. The shorter periodicity was associated with the phenomenon of subpulse drifting and was seen to be absent in central core component. Drifting showed large phase variations in conal components. Additionally, the periodic modulations had significant evolution with time, varying between very sharp and highly diffuse features. In addition to drifting the pulsar also had presence of nulling in the single pulse sequence. The longer periodic feature in the fluctuation spectra was associated with nulling behaviour. The pulsar joins a select group which shows the presence of phase modulated drifting as well as periodic nulling in the presence of core emission. This provides further evidence for the two phenomena to be distinct from each other with different physical origin.


title: Protein Structured Reservoir computing for Spike-based Pattern Recognition

abstract: Nowadays we witness a miniaturisation trend in the semiconductor industry backed up by groundbreaking discoveries and designs in nanoscale characterisation and fabrication. To facilitate the trend and produce ever smaller, faster and cheaper computing devices, the size of nanoelectronic devices is now reaching the scale of atoms or molecules - a technical goal undoubtedly demanding for novel devices. Following the trend, we explore an unconventional route of implementing a reservoir computing on a single protein molecule and introduce neuromorphic connectivity with a small-world networking property. We have chosen Izhikevich spiking neurons as elementary processors, corresponding to the atoms of verotoxin protein, and its molecule as a 'hardware' architecture of the communication networks connecting the processors. We apply on a single readout layer various training methods in a supervised fashion to investigate whether the molecular structured Reservoir Computing (RC) system is capable to deal with machine learning benchmarks. We start with the Remote Supervised Method, based on Spike-Timing-Dependent-Plasticity, and carry on with linear regression and scaled conjugate gradient back-propagation training methods. The RC network is evaluated as a proof-of-concept on the handwritten digit images from the MNIST dataset and demonstrates acceptable classification accuracy in comparison with other similar approaches.


title: The role of noise in the early universe

abstract: We consider a quantum mechanical system to model the effect of quantum fields on the evolution of the early universe. The system consists of an inverted oscillator bilinearly coupled to a set of harmonic oscillators. We point out that the role of noise may be crucial in the dynamics of the oscillator, which is analyzed using the theory of harmonic oscillators with random frequency. Using this analogy we argue that, due to the fluctuations around its mean value, a positive vacuum energy density would not produce an exponentially expanding but an oscillating universe, in the same fashion that an inverted pendulum is stabilized by random oscillations of the suspension point (stochastic Kapitza pendulum). The results emphasize the relevance of noise in the evolution of the scale factor.


title: Estimating undocumented Covid-19 infections in Cuba by means of a hybrid mechanistic-statistical approach

abstract: We adapt the hybrid mechanistic-statistical approach of Ref. [1] to estimate the total number of undocumented Covid-19 infections in Cuba. This scheme is based on the maximum likelihood estimation of a SIR-like model parameters for the infected population, assuming that the detection process matches a Bernoulli trial. Our estimations show that (a) 60% of the infections were undocumented, (b) the real epidemics behind the data peaked ten days before the reports suggested, and (c) the reproduction number swiftly vanishes after 80 epidemic days.


title: Efficient algorithms for electric vehicles' min-max routing problem

abstract: An increase in greenhouse gases emission from the transportation sector has led companies and the government to elevate and support the production of electric vehicles (EV). With recent developments in urbanization and e-commerce, transportation companies are replacing their conventional fleet with EVs to strengthen the efforts for sustainable and environment-friendly operations. However, deploying a fleet of EVs asks for efficient routing and recharging strategies to alleviate their limited range and mitigate the battery degradation rate. In this work, a fleet of electric vehicles is considered for transportation and logistic capabilities with limited battery capacity and scarce charging station availability. We introduce a min-max electric vehicle routing problem (MEVRP) where the maximum distance traveled by any EV is minimized while considering charging stations for recharging. We propose an efficient branch and cut framework and a three-phase hybrid heuristic algorithm that can efficiently solve a variety of instances. Extensive computational results and sensitivity analyses are performed to corroborate the efficiency of the proposed approach, both quantitatively and qualitatively.


title: Bayesian inference of network structure from unreliable data

abstract: Most empirical studies of complex networks do not return direct, error-free measurements of network structure. Instead, they typically rely on indirect measurements that are often error-prone and unreliable. A fundamental problem in empirical network science is how to make the best possible estimates of network structure given such unreliable data. In this paper we describe a fully Bayesian method for reconstructing networks from observational data in any format, even when the data contain substantial measurement error and when the nature and magnitude of that error is unknown. The method is introduced through pedagogical case studies using real-world example networks, and specifically tailored to allow straightforward, computationally efficient implementation with a minimum of technical input. Computer code implementing the method is publicly available.


title: MeV Gamma Rays from Fission: A Distinct Signature of Actinide Production in Neutron Star Mergers

abstract: Neutron star mergers (NSMs) are the first verified sites of rapid neutron capture (r-process) nucleosynthesis, and could emit gamma rays from the radioactive isotopes synthesized in the neutron-rich ejecta. These MeV gamma rays may provide a unique and direct probe of the NSM environment as well as insight into the nature of the r process, just as observed gammas from the 56Ni radioactive decay chain provide a window into supernova nucleosynthesis. In this work, we include the photons from fission processes for the first time in estimates of the MeV gamma-ray signal expected from an NSM event. We consider NSM ejecta compositions with a range of neutron richness and find a dramatic difference in the predicted signal depending on whether or not fissioning nuclei are produced. The difference is most striking at photon energies above ~3.5 MeV and at a relatively late time, several days after the merger event, when the ejecta is optically thin. We estimate that a Galactic NSM could be detectable by a next generation gamma-ray detector such as AMEGO in the MeV range, up to ~10^4 days after the merger, if fissioning nuclei are robustly produced in the event.


title: Evaluating Load Models and Their Impacts on Power Transfer Limits

abstract: Power transfer limits or transfer capability (TC) directly relate to the system operation and control as well as electricity markets. As a consequence, their assessment has to comply with static constraints, such as line thermal limits, and dynamic constraints, such as transient stability limits, voltage stability limits and small-signal stability limits. Since the load dynamics have substantial impacts on power system transient stability, load models are one critical factor that affects the power transfer limits. Currently, multiple load models have been proposed and adopted in the industry and academia, including the ZIP model, ZIP plus induction motor composite model (ZIP + IM) and WECC composite load model (WECC CLM). Each of them has its unique advantages, but their impacts on the power transfer limits are not yet adequately addressed. One existing challenge is fitting the high-order nonlinear models such as WECC CLM. In this study, we innovatively adopt double deep Q-learning Network (DDQN) agent as a general load modeling tool in the dynamic assessment procedure and fit the same transient field measurements into different load models. A comprehensive evaluation is then conducted to quantify the load models' impacts on the power transfer limits. The simulation environment is the IEEE-39 bus system constructed in Transient Security Assessment Tool (TSAT).


title: Application of Coupled Fixed (or Best Proximity) Points in Market Equilibrium in Oligopoly Markets

abstract: We present a possible kind of generalization of the notion of ordered pairs of cyclic maps and coupled fixed points and its application in modelling of equilibrium in oligopoly markets. We have obtained sufficient conditions for the existence and uniqueness of fixed (or best proximity) points in complete metric spaces (uniformly convex Banach spaces). We get an error estimates of the fixed (or best proximity), provided that we have used sequences of successive iterations. We illustrate one possible application of the results by building a pragmatic model on competition in oligopoly markets. To achieve this goal, we use an approach based on studying the response functions of each market participant, thus making it possible to address both Cournot and Bertrand industrial structures with unified formal method. In contrast to the restrictive theoretical constructs of duopoly equilibrium, our study is able to account for real-world limitations like minimal sustainable production levels and exclusive access to certain resources. We prove and demonstrate that by using carefully constructed response functions it is possible to build and calibrate a model that reflects different competitive strategies used in extremely concentrated markets. The response functions approach makes it also possible to take into consideration different barriers to entry. By fitting to the response functions rather than the profit maximization of the payoff functions problem we alter the classical optimization problem to a problem of coupled fixed points, which has the benefit that considering corner optimum, corner equilibria and convexity condition of the payoff function can be skipped.


title: Vibrational Entropy Investigation in High Entropy Alloys

abstract: The lattice dynamics for NiCo, NiFe, NiFeCo, NiFeCoCr, and NiFeCoCrMn medium to high entropy alloy have been investigated using the DFT calculation. The phonon dispersions along three different symmetry directions are calculated by the weighted dynamical matrix (WDM) approach and compared with the supercell approach and inelastic neutron scattering. We could correctly predict the trend of increasing of the vibrational entropy by adding the alloys and the highest vibrational entropy in NiFeCoCrMn high entropy alloy by WDM approach. The averaged first nearest neighbor (1NN) force constants between various pairs of atoms in these intermetallic are obtained from the WDM approach. The results are discussed based on the analysis of these data.


title: Deep Learning Based Dereverberation of Temporal Envelopesfor Robust Speech Recognition

abstract: Automatic speech recognition in reverberant conditions is a challenging task as the long-term envelopes of the reverberant speech are temporally smeared. In this paper, we propose a neural model for enhancement of sub-band temporal envelopes for dereverberation of speech. The temporal envelopes are derived using the autoregressive modeling framework of frequency domain linear prediction (FDLP). The neural enhancement model proposed in this paper performs an envelop gain based enhancement of temporal envelopes and it consists of a series of convolutional and recurrent neural network layers. The enhanced sub-band envelopes are used to generate features for automatic speech recognition (ASR). The ASR experiments are performed on the REVERB challenge dataset as well as the CHiME-3 dataset. In these experiments, the proposed neural enhancement approach provides significant improvements over a baseline ASR system with beamformed audio (average relative improvements of 21% on the development set and about 11% on the evaluation set in word error rates for REVERB challenge dataset).


title: Retrofitting Vector Representations of Adverse Event Reporting Data to Structured Knowledge to Improve Pharmacovigilance Signal Detection

abstract: Adverse drug events (ADE) are prevalent and costly. Clinical trials are constrained in their ability to identify potential ADEs, motivating the development of spontaneous reporting systems for post-market surveillance. Statistical methods provide a convenient way to detect signals from these reports but have limitations in leveraging relationships between drugs and ADEs given their discrete count-based nature. A previously proposed method, aer2vec, generates distributed vector representations of ADE report entities that capture patterns of similarity but cannot utilize lexical knowledge. We address this limitation by retrofitting aer2vec drug embeddings to knowledge from RxNorm and developing a novel retrofitting variant using vector rescaling to preserve magnitude. When evaluated in the context of a pharmacovigilance signal detection task, aer2vec with retrofitting consistently outperforms disproportionality metrics when trained on minimally preprocessed data. Retrofitting with rescaling results in further improvements in the larger and more challenging of two pharmacovigilance reference sets used for evaluation.


title: Enhanced light-harvesting of protein-pigment complexes assisted by a quantum dot antenna

abstract: We predict the enhanced light harvesting of a protein-pigment complex when assembled to a quantum dot (QD) antenna. Our prototypical nanoassembly setup is composed of a Fenna-Mattews-Olson system hosting 8 Bacteriochlorophyll (BChl) a dyes, and a near-infrared emitting CdSe$_x$Te$_{(1-x)}$/ZnS alloy-core/shell nanocrystal. BChl a has two wide windows of poor absorption in the green and orange-red bands, precisely where most of the sunlight energy lies. The selected QD is able to collect sunlight efficiently in a broader band and funnel its energy by a (non-radiative) F\"orster resonance energy transfer mechanism to the dyes embedded in the protein. By virtue of the coupling between the QD and the dyes, the nanoassembly absorption is dramatically improved in the poor absorption window of the BChl a.


title: A Parametrized Equation of State for Neutron Star Matter with Continuous Sound Speed

abstract: We present a generalized piecewise polytropic parameterization for the neutron-star equation of state using an ansatz that imposes continuity in not only pressure and energy density, but also in the speed of sound. The universe of candidate equations of state is shown to admit preferred dividing densities, determined by minimizing an error norm consisting of integral astrophysical observables. Generalized piecewise polytropes accurately reproduce astrophysical observables, such as mass, radius, tidal deformability and mode frequencies, as well as thermodynamic quantities, such as the adiabatic index. This makes the new EOS useful for Bayesian parameter estimation from gravitational waveforms. Moreover, since they are differentiable, generalized piecewise polytropes can improve pointwise convergence in numerical relativity simulations of neutron stars. Existing implementations of piecewise polytropes can easily accommodate this generalization.


title: A Survey on Device Behavior Fingerprinting: Data Sources, Techniques, Application Scenarios, and Datasets

abstract: In the current network-based computing world, where the number of interconnected devices grows exponentially, their diversity, malfunctions, and cybersecurity threats are increasing at the same rate. To guarantee the correct functioning and performance of novel environments such as Smart Cities, Industry 4.0, or crowdsensing, it is crucial to identify the capabilities of their devices (e.g., sensors, actuators) and detect potential misbehavior that may arise due to cyberattacks, system faults, or misconfigurations. With this goal in mind, a promising research field emerged focusing on creating and managing fingerprints that model the behavior of both the device actions and its components. The article at hand studies the recent growth of the device behavior fingerprinting field in terms of application scenarios, behavioral sources, and processing and evaluation techniques. First, it performs a comprehensive review of the device types, behavioral data, and processing and evaluation techniques used by the most recent and representative research works dealing with two major scenarios: device identification and device misbehavior detection. After that, each work is deeply analyzed and compared, emphasizing its characteristics, advantages, and limitations. This article also provides researchers with a review of the most relevant characteristics of existing datasets as most of the novel processing techniques are based on machine learning and deep learning. Finally, it studies the evolution of these two scenarios in recent years, providing lessons learned, current trends, and future research challenges to guide new solutions in the area.


title: Conductivity of superconductors in the flux flow regime

abstract: We develop a theory of conductivity of type-II superconductors in the flux flow regime taking into account random spatial fluctuations of the system parameters, such as the gap magnitude $\Delta$(r) and the diffusion coefficient D(r). We find a contribution to the conductivity that is proportional to the inelastic relaxation time $\tau_{in}$, which is much longer than the elastic relaxation time. This new contribution is due to Debye-type relaxation, and it can be much larger than the conventional flux flow conductivity due to Bardeen and Stephen. The new contribution is expected to dominate in clean superconductors at low temperatures and in magnetic fields much smaller than $H_{c2}$.


title: Monomeric, Two-Dimensionally Ordered WO$_3$ Clusters on Anatase TiO$_2$(101)

abstract: We combined scanning tunneling microscopy (STM) and X-ray photoelectron spectroscopy (XPS) experiments with density functional theory (DFT) calculations to study dispersed tungsta clusters on anatase TiO$_2$(101). Following two different preparation methods, we found that monomeric WO$_3$ species are the most stable configuration rather than WO$_3$ trimers, (WO$_3$)$_3$. The WO$_3$ monomers form tetrahedral WO$_4$ structures on anatase TiO$_2$(101), with one W$-$O bond and two W$-$O$-$Ti linkages per WO$_3$ monomer. Locally, the WO$_3$ monomers form well-ordered (2$\times$1) structures. The discovered geometric structure of WO$_3$ on anatase TiO$_2$(101) opens up numerous opportunities for fundamental studies addressing tungsta and accurate structure activity studies of WO$_3$/TiO$_2$ model catalysts.


title: Generative Adversarial Network for Radar Signal Generation

abstract: A major obstacle in radar based methods for concealed object detection on humans and seamless integration into security and access control system is the difficulty in collecting high quality radar signal data. Generative adversarial networks (GAN) have shown promise in data generation application in the fields of image and audio processing. As such, this paper proposes the design of a GAN for application in radar signal generation. Data collected using the Finite-Difference Time-Domain (FDTD) method on three concealed object classes (no object, large object, and small object) were used as training data to train a GAN to generate radar signal samples for each class. The proposed GAN generated radar signal data which was indistinguishable from the training data by qualitative human observers.


title: Linear Parameter-Varying Subspace Identification: A Unified Framework

abstract: In this paper, we establish a unified framework for subspace identification (SID) of linear parameter-varying (LPV) systems to estimate LPV state-space (SS) models in innovation form. This framework enables us to derive novel LPV SID schemes that are extensions of existing linear time-invariant (LTI) methods. More specifically, we derive the open-loop, closed-loop, and predictor-based data-equations, an input-output surrogate form of the SS representation, by systematically establishing an LPV subspace identification theory. We show the additional challenges of the LPV setting compared to the LTI case. Based on the data-equations, several methods are proposed to estimate LPV-SS models based on a maximum-likelihood or a realization based argument. Furthermore, the established theoretical framework for the LPV subspace identification problem allows us to lower the number of to-be-estimated parameters and to overcome dimensionality problems of the involved matrices, leading to a decrease in the computational complexity of LPV SIDs in general. To the authors' knowledge, this paper is the first in-depth examination of the LPV subspace identification problem. The effectiveness of the proposed subspace identification methods are demonstrated and compared with existing methods in a Monte Carlo study of identifying a benchmark MIMO LPV system.


title: The Coronal Mass Ejection Visibility Function of Modern Coronagraphs

abstract: We analyze the detection capability of Coronal Mass Ejections (CMEs) for all currently operating coronagraphs in space. We define as CMEs events that propagate beyond 10 solar radii with morphologies broadly consistent with a magnetic flux rope presence. We take advantage of multi-viewpoint observations over five month-long intervals, corresponding to special orbital configurations of the coronagraphs aboard the STEREO and SOHO missions. This allows us to sort out CMEs from other outward-propagating features (e.g. waves or outflows), and thus to identify the total number of unique CMEs ejected during those periods. We determine the CME visibility functions of the STEREO COR2-A/B and LASCO C2/C3 coronagraphs directly as the ratio of observed to unique CMEs. The visibility functions range from 0.71 to 0.92 for a 95% confidence interval. By comparing detections between coronagraphs on the same spacecraft and from multiple spacecraft, we assess the influence of field of view, instrument performance, and projection effects on the CME detection ability without resorting to proxies, such as flares or radio bursts. We find that no major CMEs are missed by any of the coronagraphs, that a few slow halo-like events may be missed in synoptic cadence movies and, that narrow field of view coronagraphs have difficulties discriminating between CMEs and other ejections leading to false detection rates. We conclude that CME detection can only be validated with multi-viewpoint imaging-- two coronagraphs in quadrature offer adequate detection capability. Finally, we apply the visibility functions to observed CME rates resulting in upward corrections of 40%.


title: Rank-based Estimation under Asymptotic Dependence and Independence, with Applications to Spatial Extremes

abstract: Multivariate extreme value theory is concerned with modeling the joint tail behavior of several random variables. Existing work mostly focuses on asymptotic dependence, where the probability of observing a large value in one of the variables is of the same order as observing a large value in all variables simultaneously. However, there is growing evidence that asymptotic independence is equally important in real world applications. Available statistical methodology in the latter setting is scarce and not well understood theoretically. We revisit non-parametric estimation and introduce rank-based M-estimators for parametric models that simultaneously work under asymptotic dependence and asymptotic independence, without requiring prior knowledge on which of the two regimes applies. Asymptotic normality of the proposed estimators is established under weak regularity conditions. We further show how bivariate estimators can be leveraged to obtain parametric estimators in spatial tail models, and again provide a thorough theoretical justification for our approach.


title: A Joint Framework for Audio Tagging and Weakly Supervised Acoustic Event Detection Using DenseNet with Global Average Pooling

abstract: This paper proposes a network architecture mainly designed for audio tagging, which can also be used for weakly supervised acoustic event detection (AED). The proposed network consists of a modified DenseNet as the feature extractor, and a global average pooling (GAP) layer to predict frame-level labels at inference time. This architecture is inspired by the work proposed by Zhou et al., a well-known framework using GAP to localize visual objects given image-level labels. While most of the previous works on weakly supervised AED used recurrent layers with attention-based mechanism to localize acoustic events, the proposed network directly localizes events using the feature map extracted by DenseNet without any recurrent layers. In the audio tagging task of DCASE 2017, our method significantly outperforms the state-of-the-art method in F1 score by 5.3% on the dev set, and 6.0% on the eval set in terms of absolute values. For weakly supervised AED task in DCASE 2018, our model outperforms the state-of-the-art method in event-based F1 by 8.1% on the dev set, and 0.5% on the eval set in terms of absolute values, by using data augmentation and tri-training to leverage unlabeled data.


title: Astraea: Predicting Long Rotation Periods with 27-Day Light Curves

abstract: The rotation periods of planet-hosting stars can be used for modeling and mitigating the impact of magnetic activity in radial velocity measurements and can help constrain the high-energy flux environment and space weather of planetary systems. Millions of stars and thousands of planet hosts are observed with the Transiting Exoplanet Survey Satellite (TESS). However, most will only be observed for 27 contiguous days in a year, making it difficult to measure rotation periods with traditional methods. This is especially problematic for field M dwarfs, which are ideal candidates for exoplanet searches, but which tend to have periods in excess of the 27-day observing baseline. We present a new tool, Astraea, for predicting long rotation periods from short-duration light curves combined with stellar parameters from Gaia DR2. Using Astraea, we can predict the rotation periods from Kepler 4-year light curves with 13% uncertainty overall (and a 9% uncertainty for periods > 30 days). By training on 27-day Kepler light curve segments, Astraea can predict rotation periods up to 150 days with 9% uncertainty (5% for periods > 30 days). After training this tool on these 27-day Kepler light curve segments, we applied \texttt{Astraea} to real TESS data. For the 195 stars that were observed by both Kepler and TESS, we were able to predict the rotation periods with 55% uncertainty despite the wild differences in systematics.


title: Reliable Liver Fibrosis Assessment from Ultrasound using Global Hetero-Image Fusion and View-Specific Parameterization

abstract: Ultrasound (US) is a critical modality for diagnosing liver fibrosis. Unfortunately, assessment is very subjective, motivating automated approaches. We introduce a principled deep convolutional neural network (CNN) workflow that incorporates several innovations. First, to avoid overfitting on non-relevant image features, we force the network to focus on a clinical region of interest (ROI), encompassing the liver parenchyma and upper border. Second, we introduce global heteroimage fusion (GHIF), which allows the CNN to fuse features from any arbitrary number of images in a study, increasing its versatility and flexibility. Finally, we use 'style'-based view-specific parameterization (VSP) to tailor the CNN processing for different viewpoints of the liver, while keeping the majority of parameters the same across views. Experiments on a dataset of 610 patient studies (6979 images) demonstrate that our pipeline can contribute roughly 7% and 22% improvements in partial area under the curve and recall at 90% precision, respectively, over conventional classifiers, validating our approach to this crucial problem.


title: Hybrid Score- and Rank-level Fusion for Person Identification using Face and ECG Data

abstract: Uni-modal identification systems are vulnerable to errors in sensor data collection and are therefore more likely to misidentify subjects. For instance, relying on data solely from an RGB face camera can cause problems in poorly lit environments or if subjects do not face the camera. Other identification methods such as electrocardiograms (ECG) have issues with improper lead connections to the skin. Errors in identification are minimized through the fusion of information gathered from both of these models. This paper proposes a methodology for combining the identification results of face and ECG data using Part A of the BioVid Heat Pain Database containing synchronized RGB-video and ECG data on 87 subjects. Using 10-fold cross-validation, face identification was 98.8% accurate, while the ECG identification was 96.1% accurate. By using a fusion approach the identification accuracy improved to 99.8%. Our proposed methodology allows for identification accuracies to be significantly improved by using disparate face and ECG models that have non-overlapping modalities.


title: Infeasibility and error bound imply finite convergence of alternating projections

abstract: This paper combines two ingredients in order to get a rather surprising result on one of the most studied, elegant and powerful tools for solving convex feasibility problems, the method of alternating projections (MAP). Going back to names such as Kaczmarz and von Neumann, MAP has the ability to track a pair of points realizing minimum distance between two given closed convex sets. Unfortunately, MAP may suffer from arbitrarily slow convergence, and sublinear rates are essentially only surpassed in the presence of some Lipschitzian error bound, which is our first ingredient. The second one is a seemingly unfavorable and unexpected condition, namely, infeasibility. For two non-intersecting closed convex sets satisfying an error bound, we establish finite convergence of MAP. In particular, MAP converges in finitely many steps when applied to a polyhedron and a hyperplane in the case in which they have empty intersection. Moreover, the farther the target sets lie from each other, the fewer are the iterations needed by MAP for finding a best approximation pair. Insightful examples and further theoretical and algorithmic discussions accompany our results, including the investigation of finite termination of other projection methods.


title: Obamacare and a Fix for the IRS Iteration

abstract: We model the quantities appearing in Internal Revenue Service (IRS) tax guidance for calculating the health insurance premium tax credit created by the Patient Protection and Affordable Care Act, also called Obamacare. We ask the question of whether there is a procedure, computable by hand, which can calculate the appropriate premium tax credit for any household with self-employment income. We motivate current IRS tax guidance, which has had self-employed taxpayers use a fixed point iteration to calculate their premium tax credits since 2014. Then, we give an example showing that the IRS iteration can lead to a divergent sequence of iterates. As a consequence, IRS guidance does not calculate appropriate premium tax credits for tax returns in certain income intervals, adversely affecting eligible beneficiaries. A bisection procedure for calculating premium tax credits is proposed. We prove that this procedure calculates appropriate premium tax credits for a model of simple tax returns. This is generalized to the case where premium tax credits are received in advance, which is the most common one in applications. We outline the problem of calculating appropriate premium tax credits for models of general tax returns. While the bisection procedure will work with the tax code in its current configuration, it could fail, eg, in states which have not expanded Medicaid, if a new deduction with certain properties were to arise.


title: X-Ray bone abnormalities detection using MURA dataset

abstract: We introduce the deep network trained on the MURA dataset from the Stanford University released in 2017. Our system is able to detect bone abnormalities on the radiographs and visualise such zones. We found that our solution has the accuracy comparable to the best results that have been achieved by other development teams that used MURA dataset, in particular the overall Kappa score that was achieved by our team is about 0.942 on the wrist, 0.862 on the hand and o.735 on the shoulder (compared to the best available results to this moment on the official web-site 0.931, 0.851 and 0.729 accordingly). However, despite the good results there are a lot of directions for the future enhancement of the proposed technology. We see a big potential in the further development computer aided systems (CAD) for the radiographs as the one that will help practical specialists diagnose bone fractures as well as bone oncology cases faster and with the higher accuracy.


title: $\mathcal Z$-stability of $\mathrm{C}(X)\rtimes\Gamma$

abstract: Let $(X, \Gamma)$ be a free and minimal topological dynamical system, where $X$ is a separable compact Hausdorff space and $\Gamma$ is a countable infinite discrete amenable group. It is shown that if $(X, \Gamma)$ has the Uniform Rokhlin Property and Cuntz comparison of open sets, then $\mathrm{mdim}(X, \Gamma)=0$ implies that $(\mathrm{C}(X) \rtimes\Gamma)\otimes\mathcal Z \cong \mathrm{C}(X) \rtimes\Gamma$, where $\mathrm{mdim}$ is the mean dimension and $\mathcal Z$ is the Jiang-Su algebra. In particular, in this case, $\mathrm{mdim}(X, \Gamma)=0$ implies that the C*-algebra $\mathrm{C}(X) \rtimes\Gamma$ is classified by the Elliott invariant.


title: The Dynamics of Bilateral Olfactory Search and Navigation

abstract: Animals use stereo sampling of odor concentration to localize sources and follow odor trails. We analyze the dynamics of a bilateral model that depends on the simultaneous comparison between odor concentrations detected by left and right sensors. The general model consists of three differential equations for the positions in the plane and the heading. When the odor landscape is an infinite trail, then we reduce the dynamics to a planar system whose dynamics have just two fixed points. Using an integrable approximation (for short sensors) we estimate the basin of attraction. In the case of a radially symmetric landscape, we again can reduce the dynamics to a planar system, but the behavior is considerably richer with multi-stability, isolas, and limit cycles. As in the linear trail case, there is also an underlying integrable system when the sensors are short. In odor landscapes that consist of multiple spots and trail segments, we find periodic and chaotic dynamics and characterize the behavior on trails with gaps and that turn corners.


title: A New Approach to Accent Recognition and Conversion for Mandarin Chinese

abstract: Two new approaches to accent classification and conversion are presented and explored, respectively. The first topic is Chinese accent classification/recognition. The second topic is the use of encoder-decoder models for end-to-end Chinese accent conversion, where the classifier in the first topic is used for the training of the accent converter encoder-decoder model. Experiments using different features and model are performed for accent recognition. These features include MFCCs and spectrograms. The classifier models were TDNN and 1D-CNN. On the MAGICDATA dataset with 5 classes of accents, the TDNN classifier trained on MFCC features achieved a test accuracy of 54% and a test F1 score of 0.54 while the 1D-CNN classifier trained on spectrograms achieve a test accuracy of 62% and a test F1 score of 0.62. A prototype of an end-to-end accent converter model is also presented. The converter model comprises of an encoder and a decoder. The encoder model converts an accented input into an accent-neutral form. The decoder model converts an accent-neutral form to an accented form with the specified accent assigned by the input accent label. The converter prototype preserves the tone and foregoes the details in the output audio. An encoder-decoder structure demonstrates the potential of being an effective accent converter. A proposal for future improvements is also presented to address the issue of lost details in the decoder output.


title: Bounded Scale Measure and Property A

abstract: We introduce a generalization for bounded geometry that we call bounded scale measure. We show that bounded scale measure is a coarse invariant unlike bounded geometry. We then show equivalent definitions for spaces with bounded scale measure and show other properties that spaces with bounded scale measure satisfy. From there, we generalize property A from uniformly discrete metric spaces to large scale spaces with bounded geometry. Lastly, we construct a definition for property A for large scale spaces with bounded scale measure and show that this definition of property A is a coarse invariant.


title: Stable rank of $\mathrm{C}(X)\rtimes\Gamma$

abstract: It is shown that, for an arbitrary free and minimal $\mathbb Z^n$-action on a compact Hausdorff space $X$, the crossed product C*-algebra $\mathrm{C}(X)\rtimes\mathbb Z^n$ always has stable rank one, i.e., invertible elements are dense. This generalizes a result of Alboiu and Lutley on $\mathbb Z$-actions. In fact, for any free and minimal topological dynamical system $(X, \Gamma)$, where $\Gamma$ is a countable discrete amenable group, if it has the uniform Rokhlin property and Cuntz comparison of open sets, then the crossed product C*-algebra $\mathrm{C}(X)\rtimes\Gamma$ has stable rank one. Moreover, in this case, the C*-algebra $\mathrm{C}(X)\rtimes\Gamma$ absorbs the Jiang-Su algebra tensorially if, and only if, it has strict comparison of positive elements.


title: On the dynamical asymptotic dimension of a free $\mathbb Z^d$-action on the Cantor set

abstract: Consider an arbitrary extension of a free $\mathbb Z^d$-action on the Cantor set. It is shown that it has dynamical asymptotic dimension at most $3^d - 1$.


title: Algebraic vector bundles and $p$-local A^1-homotopy theory

abstract: We construct many``low rank" algebraic vector bundles on ``simple" smooth affine varieties of high dimension. In a related direction, we study the existence of polynomial representatives of elements in the classical (unstable) homotopy groups of spheres. Using techniques of A^1-homotopy theory, we are able to produce ``motivic" lifts of elements in classical homotopy groups of spheres; these lifts provide interesting polynomial maps of spheres and algebraic vector bundles.


title: Improving the Speed and Quality of GAN by Adversarial Training

abstract: Generative adversarial networks (GAN) have shown remarkable results in image generation tasks. High fidelity class-conditional GAN methods often rely on stabilization techniques by constraining the global Lipschitz continuity. Such regularization leads to less expressive models and slower convergence speed; other techniques, such as the large batch training, require unconventional computing power and are not widely accessible. In this paper, we develop an efficient algorithm, namely FastGAN (Free AdverSarial Training), to improve the speed and quality of GAN training based on the adversarial training technique. We benchmark our method on CIFAR10, a subset of ImageNet, and the full ImageNet datasets. We choose strong baselines such as SNGAN and SAGAN; the results demonstrate that our training algorithm can achieve better generation quality (in terms of the Inception score and Frechet Inception distance) with less overall training time. Most notably, our training algorithm brings ImageNet training to the broader public by requiring 2-4 GPUs.


title: Generalization error of minimum weighted norm and kernel interpolation

abstract: We study the generalization error of functions that interpolate prescribed data points and are selected by minimizing a weighted norm. Under natural and general conditions, we prove that both the interpolants and their generalization errors converge as the number of parameters grow, and the limiting interpolant belongs to a reproducing kernel Hilbert space. This rigorously establishes an implicit bias of minimum weighted norm interpolation and explains why norm minimization may either benefit or suffer from over-parameterization. As special cases of this theory, we study interpolation by trigonometric polynomials and spherical harmonics. Our approach is from a deterministic and approximation theory viewpoint, as opposed to a statistical or random matrix one.


title: Curvature Invariants for the Accelerating Natario Warp Drive

abstract: A process for using curvature invariants is applied to evaluate the accelerating Natario warp drive. Curvature invariants are independent of coordinate bases and plotting the invariants is free of coordinate mapping distortions. While previous works focus mainly on the mathematical description of the warp bubble, plotting curvature invariants provides a novel pathway to investigate the Nat\'ario spacetime and its characteristics. For warp drive spacetimes, there are four independent curvature invariants the Ricci scalar, r_1, r_2, and w_2. The invariant plots demonstrate how each curvature invariant evolves over the parameters of time, acceleration, skin depth and radius of the warp bubble. They show that the Ricci scalar has the greatest impact of the invariants on the surrounding spacetime. They also reveal key features of the Natario warp bubble such as a flat harbor in the center of it, a dynamic wake, and the internal structures of the warp bubble.


title: Classification of Huntington Disease using Acoustic and Lexical Features

abstract: Speech is a critical biomarker for Huntington Disease (HD), with changes in speech increasing in severity as the disease progresses. Speech analyses are currently conducted using either transcriptions created manually by trained professionals or using global rating scales. Manual transcription is both expensive and time-consuming and global rating scales may lack sufficient sensitivity and fidelity. Ultimately, what is needed is an unobtrusive measure that can cheaply and continuously track disease progression. We present first steps towards the development of such a system, demonstrating the ability to automatically differentiate between healthy controls and individuals with HD using speech cues. The results provide evidence that objective analyses can be used to support clinical diagnoses, moving towards the tracking of symptomatology outside of laboratory and clinical environments.


title: Clustering, multicollinearity, and singular vectors

abstract: Let $A$ be a matrix with its pseudo-matrix $A^{\dagger}$ and set $S=I-A^{\dagger}A$. We prove that, after re-ordering the columns of $A$, the matrix $S$ has a block-diagonal form where each block corresponds to a set of linearly dependent columns. This allows us to identify redundant columns in $A$. We explore some applications in supervised and unsupervised learning, specially feature selection, clustering, and sensitivity of solutions of least squares solutions.


title: Stationary Solutions of the Curvature Preserving Flow on Space Curves

abstract: We study a geometric flow on curves, immersed in $\mathbb{R}^3$, that have strictly positive torsion. The evolution equation is given by $$X_{t}=\frac{1}{\sqrt{\tau}} \textbf{B}$$ where $\tau$ is the torsion and $\textbf{B}$ is the unit binormal vector. In the case of constant curvature, we find all of the stationary solutions and linearize the PDE for torsion around stationary solutions admitting an explicit formula. Afterwards, we prove the $L^2(\mathbb{R})$ linear stability of the stationary solutions corresponding to helices with constant curvature and constant torsion.


title: High-Order Multiderivative IMEX Schemes

abstract: Recently, a 4th-order asymptotic preserving multiderivative implicit-explicit (IMEX) scheme was developed (Sch\"utz and Seal 2020, arXiv:2001.08268). This scheme is based on a 4th-order Hermite interpolation in time, and uses an approach based on operator splitting that converges to the underlying quadrature if iterated sufficiently. Hermite schemes have been used in astrophysics for decades, particularly for N-body calculations, but not in a form suitable for solving stiff equations. In this work, we extend the scheme presented in Sch\"utz and Seal 2020 to higher orders. Such high-order schemes offer advantages when one aims to find high-precision solutions to systems of differential equations containing stiff terms, which occur throughout the physical sciences. We begin by deriving Hermite schemes of arbitrary order and discussing the stability of these formulas. Afterwards, we demonstrate how the method of Sch\"utz and Seal 2020 generalises in a straightforward manner to any of these schemes, and prove convergence properties of the resulting IMEX schemes. We then present results for methods ranging from 6th to 12th order and explore a selection of test problems, including both linear and nonlinear ordinary differential equations and Burgers' equation. To our knowledge this is also the first time that Hermite time-stepping methods have been applied to partial differential equations. We then discuss some benefits of these schemes, such as their potential for parallelism and low memory usage, as well as limitations and potential drawbacks.

categories: physics.comp-ph astro-ph.IM cs.NA math.NA


title: LotteryFL: Personalized and Communication-Efficient Federated Learning with Lottery Ticket Hypothesis on Non-IID Datasets

abstract: Federated learning is a popular distributed machine learning paradigm with enhanced privacy. Its primary goal is learning a global model that offers good performance for the participants as many as possible. The technology is rapidly advancing with many unsolved challenges, among which statistical heterogeneity (i.e., non-IID) and communication efficiency are two critical ones that hinder the development of federated learning. In this work, we propose LotteryFL -- a personalized and communication-efficient federated learning framework via exploiting the Lottery Ticket hypothesis. In LotteryFL, each client learns a lottery ticket network (i.e., a subnetwork of the base model) by applying the Lottery Ticket hypothesis, and only these lottery networks will be communicated between the server and clients. Rather than learning a shared global model in classic federated learning, each client learns a personalized model via LotteryFL; the communication cost can be significantly reduced due to the compact size of lottery networks. To support the training and evaluation of our framework, we construct non-IID datasets based on MNIST, CIFAR-10 and EMNIST by taking feature distribution skew, label distribution skew and quantity skew into consideration. Experiments on these non-IID datasets demonstrate that LotteryFL significantly outperforms existing solutions in terms of personalization and communication cost.


title: Full Daytime Sub-ambient Radiative Cooling with High Figure of Merit in Commercial-like Paints

abstract: Radiative cooling is a passive cooling technology by reflecting sunlight and emitting radiation in the atmospheric sky window. Although highly desired, full daytime sub-ambient radiative cooling in commercial-like single-layer particle-matrix paints is yet to be achieved. In this work, we have demonstrated full daytime sub-ambient radiative cooling in CaCO3-acrylic paint by adopting large bandgap fillers, a high particle concentration and a broad size distribution. Our paint shows the highest solar reflectance of 95.5% among paints and a high sky-window emissivity of 0.94. Field tests show cooling power exceeding 37 W/m2 and lower surface temperature more than 1.7C below ambient at noon. A figure of merit RC is proposed to compare the cooling performance under different weather conditions. The RC of our cooling paint is 0.62, among the best radiative cooling performance while offering unprecedented benefits of the convenient paint form, low cost, and the compatibility with commercial paint fabrication process.


title: Online Administration of Research-Based Assessments

abstract: The number and use of research-based assessments (RBAs) has grown significantly over the last several decades. Data from RBAs can be compared against national datasets to provide instructors with empirical evidence on the efficacy of their teaching practices. Many physics instructors, however, opt not to use RBAs due to barriers such as having to use class time to administer them. In this article we examine how these barriers can be mitigated through online administrations of RBAs, particularly through the use of free online RBA platforms that automate administering, scoring, and analyzing RBAs (e.g., the Learning About STEM Student Outcomes [LASSO], Colorado Learning Attitudes About Science Survey for Experimental Physics [E-CLASS], Physics Lab Inventory of Critical thinking [PLIC], and PhysPort DataExplorer platforms). We also explore the research into common concerns of administering RBAs online and conclude with a practical how-to guide for instructors.


title: Accurate and numerically efficient r$^2$SCAN meta-generalized gradient approximation

abstract: The recently proposed rSCAN functional [J. Chem. Phys. 150, 161101 (2019)] is a regularized form of the SCAN functional [Phys. Rev. Lett. 115, 036402 (2015)] that improves SCAN's numerical performance at the expense of breaking constraints known from the exact exchange-correlation functional. We construct a new meta-generalized gradient approximation by restoring exact constraint adherence to rSCAN. The resulting functional maintains rSCAN's numerical performance while restoring the transferable accuracy of SCAN.


title: Distributed optimization for nonrigid nano-tomography

abstract: Resolution level and reconstruction quality in nano-computed tomography (nano-CT) are in part limited by the stability of microscopes, because the magnitude of mechanical vibrations during scanning becomes comparable to the imaging resolution, and the ability of the samples to resist beam damage during data acquisition. In such cases, there is no incentive in recovering the sample state at different time steps like in time-resolved reconstruction methods, but instead the goal is to retrieve a single reconstruction at the highest possible spatial resolution and without any imaging artifacts. Here we propose a joint solver for imaging samples at the nanoscale with projection alignment, unwarping and regularization. Projection data consistency is regulated by dense optical flow estimated by Farneback's algorithm, leading to sharp sample reconstructions with less artifacts. Synthetic data tests show robustness of the method to Poisson and low-frequency background noise. Applicability of the method is demonstrated on two large-scale nano-imaging experimental data sets.


title: Comment on: "Relativistic quantum dynamics of a charged particle in cosmic string spacetime in the presence of magnetic field and scalar potential''. Eur. Phys. J. C (2012) 72:2051

abstract: We analyze the results of a paper on ``Relativistic quantum dynamics of a charged particle in cosmic string spacetime in the presence of magnetic field and scalar potential''. We show that the authors did not obtain the spectrum of the eigenvalue equation but only one eigenvalue for a specific relationship between model parameters. In particular, the existence of allowed cyclotron frequencies conjectured by the authors is a mere artifact of the truncation condition used to obtain exact solutions to the radial eigenvalue equation.


title: 2$\theta$-burster for rhythm-generating circuits

abstract: We propose and demonstrate the use of a minimal 2$\theta$ model for endogenous bursters coupled in 3-cell neural circuits. This 2$\theta$ model offers the benefit of simplicity of designing larger neural networks along with an acute reduction on the computation cost.


title: Bit Parallel 6T SRAM In-memory Computing with Reconfigurable Bit-Precision

abstract: This paper presents 6T SRAM cell-based bit-parallel in-memory computing (IMC) architecture to support various computations with reconfigurable bit-precision. In the proposed technique, bit-line computation is performed with a short WL followed by BL boosting circuits, which can reduce BL computing delays. By performing carry-propagation between each near-memory circuit, bit-parallel complex computations are also enabled by iterating operations with low latency. In addition, reconfigurable bit-precision is also supported based on carry-propagation size. Our 128KB in/near memory computing architecture has been implemented using a 28nm CMOS process, and it can achieve 2.25GHz clock frequency at 1.0V with 5.2% of area overhead. The proposed architecture also achieves 0.68, 8.09 TOPS/W for the parallel addition and multiplication, respectively. In addition, the proposed work also supports a wide range of supply voltage, from 0.6V to 1.1V.


title: Rounded Hartley Transform: A Quasi-involution

abstract: A new multiplication-free transform derived from DHT is introduced: the RHT. Investigations on the properties of the RHT led us to the concept of weak-inversion. Using new constructs, we show that RHT is not involutional like the DHT, but exhibits quasi-involutional property, a new definition derived from the periodicity of matrices. Thus instead of using the actual inverse transform, the RHT is viewed as an involutional transform, allowing the use of direct (multiplication-free) to evaluate the inverse. A fast algorithm to compute RHT is presented. This algorithm show embedded properties. We also extended RHT to the two-dimensional case. This permitted us to perform a preliminary analysis on the effects of RHT on images. Despite of some SNR loss, RHT can be very interesting for applications involving image monitoring associated to decision making, such as military applications or medical imaging.


title: Single Cell Transcriptome Research in Human Placenta

abstract: Human placenta is a complex and heterogeneous organ interfacing between the mother and the fetus that supports fetal development. Alterations to placental structural components are associated with various pregnancy complications. To reveal the heterogeneity among various placenta cell types in normal and diseased placentas, as well as elucidate molecular interactions within a population of placental cells, a new genomics technology called single cell RNA-Seq (or scRNA-seq) has been employed in the last couple of years. Here we review the principles of scRNA-seq technology, and summarize the recent human placenta studies at scRNA-seq level across gestational ages as well as in pregnancy complications such as preterm birth and preeclampsia. We list the computational analysis platforms and resources available for the public use. Lastly, we discuss the future areas of interest for placenta single cell studies, as well as the data analytics needed to accomplish them.


title: Capturing Excitonic Effects in Lead Iodide Perovskites from Many-Body Perturbation Theory

abstract: Lead iodide perovskites have attracted considerable interest in the upcoming photovoltaic technologies and optoelectronic devices. Therefore, an accurate theoretical description of the electronic and optical properties especially to understand the excitonic effects in this class of materials is of scientific and practical interest. However, despite several theoretical research endeavours in past, the most accurate analysis of the key electronic parameters for solar cell performance, such as optical properties, effective mass, exciton binding energy (E$_B$) and the radiative exciton lifetime are still largely unknown. Here, we employ state-of-the-art first-principles based methodologies viz. hybrid functional(HSE06) combined with spin-orbit coupling (SOC), many-body perturbation theory (GW, BSE), model-BSE (mBSE), Wannier-Mott (WM) and Density Functional Perturbation Theory (DFPT). By taking a prototypical model system viz. APbI$_3$ (A = Formamidinium (FA), methylammonium (MA), and Cs), an exhaustive analysis is presented on the theoretical understanding of the optical, electronic and excitonic properties. We show that tuning of exact exchange parameter ($\alpha$) in HSE06 calculations incorporating SOC, followed by single shot GW, and BSE play a pivotal role in obtaining a reliable predictions for the experimental bandgap. We demonstrate that mBSE approach improves the feature of optical spectra w.r.t experiments. Furthermore, WM approach and ionic contribution to dielectric screening (below 16 meV) ameliorate the E$_B$. Our results reveal that the direct-indirect band gap transition (Rashba splitting) may be a factor responsible for the reduced charge carrier recombination rate in MAPbI$_3$ and FAPbI$_3$. The role of cation ''A'' for procuring the long-lived exciton lifetime is well understood. This proposed methodology allows to design new materials with tailored excitonic properties.


title: Classifying sleep-wake stages through recurrent neural networks using pulse oximetry signals

abstract: The regulation of the autonomic nervous system changes with the sleep stages causing variations in the physiological variables. We exploit these changes with the aim of classifying the sleep stages in awake or asleep using pulse oximeter signals. We applied a recurrent neural network to heart rate and peripheral oxygen saturation signals to classify the sleep stage every 30 seconds. The network architecture consists of two stacked layers of bidirectional gated recurrent units (GRUs) and a softmax layer to classify the output. In this paper, we used 5000 patients from the Sleep Heart Health Study dataset. 2500 patients were used to train the network, and two subsets of 1250 were used to validate and test the trained models. In the test stage, the best result obtained was 90.13% accuracy, 94.13% sensitivity, 80.26% specificity, 92.05% precision, and 84.68% negative predictive value. Further, the Cohen's Kappa coefficient was 0.74 and the average absolute error percentage to the actual sleep time was 8.9%. The performance of the proposed network is comparable with the state-of-the-art algorithms when they use much more informative signals (except those with EEG).


title: Extracting Backbones in Weighted Modular Complex Networks

abstract: Network science provides effective tools to model and analyze complex systems. However, the increasing size of real-world networks becomes a major hurdle in order to understand their structure and topological features. Therefore, mapping the original network into a smaller one while preserving its information is an important issue. Extracting the so-called backbone of a network is a very challenging problem that is generally handled either by coarse-graining or filter-based methods. Coarse-graining methods reduce the network size by grouping similar nodes, while filter-based methods prune the network by discarding nodes or edges based on a statistical property. In this paper, we propose and investigate two filter-based methods exploiting the overlapping community structure in order to extract the backbone in weighted networks. Indeed, highly connected nodes (hubs) and overlapping nodes are at the heart of the network. In the first method, called "overlapping nodes ego backbone", the backbone is formed simply from the set of overlapping nodes and their neighbors. In the second method, called "overlapping nodes and hubs backbone", the backbone is formed from the set of overlapping nodes and the hubs. For both methods, the links with the lowest weights are removed from the network as long as a backbone with a single connected component is preserved. Experiments have been performed on real-world weighted networks originating from various domains (social, co-appearance, collaboration, biological, and technological) and different sizes. Results show that both backbone extraction methods are quite similar. Furthermore, comparison with the most influential alternative filtering method demonstrates the greater ability of the proposed backbones extraction methods to uncover the most relevant parts of the network.


title: Magnetogenesis by Wave-Driven Momentum Exchange

abstract: When multiple species interact with an electrostatic ion acoustic wave, they can exchange momentum, despite the lack of momentum in the field itself. The resulting force on the electrons can have a curl, and thus give rise to compensating electric fields with curl on magnetohydrodynamic timescales. As a result, a magnetic field can be generated. Surprisingly, in some astrophysical settings, this mechanism can seed magnetic fields with growth rates even larger than through the traditional Biermann battery.


title: Solving two-parameter eigenvalue problems using an alternating method

abstract: We present a new approach to compute selected eigenvalues and eigenvectors of the two-parameter eigenvalue problem. Our method requires computing generalized eigenvalue problems of the same size as the matrices of the initial two-parameter eigenvalue problem. The method is applicable for right definite problems, possibly after performing an affine transformation. This includes a class of Helmholtz equations when separation of variables is applied. We provide a convergence proof for extremal eigenvalues and empirical evidence along with a local convergence proof for other eigenvalues.


title: The first omega alephs: from simplices to trees of trees to higher walks

abstract: The point of departure for the present work is Barry Mitchell's 1972 theorem that the cohomological dimension of $\aleph_n$ is $n+1$. We record a new proof and mild strengthening of this theorem; our more fundamental aim, though, is some clarification of the higher-dimensional infinitary combinatorics lying at its core. In the course of this work, we describe simplicial characterizations of the ordinals $\omega_n$, higher-dimensional generalizations of coherent Aronszajn trees, bases for critical inverse systems over large index sets, nontrivial $n$-coherent families of functions, and higher-dimensional generalizations of portions of Todorcevic's walks technique. These constructions and arguments are undertaken entirely within a $\mathsf{ZFC}$ framework; at their heart is a simple, finitely iterable technique of compounding $C$-sequences.


title: Comparative Evaluation Of Three Methods Of Automatic Segmentation Of Brain Structures Using 426 Cases

abstract: Segmentation of brain structures in a large dataset of magnetic resonance images (MRI) necessitates automatic segmentation instead of manual tracing. Automatic segmentation methods provide a much-needed alternative to manual segmentation which is both labor intensive and time-consuming. Among brain structures, the hippocampus presents a challenging segmentation task due to its irregular shape, small size, and unclear edges. In this work, we use T1-weighted MRI of 426 subjects to validate the approach and compare three automatic segmentation methods: FreeSurfer, LocalInfo, and ABSS. Four evaluation measures are used to assess agreement between automatic and manual segmentation of the hippocampus. ABSS outperformed the others based on the Dice coefficient, precision, Hausdorff distance, ASSD, RMS, similarity, sensitivity, and volume agreement. Moreover, comparison of the segmentation results, acquired using 1.5T and 3T MRI systems, showed that ABSS is more sensitive than the others to the field inhomogeneity of 3T MRI.


title: Controllable Neural Prosody Synthesis

abstract: Speech synthesis has recently seen significant improvements in fidelity, driven by the advent of neural vocoders and neural prosody generators. However, these systems lack intuitive user controls over prosody, making them unable to rectify prosody errors (e.g., misplaced emphases and contextually inappropriate emotions) or generate prosodies with diverse speaker excitement levels and emotions. We address these limitations with a user-controllable, context-aware neural prosody generator. Given a real or synthesized speech recording, our model allows a user to input prosody constraints for certain time frames and generates the remaining time frames from input text and contextual prosody. We also propose a pitch-shifting neural vocoder to modify input speech to match the synthesized prosody. Through objective and subjective evaluations we show that we can successfully incorporate user control into our prosody generation model without sacrificing the overall naturalness of the synthesized speech.


title: Transport barriers to self-propelled particles in fluid flows

abstract: We present theory and experiments demonstrating the existence of invariant manifolds that impede the motion of microswimmers in two-dimensional fluid flows. One-way barriers are apparent in a hyperbolic fluid flow that block the swimming of both smooth-swimming and run-and-tumble \emph{Bacillus subtilis} bacteria. We identify key phase-space structures, called swimming invariant manifolds (SwIMs), that serve as separatrices between different regions of long-time swimmer behavior. When projected into $xy$-space, the edges of the SwIMs act as one-way barriers, consistent with the experiments.


title: Green Measures for Time Changed Markov Processes

abstract: In this paper we study Green measures for certain classes of random time change Markov processes where the random time change are inverse subordinators. We show the existence of the Green measure for these processes under the condition of the existence of the Green measure of the original Markov processes and they coincide. Applications to fractional dynamics in given.


title: Diversifying Task-oriented Dialogue Response Generation with Prototype Guided Paraphrasing

abstract: Existing methods for Dialogue Response Generation (DRG) in Task-oriented Dialogue Systems (TDSs) can be grouped into two categories: template-based and corpus-based. The former prepare a collection of response templates in advance and fill the slots with system actions to produce system responses at runtime. The latter generate system responses token by token by taking system actions into account. While template-based DRG provides high precision and highly predictable responses, they usually lack in terms of generating diverse and natural responses when compared to (neural) corpus-based approaches. Conversely, while corpus-based DRG methods are able to generate natural responses, we cannot guarantee their precision or predictability. Moreover, the diversity of responses produced by today's corpus-based DRG methods is still limited. We propose to combine the merits of template-based and corpus-based DRGs by introducing a prototype-based, paraphrasing neural network, called P2-Net, which aims to enhance quality of the responses in terms of both precision and diversity. Instead of generating a response from scratch, P2-Net generates system responses by paraphrasing template-based responses. To guarantee the precision of responses, P2-Net learns to separate a response into its semantics, context influence, and paraphrasing noise, and to keep the semantics unchanged during paraphrasing. To introduce diversity, P2-Net randomly samples previous conversational utterances as prototypes, from which the model can then extract speaking style information. We conduct extensive experiments on the MultiWOZ dataset with both automatic and human evaluations. The results show that P2-Net achieves a significant improvement in diversity while preserving the semantics of responses.


title: Grouping effects of sparse CCA models in variable selection

abstract: The sparse canonical correlation analysis (SCCA) is a bi-multivariate association model that finds sparse linear combinations of two sets of variables that are maximally correlated with each other. In addition to the standard SCCA model, a simplified SCCA criterion which maixmizes the cross-covariance between a pair of canonical variables instead of their cross-correlation, is widely used in the literature due to its computational simplicity. However, the behaviors/properties of the solutions of these two models remain unknown in theory. In this paper, we analyze the grouping effect of the standard and simplified SCCA models in variable selection. In high-dimensional settings, the variables often form groups with high within-group correlation and low between-group correlation. Our theoretical analysis shows that for grouped variable selection, the simplified SCCA jointly selects or deselects a group of variables together, while the standard SCCA randomly selects a few dominant variables from each relevant group of correlated variables. Empirical results on synthetic data and real imaging genetics data verify the finding of our theoretical analysis.


title: Integrable spinor/quaternion generalizations of the nonlinear Schrodinger equation

abstract: An integrable generalization of the NLS equation is presented, in which the dynamical complex variable $u(t,x)$ is replaced by a pair of dynamical complex variables $(u_1(t,x),u_2(t,x))$, and $i$ is replaced by a Pauli matrix $J$. Integrability is retained by the addition of a nonlocal term in the resulting 2-component system. A further integrable generalization is obtained which involves a dynamical scalar variable and an additional nonlocal term. For each system, a Lax pair and a bi-Hamiltonian formulation are derived from a zero-curvature framework that is based on symmetric Lie algebras and that uses Hasimoto variables. The systems are each shown to be equivalent to a bi-normal flow and a Schrodinger map equation, generalizing the well-known equivalence of the NLS equation to the bi-normal flow in $R^3$ and the Schrodinger map equation in $S^2$. Furthermore, both of the integrable systems describe spinor/quaternion NLS-type equations with the pair $(u_1(t,x),u_2(t,x))$ being viewed as a spinor variable or equivalently a quaternion variable.


title: Some open problems in the theory of composites

abstract: A selection of open problems in the theory of composites is presented. Particular attention is drawn to the question of whether two-dimensional, two-phase, composites with general geometries have the same set of possible effective tensors as those of hierarchical laminates. Other questions involve the conductivity and elasticity of composites. Finally, some future directions for wave and other equations are mentioned.


title: Security Design Patterns in Distributed Microservice Architecture

abstract: Micro service architecture has revolutionized the landscape for the development of web and mobile applications alike. Due to the stateless nature and loose coupling involved in the design of micro services, native mobile applications can be developed by utilizing the same backend services which feed the inputs to the web application front ends. Extending the same concept, a plethora of automated devices, thanks to the advancements in the field of IOT, have come into existence which can feed on the same set of micro services. This concept of build once and utilize for many use cases has become a new norm in the enterprise design patterns. To handle the horizontal scalability needs of so many calling clients, significant advancements have been made on the containerization and their orchestration strategies on the public cloud platforms. However, scalable design techniques have led to the increased exposure of backend services to unwanted entities. This broadened the attack surface and also the risk. On top of it the mix of heterogeneous technologies in MSA, their distinct logging strategies, makes the central logging difficult, which in turn loosens the security. Additionally, the complexity around building the resilience for fault tolerance across the decentralized networks, adds to the security loop holes. The simple security designs which were once used with traditional web applications cannot be used for Microservice based applications. This paper articulates the innovative approaches of handling the security needs involved in protection of distributed services in Microservice architecture.


title: The Outburst of the Young Star Gaia19bey

abstract: We report photometry and spectroscopy of the outburst of the young stellar object Gaia19bey. We have established the outburst light curve with archival Gaia G, ATLAS Orange, ZTF r-band and Pan-STARRS rizy-filter photometry, showing an outburst of approximately 4 years duration, longer than typical EXors but shorter than FUors. Its pre-outburst SED shows a flat far-infrared spectrum, confirming the early evolutionary state of Gaia19bey and its similarity to other deeply embedded young stars experiencing outbursts. A lower limit to the peak outburst luminosity is approximately 182 L_sun at an assumed distance of 1.4 kpc, the minimum plausible distance. Infrared and optical spectroscopy near maximum light showed an emission line spectrum, including HI lines, strong red CaII emission, other metal emission lines, infrared CO bandhead emission, and a strong infrared continuum. Towards the end of the outburst, the emission lines have all but disappeared and the spectrum has changed into an almost pure continuum spectrum. This indicates a cessation of magnetospheric accretion activity. The near-infrared colors have become redder as Gaia19bey has faded, indicating a cooling of the continuum component. Near the end of the outburst, the only remaining strong emission lines are forbidden shock-excited emission lines. Adaptive optics integral field spectroscopy shows the H_2 1--0 S(1) emission with the morphology of an outflow cavity and the extended emission in the [FeII] line at 1644 nm with the morphology of an edge-on disk. However, we do not detect any large-scale jet from Gaia19bey.


title: Navigating the landscape of COVID-19 research through literature analysis: A bird's eye view

abstract: Timely access to accurate scientific literature in the battle with the ongoing COVID-19 pandemic is critical. This unprecedented public health risk has motivated research towards understanding the disease in general, identifying drugs to treat the disease, developing potential vaccines, etc. This has given rise to a rapidly growing body of literature that doubles in number of publications every 20 days as of May 2020. Providing medical professionals with means to quickly analyze the literature and discover growing areas of knowledge is necessary for addressing their question and information needs. In this study we analyze the LitCovid collection, 13,369 COVID-19 related articles found in PubMed as of May 15th, 2020 with the purpose of examining the landscape of literature and presenting it in a format that facilitates information navigation and understanding. We do that by applying state-of-the-art named entity recognition, classification, clustering and other NLP techniques. By applying NER tools, we capture relevant bioentities (such as diseases, internal body organs, etc.) and assess the strength of their relationship with COVID-19 by the extent they are discussed in the corpus. We also collect a variety of symptoms and co-morbidities discussed in reference to COVID-19. Our clustering algorithm identifies topics represented by groups of related terms, and computes clusters corresponding to documents associated with the topic terms. Among the topics we observe several that persist through the duration of multiple weeks and have numerous associated documents, as well several that appear as emerging topics with fewer documents. All the tools and data are publicly available, and this framework can be applied to any literature collection. Taken together, these analyses produce a comprehensive, synthesized view of COVID-19 research to facilitate knowledge discovery from literature.


title: Polyatomic Molecules as Quantum Sensors for Fundamental Physics

abstract: Precision measurements in molecules have advanced rapidly in recent years through developments in techniques to cool, trap, and control. The complexity of molecules makes them a challenge to study, but also offers opportunities for enhanced sensitivity to many interesting effects. Polyatomic molecules offer additional complexity compared to diatomic molecules, yet are still "simple" enough to be laser-cooled and controlled. While laser cooling molecules is still a research frontier itself, there are many proposed and ongoing experiments seeking to combine the advanced control enabled by ultracold temperatures with the intrinsic sensitivity of molecules. In this perspective, we discuss some applications where laser-cooled polyatomic molecules may offer advantages for precision measurements of fundamental physics, both within and beyond the Standard Model.


title: Nystr\"om Approximation with Nonnegative Matrix Factorization

abstract: Motivated by the needs of estimating the proximity clustering with partial distance measurements from vantage points or landmarks for remote networked systems, we show that the proximity clustering problem can be effectively formulated as the Nystr\"om approximation problem, which solves the kernel K-means clustering problem in the complex space. We implement the Nystr\"om approximation based on a landmark based Nonnegative Matrix Factorization (NMF) process. Evaluation results show that the proposed method finds nearly optimal clustering quality on both synthetic and real-world data sets as we vary the range of parameter choices and network conditions.


title: Modal Principal Component Analysis

abstract: Principal component analysis (PCA) is a widely used method for data processing, such as for dimension reduction and visualization. Standard PCA is known to be sensitive to outliers, and thus, various robust PCA methods have been proposed. It has been shown that the robustness of many statistical methods can be improved using mode estimation instead of mean estimation, because mode estimation is not significantly affected by the presence of outliers. Thus, this study proposes a modal principal component analysis (MPCA), which is a robust PCA method based on mode estimation. The proposed method finds the minor component by estimating the mode of the projected data points. As theoretical contribution, probabilistic convergence property, influence function, finite-sample breakdown point and its lower bound for the proposed MPCA are derived. The experimental results show that the proposed method has advantages over the conventional methods.


title: Black hole in Nielsen-Olesen vortex

abstract: In this article, we calculate the classical vortex solution of a spontaneously broken gauge theory interacting with gravity in (2+1)-dimension. We also calculate the conditions for the formation of a (2+1)-dimensional black hole due to magnetic vortex (a Nielsen-Olesen vortex). The semiclassical Hawking temperature for this black hole is calculated, where we see that the temperature of a BTZ black hole increases or decreases without changing the size of the horizon if we insert the magnetic vortex fields in the black hole. Finally, the first law of black hole thermodynamics is described for this particular solution, which shows that the additional work terms from the scalar and gauge fields compensate the change in the temperature relative to its usual value for the BTZ solution.


title: Free-energy transduction within autonomous systems

abstract: The excess work required to drive a stochastic system out of thermodynamic equilibrium through a time-dependent external perturbation is directly related to the amount of entropy produced during the driving process, allowing excess work and entropy production to be used interchangeably to quantify dissipation. Given the common intuition of biological molecular machines as internally communicating work between components, it is tempting to extend this correspondence to the driving of one component of an autonomous system by another; however, no such relation between the internal excess work and entropy production exists. Here we introduce the `transduced additional free energy rate' between strongly coupled subsystems of an autonomous system, that is analogous to the excess power in systems driven by an external control parameter that receives no feedback from the system. We prove that this is a relevant measure of dissipation -- in that it equals the steady-state entropy production rate due to the downstream subsystem -- and demonstrate its advantages with a simple model system.


title: Word Error Rate Estimation Without ASR Output: e-WER2

abstract: Measuring the performance of automatic speech recognition (ASR) systems requires manually transcribed data in order to compute the word error rate (WER), which is often time-consuming and expensive. In this paper, we continue our effort in estimating WER using acoustic, lexical and phonotactic features. Our novel approach to estimate the WER uses a multistream end-to-end architecture. We report results for systems using internal speech decoder features (glass-box), systems without speech decoder features (black-box), and for systems without having access to the ASR system (no-box). The no-box system learns joint acoustic-lexical representation from phoneme recognition results along with MFCC acoustic features to estimate WER. Considering WER per sentence, our no-box system achieves 0.56 Pearson correlation with the reference evaluation and 0.24 root mean square error (RMSE) across 1,400 sentences. The estimated overall WER by e-WER2 is 30.9% for a three hours test set, while the WER computed using the reference transcriptions was 28.5%.


title: VPC-Net: Completion of 3D Vehicles from MLS Point Clouds

abstract: As a dynamic and essential component in the road environment of urban scenarios, vehicles are the most popular investigation targets. To monitor their behavior and extract their geometric characteristics, an accurate and instant measurement of vehicles plays a vital role in traffic and transportation fields. Point clouds acquired from the mobile laser scanning (MLS) system deliver 3D information of road scenes with unprecedented detail. They have proven to be an adequate data source in the fields of intelligent transportation and autonomous driving, especially for extracting vehicles. However, acquired 3D point clouds of vehicles from MLS systems are inevitably incomplete due to object occlusion or self-occlusion. To tackle this problem, we proposed a neural network to synthesize complete, dense, and uniform point clouds for vehicles from MLS data, named Vehicle Points Completion-Net (VPC-Net). In this network, we introduce a new encoder module to extract global features from the input instance, consisting of a spatial transformer network and point feature enhancement layer. Moreover, a new refiner module is also presented to preserve the vehicle details from inputs and refine the complete outputs with fine-grained information. Given sparse and partial point clouds as inputs, the network can generate complete and realistic vehicle structures and keep the fine-grained details from the partial inputs. We evaluated the proposed VPC-Net in different experiments using synthetic and real-scan datasets and applied the results to 3D vehicle monitoring tasks. Quantitative and qualitative experiments demonstrate the promising performance of the proposed VPC-Net and show state-of-the-art results.


title: Stacked 1D convolutional networks for end-to-end small footprint voice trigger detection

abstract: We propose a stacked 1D convolutional neural network (S1DCNN) for end-to-end small footprint voice trigger detection in a streaming scenario. Voice trigger detection is an important speech application, with which users can activate their devices by simply saying a keyword or phrase. Due to privacy and latency reasons, a voice trigger detection system should run on an always-on processor on device. Therefore, having small memory and compute cost is crucial for a voice trigger detection system. Recently, singular value decomposition filters (SVDFs) has been used for end-to-end voice trigger detection. The SVDFs approximate a fully-connected layer with a low rank approximation, which reduces the number of model parameters. In this work, we propose S1DCNN as an alternative approach for end-to-end small-footprint voice trigger detection. An S1DCNN layer consists of a 1D convolution layer followed by a depth-wise 1D convolution layer. We show that the SVDF can be expressed as a special case of the S1DCNN layer. Experimental results show that the S1DCNN achieve 19.0% relative false reject ratio (FRR) reduction with a similar model size and a similar time delay compared to the SVDF. By using longer time delays, the S1DCNN further improve the FRR up to 12.2% relative.


title: Security for People with Mental Illness in Telehealth Systems: A Proposal

abstract: A mental health crisis is looming large, and needs to be addressed. But across age groups, even just in the United States, more than 50% of people with any mental illness (AMI) did not seek or receive any service or treatment. The proliferation of telehealth and telepsychiatry tools and systems can help address this crisis, but outside of traditional regulatory aspects on privacy, e.g. Health Insurance Portability and Accountability Act (HIPPA), there does not seem to be enough attention on the security needs, concerns, or user experience of people with AMI using those telehealth systems. In this text, I try to explore some priority security properties for telehealth systems used by people with AMI for mental heath services (MHS). I will also suggest some key steps in a proposed process for designing and building security mechanisms into such systems, so that security is accessible and usable to patients with AMI, and these systems can achieve their goals of ameliorate this mental health crisis.


title: On Emergent Geometry of the Gromov-Witten Theory of Quintic Calabi-Yau Threefold

abstract: We carry out the explicit computations that are used to write down the integrable hierarchy associated with the quintic Calabi-Yau threefold. We also do the calculations for the geometric structures emerging in the Gromov-Witten theory of the quintic, such as the Frobenius manifold structure and the special K\"ahler structure.


title: Learning to Detect Bipolar Disorder and Borderline Personality Disorder with Language and Speech in Non-Clinical Interviews

abstract: Bipolar disorder (BD) and borderline personality disorder (BPD) are both chronic psychiatric disorders. However, their overlapping symptoms and common comorbidity make it challenging for the clinicians to distinguish the two conditions on the basis of a clinical interview. In this work, we first present a new multi-modal dataset containing interviews involving individuals with BD or BPD being interviewed about a non-clinical topic . We investigate the automatic detection of the two conditions, and demonstrate a good linear classifier that can be learnt using a down-selected set of features from the different aspects of the interviews and a novel approach of summarising these features. Finally, we find that different sets of features characterise BD and BPD, thus providing insights into the difference between the automatic screening of the two conditions.


title: Deep learnig analysis of the inverse seesaw in a 3-3-1 model at the LHC

abstract: Inverse seesaw is a genuine TeV scale seesaw mechanism. In it active neutrinos with masses at eV scale requires lepton number be explicitly violated at keV scale and the existence of new physics, in the form of heavy neutrinos, at TeV scale. Therefore it is a phenomenologically viable seesaw mechanism since its signature may be probed at the LHC. Moreover it is successfully embedded into gauge extensions of the standard model as the 3-3-1 model with the right-handed neutrinos. In this work we revisit the implementation of this mechanism into the 3-3-1 model and employ deep learning analysis to probe such setting at the LHC and, as main result, we have that if its signature is not detected in the next LHC running with energy of 14 TeVs, then, the vector boson $Z^{\prime}$ of the 3-3-1 model must be heavier than 4 TeVs.


title: OCMR (v1.0)--Open-Access Multi-Coil k-Space Dataset for Cardiovascular Magnetic Resonance Imaging

abstract: Cardiovascular MRI (CMR) is a non-invasive imaging modality that provides excellent soft-tissue contrast without the use of ionizing radiation. Physiological motions and limited speed of MRI data acquisition necessitate development of accelerated methods, which typically rely on undersampling. Recovering diagnostic quality CMR images from highly undersampled data has been an active area of research. Recently, several data acquisition and processing methods have been proposed to accelerate CMR. The availability of data to objectively evaluate and compare different reconstruction methods could expedite innovation and promote clinical translation of these methods. In this work, we introduce an open-access dataset, called OCMR, that provides multi-coil k-space data from 53 fully sampled and 212 prospectively undersampled cardiac cine series.


title: Exploring the parameter reusability of CNN

abstract: In recent times, using small data to train networks has become a hot topic in the field of deep learning. Reusing pre-trained parameters is one of the most important strategies to address the issue of semi-supervised and transfer learning. However, the fundamental reason for the success of these methods is still unclear. In this paper, we propose a solution that can not only judge whether a given network is reusable or not based on the performance of reusing convolution kernels but also judge which layers' parameters of the given network can be reused, based on the performance of reusing corresponding parameters and, ultimately, judge whether those parameters are reusable or not in a target task based on the root mean square error (RMSE) of the corresponding convolution kernels. Specifically, we define that the success of a CNN's parameter reuse depends upon two conditions: first, the network is a reusable network; and second, the RMSE between the convolution kernels from the source domain and target domain is small enough. The experimental results demonstrate that the performance of reused parameters applied to target tasks, when these conditions are met, is significantly improved.


title: Two-branch Recurrent Network for Isolating Deepfakes in Videos

abstract: The current spike of hyper-realistic faces artificially generated using deepfakes calls for media forensics solutions that are tailored to video streams and work reliably with a low false alarm rate at the video level. We present a method for deepfake detection based on a two-branch network structure that isolates digitally manipulated faces by learning to amplify artifacts while suppressing the high-level face content. Unlike current methods that extract spatial frequencies as a preprocessing step, we propose a two-branch structure: one branch propagates the original information, while the other branch suppresses the face content yet amplifies multi-band frequencies using a Laplacian of Gaussian (LoG) as a bottleneck layer. To better isolate manipulated faces, we derive a novel cost function that, unlike regular classification, compresses the variability of natural faces and pushes away the unrealistic facial samples in the feature space. Our two novel components show promising results on the FaceForensics++, Celeb-DF, and Facebook's DFDC preview benchmarks, when compared to prior work. We then offer a full, detailed ablation study of our network architecture and cost function. Finally, although the bar is still high to get very remarkable figures at a very low false alarm rate, our study shows that we can achieve good video-level performance when cross-testing in terms of video-level AUC.


title: Application of the Non-Hermitian Singular Spectrum Analysis to the exponential retrieval problem

abstract: We present a new approach to solve the exponential retrieval problem. We derive a stable technique, based on the singular value decomposition (SVD) of lag-covariance and crosscovariance matrices consisting of covariance coefficients computed for index translated copies of an initial time series. For these matrices a generalized eigenvalue problem is solved. The initial signal is mapped into the basis of the generalized eigenvectors and phase portraits are consequently analyzed. Pattern recognition techniques could be applied to distinguish phase portraits related to the exponentials and noise. Each frequency is evaluated by unwrapping phases of the corresponding portrait, detecting potential wrapping events and estimation of the phase slope. Efficiency of the proposed and existing methods is compared on the set of examples, including the white Gaussian and auto-regressive model noise.


title: Using UNet and PSPNet to explore the reusability principle of CNN parameters

abstract: How to reduce the requirement on training dataset size is a hot topic in deep learning community. One straightforward way is to reuse some pre-trained parameters. Some previous work like Deep transfer learning reuse the model parameters trained for the first task as the starting point for the second task, and semi-supervised learning is trained upon a combination of labeled and unlabeled data. However, the fundamental reason of the success of these methods is unclear. In this paper, the reusability of parameters in each layer of a deep convolutional neural network is experimentally quantified by using a network to do segmentation and auto-encoder task. This paper proves that network parameters can be reused for two reasons: first, the network features are general; Second, there is little difference between the pre-trained parameters and the ideal network parameters. Through the use of parameter replacement and comparison, we demonstrate that reusability is different in BN(Batch Normalization)[7] layer and Convolution layer and some observations: (1)Running mean and running variance plays an important role than Weight and Bias in BN layer.(2)The weight and bias can be reused in BN layers.( 3) The network is very sensitive to the weight of convolutional layer.(4) The bias in Convolution layers are not sensitive, and it can be reused directly.


title: Assessing Demographic Bias in Named Entity Recognition

abstract: Named Entity Recognition (NER) is often the first step towards automated Knowledge Base (KB) generation from raw text. In this work, we assess the bias in various Named Entity Recognition (NER) systems for English across different demographic groups with synthetically generated corpora. Our analysis reveals that models perform better at identifying names from specific demographic groups across two datasets. We also identify that debiased embeddings do not help in resolving this issue. Finally, we observe that character-based contextualized word representation models such as ELMo results in the least bias across demographics. Our work can shed light on potential biases in automated KB generation due to systematic exclusion of named entities belonging to certain demographics.


title: Quotients of multiplicative forms and Poisson reduction

abstract: In this paper we study quotients of Lie algebroids and groupoids endowed with compatible differential forms. We identify Lie theoretic conditions under which such forms become basic and characterize the induced forms on the quotients. We apply these results to describe generalized quotient and reduction processes for (twisted) Poisson and Dirac structures, as well as to their integration by (twisted, pre-)symplectic groupoids. In particular, we recover and generalize several known results concerning Poisson reduction.


title: Point or Generate Dialogue State Tracker

abstract: Dialogue state tracking is a key part of a task-oriented dialogue system, which estimates the user's goal at each turn of the dialogue. In this paper, we propose the Point-Or-Generate Dialogue State Tracker (POGD). POGD solves the dialogue state tracking task in two perspectives: 1) point out explicitly expressed slot values from the user's utterance, and 2) generate implicitly expressed ones based on slot-specific contexts. It also shares parameters across all slots, which achieves knowledge sharing and gains scalability to large-scale across-domain dialogues. Moreover, the training process of its submodules is formulated as a multi-task learning procedure to further promote its capability of generalization. Experiments show that POGD not only obtains state-of-the-art results on both WoZ 2.0 and MultiWoZ 2.0 datasets but also has good generalization on unseen values and new slots.


title: Service Ecosystem: A Lens of Smart Society

abstract: Intelligence services are playing an increasingly important role in the operation of our society. Exploring the evolution mechanism, boundaries and challenges of service ecosystem is essential to our ability to realize smart society, reap its benefits and prevent potential risks. We argue that this necessitates a broad scientific research agenda to study service ecosystem that incorporates and expands upon the disciplines of computer science and includes insights from across the sciences. We firstly outline a set of research issues that are fundamental to this emerging field, and then explores the technical, social, legal and institutional challenges on the study of service ecosystem.