title: Viewmaker Networks: Learning Views for Unsupervised Representation Learning

abstract: Many recent methods for unsupervised representation learning train models to be invariant to different "views," or distorted versions of an input. However, designing these views requires considerable trial and error by human experts, hindering widespread adoption of unsupervised representation learning methods across domains and modalities. To address this, we propose viewmaker networks: generative models that learn to produce useful views from a given input. Viewmakers are stochastic bounded adversaries: they produce views by generating and then adding an $\ell_p$-bounded perturbation to the input, and are trained adversarially with respect to the main encoder network. Remarkably, when pretraining on CIFAR-10, our learned views enable comparable transfer accuracy to the well-tuned SimCLR augmentations -- despite not including transformations like cropping or color jitter. Furthermore, our learned views significantly outperform baseline augmentations on speech recordings (+9% points, on average) and wearable sensor data (+17% points). Viewmakers can also be combined with handcrafted views: they improve robustness to common image corruptions and can increase transfer performance in cases where handcrafted views are less explored. These results suggest that viewmakers may provide a path towards more general representation learning algorithms -- reducing the domain expertise and effort needed to pretrain on a much wider set of domains. Code is available at https://github.com/alextamkin/viewmaker.


title: Trisections of non-orientable 4-manifolds

abstract: We study trisections of smooth, compact non-orientable 4-manifolds, and introduce trisections of non-orientable 4-manifolds with boundary. In particular, we prove a non-orientable analogue of a classical theorem of Laudenbach-Po\'enaru. As a consequence, trisection diagrams and Kirby diagrams of closed non-orientable 4-manifolds exist. We discuss how the theory of trisections may be adapted to the setting of non-orientable 4-manifolds with many examples.


title: Exploring the impacts of conformer selection methods on ion mobility collision cross section predictions

abstract: The prediction of structure dependent molecular properties, such as collision cross sections as measured using ion mobility spectrometry, are crucially dependent on the selection of the correct population of molecular conformers. Here, we report an in-depth evaluation of multiple conformation selection techniques, including simple averaging, Boltzmann weighting, lowest energy selection, low energy threshold reductions, and similarity reduction. Generating 50,000 conformers each for 18 molecules, we used the In Silico Chemical Library Engine (ISiCLE) to calculate the collision cross sections for the entire dataset. First, we employed Monte Carlo simulations to understand the variability between conformer structures as generated using simulated annealing. Then we employed Monte Carlo simulations to the aforementioned conformer selection techniques applied on the simulated molecular property - the ion mobility collision cross section. Based on our analyses, we found Boltzmann weighting to be a good tradeoff between precision and theoretical accuracy. Combining multiple techniques revealed that energy thresholds and root-mean-squared deviation-based similarity reductions can save considerable computational expense while maintaining property prediction accuracy. Molecular dynamic conformer generation tools like AMBER can continue to generate new lowest energy conformers even after tens of thousands of generations, decreasing precision between runs. This reduced precision can be ameliorated and theoretical accuracy increased by running density functional theory geometry optimization on carefully selected conformers.


title: From Language to Language-ish: How Brain-Like is an LSTM's Representation of Nonsensical Language Stimuli?

abstract: The representations generated by many models of language (word embeddings, recurrent neural networks and transformers) correlate to brain activity recorded while people read. However, these decoding results are usually based on the brain's reaction to syntactically and semantically sound language stimuli. In this study, we asked: how does an LSTM (long short term memory) language model, trained (by and large) on semantically and syntactically intact language, represent a language sample with degraded semantic or syntactic information? Does the LSTM representation still resemble the brain's reaction? We found that, even for some kinds of nonsensical language, there is a statistically significant relationship between the brain's activity and the representations of an LSTM. This indicates that, at least in some instances, LSTMs and the human brain handle nonsensical data similarly.


title: Comparison Between Two Numerical Schemes to Study the Spectra of Charmed Quarkonium

abstract: Two numerical methods are developed to reduce the solution of the radial Schr\"odinger equation for proposed heavy quark-antiquark interactions, into the solution of the eigenvalue problem for the infinite system of tridiagonal matrices. Our perspective is a numerical approach relies on finding the proper numerical method to investigate the static properties of heavy quarkonia-mesons, such as spectrum, radius ... etc., with implantation of both the nonrelativistic quark model and the ingredients of the quantum chromodynamics (QCD) theory. The application of these proposed schemes resulted in mass spectra of charmed-quarkonium (charmonium) multiplets, which are compared with the experimental published profiles of Particle Data Group (PDG). Besides, the normalized radial wave-functions of the charmonium various bound states are represented. The convergence of each numerical recipe versus the iteration number N and the radial distance is investigated through this work. Although it was observed that our numerical treatments are reliable to study charmed Quarkonium bound states profile, we found that one of these proposed techniques is favored over the other in terms of high precision comparisons with experiments and convergence analysis.

categories: hep-ph cs.NA hep-th math.NA physics.comp-ph quant-ph


title: Tracking Results and Utilization of Artificial Intelligence (tru-AI) in Radiology: Early-Stage COVID-19 Pandemic Observations

abstract: Objective: To introduce a method for tracking results and utilization of Artificial Intelligence (tru-AI) in radiology. By tracking both large-scale utilization and AI results data, the tru-AI approach is designed to calculate surrogates for measuring important disease-related observational quantities over time, such as the prevalence of intracranial hemorrhage during the COVID-19 pandemic outbreak. Methods: To quantitatively investigate the clinical applicability of the tru-AI approach, we analyzed service requests for automatically identifying intracranial hemorrhage (ICH) on head CT using a commercial AI solution. This software is typically used for AI-based prioritization of radiologists' reading lists for reducing turnaround times in patients with emergent clinical findings, such as ICH or pulmonary embolism.We analyzed data of N=9,421 emergency-setting non-contrast head CT studies at a major US healthcare system acquired from November 1, 2019 through June 2, 2020, and compared two observation periods, namely (i) a pre-pandemic epoch from November 1, 2019 through February 29, 2020, and (ii) a period during the COVID-19 pandemic outbreak, April 1-30, 2020. Results: Although daily CT scan counts were significantly lower during (40.1 +/- 7.9) than before (44.4 +/- 7.6) the COVID-19 outbreak, we found that ICH was more likely to be observed by AI during than before the COVID-19 outbreak (p<0.05), with approximately one daily ICH+ case more than statistically expected. Conclusion: Our results suggest that, by tracking both large-scale utilization and AI results data in radiology, the tru-AI approach can contribute clinical value as a versatile exploratory tool, aiming at a better understanding of pandemic-related effects on healthcare.


title: $T^3$-Invariant Heterotic Hull-Strominger Solutions

abstract: We consider the heterotic string on Calabi-Yau manifolds admitting a Strominger-Yau-Zaslow fibration. Upon reducing the system in the $T^3$-directions, the Hermitian Yang-Mills conditions can then be reinterpreted as a complex flat connection on $\mathbb{R}^3$ satisfying a certain co-closure condition. We give a number of abelian and non-abelian examples, and also compute the back-reaction on the geometry through the non-trivial $\alpha'$-corrected heterotic Bianchi identity, which includes an important correction to the equations for the complex flat connection. These are all new local solutions to the Hull-Strominger system on $T^3\times\mathbb{R}^3$. We also propose a method for computing the spectrum of certain non-abelian models, in close analogy with the Morse-Witten complex of the abelian models.


title: Sea-level rise and continuous adaptation: residual damage rises faster than the protection costs

abstract: Damage cost curves -- relating the typical damage of a natural hazard to its physical magnitude -- represent an indispensable ingredient necessary for climate change impact assessments. Combining such curves with the occurrence probability of the considered natural hazard, expected damage and related risk can be estimated. Here we study recently published city scale damage cost curves for coastal flooding and demonstrate which insights can be gained from the functions only. Therefore, we include protection cost curves -- relating the typical investment costs necessary to protect a city against a natural hazard of certain magnitude -- which are analogous to and consistent with the above mentioned damage cost curves. Specifically, we motivate log-logistic functions, which exhibit a power-law increase at the lower end, and fit them to the cost curves. As expected, cities with large maximum potential loss (typically large cities) are also more costly to protect. Moreover, we study the idealized case of continuous adaptation, i.e.\ increasing protection levels in the same pace as sea-level rise, and compare the associated costs with residual damage from extreme events exceeding the protection. Based on the fitted exponents we find that in almost all cities the residual damage rises faster than the protection costs. Raising coastal protection can lead to lull oneself in a deceptive safety.


title: A new approach for extracting the conceptual schema of texts based on the linguistic Thematic Progression theory

abstract: The purpose of this article is to present a new approach for the discovery and labelling of the implicit conceptual schema of texts through the application of the Thematic Progression theory. The underlying conceptual schema is the core component for the generation of summaries that are genuinely consistent with the semantics of the text.


title: Auto-calibration Method Using Stop Signs for Urban Autonomous Driving Applications

abstract: Calibration of sensors is fundamental to robust performance for intelligent vehicles. In natural environments, disturbances can easily challenge calibration. One possibility is to use natural objects of known shape to recalibrate sensors. An approach based on recognition of traffic signs, such as stop signs, and use of them for recalibration of cameras is presented. The approach is based on detection, geometry estimation, calibration, and recursive updating. Results from natural environments are presented that clearly show convergence and improved performance.


title: AI-based BMI Inference from Facial Images: An Application to Weight Monitoring

abstract: Self-diagnostic image-based methods for healthy weight monitoring is gaining increased interest following the alarming trend of obesity. Only a handful of academic studies exist that investigate AI-based methods for Body Mass Index (BMI) inference from facial images as a solution to healthy weight monitoring and management. To promote further research and development in this area, we evaluate and compare the performance of five different deep-learning based Convolutional Neural Network (CNN) architectures i.e., VGG19, ResNet50, DenseNet, MobileNet, and lightCNN for BMI inference from facial images. Experimental results on the three publicly available BMI annotated facial image datasets assembled from social media, namely, VisualBMI, VIP-Attributes, and Bollywood datasets, suggest the efficacy of the deep learning methods in BMI inference from face images with minimum Mean Absolute Error (MAE) of $1.04$ obtained using ResNet50.


title: SUPER III. Broad Line Region properties of AGN at z$\sim$2

abstract: The SINFONI survey for Unveiling the Physics and Effect of Radiative feedback (SUPER) was designed to conduct a blind search for AGN-driven outflows on X-ray selected AGN at redshift z$\sim$2 with high ($\sim$2 kpc) spatial resolution, and correlate them to the properties of the host galaxy and central black hole. The main aims of this paper are: a) to derive reliable estimates for the BH mass and accretion rates for the Type-1 AGN in this survey; b) to characterize the properties of the AGN driven winds in the BLR. We analyzed rest-frame optical and UV spectra of 21 Type-1 AGN. We found that the BH masses estimated from H$\alpha$ and H$\beta$ lines are in agreement. We estimate BH masses in the range Log(M$\rm_{BH}/M_{\odot}$)=8.4-10.8 and Eddington ratios $\rm\lambda_{Edd}$ =0.04-1.3. We confirm that the CIV line width does not correlate with the Balmer lines and the peak of the line profile is blue-shifted with respect to the [OIII]-based systemic redshift. These findings support the idea that the CIV line is tracing outflowing gas in the BLR, with velocities up to $\sim$4700 km/s. We confirm the strong dependence of the BLR wind velocity with the UV-to-Xray continuum slope, L$\rm_{Bol}$ and $\rm\lambda_{Edd}$. We inferred BLR mass outflow rates in the range 0.005-3 M$_{\odot}$/yr, showing a correlation with the bolometric luminosity consistent with that observed for ionized winds in the NLR and X-ray winds detected in local AGN, and kinetic power $\sim$10$^{[-7:-4]}\times$ L$\rm_{Bol}$. Finally, we found an anti-correlation between the equivalent width of the [OIII] line with respect to the CIV shift, and a positive correlation with [OIII] outflow velocity. These findings, for the first time in an unbiased sample of AGN at z$\sim$2, support a scenario where BLR winds are connected to galaxy scale detected outflows, and are capable of affecting the gas in the NLR located at kpc scale.


title: SpaML: a Bimodal Ensemble Learning Spam Detector based on NLP Techniques

abstract: In this paper, we put forward a new tool, called SpaML, for spam detection using a set of supervised and unsupervised classifiers, and two techniques imbued with Natural Language Processing (NLP), namely Bag of Words (BoW) and Term Frequency-Inverse Document Frequency (TF-IDF). We first present the NLP techniques used. Then, we present our classifiers and their performance on each of these techniques. Then, we present our overall Ensemble Learning classifier and the strategy we are using to combine them. Finally, we present the interesting results shown by SpaML in terms of accuracy and precision.


title: Deep Learning Models for Predicting Wildfires from Historical Remote-Sensing Data

abstract: Identifying regions that have high likelihood for wildfires is a key component of land and forestry management and disaster preparedness. We create a data set by aggregating nearly a decade of remote-sensing data and historical fire records to predict wildfires. This prediction problem is framed as three machine learning tasks. Results are compared and analyzed for four different deep learning models to estimate wildfire likelihood. The results demonstrate that deep learning models can successfully identify areas of high fire likelihood using aggregated data about vegetation, weather, and topography with an AUC of 83%.


title: The Story of Airplane Wings

abstract: The purpose of this work is to explain how wings work and how they were invented. We use the lens of history, looking at the individual people who wanted to fly, the lens of technology, looking at the key inventions leading up to modern airplanes, and the lens of physics, looking at the equations of airflow that made it all possible. Finally, we derive our own wing from scratch. We do this by simulating a wind tunnel, placing a rectangular occlusion in it, and then using gradient ascent to turn it into a wing.


title: Semantic Label Smoothing for Sequence to Sequence Problems

abstract: Label smoothing has been shown to be an effective regularization strategy in classification, that prevents overfitting and helps in label de-noising. However, extending such methods directly to seq2seq settings, such as Machine Translation, is challenging: the large target output space of such problems makes it intractable to apply label smoothing over all possible outputs. Most existing approaches for seq2seq settings either do token level smoothing, or smooth over sequences generated by randomly substituting tokens in the target sequence. Unlike these works, in this paper, we propose a technique that smooths over \emph{well formed} relevant sequences that not only have sufficient n-gram overlap with the target sequence, but are also \emph{semantically similar}. Our method shows a consistent and significant improvement over the state-of-the-art techniques on different datasets.


title: Exploring the parameter space of quasi-particle model with the strange quark stars

abstract: The properties of strange quark stars are studied within the quasi-particle model. Taking into account the chemical equilibrium and charge neutrality, the EOS of $ (2+1) $-flavor quark matter is obtained. We illustrate the parameter spaces with constraints from two aspects: the one is based on the astronomical results of PSR J$ 0740+6620 $ and GW$ 170817 $, and another is based on the constraints proposed from the theoretical study of compact star that the EOS must ensure the tidal deformability $ \varLambda_{1.4}=190^{+390}_{-120} $ and support a maximum mass above $ 1.97~M_{\odot} $. It is found that the both types of constraints can not restrict the parameter space of quasi-particle model in a reliable region and thus we conclude that the small compact star cannot be strange quark star.


title: Intuitive sequence matching algorithm applied to a sip-and-puff control interface for robotic assistive devices

abstract: This paper presents the development and preliminary validation of a control interface based on a sequence matching algorithm. An important challenge in the field of assistive technology is for users to control high dimensionality devices (e.g., assistive robot with several degrees of freedom, or computer) with low dimensionality control interfaces (e.g., a few switches). Sequence matching consists in the recognition of a pattern obtained from a sensor's signal compared to a predefined pattern library. The objective is to allow the user to input several different commands with a low dimensionality interface (e.g., Morse code allowing inputting several letters with a single switch). In this paper, the algorithm is used in the context of the control of an assistive robotic arm and has been adapted to a sip-and-puff interface where short and long bursts can be detected. Compared to a classic sip-and-puff interface, a preliminary validation with 8 healthy subjects has shown that sequence matching makes the control faster, easier and more comfortable. This paper is a proof of concept that leads the way towards a more advanced algorithm and the usage of more versatile sensors such as inertial measurement units (IMU).


title: Development and Validation of a Data Fusion Algorithm with Low-Cost Inertial Measurement Units to Analyze Shoulder Movements in Manual Workers

abstract: Work-related upper extremity musculoskeletal disorders (WRUED) are a major problem in modern societies as they affect the quality of life of workers and lead to absenteeism and productivity loss. According to studies performed in North America and Western Europe, their prevalence has increased in the last few decades. This challenge calls for improvements in prevention methods. One avenue is through the development of wearable sensor systems to analyze worker's movements and provide feedback to workers and/or clinicians. Such systems could decrease the physical work demands and ultimately prevent musculoskeletal disorders. This paper presents the development and validation of a data fusion algorithm for inertial measurement units to analyze worker's arm elevation. The algorithm was implemented on two commercial sensor systems (Actigraph GT9X and LSM9DS1) and results were compared with the data fusion results from a validated commercial sensor (XSens MVN system). Cross-correlation analyses [r], root-mean-square error (RMSE) and average absolute error of estimate were used to establish the construct validity of the algorithm. Five subjects each performed ten different arm elevation tasks. The results show that the algorithm is valid to evaluate shoulder movements with high correlations between the results of the two different sensors and the commercial sensor (0.900-0.998) and relatively low RMSE value for the ten tasks (1.66-11.24{\deg}). The proposed data fusion algorithm could thus be used to estimate arm elevation.


title: Dynamic Walking: Toward Agile and Efficient Bipedal Robots

abstract: Dynamic walking on bipedal robots has evolved from an idea in science fiction to a practical reality. This is due to continued progress in three key areas: a mathematical understanding of locomotion, the computational ability to encode this mathematics through optimization, and the hardware capable of realizing this understanding in practice. In this context, this review article outlines the end-to-end process of methods which have proven effective in the literature for achieving dynamic walking on bipedal robots. We begin by introducing mathematical models of locomotion, from reduced order models that capture essential walking behaviors to hybrid dynamical systems that encode the full order continuous dynamics along with discrete footstrike dynamics. These models form the basis for gait generation via (nonlinear) optimization problems. Finally, models and their generated gaits merge in the context of real-time control, wherein walking behaviors are translated to hardware. The concepts presented are illustrated throughout in simulation, and experimental instantiation on multiple walking platforms are highlighted to demonstrate the ability to realize dynamic walking on bipedal robots that is agile and efficient.


title: Near Optimality of Finite Memory Feedback Policies in Partially Observed Markov Decision Processes

abstract: In the theory of Partially Observed Markov Decision Processes (POMDPs), existence of optimal policies have in general been established via converting the original partially observed stochastic control problem to a fully observed one on the belief space, leading to a belief-MDP. However, computing an optimal policy for this fully observed model, and so for the original POMDP, using classical dynamic or linear programming methods is challenging even if the original system has finite state and action spaces, since the state space of the fully observed belief-MDP model is always uncountable. Furthermore, there exist very few rigorous value function approximation and optimal policy approximation results, as regularity conditions needed often require a tedious study involving the spaces of probability measures leading to properties such as Feller continuity. In this paper, we study a planning problem for POMDPs where the system dynamics and measurement channel model are assumed to be known. We construct an approximate belief model by discretizing the belief space using only finite window information variables. We then find optimal policies for the approximate model and we rigorously establish near optimality of the constructed finite window control policies in POMDPs under mild non-linear filter stability conditions and the assumption that the measurement and action sets are finite (and the state space is real vector valued). We also establish a rate of convergence result which relates the finite window memory size and the approximation error bound, where the rate of convergence is exponential under explicit and testable exponential filter stability conditions. While there exist many experimental results and few rigorous asymptotic convergence results, an explicit rate of convergence result is new in the literature, to our knowledge.


title: Exact and approximate continuous-variable gate decompositions

abstract: We gather and examine in detail gate decomposition techniques for continuous-variable quantum computers and also introduce some new techniques which expand on these methods. Both exact and approximate decomposition methods are studied and gate counts are compared for some common operations. While each having distinct advantages, we find that exact decompositions have lower gate counts whereas approximate techniques can cover decompositions for all continuous-variable operations but require significant circuit depth for a modest precision.


title: Microscopic mechanism of high-temperature ferromagnetism in Fe, Mn, and Cr-doped InSb, InAs, and GaSb magnetic semiconductors

abstract: In recent experiments, high Curie temperatures Tc above room temperature were reported in ferromagnetic semiconductors Fe-doped GaSb and InSb, while low Tc between 20 K to 90 K were observed in some other semiconductors with the same crystal structure, including Fe-doped InAs and Mn-doped GaSb, InSb, and InAs. Here we study systematically the origin of high temperature ferromagnetism in Fe, Mn, Cr-doped GaSb, InSb, and InAs magnetic semiconductors by combining the methods of density functional theory and quantum Monte Carlo. In the diluted impurity limit, the calculations show that the impurities Fe, Mn, and Cr have similar magnetic correlations in the same semiconductors. Our results suggest that high (low) Tc obtained in these experiments mainly comes from high (low) impurity concentrations. In addition, our calculations predict the ferromagnetic semiconductors of Cr-doped InSb, InAs, and GaSb that may have possibly high Tc. Our results show that the origin of high Tc in (Ga,Fe)Sb and (In,Fe)Sb is not due to the carrier induced mechanism because Fe3+ does not introduce carriers.


title: Advances to tackle backbone flexibility in protein docking

abstract: Computational docking methods can provide structural models of protein-protein complexes, but protein backbone flexibility upon association often thwarts accurate predictions. In recent blind challenges, medium or high accuracy models were submitted in less than 20% of the "difficult" targets (with significant backbone change or uncertainty). Here, we describe recent developments in protein-protein docking and highlight advances that tackle backbone flexibility. In molecular dynamics and Monte Carlo approaches, enhanced sampling techniques have reduced time-scale limitations. Internal coordinate formulations can now capture realistic motions of monomers and complexes using harmonic dynamics. And machine learning approaches adaptively guide docking trajectories or generate novel binding site predictions from deep neural networks trained on protein interfaces. These tools poise the field to break through the longstanding challenge of correctly predicting complex structures with significant conformational change.


title: Structural disorder-driven topological phase transition in noncentrosymmetric BiTeI

abstract: We investigate the possibility of using structural disorder to induce a topological phase in a solid state system. Using first-principles calculations, we introduce structural disorder in the trivial insulator BiTeI and observe the emergence of a topological insulating phase. By modifying the bonding environments, the crystal-field splitting is enhanced and the spin-orbit interaction produces a band inversion in the bulk electronic structure. Analysis of the Wannier charge centers and the surface electronic structure reveals a strong topological insulator with Dirac surface states. Finally, we propose a prescription for inducing topological states from disorder in crystalline materials. Understanding how local environments produce topological phases is a key step for predicting disordered and amorphous topological materials.


title: Pulsar Candidate Identification Using Semi-Supervised Generative Adversarial Networks

abstract: Machine learning methods are increasingly helping astronomers identify new radio pulsars. However, they require a large amount of labelled data, which is time consuming to produce and biased. Here we describe a Semi-Supervised Generative Adversarial Network (SGAN) which achieves better classification performance than the standard supervised algorithms using majority unlabelled datasets. We achieved an accuracy and mean F-Score of 94.9% trained on only 100 labelled candidates and 5000 unlabelled candidates compared to our standard supervised baseline which scored at 81.1% and 82.7% respectively. Our final model trained on a much larger labelled dataset achieved an accuracy and mean F-score value of 99.2% and a recall rate of 99.7%. This technique allows for high quality classification during the early stages of pulsar surveys on new instruments when limited labelled data is available. We open-source our work along with a new pulsar-candidate dataset produced from the High Time Resolution Universe - South Low Latitude Survey. This dataset has the largest number of pulsar detections of any public dataset and we hope it will be a valuable tool for benchmarking future machine learning models.


title: Causal Inference in the Presence of Interference in Sponsored Search Advertising

abstract: In classical causal inference, inferring cause-effect relations from data relies on the assumption that units are independent and identically distributed. This assumption is violated in settings where units are related through a network of dependencies. An example of such a setting is ad placement in sponsored search advertising, where the clickability of a particular ad is potentially influenced by where it is placed and where other ads are placed on the search result page. In such scenarios, confounding arises due to not only the individual ad-level covariates but also the placements and covariates of other ads in the system. In this paper, we leverage the language of causal inference in the presence of interference to model interactions among the ads. Quantification of such interactions allows us to better understand the click behavior of users, which in turn impacts the revenue of the host search engine and enhances user satisfaction. We illustrate the utility of our formalization through experiments carried out on the ad placement system of the Bing search engine.


title: Multi-label Few/Zero-shot Learning with Knowledge Aggregated from Multiple Label Graphs

abstract: Few/Zero-shot learning is a big challenge of many classifications tasks, where a classifier is required to recognise instances of classes that have very few or even no training samples. It becomes more difficult in multi-label classification, where each instance is labelled with more than one class. In this paper, we present a simple multi-graph aggregation model that fuses knowledge from multiple label graphs encoding different semantic label relationships in order to study how the aggregated knowledge can benefit multi-label zero/few-shot document classification. The model utilises three kinds of semantic information, i.e., the pre-trained word embeddings, label description, and pre-defined label relations. Experimental results derived on two large clinical datasets (i.e., MIMIC-II and MIMIC-III) and the EU legislation dataset show that methods equipped with the multi-graph knowledge aggregation achieve significant performance improvement across almost all the measures on few/zero-shot labels.


title: Promise and Challenges of a Data-Driven Approach for Battery Lifetime Prognostics

abstract: Recent data-driven approaches have shown great potential in early prediction of battery cycle life by utilizing features from the discharge voltage curve. However, these studies caution that data-driven approaches must be combined with specific design of experiments in order to limit the range of aging conditions, since the expected life of Li-ion batteries is a complex function of various aging factors. In this work, we investigate the performance of the data-driven approach for battery lifetime prognostics with Li-ion batteries cycled under a variety of aging conditions, in order to determine when the data-driven approach can successfully be applied. Results show a correlation between the variance of the discharge capacity difference and the end-of-life for cells aged under a wide range of charge/discharge C-rates and operating temperatures. This holds despite the different conditions being used not only to cycle the batteries but also to obtain the features: the features are calculated directly from cycling data without separate slow characterization cycles at a controlled temperature. However, the correlation weakens considerably when the voltage data window for feature extraction is reduced, or when features from the charge voltage curve instead of discharge are used. As deep constant-current discharges rarely happen in practice, this imposes new challenges for applying this method in a real-world system.


title: Optimal Control for Discrete-time NCSs with Input Delay and Markovian Packet Losses: Hold-Input Case

abstract: This paper is concerned with the linear quadratic optimal control problem for networked system simultaneously with input delay and Markovian dropout. Different from the results in the literature, we consider the hold-input strategy, which is much more computationally complicated than zero-input strategy, but much better in most cases especially in the transition phase. Necessary and sufficient conditions for the solvability of optimal control problem over a finite horizon are given by the coupled difference Riccati-type equations. Moreover, the networked control system is mean-square stability if and only if the coupled algebraic Riccati-type equations have a particular solution. The key technique in this paper is to tackle the forward and backward difference equations, which are more difficult to be dealt with, due to the adaptability of controller and the temporal correlation caused by simultaneous input delay and Markovian jump.


title: Multi-feature Clustering of Step Data using Multivariate Functional Principal Component Analysis

abstract: This paper presents a new statistical method for clustering step data, a popular form of health record data easily obtained from wearable devices. Since step data are high-dimensional and zero-inflated, classical methods such as K-means and partitioning around medoid (PAM) cannot be applied directly. The proposed method is a novel combination of newly constructed variables that reflect the inherent features of step data, such as quantity, strength, and pattern, and a multivariate functional principal component analysis that can integrate all the features of the step data for clustering. The proposed method is implemented by applying a conventional clustering method such as K-means and PAM to the multivariate functional principal component scores obtained from these variables. Simulation studies and real data analysis demonstrate significant improvement in clustering quality.


title: NanoNET: an extendable Python framework for semi-empirical tight-binding models

abstract: We present a novel open-source Python framework called NanoNET (Nanoscale Non-equilibrium Electron Transport) for modelling electronic structure and transport. Our method is based on the tight-binding method and non-equilibrium Green's function theory. The core functionality of the framework is providing facilities for efficient construction of tight-binding Hamiltonian matrices from a list of atomic coordinates and a lookup table of the two-center integrals in dense, sparse, or block-tridiagonal forms. The framework implements a method based on $kd$-tree nearest-neighbour search and is applicable to isolated atomic clusters and periodic structures. A set of subroutines for detecting the block-tridiagonal structure of a Hamiltonian matrix and splitting it into series of diagonal and off-diagonal blocks is based on a new greedy algorithm with recursion. Additionally the developed software is equipped with a set of programs for computing complex band structure, self-energies of elastic scattering processes, and Green's functions. Examples of usage and capabilities of the computational framework are illustrated by computing the band structure and transport properties of a silicon nanowire as well as the band structure of bulk bismuth.


title: Rotating quantum turbulence in the unitary Fermi gas

abstract: Quantized vortices carry the angular momentum in rotating superfluids, and are key to the phenomenon of quantum turbulence. Advances in ultra-cold atom technology enable quantum turbulence to be studied in regimes with both experimental and theoretical control, unlike the original contexts of superfluid helium experiments. While much work has been performed with bosonic systems, detailed studies of fermionic quantum turbulence are nascent, despite wide applicability to other contexts such as rotating neutron stars. In this paper, we present the first large-scale study of quantum turbulence in rotating fermionic superfluids using an accurate orbital based time-dependent density functional theory (DFT) called the superfluid local density approximation (SLDA). We identify two different modes of turbulent decay in the dynamical equilibration of a rotating fermionic superfluid, and contrast these results with a computationally simpler orbital-free DFT, which we find can qualitatively reproduce these decay mechanisms if dissipation is explicitly included. These results demonstrate that one-body dissipation mechanisms intrinsic to fermionic superfluids play a key role differentiating fermionic from bosonic turbulence, but also suggest that simpler orbital-free theories may be corrected so that these more efficient techniques can be used to model extended physical systems such as neutron superfluids in neutron stars.


title: Detecting conflicting summary statistics in likelihood-free inference

abstract: Bayesian likelihood-free methods implement Bayesian inference using simulation of data from the model to substitute for intractable likelihood evaluations. Most likelihood-free inference methods replace the full data set with a summary statistic before performing Bayesian inference, and the choice of this statistic is often difficult. The summary statistic should be low-dimensional for computational reasons, while retaining as much information as possible about the parameter. Using a recent idea from the interpretable machine learning literature, we develop some regression-based diagnostic methods which are useful for detecting when different parts of a summary statistic vector contain conflicting information about the model parameters. Conflicts of this kind complicate summary statistic choice, and detecting them can be insightful about model deficiencies and guide model improvement. The diagnostic methods developed are based on regression approaches to likelihood-free inference, in which the regression model estimates the posterior density using summary statistics as features. Deletion and imputation of part of the summary statistic vector within the regression model can remove conflicts and approximate posterior distributions for summary statistic subsets. A larger than expected change in the estimated posterior density following deletion and imputation can indicate a conflict in which inferences of interest are affected. The usefulness of the new methods is demonstrated in a number of real examples.


title: The Language of Food during the Pandemic: Hints about the Dietary Effects of Covid-19

abstract: We study the language of food on Twitter during the pandemic lockdown in the United States, focusing on the two month period of March 15 to May 15, 2020. Specifically, we analyze over770,000 tweets published during the lockdown and the equivalent period in the five previous years and highlight several worrying trends. First, we observe that during the lockdown there was a notable shift from mentions of healthy foods to unhealthy foods. Second, we show an increased pointwise mutual information of depression hashtags with food-related tweets posted during the lockdown and an increased association between depression hashtags and unhealthy foods, tobacco, and alcohol during the lockdown.


title: Human-guided Robot Behavior Learning: A GAN-assisted Preference-based Reinforcement Learning Approach

abstract: Human demonstrations can provide trustful samples to train reinforcement learning algorithms for robots to learn complex behaviors in real-world environments. However, obtaining sufficient demonstrations may be impractical because many behaviors are difficult for humans to demonstrate. A more practical approach is to replace human demonstrations by human queries, i.e., preference-based reinforcement learning. One key limitation of the existing algorithms is the need for a significant amount of human queries because a large number of labeled data is needed to train neural networks for the approximation of a continuous, high-dimensional reward function. To reduce and minimize the need for human queries, we propose a new GAN-assisted human preference-based reinforcement learning approach that uses a generative adversarial network (GAN) to actively learn human preferences and then replace the role of human in assigning preferences. The adversarial neural network is simple and only has a binary output, hence requiring much less human queries to train. Moreover, a maximum entropy based reinforcement learning algorithm is designed to shape the loss towards the desired regions or away from the undesired regions. To show the effectiveness of the proposed approach, we present some studies on complex robotic tasks without access to the environment reward in a typical MuJoCo robot locomotion environment. The obtained results show our method can achieve a reduction of about 99.8% human time without performance sacrifice.


title: AdaBelief Optimizer: Adapting Stepsizes by the Belief in Observed Gradients

abstract: Most popular optimizers for deep learning can be broadly categorized as adaptive methods (e.g. Adam) and accelerated schemes (e.g. stochastic gradient descent (SGD) with momentum). For many models such as convolutional neural networks (CNNs), adaptive methods typically converge faster but generalize worse compared to SGD; for complex settings such as generative adversarial networks (GANs), adaptive methods are typically the default because of their stability.We propose AdaBelief to simultaneously achieve three goals: fast convergence as in adaptive methods, good generalization as in SGD, and training stability. The intuition for AdaBelief is to adapt the stepsize according to the "belief" in the current gradient direction. Viewing the exponential moving average (EMA) of the noisy gradient as the prediction of the gradient at the next time step, if the observed gradient greatly deviates from the prediction, we distrust the current observation and take a small step; if the observed gradient is close to the prediction, we trust it and take a large step. We validate AdaBelief in extensive experiments, showing that it outperforms other methods with fast convergence and high accuracy on image classification and language modeling. Specifically, on ImageNet, AdaBelief achieves comparable accuracy to SGD. Furthermore, in the training of a GAN on Cifar10, AdaBelief demonstrates high stability and improves the quality of generated samples compared to a well-tuned Adam optimizer. Code is available at https://github.com/juntang-zhuang/Adabelief-Optimizer


title: Unsupervised Self-training Algorithm Based on Deep Learning for Optical Aerial Images Change Detection

abstract: Optical aerial images change detection is an important task in earth observation and has been extensively investigated in the past few decades. Generally, the supervised change detection methods with superior performance require a large amount of labeled training data which is obtained by manual annotation with high cost. In this paper, we present a novel unsupervised self-training algorithm (USTA) for optical aerial images change detection. The traditional method such as change vector analysis is used to generate the pseudo labels. We use these pseudo labels to train a well designed convolutional neural network. The network is used as a teacher to classify the original multitemporal images to generate another set of pseudo labels. Then two set of pseudo labels are used to jointly train a student network with the same structure as the teacher. The final change detection result can be obtained by the trained student network. Besides, we design an image filter to control the usage of change information in the pseudo labels in the training process of the network. The whole process of the algorithm is an unsupervised process without manually marked labels. Experimental results on the real datasets demonstrate competitive performance of our proposed method.


title: Masked Contrastive Representation Learning for Reinforcement Learning

abstract: Improving sample efficiency is a key research problem in reinforcement learning (RL), and CURL, which uses contrastive learning to extract high-level features from raw pixels of individual video frames, is an efficient algorithm~\citep{srinivas2020curl}. We observe that consecutive video frames in a game are highly correlated but CURL deals with them independently. To further improve data efficiency, we propose a new algorithm, masked contrastive representation learning for RL, that takes the correlation among consecutive inputs into consideration. In addition to the CNN encoder and the policy network in CURL, our method introduces an auxiliary Transformer module to leverage the correlations among video frames. During training, we randomly mask the features of several frames, and use the CNN encoder and Transformer to reconstruct them based on the context frames. The CNN encoder and Transformer are jointly trained via contrastive learning where the reconstructed features should be similar to the ground-truth ones while dissimilar to others. During inference, the CNN encoder and the policy network are used to take actions, and the Transformer module is discarded. Our method achieves consistent improvements over CURL on $14$ out of $16$ environments from DMControl suite and $21$ out of $26$ environments from Atari 2600 Games. The code is available at https://github.com/teslacool/m-curl.


title: Equilibrium Dynamics of the Sub-Ohmic Spin-boson Model At Finite Temperature

abstract: We use the full-density matrix (FDM) numerical renormalization group (NRG) method to calculate the equilibrium dynamical correlation function $C(\omega)$ of the spin operator $\sigma_z$ at finite temperature for the sub-Ohmic spin-boson model. A peak is observed at the frequency $\omega_{T}\sim T$ in the curve of $C(\omega)$. The curve merges with the zero temperature $C(\omega)$ in $\omega \gg \omega_{T}$ and deviate significantly from the power-law form $\omega^{\pm s}$ of the zero temperature curve in $\omega \ll\omega_{T}$.


title: Lense-Thirring precession and gravito-gyromagnetic ratio

abstract: The geodesics of bound spherical orbits i.e. of orbits performing Lense-Thirring precession, are obtained in the case of the $\Lambda$-term within gravito-electromagnetic formalism. It is shown that the presence of the $\Lambda$-term in the equations of gravity leads to both relativistic and non-relativistic corrections in the equations of motion. The contribution of the $\Lambda$-term in the Lense-Thirring precession is interpreted as an additional relativistic correction and the gravito-gyromagnetic ratio is defined.


title: Modeling Microglia Activation and Inflammation-Based Neuroprotectant Strategies During Ischemic Stroke

abstract: Neural inflammation immediately follows the onset of ischemic stroke. During this process, microglial cells can be activated into two different phenotypes: the M1 phenotype, which can worsen brain injury by producing pro-inflammatory cytokines; or the M2 phenotype, which can aid in long term recovery by producing anti-inflammatory cytokines. In this study, we formulate a nonlinear system of differential equations to model the activation of microglia post-ischemic stroke, which includes bidirectional switching between the microglia phenotypes, as well as the interactions between these cells and the cytokines that they produce. Further, we explore neuroprotectant-based modeling strategies to suppress the activation of the detrimental M1 phenotype, while promoting activation of the beneficial M2 phenotype. Through use of global sensitivity techniques, we analyze the effects of the model parameters on the ratio of M1 to M2 microglia and the total number of activated microglial cells in the system over time. Results demonstrate the significance of bidirectional microglia phenotype switching on the ratio of M1 to M2 microglia, in both the absence and presence of neuroprotectant terms. Simulations further suggest that early inhibition of M1 activation and support of M2 activation leads to a decreased minimum ratio of M1 to M2 microglia and allows for a larger number of M2 than M1 cells for a longer time period.


title: Auto-STGCN: Autonomous Spatial-Temporal Graph Convolutional Network Search Based on Reinforcement Learning and Existing Research Results

abstract: In recent years, many spatial-temporal graph convolutional network (STGCN) models are proposed to deal with the spatial-temporal network data forecasting problem. These STGCN models have their own advantages, i.e., each of them puts forward many effective operations and achieves good prediction results in the real applications. If users can effectively utilize and combine these excellent operations integrating the advantages of existing models, then they may obtain more effective STGCN models thus create greater value using existing work. However, they fail to do so due to the lack of domain knowledge, and there is lack of automated system to help users to achieve this goal. In this paper, we fill this gap and propose Auto-STGCN algorithm, which makes use of existing models to automatically explore high-performance STGCN model for specific scenarios. Specifically, we design Unified-STGCN framework, which summarizes the operations of existing architectures, and use parameters to control the usage and characteristic attributes of each operation, so as to realize the parameterized representation of the STGCN architecture and the reorganization and fusion of advantages. Then, we present Auto-STGCN, an optimization method based on reinforcement learning, to quickly search the parameter search space provided by Unified-STGCN, and generate optimal STGCN models automatically. Extensive experiments on real-world benchmark datasets show that our Auto-STGCN can find STGCN models superior to existing STGCN models with heuristic parameters, which demonstrates the effectiveness of our proposed method.


title: Neural Deepfake Detection with Factual Structure of Text

abstract: Deepfake detection, the task of automatically discriminating machine-generated text, is increasingly critical with recent advances in natural language generative models. Existing approaches to deepfake detection typically represent documents with coarse-grained representations. However, they struggle to capture factual structures of documents, which is a discriminative factor between machine-generated and human-written text according to our statistical analysis. To address this, we propose a graph-based model that utilizes the factual structure of a document for deepfake detection of text. Our approach represents the factual structure of a given document as an entity graph, which is further utilized to learn sentence representations with a graph neural network. Sentence representations are then composed to a document representation for making predictions, where consistent relations between neighboring sentences are sequentially modeled. Results of experiments on two public deepfake datasets show that our approach significantly improves strong base models built with RoBERTa. Model analysis further indicates that our model can distinguish the difference in the factual structure between machine-generated text and human-written text.


title: Locomotion Design for an Internally Actuated Cubic Robot for Exploration of Low Gravity Bodies in the Solar System

abstract: The exploration of asteroids and comets is important in the quest for the formation of the Solar System and it is an important step for human space travel. Moving on the surface of asteroids is challenging for future robotic explorers due to the weak gravity force. In this research, an approach that is based on a new kind of jumping rovers is presented. This robotic platform has internal masses and by spinning up these flywheels and suddenly stopping them, it is feasible to perform a hop from a few meters up to hundreds of meters. In contrast to related works where robotic explorers usually stop a flywheel instantaneously, the INAHOPPER prototype takes advantage of on stopping a flywheel by voltage inversion in a short lapse to modify the launch angle, a very useful action over terrains with different degrees of inclination. This article discusses, first, the dynamics of the rover for a 2D model, second, the control algorithm executed in the prototype for braking the flywheel, and third, the analysis of the performance of the flywheel to make simulations of the trajectories over an asteroid.


title: Minimizing Pumping Energy Cost in Real-time Operations of Water Distribution Systems using Economic Model Predictive Control

abstract: Optimizing pump operations is a challenging task for real-time management of water distribution systems (WDSs). With suitable pump scheduling, pumping costs can be significantly reduced. In this research, a novel economic model predictive control (EMPC) framework for real-time management of WDSs is proposed. Optimal pump operations are selected based on predicted system behavior over a receding time horizon with the aim to minimize the total pumping energy cost. Time-varying electricity tariffs are considered while all the required water demands are satisfied. The novelty of this framework is to choose the number of pumps to operate in each pump station as decision variables in order to optimize the total pumping energy costs. By using integer programming, the proposed EMPC is applied to a benchmark case study, the Richmond Pruned network. The simulation with an EPANET hydraulic simulator is implemented. Moreover, a comparison of the results obtained using the proposed EMPC with those obtained using trigger-level control demonstrates significant economic benefits of the proposed EMPC.


title: Diagnosing First and Second Order Phase Transitions with Probes of Quantum Chaos

abstract: We explore quantum phase transitions using two probes of quantum chaos: out-of-time-order correlators (OTOCs) and the $r$-parameter obtained from the level spacing statistics. In particular, we address $p$-spin models associated with quantum annealing or reverse annealing. Quantum annealing triggers first-order or second-order phase transitions, which is crucial for the performance of quantum devices. We find that the time-averaging OTOCs for the ground state and the average $r$-parameter change behavior around the corresponding transition points, diagnosing the phase transition. Furthermore, they can identify the order (first or second) of the phase transition by their behavior at the quantum transition point, which changes abruptly (smoothly) in the case of first-order (second-order) phase transitions.


title: Quantifying and attributing time step sensitivities in present-day climate simulations conducted with EAMv1

abstract: This study assesses the relative importance of time integration error in present-day climate simulations conducted with the atmosphere component of the Energy Exascale Earth System Model version 1 (EAMv1) at 1-degree horizontal resolution. We show that a factor-of-6 reduction of time step size in all major parts of the model leads to significant changes in the long-term mean climate. These changes imply that the reduction of temporal truncation errors leads to a notable although unsurprising degradation of agreement between the simulated and observed present-day climate; the model would require retuning to regain optimal climate fidelity in the absence of those truncation errors. A coarse-grained attribution of the time step sensitivities is carried out by separately shortening time steps used in various components of EAM or by revising the numerical coupling between some processes. The results provide useful clues to help better understand the root causes of time step sensitivities in EAM. The experimentation strategy used here can also provide a pathway for other models to identify and reduce time integration errors.


title: A relation between track length and deposited energy in a homogeneous calorimeter by Geant4 simulation at high energy

abstract: We performed a Geant4 simulation study on showers generated by electrons and hadrons in a large homogeneous calorimeter. We found that the energy deposit can be expressed as a linear function of the track length. The line does not pass through the origin, and the energy deposit at the intercept is proportional to the incident energy. Moreover, for both electrons and hadrons, the slope of the line is independent of the incident energy. The energy resolution of the calorimeter can be expressed in terms of the distribution around the correlation line, which we found to be very good at about $ 19\% / \sqrt{E(\rm{GeV})}$ for pions.


title: Early spectral evolution of classical novae: consistent evidence for multiple distinct outflows

abstract: The physical mechanism driving mass ejection during a nova eruption is still poorly understood. Possibilities include ejection in a single ballistic event, a common envelope interaction, a continuous wind, or some combination of these processes. Here we present a study of 12 Galactic novae, for which we have pre-maximum high-resolution spectroscopy. All 12 novae show the same spectral evolution. Before optical peak, they show a slow P Cygni component. After peak a fast component quickly arises, while the slow absorption remains superimposed on top of it, implying the presence of at least two physically distinct flows. For novae with high-cadence monitoring, a third, intermediate-velocity component is also observed. These observations are consistent with a scenario where the slow component is associated with the initial ejection of the accreted material and the fast component with a radiation-driven wind from the white dwarf. When these flows interact, the slow flow is swept up by the fast flow, producing the intermediate component. These colliding flows may produce the gamma-ray emission observed in some novae. Our spectra also show that the transient heavy element absorption lines seen in some novae have the same velocity structure and evolution as the other lines in the spectrum, implying an association with the nova ejecta rather than a pre-existing circumbinary reservoir of gas or material ablated from the secondary. While this basic scenario appears to qualitatively reproduce multi-wavelength observations of classical novae, substantial theoretical and observational work is still needed to untangle the rich diversity of nova properties.


title: New observations of NGC 1624-2 reveal a complex magnetospheric structure and underlying surface magnetic geometry

abstract: NGC 1624-2 is the most strongly magnetized O-type star known. Previous spectroscopic observations of this object in the ultraviolet provided evidence that it hosts a large and dense circumstellar magnetosphere. Follow-up observations obtained with the \textit{Hubble Space Telescope} not only confirm that previous inference, but also suggest that NGC 1624-2's magnetosphere has a complex structure. Furthermore, an expanded spectropolarimetric time series shows a potential departure from a dipolar magnetic field geometry, which could mean that the strongest field detected at the surface of an O-type star is also topologically complex. This result raises important questions regarding the origin and evolution of magnetic fields in massive stars.


title: Design of Spatial-Spectral Filters for CT Material Decomposition

abstract: Spectral CT has shown promise for high-sensitivity quantitative imaging and material decomposition. This work presents a new device called a spatial-spectral filter (SSF) which consists of a tiled array of filter materials positioned near the x-ray source that is used to modulate the spectral shape of the x-ray beam. The filter is moved to obtain projection data that is sparse in each spectral channel. To process this sparse data, we employ a direct model-based material decomposition (MBMD)to reconstruct basis material density images directly from the SSF CT data. To evaluate different possible SSF designs, we define a new Fisher-information-based predictive image quality metric called separability index which characterizes the ability of a spectral CT system to distinguish between the signals from two or more materials. This predictive metric is used to define a system design optimization framework. We have applied this framework to find optimized combinations of filter materials, filter tile widths, and source settings for SSF CT. We conducted simulation-based design optimization study and separability-optimized filter designs are presented for water/iodine imaging and water/iodine/gadolinium/gold imaging for different patient sizes. Finally, we present MBMD results using simulated SSFCT data using the optimized designs to demonstrate the ability to reconstruct basis material density images and to show the benefits of the optimized designs.


title: Modified Kernel MLAA Using Autoencoder for PET-enabled Dual-Energy CT

abstract: Combined use of PET and dual-energy CT provides complementary information for multi-parametric imaging. PETenabled dual-energy CT combines a low-energy x-ray CT image with a high-energy &\gamma&-ray CT (GCT) image reconstructed from time-of-flight PET emission data to enable dual-energy CT material decomposition on a PET/CT scanner. The maximumlikelihood attenuation and activity (MLAA) algorithm has been used for GCT reconstruction but suffers from noise. Kernel MLAA exploits an x-ray CT image prior through the kernel framework to guide GCT reconstruction and has demonstrated substantial improvements in noise suppression. However, similar to other kernel methods for image reconstruction, the existing kernel MLAA uses image intensity-based features to construct the kernel representation, which is not always robust and may lead to suboptimal reconstruction with artifacts. In this paper, we propose a modified kernel method by using an autoencoder convolutional neural network (CNN) to extract an intrinsic feature set from the x-ray CT image prior. A computer simulation study was conducted to compare the autoencoder CNN-derived feature representation with raw image patches for evaluation of kernel MLAA for GCT image reconstruction and dual-energy multimaterial decomposition. The results show that the autoencoder kernel MLAA method can achieve a significant image quality improvement for GCT and material decomposition as compared to the existing kernel MLAA algorithm. A weakness of the proposed method is its potential over-smoothness in a bone region, indicating the importance of further optimization in future work. The codes is available on https://github.com/SiqiLi1020/Autoencoder- Kernel-MLAA.


title: Reducing the Teacher-Student Gap via Spherical Knowledge Disitllation

abstract: Knowledge distillation aims at obtaining a compact and effective model by learning the mapping function from a much larger one. Due to the limited capacity of the student, the student would underfit the teacher. Therefore, student performance would unexpectedly drop when distilling from an oversized teacher, termed the capacity gap problem. We investigate this problem by study the gap of confidence between teacher and student. We find that the magnitude of confidence is not necessary for knowledge distillation and could harm the student performance if the student are forced to learn confidence. We propose Spherical Knowledge Distillation to eliminate this gap explicitly, which eases the underfitting problem. We find this novel knowledge representation can improve compact models with much larger teachers and is robust to temperature. We conducted experiments on both CIFAR100 and ImageNet, and achieve significant improvement. Specifically, we train ResNet18 to 73.0 accuracy, which is a substantial improvement over previous SOTA and is on par with resnet34 almost twice the student size. The implementation has been shared at https://github.com/forjiuzhou/Spherical-Knowledge-Distillation.


title: CS2-Net: Deep Learning Segmentation of Curvilinear Structures in Medical Imaging

abstract: Automated detection of curvilinear structures, e.g., blood vessels or nerve fibres, from medical and biomedical images is a crucial early step in automatic image interpretation associated to the management of many diseases. Precise measurement of the morphological changes of these curvilinear organ structures informs clinicians for understanding the mechanism, diagnosis, and treatment of e.g. cardiovascular, kidney, eye, lung, and neurological conditions. In this work, we propose a generic and unified convolution neural network for the segmentation of curvilinear structures and illustrate in several 2D/3D medical imaging modalities. We introduce a new curvilinear structure segmentation network (CS2-Net), which includes a self-attention mechanism in the encoder and decoder to learn rich hierarchical representations of curvilinear structures. Two types of attention modules - spatial attention and channel attention - are utilized to enhance the inter-class discrimination and intra-class responsiveness, to further integrate local features with their global dependencies and normalization, adaptively. Furthermore, to facilitate the segmentation of curvilinear structures in medical images, we employ a 1x3 and a 3x1 convolutional kernel to capture boundary features. ...


title: Formalizing Trust in Artificial Intelligence: Prerequisites, Causes and Goals of Human Trust in AI

abstract: Trust is a central component of the interaction between people and AI, in that 'incorrect' levels of trust may cause misuse, abuse or disuse of the technology. But what, precisely, is the nature of trust in AI? What are the prerequisites and goals of the cognitive mechanism of trust, and how can we promote them, or assess whether they are being satisfied in a given interaction? This work aims to answer these questions. We discuss a model of trust inspired by, but not identical to, sociology's interpersonal trust (i.e., trust between people). This model rests on two key properties of the vulnerability of the user and the ability to anticipate the impact of the AI model's decisions. We incorporate a formalization of 'contractual trust', such that trust between a user and an AI is trust that some implicit or explicit contract will hold, and a formalization of 'trustworthiness' (which detaches from the notion of trustworthiness in sociology), and with it concepts of 'warranted' and 'unwarranted' trust. We then present the possible causes of warranted trust as intrinsic reasoning and extrinsic behavior, and discuss how to design trustworthy AI, how to evaluate whether trust has manifested, and whether it is warranted. Finally, we elucidate the connection between trust and XAI using our formalization.


title: RetiNerveNet: Using Recursive Deep Learning to Estimate Pointwise 24-2 Visual Field Data based on Retinal Structure

abstract: Glaucoma is the leading cause of irreversible blindness in the world, affecting over 70 million people. The cumbersome Standard Automated Perimetry (SAP) test is most frequently used to detect visual loss due to glaucoma. Due to the SAP test's innate difficulty and its high test-retest variability, we propose the RetiNerveNet, a deep convolutional recursive neural network for obtaining estimates of the SAP visual field. RetiNerveNet uses information from the more objective Spectral-Domain Optical Coherence Tomography (SDOCT). RetiNerveNet attempts to trace-back the arcuate convergence of the retinal nerve fibers, starting from the Retinal Nerve Fiber Layer (RNFL) thickness around the optic disc, to estimate individual age-corrected 24-2 SAP values. Recursive passes through the proposed network sequentially yield estimates of the visual locations progressively farther from the optic disc. While all the methods used for our experiments exhibit lower performance for the advanced disease group, the proposed network is observed to be more accurate than all the baselines for estimating the individual visual field values. We further augment RetiNerveNet to additionally predict the SAP Mean Deviation values and also create an ensemble of RetiNerveNets that further improves the performance, by increasingly weighting-up underrepresented parts of the training data.


title: Reverse Engineering Imperceptible Backdoor Attacks on Deep Neural Networks for Detection and Training Set Cleansing

abstract: Backdoor data poisoning is an emerging form of adversarial attack usually against deep neural network image classifiers. The attacker poisons the training set with a relatively small set of images from one (or several) source class(es), embedded with a backdoor pattern and labeled to a target class. For a successful attack, during operation, the trained classifier will: 1) misclassify a test image from the source class(es) to the target class whenever the same backdoor pattern is present; 2) maintain a high classification accuracy for backdoor-free test images. In this paper, we make a break-through in defending backdoor attacks with imperceptible backdoor patterns (e.g. watermarks) before/during the training phase. This is a challenging problem because it is a priori unknown which subset (if any) of the training set has been poisoned. We propose an optimization-based reverse-engineering defense, that jointly: 1) detects whether the training set is poisoned; 2) if so, identifies the target class and the training images with the backdoor pattern embedded; and 3) additionally, reversely engineers an estimate of the backdoor pattern used by the attacker. In benchmark experiments on CIFAR-10, for a large variety of attacks, our defense achieves a new state-of-the-art by reducing the attack success rate to no more than 4.9% after removing detected suspicious training images.


title: Determining minimum number of required accelerometer for output-only structural identification of frames

abstract: Operational modal analysis (OMA) aims at identifying the modal properties of a structure based on response data of the structure excited by ambient sources. Modal parameters of the ambient vibration structures consist of natural frequencies, mode shapes, and modal damping ratios. In this paper, a typical frame with arbitrary loading has been modeled in finite element software, ANSYS, and the responses (accelerations of nodes) have been achieved. By using these data and the codes written in MATLAB, the modal parameters (natural frequencies, mode shapes) of the beams are identified with FDD (Frequency Domain Decomposition) and PP (Peak Picking) methods and then justified with the results of input-output method which was determined by modal analysis. The results indicate that there is a good agreement between three methods for determining the dynamic characteristics of frames. Then, the minimum number of required accelerometer has been determined that recording the acceleration in that location leads to identifying all the natural frequencies of the frame.


title: Homogeneity of neutron transmission imaging over a large sensitive area with a four-channel superconducting detector

abstract: We previously proposed a method to detect neutrons by using a current-biased kinetic inductance detector (CB-KID), where neutrons are converted into charged particles using a 10B conversion layer. The charged particles are detected based on local changes in kinetic inductance of X and Y superconducting meanderlines under a modest DC bias current. The system uses a delay-line method to locate the positions of neutron-10B reactions by acquiring the four arrival timestamps of signals that propagate from hot spots created by a passing charged particle to the end electrodes of the meanderlines. Unlike conventional multi-pixel imaging systems, the CB-KID system performs high spatial resolution imaging over a 15 mm x 15 mm sensitive area using only four channel readouts. Given the large sensitive area, it is important to check the spatial homogeneity and linearity of detected neutron positions when imaging with CB-KID. To this end we imaged a pattern of 10B dot absorbers with a precise dot pitch to investigate the spatial homogeneity of the detector. We confirmed the spatial homogeneity of detected dot positions based on the distribution of measured dot pitches across the sensitive area of the detector. We demonstrate potential applications of the system by taking a clear transmission image of tiny metallic screws and nuts and a ladybug. The image was useful for characterizing the ladybug noninvasively. Detection efficiencies were low when the detector was operated at 4 K, so we plan to explore raising the operating temperature towards the critical temperature of the detector as a means to improve counting rates.


title: NeRF++: Analyzing and Improving Neural Radiance Fields

abstract: Neural Radiance Fields (NeRF) achieve impressive view synthesis results for a variety of capture settings, including 360 capture of bounded scenes and forward-facing capture of bounded and unbounded scenes. NeRF fits multi-layer perceptrons (MLPs) representing view-invariant opacity and view-dependent color volumes to a set of training images, and samples novel views based on volume rendering techniques. In this technical report, we first remark on radiance fields and their potential ambiguities, namely the shape-radiance ambiguity, and analyze NeRF's success in avoiding such ambiguities. Second, we address a parametrization issue involved in applying NeRF to 360 captures of objects within large-scale, unbounded 3D scenes. Our method improves view synthesis fidelity in this challenging scenario. Code is available at https://github.com/Kai-46/nerfplusplus.


title: Securing Manufacturing Using Blockchain

abstract: Due to the rise of Industrial Control Systems (ICSs) cyber-attacks in the recent decade, various security frameworks have been designed for anomaly detection. While advanced ICS attacks use sequential phases to launch their final attacks, existing anomaly detection methods can only monitor a single source of data. Therefore, analysis of multiple security data can provide comprehensive and system-wide anomaly detection in industrial networks. In this paper, we propose an anomaly detection framework for ICSs that consists of two stages: i) blockchain-based log management where the logs of ICS devices are collected in a secure and distributed manner, and ii) multi-source anomaly detection where the blockchain logs are analysed using multi-source deep learning which in turn provides a system wide anomaly detection method. We validated our framework using two ICS datasets: a factory automation dataset and a Secure Water Treatment (SWAT) dataset. These datasets contain physical and network level normal and abnormal traffic. The performance of our new framework is compared with single-source machine learning methods. The precision of our framework is 95% which is comparable with single-source anomaly detectors.


title: Knowledge Transfer in Multi-Task Deep Reinforcement Learning for Continuous Control

abstract: While Deep Reinforcement Learning (DRL) has emerged as a promising approach to many complex tasks, it remains challenging to train a single DRL agent that is capable of undertaking multiple different continuous control tasks. In this paper, we present a Knowledge Transfer based Multi-task Deep Reinforcement Learning framework (KTM-DRL) for continuous control, which enables a single DRL agent to achieve expert-level performance in multiple different tasks by learning from task-specific teachers. In KTM-DRL, the multi-task agent first leverages an offline knowledge transfer algorithm designed particularly for the actor-critic architecture to quickly learn a control policy from the experience of task-specific teachers, and then it employs an online learning algorithm to further improve itself by learning from new online transition samples under the guidance of those teachers. We perform a comprehensive empirical study with two commonly-used benchmarks in the MuJoCo continuous control task suite. The experimental results well justify the effectiveness of KTM-DRL and its knowledge transfer and online learning algorithms, as well as its superiority over the state-of-the-art by a large margin.


title: Frequency-specific, valveless flow control in insect-mimetic microfluidic devices

abstract: Inexpensive, portable lab-on-a-chip devices would revolutionize fields like environmental monitoring and global health, but current microfluidic chips are tethered to extensive off-chip hardware. Insects, however, are self-contained and expertly manipulate fluids at the microscale using largely unexplored methods. We fabricated a series of microfluidic devices that mimic key features of insect respiratory kinematics observed by synchrotron-radiation imaging, including the collapse of portions of multiple respiratory tracts in response to a single fluctuating pressure signal. In one single-channel device, the flow rate and direction could be controlled by the actuation frequency alone, without the use of internal valves. Additionally, we fabricated multichannel chips whose individual channels responded selectively (on with a variable, frequency-dependent flow rate, or off) to a single, global actuation frequency. Our results demonstrate that insect-mimetic designs have the potential to drastically reduce the actuation overhead for microfluidic chips, and that insect respiratory systems may share features with impedance-mismatch pumps.


title: Readout Rebalancing for Near Term Quantum Computers

abstract: Readout errors are a significant source of noise for near term intermediate scale quantum computers. Mismeasuring a qubit as a 1 when it should be 0 occurs much less often than mismeasuring a qubit as a 0 when it should have been 1. We make the simple observation that one can improve the readout fidelity of quantum computers by applying targeted X gates prior to performing a measurement. These X gates are placed so that the expected number of qubits in the 1 state is minimized. Classical post processing can undo the effect of the X gates so that the expectation value of any observable is unchanged. We show that the statistical uncertainty following readout error corrections is smaller when using readout rebalancing. The statistical advantage is circuit- and computer-dependent, and is demonstrated for the $W$ state, a Grover search, and for a Gaussian state. The benefit in statistical precision is most pronounced (and nearly a factor of two in some cases) when states with many qubits in the excited state have high probability.


title: MedDG: An Entity-Centric Medical Consultation Dataset for Entity-Aware Medical Dialogue Generation

abstract: Developing conversational agents to interact with patients and provide primary clinical advice has attracted increasing attention due to its huge application potential, especially in the time of COVID-19 Pandemic. However, the training of end-to-end neural-based medical dialogue system is restricted by an insufficient quantity of medical dialogue corpus. In this work, we make the first attempt to build and release a large-scale high-quality Medical Dialogue dataset related to 12 types of common Gastrointestinal diseases named MedDG, with more than 17K conversations collected from the online health consultation community. Five different categories of entities, including diseases, symptoms, attributes, tests, and medicines, are annotated in each conversation of MedDG as additional labels. To push forward the future research on building expert-sensitive medical dialogue system, we proposes two kinds of medical dialogue tasks based on MedDG dataset. One is the next entity prediction and the other is the doctor response generation. To acquire a clear comprehension on these two medical dialogue tasks, we implement several state-of-the-art benchmarks, as well as design two dialogue models with a further consideration on the predicted entities. Experimental results show that the pre-train language models and other baselines struggle on both tasks with poor performance in our dataset, and the response quality can be enhanced with the help of auxiliary entity information. From human evaluation, the simple retrieval model outperforms several state-of-the-art generative models, indicating that there still remains a large room for improvement on generating medically meaningful responses.


title: Bayesian Spatio-Temporal Graph Convolutional Network for Traffic Forecasting

abstract: In traffic forecasting, graph convolutional networks (GCNs), which model traffic flows as spatio-temporal graphs, have achieved remarkable performance. However, existing GCN-based methods heuristically define the graph structure as the physical topology of the road network, ignoring potential dependence of the graph structure over traffic data. And the defined graph structure is deterministic, which lacks investigation of uncertainty. In this paper, we propose a Bayesian Spatio-Temporal Graph Convolutional Network (BSTGCN) for traffic prediction. The graph structure in our network is learned from the physical topology of the road network and traffic data in an end-to-end manner, which discovers a more accurate description of the relationship among traffic flows. Moreover, a parametric generative model is proposed to represent the graph structure, which enhances the generalization capability of GCNs. We verify the effectiveness of our method on two real-world datasets, and the experimental results demonstrate that BSTGCN attains superior performance compared with state-of-the-art methods.


title: Sigma-invariants and tropical varieties

abstract: The Bieri-Neumann-Strebel-Renz invariants $\Sigma^q(X,\mathbb{Z})\subset H^1(X,\mathbb{R})$ of a connected, finite-type CW-complex $X$ are the vanishing loci for Novikov-Sikorav homology in degrees up to $q$, while the characteristic varieties $\mathcal{V}^q(X) \subset H^1(X,\mathbb{C}^{\times})$ are the nonvanishing loci for homology with coefficients in rank 1 local systems in degree $q$. We show that each BNSR invariant $\Sigma^q(X,\mathbb{Z})$ is contained in the complement of the tropical variety associated to the algebraic variety $\mathcal{V}^{\le q}(X)$, and provide applications to several classes of groups and spaces.


title: Corrigendum and Addendum to "Computation of domains of analyticity for the dissipative standard map in the limit of small dissipation" [arXiv:1712.05476]

abstract: We correct some tables and figures in [A.P. Bustamante and R.C. Calleja, Physica D: Nonlinear Phenomena, 395 (2019), pp. 15-23, arXiv:1712.05476]. We also report on the new computations that verify the accuracy of the data and extend the results. The new computations have led us to find new patterns in the data that were not noticed before. We formulate some more precise conjectures.


title: Moderate deviations for empirical measures for nonhomogeneous Markov chains

abstract: We prove that moderate deviations for empirical measures for countable nonhomogeneous Markov chains hold under the assumption of uniform convergence of transition probability matrices for countable nonhomogeneous Markov chains in Ces\`aro sense.


title: Extrinsic curvature and conformal Gauss-Bonnet for four-manifolds with corner

abstract: This paper defines two new extrinsic curvature quantities on the corner of a four-dimensional Riemannian manifold with corner. One of these is a pointwise conformal invariant, and the conformal transformation of the other is governed by a new linear second-order pointwise conformally invariant partial differential operator. The Gauss-Bonnet theorem is then stated in terms of these quantities.


title: Multi-Task Learning for Cross-Lingual Abstractive Summarization

abstract: We present a multi-task learning framework for cross-lingual abstractive summarization to augment training data. Recent studies constructed pseudo cross-lingual abstractive summarization data to train their neural encoder-decoders. Meanwhile, we introduce existing genuine data such as translation pairs and monolingual abstractive summarization data into training. Our proposed method, Transum, attaches a special token to the beginning of the input sentence to indicate the target task. The special token enables us to incorporate the genuine data into the training data easily. The experimental results show that Transum achieves better performance than the model trained with only pseudo cross-lingual summarization data. In addition, we achieve the top ROUGE score on Chinese-English and Arabic-English abstractive summarization. Moreover, Transum also has a positive effect on machine translation. Experimental results indicate that Transum improves the performance from the strong baseline, Transformer, in Chinese-English, Arabic-English, and English-Japanese translation datasets.


title: Designing Emergency Response Pipelines : Lessons and Challenges

abstract: Emergency response to incidents such as accidents, crimes, and fires is a major problem faced by communities. Emergency response management comprises of several stages and sub-problems like forecasting, resource allocation, and dispatch. The design of principled approaches to tackle each problem is necessary to create efficient emergency response management (ERM) pipelines. Over the last six years, we have worked with several first responder organizations to design ERM pipelines. In this paper, we highlight some of the challenges that we have identified and lessons that we have learned through our experience in this domain. Such challenges are particularly relevant for practitioners and researchers, and are important considerations even in the design of response strategies to mitigate disasters like floods and earthquakes.


abstract: We calculate the Gerstenhaber bracket on Hopf algebra and Hochschild cohomologies of the Taft algebra $T_p$ for any integer $p>2$ which is a nonquasi-triangular Hopf algebra. We show that the bracket is indeed zero on Hopf algebra cohomology of $T_p$, as in all known quasi-triangular Hopf algebras. This example is the first known bracket computation for a nonquasi-triangular algebra. Also, we find a general formula for the bracket on Hopf algebra cohomology of any Hopf algebra with bijective antipode on the bar resolution that is reminiscent of Gerstenhaber's original formula for Hochschild cohomology.


title: EIC (Expert Information Criterion) not AIC: the cautious biologist's guide to model selection

abstract: 1.A goal of many research programs in biology is to extract meaningful insights from large, complex data sets. Researchers in Ecology, Evolution and Behavior (EEB) often grapple with long-term, observational data sets from which they construct models to address fundamental questions about biology. Similarly, epidemiologists analyze large, complex observational data sets to understand the distribution and determinants of human health and disease. A key difference in the analytical workflows for these two distinct areas of biology is delineation of data analysis tasks and explicit use of causal inference methods, widely adopted by epidemiologists. 2.Here, we review the most recent causal inference literature and describe an analytical workflow that has direct applications for EEB researchers. 3.The first half of this commentary defines four distinct analytical tasks (description, prediction, association, and causal inference), and the corresponding approaches to data analysis and model selection. The latter half is dedicated to walking the reader through the steps of casual inference, focusing on examples from EEB. 4.Given increasing interest in causal inference and common misperceptions regarding the task of causal inference, we aim to facilitate an exchange of ideas between disciplinary silos and provide a framework for analyses of all data, though particularly relevant for observational data.


title: Bott-Samelson-Demazure-Hansen Varieties for Projective Homogeneous Varieties with Nonreduced Stabilizers

abstract: Over a field of positive characteristic, a semisimple algebraic group $G$ may have some nonreduced parabolic subgroup $P$. In this paper, we study the Schubert and Bott-Samelson-Demazure-Hansen (BSDH) varieties of $G/P$, with $P$ nonreduced, when the base field is perfect. It is shown that in general the Schubert and BSDH varieties of such a $G/P$ are not normal, and the projection of the BSDH variety onto the Schubert variety has nonreduced fibers at closed points. When the base field is finite, the generalized convolution morphisms between BSDH varieties are also studied. It is shown that the decomposition theorem holds for such morphisms, and the pushforward of intersection complexes by such morphisms are Frobenius semisimple.


title: Towards sharp error analysis of extended Lagrangian molecular dynamics

abstract: The extended Lagrangian molecular dynamics (XLMD) method provides a useful framework for reducing the computational cost of a class of molecular dynamics simulations with constrained latent variables. The XLMD method relaxes the constraints by introducing a fictitious mass $\varepsilon$ for the latent variables, solving a set of singularly perturbed ordinary differential equations. While favorable numerical performance of XLMD has been demonstrated in several different contexts in the past decade, mathematical analysis of the method remains scarce. We propose the first error analysis of the XLMD method in the context of a classical polarizable force field model. While the dynamics with respect to the atomic degrees of freedom are general and nonlinear, the key mathematical simplification of the polarizable force field model is that the constraints on the latent variables are given by a linear system of equations. We prove that when the initial value of the latent variables is compatible in a sense that we define, XLMD converges as the fictitious mass $\varepsilon$ is made small with $\mathcal{O}(\varepsilon)$ error for the atomic degrees of freedom and with $\mathcal{O}(\sqrt{\varepsilon})$ error for the latent variables, when the dimension of the latent variable $d'$ is 1. Furthermore, when the initial value of the latent variables is improved to be optimally compatible in a certain sense, we prove that the convergence rate can be improved to $\mathcal{O}(\varepsilon)$ for the latent variables as well. Numerical results verify that both estimates are sharp not only for $d' =1$, but also for arbitrary $d'$. In the setting of general $d'$, we do obtain convergence, but with the non-sharp rate of $\mathcal{O}(\sqrt{\varepsilon})$ for both the atomic and latent variables.


title: Analysis of Heterogeneity of Pneumothorax-associated Deformation using Model-based Registration

abstract: Recent advances in imaging techniques have enabled us to visualize lung tumors or nodules in early-stage cancer. However, the positions of nodules can change because of intraoperative lung deflation, and the modeling of pneumothorax-associated deformation remains a challenging issue for intraoperative tumor localization. In this study, we introduce spatial and geometric analysis methods for inflated/deflated lungs and discuss heterogeneity in pneumothorax-associated deformation. Contrast-enhanced CT images simulating intraoperative conditions were acquired from live Beagle dogs. Deformable mesh registration techniques were designed to map the surface and subsurface tissues of lung lobes. The developed framework addressed local mismatches of bronchial tree structures and achieved stable registration with a Hausdorff distance of less than 1 mm and a target registration error of less than 5 mm. Our results show that the strain of lung parenchyma was 35% higher than that of bronchi, and that subsurface deformation in the deflated lung is heterogeneous.


title: A Human Eye-based Text Color Scheme Generation Method for Image Synthesis

abstract: Synthetic data used for scene text detection and recognition tasks have proven effective. However, there are still two problems: First, the color schemes used for text coloring in the existing methods are relatively fixed color key-value pairs learned from real datasets. The dirty data in real datasets may cause the problem that the colors of text and background are too similar to be distinguished from each other. Second, the generated texts are uniformly limited to the same depth of a picture, while there are special cases in the real world that text may appear across depths. To address these problems, in this paper we design a novel method to generate color schemes, which are consistent with the characteristics of human eyes to observe things. The advantages of our method are as follows: (1) overcomes the color confusion problem between text and background caused by dirty data; (2) the texts generated are allowed to appear in most locations of any image, even across depths; (3) avoids analyzing the depth of background, such that the performance of our method exceeds the state-of-the-art methods; (4) the speed of generating images is fast, nearly one picture generated per three milliseconds. The effectiveness of our method is verified on several public datasets.


title: Deformations of lattice cohomology and the upsilon invariant

abstract: We introduce deformations of lattice cohomology corresponding to the knot homologies found by Ozsv\' ath, Stipsicz and Szab\' o in \cite{OSS4}. By means of holomorphic triangles counting, we prove equivalence with the analytic theory for a wide class of knots. This yields combinatorial formulae for the upsilon invariant.


title: Broad-line region configuration of the supermassive binary black hole candidate PG1302-102 in the relativistic Doppler boosting scenario

abstract: PG1302-102 is thought to be a supermassive binary black hole (BBH) system according to the periodical variations of its optical and UV photometry, which may be interpreted as being due to the relativistic Doppler boosting of the emission mainly from the disk around the secondary black hole (BH) modulated by its orbital motion. In this paper, we investigate several broad emission lines of PG1302-102 using archived UV spectra obtained by IUE, GALEX, and Hubble, to reveal the broad-line region (BLR) emission properties of this BBH system under the Doppler boosting scenario. We find that the broad lines Ly$\alpha$, NV, CIV, and CIII] all show Gaussian profiles, and none of these lines exhibits obvious periodical variation. Adopting a simple model for the BLR, we perform Markov chain Monte Carlo fittings to these broad lines, and find that the BLR must be viewed at an orientation angle of $\sim33^{\circ}$, close to face-on. If the Doppler boosting interpretation is correct, then the BLR is misaligned with the BBH orbital plane by an angle of $\sim51^\circ$, which suggests that the Doppler boosted continuum variation has little effect on the broad-line emission and thus does not lead to periodical line variation. We further discuss the possible implications for such a BLR configuration with respect to the BBH orbital plane.


title: Optimal Dispatch in Emergency Service System via Reinforcement Learning

abstract: In the United States, medical responses by fire departments over the last four decades increased by 367%. This had made it critical to decision makers in emergency response departments that existing resources are efficiently used. In this paper, we model the ambulance dispatch problem as an average-cost Markov decision process and present a policy iteration approach to find an optimal dispatch policy. We then propose an alternative formulation using post-decision states that is shown to be mathematically equivalent to the original model, but with a much smaller state space. We present a temporal difference learning approach to the dispatch problem based on the post-decision states. In our numerical experiments, we show that our obtained temporal-difference policy outperforms the benchmark myopic policy. Our findings suggest that emergency response departments can improve their performance with minimal to no cost.