title: The Diversity of Exoplanets: From Interior Dynamics to Surface Expressions

abstract: The coupled interior-atmosphere system of terrestrial exoplanets remains poorly understood. Exoplanets show a wide variety of sizes, densities, surface temperatures, and interior structures, with important knock-on effects for this coupled system. Many exoplanets are predicted to have a "stagnant lid" at the surface, with a rigid stationary crust, sluggish mantle convection, and only minor volcanism. However, if exoplanets have Earth-like plate tectonics, which involves several discrete, slowly moving plates and vigorous tectono-magmatic activity, then this may be critical for planetary habitability and have implications for the development (and evolution) of life in the galaxy. Here, we summarize our current knowledge of coupled planetary dynamics in the context of exoplanet diversity.


title: Leveraging Models to Constrain the Climates of Rocky Exoplanets

abstract: In recent years, numerical models that were developed for Earth have been adapted to study exoplanetary climates to understand how the broad range of possible exoplanetary properties affects their climate state. The recent discovery and upcoming characterization of nearby rocky exoplanets opens an avenue toward understanding the processes that shape planetary climates and lead to the persistent habitability of Earth. In this review, we summarize recent advances in understanding the climate of rocky exoplanets, including their atmospheric structure, chemistry, evolution, and atmospheric and oceanic circulation. We describe current and upcoming astronomical observations that will constrain the climate of rocky exoplanets and describe how modeling tools will both inform and interpret future observations.


title: The air over there: exploring exoplanet atmospheres

abstract: Atmospheric compositions for rocky exoplanets will depend strongly on the bulk planetary composition and the orbital position of the planet. Non-traditional gases may be present in the atmospheres of exceptionally hot planets. Atmospheres of more clement planets will depend on the abundances of volatiles acquired during planet formation and atmospheric removal processes, including escape, condensation, and reaction with the surface. While the observations of exoplanet atmospheres to date has focused on giant planets, a series of new space and ground-based observatories over the coming decade will revolutionize the precision and spectral resolution with which we are able to probe exoplanet atmospheres. This article consolidates lessons learned from the study of giant planet atmospheres, and points to the observations and challenges on the horizon for terrestrial planets.


title: Starting Life and Searching for Life on Rocky Planets

abstract: The study of origins of life on Earth and the search for life on other planets are closely linked. Prebiotic chemical scenarios can help prioritize planets as targets for the search for life as we know it and can provide informative priors to help us assess the likelihood that particular spectroscopic features are evidence of life. The prerequisites for origins scenarios themselves predict spectral signatures. The interplay between origins research and the search for extraterrestrial life must start with lab work guiding exploratory ventures in the solar system, and the discoveries in the solar system informing future exoplanet observations and laboratory research. Subsequent exoplanet research will in turn provide statistical context to conclusions about the nature and origins of life.


title: Confirmation of Iron Emission Lines and Non-detection of TiO on the Dayside of KELT-9b with MAROON-X

abstract: We present dayside thermal emission observations of the hottest exoplanet KELT-9b using the new MAROON-X spectrograph. We detect atomic lines in emission with a signal-to-noise ratio of 10 using cross-correlation with binary masks. The detection of emission lines confirms the presence of a thermal inversion in KELT-9b's atmosphere. We also use M-dwarf stellar masks to search for TiO, which has recently been invoked to explain the unusual \textit{HST}/WFC3 spectrum of the planet. We find that the KELT-9b atmosphere is inconsistent with the M-dwarf masks. Furthermore, we use an atmospheric retrieval approach to place an upper limit on the TiO volume mixing ratio of 10$^{-8.5}$ (at 99\% confidence). This upper limit is inconsistent with the models used to match the WFC3 data, which require at least an order of magnitude more TiO, thus suggesting the need for an alternate explanation of the space-based data. Our retrieval results also strongly prefer an inverted temperature profile and atomic/ion abundances largely consistent with the expectations for a solar composition gas in thermochemcial equilibrium. The exception is the retrieved abundance of Fe$^+$, which is about 1-2 orders of magnitude greater than predictions. These results highlight the growing power of high-resolution spectrographs on large ground-based telescopes to characterize exoplanet atmospheres when used in combination with new retrieval techniques.


title: Characterizing exoplanetary atmospheres at high resolution with SPIRou: Detection of water on HD 189733 b

abstract: We present the first exoplanet atmosphere detection made as part of the SPIRou Legacy Survey, a Large Observing Program of 300 nights exploiting the capabilities of SPIRou, the new near-infrared high-resolution (R ~ 70 000) spectro-polarimeter installed on the Canada-France-Hawaii Telescope (CFHT; 3.6-m). We observed two transits of HD 189733, an extensively studied hot Jupiter that is known to show prominent water vapor absorption in its transmission spectrum. When combining the two transits, we successfully detect the planet's water vapor absorption at 5.9 sigma using a cross-correlation t-test, or with a Delta BIC >10 using a log-likelihood calculation. Using a Bayesian retrieval framework assuming a parametrized T-P profile atmosphere models, we constrain the planet atmosphere parameters, in the region probed by our transmission spectrum, to the following values: VMR[H2O] = -4.4^{+0.4}_{-0.4}, and P_cloud >~ 0.2 bar (grey clouds), both of which are consistent with previous studies of this planet. Our retrieved water volume mixing ratio is slightly sub-solar although, combining it with the previously retrieved super-solar CO abundances from other studies would imply super-solar C/O ratio. We furthermore measure a net blue shift of the planet signal of -4.62^{+0.46}_{-0.44} km s-1, which is somewhat larger than many previous measurements and unlikely to result solely from winds in the planet's atmosphere, although it could possibly be explained by a transit signal dominated by the trailing limb of the planet. This large blue shift is observed in all the different detection/retrieval methods that were performed and in each of the two transits independently.


title: Quantum cohomology as a deformation of symplectic cohomology

abstract: We prove that under certain conditions, the quantum cohomology of a positively monotone compact symplectic manifold is a deformation of the symplectic cohomology of the complement of a simple crossings symplectic divisor. We also prove rigidity results for the skeleton of the divisor complement.


title: Nonsmooth Mechanics Based on Linear Projection Operator

abstract: This paper presents a unifying dynamics formulation for nonsmooth multibody systems (MBSs) subject to changing topology and multiple impacts based on linear projection operator. An oblique projection matrix ubiquitously derives all characteristic variables of such systems as follow: i) The constrained acceleration before jump discontinuity from projection of unconstrained acceleration, ii) post-impact velocity from projection of pre-impact velocity, iii) impulse during impact from projection of pre-impact momentum, iv) generalized constraint force from projection of generalized input force, and v) post-impact kinetic energy from pre-impact kinetic energy based on projected inertia matrix. All solutions are presented in closed-form with elegant geometrical interpretations. The formulation is general enough to be applicable to MBSs subject to simultaneous multiple impacts with non-identical restitution coefficients, changing topology, i.e., unilateral constraints becomes inactive or vice versa, or even when the overall constraint Jacobian becomes singular. Not only do the solutions always exist regardless the constraint condition, but also the condition number for a generalized constraint inertia matrix is minimized in order to reduce numerical sensitivity in computation of the projection matrix to roundoff errors. The model is proven to be energetically consistent if a global restitution coefficient is assumed. In the case of non-identical restitution coefficients, the set of energetically consistent restitution matrices is characterized by using Linear Matrix Inequality (LMI).


title: Low levels of sulphur dioxide contamination of Venusian phosphine spectra

abstract: New analysis is presented of the 1.1 mm wavelength absorption lines in Venus' atmosphere that suggested the presence of phosphine. We retrieve a sulphur dioxide observation from the JCMT archive that was simultaneous within a few days of the PH3 1-0 spectrum obtained in June 2017, and demonstrate via a radiative transfer calculation that contamination of PH3 by SO2 was ~10 per cent. We also present ALMA 2019 spectra of PH3 1-0 and an SO2 transition acquired simultaneously, and infer that SO2 line-contamination was ~2 percent (for the least-noisy half of the planetary disc). The contamination-subtracted ALMA and JCMT spectra (of 6-8 sigma confidence) are now consistent with similar absorption-depths at the two epochs. The two values span -1.9(+/-0.2) 10-4 of the continuum signal (which was re-estimated for ALMA), albeit for differing planetary areas. This suggests that the abundance attributed to phosphine in Venus' atmosphere was broadly similar in 2017 and 2019.


title: Learning to Detect: A Data-driven Approach for Network Intrusion Detection

abstract: With massive data being generated daily and the ever-increasing interconnectivity of the world's Internet infrastructures, a machine learning based intrusion detection system (IDS) has become a vital component to protect our economic and national security. In this paper, we perform a comprehensive study on NSL-KDD, a network traffic dataset, by visualizing patterns and employing different learning-based models to detect cyber attacks. Unlike previous shallow learning and deep learning models that use the single learning model approach for intrusion detection, we adopt a hierarchy strategy, in which the intrusion and normal behavior are classified firstly, and then the specific types of attacks are classified. We demonstrate the advantage of the unsupervised representation learning model in binary intrusion detection tasks. Besides, we alleviate the data imbalance problem with SVM-SMOTE oversampling technique in 4-class classification and further demonstrate the effectiveness and the drawback of the oversampling mechanism with a deep neural network as a base model.


title: What Distributed Systems Say: A Study of Seven Spark Application Logs

abstract: Execution logs are a crucial medium as they record runtime information of software systems. Although extensive logs are helpful to provide valuable details to identify the root cause in postmortem analysis in case of a failure, this may also incur performance overhead and storage cost. Therefore, in this research, we present the result of our experimental study on seven Spark benchmarks to illustrate the impact of different logging verbosity levels on the execution time and storage cost of distributed software systems. We also evaluate the log effectiveness and the information gain values, and study the changes in performance and the generated logs for each benchmark with various types of distributed system failures. Our research draws insightful findings for developers and practitioners on how to set up and utilize their distributed systems to benefit from the execution logs.


title: Gaussian, stable, tempered stable and mixed limit laws for random walks in cooling random environments

abstract: Random Walks in Cooling Random Environments (RWCRE) is a model of random walks in dynamic random environments where the entire environment is resampled along a fixed sequence of times, called the "cooling sequence," and is kept fixed in between those times. This model interpolates between that of a homogenous random walk, where the environment is reset at every step, and Random Walks in (static) Random Environments (RWRE), where the environment is never resampled. In this work we focus on the limiting distributions of one-dimensional RWCRE in the regime where the fluctuations of the corresponding (static) RWRE is given by a $s$-stable random variable with $s\in(1,2)$. In this regime, due to the two extreme cases (resampling every step and never resampling, respectively), a crossover from Gaussian to stable limits for sufficiently regular cooling sequence was previously conjectured. Our first result answers affirmatively this conjecture by making clear critical exponent, norming sequences and limiting laws associated with the crossover which demonstrates a change from Gaussian to $s$-stable limits, passing at criticality through a certain generalized tempered stable distribution. We then explore the resulting RWCRE scaling limits for general cooling sequences. On the one hand, we offer sets of operative sufficient conditions that guarantee asymptotic emergence of either Gaussian, $s$-stable or generalized tempered distributions from a certain class. On the other hand, we give explicit examples and describe how to construct irregular cooling sequences for which the corresponding limit law is characterized by mixtures of the three above mentioned laws. To obtain these results, we need and derive a number of refined asymptotic results for the static RWRE with $s\in(1,2)$ which may be of independent interest.


title: Superradiance in dynamically modulated Tavis-Cumming model with spectral disorder

abstract: Superradiance is the enhanced emission of photons from quantum emitters collectively coupling to the same optical mode. However, disorder in the resonant frequencies of the quantum emitters can perturb this effect. In this paper, we study the interplay between superradiance and spectral disorder in a dynamically modulated Tavis-Cummings model. Through numerical simulations and analytical calculations, we show that the effective cooperativity of the superradiant mode, which is always formed over an extensive number of emitters, can be multiplicatively enhanced with a quantum control protocol modulating the resonant frequency of the optical mode. Our results are relevant to experimental demonstration of superradiant effects in solid-state quantum optical systems, wherein the spectral disorder is a significant technological impediment towards achieving photon-mediated emitter-emitter couplings.


title: A good body is all you need: avoiding catastrophic interference via agent architecture search

abstract: In robotics, catastrophic interference continues to restrain policy training across environments. Efforts to combat catastrophic interference to date focus on novel neural architectures or training methods, with a recent emphasis on policies with good initial settings that facilitate training in new environments. However, none of these methods to date have taken into account how the physical architecture of the robot can obstruct or facilitate catastrophic interference, just as the choice of neural architecture can. In previous work we have shown how aspects of a robot's physical structure (specifically, sensor placement) can facilitate policy learning by increasing the fraction of optimal policies for a given physical structure. Here we show for the first time that this proxy measure of catastrophic interference correlates with sample efficiency across several search methods, proving that favorable loss landscapes can be induced by the correct choice of physical structure. We show that such structures can be found via co-optimization -- optimization of a robot's structure and control policy simultaneously -- yielding catastrophic interference resistant robot structures and policies, and that this is more efficient than control policy optimization alone. Finally, we show that such structures exhibit sensor homeostasis across environments and introduce this as the mechanism by which certain robots overcome catastrophic interference.


title: Big Data in Astroinformatics -- Compression of Scanned Astronomical Photographic Plates

abstract: Construction of Scanned Astronomical Photographic Plates(SAPPs) databases and SVD image compression algorithm are considered. Some examples of compression with different plates are shown.


title: Factors correlating to enhanced surface diffusion in metallic glasses

abstract: The enhancement of surface diffusion (DS) over the bulk (DV) in metallic glasses (MGs) is well documented and likely to strongly influence the properties of glasses grown by vapor deposition. Here, we use classical molecular dynamics simulations to identify different factors influencing the enhancement of surface diffusion in MGs. MGs have a simple atomic structure and belong to the category of moderately fragile glasses that undergo pronounced slowdown of bulk dynamics with cooling close to the glass transition temperature (Tg). We observe that DS exhibits a much more moderate slowdown compared to DV when approaching Tg, and DS/DV at Tg varies by two orders of magnitude among the MGs investigated. We demonstrate that both the surface energy and the fraction of missing bonds for surface atoms show good correlation to DS/DV, implying that the loss of nearest neighbors at the surface directly translates into higher mobility, unlike the behavior of network- and hydrogen-bonded organic glasses. Fragility, a measure of the slowdown of bulk dynamics close to Tg, also correlates to DS/DV, with more fragile systems having larger surface enhancement of mobility. The deviations observed in the fragility and DS over DV relationship are shown to be correlated to the extent of segregation or depletion of the mobile element at the surface. Finally, we explore the relationship between the diffusion pre-exponential factor (D0) and activation energy (Q) and compare to a ln(D0)-Q correlation previously established for bulk glasses, demonstrating similar correlations from MD as in the experiments and that the surface and bulk have very similar ln(D0)-Q correlations.


title: GP-S3Net: Graph-based Panoptic Sparse Semantic Segmentation Network

abstract: Panoptic segmentation as an integrated task of both static environmental understanding and dynamic object identification, has recently begun to receive broad research interest. In this paper, we propose a new computationally efficient LiDAR based panoptic segmentation framework, called GP-S3Net. GP-S3Net is a proposal-free approach in which no object proposals are needed to identify the objects in contrast to conventional two-stage panoptic systems, where a detection network is incorporated for capturing instance information. Our new design consists of a novel instance-level network to process the semantic results by constructing a graph convolutional network to identify objects (foreground), which later on are fused with the background classes. Through the fine-grained clusters of the foreground objects from the semantic segmentation backbone, over-segmentation priors are generated and subsequently processed by 3D sparse convolution to embed each cluster. Each cluster is treated as a node in the graph and its corresponding embedding is used as its node feature. Then a GCNN predicts whether edges exist between each cluster pair. We utilize the instance label to generate ground truth edge labels for each constructed graph in order to supervise the learning. Extensive experiments demonstrate that GP-S3Net outperforms the current state-of-the-art approaches, by a significant margin across available datasets such as, nuScenes and SemanticPOSS, ranking first on the competitive public SemanticKITTI leaderboard upon publication.


title: A Green's function proof of the Positive Mass Theorem

abstract: In this paper, a new proof of the Positive Mass Theorem is established through a newly discovered monotonicity formula, holding along the level sets of the Green's function of an asymptotically flat $3$-manifold. In the same context and for $1<p<3$, a Geroch-type calculation is performed along the level sets of $p$-harmonic functions, leading to a new proof of the Riemannian Penrose Inequality under favourable assumptions. A new characterisation of scalar curvature lower bounds in terms of the monotonicity formulas is also given.


title: 3D Reconstruction of Bias Effects on Porosity, Alignment and Mesoscale Structure in Electrospun Tubular Polycaprolactone

abstract: Porosity variations in tubular scaffolds are critical to reproducible, sophisticated applications of electrospun fibers in biomedicine. Established laser micrometry techniques produced ~14,000 datapoints enabling thickness and porosity plots versus both the azimuthal (Phi) and axial (Z) directions following cylindrical mandrel deposition. These 3D datasets could then be "unrolled" into "maps" revealing variations in thickness and porosity versus 0, -5, and -15 kV collector bias. As bias increases, thinner, more "focused" depositions occur. Simultaneous decreases in net porosity versus bias (91.1% 0kV > 83.4% -5kV > 80.2% -15 kV) are sensible, but significant changes in the distribution were unexpected. Surprisingly, at 0 kV, extensive mesoscale surface roughness is evident. Optical profilometry revealed unique features ~1600-420 mum in size, standing ~210 mum above the surrounding surface. These shrink to only ~440-150 mum in size and ~30 mum higher at -5 kV bias and disappear entirely at -15 kV. Scanning electron microscopy (SEM) resolved these into novel, localized "domains" containing tightly aligned fibers oriented parallel to the mandrel axis. Unexpectedly, we also observed substantial orientation along the mandrel axis. By modifying classical bending instability models to incorporate cylindrical electric fields, simulation revealed that horizontal components in the modified electric field alter bending loop shape, causing the observed alignment. This provides a new, easily utilized tool enabling facile, efficient tuning of orientation.


title: Federated Variational Learning for Anomaly Detection in Multivariate Time Series

abstract: Anomaly detection has been a challenging task given high-dimensional multivariate time series data generated by networked sensors and actuators in Cyber-Physical Systems (CPS). Besides the highly nonlinear, complex, and dynamic natures of such time series, the lack of labeled data impedes data exploitation in a supervised manner and thus prevents an accurate detection of abnormal phenomenons. On the other hand, the collected data at the edge of the network is often privacy sensitive and large in quantity, which may hinder the centralized training at the main server. To tackle these issues, we propose an unsupervised time series anomaly detection framework in a federated fashion to continuously monitor the behaviors of interconnected devices within a network and alerts for abnormal incidents so that countermeasures can be taken before undesired consequences occur. To be specific, we leave the training data distributed at the edge to learn a shared Variational Autoencoder (VAE) based on Convolutional Gated Recurrent Unit (ConvGRU) model, which jointly captures feature and temporal dependencies in the multivariate time series data for representation learning and downstream anomaly detection tasks. Experiments on three real-world networked sensor datasets illustrate the advantage of our approach over other state-of-the-art models. We also conduct extensive experiments to demonstrate the effectiveness of our detection framework under non-federated and federated settings in terms of overall performance and detection latency.


title: Integrating Dialog History into End-to-End Spoken Language Understanding Systems

abstract: End-to-end spoken language understanding (SLU) systems that process human-human or human-computer interactions are often context independent and process each turn of a conversation independently. Spoken conversations on the other hand, are very much context dependent, and dialog history contains useful information that can improve the processing of each conversational turn. In this paper, we investigate the importance of dialog history and how it can be effectively integrated into end-to-end SLU systems. While processing a spoken utterance, our proposed RNN transducer (RNN-T) based SLU model has access to its dialog history in the form of decoded transcripts and SLU labels of previous turns. We encode the dialog history as BERT embeddings, and use them as an additional input to the SLU model along with the speech features for the current utterance. We evaluate our approach on a recently released spoken dialog data set, the HarperValleyBank corpus. We observe significant improvements: 8% for dialog action and 30% for caller intent recognition tasks, in comparison to a competitive context independent end-to-end baseline system.


title: Estimating distinguishability measures on quantum computers

abstract: The performance of a quantum information processing protocol is ultimately judged by distinguishability measures that quantify how distinguishable the actual result of the protocol is from the ideal case. The most prominent distinguishability measures are those based on the fidelity and trace distance, due to their physical interpretations. In this paper, we propose and review several algorithms for estimating distinguishability measures based on trace distance and fidelity. The algorithms can be used for distinguishing quantum states, channels, and strategies (the last also known in the literature as "quantum combs"). The fidelity-based algorithms offer novel physical interpretations of these distinguishability measures in terms of the maximum probability with which a single prover (or competing provers) can convince a verifier to accept the outcome of an associated computation. We simulate many of these algorithms by using a variational approach with parameterized quantum circuits. We find that the simulations converge well in both the noiseless and noisy scenarios, for all examples considered. Furthermore, the noisy simulations exhibit a parameter noise resilience. Finally, we establish a strong relationship between various quantum computational complexity classes and distance estimation problems.


title: Show or Tell? Visual and Verbal Representations Bias Position Recall

abstract: When we view visualizations, we not only have a visual representation of the data, but also a verbal one. Recent work has shown that these visual representations of data can be biased, such that the position of a line in a chart will be consistently underestimated. But are the verbal representations of position encodings also biased in the same manner, or is this a purely visual bias that can be mitigated with verbal context? We explored the bias in position reproductions for simple uniform lines for both visual and verbal representations. We find that the direction of the bias changed depending on the response modality, with visual reproductions showing a position underestimation while verbal responses showed overestimation. This finding indicates that, even for simple line charts, biases are still present for both visual and verbal representations, although the directionality of this bias depends on the modality.


title: Correlated Oxide Dirac Semimetal in the Extreme Quantum Limit

abstract: Quantum materials (QMs) with strong correlation and non-trivial topology are indispensable to next-generation information and computing technologies. Exploitation of topological band structure is an ideal starting point to realize correlated topological QMs. Herein, we report that strain-induced symmetry modification in correlated oxide SrNbO3 thin films creates an emerging topological band structure. Dirac electrons in strained SrNbO3 films reveal ultra-high mobility (100,000 cm2/Vs), exceptionally small effective mass (0.04me), and non-zero Berry phase. More importantly, strained SrNbO3 films reach the extreme quantum limit, exhibiting a sign of fractional occupation of Landau levels and giant mass enhancement. Our results suggest that symmetry-modified SrNbO3 is a rare example of a correlated topological QM, in which strong correlation of Dirac electrons leads to the realization of fractional occupation of Landau levels.


title: Thermal Transport in Graphene Composites: The Effect of Lateral Dimensions of Graphene Fillers

abstract: We report on the investigation of thermal transport in non-cured silicone composites with graphene fillers of different lateral dimensions. Graphene fillers are comprised of few-layer graphene flakes with lateral sizes in the range from 400 nm to 1200 nm and number of atomic planes from one to ~100. The distribution of the lateral dimensions and thicknesses of graphene fillers has been determined via atomic force microscopy statistics. It was found that in the examined range of the lateral dimensions the thermal conductivity of the composites increases with the increasing size of the graphene fillers. The observed difference in thermal properties can be related to the average gray phonon mean free path in graphene, which has been estimated to be around ~800 nm at room temperature. The thermal contact resistance of composites with graphene fillers of 1200-nm lateral dimensions was also smaller than that of composites with graphene fillers of 400-nm lateral dimensions. The effects of the filler loading fraction and the filler size on the thermal conductivity of the composites were rationalized within the Kanari model. The obtained results are important for optimization of graphene fillers for applications in thermal interface materials for heat removal from high-power-density electronics.


title: The pigenhole principle and multicolor Ramsey numbers

abstract: For integers $k,r\geq 2$, the diagonal Ramsey number $R_r(k)$ is the minimum $N\in\mathbb{N}$ such that every $r$-coloring of the edges of a complete graph on $N$ vertices yields on a monochromatic subgraph on $k$ vertices. Here we make a careful effort of extracting explicit upper bounds for $R_r(k)$ from the pigeonhole principle alone. Our main term improves on previously documented explicit bounds for $r\geq 3$, and we also consider an often ignored secondary term, which allows us to subtract a uniformly bounded below positive proportion of the main term. Asymptotically, we give a self-contained proof that $R_r(k)\leq \left(\frac{3+e}{2}\right)\frac{(r(k-2))!}{((k-2)!)^r}(1+o_{r\to \infty}(1)),$ and we conclude by noting that our methods combine with previous estimates on $R_r(3)$ to improve the constant $\frac{3+e}{2}$ to $\frac{3+e}{2}-\frac{d}{48}$, where $d=66-R_4(3)\geq 4$. We also compare our formulas, and previously documented formulas, to some collected numerical data.


title: FeelsGoodMan: Inferring Semantics of Twitch Neologisms

abstract: Twitch chats pose a unique problem in natural language understanding due to a large presence of neologisms, specifically emotes. There are a total of 8.06 million emotes, over 400k of which were used in the week studied. There is virtually no information on the meaning or sentiment of emotes, and with a constant influx of new emotes and drift in their frequencies, it becomes impossible to maintain an updated manually-labeled dataset. Our paper makes a two fold contribution. First we establish a new baseline for sentiment analysis on Twitch data, outperforming the previous supervised benchmark by 7.9% points. Secondly, we introduce a simple but powerful unsupervised framework based on word embeddings and k-NN to enrich existing models with out-of-vocabulary knowledge. This framework allows us to auto-generate a pseudo-dictionary of emotes and we show that we can nearly match the supervised benchmark above even when injecting such emote knowledge into sentiment classifiers trained on extraneous datasets such as movie reviews or Twitter.


title: Learning explicit predictive controllers: theory and applications

abstract: In this paper, we deal with data-driven predictive control of linear time-invariant (LTI) systems. Specifically, we show for the first time how explicit predictive laws can be learnt directly from data, without needing to identify the system to control. To this aim, we resort to the Willems' fundamental lemma and we derive the explicit formulas by suitably elaborating the constrained optimization problem under investigation. The resulting optimal controller turns out to be a piecewise affine system coinciding with the solution of the original model-based problem in case of noiseless data. Such an equivalence is proven to hold asymptotically also in presence of measurement noise, thus making the proposed method a computationally efficient (but model-free) alternative to the state of the art predictive controls. The above statements are further supported by numerical simulations on three benchmark examples.


title: Actads

abstract: In this paper, I introduce a new generalization of the concept of an operad, further generalizing the concept of an opetope introduced by Baez and Dolan, who used this for the definition of their version of non-strict $n$-categories. Opetopes arise from iterating a certain construction on operads called the $+$-construction, starting with monoids. The first step gives rise to plain operads, i.e. operads without symmetries. The permutation axiom in a symmetric operad, however, is an additional structure resulting from permutation of variables, independent of the structure of a monoid. Even though we can apply the $+$-construction to symmetric operads, there is the possibility of introducing a completely different kind of permutations on the higher levels by again permuting variables without regard to the structure on the previous levels. Defining and investigating these structures is the main purpose of this paper. The structures obtained in this way is what I call $n$-actads. In $n$-actads with $n>1$, the permutations on the different levels give rise to a certain special kind of $n$-fold category. I also explore the concept of iterated algebras over an $n$-actad (generalizing an algebra and module over an operad), and various types of iterated units. I give some examples of algebras over $2$-actads, and show how they can be used to construct certain new interesting homotopy types of operads. I also discuss a connection between actads and ordinal notation.


title: Boundary Modes from Periodic Magnetic and Pseudomagnetic Fields in Graphene

abstract: Single-layer graphenes subject to periodic lateral strains are artificial crystals that can support boundary spectra with an intrinsic polarity. These are analyzed by comparing the effects of periodic magnetic fields and strain-induced pseudomagnetic fields that respectively break and preserve time-reversal symmetry. In the former case, a Chern classification of the superlattice minibands with zero total magnetic flux enforces {\it single} counter-propagating modes traversing each bulk gap on opposite boundaries of a nanoribbon. For the pseudomagnetic field, pairs of counter-propagating modes migrate to the {\it same} boundary where they provide well-developed valley-helical transport channels on a single zigzag edge. We discuss possible schemes for implementing this situation and their experimental signatures.


title: Transfer learning of individualized treatment rules from experimental to real-world data

abstract: Individualized treatment effect lies at the heart of precision medicine. Interpretable individualized treatment rules (ITRs) are desirable for clinicians or policymakers due to their intuitive appeal and transparency. The gold-standard approach to estimating the ITRs is randomized experiments, where subjects are randomized to different treatment groups and the bias is minimized to the extent possible. However, experimental data are limited in external validity because of their selection restrictions and therefore are not representative of the target real-world population. Conventional learning methods of optimal interpretable ITRs for a target population based only on experimental data are biased. On the other hand, real-world data (RWD) are becoming popular and provide a representative sample of the population. To learn the generalizable optimal interpretable ITRs, we propose an integrative transfer learning method based on weighting schemes to calibrate the covariate distribution of the experiment to that of the RWD. We show that the proposed ITR estimator has a theoretical guarantee of the risk consistency. We evaluate the transfer learner based on the finite-sample performance through simulation and apply it to a real data application of a job training program.


title: Primordial black holes as a dark matter candidate in theories with supersymmetry and inflation

abstract: We show that supersymmetry and inflation, in a broad class of models, generically lead to formation of primordial black holes (PBHs) that can account for dark matter. Supersymmetry predicts a number of scalar fields that develop a coherent condensate along the flat directions of the potential at the end of inflation. The subsequent evolution of the condensate involves perturbative decay, as well as fragmentation into Q-balls, which can interact by some long-range forces mediated by the scalar fields. The attractive scalar long-range interactions between Q-balls facilitates the growth of Q-balls until their ultimate collapse to black holes. For a flat direction lifted by supersymmetry breaking at the scale $\Lambda\sim 100$ TeV, the black hole masses are of the order of $(M_{\rm Planck}^3/\Lambda^2)\sim 10^{22}$ g, in the allowed range for dark matter. Similar potentials with a lower scale $\Lambda$ (not necessarily associated with supersymmetry) can result in a population of primordial black holes with larger masses, which can explain some recently reported microlensing events.


title: Estimating the natural indirect effect and the mediation proportion via the product method

abstract: The natural indirect effect (NIE) and mediation proportion (MP) are two measures of primary interest in mediation analysis. The standard approach for estimating NIE and MP is through the product method, which involves a model for the outcome conditional on the mediator and exposure and another model describing the exposure-mediator relationship. The purpose of this article is to comprehensively develop and investigate the finite-sample performance of NIE and MP estimators via the product method. With four common data types, we propose closed-form interval estimators via the theory of estimating equations and multivariate delta method, and evaluate its empirical performance relative to the bootstrap approach. In addition, we have observed that the rare outcome assumption is frequently invoked to approximate the NIE and MP with a binary outcome, although this approximation may lead to non-negligible bias when the outcome is common. We therefore introduce the exact expressions for NIE and MP with a binary outcome without the rare outcome assumption and compare its performance with the approximate estimators. Based upon these theoretical developments and empirical studies, we offer several practical recommendations to inform practice. An R package mediateP is developed to implement the methods for point and variance estimation discussed in this paper.


title: Optimised Multithreaded CV-QKD Reconciliation for Global Quantum Networks

abstract: Designing a practical Continuous Variable (CV) Quantum Key Distribution (QKD) system requires an estimation of the quantum channel characteristics and the extraction of secure key bits based on a large number of distributed quantum signals. Meeting this requirement in short timescales is difficult. On standard processors, it can take several hours to reconcile the required number of quantum signals. This problem is exacerbated in the context of Low Earth Orbit (LEO) satellite CV-QKD, in which the satellite flyover time is constrained to be less than a few minutes. A potential solution to this problem is massive parallelisation of the classical reconciliation process in which a large-code block is subdivided into many shorter blocks for individual decoding. However, the penalty of this procedure on the important final secured key rate is non-trivial to determine and hitherto has not been formally analysed. Ideally, a determination of the optimal reduced block size, maximising the final key rate, would be forthcoming in such an analysis. In this work, we fill this important knowledge gap via detailed analyses and experimental verification of a CV-QKD sliced reconciliation protocol that uses large block-length low-density parity-check decoders. Our new solution results in a significant increase in the final key rate relative to non-optimised reconciliation. In addition, it allows for the acquisition of quantum secured messages between terrestrial stations and LEO satellites within a flyover timescale even using off-the-shelf processors. Our work points the way to optimised global quantum networks secured via fundamental physics.


title: Volume bounds for the canonical lift complement of a random geodesic

abstract: Given a filling primitive geodesic curve in a closed hyperbolic surface one obtains a hyperbolic three-manifold as the complement of the curve's canonical lift to the projective tangent bundle. In this paper we give the first known lower bound for the volume of these manifolds in terms of the length of generic curves. We show that estimating the volume from below can be reduced to a counting problem in the unit tangent bundle and solve it by applying an exponential multiple mixing result for the geodesic flow.


title: D3D-HOI: Dynamic 3D Human-Object Interactions from Videos

abstract: We introduce D3D-HOI: a dataset of monocular videos with ground truth annotations of 3D object pose, shape and part motion during human-object interactions. Our dataset consists of several common articulated objects captured from diverse real-world scenes and camera viewpoints. Each manipulated object (e.g., microwave oven) is represented with a matching 3D parametric model. This data allows us to evaluate the reconstruction quality of articulated objects and establish a benchmark for this challenging task. In particular, we leverage the estimated 3D human pose for more accurate inference of the object spatial layout and dynamics. We evaluate this approach on our dataset, demonstrating that human-object relations can significantly reduce the ambiguity of articulated object reconstructions from challenging real-world videos. Code and dataset are available at https://github.com/facebookresearch/d3d-hoi.


title: Exploiting Multi-Object Relationships for Detecting Adversarial Attacks in Complex Scenes

abstract: Vision systems that deploy Deep Neural Networks (DNNs) are known to be vulnerable to adversarial examples. Recent research has shown that checking the intrinsic consistencies in the input data is a promising way to detect adversarial attacks (e.g., by checking the object co-occurrence relationships in complex scenes). However, existing approaches are tied to specific models and do not offer generalizability. Motivated by the observation that language descriptions of natural scene images have already captured the object co-occurrence relationships that can be learned by a language model, we develop a novel approach to perform context consistency checks using such language models. The distinguishing aspect of our approach is that it is independent of the deployed object detector and yet offers very high accuracy in terms of detecting adversarial examples in practical scenes with multiple objects.


title: Generating Smooth Pose Sequences for Diverse Human Motion Prediction

abstract: Recent progress in stochastic motion prediction, i.e., predicting multiple possible future human motions given a single past pose sequence, has led to producing truly diverse future motions and even providing control over the motion of some body parts. However, to achieve this, the state-of-the-art method requires learning several mappings for diversity and a dedicated model for controllable motion prediction. In this paper, we introduce a unified deep generative network for both diverse and controllable motion prediction. To this end, we leverage the intuition that realistic human motions consist of smooth sequences of valid poses, and that, given limited data, learning a pose prior is much more tractable than a motion one. We therefore design a generator that predicts the motion of different body parts sequentially, and introduce a normalizing flow based pose prior, together with a joint angle loss, to achieve motion realism.Our experiments on two standard benchmark datasets, Human3.6M and HumanEva-I, demonstrate that our approach outperforms the state-of-the-art baselines in terms of both sample diversity and accuracy. The code is available at https://github.com/wei-mao-2019/gsps


title: Second-Order Specifications and Quantifier Elimination for Consistent Query Answering in Databases

abstract: Consistent answers to a query from a possibly inconsistent database are answers that are simultaneously retrieved from every possible repair of the database. Repairs are consistent instances that minimally differ from the original inconsistent instance. It has been shown before that database repairs can be specified as the stable models of a disjunctive logic program. In this paper we show how to use the repair programs to transform the problem of consistent query answering into a problem of reasoning w.r.t. a theory written in second-order predicate logic. It also investigated how a first-order theory can be obtained instead by applying second-order quantifier elimination techniques.


title: Improved regularity for the parabolic normalized p-Laplace equation

abstract: We derive regularity estimates for viscosity solutions to the parabolic normalized p-Laplace. By using approximation methods and scaling arguments for the normalized p-parabolic operator, we show that the gradient of bounded viscosity solutions is locally asymptotically Lipschitz continuous when $p$ is sufficiently close to 2. In addition, we establish regularity estimates in Sobolev spaces.


title: Pre-burst neutrinos of gamma-ray bursters accompanied by high-energy photons

abstract: Previous researches on high-energy neutrino events from gamma-ray bursters (GRBs) suggest a neutrino speed variation $v(E)=c(1\pm E/E^{\nu}_{\mathrm{LV}})$ with ${E}^{\nu}_{\rm LV}=(6.4\pm 1.5)\times10^{17}~{ \rm GeV}$, together with an intrinsic time difference ${\Delta {t}_{\rm in}=(-2.8\pm 0.7)\times10^2~{\rm s}}$, which means that high-energy neutrinos come out about 300~s earlier than low-energy photons in the source reference system. Considering the possibility that pre-bursts of neutrinos may be accompanied by high-energy photons, in this work we search for high-energy photon events with earlier emission time from 100 to 1000~s before low-energy photons at source by analyzing Fermi Gamma-ray Space Telescope (FGST) data. We perform the searching of photon events with energies larger than 100~MeV, and find 14 events from 48 GRBs with known redshifts. Combining these events with a $1.07~\rm{TeV}$ photon event observed by the Major Atmospheric Gamma Imaging Cherenkov telescopes (MAGIC), we suggest a pre-burst stage with a long duration period of several minutes of high energy neutrino emissions accompanied by high energy photons at the GRB source.


title: Self-Supervised Video Representation Learning with Meta-Contrastive Network

abstract: Self-supervised learning has been successfully applied to pre-train video representations, which aims at efficient adaptation from pre-training domain to downstream tasks. Existing approaches merely leverage contrastive loss to learn instance-level discrimination. However, lack of category information will lead to hard-positive problem that constrains the generalization ability of this kind of methods. We find that the multi-task process of meta learning can provide a solution to this problem. In this paper, we propose a Meta-Contrastive Network (MCN), which combines the contrastive learning and meta learning, to enhance the learning ability of existing self-supervised approaches. Our method contains two training stages based on model-agnostic meta learning (MAML), each of which consists of a contrastive branch and a meta branch. Extensive evaluations demonstrate the effectiveness of our method. For two downstream tasks, i.e., video action recognition and video retrieval, MCN outperforms state-of-the-art approaches on UCF101 and HMDB51 datasets. To be more specific, with R(2+1)D backbone, MCN achieves Top-1 accuracies of 84.8% and 54.5% for video action recognition, as well as 52.5% and 23.7% for video retrieval.


title: Chirality-induced zigzag domain wall in in-plane magnetized ultrathin films

abstract: The domain structure in in-plane magnetized Fe/Ni/W(110) films is investigated using spin-polarized low-energy electron microscopy. A novel transition of the domain wall shape from a zigzag-like pattern to straight is observed as a function of the film thickness, which is triggered by the transition of the domain wall type from out-of-plane chiral wall to in-plane N\'eel wall. The contribution of the Dzyaloshinskii-Moriya interaction to the wall energy is proposed to explain the transition of the domain wall shape, which is supported by Monte-Carlo simulations.


title: Silicon photonics integrated dynamic polarization controller for continuous-variable quantum key distribution

abstract: We designed and demonstrated experimentally a silicon photonics integrated dynamic polarization controller which is a crucial component of a continuous-variable quantum key distribution system. By using a variable step simulated annealing approach, we achieve a dynamic polarization extinction ratio greater than 25 dB. The dynamic polarization controller can be utilized in silicon photonics integrated continuous-variable quantum key distribution system to minimize the size and decrease the cost further.


title: Evidence for a liquid precursor to biomineral formation

abstract: The crystals in animal biominerals such as sea urchin spines, mollusk shells, and coral skeletons, form by attachment of amorphous particles that subsequently crystallize. Do these solid amorphous precursor particles have liquid precursors? Polymer-induced liquid precursors (PILP), or prenucleation clusters coalescing into a liquid precursor to calcium carbonate crystallization have been observed extensively in synthetic systems. Molecular dynamics simulations also predict liquid-liquid phase separation. However, evidence for liquid precursors in natural biominerals remains elusive. Here we present Scanning or PhotoEmission Electron Microscopy (SEM, PEEM) evidence consistent with a dense liquid-like precursor in regenerating sea urchin spines. The observed precursor originates in tissue and ultimately transforms into a single crystal of calcite (CaCO3) with complex stereom morphology.


title: Stellar Core-Merger-Induced Collapse: New Formation Pathways for Black Holes, Thorne-$\dot{\rm Z}$ytkow objects, Magnetars and Superluminous Supernovae

abstract: Most neutron stars (NSs) and black holes (BHs) are believed to be the final remnants in the evolution of massive stars. In this study, we propose a new formation channel for the formation of BHs and peculiar NSs (specifically, magnetars and Thorne-$\dot{\rm Z}$ytkow objects [T$\dot{\rm Z}$Os]), which we refer to as the core merger-induced collapse (CMIC) model. This model involves the merger at the end of a common-envelope phase of an oxygen/neon/magnesium composition white dwarf and the core of a hydrogen-rich or helium-rich non-degenerate star, leading to the creation of peculiar new types of objects. The results of binary population synthesis simulations show that the CMIC channel could make important contributions to the populations of (millisecond) pulsars, T$\dot{\rm Z}$Os, magnetars and BHs. The possibility of superluminous supernovae powered by T$\dot{\rm Z}$Os, magnetars and BHs formed through the CMIC model is also being investigated. Magnetars with immediate matter surroundings formed after the CMIC might be good sources for fast radio bursts.


title: Limits of KMS states on Toeplitz algebras of finite graphs

abstract: The structure of KMS states of Toeplitz algebras associated to finite graphs equipped with the gauge action is determined by an Huef--Laca--Raeburn--Sims. Their results imply that extremal KMS states of type I correspond to vertices, while extremal KMS states at critical inverse temperatures correspond to minimal strongly connected components. The purpose of this article is to clarify the role of non-minimal components and the relation between vertices and minimal components in the KMS-structure. For each component $C_0$ and each vertex $v \in C_0$, the KMS states at the critical inverse temperature of $v$ obtained by the limit of type I KMS states associated to $v$ uniquely decomposes into a convex combination of KMS states associated to minimal components. We show that for each minimal component $C$, the coefficient of the KMS state associated to $C$ is nonzero if and only if there exists a maximal path from $C$ to $C_0$ in the graph of components.


title: Box-Adapt: Domain-Adaptive Medical Image Segmentation using Bounding BoxSupervision

abstract: Deep learning has achieved remarkable success in medicalimage segmentation, but it usually requires a large numberof images labeled with fine-grained segmentation masks, andthe annotation of these masks can be very expensive andtime-consuming. Therefore, recent methods try to use un-supervised domain adaptation (UDA) methods to borrow in-formation from labeled data from other datasets (source do-mains) to a new dataset (target domain). However, due tothe absence of labels in the target domain, the performance ofUDA methods is much worse than that of the fully supervisedmethod. In this paper, we propose a weakly supervised do-main adaptation setting, in which we can partially label newdatasets with bounding boxes, which are easier and cheaperto obtain than segmentation masks. Accordingly, we proposea new weakly-supervised domain adaptation method calledBox-Adapt, which fully explores the fine-grained segmenta-tion mask in the source domain and the weak bounding boxin the target domain. Our Box-Adapt is a two-stage methodthat first performs joint training on the source and target do-mains, and then conducts self-training with the pseudo-labelsof the target domain. We demonstrate the effectiveness of ourmethod in the liver segmentation task. Weakly supervised do-main adaptation


title: Slip topology of steady flows around a critical point: Taking the linear velocity field as an example

abstract: The flow of viscous fluids is considered as the aggregation of the motion of fluid particles when the fluid is conceived to be made up by an infinite number of particles. As an alternative of this conventional model, fluid motion could be understood as the slip of fluid layers with a molecular scale over each other, where the slip structures of fluid and their associated small-scale motion are characterized by an axial-vector-valued differential 1-form, called the vortex field. In this paper, in the case of steady flows we define the swirling degree of the velocity field at a point, and further the swirl field of the steady flow, to study the slip topology of fluid or the local streamline pattern around the critical point. The linear velocity field in the right real Schur form is used to carry out detailed analyses around the isolated critical point. Theoretical deduction and numerical test unveil the connection between the swirling degree and the swirl field, greatly make clear the topological property of slip structures of fluid in steady flows, especially in three-dimensional space.


title: A novel method in solving seepage problems implementation in Abaqus based on the polygonal scaled boundary finite element method

abstract: The scaled boundary finite element method (SBFEM) is a semi-analytical computational scheme, which is based on the characteristics of the finite element method (FEM) and combines the advantages of the boundary element method (BEM). This paper integrates the scaled boundary finite element method (SBFEM) and the polygonal mesh technique into a new approach to solving the steady-state and transient seepage problems. The proposed method is implemented in Abaqus using a user-defined element (UEL). The detailed implementations of the procedure, defining the UEL element, updating the RHS and AMATRX, and solving the stiffness/mass matrix by the eigenvalue decomposition are presented. Several benchmark problems from seepage are solved to validate the proposed implementation. Results show that the polygonal element of PS-SBFEM has a higher accuracy rate than the standard FEM element in the same element size. For the transient problems, the results between PS-SBFEM and the FEM are in excellent agreement. Furthermore, the PS-SBFEM with quadtree meshes shows a good effect for solving complex geometric in the seepage problem. Hence, the proposed method is robust accurate for solving the steady-state and transient seepage problems. The developed UEL source code and the associated input files can be downloaded from https://github.com/yangyLab/PS-SBFEM.


title: Addressing Algorithmic Disparity and Performance Inconsistency in Federated Learning

abstract: Federated learning (FL) has gain growing interests for its capability of learning from distributed data sources collectively without the need of accessing the raw data samples across different sources. So far FL research has mostly focused on improving the performance, how the algorithmic disparity will be impacted for the model learned from FL and the impact of algorithmic disparity on the utility inconsistency are largely unexplored. In this paper, we propose an FL framework to jointly consider performance consistency and algorithmic fairness across different local clients (data sources). We derive our framework from a constrained multi-objective optimization perspective, in which we learn a model satisfying fairness constraints on all clients with consistent performance. Specifically, we treat the algorithm prediction loss at each local client as an objective and maximize the worst-performing client with fairness constraints through optimizing a surrogate maximum function with all objectives involved. A gradient-based procedure is employed to achieve the Pareto optimality of this optimization problem. Theoretical analysis is provided to prove that our method can converge to a Pareto solution that achieves the min-max performance with fairness constraints on all clients. Comprehensive experiments on synthetic and real-world datasets demonstrate the superiority that our approach over baselines and its effectiveness in achieving both fairness and consistency across all local clients.


title: Identifiability Implies Robust, Globally Exponentially Convergent On-line Parameter Estimation: Application to Model Reference Adaptive Control

abstract: In this paper we propose a new parameter estimator that ensures global exponential convergence of linear regression models requiring only the necessary assumption of identifiability of the regression equation,which we show is equivalent to interval excitation of the regressor vector. Continuous and discrete-time versions of the estimators are given. An extension to--separable and monotonic--non-linear parameterizations is also given. The estimators are shown to be robust to additive measurement noise and--not necessarily slow--parameter variations. Moreover, a version of the continuous-time estimator that rejects sinusoidal disturbances with unknown internal model is given. The estimator is shown to be applicable to the classical model reference adaptive control problem relaxing the conspicuous assumption of known sign of the high-frequency gain. Simulation results that illustrate the performance of the estimator are given.


title: Energy Stable L2 Schemes for Time-Fractional Phase-Field Equations

abstract: In this article, the energy stability of two high-order L2 schemes for time-fractional phase-field equations is established. We propose a reformulation of the L2 operator and also some new properties on it. We prove the energy boundedness (by initial energy) of an L2 scalar auxiliary variable scheme for any phase-field equation and the fractional energy law of an implicit-explicit L2 Adams--Bashforth scheme for the Allen--Cahn equation. The stability analysis is based on a new Cholesky decomposition proposed recently by some of us.


title: Testing the equivalence principle and discreteness of spacetime through the $t^3$ gravitational phase with quantum information technology

abstract: We propose a new thought experiment, based on present-day Quantum Information Technologies, to measure quantum gravitational effects through the Bose-Marletto-Vedral (BMV) effect by revealing the gravitational $t^3$ phase term, its expected relationships with low-energy quantum gravity phenomena and test the equivalence principle of general relativity. The technique here proposed promise to reveal gravitational field fluctuations from the analysis of the stochastic noise associated to an ideal output of a measurement process of a quantum system. To improve the sensitivity we propose to cumulate the effects of the gravitational field fluctuations in time on the outputs of a series of independent measurements acted on entangled states of particles, like in the building of a quantum cryptographic key, and extract from the associated time series the effect of the expected gravitational field fluctuations. In fact, an ideal quantum cryptographic key, built with the sharing of maximally entangled states of particles, is represented by a random sequence of uncorrelated symbols mathematically described by a perfect white noise, a stochastic process with zero mean and without correlation between its values taken at different times. Gravitational field perturbations, including quantum gravity fluctuations and gravitational waves, introduce additional phase terms that decohere the entangled pairs used to build the quantum cryptographic key, with the result of coloring the white noise. We find that this setup, built with massive mesoscopic particles, can potentially reveal the $t^3$ gravitational phase term and thus, the BMV effect.


title: Bayesian Semiparametric Hidden Markov Tensor Partition Models for Longitudinal Data with Local Variable Selection

abstract: We present a flexible Bayesian semiparametric mixed model for longitudinal data analysis in the presence of potentially high-dimensional categorical covariates. Building on a novel hidden Markov tensor decomposition technique, our proposed method allows the fixed effects components to vary between dependent random partitions of the covariate space at different time points. The mechanism not only allows different sets of covariates to be included in the model at different time points but also allows the selected predictors' influences to vary flexibly over time. Smooth time-varying additive random effects are used to capture subject specific heterogeneity. We establish posterior convergence guarantees for both function estimation and variable selection. We design a Markov chain Monte Carlo algorithm for posterior computation. We evaluate the method's empirical performances through synthetic experiments and demonstrate its practical utility through real world applications.


title: Multi-window SRS imaging using a rapid widely tunable fiber laser

abstract: Spectroscopic stimulated Raman scattering (SRS) imaging has become a useful tool finding a broad range of applications. Yet, wider adoption is hindered by the bulky and environmentally-sensitive solid-state optical parametric oscillator (OPO) in current SRS microscope. Moreover, chemically-informative multi-window SRS imaging across C-H, C-D and fingerprint Raman regions is challenging due to the slow wavelength tuning speed of the solid-state OPO. In this work, we present a multi-window SRS imaging system based on a compact and robust fiber laser with rapid and widely tuning capability. To address the relative intensity noise intrinsic to fiber laser, we implemented auto-balanced detection which enhances the signal-to-noise ratio of stimulated Raman loss imaging by 23 times. We demonstrate high-quality SRS metabolic imaging of fungi, cancer cells, and Caenorhabditis elegans across the C-H, C-D and fingerprint Raman windows. Our re-sults showcase the potential of the compact multi-window SRS system for a broad range of applications.


title: Chaos Engineering For Understanding Consensus Algorithms Performance in Permissioned Blockchains

abstract: A critical component of any blockchain or distributed ledger technology (DLT) platform is the consensus algorithm. Blockchain consensus algorithms are the primary vehicle for the nodes within a blockchain network to reach an agreement. In recent years, many blockchain consensus algorithms have been proposed mainly for private and permissioned blockchain networks. However, the performance of these algorithms and their reliability in hostile environments or the presence of byzantine and other network failures are not well understood. In addition, the testing and validation of blockchain applications come with many technical challenges. In this paper, we apply chaos engineering and testing to understand the performance of consensus algorithms in the presence of different loads, byzantine failure and other communication failure scenarios. We apply chaos engineering to evaluate the performance of three different consensus algorithms (PBFT, Clique, Raft) and their respective blockchain platforms. We measure the blockchain network's throughput, latency, and success rate while executing chaos and load tests. We develop lightweight blockchain applications to execute our test in a semi-production environment. Our results show that using chaos engineering helps understand how different consensus algorithms perform in a hostile or unreliable environment and the limitations of blockchain platforms. Our work demonstrates the benefits of using chaos engineering in testing complex distributed systems such as blockchain networks.


title: Multiple stellar populations at less evolved stages-II: no evidence of significant helium spread among NGC 1846 dwarfs

abstract: The detection of star-to-star chemical variations in star clusters older than 2 Gyr has changed the traditional view of star clusters as canonical examples of "simple stellar populations" (SSPs) into the so-called "multiple stellar populations" (MPs). Although the significance of MPs seems to correlate with cluster total mass, it seems that the presence of MPs is determined by cluster age, however. In this article, we use deep photometry from the Hubble Space Telescope to investigate whether the FG-type dwarfs in the $\sim$1.7 Gyr-old cluster NGC 1846, have helium spread. By comparing the observation with the synthetic stellar populations, we estimate a helium spread of $\Delta{Y}\sim0.01\pm0.01$ among the main-sequence stars in NGC 1846. The maximum helium spread would not exceed $\Delta{Y}\sim0.02$, depending on the adopted fraction of helium-enriched stars. To mask the color variation caused by such a helium enrichment, a nitrogen enrichment of at least $\Delta{\rm [N/Fe]}$=0.8 dex is required, which is excluded by previous analyses of the red-giant branch in this cluster. We find that our result is consistent with the $\Delta{Y}$--mass relationship for Galactic globular clusters. To examine whether or not NGC 1846 harbors MPs, higher photometric accuracy is required. We conclude that under the adopted photometric quality, there is no extreme helium variation among NGC 1846 dwarfs.


title: Semantic Reinforced Attention Learning for Visual Place Recognition

abstract: Large-scale visual place recognition (VPR) is inherently challenging because not all visual cues in the image are beneficial to the task. In order to highlight the task-relevant visual cues in the feature embedding, the existing attention mechanisms are either based on artificial rules or trained in a thorough data-driven manner. To fill the gap between the two types, we propose a novel Semantic Reinforced Attention Learning Network (SRALNet), in which the inferred attention can benefit from both semantic priors and data-driven fine-tuning. The contribution lies in two-folds. (1) To suppress misleading local features, an interpretable local weighting scheme is proposed based on hierarchical feature distribution. (2) By exploiting the interpretability of the local weighting scheme, a semantic constrained initialization is proposed so that the local attention can be reinforced by semantic priors. Experiments demonstrate that our method outperforms state-of-the-art techniques on city-scale VPR benchmark datasets.


title: A 1+O(1/N) approximation algorithm for TTP(2)

abstract: The traveling tournament problem is a well-known benchmark problem of the sports scheduling. We propose an approximation algorithm for the traveling tournament problem with the constraints such that both the number of consecutive home games and that of consecutive away games are at most two (called TTP(2)). The approximation ratio of the proposed algorithm is 1 + 24/n for n teams, which is the first 1 + O(1/n) approximation algorithm for TTP(2).


title: Seven Principles for Rapid-Response Data Science: Lessons Learned from Covid-19 Forecasting

abstract: In this article, we take a step back to distill seven principles out of our experience in the spring of 2020, when our 12-person rapid-response team used skills of data science and beyond to help distribute Covid PPE. This process included tapping into domain knowledge of epidemiology and medical logistics chains, curating a relevant data repository, developing models for short-term county-level death forecasting in the US, and building a website for sharing visualization (an automated AI machine). The principles are described in the context of working with Response4Life, a then-new nonprofit organization, to illustrate their necessity. Many of these principles overlap with those in standard data-science teams, but an emphasis is put on dealing with problems that require rapid response, often resembling agile software development.


title: Coformality around fibrations and cofibrations

abstract: We show that in a fibration the coformality of the base space implies the coformality of the total space under reasonable conditions, and these conditions can not be weakened. The result is partially dual to the classical work of Lupton \cite{Lup} on the formality within a fibration. Our result has two applications. First, we show that for certain cofibrations, the coformality of the cofiber implies the coformality of the base. Secondly, we show that the total spaces of certain spherical fibrations are Koszul in the sense of Berglund \cite{Ber}.


title: MvSR-NAT: Multi-view Subset Regularization for Non-Autoregressive Machine Translation

abstract: Conditional masked language models (CMLM) have shown impressive progress in non-autoregressive machine translation (NAT). They learn the conditional translation model by predicting the random masked subset in the target sentence. Based on the CMLM framework, we introduce Multi-view Subset Regularization (MvSR), a novel regularization method to improve the performance of the NAT model. Specifically, MvSR consists of two parts: (1) \textit{shared mask consistency}: we forward the same target with different mask strategies, and encourage the predictions of shared mask positions to be consistent with each other. (2) \textit{model consistency}, we maintain an exponential moving average of the model weights, and enforce the predictions to be consistent between the average model and the online model. Without changing the CMLM-based architecture, our approach achieves remarkable performance on three public benchmarks with 0.36-1.14 BLEU gains over previous NAT models. Moreover, compared with the stronger Transformer baseline, we reduce the gap to 0.01-0.44 BLEU scores on small datasets (WMT16 RO$\leftrightarrow$EN and IWSLT DE$\rightarrow$EN).


title: Improved Robustness and Safety for Pre-Adaptation of Meta Reinforcement Learning with Prior Regularization

abstract: Meta Reinforcement Learning (Meta-RL) has seen substantial advancements recently. In particular, off-policy methods were developed to improve the data efficiency of Meta-RL techniques. \textit{Probabilistic embeddings for actor-critic RL} (PEARL) is a leading approach for multi-MDP adaptation problems. A major drawback of many existing Meta-RL methods, including PEARL, is that they do not explicitly consider the safety of the prior policy when it is exposed to a new task for the first time. Safety is essential for many real-world applications, including field robots and Autonomous Vehicles (AVs). In this paper, we develop the PEARL PLUS (PEARL$^+$) algorithm, which optimizes the policy for both prior (pre-adaptation) safety and posterior (after-adaptation) performance. Building on top of PEARL, our proposed PEARL$^+$ algorithm introduces a prior regularization term in the reward function and a new Q-network for recovering the state-action value under prior context assumptions, to improve the robustness to task distribution shift and safety of the trained network exposed to a new task for the first time. The performance of PEARL$^+$ is validated by solving three safety-critical problems related to robots and AVs, including two MuJoCo benchmark problems. From the simulation experiments, we show that safety of the prior policy is significantly improved and more robust to task distribution shift compared to PEARL.


title: A cut-and-fold self-sustained compliant oscillator for autonomous actuation of origami-inspired robots

abstract: Origami-inspired robots are of particular interest given their potential for rapid and accessible design and fabrication of elegant designs and complex functionalities through cutting and folding of flexible 2D sheets or even strings, i.e.printable manufacturing. Yet, origami robots still require bulky, rigid components or electronics for actuation and control to accomplish tasks with reliability, programmability, ability to output substantial force, and durability, restricting their full potential. Here, we present a printable self-sustained compliant oscillator that generates periodic actuation using only constant electrical power, without discrete components or electronic control hardware. This oscillator is robust (9 out of 10 prototypes worked successfully on the first try), configurable (with tunable periods from 3 s to 12 s), powerful (can overcome hydrodynamic resistance to consistently propel a swimmer at ~1.6 body lengths/min), and long-lasting (~10^3 cycles); it enables driving macroscale devices with prescribed autonomous behaviors, e.g. locomotion and sequencing. This oscillator is also fully functional underwater and in high magnetic fields. Our analytical model characterizes essential parameters of the oscillation period, enabling programmable design of the oscillator. The printable oscillator can be integrated into origami-inspired systems seamlessly and monolithically, allowing rapid design and prototyping; the resulting integrated devices are lightweight, low-cost, compliant, electronic-free, and nonmagnetic, enabling practical applications in extreme areas. We demonstrate the functionalities of the oscillator with: (i) autonomous gliding of a printable swimmer, (ii) LED flashing, and (iii) fluid stirring. This work paves the way for realizing fully printable autonomous robots with a high integration of actuation and control.


title: Taurid stream #628: a reservoir of large cometary impactors

abstract: The Desert Fireball Network observed a significant outburst of fireballs belonging to the Southern Taurid Complex of meteor showers between October 27 and November 17, 2015. At the same time, the Cameras for Allsky Meteor Surveillance project detected a distinct population of smaller meteors belonging to the irregular IAU shower #628, the s-Taurids. While this returning outburst was predicted and observed in previous work, the reason for this stream is not yet understood. 2015 was the first year that the stream was precisely observed, providing an opportunity to better understand its nature. We analyse the orbital elements of stream members, and establish a size frequency distribution from millimetre to metre size range. The stream is highly stratified with a large change of entry speed along Earth's orbit. We confirm that the meteoroids have orbital periods near the 7:2 mean-motion resonance with Jupiter. The mass distribution of this population is dominated by larger meteoroids, unlike that for the regular Southern Taurid shower. The distribution index is consistent with a gentle collisional fragmentation of weak material. A population of metre-sized objects is identified from satellite observations at a rate consistent with a continuation of the size-frequency distribution established at centimetre size. The observed change of longitude of perihelion among the s-Taurids points to recent (a few centuries ago) activity from fragmentation involving surviving asteroid 2015TX24. This supports a model for the Taurid Complex showers that involves an ongoing fragmentation cascade of comet 2P/Encke siblings following a breakup some 20,000 years ago.


title: Augmenting Slot Values and Contexts for Spoken Language Understanding with Pretrained Models

abstract: Spoken Language Understanding (SLU) is one essential step in building a dialogue system. Due to the expensive cost of obtaining the labeled data, SLU suffers from the data scarcity problem. Therefore, in this paper, we focus on data augmentation for slot filling task in SLU. To achieve that, we aim at generating more diverse data based on existing data. Specifically, we try to exploit the latent language knowledge from pretrained language models by finetuning them. We propose two strategies for finetuning process: value-based and context-based augmentation. Experimental results on two public SLU datasets have shown that compared with existing data augmentation methods, our proposed method can generate more diverse sentences and significantly improve the performance on SLU.


title: Uniform hyperbolicity of nonseparating curve graphs of nonorientable surfaces

abstract: Let $N$ be a connected finite type nonorientable surface with or without boundary components and punctures. We prove that the graph of nonseparating curves of $N$ is connected and Gromov hyperbolic with a constant which does not depend on the topological type of the surface by using the bicorn curves introduced by Przytycki and Sisto. The proof is based on the argument by Rasmussen on the uniform hyperbolicity of graphs of nonseparating curves for finite type orientable surfaces.


title: Clustering-Based Subset Selection in Evolutionary Multiobjective Optimization

abstract: Subset selection is an important component in evolutionary multiobjective optimization (EMO) algorithms. Clustering, as a classic method to group similar data points together, has been used for subset selection in some fields. However, clustering-based methods have not been evaluated in the context of subset selection from solution sets obtained by EMO algorithms. In this paper, we first review some classic clustering algorithms. We also point out that another popular subset selection method, i.e., inverted generational distance (IGD)-based subset selection, can be viewed as clustering. Then, we perform a comprehensive experimental study to evaluate the performance of various clustering algorithms in different scenarios. Experimental results are analyzed in detail, and some suggestions about the use of clustering algorithms for subset selection are derived. Additionally, we demonstrate that decision maker's preference can be introduced to clustering-based subset selection.


title: Improving Human Sequential Decision-Making with Reinforcement Learning

abstract: Workers spend a significant amount of time learning how to make good decisions. Evaluating the efficacy of a given decision, however, can be complicated -- e.g., decision outcomes are often long-term and relate to the original decision in complex ways. Surprisingly, even though learning good decision-making strategies is difficult, they can often be expressed in simple and concise forms. Focusing on sequential decision-making, we design a novel machine learning algorithm that is capable of extracting "best practices" from trace data and conveying its insights to humans in the form of interpretable "tips". Our algorithm selects the tip that best bridges the gap between the actions taken by human workers and those taken by the optimal policy in a way that accounts for which actions are consequential for achieving higher performance. We evaluate our approach through a series of randomized controlled experiments where participants manage a virtual kitchen. Our experiments show that the tips generated by our algorithm can significantly improve human performance relative to intuitive baselines. In addition, we discuss a number of empirical insights that can help inform the design of algorithms intended for human-AI interfaces. For instance, we find evidence that participants do not simply blindly follow our tips; instead, they combine them with their own experience to discover additional strategies for improving performance.


title: BackREST: A Model-Based Feedback-Driven Greybox Fuzzer for Web Applications

abstract: Following the advent of the American Fuzzy Lop (AFL), fuzzing had a surge in popularity, and modern day fuzzers range from simple blackbox random input generators to complex whitebox concolic frameworks that are capable of deep program introspection. Web application fuzzers, however, did not benefit from the tremendous advancements in fuzzing for binary programs and remain largely blackbox in nature. This paper introduces BackREST, a fully automated, model-based, coverage- and taint-driven fuzzer that uses its feedback loops to find more critical vulnerabilities, faster (speedups between 7.4x and 25.9x). To model the server-side of web applications, BackREST automatically infers REST specifications through directed state-aware crawling. Comparing BackREST against three other web fuzzers on five large (>500 KLOC) Node.js applications shows how it consistently achieves comparable coverage while reporting more vulnerabilities than state-of-the-art. Finally, using BackREST, we uncovered nine 0-days, out of which six were not reported by any other fuzzer. All the 0-days have been disclosed and most are now public, including two in the highly popular Sequelize and Mongodb libraries.


title: Blockchain Phishing Scam Detection via Multi-channel Graph Classification

abstract: With the popularity of blockchain technology, the financial security issues of blockchain transaction networks have become increasingly serious. Phishing scam detection methods will protect possible victims and build a healthier blockchain ecosystem. Usually, the existing works define phishing scam detection as a node classification task by learning the potential features of users through graph embedding methods such as random walk or graph neural network (GNN). However, these detection methods are suffered from high complexity due to the large scale of the blockchain transaction network, ignoring temporal information of the transaction. Addressing this problem, we defined the transaction pattern graphs for users and transformed the phishing scam detection into a graph classification task. To extract richer information from the input graph, we proposed a multi-channel graph classification model (MCGC) with multiple feature extraction channels for GNN. The transaction pattern graphs and MCGC are more able to detect potential phishing scammers by extracting the transaction pattern features of the target users. Extensive experiments on seven benchmark and Ethereum datasets demonstrate that the proposed MCGC can not only achieve state-of-the-art performance in the graph classification task but also achieve effective phishing scam detection based on the target users' transaction pattern graphs.


title: Cost-Efficient RIS-Aided Channel Estimation via Rank-One Matrix Factorization

abstract: A reconfigurable intelligent surface (RIS) consists of massive meta elements, which can improve the performance of future wireless communication systems. Existing RIS-aided channel estimation methods try to estimate the cascaded channel directly, incurring high computational and training overhead especially when the number of elements of RIS is extremely large. In this paper, we propose a cost-efficient channel estimation method via rank-one matrix factorization (MF). Specifically, if the RIS is employed near base station (BS), it is found that the RIS- aided channel can be factorized into a product of low-dimensional matrices. To estimate these factorized matrices, we propose alternating minimization and gradient descent approaches to obtain the near optimal solutions. Compared to directly estimating the cascaded channel, the proposed MF method reduces training overhead substantially. Finally, the numerical simulations show the effectiveness of the proposed MF method.


title: Quantized edge magnetizations and their symmetry protection in one-dimensional quantum spin systems

abstract: The bulk electric polarization works as a nonlocal order parameter that characterizes topological quantum matters. Motivated by a recent paper [H. Watanabe \textit{et al.}, Phys. Rev. B {\bf 103}, 134430 (2021)], we discuss magnetic analogs of the bulk polarization in one-dimensional quantum spin systems, that is, quantized magnetizations on the edges of one-dimensional quantum spin systems.The edge magnetization shares the topological origin with the fractional edge state of the topological odd-spin Haldane phases. Despite this topological origin, the edge magnetization can also appear in topologically trivial quantum phases. We develop straightforward field theoretical arguments that explain the characteristic properties of the edge magnetization. The field theory shows that a U(1) spin-rotation symmetry and a site-centered or bond-centered inversion symmetry protect the quantization of the edge magnetization. We proceed to discussions that quantum phases on nonzero magnetization plateaus can also have the quantized edge magnetization that deviates from the magnetization density in bulk. We demonstrate that the quantized edge magnetization distinguishes two quantum phases on a magnetization plateau separated by a quantum critical point. The edge magnetization exhibits an abrupt stepwise change from zero to $1/2$ at the quantum critical point because the quantum phase transition occurs in the presence of the symmetries protecting the quantization of the edge magnetization. We also show that the quantized edge magnetization can result from the spontaneous ferrimagnetic order.


title: Intrinsic topological magnons in arrays of magnetic dipoles

abstract: We study a simple magnetic system composed of periodically modulated magnetic dipoles with an easy axis. Upon adjusting the modulation amplitude alone, chains and two-dimensional stacked chains exhibit a rich magnon spectrum where frequency gaps and magnon speeds are easily manipulable. The blend of anisotropy due to dipolar interactions between magnets and geometrical modulation induces a magnetic phase with fractional Zak number in infinite chains and end states in open one-dimensional systems. In two dimensions it gives rise to topological modes at the edges of stripes. Tuning the amplitude in two-dimensional lattices causes a band touching, which triggers the exchange of the Chern numbers of the volume bands and switches the sign of the thermal conductivity.


title: Local H\"older continuity of solutions of the complex Monge-Amp\`ere equation

abstract: In this paper, we are interested in studying the Dirichlet problem for the complex Monge-Amp\`ere operator. We provide necessary and sufficient conditions for the problem to have H\"older continuous solutions.


title: The Bootstrap for Dynamical Systems

abstract: Despite their deterministic nature, dynamical systems often exhibit seemingly random behaviour. Consequently, a dynamical system is usually represented by a probabilistic model of which the unknown parameters must be estimated using statistical methods. When measuring the uncertainty of such parameter estimation, the bootstrap stands out as a simple but powerful technique. In this paper, we develop the bootstrap for dynamical systems and establish not only its consistency but also its second-order efficiency via a novel \textit{continuous} Edgeworth expansion for dynamical systems. This is the first time such continuous Edgeworth expansions have been studied. Moreover, we verify the theoretical results about the bootstrap using computer simulations.


title: $\mathcal{L}_1$ Adaptive Control with Switched Reference Models: Application to Learn-to-Fly

abstract: Learn-to-Fly (L2F) is a new framework that aims to replace the traditional iterative development paradigm for aerial vehicles with a combination of real-time aerodynamic modeling, guidance, and learning control. To ensure safe learning of the vehicle dynamics on the fly, this paper presents an $\mathcal{L}_1$ adaptive control ($\mathcal{L}_1$AC) based scheme, which actively estimates and compensates for the discrepancy between the intermediately learned dynamics and the actual dynamics. First, to incorporate the periodic update of the learned model within the L2F framework, this paper extends the $\mathcal{L}_1$AC architecture to handle a switched reference system subject to unknown time-varying parameters and disturbances. The paper also includes an analysis of both transient and steady-state performance of the $\mathcal{L}_1$AC architecture in the presence of non-zero initialization error for the state predictor. Second, the paper presents how the proposed $\mathcal{L}_1$AC scheme is integrated into the L2F framework, including its interaction with the baseline controller and the real-time modeling module. Finally, flight tests on an unmanned aerial vehicle (UAV) validate the efficacy of the proposed control and learning scheme.


title: Comparison of simulated neutrino emission models with data on Supernova 1987A

abstract: We compare models of supernova (SN) neutrino emission with the Kamiokande II data on SN 1987A using the Bayesian approach. These models are taken from simulations and are representative of current 1D SN models. We find that models with a brief accretion phase of neutrino emission are the most favored. This result is not affected by varying the overall flux normalization or considering neutrino oscillations. We also check the compatibility of the best-fit models with the data.


title: Svar: A Tiny C++ Header Brings Unified Interface for Multiple programming Languages

abstract: There are numerous types of programming languages developed in the last decades, and most of them provide interface to call C++ or C for high efficiency implementation. The motivation of Svar is to design an efficient, light-weighted and general middle-ware for multiple languages, meanwhile, brings the dynamism features from script language to C++ in a straightforward way. Firstly, a Svar class with JSON like data structure is designed to hold everything exists in C++, including basic values, functions or user defined classes and objects. Secondly, arguments are auto cast to and from Svar efficiently with compile time pointers, references and shared\_ptr detection. Thirdly, classes and functions are binded with string names to support reflection, this means all functions and classes in a shared library can be exported to a Svar object, which also calls a Svar module. The Svar modules can be accessed by different languages and this paper demonstrates how to import and use a Svar module in Python and Node.js. Moreover, the Svar modules or even a python module can also be imported by C++ at runtime, which makes C++ easier to compile and use since headers are not required anymore. We compare the performance of Svar with two state-of-the-art binding tool for Python and Node.js, and the result demonstrates that Svar is efficient, elegant and general. The core of this project is one single tiny modern C++ header with less than 5000 lines code without extra dependency. To help developers using Svar, all the source codes related are public available on http://github.com/zdzhaoyong/Svar, including documentations and benchmarks.


title: A Partial Order on Preference Profiles

abstract: We propose a theoretical framework under which preference profiles can be meaningfully compared. Specifically, given a finite set of feasible allocations and a preference profile, we first define a ranking vector of an allocation as the vector of all individuals' rankings of this allocation. We then define a partial order on preference profiles and write "$P \geq P^{'}$", if there exists an onto mapping $\psi$ from the Pareto frontier of $P^{'}$ onto the Pareto frontier of $P$, such that the ranking vector of any Pareto efficient allocation $x$ under $P^{'}$ is weakly dominated by the ranking vector of the image allocation $\psi(x)$ under $P$. We provide a characterization of the maximal and minimal elements under the partial order. In particular, we illustrate how an individualistic form of social preferences can be maximal in a specific setting. We also discuss how the framework can be further generalized to incorporate additional economic ingredients.


title: Busemann functions in asymptotically harmonic Finsler manifolds

abstract: In the present paper, we investigate Busemann functions in a general Finsler setting as well as in asymptotically harmonic Finsler manifolds. In particular, we show Busemann functions are smooth on asymptotically harmonic Finsler manifolds.


title: Medical Image Segmentation with 3D Convolutional Neural Networks: A Survey

abstract: Computer-aided medical image analysis plays a significant role in assisting medical practitioners for expert clinical diagnosis and deciding the optimal treatment plan. At present, convolutional neural networks (CNN) are the preferred choice for medical image analysis. In addition, with the rapid advancements in three-dimensional (3D) imaging systems and the availability of excellent hardware and software support to process large volumes of data, 3D deep learning methods are gaining popularity in medical image analysis. Here, we present an extensive review of the recently evolved 3D deep learning methods in medical image segmentation. Furthermore, the research gaps and future directions in 3D medical image segmentation are discussed.


title: QUEACO: Borrowing Treasures from Weakly-labeled Behavior Data for Query Attribute Value Extraction

abstract: We study the problem of query attribute value extraction, which aims to identify named entities from user queries as diverse surface form attribute values and afterward transform them into formally canonical forms. Such a problem consists of two phases: {named entity recognition (NER)} and {attribute value normalization (AVN)}. However, existing works only focus on the NER phase but neglect equally important AVN. To bridge this gap, this paper proposes a unified query attribute value extraction system in e-commerce search named QUEACO, which involves both two phases. Moreover, by leveraging large-scale weakly-labeled behavior data, we further improve the extraction performance with less supervision cost. Specifically, for the NER phase, QUEACO adopts a novel teacher-student network, where a teacher network that is trained on the strongly-labeled data generates pseudo-labels to refine the weakly-labeled data for training a student network. Meanwhile, the teacher network can be dynamically adapted by the feedback of the student's performance on strongly-labeled data to maximally denoise the noisy supervisions from the weak labels. For the AVN phase, we also leverage the weakly-labeled query-to-attribute behavior data to normalize surface form attribute values from queries into canonical forms from products. Extensive experiments on a real-world large-scale E-commerce dataset demonstrate the effectiveness of QUEACO.


title: Enright resolutions encoded by a generating function for Blattner's formula: Type A

abstract: Consider the classical action of ${\rm GL}_n$ on a sum of $q$ copies of the defining representation and $p$ copies of its dual; by Howe duality, the polynomial functions on this space decompose under the joint action of ${\rm GL}_n$ and $\mathfrak{gl}_{p+q}$. The modules for $\mathfrak{gl}_{p+q}$ are infinite-dimensional and their structure is complicated outside a certain stable range, although Enright and Willenbring (2005) constructed resolutions in terms of generalized Verma modules. We show that these resolutions can be read off from the coefficients in a formal series arising in an entirely different setting: discrete series representations of ${\rm SU}(n,p+q)$ in the case of two noncompact simple roots.


title: ChMusic: A Traditional Chinese Music Dataset for Evaluation of Instrument Recognition

abstract: Musical instruments recognition is a widely used application for music information retrieval. As most of previous musical instruments recognition dataset focus on western musical instruments, it is difficult for researcher to study and evaluate the area of traditional Chinese musical instrument recognition. This paper propose a traditional Chinese music dataset for training model and performance evaluation, named ChMusic. This dataset is free and publicly available, 11 traditional Chinese musical instruments and 55 traditional Chinese music excerpts are recorded in this dataset. Then an evaluation standard is proposed based on ChMusic dataset. With this standard, researchers can compare their results following the same rule, and results from different researchers will become comparable.