title: Clinical Evaluation of Real-Time Optical-Tracking Navigation and Live Time-Intensity Curves to Provide Feedback During Blinded 4D Contrast-Enhanced Ultrasound Imaging

abstract: Current commercial matrix transducers for 3D DCE-US do not display side-by-side B-mode and contrast-mode images when capturing volumetric data, thus leaving the operator with no position feedback during lengthy acquisitions. The purpose of this study was to investigate the use of transducer tracking to provide positioning feedback and to re-align images to improve quantification. An interventional tracking system was developed in house using an infrared camera and a 3D-printed tracking target attached to a X6-1 matrix transducer. The system displays a virtual probe on a separate screen and allows to capture a reference position to provide operator feedback when no B-mode image is available. To test this set-up, five experienced operators were asked to locate an image landmark within a volunteer liver in B-mode images using the X6-1 connected to an EPIQ7 system. Operators were then asked to maintain the transducer position for 4 minutes under three feedback methods: i) B-mode, ii) display of real-time virtual transducer, iii) blind. The magnitude of displacement over the cine was computed as an estimate of the imaging position error. We also investigated whether transducer coordinates can be used to re-align images due to motion and improve contrast ultrasound perfusion repeatability. A total of 8 patient data were obtained under an IRB for this. Results suggest that tracking can assist operators maintain a steady position during a lengthy acquisition. With blinded acquisition, an average displacement of 4.58 mm (S.D. 2.65 mm) was noted. In contrast, the average displacement for tracking-feedback was comparable to B-mode at 3.48 mm (S.D. 0.8 mm). We also observed that perfusion parameters had better repeatability after re-alignment.


title: Transport based Graph Kernels

abstract: Graph kernel is a powerful tool measuring the similarity between graphs. Most of the existing graph kernels focused on node labels or attributes and ignored graph hierarchical structure information. In order to effectively utilize graph hierarchical structure information, we propose pyramid graph kernel based on optimal transport (OT). Each graph is embedded into hierarchical structures of the pyramid. Then, the OT distance is utilized to measure the similarity between graphs in hierarchical structures. We also utilize the OT distance to measure the similarity between subgraphs and propose subgraph kernel based on OT. The positive semidefinite (p.s.d) of graph kernels based on optimal transport distance is not necessarily possible. We further propose regularized graph kernel based on OT where we add the kernel regularization to the original optimal transport distance to obtain p.s.d kernel matrix. We evaluate the proposed graph kernels on several benchmark classification tasks and compare their performance with the existing state-of-the-art graph kernels. In most cases, our proposed graph kernel algorithms outperform the competing methods.


title: Triangulated Laman Graphs, Local Stochastic Matrices, and Limits of Their Products

abstract: We derive conditions on the products of stochastic matrices guaranteeing the existence of a unique limit invariant distribution. Belying our approach is the hereby defined notion of restricted triangulated Laman graphs. The main idea is the following: to each triangle in the graph, we assign a stochastic matrix. Two matrices can be adjacent in a product only if their corresponding triangles share an edge in the graph. We provide an explicit formula for the limit invariant distribution of the product in terms of the individual stochastic matrices.


title: Dual-decoder Transformer for Joint Automatic Speech Recognition and Multilingual Speech Translation

abstract: We introduce dual-decoder Transformer, a new model architecture that jointly performs automatic speech recognition (ASR) and multilingual speech translation (ST). Our models are based on the original Transformer architecture (Vaswani et al., 2017) but consist of two decoders, each responsible for one task (ASR or ST). Our major contribution lies in how these decoders interact with each other: one decoder can attend to different information sources from the other via a dual-attention mechanism. We propose two variants of these architectures corresponding to two different levels of dependencies between the decoders, called the parallel and cross dual-decoder Transformers, respectively. Extensive experiments on the MuST-C dataset show that our models outperform the previously-reported highest translation performance in the multilingual settings, and outperform as well bilingual one-to-one results. Furthermore, our parallel models demonstrate no trade-off between ASR and ST compared to the vanilla multi-task architecture. Our code and pre-trained models are available at https://github.com/formiel/speech-translation.


title: Interpreting Graph Drawing with Multi-Agent Reinforcement Learning

abstract: Applying machine learning techniques to graph drawing has become an emergent area of research in visualization. In this paper, we interpret graph drawing as a multi-agent reinforcement learning (MARL) problem. We first demonstrate that a large number of classic graph drawing algorithms, including force-directed layouts and stress majorization, can be interpreted within the framework of MARL. Using this interpretation, a node in the graph is assigned to an agent with a reward function. Via multi-agent reward maximization, we obtain an aesthetically pleasing graph layout that is comparable to the outputs of classic algorithms. The main strength of a MARL framework for graph drawing is that it not only unifies a number of classic drawing algorithms in a general formulation but also supports the creation of novel graph drawing algorithms by introducing a diverse set of reward functions.


title: Characterizing and Utilizing the Interplay Between Core and Truss Decompositions

abstract: Finding the dense regions in a graph is an important problem in network analysis. Core decomposition and truss decomposition address this problem from two different perspectives. The former is a vertex-driven approach that assigns density indicators for vertices whereas the latter is an edge-driven technique that put density quantifiers on edges. Despite the algorithmic similarity between these two approaches, it is not clear how core and truss decompositions in a network are related. In this work, we introduce the vertex interplay (VI) and edge interplay (EI) plots to characterize the interplay between core and truss decompositions. Based on our observations, we devise CORE-TRUSSDD, an anomaly detection algorithm to identify the discrepancies between core and truss decompositions. We analyze a large and diverse set of real-world networks, and demonstrate how our approaches can be effective tools to characterize the patterns and anomalies in the networks. Through VI and EI plots, we observe distinct behaviors for graphs from different domains, and identify two anomalous behaviors driven by specific real-world structures. Our algorithm provides an efficient solution to retrieve the outliers in the networks, which correspond to the two anomalous behaviors. We believe that investigating the interplay between core and truss decompositions is important and can yield surprising insights regarding the dense subgraph structure of real-world networks.


title: Intra-night optical variability of $\gamma-$ray detected narrow-line Seyfert 1 galaxies

abstract: We report the first attempt to systematically characterise intra-night optical variability (INOV) of the rare and enigmatic subset of Narrow-Line Seyfert1 galaxies (NLSy1s), which is marked by detection in the $\gamma$-ray band and is therefore endowed with Doppler boosted relativistic jets, like blazars. However, the central engines in these two types of AGN are thought to operate in different regimes of accretion rate. Our INOV search in a fairly large and unbiased sample of 15 $\gamma$-ray NLSy1s was conducted in 36 monitoring sessions, each lasting $\geq$ 3 hrs. In our analysis, special care has been taken to address the possible effect on the differential light curves, of any variation in the seeing disc during the session, since that might lead to spurious claims of INOV from such AGN due to the possibility of a significant contribution from the host galaxy to the total optical emission. From our observations, a duty cycle (DC) of INOV detection in the $\gamma$-ray NLSy1s is estimated to be around 25% - 30%, which is comparable to that known for blazars. This estimate of DC will probably need an upward revision, once it becomes possible to correct for the dilution of the AGN's nonthermal optical emission by the (much steadier) optical emission contributed not only by the host galaxy but also the nuclear accretion disc in these high Eddington rate accretors. Finally, we also draw attention to the possibility that sharp optical flux changes on sub-hour time scale are less rare for $\gamma$-ray NLSy1s, in comparison to blazars.


title: A Critical Correspondence on Humpty Dumpty's Funding for European Journalism

abstract: This short critical correspondence discusses the Digital News Innovation (DNI) fund orchestrated by Humpty Dumpty -- a.k.a. Google -- for helping European journalism to innovate and renew itself. Based on topic modeling and critical discourse analysis, the results indicate that the innovative projects mostly mimic the old business model of Humpty Dumpty. With these results and the accompanying critical discussion, this correspondence contributes to the ongoing battle between platforms and media.


title: Understanding the morphotropic phase boundary of perovskite solid solutions as a frustrated state

abstract: Perovskite solid solutions that have a chemical composition A(C$_x$D$_{1-x})$O$_3$ with transition metals C and D substitutionally occupying the B site of a perovskite lattice are attractive in various applications for their dielectric, piezoelectric and other properties. A remarkable feature of these solid solutions is the \emph{morphotropic phase boundary} (MPB), the composition across which the crystal symmetry changes. Critically, it has long been observed that the dielectric and piezoelectric as well as the ability to pole a ceramic increases dramatically at the MPB. While this has motivated much study of perovskite MPBs, a number of important questions about the role of disorder remain unanswered. We address these questions using a new approach based on the random-field Ising model with long-range interactions that incorporates the basic elements of the physics at the meso-scale. We show that the MPB emerges naturally in this approach as a frustrated state where stability is exchanged between two well-defined phases. Specifically, long-range interactions suppress the disorder at compositions away from MPB but are unable to do so when there is an exchange of stability. Further, the approach also predicts a number of experimentally observed features like the fragmented domain patterns and superior ability to pole at the MPB. The insights from this model also suggest the possibility of entirely new materials with strong ferroelectric-ferromagnetic coupling using an MPB.


title: BayesBeat: Reliable Atrial Fibrillation Detection from Noisy Photoplethysmography Data

abstract: Smartwatches or fitness trackers have garnered a lot of popularity as potential health tracking devices due to their affordable and longitudinal monitoring capabilities. To further widen their health tracking capabilities, in recent years researchers have started to look into the possibility of Atrial Fibrillation (AF) detection in real-time leveraging photoplethysmography (PPG) data, an inexpensive sensor widely available in almost all smartwatches. A significant challenge in AF detection from PPG signals comes from the inherent noise in the smartwatch PPG signals. In this paper, we propose a novel deep learning based approach, BayesBeat that leverages the power of Bayesian deep learning to accurately infer AF risks from noisy PPG signals, and at the same time provides an uncertainty estimate of the prediction. Extensive experiments on two publicly available dataset reveal that our proposed method BayesBeat outperforms the existing state-of-the-art methods. Moreover, BayesBeat is substantially more efficient having 40-200X fewer parameters than state-of-the-art baseline approaches making it suitable for deployment in resource constrained wearable devices.


title: Toward a Generalization Metric for Deep Generative Models

abstract: Measuring the generalization capacity of Deep Generative Models (DGMs) is difficult because of the curse of dimensionality. Evaluation metrics for DGMs such as Inception Score, Fr\'echet Inception Distance, Precision-Recall, and Neural Net Divergence try to estimate the distance between the generated distribution and the target distribution using a polynomial number of samples. These metrics are the target of researchers when designing new models. Despite the claims, it is still unclear how well can they measure the generalization capacity of a generative model. In this paper, we investigate the capacity of these metrics in measuring the generalization capacity. We introduce a framework for comparing the robustness of evaluation metrics. We show that better scores in these metrics do not imply better generalization. They can be fooled easily by a generator that memorizes a small subset of the training set. We propose a fix to the NND metric to make it more robust to noise in the generated data. Toward building a robust metric for generalization, we propose to apply the Minimum Description Length principle to the problem of evaluating DGMs. We develop an efficient method for estimating the complexity of Generative Latent Variable Models (GLVMs). Experimental results show that our metric can effectively detect training set memorization and distinguish GLVMs of different generalization capacities. Source code is available at https://github.com/htt210/GeneralizationMetricGAN.


title: Maximal diameter theorem for directed graphs of positive Ricci curvature

abstract: In a previous work, the authors have introduced a Lin-Lu-Yau type Ricci curvature for directed graphs, and obtained a diameter comparison of Bonnet-Myers type. In this paper, we investigate rigidity properties for the equality case, and conclude a maximal diameter theorem of Cheng type.


title: Observation Space Matters: Benchmark and Optimization Algorithm

abstract: Recent advances in deep reinforcement learning (deep RL) enable researchers to solve challenging control problems, from simulated environments to real-world robotic tasks. However, deep RL algorithms are known to be sensitive to the problem formulation, including observation spaces, action spaces, and reward functions. There exist numerous choices for observation spaces but they are often designed solely based on prior knowledge due to the lack of established principles. In this work, we conduct benchmark experiments to verify common design choices for observation spaces, such as Cartesian transformation, binary contact flags, a short history, or global positions. Then we propose a search algorithm to find the optimal observation spaces, which examines various candidate observation spaces and removes unnecessary observation channels with a Dropout-Permutation test. We demonstrate that our algorithm significantly improves learning speed compared to manually designed observation spaces. We also analyze the proposed algorithm by evaluating different hyperparameters.


title: Signatures of magnetostriction and spin-phonon coupling in magnetoelectric hexagonal 15R-BaMnO3

abstract: Spin-phonon coupling, the interaction of spins with surrounding lattice is a key parameter to understand the underlying physics of multiferroics and engineer their magnetization dynamics. Elementary excitations in multiferroic materials are strongly influenced by spin-phonon interaction, making Raman spectroscopy a unique tool to probe these coupling(s). Recently, it has been suggested that the dielectric and magnetic properties of 15R-type hexagonal BaMnO3 are correlated through the spin-lattice coupling. Here, we report the observation of an extensive renormalization of the Raman spectrum of 15R-BaMnO3 at 230 K, 280 K, and 330 K. Magnetic measurements reveal the presence of a long-range and a short-range magnetic ordering in 15R-BaMnO3 at 230 K and 330 K, respectively. The Raman spectrum shows the appearance of new Raman modes in the magnetically ordered phases. Furthermore, an additional Raman phonon appears below ~ 280 K, possibly arising from a local lattice-distortion due to the displacement of Mn-ions, that exhibits anomalous shift with temperature. The origin of the observed renormalization and phonon anomalies in Raman spectra are discussed based on the evidences from temperature- and magnetic-field-dependent Raman spectra, temperature-dependent x-ray diffraction, magnetization, and specific heat measurements. Our results indicate the presence of magnetostriction and spin-phonon coupling in 15R-BaMnO3 thus suggesting that the optical phonons are strongly correlated to its magnetoelectric properties.


title: \'UFAL at MRP 2020: Permutation-invariant Semantic Parsing in PERIN

abstract: We present PERIN, a novel permutation-invariant approach to sentence-to-graph semantic parsing. PERIN is a versatile, cross-framework and language independent architecture for universal modeling of semantic structures. Our system participated in the CoNLL 2020 shared task, Cross-Framework Meaning Representation Parsing (MRP 2020), where it was evaluated on five different frameworks (AMR, DRG, EDS, PTG and UCCA) across four languages. PERIN was one of the winners of the shared task. The source code and pretrained models are available at https://github.com/ufal/perin.


title: Data-Driven Approximation of the Perron-Frobenius Operator Using the Wasserstein Metric

abstract: This manuscript introduces a regression-type formulation for approximating the Perron-Frobenius Operator by relying on distributional snapshots of data. These snapshots may represent densities of particles. The Wasserstein metric is leveraged to define a suitable functional optimization in the space of distributions. The formulation allows seeking suitable dynamics so as to interpolate the distributional flow in function space. A first-order necessary condition for optimality is derived and utilized to construct a gradient flow approximating algorithm. The framework is exemplied with numerical simulations.


title: 1-d Ising model using Kronecker sum and Kronecker product

abstract: Calculations in Ising model can be cumbersome and non-intuitive. Here we provide a formulation that addresses these issues for 1-D scenario. We represent the microstates of spin interactions as a diagonal matrix. This is done using two operations: Kronecker sum and Kronecker product. The calculations thus become simple matter of manipulating diagonal matrices. We address the following problems in this work: spins in the magnetic field, open-chain 1-D Ising model, closed-chain 1-D Ising model, 1-D Ising model in an external magnetic field. We believe that this representation will help provide students as well as experts with a simple yet powerful technique to carry out calculations in this model.


title: On regular genus and G-degree of PL 4-manifolds with boundary

abstract: In this article, we introduce two new PL-invariants: weighted regular genus and weighted G-degree for manifolds with boundary. We first prove two inequalities involving some PL-invariants which state that for any PL-manifold $M$ with non spherical boundary components, the regular genus $\mathcal{G}(M)$ of $M$ is at least the weighted regular genus $\tilde{G}(M)$ of $M$ which is again at least the generalized regular genus $\bar{G}(M)$ of $M$. Another inequality states that the weighted G-degree $\tilde{D}_G (M)$ of $M$ is always greater than or equal to the G-degree $D_G (M)$ of $M$. Let $M$ be any compact connected PL $4$-manifold with $h$ number of non spherical boundary components. Then we compute the following: $$\tilde{G} (M) \geq 2 \chi(M)+3m+2h-4+2 \hat{m} \mbox{ and } \tilde{D}_G (M) \geq 12(2 \chi(M)+3m+2h-4+2 \hat{m}),$$ where $m$ and $\hat{m}$ are the ranks of the fundamental groups of $M$ and the corresponding singular manifold $\widehat{M}$ (obtained by coning off the boundary components of $M$) respectively. As a consequence we prove that the regular genus $\mathcal{G}(M)$ satisfies the following inequality: $$\mathcal{G} (M) \geq 2 \chi(M)+3m+2h-4+2 \hat{m},$$ which improves the previous known lower bounds for the regular genus $\mathcal{G}(M)$ of $M$. Then we define two classes of gems for PL $4$-manifold $M$ with boundary: one consists of semi-simple gems and the other consists of weak semi-simple gems, and prove that the lower bounds for the weighted G-degree and weighted regular genus are attained in these two classes respectively.


title: $L^p$-Green-tight measures of $L^p$-Kato class for symmetric Markov processes

abstract: In this paper, we introduce the notion of $L^p$-Green-tight measures of $L^p$-Kato class in the framework of symmetric Markov processes. The class of $L^p$-Green-tight measures of $L^p$-Kato class is defined by the $p$-th power of resolvent kernels. We first prove that under the $L^p$-Green tightness of the measure $\mu$, the embedding of extended Dirichlet space into $L^{2p}(E;\mu)$ is compact under the absolute continuity condition for transient Markov processes, which is an extension of recent seminal work by Takeda. Secondly, we prove the coincidence between two classes of $L^p$-Green-tightness, one is originally introduced by Zhao, and another one is invented by Chen. Finally, we prove that our class of $L^p$-Green-tight measures of $L^p$-Kato class coincides with the class of $L^p$-Green tight measures of Kato class in terms of Green kernel under the global heat kernel estimates. We apply our results to $d$-dimensional Brownian motion androtationally symmetric relativistic $\alpha$-stable processes on $\mathbb{R}^d$.


title: Rydberg-dressed Fermi liquid: correlations and signatures of droplet crystallization

abstract: We investigate the effects of many-body correlations on the ground-state properties of a single component ultra-cold Rydberg-dressed Fermi liquid with purely repulsive inter-particle interactions, in both three and two spatial dimensions. We have employed the Fermi-hypernetted-chain Euler-Lagrange approximation and observed that the contribution of the correlation energy on the ground-state energy becomes significant at intermediate values of the soft-core radius and large coupling strengths. For small and large soft-core radii, the correlation energy is negligible and the ground-state energy approaches the Hartree-Fock value. The positions of the main peaks in static structure factor and pair distribution function in the homogeneous fluid phase signal the formation of quantum droplet crystals with several particles confined inside each droplet.


title: State-Driven Dynamic Graphon Model

abstract: This paper shows the equivalence class definition of graphons hinders a direct development of dynamics on the graphon space, and hence proposes a state-driven approach to obtain dynamic graphons. The state-driven dynamic graphon model constructs a time-index sequence of the permutation-invariant probability measures on the universal graph space by assigning i.i.d. state random processes to $\mathbbm{N}$ and edge random variables to each of the unordered integer pairs. The model is justified from three perspectives: graph limit definition preservation, genericity, and analysis availability. It preserves the graph limit definition of graphon by applying a bijection between the permutation-invariant probability measures on the universal graph space and the graphon space to obtain the dynamic graphon, where the existence of the bijection is proved. Also, a generalized version of the model is proved to cover the graphon space by an application of the celebrated Aldous-Hoover representation, where generalization is achieved by adding randomness to the edge-generating functions. Finally, analysis of the behavior of the dynamic graphon is shown to be available by making assumptions on the state random processes and the edge random variables.


title: Intelligent Omni-Surface: Ubiquitous Wireless Transmission by Reflective-Transmissive Metasurface

abstract: Intelligent reflecting surface (IRS), which is capable to adjust propagation conditions by controlling phase shifts of the reflected waves that impinge on the surface, has been widely analyzed for enhancing the performance of wireless systems. However, the reflective properties of widely studied IRSs restrict the service coverage to only one side of the surface. In this paper, to extend the wireless coverage of communication systems, we introduce the concept of intelligent omni-surface (IOS)-assisted communication. More precisely, IOS is an important instance of reconfigurable intelligent surface (RIS) that is capable to provide service coverage to the mobile users (MUs) in a reflective and a transmissive manner. We consider a downlink IOS-assisted communication system, where a multi-antenna small base station (SBS) and an IOS perform beamforming jointly, to improve the received power of multiple MUs on both sides of the IOS, through different reflective/transmissive channels. To maximize the sum-rate, we formulate a joint IOS phase shift design and SBS beamforming optimization problem, and propose an iterative algorithm to solve the resulting non-convex program efficiently. Both theoretical analysis and simulation results show that an IOS significantly extends the service coverage of the SBS when compared to an IRS.


title: I Know What You Asked: Graph Path Learning using AMR for Commonsense Reasoning

abstract: CommonsenseQA is a task in which a correct answer is predicted through commonsense reasoning with pre-defined knowledge. Most previous works have aimed to improve the performance with distributed representation without considering the process of predicting the answer from the semantic representation of the question. To shed light upon the semantic interpretation of the question, we propose an AMR-ConceptNet-Pruned (ACP) graph. The ACP graph is pruned from a full integrated graph encompassing Abstract Meaning Representation (AMR) graph generated from input questions and an external commonsense knowledge graph, ConceptNet (CN). Then the ACP graph is exploited to interpret the reasoning path as well as to predict the correct answer on the CommonsenseQA task. This paper presents the manner in which the commonsense reasoning process can be interpreted with the relations and concepts provided by the ACP graph. Moreover, ACP-based models are shown to outperform the baselines.


title: Reducing Confusion in Active Learning for Part-Of-Speech Tagging

abstract: Active learning (AL) uses a data selection algorithm to select useful training samples to minimize annotation cost. This is now an essential tool for building low-resource syntactic analyzers such as part-of-speech (POS) taggers. Existing AL heuristics are generally designed on the principle of selecting uncertain yet representative training instances, where annotating these instances may reduce a large number of errors. However, in an empirical study across six typologically diverse languages (German, Swedish, Galician, North Sami, Persian, and Ukrainian), we found the surprising result that even in an oracle scenario where we know the true uncertainty of predictions, these current heuristics are far from optimal. Based on this analysis, we pose the problem of AL as selecting instances which maximally reduce the confusion between particular pairs of output tags. Extensive experimentation on the aforementioned languages shows that our proposed AL strategy outperforms other AL strategies by a significant margin. We also present auxiliary results demonstrating the importance of proper calibration of models, which we ensure through cross-view training, and analysis demonstrating how our proposed strategy selects examples that more closely follow the oracle data distribution.


title: Deep Feature Augmentation for Occluded Image Classification

abstract: Due to the difficulty in acquiring massive task-specific occluded images, the classification of occluded images with deep convolutional neural networks (CNNs) remains highly challenging. To alleviate the dependency on large-scale occluded image datasets, we propose a novel approach to improve the classification accuracy of occluded images by fine-tuning the pre-trained models with a set of augmented deep feature vectors (DFVs). The set of augmented DFVs is composed of original DFVs and pseudo-DFVs. The pseudo-DFVs are generated by randomly adding difference vectors (DVs), extracted from a small set of clean and occluded image pairs, to the real DFVs. In the fine-tuning, the back-propagation is conducted on the DFV data flow to update the network parameters. The experiments on various datasets and network structures show that the deep feature augmentation significantly improves the classification accuracy of occluded images without a noticeable influence on the performance of clean images. Specifically, on the ILSVRC2012 dataset with synthetic occluded images, the proposed approach achieves 11.21% and 9.14% average increases in classification accuracy for the ResNet50 networks fine-tuned on the occlusion-exclusive and occlusion-inclusive training sets, respectively.


title: Fabrication of on-chip probes for double-tip scanning tunneling microscopy

abstract: Reduction of the inter-probe distance in multi-probe and double-tip STM down to the nanometer scale has been a longstanding and technically difficult challenge. Recent multi-probe systems have allowed for significant progress by achieving distances of around 30 nm using two individually driven, traditional metal wire tips. For situations where simple alignment and a fixed separation can be advantageous, we here present the fabrication of on-chip double-tip devices that incorporate two mechanically fixed gold tips with a tip separation of only 35 nm. We utilize the excellent mechanical, insulating and dielectric properties of high quality SiN as a base material to realize easy-to-implement, lithographically defined and mechanically stable tips. With their large contact pads and adjustable footprint these novel tips can be easily integrated with most existing commercial combined STM/AFM systems.


title: Context-Aware Cross-Attention for Non-Autoregressive Translation

abstract: Non-autoregressive translation (NAT) significantly accelerates the inference process by predicting the entire target sequence. However, due to the lack of target dependency modelling in the decoder, the conditional generation process heavily depends on the cross-attention. In this paper, we reveal a localness perception problem in NAT cross-attention, for which it is difficult to adequately capture source context. To alleviate this problem, we propose to enhance signals of neighbour source tokens into conventional cross-attention. Experimental results on several representative datasets show that our approach can consistently improve translation quality over strong NAT baselines. Extensive analyses demonstrate that the enhanced cross-attention achieves better exploitation of source contexts by leveraging both local and global information.


title: Multitask Learning and Joint Optimization for Transformer-RNN-Transducer Speech Recognition

abstract: Recently, several types of end-to-end speech recognition methods named transformer-transducer were introduced. According to those kinds of methods, transcription networks are generally modeled by transformer-based neural networks, while prediction networks could be modeled by either transformers or recurrent neural networks (RNN). This paper explores multitask learning, joint optimization, and joint decoding methods for transformer-RNN-transducer systems. Our proposed methods have the main advantage in that the model can maintain information on the large text corpus. We prove their effectiveness by performing experiments utilizing the well-known ESPNET toolkit for the widely used Librispeech datasets. We also show that the proposed methods can reduce word error rate (WER) by 16.6 % and 13.3 % for test-clean and test-other datasets, respectively, without changing the overall model structure nor exploiting an external LM.


title: Some extended hypergeometric matrix functions and their fractional calculus

abstract: In this paper, we study some extended hypergeometric functions from matrix point of view. We have given the integral representations of these matrix functions. Finally, we obtain some generating function relations using fractional derivative operators.


title: Using a Bi-directional LSTM Model with Attention Mechanism trained on MIDI Data for Generating Unique Music

abstract: Generating music is an interesting and challenging problem in the field of machine learning. Mimicking human creativity has been popular in recent years, especially in the field of computer vision and image processing. With the advent of GANs, it is possible to generate new similar images, based on trained data. But this cannot be done for music similarly, as music has an extra temporal dimension. So it is necessary to understand how music is represented in digital form. When building models that perform this generative task, the learning and generation part is done in some high-level representation such as MIDI (Musical Instrument Digital Interface) or scores. This paper proposes a bi-directional LSTM (Long short-term memory) model with attention mechanism capable of generating similar type of music based on MIDI data. The music generated by the model follows the theme/style of the music the model is trained on. Also, due to the nature of MIDI, the tempo, instrument, and other parameters can be defined, and changed, post generation.


title: Set Augmented Triplet Loss for Video Person Re-Identification

abstract: Modern video person re-identification (re-ID) machines are often trained using a metric learning approach, supervised by a triplet loss. The triplet loss used in video re-ID is usually based on so-called clip features, each aggregated from a few frame features. In this paper, we propose to model the video clip as a set and instead study the distance between sets in the corresponding triplet loss. In contrast to the distance between clip representations, the distance between clip sets considers the pair-wise similarity of each element (i.e., frame representation) between two sets. This allows the network to directly optimize the feature representation at a frame level. Apart from the commonly-used set distance metrics (e.g., ordinary distance and Hausdorff distance), we further propose a hybrid distance metric, tailored for the set-aware triplet loss. Also, we propose a hard positive set construction strategy using the learned class prototypes in a batch. Our proposed method achieves state-of-the-art results across several standard benchmarks, demonstrating the advantages of the proposed method.


title: A Curious New Result of Resolution Strategies in Negation-Limited Inverters Problem

abstract: Generally, negation-limited inverters problem is known as a puzzle of constructing an inverter with AND gates and OR gates and a few inverters. In this paper, we introduce a curious new result about the effectiveness of two powerful ATP (Automated Theorem Proving) strategies on tackling negation limited inverter problem. Two resolution strategies are UR (Unit Resulting) resolution and hyper-resolution. In experiment, we come two kinds of automated circuit construction: 3 input/output inverters and 4 input/output BCD Counter Circuit. Both circuits are constructed with a few limited inverters. Curiously, it has been turned out that UR resolution is drastically faster than hyper-resolution in the measurement of the size of SOS (Set of Support). Besides, we discuss the syntactic and semantic criteria which might causes considerable difference of computation cost between UR resolution and hyper-resolution.


title: Incorporating Gas Pipeline Leakage Failure Modes in Risk Evaluation of Electricity-Gas Integrated Energy Systems

abstract: In the existing literatures for the risk evaluation of electricity-gas integrated energy system (EGIES), the impacts of gas leakage in pipelines are ignored. This paper presents a method to incorporate the failure modes of gas pipeline leakage in EGIES risk evaluation. A Markov state transition model of gas pipeline with multi-state and multi-mode transition process, and a bi-level Monte Carlo sampling method for this model are developed. A stochastic topology change based network model of EGIES considering the pipeline leakage failure modes is presented. The risk indices for EGIES based on the load shedding, including those specifically for gas leakage risks, are also proposed. An EGIES with a modified RBTS and a 7-node gas system was used to demonstrate an application of the proposed method and models. The results indicate that pipeline leakage failures have significant impacts on the risk of EGIES. Ignoring pipeline leakage failures in the risk evaluation of EGIES will result in an overly underestimation of system risk and most likely a misleading conclusion in system planning.


title: COSMO: Conditional SEQ2SEQ-based Mixture Model for Zero-Shot Commonsense Question Answering

abstract: Commonsense reasoning refers to the ability of evaluating a social situation and acting accordingly. Identification of the implicit causes and effects of a social context is the driving capability which can enable machines to perform commonsense reasoning. The dynamic world of social interactions requires context-dependent on-demand systems to infer such underlying information. However, current approaches in this realm lack the ability to perform commonsense reasoning upon facing an unseen situation, mostly due to incapability of identifying a diverse range of implicit social relations. Hence they fail to estimate the correct reasoning path. In this paper, we present Conditional SEQ2SEQ-based Mixture model (COSMO), which provides us with the capabilities of dynamic and diverse content generation. We use COSMO to generate context-dependent clauses, which form a dynamic Knowledge Graph (KG) on-the-fly for commonsense reasoning. To show the adaptability of our model to context-dependant knowledge generation, we address the task of zero-shot commonsense question answering. The empirical results indicate an improvement of up to +5.2% over the state-of-the-art models.


title: Learning Sequences of Manipulation Primitives for Robotic Assembly

abstract: This paper explores the idea that skillful assembly is best represented as dynamic sequences of Manipulation Primitives, and that such sequences can be automatically discovered by Reinforcement Learning. Manipulation Primitives, such as "Move down until contact", "Slide along x while maintaining contact with the surface", have enough complexity to keep the search tree shallow, yet are generic enough to generalize across a wide range of assembly tasks. Moreover, the additional "semantics" of the Manipulation Primitives make them more robust in sim2real and against model/environment variations and uncertainties, as compared to more elementary actions. Policies are learned in simulation, and then transferred onto a physical platform. Direct sim2real transfer (without retraining in real) achieves excellent success rates on challenging assembly tasks, such as round peg insertion with 0.04 mm clearance or square peg insertion with large hole position/orientation estimation errors.


title: Phase field predictions of microscopic fracture and R-curve behaviour of fibre-reinforced composites

abstract: We present a computational framework to explore the effect of microstructure and constituent properties upon the fracture toughness of fibre-reinforced polymer composites. To capture microscopic matrix cracking and fibre-matrix debonding, the framework couples the phase field fracture method and a cohesive zone model in the context of the finite element method. Virtual single-notched three point bending tests are conducted. The actual microstructure of the composite is simulated by an embedded cell in the fracture process zone, while the remaining area is homogenised to be an anisotropic elastic solid. A detailed comparison of the predicted results with experimental observations reveals that it is possible to accurately capture the crack path, interface debonding and load versus displacement response. The sensitivity of the crack growth resistance curve (R-curve) to the matrix fracture toughness and the fibre-matrix interface properties is determined. The influence of porosity upon the R-curve of fibre-reinforced composites is also explored, revealing a stabler response with increasing void volume fraction. These results shed light into microscopic fracture mechanisms and set the basis for efficient design of high fracture toughness composites.


title: Adapting Pretrained Transformer to Lattices for Spoken Language Understanding

abstract: Lattices are compact representations that encode multiple hypotheses, such as speech recognition results or different word segmentations. It is shown that encoding lattices as opposed to 1-best results generated by automatic speech recognizer (ASR) boosts the performance of spoken language understanding (SLU). Recently, pretrained language models with the transformer architecture have achieved the state-of-the-art results on natural language understanding, but their ability of encoding lattices has not been explored. Therefore, this paper aims at adapting pretrained transformers to lattice inputs in order to perform understanding tasks specifically for spoken language. Our experiments on the benchmark ATIS dataset show that fine-tuning pretrained transformers with lattice inputs yields clear improvement over fine-tuning with 1-best results. Further evaluation demonstrates the effectiveness of our methods under different acoustic conditions. Our code is available at https://github.com/MiuLab/Lattice-SLU


title: Searching k-Optimal Goals for an Orienteering Problem on a Specialized Graph with Budget Constraints

abstract: We propose a novel non-randomized anytime orienteering algorithm for finding k-optimal goals that maximize reward on a specialized graph with budget constraints. This specialized graph represents a real-world scenario which is analogous to an orienteering problem of finding k-most optimal goal states.


title: CVC: Contrastive Learning for Non-parallel Voice Conversion

abstract: Cycle consistent generative adversarial network (CycleGAN) and variational autoencoder (VAE) based models have gained popularity in non-parallel voice conversion recently. However, they often suffer from difficult training process and unsatisfactory results. In this paper, we propose CVC, a contrastive learning-based adversarial approach for voice conversion. Compared to previous CycleGAN-based methods, CVC only requires an efficient one-way GAN training by taking the advantage of contrastive learning. When it comes to non-parallel one-to-one voice conversion, CVC is on par or better than CycleGAN and VAE while effectively reducing training time. CVC further demonstrates superior performance in many-to-one voice conversion, enabling the conversion from unseen speakers.


title: Operator-stable-like Processes

abstract: In the present paper, we introduce so-called operator-stable-like processes. Roughly speaking, they behave locally like operator-stable processes, but they need not to be homogenous in space. Having shown existence for this class of processes, we analyze maximal estimates, the existence of moments, the short- and long-time behavior of the sample paths and $p$-variation. The class introduced here includes stable-like processes as special case.


title: Context-based Image Segment Labeling (CBISL)

abstract: Working with images, one often faces problems with incomplete or unclear information. Image inpainting can be used to restore missing image regions but focuses, however, on low-level image features such as pixel intensity, pixel gradient orientation, and color. This paper aims to recover semantic image features (objects and positions) in images. Based on published gated PixelCNNs, we demonstrate a new approach referred to as quadro-directional PixelCNN to recover missing objects and return probable positions for objects based on the context. We call this approach context-based image segment labeling (CBISL). The results suggest that our four-directional model outperforms one-directional models (gated PixelCNN) and returns a human-comparable performance.


title: Imaging the coupling between itinerant electrons and localised moments in the centrosymmetric skyrmion magnet GdRu2Si2

abstract: Magnetic skyrmions were thought to be stabilised only in inversion-symmetry breaking structures, but skyrmion lattices were recently discovered in inversion symmetric Gd-based compounds, spurring questions of the stabilisationmechanism. A natural consequence of a recent theoretical proposal, a coupling between itinerant electrons and localised magnetic moments, is that the skyrmions are amenable to detection using even non-magnetic probes such as spectroscopic-imaging scanning tunnellingmicroscopy (SI-STM). Here SI-STM observations of GdRu$_2$Si$_2$ reveal patterns in the local density of states that indeed vary with the underlying magnetic structures. These patterns are qualitatively reproduced by model calculations which assume exchange coupling between itinerant electrons and localised moments. These findings provide a clue to understand the skyrmion formation mechanism in GdRu$_2$Si$_2$.


title: Actor and Action Modular Network for Text-based Video Segmentation

abstract: Text-based video segmentation aims to segment an actor in video sequences by specifying the actor and its performing action with a textual query. Previous methods fail to explicitly align the video content with the textual query in a fine-grained manner according to the actor and its action, due to the problem of \emph{semantic asymmetry}. The \emph{semantic asymmetry} implies that two modalities contain different amounts of semantic information during the multi-modal fusion process. To alleviate this problem, we propose a novel actor and action modular network that individually localizes the actor and its action in two separate modules. Specifically, we first learn the actor-/action-related content from the video and textual query, and then match them in a symmetrical manner to localize the target tube. The target tube contains the desired actor and action which is then fed into a fully convolutional network to predict segmentation masks of the actor. Our method also establishes the association of objects cross multiple frames with the proposed temporal proposal aggregation mechanism. This enables our method to segment the video effectively and keep the temporal consistency of predictions. The whole model is allowed for joint learning of the actor-action matching and segmentation, as well as achieves the state-of-the-art performance for both single-frame segmentation and full video segmentation on A2D Sentences and J-HMDB Sentences datasets.


title: Differential recurrences for the distribution of the trace of the $\beta$-Jacobi ensemble

abstract: Examples of the $\beta$-Jacobi ensemble specify the joint distribution of the transmission eigenvalues in scattering problems. In this context, there has been interest in the distribution of the trace, as the trace corresponds to the conductance. Earlier, in the case $\beta = 1$, the trace statistic was isolated in studies of covariance matrices in multivariate statistics, where it is referred to as Pillai's $V$ statistic. In this context, Davis showed that for $\beta = 1$ the trace statistic, and its Fourier-Laplace transform, can be characterised by $(N+1) \times (N+1)$ matrix differential equations. For the Fourier-Laplace transform, this leads to a vector recurrence for the moments. However, for the distribution itself the characterisation provided was incomplete, as the connection problem of determining the linear combination of Frobenius type solutions that correspond to the statistic was not solved. We solve this connection problem for Jacobi parameter $b$ and Dyson index $\beta$ non-negative integers. For the other Jacobi parameter $a$ also a non-negative integer, the power series portion of each Frobenius solution terminates to a polynomial, and the matrix differential equation gives a recurrence for their computation.

categories: math-ph cond-mat.mes-hall math.MP math.ST stat.CO stat.TH


title: Representation Decomposition for Image Manipulation and Beyond

abstract: Representation disentanglement aims at learning interpretable features, so that the output can be recovered or manipulated accordingly. While existing works like infoGAN and AC-GAN exist, they choose to derive disjoint attribute code for feature disentanglement, which is not applicable for existing/trained generative models. In this paper, we propose a decomposition-GAN (dec-GAN), which is able to achieve the decomposition of an existing latent representation into content and attribute features. Guided by the classifier pre-trained on the attributes of interest, our dec-GAN decomposes the attributes of interest from the latent representation, while data recovery and feature consistency objectives enforce the learning of our proposed method. Our experiments on multiple image datasets confirm the effectiveness and robustness of our dec-GAN over recent representation disentanglement models.


title: Role Taxonomy of Units in Deep Neural Networks

abstract: Identifying the role of network units in deep neural networks (DNNs) is critical in many aspects including giving understandings on the mechanisms of DNNs and building basic connections between deep learning and neuroscience. However, there remains unclear on which roles the units in DNNs with different generalization ability could present. To this end, we give role taxonomy of units in DNNs via introducing the retrieval-of-function test, where units are categorized into four types in terms of their functional preference on separately the training set and testing set. We show that ratios of the four categories are highly associated with the generalization ability of DNNs from two distinct perspectives, based on which we give signs of DNNs with well generalization.


title: On Control of Epidemics with Application to COVID-19

abstract: At the time of writing, the ongoing COVID-19 pandemic, caused by severe acute respiratory syndrome coronavirus 2 (SARS-CoV-2), had already resulted in more than thirty-two million cases infected and more than one million deaths worldwide. Given the fact that the pandemic is still threatening health and safety, it is in the urgency to understand the COVID-19 contagion process and know how it might be controlled. With this motivation in mind, in this paper, we consider a version of a stochastic discrete-time Susceptible-Infected-Recovered-Death~(SIRD)-based epidemiological model with two uncertainties: The uncertain rate of infected cases which are undetected or asymptomatic, and the uncertain effectiveness rate of control. Our aim is to study the effect of an epidemic control policy on the uncertain model in a control-theoretic framework. We begin by providing the closed-form solutions of states in the modified SIRD-based model such as infected cases, susceptible cases, recovered cases, and deceased cases. Then, the corresponding expected states and the technical lower and upper bounds for those states are provided as well. Subsequently, we consider two epidemic control problems to be addressed: One is almost sure epidemic control problem and the other average epidemic control problem. Having defined the two problems, our main results are a set of sufficient conditions on a class of linear control policy which assures that the epidemic is "well-controlled"; i.e., both of the infected cases and deceased cases are upper bounded uniformly and the number of infected cases converges to zero asymptotically. Our numerical studies, using the historical COVID-19 contagion data in the United States, suggest that our appealingly simple model and control framework can provide a reasonable epidemic control performance compared to the ongoing pandemic situation.


abstract: Numerous deep reinforcement learning agents have been proposed, and each of them has its strengths and flaws. In this work, we present a Cooperative Heterogeneous Deep Reinforcement Learning (CHDRL) framework that can learn a policy by integrating the advantages of heterogeneous agents. Specifically, we propose a cooperative learning framework that classifies heterogeneous agents into two classes: global agents and local agents. Global agents are off-policy agents that can utilize experiences from the other agents. Local agents are either on-policy agents or population-based evolutionary algorithms (EAs) agents that can explore the local area effectively. We employ global agents, which are sample-efficient, to guide the learning of local agents so that local agents can benefit from sample-efficient agents and simultaneously maintain their advantages, e.g., stability. Global agents also benefit from effective local searches. Experimental studies on a range of continuous control tasks from the Mujoco benchmark show that CHDRL achieves better performance compared with state-of-the-art baselines.


title: A Flexible Class of Dependence-aware Multi-Label Loss Functions

abstract: Multi-label classification is the task of assigning a subset of labels to a given query instance. For evaluating such predictions, the set of predicted labels needs to be compared to the ground-truth label set associated with that instance, and various loss functions have been proposed for this purpose. In addition to assessing predictive accuracy, a key concern in this regard is to foster and to analyze a learner's ability to capture label dependencies. In this paper, we introduce a new class of loss functions for multi-label classification, which overcome disadvantages of commonly used losses such as Hamming and subset 0/1. To this end, we leverage the mathematical framework of non-additive measures and integrals. Roughly speaking, a non-additive measure allows for modeling the importance of correct predictions of label subsets (instead of single labels), and thereby their impact on the overall evaluation, in a flexible way - by giving full importance to single labels and the entire label set, respectively, Hamming and subset 0/1 are rather extreme in this regard. We present concrete instantiations of this class, which comprise Hamming and subset 0/1 as special cases, and which appear to be especially appealing from a modeling perspective. The assessment of multi-label classifiers in terms of these losses is illustrated in an empirical study.


title: Measurement of time-dependent CP violation parameters in $B^0 \to K_0^SK_0^SK_0^S$ decays at Belle

abstract: We measure the time-dependent $C\!P$ violation parameters in $B^{0} \to K^{0}_{S}K^{0}_{S}K^{0}_{S}$ decays using $772 \times 10^6$ $B {\mkern 1.5mu\overline{\mkern-1.5mu B \mkern-0.1mu}\mkern 0.1mu}$ pairs collected at the $\Upsilon (4S)$ resonance with the Belle detector at the KEKB asymmetric-energy $e^+ e^-$ collider. The obtained mixing-induced and direct $C\!P$ asymmetries are $-0.71 \pm 0.23~{\rm(stat)} \pm 0.05~{\rm(syst)}$ and $0.12 \pm 0.16~{\rm(stat)} \pm 0.05~{\rm(syst)}$, respectively. These values are consistent with the Standard Model predictions. The significance of $C\!P$ violation differs from zero by 2.5 standard deviations.


title: CaCL: Class-aware Codebook Learning for Weakly Supervised Segmentation on Diffuse Image Patterns

abstract: Weakly supervised learning has been rapidly advanced in biomedical image analysis to achieve pixel-wise labels (segmentation) from image-wise annotations (classification), as biomedical images naturally contain image-wise labels in many scenarios. The current weakly supervised learning algorithms from the computer vision community are largely designed for focal objects (e.g., dogs and cats). However, such algorithms are not optimized for diffuse patterns in biomedical imaging (e.g., stains and fluorescence in microscopy imaging). In this paper, we propose a novel class-aware codebook learning (CaCL) algorithm to perform weakly supervised learning for diffuse image patterns. Specifically, the CaCL algorithm is deployed to segment protein expressed brush border regions from histological images of human duodenum. Our contribution is three-fold: (1) we approach the weakly supervised segmentation from a novel codebook learning perspective; (2) the CaCL algorithm segments diffuse image patterns rather than focal objects; and (3) the proposed algorithm is implemented in a multi-task framework based on Vector Quantised-Variational AutoEncoder (VQ-VAE) via joint image reconstruction, classification, feature embedding, and segmentation. The experimental results show that our method achieved superior performance compared with baseline weakly supervised algorithms. The code is available at https://github.com/ddrrnn123/CaCL.


title: NGC 5474 X-1: a neutron star ULX in an old stellar cluster?

abstract: We present the optical and X-ray study of the ultraluminous X-ray source (ULX) NGC 5474 X-1. The X-ray spectrum taken during the bright state of the source ($L_X \sim 2\times10^{40}$ egs/s) shows signatures of a broad absorption line at $\simeq 8$ keV which may be a cyclotron resonant scattering feature. This implies that this system may host a neutron star with a magnetic field $\sim 10^{12}$ G. The first observation of this area with the Hubble Space Telescope (HST) carried out 14 months later revealed that the source was bright in the optical range as well. The subsequent observations have shown that the source faded in both ranges (more than $2.8^m$ in the U band and by a factor of 50-100 in X-rays) and has never become bright again. Deeper HST observations made it possible to impose constraints on the donor star spectral class and mass ($<\,7$ M$_\odot$), as well as to identify a stellar cluster of about 1 Gyr, the centre of which is located at a projected distance of $\simeq 2$ pc from NGC 5474 X-1. The ULX can be a member of this old cluster, however, the presence of stars with ages of $\sim10$ Myr within 300 pc around the ULX does not completely exclude the possibility that it is just an accidental projection.


title: Time-scale dependence of solar wind-based regression models of ionospheric electrodynamics

abstract: The solar wind influence on geospace can be described as the sum of a directly driven component, or dayside reconnection, and an unloading component, associated with the release of magnetic energy via nightside reconnection. The two processes are poorly correlated on short time scales, but exactly equal when averaged over long time windows. Because of this peculiar property, regression models of ionospheric electrodynamics that are based on solar wind data are time scale specific: Models derived from 1 min resolution data will be different from models derived from hourly, daily, or monthly data. We explain and quantify this effect on simple linear regression models of various geomagnetic indices. We also derive a time scale-dependent correction factor that can be used with the Average Magnetic field and Polar current System model. Finally, we show how absolute estimates of the nightside reconnection rate can be calculated from solar wind measurements and geomagnetic indices.


title: Context Dependent Semantic Parsing: A Survey

abstract: Semantic parsing is the task of translating natural language utterances into machine-readable meaning representations. Currently, most semantic parsing methods are not able to utilize contextual information (e.g. dialogue and comments history), which has a great potential to boost semantic parsing performance. To address this issue, context dependent semantic parsing has recently drawn a lot of attention. In this survey, we investigate progress on the methods for the context dependent semantic parsing, together with the current datasets and tasks. We then point out open problems and challenges for future research in this area. The collected resources for this topic are available at:https://github.com/zhuang-li/Contextual-Semantic-Parsing-Paper-List.


title: Existence and non-existence for time-dependent mean field games with strong aggregation

abstract: We investigate the existence of classical solutions to second-order quadratic Mean-Field Games systems with local and strongly decreasing couplings of the form $-\sigma m^\alpha$, $\alpha \ge 2/N$, where $m$ is the population density and $N$ is the dimension of the state space. We prove the existence of solutions under the assumption that $\sigma$ is small enough. For large $\sigma$, we show that existence may fail whenever the time horizon $T$ is large.


title: On Ricci curvature of metric structures on $\mathfrak{g}$-manifolds

abstract: We study the properties of Ricci curvature of ${\mathfrak{g}}$-manifolds with particular attention paid to higher dimensional abelian Lie algebra case. The relations between Ricci curvature of the manifold and the Ricci curvature of the transverse manifold of the characteristic foliation are investigated. In particular, sufficient conditions are found under which the ${\mathfrak{g}}$-manifold can be a Ricci soliton or a gradient Ricci soliton. Finally, we obtain a amazing (non-existence) higher dimensional generalization of the Boyer-Galicki theorem on Einstein K-manifolds for a special class of abelian ${\mathfrak{g}}$-manifolds.


title: Real-to-Sim Registration of Deformable Soft Tissue with Position-Based Dynamics for Surgical Robot Autonomy

abstract: Autonomy in robotic surgery is very challenging in unstructured environments, especially when interacting with deformable soft tissues. The main difficulty is to generate model-based control methods that account for deformation dynamics during tissue manipulation. Previous works in vision-based perception can capture the geometric changes within the scene, however, model-based controllers integrated with dynamic properties, a more accurate and safe approach, has not been studied before. Considering the mechanic coupling between the robot and the environment, it is crucial to develop a registered, simulated dynamical model. In this work, we propose an online, continuous, real-to-sim registration method to bridge 3D visual perception with position-based dynamics (PBD) modeling of tissues. The PBD method is employed to simulate soft tissue dynamics as well as rigid tool interactions for model-based control. Meanwhile, a vision-based strategy is used to generate 3D reconstructed point cloud surfaces based on real-world manipulation, so as to register and update the simulation. To verify this real-to-sim approach, tissue experiments have been conducted on the da Vinci Research Kit. Our real-to-sim approach successfully reduces registration error online, which is especially important for safety during autonomous control. Moreover, it achieves higher accuracy in occluded areas than fusion-based reconstruction.


title: Sound Event Detection and Separation: a Benchmark on Desed Synthetic Soundscapes

abstract: We propose a benchmark of state-of-the-art sound event detection systems (SED). We designed synthetic evaluation sets to focus on specific sound event detection challenges. We analyze the performance of the submissions to DCASE 2021 task 4 depending on time related modifications (time position of an event and length of clips) and we study the impact of non-target sound events and reverberation. We show that the localization in time of sound events is still a problem for SED systems. We also show that reverberation and non-target sound events are severely degrading the performance of the SED systems. In the latter case, sound separation seems like a promising solution.


title: Hierarchical Bi-Directional Self-Attention Networks for Paper Review Rating Recommendation

abstract: Review rating prediction of text reviews is a rapidly growing technology with a wide range of applications in natural language processing. However, most existing methods either use hand-crafted features or learn features using deep learning with simple text corpus as input for review rating prediction, ignoring the hierarchies among data. In this paper, we propose a Hierarchical bi-directional self-attention Network framework (HabNet) for paper review rating prediction and recommendation, which can serve as an effective decision-making tool for the academic paper review process. Specifically, we leverage the hierarchical structure of the paper reviews with three levels of encoders: sentence encoder (level one), intra-review encoder (level two) and inter-review encoder (level three). Each encoder first derives contextual representation of each level, then generates a higher-level representation, and after the learning process, we are able to identify useful predictors to make the final acceptance decision, as well as to help discover the inconsistency between numerical review ratings and text sentiment conveyed by reviewers. Furthermore, we introduce two new metrics to evaluate models in data imbalance situations. Extensive experiments on a publicly available dataset (PeerRead) and our own collected dataset (OpenReview) demonstrate the superiority of the proposed approach compared with state-of-the-art methods.


title: What's All the FUSS About Free Universal Sound Separation Data?

abstract: We introduce the Free Universal Sound Separation (FUSS) dataset, a new corpus for experiments in separating mixtures of an unknown number of sounds from an open domain of sound types. The dataset consists of 23 hours of single-source audio data drawn from 357 classes, which are used to create mixtures of one to four sources. To simulate reverberation, an acoustic room simulator is used to generate impulse responses of box shaped rooms with frequency-dependent reflective walls. Additional open-source data augmentation tools are also provided to produce new mixtures with different combinations of sources and room simulations. Finally, we introduce an open-source baseline separation model, based on an improved time-domain convolutional network (TDCN++), that can separate a variable number of sources in a mixture. This model achieves 9.8 dB of scale-invariant signal-to-noise ratio improvement (SI-SNRi) on mixtures with two to four sources, while reconstructing single-source inputs with 35.5 dB absolute SI-SNR. We hope this dataset will lower the barrier to new research and allow for fast iteration and application of novel techniques from other machine learning domains to the sound separation challenge.


title: Ground states for 3D dipolar Bose-Einstein condensate involving quantum fluctuations and three-body losses

abstract: We consider ground states of three-dimensional dipolar Bose-Einstein condensate involving quantum fluctuations and three-body losses, which can be described equivalently by positive $L^2$-constraint critical point of the Gross-Pitaevskii energy functional \[E(u)\!=\!\frac{1}{2}\int_{{\mathbb{R}^3}} {|\nabla u|}^2dx+\frac{\lambda_{1}}{2}\int_{{\mathbb{R}^3}} {| u|}^4dx+\frac{\lambda_{2}}{2} \int_{\mathbb{R}^{3}}\left(K \star|u|^{2}\right)|u|^{2} d x+\frac{2\lambda_{3}}{p}\int_{{\mathbb{R}^3}} {|u|}^{p}dx,\] where $2<p<\frac{10}{3}$, $\lambda_{3}<0$, $\star$ is the convolution, $ K(x) \!=\! \frac{{1-3{{\cos }^2}\theta(x) }}{{{{| x |}^3}}}$, $\theta(x)$ is the angle between the dipole axis determined by $(0,0,1)$ and the vector $x$. If ${\lambda _1} \!\!<\!\! \frac{4\pi} {3} {\lambda _2}\!\leq\! 0$ or ${\lambda _1} \!\!<\!- \frac{8\pi}{3} {\lambda _2}\!\leq\! 0$, $E(u)$ is unbounded on the $L^2$-sphere $S_{c}\!:=\!\Big\{ u \!\in\! H^1({\mathbb{R}^3}): \int_{{\mathbb{R}^3}} {{|u|}^2}dx\!=\!c^2 \Big\}$, so we turn to study a local minimization problem $$ m(c,R_0)\!:=\!\inf _{u \in V^c_{R_0}} E(u)$$ for a suitable $R_0\!>\!0$ with $V^c_{R_0} \!:=\!\left\{u \!\in\! S_c : \big(\int_{{\mathbb{R}^3}} {{|\nabla u|}^2dx}\big)^{\frac{1}{2}} \!<\!R_0\right\}$. We show that $m(c,R_0)$ is achieved by some $u_c>0$, which is a stable ground state. Furthermore, by refining the upper bound of $m(c, R_0)$, we provide a precise description of the asymptotic behavior of $u_c$ as the mass $c$ vanishes, i.e. $${[\frac{{p|{\lambda _3}|}}{{2{\gamma _c}}}]^{\frac{1}{{p - 2}}}}{u_c}(\frac{{x + {y_c}}}{{\sqrt {2{\delta _p}{\gamma _c}} }}) \to {W_p}\;\;\;\;{\rm{in}}\;\;\;\;{H^1}({\mathbb{R}^3})\;\;\;\;{\rm{for some}}\;\;\;\;{y_c} \in {\mathbb{R}^3}\;\;\;\;{\rm{as}}\;\;\;\;c \to {0^ + }.$$


title: Minimally modified gravity with an auxiliary constraint: a Hamiltonian construction

abstract: Working directly with a general Hamiltonian for the spacetime metric with the $3+1$ decomposition and keeping only the spatial covariance, we investigate the possibility of reducing the number of degrees of freedom by introducing an auxiliary constraint. The auxiliary constraint is considered as part of the definition of the theory. Through a general Hamiltonian analysis, we find the conditions for the Hamiltonian as well as for the auxiliary constraint, under which the theory propagates two tensorial degrees of freedom only. The class of theories satisfying these conditions can be viewed as a new construction for the type-II minimally modified gravity theories, which propagate the same degrees of freedom of but are not equivalent to general relativity in the vacuum. We also illustrate our formalism by a concrete example, and derive the dispersion relation for the gravitational waves, which can be constrained by observations.


title: Search-based Kinodynamic Motion Planning for Omnidirectional Quadruped Robots

abstract: Autonomous navigation has played an increasingly significant role in quadruped robot system. However, most existing works on quadruped robots navigation using traditional search-based or sample-based methods do not consider the kinodynamic characteristics of quadruped robots, generating kinodynamically infeasible parts, that are difficult to track. In this paper, we introduce a complete navigation system considering the omnidirectional abilities of quadruped robots. First, we use kinodynamic path finding method to obtain smooth, dynamically feasible, time-optimal initial paths and add collision cost as a soft constraint to ensure safety. Then the trajectory is refined by the timed elastic band (TEB) method based on the omnidirectional model of quadruped robots. The superior performance of our work is demonstrated through simulating and real-world experiments on our quadruped robot Jueying Mini.


title: Non-squareness and local uniform non-squareness properties of Orlicz-Lorentz function spaces endowed with the Orlicz norm

abstract: In this paper the necessary and sufficient conditions were given for Orlicz-Lorentz function space endowed with the Orlicz norm having non-squareness and local uniform non-squareness.


title: Entropic uncertainty relations for SIC-POVMs and MUMs

abstract: We construct inequalities between R\'{e}nyi entropy and the indexes of coincidence of probability distributions, based on which we obtain improved state-dependent entropic uncertainty relations for general symmetric informationally complete positive operator-valued measures (SIC-POVM) and mutually unbiased measurements (MUM) on finite dimensional systems. We show that our uncertainty relations for general SIC-POVMs and MUMs can be tight for sufficiently mixed states, and moreover, comparisons to the numerically optimal results are made via information diagrams.


title: Data-free Knowledge Distillation for Segmentation using Data-Enriching GAN

abstract: Distilling knowledge from huge pre-trained networks to improve the performance of tiny networks has favored deep learning models to be used in many real-time and mobile applications. Several approaches that demonstrate success in this field have made use of the true training dataset to extract relevant knowledge. In absence of the True dataset, however, extracting knowledge from deep networks is still a challenge. Recent works on data-free knowledge distillation demonstrate such techniques on classification tasks. To this end, we explore the task of data-free knowledge distillation for segmentation tasks. First, we identify several challenges specific to segmentation. We make use of the DeGAN training framework to propose a novel loss function for enforcing diversity in a setting where a few classes are underrepresented. Further, we explore a new training framework for performing knowledge distillation in a data-free setting. We get an improvement of 6.93% in Mean IoU over previous approaches.


title: Aggregating Incomplete and Noisy Rankings

abstract: We consider the problem of learning the true ordering of a set of alternatives from largely incomplete and noisy rankings. We introduce a natural generalization of both the classical Mallows model of ranking distributions and the extensively studied model of noisy pairwise comparisons. Our selective Mallows model outputs a noisy ranking on any given subset of alternatives, based on an underlying Mallows distribution. Assuming a sequence of subsets where each pair of alternatives appears frequently enough, we obtain strong asymptotically tight upper and lower bounds on the sample complexity of learning the underlying complete ranking and the (identities and the) ranking of the top-k alternatives from selective Mallows rankings. Moreover, building on the work of (Braverman and Mossel, 2009), we show how to efficiently compute the maximum likelihood complete ranking from selective Mallows rankings.


title: A network-ready random-access qubits memory

abstract: Photonic qubits memories are essential ingredients of numerous quantum networking protocols. The ideal situation features quantum computing nodes that are efficiently connected to quantum communication channels via quantum interfaces. The nodes contain a set of long-lived matter qubits, the channels support the propagation of light qubits, and the interface couples light and matter qubits. Towards this vision, we here demonstrate a random-access multi-qubit write-read memory for photons using two rubidium atoms coupled to the same mode of an optical cavity, a setup which is known to feature quantum computing capabilities. We test the memory with more than ten independent photonic qubits, observe no noticeable cross talk, and find no need for re-initialization even after ten write-read attempts. The combined write-read efficiency is 26% and the coherence time approaches 1ms. With these features, the node constitutes a promising building block for a quantum repeater and ultimately a quantum internet.


title: Mpemba effect in inertial suspensions

abstract: The Mpemba effect (a counterintuitive thermal relaxation process where an initially hotter system may cool down to the steady state sooner than an initially colder system) is studied in terms of a model of inertial suspensions under shear. The relaxation to a common steady state of a suspension initially prepared in a quasi-equilibrium state is compared with that of a suspension initially prepared in a nonequilibrium sheared state. Two classes of Mpemba effect are identified, the normal and the anomalous one. The former is generic, in the sense that the kinetic temperature starting from a cold nonequilibrium sheared state is overtaken by the one starting from a hot quasi-equilibrium state, due to the absence of initial viscous heating in the latter, resulting in a faster initial cooling. The anomalous Mpemba effect is opposite to the normal one since, despite the initial slower cooling of the nonequilibrium sheared state, it can eventually overtake an initially colder quasi-equilibrium state. The theoretical results based on kinetic theory agree with those obtained from event-driven simulations for inelastic hard spheres. It is also confirmed the existence of the inverse Mpemba effect, which is a peculiar heating process, in these suspensions. More particularly, we find the existence of a mixed process in which both heating and cooling can be observed during relaxation.


title: Multi-Armed Bandits with Censored Consumption of Resources

abstract: We consider a resource-aware variant of the classical multi-armed bandit problem: In each round, the learner selects an arm and determines a resource limit. It then observes a corresponding (random) reward, provided the (random) amount of consumed resources remains below the limit. Otherwise, the observation is censored, i.e., no reward is obtained. For this problem setting, we introduce a measure of regret, which incorporates the actual amount of allocated resources of each learning round as well as the optimality of realizable rewards. Thus, to minimize regret, the learner needs to set a resource limit and choose an arm in such a way that the chance to realize a high reward within the predefined resource limit is high, while the resource limit itself should be kept as low as possible. We propose a UCB-inspired online learning algorithm, which we analyze theoretically in terms of its regret upper bound. In a simulation study, we show that our learning algorithm outperforms straightforward extensions of standard multi-armed bandit algorithms.


title: Numerical simulation of two-phase incompressible viscous flows using general pressure equation

abstract: The general pressure equation (GPE) is a new method proposed recently by Toutant (J. Comput. Phys., 374:822-842 (2018)) for incompressible flow simulation. It circumvents the Poisson equation for the pressure and performs better than the classical artificial compressibility method. Here it is generalized for two-phase incompressible viscous flows with variable density and viscosity. First, the pressure evolution equation is modified to account for the density variation. Second, customized discretizations are proposed to deal with the viscous stress terms with variable viscosity. Besides, additional terms related to the bulk viscosity are included to stabilize the simulation. The interface evolution and surface tension effects are handled by a phase-field model coupled with the GPE-based flow equations. The pressure and momentum equations are discretized on a stagger grid using the second order centered scheme and marched in time using the third order total variation diminishing Runge-Kutta scheme. Several unsteady two-phase problems in two dimensional, axisymmetric and three dimensional geometries at intermediate density and viscosity ratios were simulated and the results agreed well with those obtained by other incompressible solvers and/or the lattice-Boltzmann method (LBM) simulations. Similar to the LBM, the proposed GPE-based method is fully explicit and easy to be parallelized. Although slower than the LBM, it requires much less memory than the LBM. Thus, it can be a good alternative to simulate two-phase flows with limited memory resource.


title: On unitriangular basic sets for symmetric and alternating groups

abstract: We study the modular representation theory of the symmetric and alternating groups. One of the most natural ways to label the irreducible representations of a given group or algebra in the modular case is to show the unitriangularity of the decomposition matrices, that is, the existence of a unitriangular basic set. We study several ways to obtain such sets in the general case of a symmetric algebra. We apply our results to the symmetric groups and to their Hecke algebras and thus obtain new ways to label the simple modules for these objects. Finally, we show that these sets do not always exist in the case of the alternating groups by studying two explicit cases in characteristic 3.


title: Constraints on Ho\v{r}ava-Lifshitz gravity from GRB 170817A

abstract: In this work we focus on a toy model: (3+1)-dimensional Ho\v{r}ava-Lifshitz gravity coupling with an anisotropic electromagnetic (EM) field which is generated through a Kaluza-Klein reduction of a (4+1)-dimensional Ho\v{r}ava-Lifshitz gravity. This model exhibits a remarkable feature that it has the same velocity for both gravitational and electromagnetic waves. This feature makes it possible to restrict the parameters of the theory from GRB 170817A. In this work we use this feature to discuss possible constraints on the parameter $\beta$ in the theory, by analyzing the possible Lorentz invariance violation effect of the GRB 170817A. This is achieved by analyzing potential time delay of gamma-ray photons in this event. It turns out that it places a stringent constraint on this parameter. In the most ideal case, it gives $|1-\sqrt{\beta}|<(10^{-19}-10^{-18})$.


title: Generalized Load Balancing and Clustering Problems with Norm Minimization

abstract: In many fundamental combinatorial optimization problems, a feasible solution induces some real cost vectors as an intermediate result, and the optimization objective is a certain function of the vectors. For example, in the problem of makespan minimization on unrelated parallel machines, a feasible job assignment induces a vector containing the sizes of assigned jobs for each machine, and the goal is to minimize the $L_\infty$ norm of $L_1$ norms of the vectors. Another example is fault-tolerant $k$-center, where each client is connected to multiple open facilities, thus having a vector of distances to these facilities, and the goal is to minimize the $L_\infty$ norm of $L_\infty$ norms of these vectors. In this paper, we study the maximum of norm problem. Given an arbitrary symmetric monotone norm $f$, the objective is defined as the maximum ($L_\infty$ norm) of $f$-norm values of the induced cost vectors. This versatile formulation captures a wide variety of problems, including makespan minimization, fault-tolerant $k$-center and many others. We give concrete results for load balancing on unrelated parallel machines and clustering problems, including constant-factor approximation algorithms when $f$ belongs with a certain rich family of norms, and $O(\log n)$-approximations when $f$ is general and satisfies some mild assumptions. We also consider the aforementioned problems in a generalized fairness setting. As a concrete example, the insight is to prevent a scheduling algorithm from assigning too many jobs consistently on any machine in a job-recurring scenario, and causing the machine's controller to fail. Our algorithm needs to stochastically output a feasible solution minimizing the objective function, and satisfy the given marginal fairness constraints.


title: Low temperature carrier transport mechanism and photoconductivity of WSe2

abstract: This work reports the electrical transport and temperature-dependent photoconductivity in tungsten diselenide (WSe2) thin films. The electrical conductivity analysis shows the presence of the three regions with temperature variation. At lower temperatures (<190K), carriers become localized to small regions in the film due to the Mott hopping mechanism. The middle region (190 to 273 K) follows Seto parameters and obtained low barrier height (0.0873 eV) may be responsible for the improved carrier mobility. At higher temperature (>273K) region, thermally activated conduction is dominated with two activation energies of ~138 meV and 98 meV. The peaks obtained in photoluminescent analysis attributes to the presence of mid-bandgap states or defect states which play an important role in the photoconductivity of WSe2. The transient photoconductivity measurements show consistent temperature-dependent behaviour. The effect of light intensity and wavelength variation on the photoconductivity of WSe2 thin films is also discussed. The photocurrent is 1.19*10-5 A at 125 K while at 350 K it was observed to be 3.12*10-4 A. The light-on/off current cycles show that the current can recover to its initial state which points to the stable and outstanding reversible properties of the WSe2 thin film device to be used in photodetector applications.


title: Self-Concordant Analysis of Generalized Linear Bandits with Forgetting

abstract: Contextual sequential decision problems with categorical or numerical observations are ubiquitous and Generalized Linear Bandits (GLB) offer a solid theoretical framework to address them. In contrast to the case of linear bandits, existing algorithms for GLB have two drawbacks undermining their applicability. First, they rely on excessively pessimistic concentration bounds due to the non-linear nature of the model. Second, they require either non-convex projection steps or burn-in phases to enforce boundedness of the estimators. Both of these issues are worsened when considering non-stationary models, in which the GLB parameter may vary with time. In this work, we focus on self-concordant GLB (which include logistic and Poisson regression) with forgetting achieved either by the use of a sliding window or exponential weights. We propose a novel confidence-based algorithm for the maximum-likehood estimator with forgetting and analyze its perfomance in abruptly changing environments. These results as well as the accompanying numerical simulations highlight the potential of the proposed approach to address non-stationarity in GLB.


title: Second-order accurate BGK schemes for the special relativistic hydrodynamics with the Synge equation of state

abstract: This paper extends the second-order accurate BGK finite volume schemes for the ultra-relativistic flow simulations [5] to the 1D and 2D special relativistic hydrodynamics with the Synge equation of state. It is shown that such 2D schemes are very time-consuming due to the moment integrals (triple integrals) so that they are no longer practical. In view of this, the simplified BGK (sBGK) schemes are presented by removing some terms in the approximate nonequilibrium distribution at the cell interface for the BGK scheme without loss of accuracy. They are practical because the moment integrals of the approximate distribution can be reduced to the single integrals by some coordinate transformations. The relations between the left and right states of the shock wave, rarefaction wave, and contact discontinuity are also discussed, so that the exact solution of the 1D Riemann problem could be derived and used for the numerical comparisons. Several numerical experiments are conducted to demonstrate that the proposed gas-kinetic schemes are accurate and stable. A comparison of the sBGK schemes with the BGK scheme in one dimension shows that the former performs almost the same as the latter in terms of the accuracy and resolution, but is much more efficiency.


title: Low-energy dipole excitation mode in $^{18}$O with antisymmetrized molecular dynamics

abstract: Low-energy dipole (LED) excitations in $^{18}$O were investigated using a combination of the variation after $K$-projection in the framework of antisymmetrized molecular dynamics with $\beta$-constraint with the generator coordinate method. We obtained two LED states, namely, the $1_1^-$ state with a dominant shell-model structure and the $1_2^-$ state with a large $^{14}\textrm{C}+\alpha$ cluster component. Both these states had significant toroidal dipole (TD) and compressive dipole (CD) strengths, indicating that the TD and CD modes are not separated but mixed in the LED excitations of $^{18}$O. This is unlike the CD and TD modes for well-deformed nuclei such as $^{10}$Be, where the CD and TD modes are generated as $K^{\pi}=0^-$ and $K^{\pi}=1^-$ excitations, respectively, in a largely deformed state.


title: Optimal transport between determinantal point processes and application to fast simulation

abstract: We analyze several optimal transportation problems between de-terminantal point processes. We show how to estimate some of the distances between distributions of DPP they induce. We then apply these results to evaluate the accuracy of a new and fast DPP simulation algorithm. We can now simulate in a reasonable amount of time more than ten thousands points.


title: Near-on-Demand Mobility. The Benefits of User Flexibility for Ride-Pooling Services

abstract: Mobility-On-Demand (MoD) services have been transforming the urban mobility ecosystem. However, they raise a lot of concerns for their impact on congestion, Vehicle Miles Travelled (VMT), and competition with transit. There are also questions about their long-term survival because of inherent inefficiencies in their operations. Considering the popularity of the MoD services, increasing ride-pooling is an important means to address these concerns. Shareability depends not only on riders attitudes and preferences but also on operating models deployed by providers. The paper introduces an advance requests operating model for ride pooling where users may request rides at least H minutes in advance of their desired departure times. A platform with efficient algorithms for request matching, vehicle routing, rebalancing, and flexible user preferences is developed. A large-scale transportation network company dataset is used to evaluate the performance of the advance requests system relative to current practices. The impacts of various design aspects of the system (advance requests horizon, vehicle capacity) on its performance are investigated. The sensitivity of the results to user preferences in terms of the level of service (time to be served and excess trip time), willingness to share and place requests in advance, and traffic conditions are explored. The results suggest that significant benefits in terms of sustainability, level of service, and fleet utilization can be realized when advance requests are along with an increased willingness to share. Furthermore, even near-on-demand (relative short advance planning horizons) operations can offer many benefits for all stakeholders involved (passengers, operators, and cities).


title: Complexity of near-optimal robust versions of multilevel optimization problems

abstract: Near-optimality robustness extends multilevel optimization with a limited deviation of a lower level from its optimal solution, anticipated by higher levels. We analyze the complexity of near-optimal robust multilevel problems, where near-optimal robustness is modelled through additional adversarial decision-makers. Near-optimal robust versions of multilevel problems are shown to remain in the same complexity class as the problem without near-optimality robustness under general conditions.


title: Reinforcement Learning with Efficient Active Feature Acquisition

abstract: Solving real-life sequential decision making problems under partial observability involves an exploration-exploitation problem. To be successful, an agent needs to efficiently gather valuable information about the state of the world for making rewarding decisions. However, in real-life, acquiring valuable information is often highly costly, e.g., in the medical domain, information acquisition might correspond to performing a medical test on a patient. This poses a significant challenge for the agent to perform optimally for the task while reducing the cost for information acquisition. In this paper, we propose a model-based reinforcement learning framework that learns an active feature acquisition policy to solve the exploration-exploitation problem during its execution. Key to the success is a novel sequential variational auto-encoder that learns high-quality representations from partially observed states, which are then used by the policy to maximize the task reward in a cost efficient manner. We demonstrate the efficacy of our proposed framework in a control domain as well as using a medical simulator. In both tasks, our proposed method outperforms conventional baselines and results in policies with greater cost efficiency.


title: PV-NAS: Practical Neural Architecture Search for Video Recognition

abstract: Recently, deep learning has been utilized to solve video recognition problem due to its prominent representation ability. Deep neural networks for video tasks is highly customized and the design of such networks requires domain experts and costly trial and error tests. Recent advance in network architecture search has boosted the image recognition performance in a large margin. However, automatic designing of video recognition network is less explored. In this study, we propose a practical solution, namely Practical Video Neural Architecture Search (PV-NAS).Our PV-NAS can efficiently search across tremendous large scale of architectures in a novel spatial-temporal network search space using the gradient based search methods. To avoid sticking into sub-optimal solutions, we propose a novel learning rate scheduler to encourage sufficient network diversity of the searched models. Extensive empirical evaluations show that the proposed PV-NAS achieves state-of-the-art performance with much fewer computational resources. 1) Within light-weight models, our PV-NAS-L achieves 78.7% and 62.5% Top-1 accuracy on Kinetics-400 and Something-Something V2, which are better than previous state-of-the-art methods (i.e., TSM) with a large margin (4.6% and 3.4% on each dataset, respectively), and 2) among median-weight models, our PV-NAS-M achieves the best performance (also a new record)in the Something-Something V2 dataset.


title: Rounding Error Analysis of Linear Recurrences Using Generating Series

abstract: We develop a toolbox for the error analysis of linear recurrences with constant or polynomial coefficients, based on generating series, Cauchy's method of majorants, and simple results from analytic combinatorics. We illustrate the power of the approach by several nontrivial application examples. Among these examples are a new worst-case analysis of an algorithm for computing Bernoulli numbers, and a new algorithm for evaluating differentially finite functions in interval arithmetic while avoiding interval blow-up.


title: Millimeter-Wave Antenna Array Diagnosis with Partial Channel State Information

abstract: Large antenna arrays enable directional precoding for Millimeter-Wave (mmWave) systems and provide sufficient link budget to combat the high path-loss at these frequencies. Due to atmospheric conditions and hardware malfunction, outdoor mmWave antenna arrays are prone to blockages or complete failures. This results in a modified array geometry, distorted far-field radiation pattern, and system performance degradation. Recent remote array diagnostic techniques have emerged as an effective way to detect defective antenna elements in an array with few diagnostic measurements. These techniques, however, require full and perfect channel state information (CSI), which can be challenging to acquire in the presence of antenna faults. This paper proposes a new remote array diagnosis technique that relaxes the need for full CSI and only requires knowledge of the incident angle-of-arrivals, i.e. partial channel knowledge. Numerical results demonstrate the effectiveness of the proposed technique and show that fault detection can be obtained with comparable number of diagnostic measurements required by diagnostic techniques based on full channel knowledge. In presence of channel estimation errors, the proposed technique is shown to out-perform recently proposed array diagnostic techniques.


title: A Generic Trauma Severity Computer Method Applied to Pedestrian Collisions

abstract: In the real world, the severity of traumatic injuries are measured using the Abbreviated Injury Scale (AIS). However the AIS scale cannot currently be computed by using finite element human computer models, which calculate a maximum principal strains (MPS). Further, MPS only establishes a threshold above which a serious or fatal injury occurs. In order to overcome these limitations, a unique Organ Trauma Model (OTM) able to calculate the threat to life of any organ injury is proposed. The focus, in this case is on real world pedestrian brain injuries. The OTM uses a power method, named Peak Virtual Power (PVP), and defines brain white and grey matters trauma responses as a function of impact location and impact speed extracted from the pedestrian collision kinematics. This research has included ageing in the injury severity computation by including soft tissue material degradation, as well as brain volume changes. Further, to account for the limitations of the Lagrangian formulation of the brain model in representing haemorrhage, an approach to include the effects of subdural hematoma is proposed and included as part of the OTM predictions in this study. The OTM model was tested against three real-life pedestrian accidents and has proven to reasonably predict the Post Mortem (PM) outcome. Its AIS predictions are closer to the real world injury severity than standard MPS methods currently recommended. This study suggests that the OTM has the potential to improve forensic predictions as well as contribute to the improvement in vehicle safety design through the ability to measure injury severity. This study concludes that future advances in trauma computing would require the development of a brain model which could predict haemorrhaging.