title: The compactness of minimizing sequences for a nonlinear Schr\"odinger system with potentials

abstract: In this paper, we consider the following minimizing problem with two constraints: \[ \inf \left\{ E(u) | u=(u_1,u_2), \ \| u_1 \|_{L^2}^2 = \alpha_1, \ \| u_2 \|_{L^2}^2 = \alpha_2 \right\}, \] where $\alpha_1,\alpha_2 > 0$ and $E(u)$ is defined by \[ E(u) := \int_{\mathbf{R}^N} \left\{\frac{1}{2} \sum_{i=1}^2 \left( |\nabla u_1|^2 + V_i (x) |u_i|^2 \right) - \sum_{i=1}^2 \frac{\mu_i}{2p_i+2} |u_i|^{2p_i+2} - \frac{\beta}{p_3+1} |u_1|^{p_3+1} |u_2|^{p_3+1} \right\} \mathrm{d} x. \] Here $N \geq 1$, $ \mu_1,\mu_2,\beta > 0$ and $V_i(x)$ $(i=1,2)$ are given functions. For $V_i(x)$, we consider two cases: (i) both of $V_1$ and $V_2$ are bounded, (ii) one of $V_1$ and $V_2$ is bounded. Under some assumptions on $V_i$ and $p_j$, we discuss the compactness of any minimizing sequence.


title: Development and Application of QM/MM Methods with Advanced Polarizable Potentials

abstract: Quantum Mechanics/Molecular Mechanics (QM/MM) simulations are a popular approach to study various features of large systems. A common application of QM/MM calculations is in the investigation of reaction mechanisms in condensed-phase and biological systems. The combination of QM and MM methods to represent a system gives rise to several challenges that need to be addressed. The increase in computational speed has allowed the expanded use of more complicated and accurate methods for both QM and MM simulations. Here, we review some approaches that address several common challenges encountered in QM/MM simulations with advanced polarizable potentials, from methods to account for boundary across covalent bonds and long-range effects, to polarization and advanced embedding potentials.


title: Spectrality of generalized Sierpinski-type self-affine measures

abstract: For an expanding integer matrix $M\in M_2(\mathbb{Z})$ and an integer digit set $D=\{(0,0)^t,(\alpha_1,\alpha_2)^t,(\beta_1,\beta_2)^t\}$ with $\alpha_1\beta_2-\alpha_2\beta_1\neq0$, let $\mu_{M,D}$ be the Sierpinski-type self-affine measure defined by $\mu_{M,D}(\cdot)=\frac{1}{3}\sum_{d\in D}\mu_{M,D}(M(\cdot)-d)$. In [5.36], the authors separately investigated the spectral property of the measure $\mu_{M,D}$ in the case of $\det(M)\notin 3\mathbb{Z}$ or $\alpha_1\beta_2-\alpha_2\beta_1\notin 3\mathbb{Z}$. In this paper, we consider the remaining case where $\det(M)\in 3\mathbb{Z}$ and $\alpha_1\beta_2-\alpha_2\beta_1\in 3\mathbb{Z}$, and give the necessary and sufficient conditions for $\mu_{M,D}$ to be a spectral measure. This completely settles the spectrality of the Sierpinski-type self-affine measure $\mu_{M,D}$.


title: CASS-NAT: CTC Alignment-based Single Step Non-autoregressive Transformer for Speech Recognition

abstract: We propose a CTC alignment-based single step non-autoregressive transformer (CASS-NAT) for speech recognition. Specifically, the CTC alignment contains the information of (a) the number of tokens for decoder input, and (b) the time span of acoustics for each token. The information are used to extract acoustic representation for each token in parallel, referred to as token-level acoustic embedding which substitutes the word embedding in autoregressive transformer (AT) to achieve parallel generation in decoder. During inference, an error-based alignment sampling method is proposed to be applied to the CTC output space, reducing the WER and retaining the parallelism as well. Experimental results show that the proposed method achieves WERs of 3.8%/9.1% on Librispeech test clean/other dataset without an external LM, and a CER of 5.8% on Aishell1 Mandarin corpus, respectively1. Compared to the AT baseline, the CASS-NAT has a performance reduction on WER, but is 51.2x faster in terms of RTF. When decoding with an oracle CTC alignment, the lower bound of WER without LM reaches 2.3% on the test-clean set, indicating the potential of the proposed method.


title: Mean Li-Yorke chaos along polynomials of several variables and prime numbers

abstract: In this paper, for any given polynomial, by analyzing the limiting behavior of ergodic averages along polynomials of several variables and prime numbers, we prove that for a topology dynamical system, positive entropy implies mean Li-Yoke chaos along non-constant polynomials of several variables and prime numbers.


title: Floquet Cavity Electromagnonics

abstract: Hybrid magnonics has recently attracted intensive attentions as a promising platform for coherent information processing. In spite of its rapid development, on-demand control over the interaction of magnons with other information carriers, in particular microwave photons in electromagnonic systems, has been long missing, significantly limiting the broad applications of hybrid magnonics. Here, we show that by introducing Floquet engineering into cavity electromagnonics, coherent control on the magnon-microwave photon coupling can be realized. Leveraging the periodic temporal modulation from a Floquet drive, our first-of-its-kind Floquet cavity electromagnonic system can manipulate the interaction between hybridized cavity electromagnonic modes on demand. Moreover, we demonstrate a new coupling regime in such systems: the Floquet ultrastrong coupling, where the Floquet splitting is comparable with or even larger than the level spacing of the two interacting modes, resulting in the breakdown of the rotating wave approximation. Our findings open up new directions for magnon-based coherent signal processing.


title: Non-local quark models for description of dense matter in the cores of neutron stars

abstract: This thesis work focuses on studying the possible existence of phase transitions in the immediate compact remnants of core collapse supernova, neutron stars, and the theoretical models that describe the interior of dense matter. Specifically, we are interested in analyzing the feasibility of a transition from hadronic matter to quark matter in the cores of these objects. For the phase transition we will use two different formalisms: the Maxwell formalism or abrupt phase transition and the Gibbs formalisms or mixed phase transition. For the description of hadronic matter, we will use different parametrizations of the relativistic mean field model with density-dependent coupling constants. For the description of quark matter we will use an effective nonlocal Nambu Jona-Lasinio model of three flavors with vector interactions, in which we will include the possibility of formation of diquarks to model a superconducting phase of color in $SU(3)$. Phase diagrams and equations of state of quark matter at finite temperature are presented, and the influence of that type of matter on observables associated with neutron stars is investigated. The simplified thermal evolution of compact stars during their formation is studied, from their state of proto-neutron stars to that of cold neutron stars, and the results obtained are compared with recent astrophysical observations. The results obtained indicate that the occurrence of quark matter in the nuclei of these stars remains a promising possibility. The fact that the use of more realistic models for the description of the dense matter in these objects indicates the presence of quark matter inside neutron stars, could be an answer to the question of the behavior of that kind of matter and the determination of its corresponding equation of state.


title: Ultradilute self-bound quantum droplets in Bose-Bose mixtures at finite temperature

abstract: We theoretically investigate the finite-temperature structure and collective excitations of a self-bound ultradilute Bose droplet in a flat space realized in a binary Bose mixture with attractive inter-species interactions on the verge of mean-field collapse. As the droplet formation relies critically on the repulsive force provided by Lee-Huang-Yang quantum fluctuations, which can be easily compensated by thermal fluctuations, we find a significant temperature effect in the density distribution and collective excitation spectrum of the Bose droplet. A finite-temperature phase diagram as a function of the number of particles is determined. We show that the critical number of particles at the droplet-to-gas transition increases dramatically with increasing temperature. Towards the bulk threshold temperature for thermally destabilizing an infinitely large droplet, we find that the excitation-forbidden, self-evaporation region in the excitation spectrum, predicted earlier by Petrov using a zero-temperature theory, shrinks and eventually disappears. All the collective excitations, including both surface modes and compressional bulk modes, become softened at the droplet-to-gas transition. The predicted temperature effects of a self-bound Bose droplet in this work could be difficult to measure experimentally due to the lack of efficient thermometry at low temperatures. However, these effects may already present in the current cold-atom experiments.


title: DisenE: Disentangling Knowledge Graph Embeddings

abstract: Knowledge graph embedding (KGE), aiming to embed entities and relations into low-dimensional vectors, has attracted wide attention recently. However, the existing research is mainly based on the black-box neural models, which makes it difficult to interpret the learned representation. In this paper, we introduce DisenE, an end-to-end framework to learn disentangled knowledge graph embeddings. Specially, we introduce an attention-based mechanism that enables the model to explicitly focus on relevant components of entity embeddings according to a given relation. Furthermore, we introduce two novel regularizers to encourage each component of the entity representation to independently reflect an isolated semantic aspect. Experimental results demonstrate that our proposed DisenE investigates a perspective to address the interpretability of KGE and is proved to be an effective way to improve the performance of link prediction tasks.


title: MultiMix: Sparingly Supervised, Extreme Multitask Learning From Medical Images

abstract: Semi-supervised learning via learning from limited quantities of labeled data has been investigated as an alternative to supervised counterparts. Maximizing knowledge gains from copious unlabeled data benefit semi-supervised learning settings. Moreover, learning multiple tasks within the same model further improves model generalizability. We propose a novel multitask learning model, namely MultiMix, which jointly learns disease classification and anatomical segmentation in a sparingly supervised manner, while preserving explainability through bridge saliency between the two tasks. Our extensive experimentation with varied quantities of labeled data in the training sets justify the effectiveness of our multitasking model for the classification of pneumonia and segmentation of lungs from chest X-ray images. Moreover, both in-domain and cross-domain evaluations across the tasks further showcase the potential of our model to adapt to challenging generalization scenarios.


title: Hubble parameter estimation via dark sirens with the LISA-Taiji network

abstract: The Hubble parameter is one of the central parameters in modern cosmology, which describes the present expansion rate of the universe. Their values inferred from the late-time observations are systematically higher than those from the early-time measurements by about $10\%$. To come to a robust conclusion, independent probes with accuracy at percent levels are crucial. Gravitational waves from compact binary coalescence events can be formulated into the standard siren approach to provide an independent Hubble parameter measurement. The future space-borne gravitational wave observatory network, such as the LISA-Taiji network, will be able to measure the gravitational wave signals in the Millihertz bands with unprecedented accuracy. By including several statistical and instrumental noises, we show that within 5 years operation time, the LISA-Taiji network is able to constrain the Hubble parameter within $1\%$ accuracy, and possibly beats the scatters down to $0.5\%$ or even better.


title: Joint Path and Push Planning Among Movable Obstacles

abstract: This paper explores the Navigation Among Movable Obstacles (NAMO) problem and proposes joint path and push planning: which path to take and in what direction the obstacles should be pushed at, given a start and goal position. We present a planning algorithm for selecting a path and the obstacles to be pushed, where a Rapidly-exploring Random Tree (RRT)-based heuristic is employed to calculate a minimal collision path. When it is necessary to apply a pushing force to slide an obstacle out of the way, the planners leverage means-end analysis through a dynamic physics simulation to determine the sequence of linear pushes to clear the necessary space. Simulation experiments show that our approach finds solutions in higher clutter percentages (up to 49%) compared to the straight-line push planner (37%) and RRT without pushing (18%).


title: Generalized eigen, singular value, and partial least squares decompositions: The GSVD package

abstract: The generalized singular value decomposition (GSVD, a.k.a. "SVD triplet", "duality diagram" approach) provides a unified strategy and basis to perform nearly all of the most common multivariate analyses (e.g., principal components, correspondence analysis, multidimensional scaling, canonical correlation, partial least squares). Though the GSVD is ubiquitous, powerful, and flexible, it has very few implementations. Here I introduce the GSVD package for R. The general goal of GSVD is to provide a small set of accessible functions to perform the GSVD and two other related decompositions (generalized eigenvalue decomposition, generalized partial least squares-singular value decomposition). Furthermore, GSVD helps provide a more unified conceptual approach and nomenclature to many techniques. I first introduce the concept of the GSVD, followed by a formal definition of the generalized decompositions. Next I provide some key decisions made during development, and then a number of examples of how to use GSVD to implement various statistical techniques. These examples also illustrate one of the goals of GSVD: how others can (or should) build analysis packages that depend on GSVD. Finally, I discuss the possible future of GSVD.


title: Encoding the information in relative parameters

abstract: We investigate the problem of communicating three parameters in the absence of shared reference frame. We explore two methods in which the relative angles of spins are used to encode the parameters. In the first method we use three spins that carry the information in their relative angles while in the second method we use three disjoint spin-pairs and the information is sent through the relative angles of each individual pair. We show that in the first method, the information conveyed by each qubit is more than the second one, and that is while it requires fewer particles.


title: Morita theorem for hereditary Calabi-Yau categories

abstract: We give a structure theorem for Calabi-Yau triangulated category with a hereditary cluster tilting object. We prove that an algebraic $d$-Calabi-Yau triangulated category with a $d$-cluster tilting object $T$ such that its shifted sum $T\oplus\cdots\oplus T[-(d-2)]$ has hereditary endomorphism algebra $H$ is triangle equivalent to the orbit category $\mathscr{D}^b(\mathrm{\mathop{mod}}\, H)/\tau^{-1/(d-1)}[1]$ of the derived category of $H$ for a naturally defined $(d-1)$-st root $\tau^{1/(d-1)}$ of the AR translation, provided $H$ is of non-Dynkin type. We also show that hereditaryness of $H$ follows from that of $T$ is when $d=3$, that of $T\oplus T[-1]$ when $d=4$, and similarly from a smaller endomorphism algebra for higher dimensions under vanishing of some negative self-extensions of $T$. Our result therefore generalizes the established theorems by Keller--Reiten and Keller--Murfet--Van den Bergh. Furthermore, we show that enhancements of such triangulated categories are unique. Finally we apply our results to Calabi-Yau reductions of a higher cluster category of a finite dimensional algebra and of the singularity category of an invariant subring.


title: A Herschel mapping of [C ii], [O i] and [O iii] lines from the circumnuclear region of M31

abstract: The circumnuclear region of M31, consisting of multiphase interstellar medium, provides a close-up view of the interaction of the central supermassive black hole and surrounding materials. Far-infrared (FIR) line structure lines and their flux ratios can be used as diagnostics of physical properties of the neutral gas in this region. Here we present the first FIR spectroscopic mapping of the circumnuclear region of M31 in [C ii] 158 um, [O i] 63 um and [O iii] 88 um lines with the Herschel Space Observatory, covering a ~500 x 500 pc (2' x 2') field. Significant emissions of all three lines are detected along the so-called nuclear spiral across the central kpc of M31. The velocity field under a spatial resolution of ~50 pc of the three lines are in broad consistency and also consistent with previous CO(3-2) line observations in the central region. Combined with existing [C ii] and CO(3-2) observations of five other fields targeting on the disk, we derived the radial distribution of [C ii]/CO(3-2) flux ratio, and found that this ratio is higher in the center than the disk, indicating a low gas density and strong radiation field in the central region. We also found that the [C ii]/FIR ratio in the central region is 5.4 (+-0.8) x 10^-3, which exhibits an increasing trend with the galactocentric radius, suggesting an increasing contribution from old stellar population to dust heating towards the center.


title: Effective Cross Section of Fuzzy Dark Matter Halos

abstract: We numerically study the movement of two colliding fuzzy dark matter solitons without explicit self-interaction and find the effective cross section of dissipative change in velocity. The cross section turns out to be inversely proportional to the velocity cubed, and we present its analytic interpretation. Using the result we roughly estimate spatial offsets during head-on collisions of two fuzzy dark matter halos, which can be related to the spatial offsets between stars and dark matter in collisions of some galaxy clusters. We also show that the gravitational cooling plays an important role during the collisions.


title: The Maxwell crossover and the van der Waals equation of state

abstract: The well-known Maxwell construction[1] (the equal-area rule, EAR) was devised for vapor liquid equilibrium (VLE) calculation with the van der Waals (vdW) equation of state (EoS)[2]. The EAR generates an intermediate volume between the saturated liquid and vapor volumes. The trajectory of the intermediate volume over the coexistence region is defined here as the Maxwell crossover, denoted as the M-line, which is independent of EoS. For the vdW or any cubic[3] EoS, the intermediate volume corresponds to the unphysical root, while other two corresponding to the saturated volumes of vapor and liquid phases, respectively. Due to its unphysical nature, the intermediate volume has always been discarded. Here we show that the M-line, which turns out to be strictly related to the diameter[4] of the coexistence curve, holds the key to solving several major issues. Traditionally the coexistence curve with two branches is considered as the extension of the Widom line[5,6-9]. This assertion causes an inconsistency in three planes of temperature, pressure and volume. It is found that the M-line is the natural extension of the Widom line into the vapor-liquid coexistence region. As a result, the united single line coherently divides the entire phase space, including the coexistence and supercritical fluid regions, into gas-like and liquid-like regimes in all the planes. Moreover, along the M-line the vdW EoS finds a new perspective to access the second-order transition in a way better aligning with observations and modern theory[10]. Lastly, by using the feature of the M-line, we are able to derive a highly accurate and analytical proximate solution to the VLE problem with the vdW EoS.


title: Asymptotic limits, Banach limits, and Ces\`aro means

abstract: Every new inner product in a Hilbert space is obtained from the original one by means of a unique positive operator$.$ The first part of the paper is a survey on applications of such a technique, including a characterization of similarity to isometries$.$ The second part focuses on Banach limits for dealing with power bounded operators. It is shown that if a power bounded operator for which the sequence of shifted Ces\`aro means converges (at least in the weak topology) uniformly in the shift parameter, then it has a Ces\`aro asymptotic limit coinciding with its $\varphi$-asymptotic limit for all Banach limits $\varphi$.


title: $L_{\rm syn}-E_{\rm syn, p}-\delta$ relation in Active Galactic Nucleus Jets and Implication for the physical origin of the $L_{\rm p}-E_{\rm p,z}-\Gamma_0$ relation of Gamma-Ray Bursts

abstract: High energy photon radiations of gamma-ray bursts (GRBs) and active galactic nuclei (AGNs) are dominated by their jet radiations. We examine wether the synchrotron radiations of jets in BL Lacs, flat spectrum radio quasars (FSRQs), and Narrow Line Seyfert 1 galaxies (NLS1s) follow the relation between the prompt gamma-ray emission and the initial Lorentz factor ($\Gamma_0$) of GRBs. It is showed that the AGNs sample does not agree with the $L_{\rm p}-E_{\rm p,z}-\Gamma_{0}$ of GRBs. In addition, we obtain a tight relation of $L_{\rm syn}\propto E^{0.45\pm0.15}_{\rm syn,p}\delta^{3.50\pm0.25}$ for FSRQs and NLS1 galaxies, where $L_{\rm syn}$ is the luminosity at peak photon energy $E_{\rm syn, p}$ of the synchrotron radiations. This relation is different from the $L_{\rm p}-E_{\rm p,z}-\Gamma_{0}$ relation of GRBs. The dependence of $L_{\rm syn}$ to $\delta$ is consistent with the expectation of the Doppler boosting effect for the FSRQs and NLS1 galaxies, but it is not for GBRs. We argue that $\Gamma_0$ may be a representative of the kinetic power of the radiating region and the tight $L_{\rm p}-E_{\rm p, z}-\Gamma_0$ relation is shaped by the radiation physics and the jet power together.


title: ElderSim: A Synthetic Data Generation Platform for Human Action Recognition in Eldercare Applications

abstract: To train deep learning models for vision-based action recognition of elders' daily activities, we need large-scale activity datasets acquired under various daily living environments and conditions. However, most public datasets used in human action recognition either differ from or have limited coverage of elders' activities in many aspects, making it challenging to recognize elders' daily activities well by only utilizing existing datasets. Recently, such limitations of available datasets have actively been compensated by generating synthetic data from realistic simulation environments and using those data to train deep learning models. In this paper, based on these ideas we develop ElderSim, an action simulation platform that can generate synthetic data on elders' daily activities. For 55 kinds of frequent daily activities of the elders, ElderSim generates realistic motions of synthetic characters with various adjustable data-generating options, and provides different output modalities including RGB videos, two- and three-dimensional skeleton trajectories. We then generate KIST SynADL, a large-scale synthetic dataset of elders' activities of daily living, from ElderSim and use the data in addition to real datasets to train three state-of the-art human action recognition models. From the experiments following several newly proposed scenarios that assume different real and synthetic dataset configurations for training, we observe a noticeable performance improvement by augmenting our synthetic data. We also offer guidance with insights for the effective utilization of synthetic data to help recognize elders' daily activities.


title: Chains of Planets in Mean Motion Resonances Arising from Oligarchic Growth

abstract: Exoplanet systems with multiple planets in mean motion resonances have often been hailed as a signpost of disk driven migration. Resonant chains like Kepler-223 and Kepler-80 consist of a trio of planets with the three-body resonant angle librating and/or with a two-body resonant angle librating for each pair. Here we investigate whether close-in super-Earths and mini-Neptunes forming in situ can lock into resonant chains due to dissipation from a depleted gas disk. We simulate the giant impact phase of planet formation, including eccentricity damping from a gaseous disk, followed by subsequent dynamical evolution over tens of millions of years. In a fraction of simulated systems, we find that planets naturally lock into resonant chains. These planets achieve a chain of near-integer period ratios during the gas disk stage, experience eccentricity damping that captures them into resonance, stay in resonance as the gas disk dissipates, and avoid subsequent giant impacts, eccentricity excitation, and chaotic diffusion that would dislodge the planets from resonance. Disk conditions that enable planets to complete their formation during the gas disk stage enable those planets to achieve tight period ratios <= 2 and, if they happen to be near integer period ratios, lock into resonance. Using the weighting of different disk conditions deduced by MacDonald et al. (2020) and forward modeling Kepler selection effects, we find that our simulations of in situ formation via oligarchic growth lead to a rate of observable trios with integer period ratios and librating resonant angles comparable to observed Kepler systems.


title: Distributed Quantum Sensing

abstract: A plethora of applications hinge on a network or an array of sensors to undertake measurement tasks. A rule of thumb for sensing is that a collective measurement taken by $M$ independent sensors can improve the sensitivity by $1/\sqrt{M}$, known as the standard quantum limit (SQL). Quantum resources such as entanglement and squeezed light can be harnessed to surpass the SQL. Distributed quantum sensing is an emerging subject dedicated to investigating the performance gain enabled by entangled states shared by multiple sensors in tackling different measurement problems. This Review formulates distributed quantum sensing from a quantum-information perspective and describes distributed quantum sensing protocols and their experimental demonstrations. The applications enabled by distributed quantum sensing and an outlook for future opportunities will also be discussed.


title: Generalized Nonlinear and Finsler Geometry for Robotics

abstract: Robotics research has found numerous important applications of Riemannian geometry. Despite that, the concept remain challenging to many roboticists because the background material is complex and strikingly foreign. Beyond {\em Riemannian} geometry, there are many natural generalizations in the mathematical literature -- areas such as Finsler geometry and spray geometry -- but those generalizations are largely inaccessible, and as a result there remain few applications within robotics. This paper presents a re-derivation of spray and Finsler geometries we found critical for the development of our recent work on a powerful behavioral design tool we call geometric fabrics. These derivations build from basic tools in advanced calculus and the calculus of variations making them more accessible to a robotics audience than standard presentations. We focus on the pragmatic and calculable results, avoiding the use of tensor notation to appeal to a broader audience, emphasizing geometric path consistency over ideas around connections and curvature. We hope that these derivations will contribute to an increased understanding of generalized nonlinear, and even classical Riemannian, geometry within the robotics community and inspire future research into new applications.


title: Continuous Lyapunov Controller and Chaotic Non-linear System Optimization using Deep Machine Learning

abstract: The introduction of unexpected system disturbances and new system dynamics does not allow guaranteed continuous system stability. In this research we present a novel approach for detecting early failure indicators of non-linear highly chaotic system and accordingly predict the best parameter calibrations to offset such instability using deep machine learning regression model. The approach proposed continuously monitors the system and controller signals. The Re-calibration of the system and controller parameters is triggered according to a set of conditions designed to maintain system stability without compromise to the system speed, intended outcome or required processing power. The deep neural model predicts the parameter values that would best counteract the expected system in-stability. To demonstrate the effectiveness of the proposed approach, it is applied to the non-linear complex combination of Duffing Van der pol oscillators. The approach is also tested under different scenarios the system and controller parameters are initially chosen incorrectly or the system parameters are changed while running or new system dynamics are introduced while running to measure effectiveness and reaction time.


title: EC-SVC: Secure CAN Bus In-Vehicle Communications with Fine-grained Access Control Based on Edge Computing

abstract: In-vehicle communications are not designed for message exchange between the vehicles and outside systems originally. Thus, the security design of message protection is insufficient. Moreover, the internal devices do not have enough resources to process the additional security operations. Nonetheless, due to the characteristic of the in-vehicle network in which messages are broadcast, secure message transmission to specific receivers must be ensured. With consideration of the facts aforementioned, this work addresses resource problems by offloading secure operations to high-performance devices, and uses attribute-based access control to ensure the confidentiality of messages from attackers and unauthorized users. In addition, we reconfigure existing access control based cryptography to address new vulnerabilities arising from the use of edge computing and attribute-based access control. Thus, this paper proposes an edge computing-based security protocol with fine-grained attribute-based encryption using a hash function, symmetric-based cryptography, and reconfigured cryptographic scheme. In addition, this work formally proves the reconfigured cryptographic scheme and security protocol, and evaluates the feasibility of the proposed security protocol in various aspects using the CANoe software.


title: Lipatov's QCD high energy effective action: past and future

abstract: In this contribution we briefly review some aspects of Lipatov's gauge invariant QCD high energy effective action. The high energy effective provides a field theory framework to systematically factorize QCD scattering amplitudes and related theories in the limit of high center of mass energies. After a short review of the underlying concepts, we address the question how the high energy effective action can be used for actual calculations. As an explicit example we review the derivation of the gluon Regge trajectory up to 2 loop. We then review two topics of current interest: automatic amplitude generation of high energy effective action amplitudes and a discussion of the relation between the so-called Color-Glass-Condensate framework and the high energy effective action.


title: Tristability in viscoelastic flow past side-by-side microcylinders

abstract: Viscoelastic flows through microscale porous arrays exhibit complex path-selection and switching phenomena. However, understanding this process is limited by a lack of studies linking between a single object and large arrays. Here, we report experiments on viscoelastic flow past side-by-side microcylinders with variable intercylinder gap. With increasing flow rate, a sequence of two imperfect symmetry-breaking bifurcations forces selection of either one or two of the three possible flow paths around the cylinders. Tuning the gap length through the value where the first bifurcation becomes perfect reveals regions of bi and tristability in a dimensionless flow rate-gap length `phase' diagram.


title: Geometric Fabrics for the Acceleration-based Design of Robotic Motion

abstract: This paper describes the pragmatic design and construction of geometric fabrics for shaping a robot's task-independent nominal behavior, capturing behavioral components such as obstacle avoidance, joint limit avoidance, redundancy resolution, global navigation heuristics, etc. Geometric fabrics constitute the most concrete incarnation of a new mathematical formulation for reactive behavior called optimization fabrics. Fabrics generalize recent work on Riemannian Motion Policies (RMPs); they add provable stability guarantees and improve design consistency while promoting the intuitive acceleration-based principles of modular design that make RMPs successful. We describe a suite of mathematical modeling tools that practitioners can employ in practice and demonstrate both how to mitigate system complexity by constructing behaviors layer-wise and how to employ these tools to design robust, strongly-generalizing, policies that solve practical problems one would expect to find in industry applications. Our system exhibits intelligent global navigation behaviors expressed entirely as provably stable fabrics with zero planning or state machine governance.


title: An iterative framework for self-supervised deep speaker representation learning

abstract: In this paper, we propose an iterative framework for self-supervised speaker representation learning based on a deep neural network (DNN). The framework starts with training a self-supervision speaker embedding network by maximizing agreement between different segments within an utterance via a contrastive loss. Taking advantage of DNN's ability to learn from data with label noise, we propose to cluster the speaker embedding obtained from the previous speaker network and use the subsequent class assignments as pseudo labels to train a new DNN. Moreover, we iteratively train the speaker network with pseudo labels generated from the previous step to bootstrap the discriminative power of a DNN. Speaker verification experiments are conducted on the VoxCeleb dataset. The results show that our proposed iterative self-supervised learning framework outperformed previous works using self-supervision. The speaker network after 5 iterations obtains a 61% performance gain over the speaker embedding model trained with contrastive loss.


title: Competitive Analysis of Move-to-Front-or-Middle (MFM) Online List Update Algorithm

abstract: The design and analysis of efficient algorithms with the knowledge of current and past inputs is a non-trivial and challenging research area in computer science. In many practical applications the future inputs are not available to the algorithm at any instance of time. So the algorithm has to make decisions based on a sequence of inputs that are in order and on the fly. Such algorithms are known as online algorithms. For measuring the performance of online algorithms, a standard measure, known as competitive analysis, has been extensively used in the literature. List update problem is a well studied research problem in the area of online algorithms since last few decades. One of the widely used deterministic online list update algorithm is the Move-To-Front (MTF) algorithm, which has been shown to be 2-competitive with best performance in practical real life inputs. In this paper we analyse the Move-to-Front-or-Middle (MFM) algorithm using competitive analysis by addressing one of an open question raised by Albers that whether dynamic offline algorithm can be used in finding the competitiveness of an online algorithm? Move-To-Front-or-Middle (MFM) was experimentally studied and observed to be performing better than MTF algorithm by using the Calgary Corpus and Canterbury Corpus data set. However, it is interesting and challenging to find the lower bound and upper bound on the competitive ratio of MFM algorithm. We make a first attempt to find the competitiveness of MFM algorithm. Our new results show that MFM is not 2-competitive with respect to static optimum offline algorithm, whereas it is 2-competitive with respect to dynamic optimum offline algorithm. Our new theoretical results may open up a new direction of research in the online list update problem by characterising the structure of competitive and non competitive deterministic online algorithms.


title: A short note on the decision tree based neural turing machine

abstract: Turing machine and decision tree have developed independently for a long time. With the recent development of differentiable models, there is an intersection between them. Neural turing machine(NTM) opens door for the memory network. It use differentiable attention mechanism to read/write external memory bank. Differentiable forest brings differentiable properties to classical decision tree. In this short note, we show the deep connection between these two models. That is: differentiable forest is a special case of NTM. Differentiable forest is actually decision tree based neural turing machine. Based on this deep connection, we propose a response augmented differential forest (RaDF). The controller of RaDF is differentiable forest, the external memory of RaDF are response vectors which would be read/write by leaf nodes.


title: On the May Spectral Sequence at the prime 2

abstract: We make a conjecture about the whole $E_2$ page of the May spectral sequence in terms of generators and relations and we prove it in a subalgebra which covers a large range of dimensions. We show that the $E_2$ page plays a universal role in the study of Massey products in commutative DGAs. We conjecture that the $E_2$ page is nilpotent free and also prove it in this subalgebra. We compute all the $d_2$ differentials of the generators in the conjecture and construct maps of spectral sequences which allow us to explore Adams vanishing line theorem to compute differentials in the May spectral sequence.


title: Explore-Before-Talk: Multichannel Selection Diversity for Uplink Transmissions in Machine-Type Communication

abstract: Improving the data rate of machine-type communication (MTC) is essential in supporting emerging Internet of things (IoT) applications ranging from real-time surveillance to edge machine learning. To this end, in this paper we propose a resource allocation approach for uplink transmissions within a random access procedure in MTC by exploiting multichannel selection diversity, coined explore-before-talk (EBT). Each user in EBT first sends pilot signals through multiple channels that are initially allocated by a base station (BS) for exploration, and then the BS informs a subset of initially allocated channels that are associated with high signal-to-noise ratios (SNRs) for data packet transmission by the user while releasing the rest of the channels for other users. Consequently, EBT exploits a multichannel selection diversity gain during data packet transmission, at the cost of exploration during pilot transmission. We optimize this exploration-exploitation trade-off, by deriving closed-form mean data rate and resource outage probability expressions. Numerical results corroborate that EBT achieves a higher mean data rate while satisfying the same outage constraint, compared to a conventional MTC protocol without exploration.


title: Comparing Workflow Application Designs for High Resolution Satellite Image Analysis

abstract: Very High Resolution satellite and aerial imagery are used to monitor and conduct large scale surveys of ecological systems. Convolutional Neural Networks have successfully been employed to analyze such imagery to detect large animals and salient features. As the datasets increase in volume and number of images, utilizing High Performance Computing resources becomes necessary. In this paper, we investigate three task-parallel, data-driven workflow designs to support imagery analysis pipelines with heterogeneous tasks on HPC. We analyze the capabilities of each design when processing datasets from two use cases for a total of 4,672 satellite and aerial images, and 8.35 TB of data. We experimentally model the execution time of the tasks of the image processing pipelines. We perform experiments to characterize the resource utilization, total time to completion, and overheads of each design. Based on the model, overhead and utilization analysis, we show which design is best suited to scientific pipelines with similar characteristics.


title: Block Form of Frobenius Groups

abstract: The aim of this paper is to apply character properties of Frobenius group to a local block form of an group algebra. We start by establishing a block form of Brauer permutation Lemma by using block participation of conjugate classes of a group $G$. Then we can define a pair of Frobenius corresponding blocks between a group $G$ and its normal subgroup $N$. A near group condition is given to determine a pair of Frobenius corresponding blocks. With a pair of Frobenius corresponding blocks, we study its group structure. At last we prove connections between nilpotent properties and Frobenius corresponding blocks.


title: Design of Bilayer and Multi-layer LDPC Ensembles from Individual Degree Distributions

abstract: A new approach for designing bilayer and multi-layer LDPC codes is proposed and studied in the asymptotic regime. The ensembles are defined through individual uni-variate degree distributions, one for each layer. We present a construction that: 1) enables low-complexity decoding for high-SNR channel instances, 2) provably approaches capacity for low-SNR instances, 3) scales linearly (in terms of design complexity) in the number of layers. For the setup where decoding the second layer is significantly more costly than the first layer, we propose an optimal-cost decoding schedule and study the trade-off between code rate and decoding cost.


title: Fine-grained Information Status Classification Using Discourse Context-Aware BERT

abstract: Previous work on bridging anaphora recognition (Hou et al., 2013a) casts the problem as a subtask of learning fine-grained information status (IS). However, these systems heavily depend on many hand-crafted linguistic features. In this paper, we propose a simple discourse context-aware BERT model for fine-grained IS classification. On the ISNotes corpus (Markert et al., 2012), our model achieves new state-of-the-art performance on fine-grained IS classification, obtaining a 4.8 absolute overall accuracy improvement compared to Hou et al. (2013a). More importantly, we also show an improvement of 10.5 F1 points for bridging anaphora recognition without using any complex hand-crafted semantic features designed for capturing the bridging phenomenon. We further analyze the trained model and find that the most attended signals for each IS category correspond well to linguistic notions of information status.


title: The generalised Hausdorff measure of sets of Dirichlet non-improvable numbers

abstract: Let $\psi:\mathbb R_+\to\mathbb R_+$ be a non-increasing function. A real number $x$ is said to be $\psi$-Dirichlet improvable if the system $$|qx-p|< \, \psi(t) \ \ {\text{and}} \ \ |q|<t$$ has a non-trivial integer solution for all large enough $t$. Denote the collection of such points by $D(\psi)$. In this paper, we prove a zero-infinity law valid for all dimension functions under natural non-restrictive conditions. Some of the consequences are zero-infinity laws, for all essentially sub-linear dimension functions proved by Hussain-Kleinbock-Wadleigh-Wang (2018), for some non-essentially sub-linear dimension functions, and for all dimension functions but with a growth condition on the approximating function.


title: Wide flat minima and optimal generalization in classifying high-dimensional Gaussian mixtures

abstract: We analyze the connection between minimizers with good generalizing properties and high local entropy regions of a threshold-linear classifier in Gaussian mixtures with the mean squared error loss function. We show that there exist configurations that achieve the Bayes-optimal generalization error, even in the case of unbalanced clusters. We explore analytically the error-counting loss landscape in the vicinity of a Bayes-optimal solution, and show that the closer we get to such configurations, the higher the local entropy, implying that the Bayes-optimal solution lays inside a wide flat region. We also consider the algorithmically relevant case of targeting wide flat minima of the (differentiable) mean squared error loss. Our analytical and numerical results show not only that in the balanced case the dependence on the norm of the weights is mild, but also, in the unbalanced case, that the performances can be improved.


title: Construction of the Hodge-Neumann heat kernel, local Bernstein estimates, and Onsager's conjecture in fluid dynamics

abstract: Most recently, in arXiv:1907.05360 [math.AP], we introduced the theory of heatable currents and proved Onsager's conjecture on Riemannian manifolds with boundary, where the weak solution has $B_{3,1}^{\frac{1}{3}}$ spatial regularity. In this sequel, by applying techniques from geometric microlocal analysis to construct the Hodge-Neumann heat kernel, we obtain off-diagonal decay and local Bernstein estimates, and then use them to extend the result to the Besov space $\widehat{B}_{3,V}^{\frac{1}{3}}$, which generalizes both the space $\widehat{B}_{3,c(\mathbb{N})}^{1/3}$ from arXiv:1310.7947 [math.AP] and the space $\underline{B}_{3,\text{VMO}}^{1/3}$ from arXiv:1902.07120 [math.AP] -- the best known function space where Onsager's conjecture holds on flat backgrounds.


title: Hogwild! over Distributed Local Data Sets with Linearly Increasing Mini-Batch Sizes

abstract: Hogwild! implements asynchronous Stochastic Gradient Descent (SGD) where multiple threads in parallel access a common repository containing training data, perform SGD iterations and update shared state that represents a jointly learned (global) model. We consider big data analysis where training data is distributed among local data sets in a heterogeneous way -- and we wish to move SGD computations to local compute nodes where local data resides. The results of these local SGD computations are aggregated by a central "aggregator" which mimics Hogwild!. We show how local compute nodes can start choosing small mini-batch sizes which increase to larger ones in order to reduce communication cost (round interaction with the aggregator). We improve state-of-the-art literature and show $O(\sqrt{K}$) communication rounds for heterogeneous data for strongly convex problems, where $K$ is the total number of gradient computations across all local compute nodes. For our scheme, we prove a \textit{tight} and novel non-trivial convergence analysis for strongly convex problems for {\em heterogeneous} data which does not use the bounded gradient assumption as seen in many existing publications. The tightness is a consequence of our proofs for lower and upper bounds of the convergence rate, which show a constant factor difference. We show experimental results for plain convex and non-convex problems for biased (i.e., heterogeneous) and unbiased local data sets.


title: Effective Decoder Masking for Transformer Based End-to-End Speech Recognition

abstract: The attention-based encoder-decoder modeling paradigm has achieved promising results on a variety of speech processing tasks like automatic speech recognition (ASR), text-to-speech (TTS) and among others. This paradigm takes advantage of the generalization ability of neural networks to learn a direct mapping from an input sequence to an output sequence, without recourse to prior knowledge such as audio-text alignments or pronunciation lexicons. However, ASR models stemming from this paradigm are prone to overfitting, especially when the training data is limited. Inspired by SpecAugment and BERT-like masked language modeling, we propose in the paper a decoder masking based training approach for end-to-end (E2E) ASR models. During the training phase we randomly replace some portions of the decoder's historical text input with the symbol [mask], in order to encourage the decoder to robustly output a correct token even when parts of its decoding history are masked or corrupted. The proposed approach is instantiated with the top-of-the-line transformer-based E2E ASR model. Extensive experiments on the Librispeech960h and TedLium2 benchmark datasets demonstrate the superior performance of our approach in comparison to some existing strong E2E ASR systems.


title: Deep Networks from the Principle of Rate Reduction

abstract: This work attempts to interpret modern deep (convolutional) networks from the principles of rate reduction and (shift) invariant classification. We show that the basic iterative gradient ascent scheme for optimizing the rate reduction of learned features naturally leads to a multi-layer deep network, one iteration per layer. The layered architectures, linear and nonlinear operators, and even parameters of the network are all explicitly constructed layer-by-layer in a forward propagation fashion by emulating the gradient scheme. All components of this "white box" network have precise optimization, statistical, and geometric interpretation. This principled framework also reveals and justifies the role of multi-channel lifting and sparse coding in early stage of deep networks. Moreover, all linear operators of the so-derived network naturally become multi-channel convolutions when we enforce classification to be rigorously shift-invariant. The derivation also indicates that such a convolutional network is significantly more efficient to construct and learn in the spectral domain. Our preliminary simulations and experiments indicate that so constructed deep network can already learn a good discriminative representation even without any back propagation training.


title: A Sober Look at the Unsupervised Learning of Disentangled Representations and their Evaluation

abstract: The idea behind the \emph{unsupervised} learning of \emph{disentangled} representations is that real-world data is generated by a few explanatory factors of variation which can be recovered by unsupervised learning algorithms. In this paper, we provide a sober look at recent progress in the field and challenge some common assumptions. We first theoretically show that the unsupervised learning of disentangled representations is fundamentally impossible without inductive biases on both the models and the data. Then, we train over $14000$ models covering most prominent methods and evaluation metrics in a reproducible large-scale experimental study on eight data sets. We observe that while the different methods successfully enforce properties "encouraged" by the corresponding losses, well-disentangled models seemingly cannot be identified without supervision. Furthermore, different evaluation metrics do not always agree on what should be considered "disentangled" and exhibit systematic differences in the estimation. Finally, increased disentanglement does not seem to necessarily lead to a decreased sample complexity of learning for downstream tasks. Our results suggest that future work on disentanglement learning should be explicit about the role of inductive biases and (implicit) supervision, investigate concrete benefits of enforcing disentanglement of the learned representations, and consider a reproducible experimental setup covering several data sets.


title: Hadron structure and spin effects in elastic hadron scattering at NICA energies

abstract: The spin effects in the elastic proton-proton scattering are analysed at NICA energies. It is shown the importance the investigation of the region of the diffraction minimum in the differential cross sections. Some possible estimation of spin effects are given for the different NICA energies in the framework of the new high energy generelazed structure (HEGS) model.


title: Connection between missing-charge in quasielastic electron scattering and two(one) proton knockout reactions and the island-of-inversion

abstract: Our model, based on Quantum Chromodynamics, emphasizes the role of triton clustering in nuclei. As there is good empirical support of triton clustering in nuclei, we may even treat this as a good phenomenological working hypothesis as well. Here we show how our model finds remarkable success in being able to provide a consistent and interconnected understanding of such diverse empirical realities as the missing electric-charge in quasielastic electron scattering, and simultaneously, also the puzzling data within the studies of exotic nuclei. This gives us confidence, that our model should be taking account of the correct and proper degrees of freedom, to physically specify and explain, the total physical reality as manifested in the nuclear medium.


title: Continuous time-reversal and equality in the thermodynamic uncertainty relation

abstract: We introduce a continuous time-reversal operation which connects the time-forward and time-reversed trajectories in the steady state of an irreversible Markovian dynamics via a continuous family of stochastic dynamics. This continuous time-reversal allows us to derive a tighter version of the thermodynamic uncertainty relation (TUR) involving observables evaluated relative to their local mean value. Moreover, the family of dynamics realizing the continuous time-reversal contains an equilibrium dynamics halfway between the time-forward and time-reversed dynamics. We show that this equilibrium dynamics, together with an appropriate choice of the observable, turns the inequality in the TUR into an equality. We demonstrate our findings for the example of a particle diffusing in a tilted periodic potential.


title: Strongly NIP almost real closed fields

abstract: The following conjecture is due to Shelah-Hasson: Any infinite strongly NIP field is either real closed, algebraically closed, or admits a non-trivial definable henselian valuation, in the language of rings. We specialise this conjecture to ordered fields in the language of ordered rings, which leads towards a systematic study of the class of strongly NIP almost real closed fields. As a result, we obtain a complete characterisation of this class.


title: Batch Reinforcement Learning with a Nonparametric Off-Policy Policy Gradient

abstract: Off-policy Reinforcement Learning (RL) holds the promise of better data efficiency as it allows sample reuse and potentially enables safe interaction with the environment. Current off-policy policy gradient methods either suffer from high bias or high variance, delivering often unreliable estimates. The price of inefficiency becomes evident in real-world scenarios such as interaction-driven robot learning, where the success of RL has been rather limited, and a very high sample cost hinders straightforward application. In this paper, we propose a nonparametric Bellman equation, which can be solved in closed form. The solution is differentiable w.r.t the policy parameters and gives access to an estimation of the policy gradient. In this way, we avoid the high variance of importance sampling approaches, and the high bias of semi-gradient methods. We empirically analyze the quality of our gradient estimate against state-of-the-art methods, and show that it outperforms the baselines in terms of sample efficiency on classical control tasks.


title: Around the variational principle for metric mean dimension

abstract: We study variational principles for metric mean dimension. First we prove that in the variational principle of Lindenstrauss and Tsukamoto it suffices to take supremum over ergodic measures. Second we derive a variational principle for metric mean dimension involving growth rates of measure-theoretic entropy of partitions decreasing in diameter which holds in full generality and in particular does not necessitate the assumption of tame growth of covering numbers. The expressions involved are a dynamical version of Renyi information dimension. Third we derive a new expression for Geiger-Koch information dimension rate for ergodic shift-invariant measures. Finally we develop a lower bound for metric mean dimension in terms of Brin-Katok local entropy.


title: Graph embedding using multi-layer adjacent point merging model

abstract: For graph classification tasks, many traditional kernel methods focus on measuring the similarity between graphs. These methods have achieved great success on resolving graph isomorphism problems. However, in some classification problems, the graph class depends on not only the topological similarity of the whole graph, but also constituent subgraph patterns. To this end, we propose a novel graph embedding method using a multi-layer adjacent point merging model. This embedding method allows us to extract different subgraph patterns from train-data. Then we present a flexible loss function for feature selection which enhances the robustness of our method for different classification problems. Finally, numerical evaluations demonstrate that our proposed method outperforms many state-of-the-art methods.


title: Structural Causal Model with Expert Augmented Knowledge to Estimate the Effect of Oxygen Therapy on Mortality in the ICU

abstract: Recent advances in causal inference techniques, more specifically, in the theory of structural causal models, provide the framework for identification of causal effects from observational data in the cases where the causal graph is identifiable, i.e., the data generating mechanism can be recovered from the joint distribution. However, no such studies have been done to demonstrate this concept with a clinical example. We present a complete framework to estimate the causal effect from observational data by augmenting expert knowledge in the model development phase and with a practical clinical application. Our clinical application entails a timely and important research question, i.e., the effect of oxygen therapy intervention in the intensive care unit (ICU); the result of this project is useful in a variety of disease conditions, including severe acute respiratory syndrome coronavirus-2 (SARS-CoV-2) patients in the ICU. We used data from the MIMIC III database, a standard database in the machine learning community that contains 58,976 admissions from an ICU in Boston, MA, for estimating the oxygen therapy effect on morality. We also identified the covariate-specific effect to oxygen therapy from the model for more personalized intervention.


title: Lexicographic Groebner bases of bivariate polynomials modulo a univariate one

abstract: Let T(x) in k[x] be a monic non-constant polynomial and write R=k[x] / (T) the quotient ring. Consider two bivariate polynomials a(x, y), b(x, y) in R[y]. In a first part, T = p^e is assumed to be the power of an irreducible polynomial p. A new algorithm that computes a minimal lexicographic Groebner basis of the ideal ( a, b, p^e), is introduced. A second part extends this algorithm when T is general through the "local/global" principle realized by a generalization of "dynamic evaluation", restricted so far to a polynomial T that is squarefree. The algorithm produces splittings according to the case distinction "invertible/nilpotent", extending the usual "invertible/zero" in classic dynamic evaluation. This algorithm belongs to the Euclidean family, the core being a subresultant sequence of a and b modulo T. In particular no factorization or Groebner basis computations are necessary. The theoretical background relies on Lazard's structural theorem for lexicographic Groebner bases in two variables. An implementation is realized in Magma. Benchmarks show clearly the benefit, sometimes important, of this approach compared to the Groebner bases approach.


title: Realization of a deterministic quantum Toffoli gate with a single photon

abstract: Quantum controlled-logic gates, including controlled NOT gate and Toffoli gate, play critical roles in lots of quantum information processing schemes. We design and experimentally demonstrate deterministic Toffoli gate by utilizing orbital-angular-momentum and polarization degrees of freedom of a single photon. In addition, we generate Bell states by using the controlled NOT gate. The effective conversion rate of the Toffoli gate in our experiment is $(95.1\pm3.2)\%$. Furthermore, our experimental setup does not require any auxiliary photons and probabilistic post selections.


title: Statistical analysis of the material, geometrical and imperfection characteristics of structural stainless steels and members

abstract: Traditional member-based two-step design approaches included in current structural codes for steel structures, as well as more recent system-based direct-design alternatives, require building rigorous structural reliability frameworks for the calibration of partial coefficients (resistance factors) to achieve specified target reliability requirements. Key design parameters affecting the strength of structures and their random variations are generally modelled by nominal or characteristic values in design standards, which are combined with partial coefficients that need to be calibrated from measurements on real samples. While the statistical characterization of material and geometric properties of structural steels has been consolidated over the last decades, information about the characterization of structural stainless steels is virtually non-existent due to the limited pool of available data. Thus, this paper presents the basic ingredient for developing reliability frameworks for stainless steel structures and components by statistically characterizing the main random parameters affecting their strength through a comprehensive database collected from the literature. Based on the collected data, appropriate probabilistic models are proposed for geometric properties, material properties, imperfections and residual stresses of different stainless steel alloys and cross-section or product types. The data is equally applicable to member-based reliability analyses as described in existing codes and system-based analyses targeted at the direct-design of stainless steel structures by advanced analysis.


title: DNA: Differentiable Network-Accelerator Co-Search

abstract: Powerful yet complex deep neural networks (DNNs) have fueled a booming demand for efficient DNN solutions to bring DNN-powered intelligence into numerous applications. Jointly optimizing the networks and their accelerators are promising in providing optimal performance. However, the great potential of such solutions have yet to be unleashed due to the challenge of simultaneously exploring the vast and entangled, yet different design spaces of the networks and their accelerators. To this end, we propose DNA, a Differentiable Network-Accelerator co-search framework for automatically searching for matched networks and accelerators to maximize both the task accuracy and acceleration efficiency. Specifically, DNA integrates two enablers: (1) a generic design space for DNN accelerators that is applicable to both FPGA- and ASIC-based DNN accelerators and compatible with DNN frameworks such as PyTorch to enable algorithmic exploration for more efficient DNNs and their accelerators; and (2) a joint DNN network and accelerator co-search algorithm that enables simultaneously searching for optimal DNN structures and their accelerators' micro-architectures and mapping methods to maximize both the task accuracy and acceleration efficiency. Experiments and ablation studies based on FPGA measurements and ASIC synthesis show that the matched networks and accelerators generated by DNA consistently outperform state-of-the-art (SOTA) DNNs and DNN accelerators (e.g., 3.04x better FPS with a 5.46% higher accuracy on ImageNet), while requiring notably reduced search time (up to 1234.3x) over SOTA co-exploration methods, when evaluated over ten SOTA baselines on three datasets. All codes will be released upon acceptance.


title: Stochastic Geometry Analysis of Uplink Cellular Networks with FSO Backhauling: Cooperative Relaying Vs. Reflecting Surfaces

abstract: In this work, we consider the performance analysis of the uplink cellular networks with free space optics (FSO) backhauling. The user equipment (UE) communicates with the nearest Base Station (BS) in first slot while in second slot, the BS converts the received radio frequency (RF) signal into FSO pulse and transmits to the data center. We adopt the Rayleigh fading for the uplink channels while the FSO backhaul encompasses the turbulence-induced fading which follows the M\'alaga distribution, the weather pathloss, and the pointing errors fading which is distributed following the generalized Beckmann model. Further, we will compare the performances when the BS behaves as either a decode-and-forward (DF) relay or an intelligent reflecting surface (IRS). Next, we will propose an optimal design of the phase shifters of the IRS to minimize the interference and improve the rate to beat relaying. Capitalizing on this framework, we will derive the system performance metrics such as the coverage probability as well as the spectral efficiency. Focusing on high SNR, we will obtain the diversity gain to get engineering insights into the system performance and limitations. Finally, the analytical results are confirmed by Monte Carlo simulations.


title: Comodule Structures, Equivariant Hopf Structures, and Generalized Schubert Polynomials

abstract: In this article, the comodule structure of Chow rings of Flag manifolds $\operatorname{CH}(G/B)$ is described by Schubert cells. Its equivariant version gives rise to a Hopf structure of the equivariant cohomology of flag manifolds $H^*_B(G/B)$. We get two identities of generalized Schubert polynomials as explanations of the geometric facts.


title: On the Fault Tolerant Distributed Data Caching using LDPC Codes in Cellular Networks

abstract: The base station-mobile device communication traffic has dramatically increased recently due to mobile data, which in turn heavily overloaded the underlying infrastructure. To decrease Base Station (BS) interaction, intra-cell communication between local devices, known as Device-to-Device, is utilized for distributed data caching. Nevertheless, due to the continuous departure of existing nodes and the arrival of newcomers, the missing cached data may lead to permanent data loss. In this study, we propose and analyze a class of LDPC codes for distributed data caching in cellular networks. Contrary to traditional distributed storage, a novel repair algorithm for LDPC codes is proposed which is designed to exploit the minimal direct BS communication. To assess the versatility of LDPC codes and establish performance comparisons to classic coding techniques, novel theoretical and experimental evaluations are derived. Essentially, the theoretical/numerical results for repair bandwidth cost in presence of BS are presented in a distributed caching setting. Accordingly, when the gap between the cost of downloading a symbol from BS and from other local network nodes is not dramatically high, we demonstrate that LDPC codes can be considered as a viable fault-tolerance alternative in cellular systems with caching capabilities for both low and high code rates.


title: Classification Beats Regression: Counting of Cells from Greyscale Microscopic Images based on Annotation-free Training Samples

abstract: Modern methods often formulate the counting of cells from microscopic images as a regression problem and more or less rely on expensive, manually annotated training images (e.g., dot annotations indicating the centroids of cells or segmentation masks identifying the contours of cells). This work proposes a supervised learning framework based on classification-oriented convolutional neural networks (CNNs) to count cells from greyscale microscopic images without using annotated training images. In this framework, we formulate the cell counting task as an image classification problem, where the cell counts are taken as class labels. This formulation has its limitation when some cell counts in the test stage do not appear in the training data. Moreover, the ordinal relation among cell counts is not utilized. To deal with these limitations, we propose a simple but effective data augmentation (DA) method to synthesize images for the unseen cell counts. We also introduce an ensemble method, which can not only moderate the influence of unseen cell counts but also utilize the ordinal information to improve the prediction accuracy. This framework outperforms many modern cell counting methods and won the data analysis competition (Case Study 1: Counting Cells From Microscopic Images https://ssc.ca/en/case-study/case-study-1-counting-cells-microscopic-images) of the 47th Annual Meeting of the Statistical Society of Canada (SSC). Our code is available at https://github.com/anno2020/CellCount_TinyBBBC005.


title: Age of Information Analysis in Hyperledger Fabric Blockchain-enabled Monitoring Networks

abstract: Age of information (AoI) is a recently proposed metric for quantifying data freshness in real-time status monitoring systems where timeliness is of importance. In this paper, we explore the data freshness in the Hyperledger Fabric Blockchain-enabled monitoring network (HeMN) by leveraging the AoI metric. In HeMN, status updates from sources are transmitted through an uplink and recorded in a Hyperledger Fabric (HLF) network. To provide a stochastic guarantee of data freshness, we derive a closed-form of AoI violation probability by considering the transmission latency and the consensus latency. Then, we validate our analytic results through the implemented HLF platform. We also investigate the effect of the target successful transmission probability (STP) on the AoI violation probability.


title: A Chinese Text Classification Method With Low Hardware Requirement Based on Improved Model Concatenation

abstract: In order to improve the accuracy performance of Chinese text classification models with low hardware requirements, an improved concatenation-based model is designed in this paper, which is a concatenation of 5 different sub-models, including TextCNN, LSTM, and Bi-LSTM. Compared with the existing ensemble learning method, for a text classification mission, this model's accuracy is 2% higher. Meanwhile, the hardware requirements of this model are much lower than the BERT-based model.


title: Designing Interpretable Approximations to Deep Reinforcement Learning

abstract: In an ever expanding set of research and application areas, deep neural networks (DNNs) set the bar for algorithm performance. However, depending upon additional constraints such as processing power and execution time limits, or requirements such as verifiable safety guarantees, it may not be feasible to actually use such high-performing DNNs in practice. Many techniques have been developed in recent years to compress or distill complex DNNs into smaller, faster or more understandable models and controllers. This work seeks to identify reduced models that not only preserve a desired performance level, but also, for example, succinctly explain the latent knowledge represented by a DNN. We illustrate the effectiveness of the proposed approach on the evaluation of decision tree variants and kernel machines in the context of benchmark reinforcement learning tasks.


title: Automated Detection of Accelerating Solar Eruptions using Parabolic Hough Transform

abstract: Solar eruptions such as Coronal Mass Ejections (CMEs) observed in the inner solar corona (up to 4 R$_{\odot}$) show acceleration profiles which appear as parabolic ridges in height-time plots. Inspired by the white-light automated detection algorithms, Computer Aided CME Tracking System (CACTus) and Solar Eruptive Events Detection System (SEEDS), we employ the parabolic Hough Transform for the first time to automatically detect off-disk solar eruptions {from height-time plots. Due to the limited availability of white-light observations in the inner corona, we use Extreme UltraViolet (EUV) images of the Sun. In this paper we present a new algorithm, CME Identification in Inner Solar Corona (CIISCO), which is based on Fourier motion filtering and the parabolic Hough transform, and demonstrate its implementation using EUV observations taken from {\it Atmospheric Imaging Assembly} (AIA) on-board the Solar Dynamics Observatory (SDO), {\it Extreme Ultra Violet Imager} (EUVI) on-board the STEREO-A and B satellites, and {\it Sun Watcher using Active Pixel System detector and Image Processing} (SWAP) Imager on-board PROBA2. We show that CIISCO is able to identify any {off-disk} outward moving feature in EUV images. The use of automated detection algorithms, like CIISCO, can potentially be used to provide early warnings of CMEs if an EUV telescope is located at $\pm$ 90$^{\circ}$ from the Sun-Earth line, providing CME characteristics and kinematics close to the Sun. This paper also presents the limitations of this algorithm and the prospects for future improvement.


title: Double-peaked Pulse Profile of FRB 200428: Synchrotron Maser Emission from Magnetized Shocks Encountering a Density Jump

abstract: Very recently a fast radio burst (FRB) 200428 associated with a strong X-ray burst from the Galactic magnetar SGR 1935+2154 has been detected, which is direct evidence supporting the magnetar progenitor models of FRBs. Assuming the FRB radiation mechanism is synchrotron maser emission from magnetized shocks, we develop a specific scenario by introducing a density jump structure of upstream medium, and thus the double-peaked character of FRB 200428 is a natural outcome. The luminosity and emission frequency of two pulses can be well explained in this scenario. Furthermore, we find that the synchrotron emission of shock-accelerated electrons is in the X-ray band, which therefore can be responsible for at least a portion of observed X-ray fluence. With proper upgrade, this density jump scenario can be potentially applied to FRBs with multiple peaks in the future.


title: Heralded non-destructive quantum entangling gate with single-photon sources

abstract: Heralded entangling quantum gates are an essential element for the implementation of large-scale optical quantum computation. Yet, the experimental demonstration of genuine heralded entangling gates with free-flying output photons in linear optical system, was hindered by the intrinsically probabilistic source and double-pair emission in parametric down-conversion. Here, by using an on-demand single-photon source based on a semiconductor quantum dot embedded in a micro-pillar cavity, we demonstrate a heralded controlled-NOT (CNOT) operation between two single photons for the first time. To characterize the performance of the CNOT gate, we estimate its average quantum gate fidelity of ($87.8\pm1.2$)%. As an application, we generated event-ready Bell states with a fidelity of ($83.4\pm2.4$)%. Our results are an important step towards the development of photon-photon quantum logic gates.


title: A concentrated capacity model for diffusion-advection: advection localized to a moving curve

abstract: In this work I show how a diffusion-advection equation in three space-dimensions may have its advection term weakly limited to a velocity field localized to a moving curve. This is rigorously accomplished through the technique of concentrated capacity, and the form of the concentrated capacity limit along with small time existence of solutions is determined. This problem is motivated by mathematical biology and the study of proteins in solvent where the latter is modeled as a diffusing quantity and the protein is taken to be a 1d object which advects the solvent by contact and its own motion. This work introduces a novel PDE's framework for that interaction.


title: On unramified solvable extensions of small number fields

abstract: We investigate unramified extensions of number fields with prescribed solvable Galois group and certain extra conditions. In particular, we are interested in the minimal degree of a number field $K$, Galois over $\mathbb{Q}$, such that $K$ possesses an unramified $G$-extension. We improve the best known bounds for the degree of such number fields $K$ for certain classes of solvable groups, in particular nilpotent groups.


title: One In A Hundred: Select The Best Predicted Sequence from Numerous Candidates for Streaming Speech Recognition

abstract: The RNN-Transducers and improved attention-based encoder-decoder models are widely applied to streaming speech recognition. Compared with these two end-to-end models, the CTC model is more efficient in training and inference. However, it cannot capture the linguistic dependencies between the output tokens. Inspired by the success of two-pass end-to-end models, we introduce a transformer decoder and the two-stage inference method into the streaming CTC model. During inference, the CTC decoder first generates many candidates in a streaming fashion. Then the transformer decoder selects the best candidate based on the corresponding acoustic encoded states. The second-stage transformer decoder can be regarded as a conditional language model. We assume that a large enough number and enough diversity of candidates generated in the first stage can compensate the CTC model for the lack of language modeling ability. All the experiments are conducted on a Chinese Mandarin dataset AISHELL-1. The results show that our proposed model can implement streaming decoding in a fast and straightforward way. Our model can achieve up to a 20% reduction in the character error rate than the baseline CTC model. In addition, our model can also perform non-streaming inference with only a little performance degradation.


title: Tangent complexes and the Diamond Lemma

abstract: The celebrated Diamond Lemma of Bergman gives an effectively verifiable criterion of uniqueness of normal forms for term rewriting in associative algebras. We present a new way to interpret and prove this result from the viewpoint of homotopical algebra. Our main result states that every multiplicative free resolution of an algebra with monomial relations gives rise to its own Diamond Lemma, so that Bergman's condition of "resolvable ambiguities" becomes the first non-trivial component of the Maurer--Cartan equation in the corresponding tangent complex. The same approach works for many other algebraic structures, emphasizing the relevance of computing multiplicative free resolutions of algebras with monomial relations.


title: Class-Agnostic Segmentation Loss and Its Application to Salient Object Detection and Segmentation

abstract: In this paper we present a novel loss function, called class-agnostic segmentation (CAS) loss. With CAS loss the class descriptors are learned during training of the network. We don't require to define the label of a class a-priori, rather the CAS loss clusters regions with similar appearance together in a weakly-supervised manner. Furthermore, we show that the CAS loss function is sparse, bounded, and robust to class-imbalance. We apply our CAS loss function with fully-convolutional ResNet101 and DeepLab-v3 architectures to the binary segmentation problem of salient object detection. We investigate the performance against the state-of-the-art methods in two settings of low and high-fidelity training data on seven salient object detection datasets. For low-fidelity training data (incorrect class label) class-agnostic segmentation loss outperforms the state-of-the-art methods on salient object detection datasets by staggering margins of around 50%. For high-fidelity training data (correct class labels) class-agnostic segmentation models perform as good as the state-of-the-art approaches while beating the state-of-the-art methods on most datasets. In order to show the utility of the loss function across different domains we also test on general segmentation dataset, where class-agnostic segmentation loss outperforms cross-entropy based loss by huge margins on both region and edge metrics.


title: Seen and Unseen emotional style transfer for voice conversion with a new emotional speech dataset

abstract: Emotional voice conversion aims to transform emotional prosody in speech while preserving the linguistic content and speaker identity. Prior studies show that it is possible to disentangle emotional prosody using an encoder-decoder network conditioned on discrete representation, such as one-hot emotion labels. Such networks learn to remember a fixed set of emotional styles. In this paper, we propose a novel framework based on variational auto-encoding Wasserstein generative adversarial network (VAW-GAN), which makes use of a pre-trained speech emotion recognition (SER) model to transfer emotional style during training and at run-time inference. In this way, the network is able to transfer both seen and unseen emotional style to a new utterance. We show that the proposed framework achieves remarkable performance by consistently outperforming the baseline framework. This paper also marks the release of an emotional speech dataset (ESD) for voice conversion, which has multiple speakers and languages.


title: Randomness for quantum channels:Genericity of catalysis and quantum advantage of uniformness

abstract: Randomness can help one to implement quantum maps that cannot be realized in a deterministic fashion. Recently, it was discovered that explicitly treating a randomness source as a quantum system could double the efficiency as a catalyst for some tasks. In this work, we first show that every quantum channel that can be implemented with a randomness source without leaking information to it must be a catalysis. For that purpose, we prove a new no-go theorem that generalizes the no-hiding theorem, the no-secret theorem that states no quantum information can be shared with other system as a secret without leaking some information. Second, we show that non-degenerate catalysts should be used classically when no extra dimension is allowed, which leads to the fact that the quantum advantage of a catalytic process strictly comes from the uniformness of the randomness source. Finally, we discuss a method to circumvent the previous result that achieves quantum advantage with non-degenerate catalyst uniformized by employing extra work space.


title: The Min-entropy as a Resource for One-Shot Private State Transfer, Quantum Masking and State Transition

abstract: We give an operational meaning to the min-entropy of a quantum state as a resource measure for various interconnected tasks. In particular, we show that the min-entropy without smoothing measures the amount of quantum information that can be hidden or encoded perfectly in the one-shot setting when the quantum state is used as a randomness/correlation source. First, we show that the min-entropy of entanglement of a pure bipartite state is the maximum number of qubits privately transferable when the state is used as quantum one-time pad. Then, through the equivalence of quantum secret sharing(QSS)-like protocols, it is also shown that the min-entropy of a quantum state is the maximum number of qubits that can be masked when the state is used as a randomness source for a quantum masking process. Consequently we show that the min-entropy of a quantum state is the half of the size of quantum state it can catalytically dephase.This gives a necessary and sufficient condition for catalysts for state transition processes.


title: Natural oscillations of a sessile drop: Inviscid theory

abstract: We present a fully analytical solution for the natural oscillation of an inviscid sessile drop of arbitrary contact angle on a horizontal plate for the case for the case of low Bond number, when surface tension dominates gravity. The governing equations are expressed in terms of the toroidal coordinate system which yields solutions involving hypergeometric functions. Resonant frequencies are identified for zonal, sectoral and tesseral vibration modes. The predictions show good agreement with experimental data reported in the literature, with better agreement than the model of \citeauthor{bostwick} (\textit{J. Fluid Mech.}, vol. 760, 2014, 5-38), particularly for flatter drops (lower contact angle) and higher modes of vibration. The impact of viscous dissipation is discussed briefly.


title: Decoupling Pronunciation and Language for End-to-end Code-switching Automatic Speech Recognition

abstract: Despite the recent significant advances witnessed in end-to-end (E2E) ASR system for code-switching, hunger for audio-text paired data limits the further improvement of the models' performance. In this paper, we propose a decoupled transformer model to use monolingual paired data and unpaired text data to alleviate the problem of code-switching data shortage. The model is decoupled into two parts: audio-to-phoneme (A2P) network and phoneme-to-text (P2T) network. The A2P network can learn acoustic pattern scenarios using large-scale monolingual paired data. Meanwhile, it generates multiple phoneme sequence candidates for single audio data in real-time during the training process. Then the generated phoneme-text paired data is used to train the P2T network. This network can be pre-trained with large amounts of external unpaired text data. By using monolingual data and unpaired text data, the decoupled transformer model reduces the high dependency on code-switching paired training data of E2E model to a certain extent. Finally, the two networks are optimized jointly through attention fusion. We evaluate the proposed method on the public Mandarin-English code-switching dataset. Compared with our transformer baseline, the proposed method achieves 18.14% relative mix error rate reduction.


title: Non-Iterative Blind Calibration of Nested Arrays with Asymptotically Optimal Weighting

abstract: Blind calibration of sensors arrays (without using calibration signals) is an important, yet challenging problem in array processing. While many methods have been proposed for "classical" array structures, such as uniform linear arrays, not as many are found in the context of the more "modern" sparse arrays. In this paper, we present a novel blind calibration method for $2$-level nested arrays. Specifically, and despite recent contradicting claims in the literature, we show that the Least-Squares (LS) approach can in fact be used for this purpose with such arrays. Moreover, the LS approach gives rise to optimally-weighted LS joint estimation of the sensors' gains and phases offsets, which leads to more accurate calibration, and in turn, to higher accuracy in subsequent estimation tasks (e.g., direction-of-arrival). Our method, which can be extended to $K$-level arrays ($K>2$), is superior to the current state of the art both in terms of accuracy and computational efficiency, as we demonstrate in simulation.


title: Solutions of the two-wave interactions in quadratic nonlinear media

abstract: In this paper, we propose a reliable treatment for studying the two-wave (symbiotic) solitons of interactions in nonlinear quadratic media. We investigate Schauder's fixed point theorem for proving the existence theorem. Additionally, the uniqueness solution for this system is proved. Also, a highly accurate approximate solution is presented via an iteration algorithm.


title: Matrix and tensor rigidity and $L_p$-approximation

abstract: In this paper we apply methods originated in Complexity theory to some problems of Approximation. We notice that the construction of Alman and Williams that disproves the rigidity of Walsh-Hadamard matrices, provides good $\ell_p$-approximation for $p<2$. It follows that the first $n$ functions of Walsh system can be approximated with an error $n^{-\delta}$ by a linear space of dimension $n^{1-\delta}$: $$ d_{n^{1-\delta}}(\{w_1,\ldots,w_n\}, L_p[0,1]) \le n^{-\delta},\quad p\in[1,2),\;\delta=\delta(p)>0. $$ We do not know if this is possible for the trigonometric system. We show that the algebraic method of Alon--Frankl--R\"odl for bounding the number of low-signum-rank matrices, works for tensors: almost all signum-tensors have large signum-rank and can't be $\ell_1$-approximated by low-rank tensors. This implies lower bounds for $\Theta_m$~ -- the error of $m$-term approximation of multivariate functions by sums of tensor products $u^1(x_1)\cdots u^d(x_d)$. In particular, for the set of trigonometric polynomials with spectrum in $\prod_{j=1}^d[-n_j,n_j]$ and of norm $\|t\|_\infty\le 1$ we have $$ \Theta_m(\mathcal T(n_1,\ldots,n_d)_\infty,L_1[-\pi,\pi]^d) \ge c_1(d)>0,\quad m\le c_2(d)\frac{\prod n_j}{\max\{n_j\}}. $$ Sharp bounds follow for classes of dominated mixed smoothness: $$ \Theta_m(W^{(r,r,\ldots,r)}_p,L_q[0,1]^d)\asymp m^{-\frac{rd}{d-1}},\quad\mbox 2\le p\le\infty,\; 1\le q\le 2. $$


title: SFU-Store-Nav: A Multimodal Dataset for Indoor Human Navigation

abstract: This article describes a dataset collected in a set of experiments that involves human participants and a robot. The set of experiments was conducted in the computing science robotics lab in Simon Fraser University, Burnaby, BC, Canada, and its aim is to gather data containing common gestures, movements, and other behaviours that may indicate humans' navigational intent relevant for autonomous robot navigation. The experiment simulates a shopping scenario where human participants come in to pick up items from his/her shopping list and interact with a Pepper robot that is programmed to help the human participant. We collected visual data and motion capture data from 108 human participants. The visual data contains live recordings of the experiments and the motion capture data contains the position and orientation of the human participants in world coordinates. This dataset could be valuable for researchers in the robotics, machine learning and computer vision community.


title: Enhanced Blind Calibration of Uniform Linear Arrays with One-Bit Quantization by Kullback-Leibler Divergence Covariance Fitting

abstract: One-bit quantization has recently become an attractive option for data acquisition in cutting edge applications, due to the increasing demand for low power and higher sampling rates. Subsequently, the rejuvenated one-bit array processing field is now receiving more attention, as "classical" array processing techniques are adapted / modified accordingly. However, array calibration, often an instrumental preliminary stage in array processing, has so far received little attention in its one-bit form. In this paper, we present a novel solution approach for the blind calibration problem, namely, without using known calibration signals. In order to extract information within the second-order statistics of the quantized measurements, we propose to estimate the unknown sensors' gains and phases offsets according to a Kullback-Leibler Divergence (KLD) covariance fitting criterion. We then provide a quasi-Newton solution algorithm, with a consistent initial estimate, and demonstrate the improved accuracy of our KLD-based estimates in simulations.


title: PPG-based singing voice conversion with adversarial representation learning

abstract: Singing voice conversion (SVC) aims to convert the voice of one singer to that of other singers while keeping the singing content and melody. On top of recent voice conversion works, we propose a novel model to steadily convert songs while keeping their naturalness and intonation. We build an end-to-end architecture, taking phonetic posteriorgrams (PPGs) as inputs and generating mel spectrograms. Specifically, we implement two separate encoders: one encodes PPGs as content, and the other compresses mel spectrograms to supply acoustic and musical information. To improve the performance on timbre and melody, an adversarial singer confusion module and a mel-regressive representation learning module are designed for the model. Objective and subjective experiments are conducted on our private Chinese singing corpus. Comparing with the baselines, our methods can significantly improve the conversion performance in terms of naturalness, melody, and voice similarity. Moreover, our PPG-based method is proved to be robust for noisy sources.


title: Large-Scale MIDI-based Composer Classification

abstract: Music classification is a task to classify a music piece into labels such as genres or composers. We propose large-scale MIDI based composer classification systems using GiantMIDI-Piano, a transcription-based dataset. We propose to use piano rolls, onset rolls, and velocity rolls as input representations and use deep neural networks as classifiers. To our knowledge, we are the first to investigate the composer classification problem with up to 100 composers. By using convolutional recurrent neural networks as models, our MIDI based composer classification system achieves a 10-composer and a 100-composer classification accuracies of 0.648 and 0.385 (evaluated on 30-second clips) and 0.739 and 0.489 (evaluated on music pieces), respectively. Our MIDI based composer system outperforms several audio-based baseline classification systems, indicating the effectiveness of using compact MIDI representations for composer classification.


title: The Volctrans Machine Translation System for WMT20

abstract: This paper describes our VolcTrans system on WMT20 shared news translation task. We participated in 8 translation directions. Our basic systems are based on Transformer, with several variants (wider or deeper Transformers, dynamic convolutions). The final system includes text pre-process, data selection, synthetic data generation, advanced model ensemble, and multilingual pre-training.


title: Controlling crackling dynamics by triggering low intensity avalanches

abstract: We examine the effect of small, spatially localized, excitations applied periodically in different manners, on the crackling dynamics of a brittle crack driven slowly in a heterogeneous solid. When properly adjusted, these excitations are observed to radically modify avalanche statistics and considerably limit the magnitude of the largest events. Surprisingly, this does not require information on the front loading state at the time of excitation; applying it either at a random location or at the most loaded point gives the same results. Subsequently, we unravel how the excitation amplitude, spatial extent and frequency govern the effect. We find that the excitation efficiency is ruled by a single reduced parameter, namely the injected power per unit front length; the suppression of extreme avalanches is maximum at a well-defined optimal value of this control parameter. This analysis opens a new way to control largest events in crackling dynamics. Beyond fracture problems, it may be relevant for crackling systems described by models of the same universality class, such as the wetting of heterogeneous substrates or magnetic walls in amorphous magnets.


title: AbdomenCT-1K: Is Abdominal Organ Segmentation A Solved Problem?

abstract: With the unprecedented developments in deep learning, automatic segmentation of main abdominal organs seems to be a solved problem as state-of-the-art (SOTA) methods have achieved comparable results with inter-rater variability on many benchmark datasets. However, most of the existing abdominal datasets only contain single-center, single-phase, single-vendor, or single-disease cases, and it is unclear whether the excellent performance can generalize on diverse datasets. This paper presents a large and diverse abdominal CT organ segmentation dataset, termed AbdomenCT-1K, with more than 1000 (1K) CT scans from 12 medical centers, including multi-phase, multi-vendor, and multi-disease cases. Furthermore, we conduct a large-scale study for liver, kidney, spleen, and pancreas segmentation and reveal the unsolved segmentation problems of the SOTA methods, such as the limited generalization ability on distinct medical centers, phases, and unseen diseases. To advance the unsolved problems, we further build four organ segmentation benchmarks for fully supervised, semi-supervised, weakly supervised, and continual learning, which are currently challenging and active research topics. Accordingly, we develop a simple and effective method for each benchmark, which can be used as out-of-the-box methods and strong baselines. We believe the AbdomenCT-1K dataset will promote future in-depth research towards clinical applicable abdominal organ segmentation methods. The datasets, codes, and trained models are publicly available at https://github.com/JunMa11/AbdomenCT-1K.


title: About a conjecture of Lieb-Solovej

abstract: Very recently, E. H. Lieb and J. P. Solovej stated a conjecture about the constant of embedding between two Bergman spaces of the upper-half plane. A question in relation with a Werhl-type entropy inequality for the affine $AX+B$ group. More precisely, that for any holomorphic function $F$ on the upper-half plane $\Pi^+$, $$\int_{\Pi^+}|F(x+iy)|^{2s}y^{2s-2}dxdy\le \frac{\pi^{1-s}}{(2s-1)2^{2s-2}}\left(\int_{\Pi^+}|F(x+iy)|^2 dxdy\right)^s $$ for $s\ge 1$, and the constant $\frac{\pi^{1-s}}{(2s-1)2^{2s-2}}$ is sharp. We prove differently that the above holds whenever $s$ is an integer and we prove that it holds when $s\rightarrow\infty$. We also prove that when restricted to powers of the Bergman kernel, the conjecture holds. We next study the case where $s$ is close to $1.$ Hereafter, we transfer the conjecture to the unit disc where we show that the conjecture holds when restricted to analytic monomials. Finally, we overview the bounds we obtain in our attempts to prove the conjecture.


title: Cycle-Contrast for Self-Supervised Video Representation Learning

abstract: We present Cycle-Contrastive Learning (CCL), a novel self-supervised method for learning video representation. Following a nature that there is a belong and inclusion relation of video and its frames, CCL is designed to find correspondences across frames and videos considering the contrastive representation in their domains respectively. It is different from recent approaches that merely learn correspondences across frames or clips. In our method, the frame and video representations are learned from a single network based on an R3D architecture, with a shared non-linear transformation for embedding both frame and video features before the cycle-contrastive loss. We demonstrate that the video representation learned by CCL can be transferred well to downstream tasks of video understanding, outperforming previous methods in nearest neighbour retrieval and action recognition tasks on UCF101, HMDB51 and MMAct.