title: On quantum determinants in integrable quantum gravity

abstract: Einstein-Rosen waves with two polarizations are cylindrically symmetric solutions to vacuum Einstein equations. Einstein equations in this case reduce to an integrable system. In 1971, Geroch has shown that this system admits an infinite-dimensional group of symmetry transformations known as the Geroch group. The phase space of this system can be parametrized by a matrix-valued function of spectral parameter, called monodromy matrix. The latter admits the Riemann-Hilbert factorization into a pair of transition matrices, i.e. matrix-valued functions of spectral parameter such that one of them is holomorphic in the upper half-plane, and the other is holomorphic in the lower half-plane. The classical Geroch group preserves the determinants of transition and monodromy matrices by construction. The algebraic quantization of the quadratic Poisson algebra generated by transition matrices of Einstein-Rosen system was proposed by Korotkin and Samtleben in 1997. Paternain, Perasa and Reisenberger have recently suggested a quantization of the Geroch group, which can be considered as a symmetry of the quantum algebra of observables. They have shown that commutation relations involving quantum monodromy matrices are preserved by the action of the quantum Geroch group. In present paper we introduce the notion of the determinant of the quantum monodromy matrix. We derive a factorization formula expressing the quantum determinant of the monodromy matrix as a product of the quantum determinants of the transition matrices. The action of the quantum Geroch group is extended from the subalgebra generated by the monodromy matrix onto the full algebra of observables. This extension is used to prove that the quantum determinant of the quantum monodromy matrix is invariant under the action of quantum Geroch group.


title: Non-Stochastic Private Function Evaluation

abstract: We consider private function evaluation to provide query responses based on private data of multiple untrusted entities in such a way that each cannot learn something substantially new about the data of others. First, we introduce perfect non-stochastic privacy in a two-party scenario. Perfect privacy amounts to conditional unrelatedness of the query response and the private uncertain variable of other individuals conditioned on the uncertain variable of a given entity. We show that perfect privacy can be achieved for queries that are functions of the common uncertain variable, a generalization of the common random variable. We compute the closest approximation of the queries that do not take this form. To provide a trade-off between privacy and utility, we relax the notion of perfect privacy. We define almost perfect privacy and show that this new definition equates to using conditional disassociation instead of conditional unrelatedness in the definition of perfect privacy. Then, we generalize the definitions to multi-party function evaluation (more than two data entities). We prove that uniform quantization of query responses, where the quantization resolution is a function of privacy budget and sensitivity of the query (cf., differential privacy), achieves function evaluation privacy.


title: The Effect of Spectrogram Reconstruction on Automatic Music Transcription: An Alternative Approach to Improve Transcription Accuracy

abstract: Most of the state-of-the-art automatic music transcription (AMT) models break down the main transcription task into sub-tasks such as onset prediction and offset prediction and train them with onset and offset labels. These predictions are then concatenated together and used as the input to train another model with the pitch labels to obtain the final transcription. We attempt to use only the pitch labels (together with spectrogram reconstruction loss) and explore how far this model can go without introducing supervised sub-tasks. In this paper, we do not aim at achieving state-of-the-art transcription accuracy, instead, we explore the effect that spectrogram reconstruction has on our AMT model. Our proposed model consists of two U-nets: the first U-net transcribes the spectrogram into a posteriorgram, and a second U-net transforms the posteriorgram back into a spectrogram. A reconstruction loss is applied between the original spectrogram and the reconstructed spectrogram to constrain the second U-net to focus only on reconstruction. We train our model on three different datasets: MAPS, MAESTRO, and MusicNet. Our experiments show that adding the reconstruction loss can generally improve the note-level transcription accuracy when compared to the same model without the reconstruction part. Moreover, it can also boost the frame-level precision to be higher than the state-of-the-art models. The feature maps learned by our U-net contain gridlike structures (not present in the baseline model) which implies that with the presence of the reconstruction loss, the model is probably trying to count along both the time and frequency axis, resulting in a higher note-level transcription accuracy.


title: Optimal building block of multipartite quantum battery

abstract: To take quantum advantage of collective effects in many-body system, we design an elementary block for building multipartite quantum battery, which enables charging an atomic ensemble with optimal numbers in a common thermal bath. One achieves maximum free energy as the stored energy in the steady state, which is prior to each atom parallel charging independently. It ascribes to quantum collective effects in the ensemble of atoms induced by the competition between the coherent driving and decoherent dissipation. The corresponding thermodynamic efficiency of the energy storage is analyzed. The existence of the optimal elementary units of multipartite quantum battery provide a guideline for designing a realizable charging scheme.


title: A meta-inference framework to integrate multiple external models into a current study

abstract: It is becoming increasingly common for researchers to consider incorporating external information from large studies to improve the accuracy of statistical inference instead of relying on a modestly sized dataset collected internally. With some new predictors only available internally, we aim to build improved regression models based on individual-level data from an "internal" study while incorporating summary-level information from "external" models. We propose a meta-analysis framework along with two weighted estimators as the composite of empirical Bayes estimators, which combines the estimates from the different external models. The proposed framework is flexible and robust in the ways that (i) it is capable of incorporating external models that use a slightly different set of covariates; (ii) it can identify the most relevant external information and diminish the influence of information that is less compatible with the internal data; and (iii) it nicely balances the bias-variance trade-off while preserving the most efficiency gain. The proposed estimators are more efficient than the naive analysis of the internal data and other naive combinations of external estimators.


title: A local-in-time theory for singular SDEs with applications to fluid models with transport noise

abstract: In this paper, we establish a local theory, i.e., existence, uniqueness and blow-up criterion, for a general family of singular SDEs in some Hilbert space. The key requirement is an approximation property that allows us to embed the singular drift and diffusion mappings into a hierarchy of regular mappings that are invariant with respect to the Hilbert space and enjoy a cancellation property. Various nonlinear models in fluid dynamics with transport noise belong to this type of singular SDEs. With a cancellation estimate for generalized Lie derivative operators, we can construct such regular approximations for cases involving the Lie derivative operators, or more generally, differential operators of order one with suitable coefficients. In particular, we apply the abstract theory to achieve novel local-in-time results for the stochastic two-component Camassa--Holm (CH) system and for the stochastic C\'ordoba-C\'ordoba-Fontelos (CCF) model.


title: The Tur\'{a}n number of book graphs

abstract: Given a graph $H$ and a positive integer $n,$ the Tur\'{a}n number of $H$ for the order $n,$ denoted ${\rm ex}(n,H),$ is the maximum size of a simple graph of order $n$ not containing $H$ as a subgraph. The book with $p$ pages, denoted $B_p$, is the graph that consists of $p$ triangles sharing a common edge. Bollob\'{a}s and Erd\H{o}s initiated the research on the Tur\'{a}n number of book graphs in 1975. The two numbers ${\rm ex}(p+2,B_p)$ and ${\rm ex}(p+3,B_p)$ have been determined by Qiao and Zhan. In this paper we determine the numbers ${\rm ex}(p+4,B_p),$ ${\rm ex}(p+5,B_p)$ and ${\rm ex}(p+6,B_p),$ and characterize the corresponding extremal graphs for the numbers ${\rm ex}(n,B_p)$ with $n=p+2,\,p+3,\,p+4,\,p+5.$


title: Scalable Statistical Root Cause Analysis on App Telemetry

abstract: Despite engineering workflows that aim to prevent buggy code from being deployed, bugs still make their way into the Facebook app. When symptoms of these bugs, such as user submitted reports and automatically captured crashes, are reported, finding their root causes is an important step in resolving them. However, at Facebook's scale of billions of users, a single bug can manifest as several different symptoms according to the various user and execution environments in which the software is deployed. Root cause analysis (RCA) therefore requires tedious manual investigation and domain expertise to extract out common patterns that are observed in groups of reports and use them for debugging. We propose Minesweeper, a technique for RCA that moves towards automatically identifying the root cause of bugs from their symptoms. The method is based on two key aspects: (i) a scalable algorithm to efficiently mine patterns from telemetric information that is collected along with the reports, and (ii) statistical notions of precision and recall of patterns that help point towards root causes. We evaluate Minesweeper's scalability and effectiveness in finding root causes from symptoms on real world bug and crash reports from Facebook's apps. Our evaluation demonstrates that Minesweeper can perform RCA for tens of thousands of reports in less than 3 minutes, and is more than 85% accurate in identifying the root cause of regressions.


title: Calliope: Automatic Visual Data Story Generation from a Spreadsheet

abstract: Visual data stories shown in the form of narrative visualizations such as a poster or a data video, are frequently used in data-oriented storytelling to facilitate the understanding and memorization of the story content. Although useful, technique barriers, such as data analysis, visualization, and scripting, make the generation of a visual data story difficult. Existing authoring tools rely on users' skills and experiences, which are usually inefficient and still difficult. In this paper, we introduce a novel visual data story generating system, Calliope, which creates visual data stories from an input spreadsheet through an automatic process and facilities the easy revision of the generated story based on an online story editor. Particularly, Calliope incorporates a new logic-oriented Monte Carlo tree search algorithm that explores the data space given by the input spreadsheet to progressively generate story pieces (i.e., data facts) and organize them in a logical order. The importance of data facts is measured based on information theory, and each data fact is visualized in a chart and captioned by an automatically generated description. We evaluate the proposed technique through three example stories, two controlled experiments, and a series of interviews with 10 domain experts. Our evaluation shows that Calliope is beneficial to efficient visual data story generation.


title: Improved Frequency Ratio Measurement with 87Sr and 171Yb Optical Lattice Clocks at NMIJ

abstract: We report improved frequency ratio measurement with $^{87}$Sr and $^{171}$Yb optical lattice clocks at the National Metrology Institute of Japan (NMIJ). The $^{87}$Sr optical lattice clock is enhanced with several major modifications and is re-evaluated with a reduced uncertainty of $1.1\times10^{-16}$. We employed a $^{171}$Yb optical lattice clock with an uncertainty of $4\times10^{-16}$ that was developed for contributing to International Atomic Time (TAI). The measurement result is $\nu_{\mathrm{Yb}}/\nu_{\mathrm{Sr}}$ = 1.207 507 039 343 338 58(49)$_{\mathrm{sys}}$(6)$_{\mathrm{stat}}$ with a fractional uncertainty of $4.1\times10^{-16}$, which is 3.4 times smaller than our previous measurement result.


title: Industry-scale IR-based Bug Localization: A Perspective from Facebook

abstract: We explore the application of Information Retrieval (IR) based bug localization methods at a large industrial setting, Facebook. Facebook's code base evolves rapidly, with thousands of code changes being committed to a monolithic repository every day. When a bug is detected, it is often time-sensitive and imperative to identify the commit causing the bug in order to either revert it or fix it. This is complicated by the fact that bugs often manifest with complex and unwieldy features, such as stack traces and other metadata. Code commits also have various features associated with them, ranging from developer comments to test results. This poses unique challenges to bug localization methods, making it a highly non-trivial operation. In this paper we lay out several practical concerns for industry-level IR-based bug localization, and propose Bug2Commit, a tool that is designed to address these concerns. We also assess the effectiveness of existing IR-based localization techniques from the software engineering community, and find that in the presence of complex queries or documents, which are common at Facebook, existing approaches do not perform as well as Bug2Commit. We evaluate Bug2Commit on three applications at Facebook: client-side crashes from the mobile app, server-side performance regressions, and mobile simulation tests for performance. We find that Bug2Commit outperforms the accuracy of existing approaches by up to 17%, leading to reduced time for triaging regressions and attributing bugs found in simulations.


title: Stronger, Faster and More Explainable: A Graph Convolutional Baseline for Skeleton-based Action Recognition

abstract: One essential problem in skeleton-based action recognition is how to extract discriminative features over all skeleton joints. However, the complexity of the State-Of-The-Art (SOTA) models of this task tends to be exceedingly sophisticated and over-parameterized, where the low efficiency in model training and inference has obstructed the development in the field, especially for large-scale action datasets. In this work, we propose an efficient but strong baseline based on Graph Convolutional Network (GCN), where three main improvements are aggregated, i.e., early fused Multiple Input Branches (MIB), Residual GCN (ResGCN) with bottleneck structure and Part-wise Attention (PartAtt) block. Firstly, an MIB is designed to enrich informative skeleton features and remain compact representations at an early fusion stage. Then, inspired by the success of the ResNet architecture in Convolutional Neural Network (CNN), a ResGCN module is introduced in GCN to alleviate computational costs and reduce learning difficulties in model training while maintain the model accuracy. Finally, a PartAtt block is proposed to discover the most essential body parts over a whole action sequence and obtain more explainable representations for different skeleton action sequences. Extensive experiments on two large-scale datasets, i.e., NTU RGB+D 60 and 120, validate that the proposed baseline slightly outperforms other SOTA models and meanwhile requires much fewer parameters during training and inference procedures, e.g., at most 34 times less than DGNN, which is one of the best SOTA methods.


title: An Efficient Algorithm for Device Detection and Channel Estimation in Asynchronous IoT Systems

abstract: A great amount of endeavour has recently been devoted to the joint device activity detection and channel estimation problem in massive machine-type communications. This paper targets at two practical issues along this line that have not been addressed before: asynchronous transmission from uncoordinated users and efficient algorithms for real-time implementation in systems with a massive number of devices. Specifically, this paper considers a practical system where the preamble sent by each active device is delayed by some unknown number of symbols due to the lack of coordination. We manage to cast the problem of detecting the active devices and estimating their delay and channels into a group LASSO problem. Then, a block coordinate descent algorithm is proposed to solve this problem globally, where the closed-form solution is available when updating each block of variables with the other blocks of variables being fixed, thanks to the special structure of our interested problem. Our analysis shows that the overall complexity of the proposed algorithm is low, making it suitable for real-time application.


title: Temperature increases and thermoplastic microstructural evolution in adiabatic shear bands in a high-strength and high-toughness 10 wt.% Ni steel

abstract: A 10 wt.% nickel-steel has been developed for high pressures and low-temperature applications, due to its high strength, excellent toughness, and low ductile-to-brittle transition temperature (DBTT). Under dynamic loading conditions this steel is, however, prone to shear localization that manifests as adiabatic shear bands (ASBs). The temperature increases and thermoplastic microstructural evolution in the ASB are studied in detail, from the macroscopic length scale to the atomic-scale employing correlative electron-backscatter diffraction (EBSD), transmission electron microscopy (TEM), and atom-probe tomography (APT). From a calculation of the temperature increase under adiabatic conditions, based on the conversion of plastic-work to heat generation, the microstructural transitions in the ASB are discussed specifically for: (i) a b.c.c.-f.c.c. phase-transformation and their elemental partitioning; (ii) the thermodynamic model for the compositional change of the V(Nb)-rich carbonitride precipitates during a temperature increase; and (iii) grain-refinement and rotation by dynamic/mechanical recrystallization processes. Solute segregation at subgrain boundaries, measured using the Gibbsian interfacial excess methodology, reveals how solute segregation contributes to the instability of localized shear-deformation by promoting the depinning of solute elements and the migration of a grain boundary. Finally, a kinetic model for grain refinement/rotation within an ASB is described by the dynamic recrystallization behavior with: (i) subgrain formation; (ii) rotation/refinement by deformation; and (iii) grain growth by subgrain coalescence with further rotation and a temperature increase. The temperature increase under dynamic deformation in an ASB promotes grain boundary migration and subgrain coalescence to create a large degree of equiaxed grains with a low density of imperfections.


title: The local entropy along Ricci flow---Part B: the pseudo-locality theorems

abstract: We localize the entropy functionals of G. Perelman and generalize his no-local-collapsing theorem and pseudo-locality theorem. Our generalization is technically inspired by further development of Li-Yau estimates along the Ricci flow. It has various applications, including to show the continuous dependence of the Ricci flow with respect to the initial metric in Gromov-Hausdorff topology with Ricci curvature bounded below, and to show the compactness of the moduli of K\"ahler manifolds with bounded scalar curvature and a rough locally almost Euclidean condition.


title: Depth Guided Adaptive Meta-Fusion Network for Few-shot Video Recognition

abstract: Humans can easily recognize actions with only a few examples given, while the existing video recognition models still heavily rely on the large-scale labeled data inputs. This observation has motivated an increasing interest in few-shot video action recognition, which aims at learning new actions with only very few labeled samples. In this paper, we propose a depth guided Adaptive Meta-Fusion Network for few-shot video recognition which is termed as AMeFu-Net. Concretely, we tackle the few-shot recognition problem from three aspects: firstly, we alleviate this extremely data-scarce problem by introducing depth information as a carrier of the scene, which will bring extra visual information to our model; secondly, we fuse the representation of original RGB clips with multiple non-strictly corresponding depth clips sampled by our temporal asynchronization augmentation mechanism, which synthesizes new instances at feature-level; thirdly, a novel Depth Guided Adaptive Instance Normalization (DGAdaIN) fusion module is proposed to fuse the two-stream modalities efficiently. Additionally, to better mimic the few-shot recognition process, our model is trained in the meta-learning way. Extensive experiments on several action recognition benchmarks demonstrate the effectiveness of our model.


title: Quandles versus symmetric quandles for oriented links

abstract: Given a quandle, we can construct a symmetric quandle called the symmetric double of the quandle. We show that the (co)homology groups of a given quandle are isomorphic to those of its symmetric double. Moreover, quandle coloring numbers and quandle cocycle invariants of oriented links and oriented surface-links can be interpreted by using symmetric quandles.


title: ivadomed: A Medical Imaging Deep Learning Toolbox

abstract: ivadomed is an open-source Python package for designing, end-to-end training, and evaluating deep learning models applied to medical imaging data. The package includes APIs, command-line tools, documentation, and tutorials. ivadomed also includes pre-trained models such as spinal tumor segmentation and vertebral labeling. Original features of ivadomed include a data loader that can parse image metadata (e.g., acquisition parameters, image contrast, resolution) and subject metadata (e.g., pathology, age, sex) for custom data splitting or extra information during training and evaluation. Any dataset following the Brain Imaging Data Structure (BIDS) convention will be compatible with ivadomed without the need to manually organize the data, which is typically a tedious task. Beyond the traditional deep learning methods, ivadomed features cutting-edge architectures, such as FiLM and HeMis, as well as various uncertainty estimation methods (aleatoric and epistemic), and losses adapted to imbalanced classes and non-binary predictions. Each step is conveniently configurable via a single file. At the same time, the code is highly modular to allow addition/modification of an architecture or pre/post-processing steps. Example applications of ivadomed include MRI object detection, segmentation, and labeling of anatomical and pathological structures. Overall, ivadomed enables easy and quick exploration of the latest advances in deep learning for medical imaging applications. ivadomed's main project page is available at https://ivadomed.org.


title: Power pooling: An adaptive pooling function for weakly labelled sound event detection

abstract: Access to large corpora with strongly labelled sound events is expensive and difficult in engineering applications. Much research turns to address the problem of how to detect both the types and the timestamps of sound events with weak labels that only specify the types. This task can be treated as a multiple instance learning (MIL) problem, and the key to it is the design of a pooling function. In this paper, we propose an adaptive power pooling function which can automatically adapt to various sound sources. On two public datasets, the proposed power pooling function outperforms the state-of-the-art linear softmax pooling on both coarsegrained and fine-grained metrics. Notably, it improves the event-based F1 score (which evaluates the detection of event onsets and offsets) by 11.4% and 10.2% relative on the two datasets. While this paper focuses on sound event detection applications, the proposed method can be applied to MIL tasks in other domains.


title: Determination of the spin axis in quantum spin Hall insulator monolayer WTe2

abstract: Evidence for the quantum spin Hall (QSH) effect has been reported in several experimental systems in the form of approximately quantized edge conductance. However, the most fundamental feature of the QSH effect, spin-momentum locking in the edge channels, has never been demonstrated experimentally. Here, we report clear evidence for spin-momentum locking in the edge channels of monolayer WTe2, thought to be a two-dimensional topological insulator (2D TI). We observe that the edge conductance is controlled by the component of an applied magnetic field perpendicular to a particular axis, which we identify as the spin axis. The axis is the same for all edges, situated in the mirror plane perpendicular to the tungsten chains at 40$\pm$2{\deg} to the layer normal, implying that the spin-orbit coupling is inherited from the bulk band structure. We show that this finding is consistent with theory if the band-edge orbitals are taken to have like parity. We conclude that this parity assignment is correct and that both edge states and bulk bands in monolayer WTe2 share the same simple spin structure. Combined with other known features of the edge states this establishes spin-momentum locking, and therefore that monolayer WTe2 is truly a natural 2D TI.


title: L-RED: Efficient Post-Training Detection of Imperceptible Backdoor Attacks without Access to the Training Set

abstract: Backdoor attacks (BAs) are an emerging form of adversarial attack typically against deep neural network image classifiers. The attacker aims to have the classifier learn to classify to a target class when test images from one or more source classes contain a backdoor pattern, while maintaining high accuracy on all clean test images. Reverse-Engineering-based Defenses (REDs) against BAs do not require access to the training set but only to an independent clean dataset. Unfortunately, most existing REDs rely on an unrealistic assumption that all classes except the target class are source classes of the attack. REDs that do not rely on this assumption often require a large set of clean images and heavy computation. In this paper, we propose a Lagrangian-based RED (L-RED) that does not require knowledge of the number of source classes (or whether an attack is present). Our defense requires very few clean images to effectively detect BAs and is computationally efficient. Notably, we detect 56 out of 60 BAs using only two clean images per class in our experiments on CIFAR-10.


title: Transition path theory for Langevin dynamics on manifold: optimal control and data-driven solver

abstract: We present a data-driven point of view for rare events, which represent conformational transitions in biochemical reactions modeled by over-damped Langevin dynamics on manifolds in high dimensions. We first reinterpret the transition state theory and the transition path theory from the optimal control viewpoint. Given point clouds sampled from a reaction dynamics, we construct a discrete Markov process based on an approximated Voronoi tesselation. We use the constructed Markov process to compute a discrete committor function whose level set automatically orders the point clouds. Then based on the committor function, an optimally controlled random walk on point clouds is constructed and utilized to efficiently sample transition paths, which become an almost sure event in $O(1)$ time instead of a rare event in the original reaction dynamics. To compute the mean transition path efficiently, a local averaging algorithm based on the optimally controlled random walk is developed, which adapts the finite temperature string method to the controlled Monte Carlo samples. Numerical examples on sphere/torus including a conformational transition for the alanine dipeptide in vacuum are conducted to illustrate the data-driven solver for the transition path theory on point clouds. The mean transition path obtained via the controlled Monte Carlo simulations highly coincides with the computed dominant transition path in the transition path theory.


title: Wasserstein K-Means for Clustering Tomographic Projections

abstract: Motivated by the 2D class averaging problem in single-particle cryo-electron microscopy (cryo-EM), we present a k-means algorithm based on a rotationally-invariant Wasserstein metric for images. Unlike existing methods that are based on Euclidean ($L_2$) distances, we prove that the Wasserstein metric better accommodates for the out-of-plane angular differences between different particle views. We demonstrate on a synthetic dataset that our method gives superior results compared to an $L_2$ baseline. Furthermore, there is little computational overhead, thanks to the use of a fast linear-time approximation to the Wasserstein-1 metric, also known as the Earthmover's distance.


title: The Open Catalyst 2020 (OC20) Dataset and Community Challenges

abstract: Catalyst discovery and optimization is key to solving many societal and energy challenges including solar fuels synthesis, long-term energy storage, and renewable fertilizer production. Despite considerable effort by the catalysis community to apply machine learning models to the computational catalyst discovery process, it remains an open challenge to build models that can generalize across both elemental compositions of surfaces and adsorbate identity/configurations, perhaps because datasets have been smaller in catalysis than related fields. To address this we developed the OC20 dataset, consisting of 1,281,040 Density Functional Theory (DFT) relaxations (~264,890,000 single point evaluations) across a wide swath of materials, surfaces, and adsorbates (nitrogen, carbon, and oxygen chemistries). We supplemented this dataset with randomly perturbed structures, short timescale molecular dynamics, and electronic structure analyses. The dataset comprises three central tasks indicative of day-to-day catalyst modeling and comes with pre-defined train/validation/test splits to facilitate direct comparisons with future model development efforts. We applied three state-of-the-art graph neural network models (CGCNN, SchNet, Dimenet++) to each of these tasks as baseline demonstrations for the community to build on. In almost every task, no upper limit on model size was identified, suggesting that even larger models are likely to improve on initial results. The dataset and baseline models are both provided as open resources, as well as a public leader board to encourage community contributions to solve these important tasks.


title: Coxeter invariants for non-negative unit forms of Dynkin type A

abstract: Two integral quadratic unit forms are called strongly Gram congruent if their upper triangular Gram matrices are Z-congruent. The paper gives a combinatorial strong Gram invariant for those unit forms that are non-negative of Dynkin type A, within the framework introduced in [Fundamenta Informaticae 184(1):49-82, 2021], and uses it to determine all corresponding Coxeter polynomials and (reduced) Coxeter numbers.


title: Bernstein polynomial-based transcription method for solving optimal trajectory generation problems

abstract: This paper presents a method and an open-source implementation, Bernstein/B\'ezier Optimal Trajectories (BeBOT), for the generation of trajectories for autonomous system operations. The proposed method is based on infinite dimensional optimal control formulations of trajectory generation problems. By approximating the trajectories using Bernstein polynomials, these problems can be transcribed as nonlinear programming problems, which can then be solved using off-the-shelf solvers. Bernstein polynomials possess favorable geometric properties that enable the trajectory planner to efficiently evaluate and enforce constraints along the vehicles' trajectories, including maximum speed and angular rates, minimum distance between trajectories and between the vehicles and obstacles. By virtue of these properties, feasibility and safety constraints typically imposed in autonomous vehicle operations can be enforced and guaranteed independently on the order of the polynomials. Thus, the trajectory generation algorithm can efficiently generate feasible and collision-free trajectories, and can be deployed for real-time safety critical applications in complex environments and for multiple vehicle missions.


title: Robust Asynchronous and Network-Independent Cooperative Learning

abstract: We consider the model of cooperative learning via distributed non-Bayesian learning, where a network of agents tries to jointly agree on a hypothesis that best described a sequence of locally available observations. Building upon recently proposed weak communication network models, we propose a robust cooperative learning rule that allows asynchronous communications, message delays, unpredictable message losses, and directed communication among nodes. We show that our proposed learning dynamics guarantee that all agents in the network will have an asymptotic exponential decay of their beliefs on the wrong hypothesis, indicating that the beliefs of all agents will concentrate on the optimal hypotheses. Numerical experiments provide evidence on a number of network setups.


title: Entropy stable discontinuous Galerkin methods for nonlinear conservation laws on networks and multi-dimensional domains

abstract: We present a high-order entropy stable discontinuous Galerkin (ESDG) method for nonlinear conservation laws on both multi-dimensional domains and on networks constructed from one-dimensional domains. These methods utilize treatments of multi-dimensional interfaces and network junctions which retain entropy stability when coupling together entropy stable discretizations. Numerical experiments verify the stability of the proposed schemes, and comparisons with fully 2D implementations demonstrate the accuracy of each type of junction treatment.


title: POND: Pessimistic-Optimistic oNline Dispatching

abstract: This paper considers constrained online dispatching with unknown arrival, reward and constraint distributions. We propose a novel online dispatching algorithm, named POND, standing for Pessimistic-Optimistic oNline Dispatching, which achieves $O(\sqrt{T})$ regret and $O(1)$ constraint violation. Both bounds are sharp. Our experiments on synthetic and real datasets show that POND achieves low regret with minimal constraint violations.


title: On counting cuspidal automorphic representations for $\mathrm{GSp}(4)$

abstract: We find the number $s_k(p,\Omega)$ of cuspidal automorphic representations of $\mathrm{GSp}(4,\mathbb{A}_{\mathbb{Q}})$ with trivial central character such that the archimedean component is a holomorphic discrete series representation of weight $k\ge 3$, and the non-archimedean component at $p$ is an Iwahori-spherical representation of type $\Omega$ and unramified otherwise. Using the automorphic Plancherel density theorem, we show how a limit version of our formula for $s_k(p,\Omega)$ generalizes to the vector-valued case and a finite number of ramified places.


title: Word Shape Matters: Robust Machine Translation with Visual Embedding

abstract: Neural machine translation has achieved remarkable empirical performance over standard benchmark datasets, yet recent evidence suggests that the models can still fail easily dealing with substandard inputs such as misspelled words, To overcome this issue, we introduce a new encoding heuristic of the input symbols for character-level NLP models: it encodes the shape of each character through the images depicting the letters when printed. We name this new strategy visual embedding and it is expected to improve the robustness of NLP models because humans also process the corpus visually through printed letters, instead of machinery one-hot vectors. Empirically, our method improves models' robustness against substandard inputs, even in the test scenario where the models are tested with the noises that are beyond what is available during the training phase.


title: Strong Ferromagnetism Achieved via Breathing Lattices in Atomically Thin Cobaltites

abstract: Low-dimensional quantum materials that remain strongly ferromagnetic down to mono layer thickness are highly desired for spintronic applications. Although oxide materials are important candidates for next generation of spintronic, ferromagnetism decays severely when the thickness is scaled to the nano meter regime, leading to deterioration of device performance. Here we report a methodology for maintaining strong ferromagnetism in insulating LaCoO3 (LCO) layers down to the thickness of a single unit cell. We find that the magnetic and electronic states of LCO are linked intimately to the structural parameters of adjacent "breathing lattice" SrCuO2 (SCO). As the dimensionality of SCO is reduced, the lattice constant elongates over 10% along the growth direction, leading to a significant distortion of the CoO6 octahedra, and promoting a higher spin state and long-range spin ordering. For atomically thin LCO layers, we observe surprisingly large magnetic moment (0.5 uB/Co) and Curie temperature (75 K), values larger than previously reported for any mono layer oxide. Our results demonstrate a strategy for creating ultra thin ferromagnetic oxides by exploiting atomic hetero interface engineering,confinement-driven structural transformation, and spin-lattice entanglement in strongly correlated materials.


title: Bell-type correlation at quantum phase transitions in spin-1 chain

abstract: For the identification of non-trivial quantum phase, we exploit a Bell-type correlation that is applied to the one-dimensional spin-1 XXZ chain. It is found that our generalization of bipartite Bell correlation can take a decomposed form of transverse spin correlation together with high-order terms. The formulation of density-matrix renormalisation group is utilized to obtain the ground state of a given Hamiltonian with non-trivial phase. Subsequently Bell-SLK-type generalized correlation is evaluated through the analysis of the matrix product state. Diverse classes of quantum phase transitions in the spin-1 model are identified precisely through the evaluation of the first and the second moments of the generalized Bell correlations. The role of high-order terms in the criticality has been identified and their physical implications for the quantum phase has been revealed.


title: Explorable Tone Mapping Operators

abstract: Tone-mapping plays an essential role in high dynamic range (HDR) imaging. It aims to preserve visual information of HDR images in a medium with a limited dynamic range. Although many works have been proposed to provide tone-mapped results from HDR images, most of them can only perform tone-mapping in a single pre-designed way. However, the subjectivity of tone-mapping quality varies from person to person, and the preference of tone-mapping style also differs from application to application. In this paper, a learning-based multimodal tone-mapping method is proposed, which not only achieves excellent visual quality but also explores the style diversity. Based on the framework of BicycleGAN, the proposed method can provide a variety of expert-level tone-mapped results by manipulating different latent codes. Finally, we show that the proposed method performs favorably against state-of-the-art tone-mapping algorithms both quantitatively and qualitatively.


title: Contextual Heterogeneous Graph Network for Human-Object Interaction Detection

abstract: Human-object interaction(HOI) detection is an important task for understanding human activity. Graph structure is appropriate to denote the HOIs in the scene. Since there is an subordination between human and object---human play subjective role and object play objective role in HOI, the relations between homogeneous entities and heterogeneous entities in the scene should also not be equally the same. However, previous graph models regard human and object as the same kind of nodes and do not consider that the messages are not equally the same between different entities. In this work, we address such a problem for HOI task by proposing a heterogeneous graph network that models humans and objects as different kinds of nodes and incorporates intra-class messages between homogeneous nodes and inter-class messages between heterogeneous nodes. In addition, a graph attention mechanism based on the intra-class context and inter-class context is exploited to improve the learning. Extensive experiments on the benchmark datasets V-COCO and HICO-DET demonstrate that the intra-class and inter-class messages are very important in HOI detection and verify the effectiveness of our method.


title: Collusion attack and counterattack on the quantum key agreement via non-maximally entangled cluster states

abstract: Recently, Li et al. (Int J Theor Phys: DOI: 10.1007/s10773-020-04588-w, 2020) proposed a multiparty quantum key agreement protocol via non-maximally entangled cluster states. They claimed that the proposed protocol can help all the involved participants have equal influence on the final shared key. However, this study points out a loophole that makes Li et al.'s protocol suffer from a collusion attack, i.e. several dishonest participants can conspire to manipulate the final shared key without being detected by others. To avoid this loophole, an improvement is proposed here.


title: Signatures of $\alpha$ clustering in $^{16}$O by using a multiphase transport model

abstract: $\alpha$-clustered structures in light nuclei could be studied through "snapshots" taken by relativistic heavy-ion collisions. A multiphase transport (AMPT) model is employed to simulate the initial structure of collision nuclei and the proceeding collisions at center of mass energy $\sqrt{s_{NN}}$ = 6.37 TeV. This initial structure can finally be reflected in the subsequent observations, such as elliptic flow ($v_{2}$), triangular flow ($v_{3}$) and quadrangular flow ($v_4$). Three sets of the collision systems are chosen to illustrate system scan is a good way to identify the exotic $\alpha$-clustered nuclear structure, case I: $\mathrm{^{16}O}$ nucleus (with or without $\alpha$-cluster) + ordinary nuclei (always in Woods-Saxon distribution) in most central collisions, case II: $\mathrm{^{16}O}$ nucleus (with or without $\alpha$-cluster) + $\mathrm{^{197}Au}$ nucleus collisions for centrality dependence, and case III: symmetric collision systems (namely, $^{10}$B + $^{10}$B, $^{12}$C + $^{12}$C, $^{16}$O + $^{16}$O (with or without $\alpha$-cluster), $^{20}$Ne + $^{20}$Ne, and $^{40}$Ca + $^{40}$Ca) in most central collisions. Our calculations propose that relativistic heavy-ion collision experiments at $\sqrt{s_{NN}}$ = 6.37 TeV are promised to distinguish the tetrahedron structure of $\mathrm{^{16}O}$ from the Woods-Saxon one and shed lights on the system scan projects in experiments.


title: Convolutional-LSTM for Multi-Image to Single Output Medical Prediction

abstract: Medical head CT-scan imaging has been successfully combined with deep learning for medical diagnostics of head diseases and lesions[1]. State of the art classification models and algorithms for this task usually are based on 3d convolution layers for volumetric data on a supervised learning setting (1 input volume, 1 prediction per patient) or 2d convolution layers in a supervised setting (1 input image, 1 prediction per image). However a very common scenario in developing countries is to have the volume metadata lost due multiple reasons for example formatting conversion in images (for example .dicom to jpg), in this scenario the doctor analyses the collection of images and then emits a single diagnostic for the patient (with possibly an unfixed and variable number of images per patient) , this prevents it from being possible to use state of the art 3d models, but also is not possible to convert it to a supervised problem in a (1 image,1 diagnostic) setting because different angles or positions of the images for a single patient may not contain the disease or lesion. In this study we propose a solution for this scenario by combining 2d convolutional[2] models with sequence models which generate a prediction only after all images have been processed by the model for a given patient \(i\), this creates a multi-image to single-diagnostic setting \(y^i=f(x_1,x_2,..,x_n)\) where \(n\) may be different between patients. The experimental results demonstrate that it is possible to get a multi-image to single diagnostic model which mimics human doctor diagnostic process: evaluate the collection of patient images and then use important information in memory to decide a single diagnostic for the patient.


title: Subsets and Freezing Sets in the Digital Plane

abstract: We continue the study of freezing sets for digital images introduced in [4, 2, 3]. We prove methods for obtaining freezing sets for digital images (X, c_i) for X \subset Z^2 and i \in {1, 2}. We give examples to show how these methods can lead to the determination of minimal freezing sets.


title: SWIPENET: Object detection in noisy underwater images

abstract: In recent years, deep learning based object detection methods have achieved promising performance in controlled environments. However, these methods lack sufficient capabilities to handle underwater object detection due to these challenges: (1) images in the underwater datasets and real applications are blurry whilst accompanying severe noise that confuses the detectors and (2) objects in real applications are usually small. In this paper, we propose a novel Sample-WeIghted hyPEr Network (SWIPENET), and a robust training paradigm named Curriculum Multi-Class Adaboost (CMA), to address these two problems at the same time. Firstly, the backbone of SWIPENET produces multiple high resolution and semantic-rich Hyper Feature Maps, which significantly improve small object detection. Secondly, a novel sample-weighted detection loss function is designed for SWIPENET, which focuses on learning high weight samples and ignore learning low weight samples. Moreover, inspired by the human education process that drives the learning from easy to hard concepts, we here propose the CMA training paradigm that first trains a clean detector which is free from the influence of noisy data. Then, based on the clean detector, multiple detectors focusing on learning diverse noisy data are trained and incorporated into a unified deep ensemble of strong noise immunity. Experiments on two underwater robot picking contest datasets (URPC2017 and URPC2018) show that the proposed SWIPENET+CMA framework achieves better accuracy in object detection against several state-of-the-art approaches.


title: A Simple Baseline for Pose Tracking in Videos of Crowded Scenes

abstract: This paper presents our solution to ACM MM challenge: Large-scale Human-centric Video Analysis in Complex Events\cite{lin2020human}; specifically, here we focus on Track3: Crowd Pose Tracking in Complex Events. Remarkable progress has been made in multi-pose training in recent years. However, how to track the human pose in crowded and complex environments has not been well addressed. We formulate the problem as several subproblems to be solved. First, we use a multi-object tracking method to assign human ID to each bounding box generated by the detection model. After that, a pose is generated to each bounding box with ID. At last, optical flow is used to take advantage of the temporal information in the videos and generate the final pose tracking result.


title: Towards Accurate Human Pose Estimation in Videos of Crowded Scenes

abstract: Video-based human pose estimation in crowded scenes is a challenging problem due to occlusion, motion blur, scale variation and viewpoint change, etc. Prior approaches always fail to deal with this problem because of (1) lacking of usage of temporal information; (2) lacking of training data in crowded scenes. In this paper, we focus on improving human pose estimation in videos of crowded scenes from the perspectives of exploiting temporal context and collecting new data. In particular, we first follow the top-down strategy to detect persons and perform single-person pose estimation for each frame. Then, we refine the frame-based pose estimation with temporal contexts deriving from the optical-flow. Specifically, for one frame, we forward the historical poses from the previous frames and backward the future poses from the subsequent frames to current frame, leading to stable and accurate human pose estimation in videos. In addition, we mine new data of similar scenes to HIE dataset from the Internet for improving the diversity of training set. In this way, our model achieves best performance on 7 out of 13 videos and 56.33 average w\_AP on test dataset of HIE challenge.


title: Mean-Field Convergence of Systems of Particles with Coulomb Interactions in Higher Dimensions without Regularity

abstract: We consider first-order conservative systems of particles with binary Coulomb interactions in the mean-field scaling regime in dimensions $d\geq 3$. We show that if at some time, the associated sequence of empirical measures converges in a suitable sense to a probability measure with bounded density $\omega^0$ as the number of particles $N\rightarrow\infty$, then the sequence converges for short times in the weak-* topology for measures to the unique solution of the mean-field PDE with initial datum $\omega^0$. This result extends our previous work arXiv:2004.04140 for point vortices (i.e. $d=2$). In contrast to the previous work arXiv:1803.08345, our theorem only requires the limiting measure belong to a scaling-critical function space for the well-posedness of the mean-field PDE, in particular requiring no regularity. Our proof is based on a combination of the modulated-energy method of Serfaty and a novel mollification argument first introduced by the author in arXiv:2004.04140.


title: Deterministic Identification Over Fading Channels

abstract: Deterministic identification (DI) is addressed for Gaussian channels with fast and slow fading, where channel side information is available at the decoder. In particular, it is established that the number of messages scales as $2^{n\log(n)R}$, where $n$ is the block length and $R$ is the coding rate. Lower and upper bounds on the DI capacity are developed in this scale for fast and slow fading. Consequently, the DI capacity is infinite in the exponential scale and zero in the double-exponential scale, regardless of the channel noise.


title: Classical Communication Enhanced Quantum State Verification

abstract: Quantum state verification provides an efficient approach to characterize the reliability of quantum devices for generating certain target states. The figure of merit of a specific strategy is the estimated infidelity $\epsilon$ of the tested state to the target state, given a certain number of performed measurements n. Entangled measurements constitute the globally optimal strategy and achieve the scaling that \epsilon is inversely proportional to n. Recent advances show that it is possible to achieve the same scaling simply with non-adaptive local measurements, however, the performance is still worse than the globally optimal bound up to a constant factor. In this work, by introducing classical communication, we experimentally implement an adaptive quantum state verification. The constant-factor is minimized from ~2.5 to 1.5 in this experiment, which means that only 60% measurements are required to achieve a certain value of \epsilon compared to optimal non-adaptive local strategy. Our results indicate that classical communication significantly enhances the performance of quantum state verification, and leads to an efficiency that further approaches the globally optimal bound.


title: Preference-Based Batch and Sequential Teaching

abstract: Algorithmic machine teaching studies the interaction between a teacher and a learner where the teacher selects labeled examples aiming at teaching a target hypothesis. In a quest to lower teaching complexity, several teaching models and complexity measures have been proposed for both the batch settings (e.g., worst-case, recursive, preference-based, and non-clashing models) and the sequential settings (e.g., local preference-based model). To better understand the connections between these models, we develop a novel framework that captures the teaching process via preference functions $\Sigma$. In our framework, each function $\sigma \in \Sigma$ induces a teacher-learner pair with teaching complexity as $TD(\sigma)$. We show that the above-mentioned teaching models are equivalent to specific types/families of preference functions. We analyze several properties of the teaching complexity parameter $TD(\sigma)$ associated with different families of the preference functions, e.g., comparison to the VC dimension of the hypothesis class and additivity/sub-additivity of $TD(\sigma)$ over disjoint domains. Finally, we identify preference functions inducing a novel family of sequential models with teaching complexity linear in the VC dimension: this is in contrast to the best-known complexity result for the batch models, which is quadratic in the VC dimension.


title: Training Generative Adversarial Networks via stochastic Nash games

abstract: Generative adversarial networks (GANs) are a class of generative models with two antagonistic neural networks: a generator and a discriminator. These two neural networks compete against each other through an adversarial process that can be modeled as a stochastic Nash equilibrium problem. Since the associated training process is challenging, it is fundamental to design reliable algorithms to compute an equilibrium. In this paper, we propose a stochastic relaxed forward-backward (SRFB) algorithm for GANs and we show convergence to an exact solution when an increasing number of data is available. We also show convergence of an averaged variant of the SRFB algorithm to a neighborhood of the solution when only few samples are available. In both cases, convergence is guaranteed when the pseudogradient mapping of the game is monotone. This assumption is among the weakest known in the literature. Moreover, we apply our algorithm to the image generation problem.


title: Cullen numbers in sums of terms of recurrence sequence

abstract: Let $(U_n)_{n\geq 0}$ be a fixed linear recurrence sequence of integers with order at least two, and for any positive integer $\ell$, let $\ell \cdot 2^{\ell} + 1$ be a Cullen number. Recently in \cite{bmt}, generalized Cullen numbers in terms of linear recurrence sequence $(U_n)_{n\geq 0}$ under certain weak assumptions has been studied. However, there is an error in their proof. In this paper, we generalize their work, as well as our result fixes their error. In particular, for a given polynomial $Q(x) \in \mathbb{Z}[x]$ we consider the Diophantine equation $U_{n_1} + \cdots + U_{n_k} = \ell \cdot x^{\ell} + Q(x)$, and prove effective finiteness result. Furthermore, we demonstrate our method by an example.


title: Algodynamics: Teaching Algorithms using Interactive Transition Systems

abstract: The importance of algorithms and data structures in computer science curricula has been amply recognized. For many students, however, gaining a good understanding of algorithms remains a challenge. Because of the automated nature of sequential algorithms. there is an inherent tension in directly applying the `learning by doing' approach. This partly explains the limitations of efforts like algorithm animation and code tracing. Algodynamics, the approach we propose and advocate, situates algorithms within the framework of transition systems and their dynamics and offers an attractive approach for teaching algorithms. Algodynamics starts with the premise that the key ideas underlying an algorithm can be identified and packaged into interactive transition systems. The algorithm when `opened up', reveals a transition system, shorn of most control aspects, enriched instead with interaction. The design of an algorithm can be carried out by constructing a series of interactive systems, progressively trading interactivity with automation. These transition systems constitute a family of notional machines. We illustrate the algodynamics approach by considering Bubblesort. A sequence of five interactive transition systems culminate in the classic Bubblesort algorithm. The exercise of constructing the individual systems also pays off when coding Bubblesort: a highly modular implementation whose primitives are borrowed from the transition systems. The transition systems used for Bubblesort have been implemented as interactive experiments. These web based implementations are easy to build. The simplicity and flexibility afforded by the algodynamics framework makes it an attractive option to teach algorithms in an interactive way.


title: Action Sequence Augmentation for Early Graph-based Anomaly Detection

abstract: The proliferation of web platforms has created incentives for online abuse. Many graph-based anomaly detection techniques are proposed to identify the suspicious accounts and behaviors. However, most of them detect the anomalies once the users have performed many such behaviors. Their performance is substantially hindered when the users' observed data is limited at an early stage, which needs to be improved to minimize financial loss. In this work, we propose Eland, a novel framework that uses action sequence augmentation for early anomaly detection. Eland utilizes a sequence predictor to predict next actions of every user and exploits the mutual enhancement between action sequence augmentation and user-action graph anomaly detection. Experiments on three real-world datasets show that Eland improves the performance of a variety of graph-based anomaly detection methods. With Eland, anomaly detection performance at an earlier stage is better than non-augmented methods that need significantly more observed data by up to 15% on the Area under the ROC curve.


title: Average causal effect estimation via instrumental variables: the no simultaneous heterogeneity assumption

abstract: Background: Instrumental variables (IVs) can be used to provide evidence as to whether a treatment X has a causal effect on an outcome Y. Even if the instrument Z satisfies the three core IV assumptions of relevance, independence and the exclusion restriction, further assumptions are required to identify the average causal effect (ACE) of X on Y. Sufficient assumptions for this include: homogeneity in the causal effect of X on Y; homogeneity in the association of Z with X; and no effect modification (NEM). Methods: We describe the NO Simultaneous Heterogeneity (NOSH) assumption, which requires the heterogeneity in the X-Y causal effect to be mean independent of (i.e., uncorrelated with) both Z and heterogeneity in the Z-X association. This happens, for example, if there are no common modifiers of the X-Y effect and the Z-X association, and the X-Y effect is additive linear. We illustrate NOSH using simulations and by re-examining selected published studies. Results: When NOSH holds, the Wald estimand equals the ACE even if both homogeneity assumptions and NEM (which we demonstrate to be special cases of - and therefore stronger than - NOSH) are violated. Conclusions: NOSH is sufficient for identifying the ACE using IVs. Since NOSH is weaker than existing assumptions for ACE identification, doing so may be more plausible than previously anticipated.


title: Properties of heaviest nuclei with $98\leq Z \leq 126$ and $134 \leq N \leq 192$

abstract: We systematically determine ground-state and saddle-point shapes and masses for 1305 heavy and superheavy nuclei with $Z=98-126$ and $N=134-192$, including odd-$A$ and odd-odd systems. From these, we derive static fission barrier heights, one- and two-nucleon separation energies, and $Q_\alpha$ values for g.s. to g.s transitions. Our study is performed within the microscopic-macroscopic method with the deformed Woods-Saxon single-particle potential and the Yukawa-plus-exponential macroscopic energy taken as the smooth part. We use parameters of the model that were fitted previously to masses of even-even heavy nuclei. For systems with odd numbers of protons, neutrons, or both, we use a standard BCS method with blocking. Ground-state shapes and energies are found by the minimization over seven axially-symmetric deformations. A search for saddle-points was performed by using the "imaginary water flow" method in three consecutive stages, using five- (for nonaxial shapes) and seven-dimensional (for reflection-asymmetric shapes) deformation spaces. The results are collected in two main tables. Calculated ground-state mass excess, nucleon separation- and $Q_\alpha$ energies, total, macroscopic(normalized to the macroscopic energy at the spherical shape) and shell corrections energies, and deformations are given for each nucleus in \mbox{Table 1}. \mbox{Table 2} contains calculated properties of the saddle-point configurations and the fission barrier heights. In \mbox{Tables 3-7}, are given calculated ground-state, inner and outer saddle-point and superdeformed secondary minima characteristics for 75 actinide nuclei, from Ac to Cf, for which experimental estimates of fission barrier heights are known. These results are an additional test of our model.


title: Hierarchical Conditional Relation Networks for Multimodal Video Question Answering

abstract: Video QA challenges modelers in multiple fronts. Modeling video necessitates building not only spatio-temporal models for the dynamic visual channel but also multimodal structures for associated information channels such as subtitles or audio. Video QA adds at least two more layers of complexity - selecting relevant content for each channel in the context of the linguistic query, and composing spatio-temporal concepts and relations in response to the query. To address these requirements, we start with two insights: (a) content selection and relation construction can be jointly encapsulated into a conditional computational structure, and (b) video-length structures can be composed hierarchically. For (a) this paper introduces a general-reusable neural unit dubbed Conditional Relation Network (CRN) taking as input a set of tensorial objects and translating into a new set of objects that encode relations of the inputs. The generic design of CRN helps ease the common complex model building process of Video QA by simple block stacking with flexibility in accommodating input modalities and conditioning features across both different domains. As a result, we realize insight (b) by introducing Hierarchical Conditional Relation Networks (HCRN) for Video QA. The HCRN primarily aims at exploiting intrinsic properties of the visual content of a video and its accompanying channels in terms of compositionality, hierarchy, and near and far-term relation. HCRN is then applied for Video QA in two forms, short-form where answers are reasoned solely from the visual content, and long-form where associated information, such as subtitles, presented. Our rigorous evaluations show consistent improvements over SOTAs on well-studied benchmarks including large-scale real-world datasets such as TGIF-QA and TVQA, demonstrating the strong capabilities of our CRN unit and the HCRN for complex domains such as Video QA.


title: Solvability of Doubly Nonlinear Parabolic Equation with $p$-Laplacian

abstract: In this paper, we consider a doubly nonlinear parabolic equation $ \partial _t \beta (u) - \nabla \cdot \alpha (x , \nabla u) \ni f$ with the homogeneous Dirichlet boundary condition in a bounded domain, where $\beta : \mathbb{R} \to 2 ^{ \mathbb{R} }$ is a maximal monotone graph satisfying $0 \in \beta (0)$ and $ \nabla \cdot \alpha (x , \nabla u )$ stands for a generalized $p$-Laplacian. Existence of solution to the initial boundary value problem of this equation has been investigated in an enormous number of papers for the case where single-valuedness, coerciveness, or some growth condition is imposed on $\beta $. However, there are a few results for the case where such assumptions are removed and it is difficult to construct an abstract theory which covers the case for $1 < p < 2$. Main purpose of this paper is to show the solvability of the initial boundary value problem for any $ p \in (1, \infty ) $ without any conditions for $\beta $ except $0 \in \beta (0)$. We also discuss the uniqueness of solution by using properties of entropy solution.


title: Automorphy of mod 2 Galois representations associated to certain genus 2 curves over totally real fields

abstract: Let $C$ be a genus two hyperelliptic curve over a totally real field $F$. We show that the mod 2 Galois representation $\bar{\rho}_{C,2}\colon\mathrm{Gal}(\bar{F}/F)\to \mathrm{GSp}_4(\mathbb{F}_2)$ attached to $C$ is automorphic when the image of $\bar{\rho}_{C,2}$ is isomorphic to $S_5$ and it is also a transitive subgroup under a fixed isomorphism $\mathrm{GSp}_2(\mathbb{F}_2)\cong S_6$. To be more precise, there exists a Hilbert--Siegel Hecke eigen cusp form on $\mathrm{GSp}_4(\mathbb{A}_F)$ of parallel weight two whose mod 2 Galois representation is isomorphic to $\bar{\rho}_{C,2}$.


title: Starting Dynamics of a Fully Electronically Controlled Linear Mamyshev Oscillator

abstract: We start an environmentally-stable linear Mamyshev oscillator with electronically-controlled modulated pump and a moving filter. It delivers a 21-nJ pulse that becomes 65 fs in duration after a compressor. Reliable starting into stable mode-locking is found achievable with a modulated mode-locked state observed only when the modulation frequency is larger than 70 kHz. To avoid the damage of the gain fiber, two Faraday rotators are introduced. Besides, we have studied several aspects toward obtaining successful starting.


title: Investigations on $c$-(almost) perfect nonlinear functions

abstract: In a prior paper \cite{EFRST20}, two of us, along with P. Ellingsen, P. Felke and A. Tkachenko, 1defined a new (output) multiplicative differential, and the corresponding $c$-differential uniformity, which has the potential of extending differential cryptanalysis. Here, we continue the work, by looking at some APN functions through the mentioned concept and showing that their $c$-differential uniformity increases significantly, in some cases.


title: Neural Architecture Performance Prediction Using Graph Neural Networks

abstract: In computer vision research, the process of automating architecture engineering, Neural Architecture Search (NAS), has gained substantial interest. Due to the high computational costs, most recent approaches to NAS as well as the few available benchmarks only provide limited search spaces. In this paper we propose a surrogate model for neural architecture performance prediction built upon Graph Neural Networks (GNN). We demonstrate the effectiveness of this surrogate model on neural architecture performance prediction for structurally unknown architectures (i.e. zero shot prediction) by evaluating the GNN on several experiments on the NAS-Bench-101 dataset.


title: An Investigation of Feature Selection and Transfer Learning for Writer-Independent Offline Handwritten Signature Verification

abstract: SigNet is a state of the art model for feature representation used for handwritten signature verification (HSV). This representation is based on a Deep Convolutional Neural Network (DCNN) and contains 2048 dimensions. When transposed to a dissimilarity space generated by the dichotomy transformation (DT), related to the writer-independent (WI) approach, these features may include redundant information. This paper investigates the presence of overfitting when using Binary Particle Swarm Optimization (BPSO) to perform the feature selection in a wrapper mode. We proposed a method based on a global validation strategy with an external archive to control overfitting during the search for the most discriminant representation. Moreover, an investigation is also carried out to evaluate the use of the selected features in a transfer learning context. The analysis is carried out on a writer-independent approach on the CEDAR, MCYT and GPDS datasets. The experimental results showed the presence of overfitting when no validation is used during the optimization process and the improvement when the global validation strategy with an external archive is used. Also, the space generated after feature selection can be used in a transfer learning context.


title: Local Forms of Morphisms of Colored Supermanifolds

abstract: In \cite{Covolo:2016}, \cite{Covolo:2012} and \cite{Poncin:2016}, we introduced the category of colored supermanifolds ($\mathbb{Z}_2^n$-super\-ma\-ni\-folds or just $\mathbb{Z}_2^n$-manifolds ($\mathbb{Z}_2^n=\mathbb{Z}_2\times\ldots\times\mathbb{Z}_2$ ($n$ times))), explicitly described the corresponding $\mathbb{Z}_2^n$-Berezinian and gave first insights into $\mathbb{Z}_2^n$-integration theory. The present paper contains a detailed account of parts of the $\mathbb{Z}_2^n$-differential calculus and of the $\mathbb{Z}_2^n$-variants of the trilogy of local theorems, which consists of the inverse function theorem, the implicit function theorem and the constant rank theorem.


title: Fast Video Salient Object Detection via Spatiotemporal Knowledge Distillation

abstract: Since the wide employment of deep learning frameworks in video salient object detection, the accuracy of the recent approaches has made stunning progress. These approaches mainly adopt the sequential modules, based on optical flow or recurrent neural network (RNN), to learn robust spatiotemporal features. These modules are effective but significantly increase the computational burden of the corresponding deep models. In this paper, to simplify the network and maintain the accuracy, we present a lightweight network tailored for video salient object detection through the spatiotemporal knowledge distillation. Specifically, in the spatial aspect, we combine a saliency guidance feature embedding structure and spatial knowledge distillation to refine the spatial features. In the temporal aspect, we propose a temporal knowledge distillation strategy, which allows the network to learn the robust temporal features through the infer-frame feature encoding and distilling information from adjacent frames. The experiments on widely used video datasets (e.g., DAVIS, DAVSOD, SegTrack-V2) prove that our approach achieves competitive performance. Furthermore, without the employment of the complex sequential modules, the proposed network can obtain high efficiency with 0.01s per frame.


title: Towards an Ethical Framework in the Complex Digital Era

abstract: The digital revolution has brought ethical crossroads of technology, behavior and truth. However, the need of a comprehensive and constructive ethical framework is emerging as digital platforms have been used to build a global chaotic and truth-agnostic system. The unequal structure of the global system leads to dynamic changes and systemic problems, which have a more significant impact on those that are most vulnerable. Ethical frameworks based only on the individual level are no longer sufficient as they lack the necessary articulation to provide solutions to the new challenges. A new ethical vision must comprise the understanding of the scales and complex interconnections, as well as the causal chains of modern social systems. Many of these systems are internally fragile and very sensitive to external factors and threats, which lead to unethical situations that require systemic solutions still centered on individuals. Furthermore, the multi-layered net-like social tissue generates clusters of power that prevent certain communities from proper development. Digital technology has also impacted at the individual level posing the risk of a more homogeneous, predictable and ultimately controllable humankind. To preserve the core of humanity and the aspiration of common truth, a new ethical framework must empower individuals and uniqueness, as well as cultural heterogeneity, tackling the negative outcomes of digitalization. Only combining human-centered and collectiveness-oriented digital development will it be possible to construct new social models and interactions that are ethical. This vision requires science to enhance ethical frameworks and principles using computational tools to support truth-grounded actions, so as to transform and configure properties of the social systems.


title: Connecting Weighted Automata, Tensor Networks and Recurrent Neural Networks through Spectral Learning

abstract: In this paper, we present connections between three models used in different research fields: weighted finite automata~(WFA) from formal languages and linguistics, recurrent neural networks used in machine learning, and tensor networks which encompasses a set of optimization techniques for high-order tensors used in quantum physics and numerical analysis. We first present an intrinsic relation between WFA and the tensor train decomposition, a particular form of tensor network. This relation allows us to exhibit a novel low rank structure of the Hankel matrix of a function computed by a WFA and to design an efficient spectral learning algorithm leveraging this structure to scale the algorithm up to very large Hankel matrices.We then unravel a fundamental connection between WFA and second-orderrecurrent neural networks~(2-RNN): in the case of sequences of discrete symbols, WFA and 2-RNN with linear activationfunctions are expressively equivalent. Leveraging this equivalence result combined with the classical spectral learning algorithm for weighted automata, we introduce the first provable learning algorithm for linear 2-RNN defined over sequences of continuous input vectors.This algorithm relies on estimating low rank sub-blocks of the Hankel tensor, from which the parameters of a linear 2-RNN can be provably recovered. The performances of the proposed learning algorithm are assessed in a simulation study on both synthetic and real-world data.


title: Blind Federated Edge Learning

abstract: We study federated edge learning (FEEL), where wireless edge devices, each with its own dataset, learn a global model collaboratively with the help of a wireless access point acting as the parameter server (PS). At each iteration, wireless devices perform local updates using their local data and the most recent global model received from the PS, and send their local updates to the PS over a wireless fading multiple access channel (MAC). The PS then updates the global model according to the signal received over the wireless MAC, and shares it with the devices. Motivated by the additive nature of the wireless MAC, we propose an analog `over-the-air' aggregation scheme, in which the devices transmit their local updates in an uncoded fashion. Unlike recent literature on over-the-air edge learning, here we assume that the devices do not have channel state information (CSI), while the PS has imperfect CSI. Instead, the PS is equipped multiple antennas to alleviate the destructive effect of the channel, exacerbated due to the lack of perfect CSI. We design a receive beamforming scheme at the PS, and show that it can compensate for the lack of perfect CSI when the PS has a sufficient number of antennas. We also derive the convergence rate of the proposed algorithm highlighting the impact of the lack of perfect CSI, as well as the number of PS antennas. Both the experimental results and the convergence analysis illustrate the performance improvement of the proposed algorithm with the number of PS antennas, where the wireless fading MAC becomes deterministic despite the lack of perfect CSI when the PS has a sufficiently large number of antennas.


title: Conjectures and Open Questions on the Structure and Regularity of Spaces with Lower Ricci Curvature Bounds

abstract: In this short note we review some known results on the structure and regularity of spaces with lower Ricci curvature bounds. We present some known and new open questions about next steps.


title: TTPLA: An Aerial-Image Dataset for Detection and Segmentation of Transmission Towers and Power Lines

abstract: Accurate detection and segmentation of transmission towers~(TTs) and power lines~(PLs) from aerial images plays a key role in protecting power-grid security and low-altitude UAV safety. Meanwhile, aerial images of TTs and PLs pose a number of new challenges to the computer vision researchers who work on object detection and segmentation -- PLs are long and thin, and may show similar color as the background; TTs can be of various shapes and most likely made up of line structures of various sparsity; The background scene, lighting, and object sizes can vary significantly from one image to another. In this paper we collect and release a new TT/PL Aerial-image (TTPLA) dataset, consisting of 1,100 images with the resolution of 3,840$\times$2,160 pixels, as well as manually labeled 8,987 instances of TTs and PLs. We develop novel policies for collecting, annotating, and labeling the images in TTPLA. Different from other relevant datasets, TTPLA supports evaluation of instance segmentation, besides detection and semantic segmentation. To build a baseline for detection and segmentation tasks on TTPLA, we report the performance of several state-of-the-art deep learning models on our dataset. TTPLA dataset is publicly available at https://github.com/r3ab/ttpla_dataset


title: Arbitrary-angle rotation of the polarization of a dipolar Bose-Einstein condensate

abstract: We have employed the theory of harmonically trapped dipolar Bose-Einstein condensates to examine the influence of a uniform magnetic field that rotates at an arbitrary angle to its own orientation. This is achieved by semi-analytically solving the dipolar superfluid hydrodynamics of this system within the Thomas-Fermi approximation and by allowing the body frame of the condensate's density profile to be tilted with respect to the symmetry axes of the nonrotating harmonic trap. This additional degree of freedom manifests itself in the presence of previously unknown stationary solution branches for any given dipole tilt angle. We also find that the tilt angle of the stationary state's body frame with respect to the rotation axis is a nontrivial function of the trapping geometry, rotation frequency and dipole tilt angle. For rotation frequencies of at least an order of magnitude higher than the in-plane trapping frequency, the stationary state density profile is almost perfectly equivalent to the profile expected in a time-averaged dipolar potential that effectively vanishes when the dipoles are tilted along the `magic angle', $54.7 \deg$. However, by linearizing the fully time-dependent superfluid hydrodynamics about these stationary states, we find that they are dynamically unstable against the formation of collective modes, which we expect would result in turbulent decay.


title: PAAI in the sky : towards a particulate mechanism for Dark Energy and concordant Dark Matter

abstract: We propose the origins of Dark Energy in a hidden sector with a pair of very light fermions, oppositely charged under an abelian gauge force $U(1)_X$ but of unequal mass. The system is dubbed PAAI, plasma which is abelian, asymmetric and idealised. For a range of the hidden fine structure constant values and the value of mass of the lightest fermion the PAAI is argued to simulate Dark Energy. Additional fermions from the same sector are shown to account for Dark Matter. Further, residual $X$-magnetic fields can mix with Maxwell electromagnetism to provides the seed for cosmic-scale magnetic fields. Thus the scenario can explain several cosmological puzzles from within the same hidden sector.


title: Elaborative Simplification: Content Addition and Explanation Generation in Text Simplification

abstract: Much of modern-day text simplification research focuses on sentence-level simplification, transforming original, more complex sentences into simplified versions. However, adding content can often be useful when difficult concepts and reasoning need to be explained. In this work, we present the first data-driven study of content addition in text simplification, which we call elaborative simplification. We introduce a new annotated dataset of 1.3K instances of elaborative simplification in the Newsela corpus, and analyze how entities, ideas, and concepts are elaborated through the lens of contextual specificity. We establish baselines for elaboration generation using large-scale pre-trained language models, and demonstrate that considering contextual specificity during generation can improve performance. Our results illustrate the complexities of elaborative simplification, suggesting many interesting directions for future work.


title: Heider and coevolutionary balance: From discrete to continuous phase transition

abstract: Structural balance in social complex networks has been modeled with two types of triplet interactions. First, the interaction that only considers dynamic role for links or relationships (Heider balance), and second, the interaction that considers both individual opinions (nodes) and relationships in network dynamics (coevolutionary balance). The question is, as the temperature varies, which is a measure of social disorder, how structural balance can be created or destroyed by each of these triplet interactions? We use statistical mechanics methods and observe through analytical calculation and numerical simulation that unlike the Heider balance triplet interaction which has a discrete phase transition, the coevolutionary balance has a continuous phase transition. The critical temperature of the presented model change with the root square of network size which is a linear dependence in thermal Heider balance.


title: Acoustic twisted bilayer graphene

abstract: Twisted van der Waals (vdW) heterostructures have recently emerged as an attractive platform to study tunable correlated electron systems. However, the quantum mechanical nature of vdW heterostructures makes their theoretical and experimental exploration laborious and expensive. Here we present a simple platform to mimic the behavior of twisted vdW heterostructures using acoustic metamaterials comprising of interconnected air cavities in a steel plate. Our classical analog of twisted bilayer graphene shows much of the same behavior as its quantum counterpart, including mode localization at a magic angle of about 1.1 degrees. By tuning the thickness of the interlayer membrane, we reach a regime of strong interactions more than three times higher than the feasible range of twisted bilayer graphene under pressure. In this regime, we find the magic angle as high as 6.01 degrees, corresponding to a far denser array of localized modes in real space and further increasing their interaction strength. Our results broaden the capabilities for cross-talk between quantum mechanics and acoustics, as vdW metamaterials can be used both as simplified models for exploring quantum systems and as a means for translating interesting quantum effects into acoustics.


title: SOrT-ing VQA Models : Contrastive Gradient Learning for Improved Consistency

abstract: Recent research in Visual Question Answering (VQA) has revealed state-of-the-art models to be inconsistent in their understanding of the world -- they answer seemingly difficult questions requiring reasoning correctly but get simpler associated sub-questions wrong. These sub-questions pertain to lower level visual concepts in the image that models ideally should understand to be able to answer the higher level question correctly. To address this, we first present a gradient-based interpretability approach to determine the questions most strongly correlated with the reasoning question on an image, and use this to evaluate VQA models on their ability to identify the relevant sub-questions needed to answer a reasoning question. Next, we propose a contrastive gradient learning based approach called Sub-question Oriented Tuning (SOrT) which encourages models to rank relevant sub-questions higher than irrelevant questions for an <image, reasoning-question> pair. We show that SOrT improves model consistency by upto 6.5% points over existing baselines, while also improving visual grounding.


title: Revisiting Huffman Coding: Toward Extreme Performance on Modern GPU Architectures

abstract: Today's high-performance computing (HPC) applications are producing vast volumes of data, which are challenging to store and transfer efficiently during the execution, such that data compression is becoming a critical technique to mitigate the storage burden and data movement cost. Huffman coding is arguably the most efficient Entropy coding algorithm in information theory, such that it could be found as a fundamental step in many modern compression algorithms such as DEFLATE. On the other hand, today's HPC applications are more and more relying on the accelerators such as GPU on supercomputers, while Huffman encoding suffers from low throughput on GPUs, resulting in a significant bottleneck in the entire data processing. In this paper, we propose and implement an efficient Huffman encoding approach based on modern GPU architectures, which addresses two key challenges: (1) how to parallelize the entire Huffman encoding algorithm, including codebook construction, and (2) how to fully utilize the high memory-bandwidth feature of modern GPU architectures. The detailed contribution is four-fold. (1) We develop an efficient parallel codebook construction on GPUs that scales effectively with the number of input symbols. (2) We propose a novel reduction based encoding scheme that can efficiently merge the codewords on GPUs. (3) We optimize the overall GPU performance by leveraging the state-of-the-art CUDA APIs such as Cooperative Groups. (4) We evaluate our Huffman encoder thoroughly using six real-world application datasets on two advanced GPUs and compare with our implemented multi-threaded Huffman encoder. Experiments show that our solution can improve the encoding throughput by up to 5.0X and 6.8X on NVIDIA RTX 5000 and V100, respectively, over the state-of-the-art GPU Huffman encoder, and by up to 3.3X over the multi-thread encoder on two 28-core Xeon Platinum 8280 CPUs.


title: Metric geometry on manifolds: two lectures

abstract: We discuss Besicovitch inequality, width, and systole of manifolds.


title: Looking for Clues of Language in Multilingual BERT to Improve Cross-lingual Generalization

abstract: Token embeddings in multilingual BERT (m-BERT) contain both language and semantic information. We find that the representation of a language can be obtained by simply averaging the embeddings of the tokens of the language. Given this language representation, we control the output languages of multilingual BERT by manipulating the token embeddings, thus achieving unsupervised token translation. We further propose a computationally cheap but effective approach to improve the cross-lingual ability of m-BERT based on this observation.


title: Improving Factual Completeness and Consistency of Image-to-Text Radiology Report Generation

abstract: Neural image-to-text radiology report generation systems offer the potential to improve radiology reporting by reducing the repetitive process of report drafting and identifying possible medical errors. However, existing report generation systems, despite achieving high performances on natural language generation metrics such as CIDEr or BLEU, still suffer from incomplete and inconsistent generations. Here we introduce two new simple rewards to encourage the generation of factually complete and consistent radiology reports: one that encourages the system to generate radiology domain entities consistent with the reference, and one that uses natural language inference to encourage these entities to be described in inferentially consistent ways. We combine these with the novel use of an existing semantic equivalence metric (BERTScore). We further propose a report generation system that optimizes these rewards via reinforcement learning. On two open radiology report datasets, our system substantially improved the F1 score of a clinical information extraction performance by +22.1 (Delta +63.9%). We further show via a human evaluation and a qualitative analysis that our system leads to generations that are more factually complete and consistent compared to the baselines.


title: Serpent neutronics model of Wendelstein 7-X for 14.1 MeV neutrons

abstract: In this work, a Serpent 2 neutronics model of the Wendelstein 7-X (W7-X) stellarator is prepared, and an response function for the Scintillating-Fibre neutron detector (SciFi) is calculated using the model. The neutronics model includes the simplified geometry for the key components of the stellarator itself as well as the torus hall. The objective of the model is to assess the 14.1 MeV neutron flux from deuteron-triton fusions in W7-X, where the neutrons are modelled only until they have slowed down to 1 MeV energy. The key messages of this article are: demonstration of unstructured mesh geometry usage for stellarators, W7-X in particular; technical documentation of the model and first insights in fast neutron behaviour in W7-X, especially related to the SciFi: the model indicates that the superconducting coils are the strongest scatterers and block neutrons from large parts of the plasma. The back-scattering from e.g. massive steel support structures is found to be small. The SciFi will detect neutrons from an extended plasma volume in contrast to having an effective line-of-sight.


title: Incorporating Commonsense Knowledge into Abstractive Dialogue Summarization via Heterogeneous Graph Networks

abstract: Abstractive dialogue summarization is the task of capturing the highlights of a dialogue and rewriting them into a concise version. In this paper, we present a novel multi-speaker dialogue summarizer to demonstrate how large-scale commonsense knowledge can facilitate dialogue understanding and summary generation. In detail, we consider utterance and commonsense knowledge as two different types of data and design a Dialogue Heterogeneous Graph Network (D-HGN) for modeling both information. Meanwhile, we also add speakers as heterogeneous nodes to facilitate information flow. Experimental results on the SAMSum dataset show that our model can outperform various methods. We also conduct zero-shot setting experiments on the Argumentative Dialogue Summary Corpus, the results show that our model can better generalized to the new domain.


title: On the Adversarial Robustness of LASSO Based Feature Selection

abstract: In this paper, we investigate the adversarial robustness of feature selection based on the $\ell_1$ regularized linear regression model, namely LASSO. In the considered model, there is a malicious adversary who can observe the whole dataset, and then will carefully modify the response values or the feature matrix in order to manipulate the selected features. We formulate the modification strategy of the adversary as a bi-level optimization problem. Due to the difficulty of the non-differentiability of the $\ell_1$ norm at the zero point, we reformulate the $\ell_1$ norm regularizer as linear inequality constraints. We employ the interior-point method to solve this reformulated LASSO problem and obtain the gradient information. Then we use the projected gradient descent method to design the modification strategy. In addition, We demonstrate that this method can be extended to other $\ell_1$ based feature selection methods, such as group LASSO and sparse group LASSO. Numerical examples with synthetic and real data illustrate that our method is efficient and effective.


title: Line Graph Neural Networks for Link Prediction

abstract: We consider the graph link prediction task, which is a classic graph analytical problem with many real-world applications. With the advances of deep learning, current link prediction methods commonly compute features from subgraphs centered at two neighboring nodes and use the features to predict the label of the link between these two nodes. In this formalism, a link prediction problem is converted to a graph classification task. In order to extract fixed-size features for classification, graph pooling layers are necessary in the deep learning model, thereby incurring information loss. To overcome this key limitation, we propose to seek a radically different and novel path by making use of the line graphs in graph theory. In particular, each node in a line graph corresponds to a unique edge in the original graph. Therefore, link prediction problems in the original graph can be equivalently solved as a node classification problem in its corresponding line graph, instead of a graph classification task. Experimental results on fourteen datasets from different applications demonstrate that our proposed method consistently outperforms the state-of-the-art methods, while it has fewer parameters and high training efficiency.


title: Robust Neural Networks inspired by Strong Stability Preserving Runge-Kutta methods

abstract: Deep neural networks have achieved state-of-the-art performance in a variety of fields. Recent works observe that a class of widely used neural networks can be viewed as the Euler method of numerical discretization. From the numerical discretization perspective, Strong Stability Preserving (SSP) methods are more advanced techniques than the explicit Euler method that produce both accurate and stable solutions. Motivated by the SSP property and a generalized Runge-Kutta method, we propose Strong Stability Preserving networks (SSP networks) which improve robustness against adversarial attacks. We empirically demonstrate that the proposed networks improve the robustness against adversarial examples without any defensive methods. Further, the SSP networks are complementary with a state-of-the-art adversarial training scheme. Lastly, our experiments show that SSP networks suppress the blow-up of adversarial perturbations. Our results open up a way to study robust architectures of neural networks leveraging rich knowledge from numerical discretization literature.


title: Fluent and Low-latency Simultaneous Speech-to-Speech Translation with Self-adaptive Training

abstract: Simultaneous speech-to-speech translation is widely useful but extremely challenging, since it needs to generate target-language speech concurrently with the source-language speech, with only a few seconds delay. In addition, it needs to continuously translate a stream of sentences, but all recent solutions merely focus on the single-sentence scenario. As a result, current approaches accumulate latencies progressively when the speaker talks faster, and introduce unnatural pauses when the speaker talks slower. To overcome these issues, we propose Self-Adaptive Translation (SAT) which flexibly adjusts the length of translations to accommodate different source speech rates. At similar levels of translation quality (as measured by BLEU), our method generates more fluent target speech (as measured by the naturalness metric MOS) with substantially lower latency than the baseline, in both Zh <-> En directions.


title: Turbulent relaxation to equilibrium in a two-dimensional quantum vortex gas

abstract: We experimentally study emergence of microcanonical equilibrium states in the turbulent relaxation dynamics of a two-dimensional chiral vortex gas. Same-sign vortices are injected into a quasi-two-dimensional disk-shaped atomic Bose-Einstein condensate using a range of mechanical stirring protocols. The resulting long-time vortex distributions are found to be in excellent agreement with the meanfield Poisson-Boltzmann equation for the system describing the microcanonical ensemble at fixed energy $\cal{H}$ and angular momentum $\cal{M}$. The equilibrium states are characterized by the corresponding thermodynamic variables of inverse temperature $\hat{\beta}$ and rotation frequency $\hat{\omega}$. We are able to realize equilibria spanning the full phase diagram of the vortex gas, including on-axis states near zero-temperature, infinite temperature, and negative absolute temperatures. At sufficiently high energies the system exhibits a symmetry-breaking transition, resulting in an off-axis equilibrium phase at negative absolute temperature that no longer shares the symmetry of the container. We introduce a point-vortex model with phenomenological damping and noise that is able to quantitatively reproduce the equilibration dynamics.