title: Estimating Grape Yield on the Vine from Multiple Images

abstract: Estimating grape yield prior to harvest is important to commercial vineyard production as it informs many vineyard and winery decisions. Currently, the process of yield estimation is time consuming and varies in its accuracy from 75-90\% depending on the experience of the viticulturist. This paper proposes a multiple task learning (MTL) convolutional neural network (CNN) approach that uses images captured by inexpensive smart phones secured in a simple tripod arrangement. The CNN models use MTL transfer from autoencoders to achieve 85\% accuracy from image data captured 6 days prior to harvest.


title: Trace theories, Bokstedt periodicity and Bott periodicity

abstract: We flesh out the theory of "trace theories" and "trace functors" sketched in arXiv:1308.3743, extend it to a homotopical setting, and prove a reconstruction theorem claiming that a trace theory is completely determined by the associated trace functor. As an application, we consider Topological Hoshschild Homology $THH(A,M)$ of a algebra $A$ over a perfect field of positive characteristic, with coefficients in a bimodule $M$, and prove two comparison results. Firstly, we give a very simple algebraic model for THH in terms of Hochschild-Witt Homology WHH of arXiv:1604.01588 (and we also identify $TP(A)$ with the periodic version $WHP(A)$ of WHH). Secondly, we prove that $THH(A)$ is identified with the zero term of the conjugate filtration on the co-periodic cyclic homology $\overline{HP}(A)$ of arXiv:1509.08784, and the isomorphism sends the Bokstedt periodicity generator to the Bott periodicity generator. We also give an independent proof of Bokstedt periodicity that is somewhat shorter than the usual ones.


title: Positron Processes in the Sun

abstract: Positrons play a major role in the emission of solar gamma-rays at energies from a few hundred keV to >1 GeV. Although the processes leading to positron production in the solar atmosphere are well known, the origin of the underlying energetic particles that interact with the ambient particles is poorly understood. With the aim of understanding the full gamma-ray spectrum of the Sun, I review the key emission mechanisms that contribute to the observed gamma-ray spectrum, focusing on the ones involving positrons. In particular, I review the processes involved in the 0.511 MeV positron annihilation line and the positronium continuum emissions at low energies, and the pion continuum emission at high energies in solar eruptions. It is thought that particles accelerated at the flare reconnection and at the shock driven by coronal mass ejections are responsible for the observed gamma-ray features. Based on some recent developments I suggest that energetic particles from both mechanisms may contribute to the observed gamma-ray spectrum in the impulsive phase, while the shock mechanism is responsible for the extended phase.


title: A comparative analysis for SARS-CoV-2

abstract: COVID-19 has affected the world tremendously. It is critical that biological experiments and clinical designs are informed by computational approaches for time- and cost-effective solutions. Comparative analyses particularly can play a key role to reveal structural changes in proteins due to mutations, which can lead to behavioural changes, such as the increased binding of the SARS-CoV-2 surface glycoprotein to human ACE2 receptors. The aim of this report is to provide an easy to follow tutorial for biologists and others without delving into different bioinformatics tools. More complex analyses such as the use of large-scale computational methods can then be utilised. Starting with a SARS-CoV-2 genome sequence, the report shows visualising DNA sequence features, deriving amino acid sequences, and aligning different genomes to analyse mutations and differences. The report provides further insights into how the SARS-CoV-2 surface glycoprotein mutated for higher binding affinity to human ACE2 receptors, compared to the SARS-CoV protein, by integrating existing 3D protein models.


title: Scaled Small-Gain Approach to Robust Control of LPV Systems with Uncertain Varying Delay

abstract: Linear parameter-varying (LPV) systems with uncertainty in time-varying delays are subject to performance degradation and instability. In this line, we investigate the stability of such systems invoking an input-output stability approach. By considering explicit bounds on the delay rate and time-varying delay uncertainty, the scaled small-gain theorem is adopted to form an interconnected time-delay LPV system with input and output vectors of the auxiliary system introduced for the uncertain dynamics. For such an interconnected time-delay LPV system subject to external disturbances, a Lyapunov-Krasovskii functional (LKF) is constructed whose derivative is augmented with the terms resulted from the descriptor method. Then, stability conditions and a prescribed induced L2-norm in terms of the disturbance rejection performance are derived in a convex linear matrix inequalities (LMIs) setting. Subsequently, a congruent transformation enables us to compute a gain-scheduled state-feedback controller for a class of LPV systems with an uncertain time-varying delay. As a benchmark, we examine the automated mean arterial blood pressure (MAP) control in an individual with hypotension where the MAP response dynamics to drug infusion is characterized in a time-delay LPV representation. Finally, the closed-loop simulation results are provided to demonstrate the provided methodology's performance.


title: Quantization on Algebraic Curves with Frobenius-Projective Structure

abstract: In the present paper, we study the relationship between deformation quantizations and Frobenius-projective structures defined on an algebraic curve in positive characteristic. A Frobenius-projective structure is an analogue of a complex projective structure on a Riemann surface, which was introduced by Y. Hoshi. Such an additional structure has some equivalent objects, e.g., a dormant $\mathrm{PGL}_2$-oper and a projective connection having a full set of solutions. The main result of the present paper provides a canonical construction of a Frobenius-constant quantization on the cotangent space minus the zero section on an algebraic curve by means of a Frobenius-projective structure. It may be thought of as a positive characteristic analogue of a result by D. Ben-Zvi and I. Biswas. Finally, we give a higher-dimensional variant of this result, as proved by I. Biswas in the complex case.


title: The Stefan problem and concavity

abstract: We construct examples for the one-phase Stefan problem which show that $\alpha$-concavity of the solution is in general not preserved in time, for $0 \le \alpha <1/2$. In particular, this shows that, in contrast to the case of the heat equation for a fixed convex domain, log concavity is not preserved for solutions of the Stefan problem.


title: Right-tail moderate deviations in the exponential last-passage percolation

abstract: We study moderate deviations in the exponential corner growth model, both in the bulk setting and the increment-stationary setting. The main results are sharp right-tail bounds on the last-passage time and the exit point of the increment-stationary process. The arguments utilize calculations with the stationary version and a moment generating function identity due to E. Rains, for which we give a short probabilistic proof. As applications of the deviation bounds, we derive upper bounds on the speed of distributional convergence in the Busemann function and competition interface limits.


title: The Effects of Different JSON Representations on Querying Knowledge Graphs

abstract: Knowledge Graphs (KGs) have emerged as the de-facto standard for modeling and querying datasets with a graph-like structure in the Semantic Web domain. Our focus is on the performance challenges associated with querying KGs. We developed three informationally equivalent JSON-based representations for KGs, namely, Subject-based Name/Value (JSON-SNV), Documents of Triples (JSON-DT), and Chain-based Name/Value (JSON-CNV). We analyzed the effects of these representations on query performance by storing them on two prominent document-based Data Management Systems (DMSs), namely, MongoDB and Couchbase and executing a set of benchmark queries over them. We also compared the execution times with row-store Virtuoso, column-store Virtuoso, and \mbox{Blazegraph} as three major DMSs with different architectures (aka, RDF-stores). Our results indicate that the representation type has a significant performance impact on query execution. For instance, the JSON-SNV outperforms others by nearly one order of magnitude to execute subject-subject join queries. This and the other results presented in this paper can assist in more accurate benchmarking of the emerging DMSs.


title: Subleading Logarithmic QED Initial State Corrections to $e^+e^- \rightarrow \gamma^*/{Z^{0}}^*$ to $O(\alpha^6 L^5)$

abstract: Using the method of massive operator matrix elements, we calculate the subleading QED initial state radiative corrections to the process $e^+e^- \rightarrow \gamma^*/Z^*$ for the first three logarithmic contributions from $O(\alpha^3 L^3), O(\alpha^3 L^2), O(\alpha^3 L)$ to $O(\alpha^5 L^5), O(\alpha^5 L^4), O(\alpha^5 L^3)$ and compare their effects to the leading contribution $O(\alpha^6 L^6)$ and one more subleading term $O(\alpha^6 L^5)$. The calculation is performed in the limit of large center of mass energies squared $s \gg m_e^2$. These terms supplement the known corrections to $O(\alpha^2)$, which were completed recently. Given the high precision at future colliders operating at very large luminosity, these corrections are important for concise theoretical predictions. The present calculation needs the calculation of one more two--loop massive operator matrix element in QED. The radiators are obtained as solutions of the associated Callen--Symanzik equations in the massive case. The radiators can be expressed in terms of harmonic polylogarithms to weight {\sf w = 6} of argument $z$ and $(1-z)$ and in Mellin $N$ space by generalized harmonic sums. Numerical results are presented on the position of the $Z$ peak and corrections to the $Z$ width, $\Gamma_Z$. The corrections calculated result into a final theoretical accuracy for $\delta M_Z$ and $\delta \Gamma_Z$ which is estimated to be of O(30 keV) at an anticipated systematic accuracy at the FCC\_ee of \sim 100 keV. This precision cannot be reached, however, by including only the corrections up to $O(\alpha^3)$.


title: Tunability of martensitic behavior through coherent nanoprecipitates and other nanostructures

abstract: Molecular dynamics simulations show that coherent precipitates can significantly affect the properties of martensitic transformations in Ni$_{63}$Al$_{37}$ alloys. The precipitates, consisting of non-martensitic Ni$_{50}$Al$_{50}$, modify the free energy landscape that governs the phase transformation and result in a significant reduction of the thermal hysteresis, at comparably minor expense of transformation strain, and modification of transformation temperatures. Importantly, this paper shows that free energy landscape engineering is possible with nanostructures potentially accessible through standard metallurgical processing routes. The atomistic-level nucleation and transformation mechanisms within the nanoprecipitate systems are explored and compared with epitaxial nanolaminates and nanowires. The simulations reveal three distinct regimes of transformation mechanisms and martensitic nanostructure as a function of volume fraction of the non-martensitic phase. Free energy landscape engineering is generally applicable and could contribute to the design of new shape memory alloys with novel properties, such as light weight alloys that operate at room temperature.


title: DegreeSketch: Distributed Cardinality Sketches on Massive Graphs with Applications

abstract: We present DegreeSketch, a semi-streaming distributed sketch data structure and demonstrate its utility for estimating local neighborhood sizes and local triangle count heavy hitters on massive graphs. DegreeSketch consists of vertex-centric cardinality sketches distributed across a set of processors that are accumulated in a single pass, and then behaves as a persistent query engine capable of approximately answering graph queries pertaining to the sizes of adjacency set unions and intersections. The $t$th local neighborhood of a vertex is the number of vertices reachable in $G$ from $v$ by traversing at most $t$ edges, whereas the local triangle count is the number of 3-cycles in which it is included. Both metrics are useful in graph analysis applications, but exact computations scale poorly as graph sizes grow. We present efficient algorithms for estimating both local neighborhood sizes and local triangle count heavy hitters using DegreeSketch. In our experiments we implement DegreeSketch using the celebrated hyperloglog cardinality sketch and utilize the distributed communication tool YGM to achieve state-of-the-art performance in distributed memory.


title: An investigation of phone-based subword units for end-to-end speech recognition

abstract: Phones and their context-dependent variants have been the standard modeling units for conventional speech recognition systems, while characters and subwords have demonstrated their effectiveness for end-to-end recognition systems. We investigate the use of phone-based subwords, in particular, byte pair encoder (BPE), as modeling units for end-to-end speech recognition. In addition, we also developed multi-level language model-based decoding algorithms based on a pronunciation dictionary. Besides the use of the lexicon, which is easily available, our system avoids the need of additional expert knowledge or processing steps from conventional systems. Experimental results show that phone-based BPEs tend to yield more accurate recognition systems than the character-based counterpart. In addition, further improvement can be obtained with a novel one-pass joint beam search decoder, which efficiently combines phone- and character-based BPE systems. For Switchboard, our phone-based BPE system achieves 6.8\%/14.4\% word error rate (WER) on the Switchboard/CallHome portion of the test set while joint decoding achieves 6.3\%/13.3\% WER. On Fisher + Switchboard, joint decoding leads to 4.9\%/9.5\% WER, setting new milestones for telephony speech recognition.


title: Skew braces of size $p^2q$ I: abelian type

abstract: This is the first part of a series of two articles. In this paper we enumerate and classify the left braces of size $p^2q$ where $p$ and $q$ are distinct prime numbers by the classification of regular subgroups of the holomorph of the abelian groups of the same order. We also provide the formulas that define the constructed braces.


title: Adaptive Stress Testing without Domain Heuristics using Go-Explore

abstract: Recently, reinforcement learning (RL) has been used as a tool for finding failures in autonomous systems. During execution, the RL agents often rely on some domain-specific heuristic reward to guide them towards finding failures, but constructing such a heuristic may be difficult or infeasible. Without a heuristic, the agent may only receive rewards at the time of failure, or even rewards that guide it away from failures. For example, some approaches give rewards for taking more-likely actions, because we want to find more-likely failures. However, the agent may then learn to only take likely actions, and may not be able to find a failure at all. Consequently, the problem becomes a hard-exploration problem, where rewards do not aid exploration. A new algorithm, go-explore (GE), has recently set new records on benchmarks from the hard-exploration field. We apply GE to adaptive stress testing (AST), one example of an RL-based falsification approach that provides a way to search for the most-likely failure scenario. We simulate a scenario where an autonomous vehicle drives while a pedestrian is crossing the road. We demonstrate that GE is able to find failures without domain-specific heuristics, such as the distance between the car and the pedestrian, on scenarios that other RL techniques are unable to solve. Furthermore, inspired by the robustification phase of GE, we demonstrate that the backwards algorithm (BA) improves the failures found by other RL techniques.


title: The Adaptive Stress Testing Formulation

abstract: Validation is a key challenge in the search for safe autonomy. Simulations are often either too simple to provide robust validation, or too complex to tractably compute. Therefore, approximate validation methods are needed to tractably find failures without unsafe simplifications. This paper presents the theory behind one such black-box approach: adaptive stress testing (AST). We also provide three examples of validation problems formulated to work with AST.


title: Analysis of LFT2

abstract: For a decentralized and transparent society, blockchain technology has been developed. Along with this, quite a few consensus algorithms that are one of core technologies in blockchain have been proposed. Among them, we analyze a consensus algorithm called LFT2, which is used by a blockchain system, ICON. We first formulate the LFT2 consensus algorithm and then analyze safety and liveness, which can be considered as the most important properties in distributed consensus system. We prove that LFT2 satisfies safety and liveness, where a certain assumption is required to prove liveness. In addition, we compare LFT2 with two similar consensus algorithms, and from the comparison, we show that a trade-off exist among the three consensus algorithms. Finally, we simulate LFT2 to measure a liveness quality.


title: Severing the Edge Between Before and After: Neural Architectures for Temporal Ordering of Events

abstract: In this paper, we propose a neural architecture and a set of training methods for ordering events by predicting temporal relations. Our proposed models receive a pair of events within a span of text as input and they identify temporal relations (Before, After, Equal, Vague) between them. Given that a key challenge with this task is the scarcity of annotated data, our models rely on either pretrained representations (i.e. RoBERTa, BERT or ELMo), transfer and multi-task learning (by leveraging complementary datasets), and self-training techniques. Experiments on the MATRES dataset of English documents establish a new state-of-the-art on this task.


title: Functional uncertainty quantification for isobaric molecular dynamics simulations and defect formation energies

abstract: Functional uncertainty quantification (FunUQ) was recently proposed to quantify uncertainties in models and simulations that originate from input functions, as opposed to parameters. This paper extends FunUQ to quantify uncertainties originating from interatomic potentials in isothermal-isobaric molecular dynamics (MD) simulations and to the calculation of defect formation energies. We derive and verify a computationally inexpensive expression to compute functional derivatives in MD based on perturbation theory. We show that this functional derivative of the quantities of interest (average internal energy, volume, and defect energies in our case) with respect to the interatomic potential can be used to predict those quantities for a different interatomic potential, without re-running the simulation. The codes and scripts to perform FunUQ in MD are freely available for download. In addition, to facilitate reproducibility and to enable use of best practices for the approach, we created Jupyter notebooks to perform FunUQ analysis on MD simulations and made them available for online simulation in nanoHUB. The tool uses cloud computing resources and users can view, edit, and run end-to-end workflows from a standard web-browser without the need to need to download or install any software.


title: Online simulation powered learning modules for materials science

abstract: Simulation tools are playing an increasingly important role in materials science and engineering and beyond their well established importance in research and development, these tools have a significant pedagogical potential. We describe a set of online simulation tools and learning modules designed to help students explore important concepts in materials science where hands-on activities with high-fidelity simulations can provide insight not easily acquired otherwise. The online tools, which involve density functional theory and molecular dynamics simulations, have been designed with non-expert end-users in mind and only a few clicks are required to perform most simulations, yet they are powered by research-grade codes and expert users can access advanced options. All tools and modules are available for online simulation in nanoHUB.org and access is open and free of charge. Importantly, instructors and students do not need to download or install any software. The learning modules cover a range of topics from electronic structure of crystals and doping, plastic deformation in metals, and physical properties of polymers. These modules have been used in several core undergraduate courses at Purdue's School of Materials Engineering, they are self contained, and are easy to incorporate into existing classes.


title: Modular forms and ellipsoidal T-designs

abstract: In recent work, Miezaki introduced the notion of a $spherical$ $T$-d$esign$ in $\mathbb{R}^2$, where $T$ is a potentially infinite set. As an example, he offered the $\mathbb{Z}^2$-lattice points with fixed integer norm (a.k.a. shells). These shells are $maximal$ spherical $T$-designs, where $T=\mathbb{Z}^+\setminus 4\mathbb{Z}^+$. We generalize the notion of a spherical $T$-design to special ellipses, and extend Miezaki's work to the norm form shells for rings of integers of imaginary quadratic fields with class number 1.


title: Quartet-Based Inference Methods are Statistically Consistent Under the Unified Duplication-Loss-Coalescence Model

abstract: The classic multispecies coalescent (MSC) model provides the means for theoretical justification of incomplete lineage sorting-aware species tree inference methods. A large body of work in phylogenetics is dedicated to the design of inference methods that are statistically consistent under MSC. One of such particularly popular methods is ASTRAL, a quartet-based species tree inference method. A few recent studies suggested that ASTRAL also performs well when given multi-locus gene trees in simulation studies. Further, Legried et al. recently demonstrated that ASTRAL is statistically consistent under the gene duplication and loss model (GDL). Note that GDL is prevalent in evolutionary histories and is a part of the powerful duplication-loss-coalescence evolutionary model (DLCoal) by Rasmussen and Kellis. In this work we prove that ASTRAL is statistically consistent under the general DLCoal model. Therefore, our result supports the empirical evidence from the simulation-based studies. More broadly, we prove that a randomly chosen quartet from a gene tree (with unique taxa) is more likely to agree with the respective species tree quartet than any of the two other quartets.


title: Automated Content Grading Using Machine Learning

abstract: Grading of examination papers is a hectic, time-labor intensive task and is often subjected to inefficiency and bias in checking. This research project is a primitive experiment in the automation of grading of theoretical answers written in exams by students in technical courses which yet had continued to be human graded. In this paper, we show how the algorithmic approach in machine learning can be used to automatically examine and grade theoretical content in exam answer papers. Bag of words, their vectors & centroids, and a few semantic and lexical text features have been used overall. Machine learning models have been implemented on datasets manually built from exams given by graduating students enrolled in technical courses. These models have been compared to show the effectiveness of each model.


title: Estimating Scale Discrepancy in Bayesian Model Calibration for ChemCam on the Mars Curiosity Rover

abstract: The Mars rover Curiosity carries an instrument called ChemCam to determine the composition of the soil and rocks. ChemCam uses laser-induced breakdown spectroscopy (LIBS) for this purpose. Los Alamos National Laboratory has developed a simulation capability that can predict spectra from ChemCam, but there are major scale differences between the prediction and observation. This presents a challenge when using Bayesian model calibration to determine the unknown physical parameters that describe the LIBS observations. We present an analysis of LIBS data to support ChemCam based on including a structured discrepancy model in a Bayesian model calibration scheme. This is both a novel application of Bayesian model calibration and a general purpose approach to accounting for such systematic differences between theory and observation in this setting.


title: Hedge Your Bets: Optimizing Long-term Cloud Costs by Mixing VM Purchasing Options

abstract: Cloud platforms offer the same VMs under many purchasing options that specify different costs and time commitments, such as on-demand, reserved, sustained-use, scheduled reserve, transient, and spot block. In general, the stronger the commitment, i.e., longer and less flexible, the lower the price. However, longer and less flexible time commitments can increase cloud costs for users if future workloads cannot utilize the VMs they committed to buying. Large cloud customers often find it challenging to choose the right mix of purchasing options to reduce their long-term costs, while retaining the ability to adjust capacity up and down in response to workload variations. To address the problem, we design policies to optimize long-term cloud costs by selecting a mix of VM purchasing options based on short- and long-term expectations of workload utilization. We consider a batch trace spanning 4 years from a large shared cluster for a major state University system that includes 14k cores and 60 million job submissions, and evaluate how these jobs could be judiciously executed using cloud servers using our approach. Our results show that our policies incur a cost within 41% of an optimistic optimal offline approach, and 50% less than solely using on-demand VMs.


title: Composing and Decomposing Op-Based CRDTs with Semidirect Products

abstract: Operation-based Conflict-free Replicated Data Types (CRDTs) are eventually consistent replicated data types that automatically resolve conflicts between concurrent operations. Op-based CRDTs must be designed differently for each data type, and current designs use ad-hoc techniques to handle concurrent operations that do not naturally commute. We present a new construction, the semidirect product of op-based CRDTs, which combines the operations of two CRDTs into one while handling conflicts between their concurrent operations in a uniform way. We demonstrate the construction's utility by using it to construct novel CRDTs, as well as decomposing several existing CRDTs as semidirect products of simpler CRDTs. Although it reproduces common CRDT semantics, the semidirect product can be viewed as a restricted kind of operational transformation, thus forming a bridge between these two opposing techniques for constructing replicated data types.


title: Cosmic-Ray Signatures of Dark Matter from a Flavor Dependent Gauge Symmetry Model with Neutrino Mass Mechanism

abstract: We propose an extension to the Standard Model accommodating two families of Dirac neutral fermions and Majorana fermions under additional ${U(1)_{e-\mu} \times Z_3\times Z_2}$ symmetries where ${U(1)_{e-\mu}}$ is a flavor dependent gauge symmetry related to the first and second family of the lepton sector, which features a two-loop induced neutrino mass model. The two families are favored by minimally reproducing the current neutrino oscillation data and two mass difference squares and canceling the gauge anomalies at the same time. As a result, we have a prediction for neutrino masses. The lightest Dirac neutral fermion is a dark matter candidate with tree-level interaction restricted to electron, muon and neutrinos, which makes it difficult to detect in direct dark matter search as well as indirect search focusing on the ${\tau}$-channel, such as through ${\gamma}$-rays. It may however be probed by search for dark matter signatures in electron and positron cosmic rays, and allows interpretation of a structure appearing in the CALET electron+positron spectrum around 350-400 GeV as its signature, with a boost factor $\approx$40 Breit-Wigner enhancement of the annihilation cross section.


title: Conversation Learner -- A Machine Teaching Tool for Building Dialog Managers for Task-Oriented Dialog Systems

abstract: Traditionally, industry solutions for building a task-oriented dialog system have relied on helping dialog authors define rule-based dialog managers, represented as dialog flows. While dialog flows are intuitively interpretable and good for simple scenarios, they fall short of performance in terms of the flexibility needed to handle complex dialogs. On the other hand, purely machine-learned models can handle complex dialogs, but they are considered to be black boxes and require large amounts of training data. In this demonstration, we showcase Conversation Learner, a machine teaching tool for building dialog managers. It combines the best of both approaches by enabling dialog authors to create a dialog flow using familiar tools, converting the dialog flow into a parametric model (e.g., neural networks), and allowing dialog authors to improve the dialog manager (i.e., the parametric model) over time by leveraging user-system dialog logs as training data through a machine teaching interface.


title: Physics-enhanced machine learning for virtual fluorescence microscopy

abstract: This paper introduces a new method of data-driven microscope design for virtual fluorescence microscopy. Our results show that by including a model of illumination within the first layers of a deep convolutional neural network, it is possible to learn task-specific LED patterns that substantially improve the ability to infer fluorescence image information from unstained transmission microscopy images. We validated our method on two different experimental setups, with different magnifications and different sample types, to show a consistent improvement in performance as compared to conventional illumination methods. Additionally, to understand the importance of learned illumination on inference task, we varied the dynamic range of the fluorescent image targets (from one to seven bits), and showed that the margin of improvement for learned patterns increased with the information content of the target. This work demonstrates the power of programmable optical elements at enabling better machine learning algorithm performance and at providing physical insight into next generation of machine-controlled imaging systems.


title: Dynamics of an imprecise stochastic Lotka Volterra food chain chemostat model with Levy jumps

abstract: Population dynamics are often affected by sudden environmental perturbations. Parameters of stochastic models are often imprecise due to various uncertainties. In this paper, we formulate a stochastic Lotka Volterra food chain chemostat model that includes Levy jumps and interval parameters. Firstly, we prove the existence and uniqueness of the positive solution. Moreover, the threshold between extinction and persistence in the mean of the microorganism is obtained. Finally, some simulations are carried out to demonstrate our theoretical results.


title: Learning Algorithms for Coarsening Uncertainty Space and Applications to Multiscale Simulations

abstract: In this paper, we investigate and design multiscale simulations for stochastic multiscale PDEs. As for the space, we consider a coarse grid and a known multiscale method, the Generalized Multiscale Finite Element Method (GMsFEM). In order to obtain a small dimensional representation of the solution in each coarse block, the uncertainty space needs to be partitioned (coarsened). This coarsening collects realizations that provide similar multiscale features as outlined in GMsFEM (or other method of choice). This step is known to be computationally demanding as it requires many local solves and clustering based on them. In this paper, we take a different approach and learn coarsening the uncertainty space. Our methods use deep learning techniques in identifying clusters(coarsening) in the uncertainty space. We use convolutional neural networks combined with some techniques in adversary neural networks. We define appropriate loss functions in the proposed neural networks, where the loss function is composed of several parts that includes terms related to clusters and reconstruction of basis functions. We present numerical results for channelized permeability fields in the examples of flows in porous media.


title: Massive Spinning Bosons on the Celestial Sphere

abstract: A natural extension of the Pasterski-Shao-Strominger (PSS) prescription is described, enabling the map of Minkowski space amplitudes with massive spinning external legs to the celestial sphere to be performed. An integral representation for the conformal primary wave function (CPW) of massive spinning bosons on the celestial sphere is derived explicitly for spin-one and -two. By analogy with the spin-zero case, the spinning bulk-to-boundary propagator on Euclidean AdS is employed to extend the massive CPW integral representation to arbitrary integer spin, and to describe the appropriate inverse transform of massive spinning CPWs back to the plane wave basis in Minkowski space. Subsequently, a massive spin-$s$ momentum operator representation on the celestial sphere is determined, and used in conjunction with known Lorentz generators to derive Poincar\'e symmetry constraints on generic massive spinning two-, three- and four-point celestial amplitude structures. Finally, as a consistency check, three-point Minkowski space amplitudes of two massless scalars and a spin-one or -two massive boson are explicitly mapped to the celestial sphere, and the resulting three-point function coefficients are confirmed to be in exact agreement with the results obtained from Poincar\'e symmetry constraints.


title: Experimental study on determinants of the evacuation performance in the super-high rise building

abstract: The stairwell is the main path for emergency evacuation of people in super high-rise buildings, so revealing the movement characteristics in the stairwell based on experimental data is the basis for controlling the evacuation process of super high-rise buildings to ensure the safety of the crowd. Here, an evacuation experiment is carried out in Shanghai Tower with a vertical height of 583 m, which is the second tallest building in the world. The results show that pedestrians would set a "suitable velocity" for themselves according to the target height distance, and farther distance will result in lower "suitable velocity". The evidence is that the group of participants with a 9.63% higher traveling height spend a 16.39% longer evacuation time, yet within each group the velocity do not decrease with the increase of the moving distance. Furthermore, crowding in stairwell determines whether pedestrians can achieve the "suitable velocity", and the "suitable velocity" of women or older people is smaller than men or younger people in the same scenario. The local velocity and vertical velocity of different groups, genders and ages are classified and analyzed. A new measurement method for crowd density and then the fundamental diagram of the velocity-density relation in super high-rise building is presented. These results can provide basic data for the design of emergency evacuation facilities and formulation of emergency plan for super high-rise buildings.


title: Magnitude and Spatial Distribution Control of the Supercurrent in Bi2O2Se-Based Josephson Junction

abstract: Many proposals in exploring topological quantum computation are based on superconducting quantum devices constructed on materials with strong spin-orbit coupling (SOC). For these devices, a full control on both the magnitude and the spatial distribution of the supercurrent would be highly demanded, but has been elusive up to now. We constructed proximity-type Josephson junction on nanoplates of Bi2O2Se, a new emerging semiconductor with strong SOC. Through electrical gating, we show that the supercurrent can be fully turned ON and OFF, and its real-space pathways can be configured either through the bulk or along the edges. Our work demonstrates Bi2O2Se as a promising platform for constructing multifunctional hybrid superconducting devices as well as for searching for topological superconductivity.


title: Learning to Scale Multilingual Representations for Vision-Language Tasks

abstract: Current multilingual vision-language models either require a large number of additional parameters for each supported language, or suffer performance degradation as languages are added. In this paper, we propose a Scalable Multilingual Aligned Language Representation (SMALR) that supports many languages with few model parameters without sacrificing downstream task performance. SMALR learns a fixed size language-agnostic representation for most words in a multilingual vocabulary, keeping language-specific features for just a few. We use a masked cross-language modeling loss to align features with context from other languages. Additionally, we propose a cross-lingual consistency module that ensures predictions made for a query and its machine translation are comparable. The effectiveness of SMALR is demonstrated with ten diverse languages, over twice the number supported in vision-language tasks to date. We evaluate on multilingual image-sentence retrieval and outperform prior work by 3-4% with less than 1/5th the training parameters compared to other word embedding methods.


title: Discrimination against or in favor of qubits in quantum theory

abstract: Within context of quantum logic, it is possible to assign dispersion-free probabilities to experimental propositions pertaining to qubits. This makes qubits distinct from the rest of quantum systems since the latter do not admit probabilities having only values 0 and 1. The present paper shows that erasing qubit discrimination leads to a model of computation which permits execution of many primitive operations in a massive parallel way. In the paper, it is demonstrated that such a model (that can be called a quantum parallel random-access machine, QPRAM) is quantum mechanically plausible.


title: Client Selection and Bandwidth Allocation in Wireless Federated Learning Networks: A Long-Term Perspective

abstract: This paper studies federated learning (FL) in a classic wireless network, where learning clients share a common wireless link to a coordinating server to perform federated model training using their local data. In such wireless federated learning networks (WFLNs), optimizing the learning performance depends crucially on how clients are selected and how bandwidth is allocated among the selected clients in every learning round, as both radio and client energy resources are limited. While existing works have made some attempts to allocate the limited wireless resources to optimize FL, they focus on the problem in individual learning rounds, overlooking an inherent yet critical feature of federated learning. This paper brings a new long-term perspective to resource allocation in WFLNs, realizing that learning rounds are not only temporally interdependent but also have varying significance towards the final learning outcome. To this end, we first design data-driven experiments to show that different temporal client selection patterns lead to considerably different learning performance. With the obtained insights, we formulate a stochastic optimization problem for joint client selection and bandwidth allocation under long-term client energy constraints, and develop a new algorithm that utilizes only currently available wireless channel information but can achieve long-term performance guarantee. Further experiments show that our algorithm results in the desired temporal client selection pattern, is adaptive to changing network environments and far outperforms benchmarks that ignore the long-term effect of FL.


title: Large Arabic Twitter Dataset on COVID-19

abstract: The 2019 coronavirus disease (COVID-19), emerged late December 2019 in China, is now rapidly spreading across the globe. At the time of writing this paper, the number of global confirmed cases has passed two millions and half with over 180,000 fatalities. Many countries have enforced strict social distancing policies to contain the spread of the virus. This have changed the daily life of tens of millions of people, and urged people to turn their discussions online, e.g., via online social media sites like Twitter. In this work, we describe the first Arabic tweets dataset on COVID-19 that we have been collecting since January 1st, 2020. The dataset would help researchers and policy makers in studying different societal issues related to the pandemic. Many other tasks related to behavioral change, information sharing, misinformation and rumors spreading can also be analyzed.


title: Surface Crystallization of Monoatomic Pd Metallic Glasses

abstract: Crystallization from an amorphous atomic structure is usually seen as a spontaneous process in pursuit of a lower energy state, but for alloy systems it is often hard to elucidate because of the intrinsic structural and compositional complexity. Here, by means of electron beam irradiation, we found surface-limited, and thus size-dependent crystallization in a system of monoatomic Pd metallic glass, which is ascribed to the structural differences between the surface and the interior. The equilibrium thickness of the surface crystallization is controllable, presenting a promising approach to fabricate novel nanostructures. The investigation is believed to provide a general understanding of solid amorphous-to-crystalline phase transition from the nanoscale to the bulk size.


title: Identification of splicing edges in tampered image based on Dichromatic Reflection Model

abstract: Imaging is a sophisticated process combining a plenty of photovoltaic conversions, which lead to some spectral signatures beyond visual perception in the final images. Any manipulation against an original image will destroy these signatures and inevitably leave some traces in the final forgery. Therefore we present a novel optic-physical method to discriminate splicing edges from natural edges in a tampered image. First, we transform the forensic image from RGB into color space of S and o1o2. Then on the assumption of Dichromatic Reflection Model, edges in the image are discovered by composite gradient and classified into different types based on their different photometric properties. Finally, splicing edges are reserved against natural ones by a simple logical algorithm. Experiment results show the efficacy of the proposed method.


title: Low Bitrate Image Compression with Discretized Gaussian Mixture Likelihoods

abstract: In this paper, we provide a detailed description on our submitted method Kattolab to Workshop and Challenge on Learned Image Compression (CLIC) 2020. Our method mainly incorporates discretized Gaussian Mixture Likelihoods to previous state-of-the-art learned compression algorithms. Besides, we also describes the acceleration strategies and bit optimization with the low-rate constraint. Experimental results have demonstrated that our approach Kattolab achieves 0.9761 and 0.9802 in terms of MS-SSIM at the rate constraint of 0.15bpp during the validation phase and test phase, respectively. This project page is at this https URL https://github.com/ZhengxueCheng/Learned-Image-Compression-with-GMM-and-Attention


title: Efficient Linear and Unconditionally Energy Stable Schemes for the Modified Phase Field Crystal Equation

abstract: In this paper, we construct efficient schemes based on the scalar auxiliary variable (SAV) block-centered finite difference method for the modified phase field crystal (MPFC) equation, which is a sixth-order nonlinear damped wave equation. The schemes are linear, conserve mass and unconditionally dissipate a pseudo energy. We prove rigorously second-order error estimates in both time and space for the phase field variable in discrete norms. We also present some numerical experiments to verify our theoretical results and demonstrate the robustness and accuracy.


title: TOG: Targeted Adversarial Objectness Gradient Attacks on Real-time Object Detection Systems

abstract: The rapid growth of real-time huge data capturing has pushed the deep learning and data analytic computing to the edge systems. Real-time object recognition on the edge is one of the representative deep neural network (DNN) powered edge systems for real-world mission-critical applications, such as autonomous driving and augmented reality. While DNN powered object detection edge systems celebrate many life-enriching opportunities, they also open doors for misuse and abuse. This paper presents three Targeted adversarial Objectness Gradient attacks, coined as TOG, which can cause the state-of-the-art deep object detection networks to suffer from object-vanishing, object-fabrication, and object-mislabeling attacks. We also present a universal objectness gradient attack to use adversarial transferability for black-box attacks, which is effective on any inputs with negligible attack time cost, low human perceptibility, and particularly detrimental to object detection edge systems. We report our experimental measurements using two benchmark datasets (PASCAL VOC and MS COCO) on two state-of-the-art detection algorithms (YOLO and SSD). The results demonstrate serious adversarial vulnerabilities and the compelling need for developing robust object detection systems.


title: An inertial shrinking projection algorithm for split common fixed point problems

abstract: In this paper, the purpose is to introduce and study a new modified shrinking projection algorithm with inertial effects, which solves split common fixed point problems in Banach spaces. The corresponding strong convergence theorems are obtained without the assumption of semi-compactness on mappings. Finally, some numerical examples are presented to illustrate the results in this paper.


title: Quasi-Newton Solver for Robust Non-Rigid Registration

abstract: Imperfect data (noise, outliers and partial overlap) and high degrees of freedom make non-rigid registration a classical challenging problem in computer vision. Existing methods typically adopt the $\ell_{p}$ type robust estimator to regularize the fitting and smoothness, and the proximal operator is used to solve the resulting non-smooth problem. However, the slow convergence of these algorithms limits its wide applications. In this paper, we propose a formulation for robust non-rigid registration based on a globally smooth robust estimator for data fitting and regularization, which can handle outliers and partial overlaps. We apply the majorization-minimization algorithm to the problem, which reduces each iteration to solving a simple least-squares problem with L-BFGS. Extensive experiments demonstrate the effectiveness of our method for non-rigid alignment between two shapes with outliers and partial overlap, with quantitative evaluation showing that it outperforms state-of-the-art methods in terms of registration accuracy and computational speed. The source code is available at https://github.com/Juyong/Fast_RNRR.


title: Efficient Robust Dispatch of Combined Heat and Power Systems

abstract: Combined heat and power systems facilitate efficient interactions between individual energy sectors for higher renewable energy accommodation. However, the feasibility of operational strategies is difficult to guarantee due to the presence of substantial uncertainties pertinent to renewable energy and multi-energy loads. This paper proposes a novel efficient robust dispatch model of combined heat and power systems based on extensions of disturbance invariant sets. The approach has high computational efficiency and provides flexible and robust strategies with an adjustable level of conservativeness. In particular, the proposed robust dispatch method obtains operational strategies by solving a nominal uncertainty-free dispatch problem, whose complexity is identical to a deterministic problem. The robustness against uncertainties is enhanced by endowing the nominal dispatch model with properly tightened constraints considering time-variant uncertainty sets. Towards this end, a novel direct constraint tightening algorithm is developed based on the dual norm to calculate multi-period tightened constraints efficiently without linear programming iterations. Furthermore, the budget uncertainty set is newly combined with constraint tightening to flexibly adjust the conservativeness level of robust solutions. The effectiveness of the proposed robust method is demonstrated in simulation studies of a test system in terms of computational efficiency, decision robustness and cost optimality.


title: Sliding possibility of the Julia sets

abstract: A. Sannami constructed an example of the differentiable Cantor set embedded in the real line whose difference set has a positive measure. In this paper, we generalize the definition of the difference sets for sets of the two dimensional Euclidean space as the sets of vectors between two sets, and estimate their measures. For the quadratic map Q_c(z)=z^2+c, we obtain that the measure of the difference set of its Julia set vanishes if |c|>3+sqrt{3}.


title: Regularized Boltzmann-Gibbs statistics for a Brownian particle in a non-confining field

abstract: We consider an overdamped Brownian particle subject to an asymptotically flat potential with a trap of depth $U_0$ around the origin. When the temperature is small compared to the trap depth ($\xi=k_B T/U_0 \ll 1$), there exists a range of timescales over which physical observables remain practically constant. This range can be very long, of the order of the Arrhenius factor ${\rm e}^{1/\xi}$. For these quasi-equilibrium states, the usual Boltzmann-Gibbs recipe does not work, since the partition function is divergent due to the flatness of the potential at long distances. However, we show that the standard Boltzmann-Gibbs (BG) statistical framework and thermodynamic relations can still be applied through proper regularization. This can be a valuable tool for the analysis of metastability in the non-confining potential fields that characterize a vast number of systems.


title: Accelerated projection-based forward-backward splitting algorithms for monotone inclusion problems

abstract: In this paper, based on inertial and Tseng's ideas, we propose two projection-based algorithms to solve a monotone inclusion problem in infinite dimensional Hilbert spaces. Solution theorems of strong convergence are obtained under the certain conditions. Some numerical experiments are presented to illustrate that our algorithms are efficient than the existing results.


title: Analysis of Vehicular Safety Messaging in Cellular Networks

abstract: This paper concerns the performance of vehicle-to-everything (V2X) communications. More precisely, we analyze the broadcast of safety-related V2X communications in cellular networks where base stations and vehicles are assumed to share the same spectrum and vehicles broadcast their safety messages to neighboring users. We model the locations of vehicles as a Poisson line Cox point process and the locations of users as a planar Poisson point process. We assume that users are associated with their closest base stations when there is no vehicle within a certain distance $ \rho $. On the other hand, users located within a distance $ \rho $ from vehicles are associated with the vehicles to receive their safety messages. We quantify the properties of this vehicle-prioritized association using the stochastic geometry framework. We derive the fractions of users that receive safety messages from vehicles. Then, we obtain the expression for the signal-to-interference ratio of the typical user evaluated on each association type. To address the impact of vehicular broadcast on the cellular network, the paper also derives the effective rate offered to the typical user in this setting.


title: A Brief Prehistory of Double Descent

abstract: In their thought-provoking paper [1], Belkin et al. illustrate and discuss the shape of risk curves in the context of modern high-complexity learners. Given a fixed training sample size $n$, such curves show the risk of a learner as a function of some (approximate) measure of its complexity $N$. With $N$ the number of features, these curves are also referred to as feature curves. A salient observation in [1] is that these curves can display, what they call, double descent: with increasing $N$, the risk initially decreases, attains a minimum, and then increases until $N$ equals $n$, where the training data is fitted perfectly. Increasing $N$ even further, the risk decreases a second and final time, creating a peak at $N=n$. This twofold descent may come as a surprise, but as opposed to what [1] reports, it has not been overlooked historically. Our letter draws attention to some original, earlier findings, of interest to contemporary machine learning.


title: A Deep-learning-based Method for PIR-based Multi-person Localization

abstract: Device-free localization (DFL) based on pyroelectric infrared (PIR) sensors has attracted much attention due to its advantages of low cost, low power consumption, and privacy protection. However, most existing PIR-based DFL methods require high deployment density to achieve high localization accuracy. Recently, a few works proposed that the deployment density can be reduced by deeply analyzing the analog output of PIR sensors. However, these methods can not well handle the localization task in multi-person scenarios yet. In this paper, we propose a novel neural network for PIR-based multi-person localization, which appropriately leverages a series of domain knowledge. Specifically, the proposed network consists of two modules: one is for determining the number of persons and another is for determining their locations. Meanwhile, the module of person counting is further designed as a two-stage network: one stage is for signal separation and another is for single-person detection. The module for localization is also designed as a two-stage network: one stage is for signal extraction and another is for single-person localization. Through the above methods, we succeed to remarkably reduce the deployment density of the traditional PIR-based method by about 76\%, while maintaining the localization accuracy.


title: The Secrecy Capacity of Cost-Constrained Wiretap Channels

abstract: In many information-theoretic channel coding problems, adding an input cost constraint to the operational setup amounts to restricting the optimization domain in the capacity formula. This paper shows that, in contrast to common belief, such a simple modification does not hold for the cost-constrained (CC) wiretap channel (WTC). The secrecy-capacity of the discrete memoryless (DM) WTC without cost constraints is described by a single auxiliary random variable. For the CC DM-WTC, however, we show that two auxiliaries are necessary to achieve capacity. Specifically, we first derive the secrecy-capacity formula, proving the direct part via superposition coding. Then, we provide an example of a CC DM-WTC whose secrecy-capacity cannot be achieved using a single auxiliary. This establishes the fundamental role of superposition coding over CC WTCs.


title: Robust Linear Precoder Design for 3D Massive MIMO Downlink with A Posteriori Channel Model

abstract: In this paper, we investigate the robust linear precoder design for three dimensional (3D) massive multi-input multi-output (MIMO) downlink with uniform planar array (UPA) and imperfect channel state information (CSI). In practical massive MIMO with UPAs, the number of antennas in each column or row is usually limited. The straightforward extension of the conventional DFT based beam domain channel model widely used in massive MIMO with uniform linear arrays (ULAs) can not apply. To overcome this issue, we establish a new beam domain channel model by using sampled steering vectors. Then, a novel method to obtain the beam domain channel power matrices and the instantaneous beam domain channel coefficients is proposed, and an a posteriori beam domain channel model which includes the channel aging and the spatial correlation is established. On the basis of the a posteriori channel model, we consider the robust precoder design with the expected weighted sum-rate maximization under a total power constraint. By viewing the power constraint as a Riemannian manifold, we transform the constrained optimization problem into an unconstrained optimization problem on the Riemannian manifold. Then, we derive an iterative algorithm to obtain the optimal precoders by setting the Riemannian gradient of the objective function to zero. Furthermore, we propose a low complexity robust precoder design by replacing the expected rates in the objective function with their upper bounds. Simulation results show that the proposed precoders can achieve significant performance gain than the widely used regularized zero forcing (RZF) precoder and signal to leakage noise ratio (SLNR) precoder.


title: Probing the early universe with a generalized action

abstract: Possibly, the most general action in the background of isotropic and homogeneous space-time has been considered to study the quantum evolution of the early universe, apart from a cosmological constant. The hermiticity of the effective Hamiltonian operator in the presence of curvature squared terms suggests unitary time evolution of the quantum states, assuring conservation of probability. The oscillatory behaviour of the semi-classical wavefunction around a de-Sitter solution signals that the theory is classically allowed, and the universe enters an inflationary regime just after Planck's era. In view of a hierarchy of Hubble flow parameters, and using a redefined effective potential, the complicated classical field equations in the presence of several coupling parameters, reduce to standard general-relativistic equations with a single scalar field. As a result, inflation has been studied without considering any additional flow parameters. Inflationary parameters lie very much within the presently available Planck's data, and the model admits graceful exit from inflation.


title: HopGAT: Hop-aware Supervision Graph Attention Networks for Sparsely Labeled Graphs

abstract: Due to the cost of labeling nodes, classifying a node in a sparsely labeled graph while maintaining the prediction accuracy deserves attention. The key point is how the algorithm learns sufficient information from more neighbors with different hop distances. This study first proposes a hop-aware attention supervision mechanism for the node classification task. A simulated annealing learning strategy is then adopted to balance two learning tasks, node classification and the hop-aware attention coefficients, along the training timeline. Compared with state-of-the-art models, the experimental results proved the superior effectiveness of the proposed Hop-aware Supervision Graph Attention Networks (HopGAT) model. Especially, for the protein-protein interaction network, in a 40% labeled graph, the performance loss is only 3.9%, from 98.5% to 94.6%, compared to the fully labeled graph. Extensive experiments also demonstrate the effectiveness of supervised attention coefficient and learning strategies.


title: Bringing heterogeneity to the CMS software framework

abstract: The advent of computing resources with co-processors, for example Graphics Processing Units (GPU) or Field-Programmable Gate Arrays (FPGA), for use cases like the CMS High-Level Trigger (HLT) or data processing at leadership-class supercomputers imposes challenges for the current data processing frameworks. These challenges include developing a model for algorithms to offload their computations on the co-processors as well as keeping the traditional CPU busy doing other work. The CMS data processing framework, CMSSW, implements multithreading using the Intel Threading Building Blocks (TBB) library, that utilizes tasks as concurrent units of work. In this paper we will discuss a generic mechanism to interact effectively with non-CPU resources that has been implemented in CMSSW. In addition, configuring such a heterogeneous system is challenging. In CMSSW an application is configured with a configuration file written in the Python language. The algorithm types are part of the configuration. The challenge therefore is to unify the CPU and co-processor settings while allowing their implementations to be separate. We will explain how we solved these challenges while minimizing the necessary changes to the CMSSW framework. We will also discuss on a concrete example how algorithms would offload work to NVIDIA GPUs using directly the CUDA API.


title: Comments on "Type II migration strikes back -- An old paradigm for planet migration in discs" by Scardoni et al

abstract: In the conventional view of type II migration, a giant planet migrates inward in the viscous velocity of the accretion disc in the so-call disc-dominate case. Recent hydrodynamic simulations, however, showed that planets migrate with velocities much faster than the viscous one in massive discs. Such fast migration cannot be explained by the conventional picture. Scardoni et al. (2020) has recently argued this new picture. By carrying out similar hydrodynamic simulations, they found that the migration velocity slows down with time and eventually reaches the prediction by the conventional theory. They interpreted the fast migration as an initial transient one and concluded that the conventional type II migration is realised after the transient phase. We show that the migration velocities obtained by Scardoni et al. (2020) are consistent with the previous simulations even in the transient phase that they proposed. We also find that the transient fast migration proposed by Scardoni et al. (2020) is well described by a new model of Kanagawa et al. (2018). The new model can appropriately describe significant inward migration during the initial transient phase that Scardoni et al. (2020) termed. Hence, we conclude that the time-variation of the transient migration velocity is due to the changes of the orbital radius of the planet and its background surface density during the migration.


title: MoreFusion: Multi-object Reasoning for 6D Pose Estimation from Volumetric Fusion

abstract: Robots and other smart devices need efficient object-based scene representations from their on-board vision systems to reason about contact, physics and occlusion. Recognized precise object models will play an important role alongside non-parametric reconstructions of unrecognized structures. We present a system which can estimate the accurate poses of multiple known objects in contact and occlusion from real-time, embodied multi-view vision. Our approach makes 3D object pose proposals from single RGB-D views, accumulates pose estimates and non-parametric occupancy information from multiple views as the camera moves, and performs joint optimization to estimate consistent, non-intersecting poses for multiple objects in contact. We verify the accuracy and robustness of our approach experimentally on 2 object datasets: YCB-Video, and our own challenging Cluttered YCB-Video. We demonstrate a real-time robotics application where a robot arm precisely and orderly disassembles complicated piles of objects, using only on-board RGB-D vision.


title: GeV emission of gamma-ray binary with pulsar scenario

abstract: We study GeV emission from gamma-ray binaries by assuming that the compact object is a young pulsar. We assume that the relativistic unshocked pulsar wind with Lorentz factor of 10^4~5 can produce the GeV emission by the inverse-Compton scattering process in the dense soft-photon field of the companion star. The travel distance of the unshocked pulsar wind that moves toward the observer depends on the orbital phase of the pulsar. We discuss that the orbital modulation of the GeV emission is a result of combination of the effects of the travel distance of the unshocked pulsar wind and of the anisotropic soft-photon field of the companion star. In this paper, we study how the effect of the travel distance of the unshocked pulsar wind affects to the orbital modulation of GeV emission. We apply our scenario to two gamma-ray binaries, LMC P3 and 4FGL J1405.5-6119. We find that with the suggested system parameters of LMC P3, the observed amplitude of the orbital modulation and the peak width are more consistent with the model light curve by taking into account the effect of the travel distance. For LMC P3, we analyze the GeV spectrum with 8-years Fermi-LAT data and discuss the broadband emission process in X-ray to TeV energy bands. We predict a possible system geometry for 4FGL J1405.5-6119 by fitting the GeV light curve. Key words: shock waves, gamma-rays: stars, stars: massive stars: mass-loss, stars: neutron


title: OV: Validity-based Optimistic Smart Contracts

abstract: Smart contract (SC) platforms form blocks of transactions into a chain and execute them via user-defined smart contracts. In conventional platforms like Bitcoin and Ethereum, the transactions within a block are executed \emph{sequentially} by the miner and are then validated \emph{sequentially} by the validators to reach consensus about the final state of the block. In order to leverage the advances of multicores, this paper explores the next generation of smart contract platforms that enables concurrent execution of such contracts. Reasoning about the validity of the object states is challenging in concurrent smart contracts. We examine a programming model to support \emph{optimistic} execution of SCTs. We introduce a novel programming language, so-called OV, and a Solidity API to ease programing of optimistic smart contracts. OV language together with static checking will help reasoning about a crucial property of optimistically executed smart contracts -- the validity of object states in trustless systems.


title: Confidence interval for the AUC of SROC curve and some related methods using bootstrap for meta-analysis of diagnostic accuracy studies

abstract: The area under the curve (AUC) of summary receiver operating characteristic (SROC) curve is a primary statistical outcome for meta-analysis of diagnostic test accuracy studies (DTA). However, its confidence interval has not been reported in most of DTA meta-analyses, because no certain methods and statistical packages have been provided. In this article, we provide a bootstrap algorithm for computing the confidence interval of the AUC. Also, using the bootstrap framework, we can conduct a bootstrap test for assessing significance of the difference of AUCs for multiple diagnostic tests. In addition, we provide an influence diagnostic method based on the AUC by leave-one-study-out analyses. We present illustrative examples using two DTA met-analyses for diagnostic tests of cervical cancer and asthma. We also developed an easy-to-handle R package dmetatools for these computations. The various quantitative evidence provided by these methods certainly supports the interpretations and precise evaluations of statistical evidence of DTA meta-analyses.


title: Reciprocal Learning Networks for Human Trajectory Prediction

abstract: We observe that the human trajectory is not only forward predictable, but also backward predictable. Both forward and backward trajectories follow the same social norms and obey the same physical constraints with the only difference in their time directions. Based on this unique property, we develop a new approach, called reciprocal learning, for human trajectory prediction. Two networks, forward and backward prediction networks, are tightly coupled, satisfying the reciprocal constraint, which allows them to be jointly learned. Based on this constraint, we borrow the concept of adversarial attacks of deep neural networks, which iteratively modifies the input of the network to match the given or forced network output, and develop a new method for network prediction, called reciprocal attack for matched prediction. It further improves the prediction accuracy. Our experimental results on benchmark datasets demonstrate that our new method outperforms the state-of-the-art methods for human trajectory prediction.


title: Objective Bayesian analysis for spatial Student-t regression models

abstract: The choice of the prior distribution is a key aspect of Bayesian analysis. For the spatial regression setting a subjective prior choice for the parameters may not be trivial, from this perspective, using the objective Bayesian analysis framework a reference is introduced for the spatial Student-t regression model with unknown degrees of freedom. The spatial Student-t regression model poses two main challenges when eliciting priors: one for the spatial dependence parameter and the other one for the degrees of freedom. It is well-known that the propriety of the posterior distribution over objective priors is not always guaranteed, whereas the use of proper prior distributions may dominate and bias the posterior analysis. In this paper, we show the conditions under which our proposed reference prior yield to a proper posterior distribution. Simulation studies are used in order to evaluate the performance of the reference prior to a commonly used vague proper prior.


title: Feedback Recurrent Autoencoder for Video Compression

abstract: Recent advances in deep generative modeling have enabled efficient modeling of high dimensional data distributions and opened up a new horizon for solving data compression problems. Specifically, autoencoder based learned image or video compression solutions are emerging as strong competitors to traditional approaches. In this work, We propose a new network architecture, based on common and well studied components, for learned video compression operating in low latency mode. Our method yields state of the art MS-SSIM/rate performance on the high-resolution UVG dataset, among both learned video compression approaches and classical video compression methods (H.265 and H.264) in the rate range of interest for streaming applications. Additionally, we provide an analysis of existing approaches through the lens of their underlying probabilistic graphical models. Finally, we point out issues with temporal consistency and color shift observed in empirical evaluation, and suggest directions forward to alleviate those.


title: Pruning and Sparsemax Methods for Hierarchical Attention Networks

abstract: This paper introduces and evaluates two novel Hierarchical Attention Network models [Yang et al., 2016] - i) Hierarchical Pruned Attention Networks, which remove the irrelevant words and sentences from the classification process in order to reduce potential noise in the document classification accuracy and ii) Hierarchical Sparsemax Attention Networks, which replace the Softmax function used in the attention mechanism with the Sparsemax [Martins and Astudillo, 2016], capable of better handling importance distributions where a lot of words or sentences have very low probabilities. Our empirical evaluation on the IMDB Review for sentiment analysis datasets shows both approaches to be able to match the results obtained by the current state-of-the-art (without, however, any significant benefits). All our source code is made available athttps://github.com/jmribeiro/dsl-project.


title: Revisiting 2-3 Red-Black Trees with a Pedagogically Sound yet Efficient Deletion Algorithm: The Parity-Seeking Delete Algorithm

abstract: Red-black (RB) trees are one of the most efficient variants of balanced binary search trees. However, they have always been blamed for being too complicated, hard to explain, and not suitable for pedagogical purposes. In the pioneering work of Guibas & Sedgewick (1978), both 2-3 and 2-3-4 variants of RB trees had been considered, but further study of the former had been abandoned due to the higher number of rotations in the insert algorithm. Sedgewick (2008) proposed a variant of 2-3 RB trees, viz. left-leaning red-black (LLRB) trees, in which red links are restricted to left children and proposed concise recursive insert and delete algorithms. However, the top-down deletion algorithm of LLRB is still very complicated and highly inefficient. In this paper, we reconsider 2-3 red-black trees in which both children of a node cannot be red. We propose a parity-seeking delete algorithm with the basic idea of making the deficient subtree on a par with its sibling: either by fixing the deficient subtree or by turning the sibling deficient as well, ascending deficiency to the parent node. Interestingly, the proposed parity-seeking delete algorithm works for 2-3-4 RB trees as well. Our experiments show that 2-3 RB trees are almost as efficient as RB trees and twice faster than LLRB trees. Besides, RB trees with the proposed parity-seeking delete algorithm have the same number of rotations and almost identical running time as the classical delete algorithm. While being extremely efficient, the proposed parity-seeking delete algorithm is easily understandable and suitable for pedagogical purposes.


title: Masked GANs for Unsupervised Depth and Pose Prediction with Scale Consistency

abstract: Previous work has shown that adversarial learning can be used for unsupervised monocular depth and visual odometry (VO) estimation, in which the adversarial loss and the geometric image reconstruction loss are utilized as the mainly supervisory signals to train the whole unsupervised framework. However, the performance of the adversarial framework and image reconstruction is usually limited by occlusions and the visual field changes between frames. This paper proposes a masked generative adversarial network (GAN) for unsupervised monocular depth and ego-motion estimation.The MaskNet and Boolean mask scheme are designed in this framework to eliminate the effects of occlusions and impacts of visual field changes on the reconstruction loss and adversarial loss, respectively. Furthermore, we also consider the scale consistency of our pose network by utilizing a new scale-consistency loss, and therefore, our pose network is capable of providing the full camera trajectory over a long monocular sequence. Extensive experiments on the KITTI dataset show that each component proposed in this paper contributes to the performance, and both our depth and trajectory predictions achieve competitive performance on the KITTI and Make3D datasets.


title: Massive MIMO Channels with Inter-User Angle Correlation: Open-Access Dataset, Analysis and Measurement-Based Validation

abstract: In practical propagation environments, different massive MIMO users can have correlated angles in spatial paths. In this paper, we study the effect of angle correlation on inter-user channel correlation via a combination of measurement and analysis. We show three key results. First, we collect a massive MIMO channel dataset for examining the inter-user channel correlation in a real-world propagation environment; the dataset is now open-access. We observed channel correlation higher than $0.48$ for all close-by users. Additionally, over $30$ % of far-away users, even when they are tens of wavelengths apart, have inter-user channel correlation that is at least twice higher than the correlation in the i.i.d. Rayleigh fading channel. Second, we compute the inter-user channel correlation in closed-form as a function of inter-user angle correlation, the number of base-station antennas, and base-station inter-antenna spacing. Our analysis shows that inter-user angle correlation increases the inter-user channel correlation. Inter-user channel correlation reduces with a larger base-station array aperture, i.e., more antennas and larger inter-antenna spacing. Third, we explain the measurements with numerical experiments to show that inter-user angle correlation can result in significant inter-user channel correlation in practical massive MIMO channels.


title: Mixed multifractal spectra of Birkhoff averages for non-uniformly expanding one-dimensional Markov maps with countably many branches

abstract: For a Markov map of an interval or the circle with countably many branches and finitely many neutral periodic points, we establish conditional variational formulas for the mixed multifractal spectra of Birkhoff averages of countably many observables, in terms of the Hausdorff dimension of invariant probability measures. Using our results, we are able to exhibit new fractal-geometric results for backward continued fraction expansions of real numbers, answering in particular a question of Pollicott. Moreover, we establish formulas for multi-cusp winding spectra for the Bowen-Series maps associated with finitely generated free Fuchsian groups with parabolic elements.


title: On the sparsity of LASSO minimizers in sparse data recovery

abstract: We present a detailed analysis of the unconstrained $\ell_1$-weighted LASSO method for recovery of sparse data from its observation by randomly generated matrices, satisfying the Restricted Isometry Property (RIP) with constant $\delta<1$, and subject to negligible measurement and compressibility errors. We prove that if the data is $k$-sparse, then the size of support of the LASSO minimizer, $s$, maintains a comparable sparsity, $s\leq C_\delta k$. For example, if $\delta=0.7$ then $s< 11k$ and a slightly smaller $\delta=0.4$ yields $s< 4k$. We also derive new $\ell_2/\ell_1$ error bounds which highlight precise dependence on $k$ and on the LASSO parameter $\lambda$, before the error is driven below the scale of negligible measurement/ and compressiblity errors.


title: A robust fiber-based quantum thermometer coupled with nitrogen-vacancy centers

abstract: The nitrogen-vacancy center in diamond has been broadly applied in quantum sensing since it is sensitive to different physical quantities. Meanwhile, it is difficult to isolate disturbances from unwanted physical quantities in practical applications. Here, we present a robust fiber-based quantum thermometer which can significantly isolate the magnetic field noise and microwave power shift. With a frequency modulation scheme, we realize the temperature measurement by detecting the variation of the sharp-dip in the zero-field optically detected magnetic resonance spectrum in a high-density nitrogen-vacancy ensemble. Thanks to its simplicity and compatibility in implementation and robustness in the isolation of magnetic and microwave noise, this quantum thermometer is then applied to the surface temperature imaging of an electronic chip with a sensitivity of $18$ $\rm{mK}/\sqrt{\rm{Hz}}$. It paves the way to high sensitive temperature measurement in ambiguous environments.


title: Gravitational Wave from Axion-SU(2) Gauge Fields: Effective Field Theory for Kinetically Driven Inflation

abstract: Building on Weinberg's approach to effective field theory for inflation, we construct an effective Lagrangian for a pseudo scalar (axion) inflaton field with shift symmetry. In this Lagrangian we allow the axion field to couple to non-Abelian gauge fields via a Chern-Simons term. We then analyze a class of inflation models driven by kinetic terms. We find that the observational constraints on the amplitudes of curvature perturbations and non-Gaussianity yield a lower bound for the tensor-to-scalar ratio of $r\gtrsim 5\times 10^{-3}$ from the vacuum fluctuation. The sourced gravitational wave from SU(2) gauge fields further increases the tensor-to-scalar ratio and makes the total gravitational wave partially chiral and non-Gaussian, which can be probed by polarization of the cosmic microwave background and direct detection experiments. We discuss constraints on parameter space due to backreaction of spin-2 particles produced by the gauge field.


title: Multi-feature super-resolution network for cloth wrinkle synthesis

abstract: Existing physical cloth simulators suffer from expensive computation and difficulties in tuning mechanical parameters to get desired wrinkling behaviors. Data-driven methods provide an alternative solution. It typically synthesizes cloth animation at a much lower computational cost, and also creates wrinkling effects that highly resemble the much controllable training data. In this paper we propose a deep learning based method for synthesizing cloth animation with high resolution meshes. To do this we first create a dataset for training: a pair of low and high resolution meshes are simulated and their motions are synchronized. As a result the two meshes exhibit similar large-scale deformation but different small wrinkles. Each simulated mesh pair are then converted into a pair of low and high resolution "images" (a 2D array of samples), with each sample can be interpreted as any of three features: the displacement, the normal and the velocity. With these image pairs, we design a multi-feature super-resolution (MFSR) network that jointly train an upsampling synthesizer for the three features. The MFSR architecture consists of two key components: a sharing module that takes multiple features as input to learn low-level representations from corresponding super-resolution tasks simultaneously; and task-specific modules focusing on various high-level semantics. Frame-to-frame consistency is well maintained thanks to the proposed kinematics-based loss function. Our method achieves realistic results at high frame rates: 12-14 times faster than traditional physical simulation. We demonstrate the performance of our method with various experimental scenes, including a dressed character with sophisticated collisions.


title: A Steering Paradox for Einstein-Podolsky-Rosen Argument and its Extended Inequality

abstract: The Einstein-Podolsky-Rosen (EPR) paradox is one of the milestones in quantum foundations, arising from the lack of local realistic description of quantum mechanics. The EPR paradox has stimulated an important concept of "quantum nonlocality", which manifests itself by three different types: quantum entanglement, quantum steering, and Bell nonlocality. Although Bell nonlocality is more often used to show the "quantum nonlocality", the original EPR paradox is essentially a steering paradox. In this work, we formulate the original EPR steering paradox into a contradiction equality,thus making it amenable to an experimental verification. We perform an experimental test of the steering paradox in a two-qubit scenario. Furthermore, by starting from the steering paradox, we generate a generalized linear steering inequality and transform this inequality into a mathematically equivalent form, which is more friendly for experimental implementation, i.e., one may only measure the observables in $x$-, $y$-, or $z$-axis of the Bloch sphere, rather than other arbitrary directions. We also perform experiments to demonstrate this scheme. Within the experimental errors, the experimental results coincide with the theoretical predictions. Our results deepen the understanding of quantum foundations and provide an efficient way to detect the steerability of quantum states.


title: Deep learning the atmospheric boundary layer height

abstract: A question of global concern regarding the sustainable future of humankind stems from the effect due to aerosols on the global climate. The quantification of atmospheric aerosols and their relationship to climatic impacts are key to understanding the dynamics of climate forcing and to improve our knowledge about climate change. Due to its response to precipitation, temperature, topography and human activity, one of the most dynamical atmospheric regions is the atmospheric boundary layer (ABL): ABL aerosols have a sizable impact on the evolution of the radiative forcing of climate change, human health, food security, and, ultimately, on the local and global economy. The identification of ABL pattern behaviour requires constant monitoring and the application of instrumental and computational methods for its detection and analysis. Here, we show a new method for the retrieval of ABL top arising from light detection and ranging (LiDAR) signals, by training a convolutional neural network in a supervised manner; forcing it to learn how to retrieve such a dynamical parameter on real, non-ideal conditions and in a fully automated, unsupervised way. Our findings pave the way for a full integration of LiDAR elastic, inelastic, and depolarisation signal processing, and provide a novel approach for real-time quantitative sensing of aerosols.


title: Study on the atmospheric pressure homogeneous discharge in air assisted with a floating carbon fibre microelectrode

abstract: Based on the consideration of increasing the number of initial electrons and providing an appropriate distribution of electric field strength for discharge space, a method of adopting the wire-cylindrical type electrode structure with a floating carbon fibre electrode to achieve atmospheric pressure homogeneous discharge (APHD) in air is proposed in this paper. Studies of the electrode characteristics show that this structure can make full use of the microdischarge process of the carbon fibre microelectrode and the good discharge effect of the helical electrode to provide plenty of initial electrons for the discharge space. Besides, the non-uniform electric field distribution with gradual change is conducive to the slow growth of electron avalanches in this structure. Thus, the initial discharge voltage can be reduced and the formation of filamentary discharge channels can be inhibited, which provides theoretical possibilities for the homogeneous discharge in atmospheric air. Experiments show that a three-dimensional uniform discharge phenomenon can be realized under a 6.0 kV applied voltage in a PFA tube of 6 mm inner diameter, displaying good uniformity and large scale.


title: Sensor placement minimizing the state estimation mean square error: Performance guarantees of greedy solutions

abstract: This paper studies selecting a subset of the system's output to minimize the state estimation mean square error (MSE). This results in the maximization problem of a set function defined on possible sensor selections subject to a cardinality constraint. We consider to solve it approximately by a greedy search. Since the MSE function is not submodular nor supermodular, the well-known performance guarantees for the greedy solutions do not hold in the present case. Thus, we use the quantities---the submodularity ratio and the curvature---to evaluate the degrees of submodularity and supermodularity of the objective function. By using the properties of the MSE function, we approximately compute these quantities and derive a performance guarantee for the greedy solutions. It is shown that the guarantee is less conservative than those in the existing results.


title: Improved tripartite uncertainty relation with quantum memory

abstract: Uncertainty principle is a striking and fundamental feature in quantum mechanics distinguishing from classical mechanics. It offers an important lower bound to predict outcomes of two arbitrary incompatible observables measured on a particle. In quantum information theory, this uncertainty principle is popularly formulized in terms of entropy. Here, we present an improvement of tripartite quantum-memory-assisted entropic uncertainty relation. The uncertainty's lower bound is derived by considering mutual information and Holevo quantity. It shows that the bound derived by this method will be tighter than the lower bound in [Phys. Rev. Lett. 103, 020402 (2009)]. Furthermore, regarding a pair of mutual unbiased bases as the incompatibility, our bound will become extremely tight for the three-qubit $\emph{X}$-state system, completely coinciding with the entropy-based uncertainty, and can restore Renes ${\emph{et al.}}$'s bound with respect to arbitrary tripartite pure states. In addition, by applying our lower bound, one can attain the tighter bound of quantum secret key rate, which is of basic importance to enhance the security of quantum key distribution protocols.


title: Stochastic Variance-Reduced Prox-Linear Algorithms for Nonconvex Composite Optimization

abstract: We consider minimization of composite functions of the form $f(g(x))+h(x)$, where $f$ and $h$ are convex functions (which can be nonsmooth) and $g$ is a smooth vector mapping. In addition, we assume that $g$ is the average of finite number of component mappings or the expectation over a family of random component mappings. We propose a class of stochastic variance-reduced prox-linear algorithms for solving such problems and bound their sample complexities for finding an $\epsilon$-stationary point in terms of the total number of evaluations of the component mappings and their Jacobians. When $g$ is a finite average of $N$ components, we obtain sample complexity $\mathcal{O}(N+ N^{4/5}\epsilon^{-1})$ for both mapping and Jacobian evaluations. When $g$ is a general expectation, we obtain sample complexities of $\mathcal{O}(\epsilon^{-5/2})$ and $\mathcal{O}(\epsilon^{-3/2})$ for component mappings and their Jacobians respectively. If in addition $f$ is smooth, then improved sample complexities of $\mathcal{O}(N+N^{1/2}\epsilon^{-1})$ and $\mathcal{O}(\epsilon^{-3/2})$ are derived for $g$ being a finite average and a general expectation respectively, for both component mapping and Jacobian evaluations.


title: Smooth controllability of the Navier-Stokes equation with Navier conditions. Application to Lagrangian controllability

abstract: We deal with the 3D Navier-Stokes equation in a smooth simply connected bounded domain, with controls on a non-empty open part of the boundary and a Navier slip-with-friction boundary condition on the remaining, uncontrolled, part of the boundary. We extend the small-time global exact controllability result in [J. M. Coron, F. Marbach and F. Sueur, Small-time global exact controllability of the Navier-Stokes equation with Navier slip-with-friction boundary conditions, J. Eur. Math. Soc., 22 (2020),1625-1673.] from Leray weak solutions to the case of smooth solutions. Our strategy relies on a refinement of the method of well-prepared dissipation of the viscous boundary layers which appear near the uncontrolled part of the boundary, which allows to handle the multi-scale features in a finer topology. As a byproduct of our analysis we also obtain a small-time global approximate Lagrangian controllability result, extending to the case of the Navier-Stokes equations the recent results [O. Glass and T. Horsin, Approximate Lagrangian controllability for the 2-D Euler equation. Application to the control of the shape of vortex patches, J. Math. Pures Appl. (9), 93 (2010), 61-90], [O. Glass and T. Horsin, Prescribing the motion of a set of particles in a three-dimensional perfect fluid, SIAM J. Control Optim., 50 (2012), 2726-2742], [T. Horsin and O. Kavian, Lagrangian controllability of inviscid incompressible fluids: a constructive approach, ESAIM Control Optim. Calc. Var., 23 (2017), 1179-1200] in the case of the Euler equations and the result [O. Glass and T. Horsin, Lagrangian controllability at low Reynolds number, ESAIM Control Optim. Calc. Var., 22 (2016), 1040-1053] in the case of the steady Stokes equations.


title: FPDetect: Efficient Reasoning About Stencil Programs Using Selective Direct Evaluation

abstract: We present FPDetect, a low overhead approach for detecting logical errors and soft errors affecting stencil computations without generating false positives. We develop an offline analysis that tightly estimates the number of floating-point bits preserved across stencil applications. This estimate rigorously bounds the values expected in the data space of the computation. Violations of this bound can be attributed with certainty to errors. FPDetect helps synthesize error detectors customized for user-specified levels of accuracy and coverage. FPDetect also enables overhead reduction techniques based on deploying these detectors coarsely in space and time. Experimental evaluations demonstrate the practicality of our approach.


title: The Lyman Continuum Escape Fraction of Galaxies and AGN in the GOODS Fields

abstract: We present our analysis of the LyC emission and escape fraction of 111 spectroscopically verified galaxies with and without AGN from $2.26<z<4.3$. We extended our ERS sample from Smith et al. (2018; arXiv:1602.01555) with 64 galaxies in the GOODS North and South fields using WFC3/UVIS F225W, F275W, and F336W mosaics we independently drizzled using the HDUV, CANDELS, and UVUDF data. Among the 17 AGN from the 111 galaxies, one provided a LyC detection in F275W at $m_{AB}=23.19$ mag (S/N $\simeq$ 133) and $GALEX$ NUV at $m_{AB}=23.77$ mag (S/N $\simeq$ 13). We simultaneously fit $SDSS$ and $Chandra$ spectra of this AGN to an accretion disk and Comptonization model and find $f_{esc}$ values of $f_{esc}^{F275W}\simeq 28^{+20}_{-4}$% and $f_{esc}^{NUV}\simeq 30^{+22}_{-5}$%. For the remaining 110 galaxies, we stack image cutouts that capture their LyC emission using the F225W, F275W, and F336W data of the GOODS and ERS samples, and both combined, as well as subsamples of galaxies with and without AGN, and $all$ galaxies. We find the stack of 17 AGN dominate the LyC production from $\langle z\rangle\simeq 2.3-4.3$ by a factor of $\sim$10 compared to all 94 galaxies without AGN. While the IGM of the early universe may have been reionized mostly by massive stars, there is evidence that a significant portion of the ionizing energy came from AGN.


title: Calibrating Structured Output Predictors for Natural Language Processing

abstract: We address the problem of calibrating prediction confidence for output entities of interest in natural language processing (NLP) applications. It is important that NLP applications such as named entity recognition and question answering produce calibrated confidence scores for their predictions, especially if the system is to be deployed in a safety-critical domain such as healthcare. However, the output space of such structured prediction models is often too large to adapt binary or multi-class calibration methods directly. In this study, we propose a general calibration scheme for output entities of interest in neural-network based structured prediction models. Our proposed method can be used with any binary class calibration scheme and a neural network model. Additionally, we show that our calibration method can also be used as an uncertainty-aware, entity-specific decoding step to improve the performance of the underlying model at no additional training cost or data requirements. We show that our method outperforms current calibration techniques for named-entity-recognition, part-of-speech and question answering. We also improve our model's performance from our decoding step across several tasks and benchmark datasets. Our method improves the calibration and model performance on out-of-domain test scenarios as well.


title: Detecting Dynamic Community Structure in Functional Brain Networks Across Individuals: A Multilayer Approach

abstract: We present a unified statistical framework for characterizing community structure of brain functional networks that captures variation across individuals and evolution over time. Existing methods for community detection focus only on single-subject analysis of dynamic networks; while recent extensions to multiple-subjects analysis are limited to static networks. To overcome these limitations, we propose a multi-subject, Markov-switching stochastic block model (MSS-SBM) to identify state-related changes in brain community organization over a group of individuals. We first formulate a multilayer extension of SBM to describe the time-dependent, multi-subject brain networks. We develop a novel procedure for fitting the multilayer SBM that builds on multislice modularity maximization which can uncover a common community partition of all layers (subjects) simultaneously. By augmenting with a dynamic Markov switching process, our proposed method is able to capture a set of distinct, recurring temporal states with respect to inter-community interactions over subjects and the change points between them. Simulation shows accurate community recovery and tracking of dynamic community regimes over multilayer networks by the MSS-SBM. Application to task fMRI reveals meaningful non-assortative brain community motifs, e.g., core-periphery structure at the group level, that are associated with language comprehension and motor functions suggesting their putative role in complex information integration. Our approach detected dynamic reconfiguration of modular connectivity elicited by varying task demands and identified unique profiles of intra and inter-community connectivity across different task conditions. The proposed multilayer network representation provides a principled way of detecting synchronous, dynamic modularity in brain networks across subjects.

categories: cs.LG eess.SP physics.soc-ph q-bio.NC stat.ML