title: Computing semigroups with error control

abstract: We develop an algorithm that computes strongly continuous semigroups on infinite-dimensional Hilbert spaces with explicit error control. Given a generator $A$, a time $t>0$, an arbitrary initial vector $u_0$ and an error tolerance $\epsilon>0$, the algorithm computes $\exp(tA)u_0$ with error bounded by $\epsilon$. The algorithm is based on a combination of a regularized functional calculus, suitable contour quadrature rules, and the adaptive computation of resolvents in infinite dimensions. As a particular case, we show that it is possible, even when only allowing pointwise evaluation of coefficients, to compute, with error control, semigroups on the unbounded domain $L^2(\mathbb{R}^d)$ that are generated by partial differential operators with polynomially bounded coefficients of locally bounded total variation. For analytic semigroups (and more general Laplace transform inversion), we provide a quadrature rule whose error decreases like $\exp(-cN/\log(N))$ for $N$ quadrature points, that remains stable as $N\rightarrow\infty$, and which is also suitable for infinite-dimensional operators. Numerical examples are given, including: Schr\"odinger and wave equations on the aperiodic Ammann--Beenker tiling, complex perturbed fractional diffusion equations on $L^2(\mathbb{R})$, and damped Euler--Bernoulli beam equations.


title: The Influence of the Peculiar Velocities of SNe Ia in Clusters of Galaxies on the Redshift Measurements

abstract: The most intriguing question of modern astronomy is the question of our Universe formation. The Hubble diagram analysis with Type Ia Supernovae (SNe Ia) is widely used to estimate the cosmological parameters with high accuracy. The cosmological measurements allow us to better understand the early stages of the Universe evolution. Nevertheless, the redshift on the SN Ia Hubble diagram includes the contribution from the unknown peculiar velocities that decreases the accuracy of such measurements. We consider the contamination of peculiar velocities of the host galaxies for those SNe that exploded in galaxy clusters. For this purpose, we use the Pantheon cosmological sample and offer the procedure to minimise the influence of such uncertainties.


title: An autonomous compartmental model for accelerating epidemics

abstract: In Fall 2020, several European countries reported rapid increases in COVID-19 cases along with growing estimates of the effective reproduction rates. Such an acceleration in epidemic spread is usually attributed to time-dependent effects, e.g. human travel, seasonal behavioral changes, mutations of the pathogen etc. In this case however the acceleration occurred when counter measures such as testing and contact tracing exceeded their capacity limit. Considering Austria as an example, here we show that this dynamics can be captured by a time-independent, i.e. autonomous, compartmental model that incorporates these capacity limits. In this model, the epidemic acceleration coincides with the exhaustion of mitigation efforts, resulting in an increasing fraction of undetected cases that drive the effective reproduction rate progressively higher. We demonstrate that standard models which does not include this effect necessarily result in a systematic underestimation of the effective reproduction rate.


title: Sharp Convergence to Equilibrium for the SSEP with Reservoirs

abstract: We consider the symmetric simple exclusion process evolving on the interval of length $n-1$ in contact with reservoirs of density $\rho \in (0,1)$ at the boundary. We use Yau's relative entropy method to show that if the initial measure is associated with a profile $u_0:[0,1] \to (0,1)$, then at explicit times $t^n(b)$ that depend on $u_0$, the distance to equilibrium, in total variation distance, converges, as $n \to \infty$, to a profile $\mathcal G(\gamma e^{-b})$. The parameter $\gamma$ also depends on the initial profile $u_0$ and $\mathcal G(m)$ stands for the total variation distance $\|\mathcal N (m,1) - \mathcal N(0,1)\|_{\mathrm{TV}}$.

categories: math.PR cond-mat.stat-mech math-ph math.MP


title: Tell Me How to Survey: Literature Review Made Simple with Automatic Reading Path Generation

abstract: Recent years have witnessed the dramatic growth of paper volumes with plenty of new research papers published every day, especially in the area of computer science. How to glean papers worth reading from the massive literature to do a quick survey or keep up with the latest advancement about a specific research topic has become a challenging task. Existing academic search engines such as Google Scholar return relevant papers by individually calculating the relevance between each paper and query. However, such systems usually omit the prerequisite chains of a research topic and cannot form a meaningful reading path. In this paper, we introduce a new task named Reading Path Generation (RPG) which aims at automatically producing a path of papers to read for a given query. To serve as a research benchmark, we further propose SurveyBank, a dataset consisting of large quantities of survey papers in the field of computer science as well as their citation relationships. Each survey paper contains key phrases extracted from its title and multi-level reading lists inferred from its references. Furthermore, we propose a graph-optimization-based approach for reading path generation which takes the relationship between papers into account. Extensive evaluations demonstrate that our approach outperforms other baselines. A Real-time Reading Path Generation System (RePaGer) has been also implemented with our designed model. To the best of our knowledge, we are the first to target this important research problem. Our source code of RePaGer system and SurveyBank dataset can be found on here.


title: Framework for Accessible and Inclusive Teaching Materials for Statistics and Data Science Courses

abstract: Despite rapid growth in the data science workforce, people of color, women, those with disabilities, and others remain underrepresented in, underserved by, and sometimes excluded from the field. This pattern prevents equal opportunity for individuals, while also creating products and policies that perpetuate inequality. Thus, for statistics and data science educators of the next generation, accessibility and inclusion should be of utmost importance in our programs and courses. In this paper, we discuss how we developed an accessibility and inclusion framework, hence a structure for holding ourselves accountable to these principles, for the writing of a statistics textbook. We share our experiences in setting accessibility and inclusion goals, the tools we used to achieve these goals, and recommendations for other educators. We provide examples for instructors that can be implemented in their own courses.


title: Poncelet Parabola Pirouettes

abstract: We describe some three-dozen curious phenomena manifested by parabolas inscribed or circumscribed about certain Poncelet triangle families. Despite their pirouetting motion, parabolas' focus, vertex, directrix, etc., will often sweep or envelop rather elementary loci such as lines, circles, or points. Most phenomena are unproven though supported by solid numerical evidence (proofs are welcome). Some yet unrealized experiments are posed as "challenges" (results are welcome!).


title: Tangent Space and Dimension Estimation with the Wasserstein Distance

abstract: Consider a set of points sampled independently near a smooth compact submanifold of Euclidean space. We provide mathematically rigorous bounds on the number of sample points required to estimate both the dimension and the tangent spaces of that manifold with high confidence. The algorithm for this estimation is Local PCA, a local version of principal component analysis. Our results accommodate for noisy non-uniform data distribution with the noise that may vary across the manifold, and allow simultaneous estimation at multiple points. Crucially, all of the constants appearing in our bound are explicitly described. The proof uses a matrix concentration inequality to estimate covariance matrices and a Wasserstein distance bound for quantifying nonlinearity of the underlying manifold and non-uniformity of the probability measure.


title: The Stiefel-Whitney classes of moment-angle manifolds are trivial

abstract: We prove that the Stiefel-Whitney classes of a moment-angle manifold, not necessarily smooth, are trivial. We also consider Stiefel-Whitney classes of the partial quotient of a moment-angle manifold.


title: Full linear Phan-Thien--Tanner fluid model: Exact analytical solutions for steady, start-up, and cessation regimes of shear and extensional flows

abstract: Exact, fully explicit, purely real analytical expressions for the material functions describing steady, startup, and cessation regimes of shear flows and of planar, uniaxial, and biaxial extensional flows of full linear Phan-Thien--Tanner fluids are obtained. These expressions, which have no analogs in the literature, are formulated in compact, beautiful forms, partially due to the unique scaling procedure reducing the number of the model parameters from four to one. The properties of the material functions are investigated in detail. For steady extensional flows, the possible shapes of the extensional viscosity curves are described and the conditions for these shapes to occur are determined. For startup flows, it is found when exactly the stress dynamics is oscillatory, and, in this case, a detailed characterization of oscillations is given, which includes expressions for the position and magnitude of stress overshoots and undershoots.


title: Jordan in The Church of The Higher Hilbert Space: Entanglement and Thermal Fluctuations

abstract: I revisit Jordan's derivation of Einstein's formula for energy fluctuations in the black body in thermal equilibrium. This formula is usually taken to represent the unification of the wave and the particle aspects of the electromagnetic field since the fluctuations can be shown to be the sum of wave-like and particle-like contributions. However, in Jordan's treatment there is no mention of the Planck distribution and all averages are performed with respect to pure number states of radiation (mixed states had not yet been discovered!). The chief reason why Jordan does reproduce Einstein's result despite not using thermal states of radiation is that he focuses on fluctuations in a small (compared to the whole) volume of the black body. The state of radiation in a small volume is highly entangled to the rest of the black body which leads to the correct fluctuations even though the overall state might, in fact, be assumed to be pure (i.e. at zero temperature). I present a simple derivation of the fluctuations formula as an instance of mixed states being reductions of higher level pure states, a representation that is affectionately known as ``Church of the Higher Hilbert Space". According to this view of mixed states, temperature is nothing but the amount of entanglement between the system and its environment.


title: Sub-Terahertz Spatial Statistical MIMO Channel Model for Urban Microcells at 142 GHz

abstract: Sixth generation (6G) cellular systems are expected to extend the operational range to sub-Terahertz (THz) frequencies between 100 and 300 GHz due to the broad unexploited spectrum therein. A proper channel model is needed to accurately describe spatial and temporal channel characteristics and faithfully create channel impulse responses at sub-THz frequencies. This paper studies the channel spatial statistics such as the number of spatial clusters and cluster power distribution based on recent radio propagation measurements conducted at 142 GHz in an urban microcell (UMi) scenario. For the 28 measured locations, we observe one to four spatial clusters at most locations. A detailed spatial statistical multiple input multiple output (MIMO) channel generation procedure is introduced based on the derived empirical channel statistics. We find that beamforming provides better spectral efficiency than spatial multiplexing in the LOS scenario due to the boresight path, and two spatial streams usually offer the highest spectral efficiency at most NLOS locations due to the limited number of spatial clusters.


title: Quantum circuits generating four-qubit maximally entangled states

abstract: We describe quantum circuits generating four-qubit maximally entangled states, the amount of entanglement being quantified by using the absolute value of the Cayley hyperdeterminant as an entanglement monotone. More precisely, we show that this type of four-qubit entangled states can be obtained by the action of a family of CNOT circuits on some special states of the LU orbit of the state |0000 >.


title: A Side-channel Analysis of Sensor Multiplexing for Covert Channels and Application Profiling on Mobile Devices

abstract: Mobile devices often distribute measurements from physical sensors to multiple applications using software multiplexing. On Android devices, the highest requested sampling frequency is returned to all applications, even if others request measurements at lower frequencies. In this paper, we comprehensively demonstrate that this design choice exposes practically exploitable side-channels using frequency-key shifting. By carefully modulating sensor sampling frequencies in software, we show how unprivileged malicious applications can construct reliable spectral covert channels that bypass existing security mechanisms. Additionally, we present a novel variant that allows an unprivileged malicious application to profile other active, sensor-enabled applications at a coarse-grained level. Both methods do not impose any special assumptions beyond accessing standard mobile services available to developers. As such, our work reports side-channel vulnerabilities that exploit subtle yet insecure design choices in Android sensor stacks.


title: Anomalies for anomalous symmetries

abstract: 4d gauge theories with massless fermions typically have axial U(1) transformations that suffer from the ABJ anomaly. One can modify the theory of interest by adding more fields in a way that restores the axial symmetry, and use it to derive rigorous 't-Hooft anomaly matching conditions. These conditions are not valid for the original theory of interest, but for the modified theory. We show that the modification can be done in a specific way that allows us to relate the dynamics of the modified theory to the dynamics of the original theory. In this way, the anomaly matching conditions of the modified theory can be used to learn new things on the original theory even though they involve axial transformations which are not a symmetry of the original theory. We describe this method and discuss some applications to various examples.


title: Fast Approximations for Job Shop Scheduling: A Lagrangian Dual Deep Learning Method

abstract: The Jobs shop Scheduling Problem (JSP) is a canonical combinatorial optimization problem that is routinely solved for a variety of industrial purposes. It models the optimal scheduling of multiple sequences of tasks, each under a fixed order of operations, in which individual tasks require exclusive access to a predetermined resource for a specified processing time. The problem is NP-hard and computationally challenging even for medium-sized instances. Motivated by the increased stochasticity in production chains, this paper explores a deep learning approach to deliver efficient and accurate approximations to the JSP. In particular, this paper proposes the design of a deep neural network architecture to exploit the problem structure, its integration with Lagrangian duality to capture the problem constraints, and a post-processing optimization to guarantee solution feasibility.The resulting method, called JSP-DNN, is evaluated on hard JSP instances from the JSPLIB benchmark library. Computational results show that JSP-DNN can produce JSP approximations of high quality at negligible computational costs.


title: Time Masking for Temporal Language Models

abstract: Our world is constantly evolving, and so is the content on the web. Consequently, our languages, often said to mirror the world, are dynamic in nature. However, most current contextual language models are static and cannot adapt to changes over time. In this work, we propose a temporal contextual language model called TempoBERT, which uses time as an additional context of texts. Our technique is based on modifying texts with temporal information and performing time masking - specific masking for the supplementary time information. We leverage our approach for the tasks of semantic change detection and sentence time prediction, experimenting on diverse datasets in terms of time, size, genre, and language. Our extensive evaluation shows that both tasks benefit from exploiting time masking.


title: Voice-assisted Image Labelling for Endoscopic Ultrasound Classification using Neural Networks

abstract: Ultrasound imaging is a commonly used technology for visualising patient anatomy in real-time during diagnostic and therapeutic procedures. High operator dependency and low reproducibility make ultrasound imaging and interpretation challenging with a steep learning curve. Automatic image classification using deep learning has the potential to overcome some of these challenges by supporting ultrasound training in novices, as well as aiding ultrasound image interpretation in patient with complex pathology for more experienced practitioners. However, the use of deep learning methods requires a large amount of data in order to provide accurate results. Labelling large ultrasound datasets is a challenging task because labels are retrospectively assigned to 2D images without the 3D spatial context available in vivo or that would be inferred while visually tracking structures between frames during the procedure. In this work, we propose a multi-modal convolutional neural network (CNN) architecture that labels endoscopic ultrasound (EUS) images from raw verbal comments provided by a clinician during the procedure. We use a CNN composed of two branches, one for voice data and another for image data, which are joined to predict image labels from the spoken names of anatomical landmarks. The network was trained using recorded verbal comments from expert operators. Our results show a prediction accuracy of 76% at image level on a dataset with 5 different labels. We conclude that the addition of spoken commentaries can increase the performance of ultrasound image classification, and eliminate the burden of manually labelling large EUS datasets necessary for deep learning applications.


title: Youth analysis of near infrared spectra of young low-mass stars and brown dwarfs

abstract: We aim at building a method that efficiently identifies young low-mass stars and brown dwarfs from low-resolution near-infrared spectra, by studying gravity-sensitive features and their evolution with age. We built a dataset composed of all publicly available ($\sim$2800) near-infrared spectra of dwarfs with spectral types between M0 and L3. First, we investigate methods for the derivation of the spectral type and extinction using comparison to spectral templates, and various spectral indices. Then, we examine gravity-sensitive spectral indices and apply machine learning methods, in order to efficiently separate young ($\lesssim$10 Myr) objects from the field. Using a set of six spectral indices for spectral typing, including two newly defined ones (TLI-J and TLI-K), we are able to achieve a precision below 1 spectral subtype across the entire spectral type range. We define a new gravity-sensitive spectral index (TLI-g) that consistently separates young from field objects, showing a performance superior to other indices from the literature. Even better separation between the two classes can be achieved through machine learning methods which use the entire NIR spectra as an input. Moreover, we show that the H- and K-bands alone are enough for this purpose. Finally, we evaluate the relative importance of different spectral regions for gravity classification as returned by the machine learning models. We find that the H-band broad-band shape is the most relevant feature, followed by the FeH absorption bands at 1.2 $\mu m$ and 1.24 $\mu m$ and the KI doublet at 1.24 $\mu m$.


title: Robust Performance Analysis of Source-Seeking Dynamics with Integral Quadratic Constraints

abstract: We analyze the performance of source-seeking dynamics involving either a single vehicle or multiple flocking-vehicles embedded in an underlying strongly convex scalar field with gradient based forcing terms. For multiple vehicles under flocking dynamics embedded in quadratic fields, we show that the dynamics of the center of mass are equivalent to the dynamics of a single agent. We leverage the recently developed framework of $\alpha$-integral quadratic constraints (IQCs) to obtain convergence rate estimates. We first present a derivation of \textit{hard} Zames-Falb (ZF) $\alpha$-IQCs involving general non-causal multipliers based on purely time-domain arguments and show that a parameterization of the ZF multiplier, suggested in the literature for the standard version of the ZF IQCs, can be adapted to the $\alpha$-IQCs setting to obtain quasi-convex programs for estimating convergence rates. Owing to the time-domain arguments, we can seamlessly extend these results to linear parameter varying (LPV) vehicles possibly opening the doors to non-linear vehicle models with quasi-LPV representations. We illustrate the theoretical results on a linear time invariant (LTI) model of a quadrotor, a non-minimum phase LTI plant and two LPV examples which show a clear benefit of using general non-causal dynamic multipliers to drastically reduce conservatism.


title: Existence of resonances for Schrodinger operators on hyperbolic space

abstract: We prove existence results and lower bounds for the resonances of Schr\"odinger operators associated to smooth, compactly support potentials on hyperbolic space. The results are derived from a combination of heat and wave trace expansions and asymptotics of the scattering phase.


title: Algorithmic Composition by Autonomous Systems with Multiple Time-Scales

abstract: Dynamic systems have found their use in sound synthesis as well as score synthesis. These levels can be integrated in monolithic autonomous systems in a novel approach to algorithmic composition that shares certain aesthetic motivations with some work with autonomous music systems, such as the search for emergence. We discuss various strategies for achieving variation on multiple time-scales by using slow-fast, hybrid dynamic systems, and statistical feedback. The ideas are illustrated with a case study.


title: Data-driven Leak Localization in Water Distribution Networks via Dictionary Learning and Graph-based Interpolation

abstract: In this paper, we propose a data-driven leak localization method for water distribution networks (WDNs) which combines two complementary approaches: graph-based interpolation and dictionary classification. The former estimates the complete WDN hydraulic state (i.e., hydraulic heads) from real measurements at certain nodes and the network graph. Then, these actual measurements, together with a subset of valuable estimated states, are used to feed and train the dictionary learning scheme. Thus, the meshing of these two methods is explored, showing that its performance is superior to either approach alone, even deriving different mechanisms to increase its resilience to classical problems (e.g., dimensionality, interpolation errors, etc.). The approach is validated using the L-TOWN benchmark proposed at BattLeDIM2020.


title: Enabling Level-4 Autonomous Driving on a Single $1k Off-the-Shelf Card

abstract: Autonomous driving is of great interest in both research and industry. The high cost has been one of the major roadblocks that slow down the development and adoption of autonomous driving in practice. This paper, for the first-time, shows that it is possible to run level-4 (i.e., fully autonomous driving) software on a single off-the-shelf card (Jetson AGX Xavier) for less than $1k, an order of magnitude less than the state-of-the-art systems, while meeting all the requirements of latency. The success comes from the resolution of some important issues shared by existing practices through a series of measures and innovations. The study overturns the common perceptions of the computing resources required by level-4 autonomous driving, points out a promising path for the industry to lower the cost, and suggests a number of research opportunities for rethinking the architecture, software design, and optimizations of autonomous driving.


title: The Age or Excess of the MGinf Queue Busy Cycle Mean Value

abstract: In this work, approximate and exact results concerning a performance measure of the MGinf system, the age or the excess of the busy cycle, are presented. It will be seen that it is also a measure of the busy period performance. Service distributions for which it is given for a simple expression and others for which this does not happen are considered. For this last case, bounds are deduced. A special emphasis is given to the exponential distribution and to those related with it, useful in reliability theory.


title: Coupled and Uncoupled Dynamic Mode Decomposition in Multi-Compartmental Systems with Applications to Epidemiological and Additive Manufacturing Problems

abstract: Dynamic Mode Decomposition (DMD) is an unsupervised machine learning method that has attracted considerable attention in recent years owing to its equation-free structure, ability to easily identify coherent spatio-temporal structures in data, and effectiveness in providing reasonably accurate predictions for certain problems. Despite these successes, the application of DMD to certain problems featuring highly nonlinear transient dynamics remains challenging. In such cases, DMD may not only fail to provide acceptable predictions but may indeed fail to recreate the data in which it was trained, restricting its application to diagnostic purposes. For many problems in the biological and physical sciences, the structure of the system obeys a compartmental framework, in which the transfer of mass within the system moves within states. In these cases, the behavior of the system may not be accurately recreated by applying DMD to a single quantity within the system, as proper knowledge of the system dynamics, even for a single compartment, requires that the behavior of other compartments is taken into account in the DMD process. In this work, we demonstrate, theoretically and numerically, that, when performing DMD on a fully coupled PDE system with compartmental structure, one may recover useful predictive behavior, even when DMD performs poorly when acting compartment-wise. We also establish that important physical quantities, as mass conservation, are maintained in the coupled-DMD extrapolation. The mathematical and numerical analysis suggests that DMD may be a powerful tool when applied to this common class of problems. In particular, we show interesting numerical applications to a continuous delayed-SIRD model for Covid-19, and to a problem from additive manufacturing considering a nonlinear temperature field and the resulting change of material phase from powder, liquid, and solid states.


title: ALL Dolphins Are Intelligent and SOME Are Friendly: Probing BERT for Nouns' Semantic Properties and their Prototypicality

abstract: Large scale language models encode rich commonsense knowledge acquired through exposure to massive data during pre-training, but their understanding of entities and their semantic properties is unclear. We probe BERT (Devlin et al., 2019) for the properties of English nouns as expressed by adjectives that do not restrict the reference scope of the noun they modify (as in "red car"), but instead emphasise some inherent aspect ("red strawberry"). We base our study on psycholinguistics datasets that capture the association strength between nouns and their semantic features. We probe BERT using cloze tasks and in a classification setting, and show that the model has marginal knowledge of these features and their prevalence as expressed in these datasets. We discuss factors that make evaluation challenging and impede drawing general conclusions about the models' knowledge of noun properties. Finally, we show that when tested in a fine-tuning setting addressing entailment, BERT successfully leverages the information needed for reasoning about the meaning of adjective-noun constructions outperforming previous methods.


title: A note on $\mathbb{Z}$-gradings on the Grassmann algebra and Elementary Number Theory

abstract: Let $E$ be the Grassmann algebra of an infinite dimensional vector space $L$ over a field of characteristic zero. In this paper, we study the $\mathbb{Z}$-gradings on $E$ having the form $E=E_{(r_{1},r_{2}, r_{3})}^{(v_{1},v_{2}, v_{3})}$, in which each element of a basis of $L$ has $\mathbb{Z}$-degree $r_{1}$, $r_{2}$, or $r_{3}$. We provide a criterion for the support of this structure to coincide with a subgroup of the group $\mathbb{Z}$, and we describe the graded identities for the corresponding gradings. We strongly use Elementary Number Theory as a tool, providing an interesting connection between this classical part of Mathematics, and PI Theory. Our results are generalizations of the approach presented in [11].


title: A Malmquist-like bias in the inferred areas of diamond caustics and consequences for inferred time delays of gravitationally lensed quasars

abstract: Quasars are quadruply lensed only when they lie within the diamond caustic of a lensing galaxy. This precondition produces a Malmquist-like selection effect in observed populations of quadruply lensed quasars, overestimating the true caustic area. The bias toward high values of the inferred logarithmic area, $\ln A_{inf}$, is proportional to the square of the error in that area, $\sigma^2_{\ln{A}}$. In effect, Malmquist's correction compensates post-hoc for a failure to incorporate a prior into parameter optimization. Inferred time delays are proportional to the square root of the inferred caustic area of the lensing galaxy. Model time delays are biased long, leading to overestimates of the Hubble constant. Crude estimates of $\sigma_{\ln A}$ for a sample of 13 quadruple systems give a median value of 0.16. We identify a second effect, "inferred magnification bias,'' resulting from the combination of selection by apparent magnitude and errors in model magnification. It is strongly anti-correlated with caustic area bias, and almost always leads to underestimates of the Hubble constant. Malmquist's scheme can be adapted to priors on multiple parameters, but for quad lenses, the negative covariances between caustic area and absolute magnitude are poorly known. Inferred magnification bias may even cancel out caustic area bias, depending upon (among other things) the slope of the number magnitude relation for the sample. Proper correction for these combined effects can, in principle, be built into Bayesian modeling schemes as priors, eliminating the need for Malmquist-style approximation, but is likely to be challenging in practice.


title: Spectra for Toeplitz Operators Associated with a Constrained Subalgebra

abstract: A two-point algebra is a set of bounded analytic functions on the unit disk that agree at two distinct points $a,b \in \mathbb{D}$. This algebra serves as a multiplier algebra for the family of Hardy Hilbert spaces $H^2_t := \{ f\in H^2 : f(a)=tf(b)\}$, where $t\in \mathbb{C}\cup\{\infty\}$. We show that various spectra of certain Toeplitz operators acting on these spaces are connected.


title: Adaptive Finite-Difference Interval Estimation for Noisy Derivative-Free Optimization

abstract: A common approach for minimizing a smooth nonlinear function is to employ finite-difference approximations to the gradient. While this can be easily performed when no error is present within the function evaluations, when the function is noisy, the optimal choice requires information about the noise level and higher-order derivatives of the function, which is often unavailable. Given the noise level of the function, we propose a bisection search for finding a finite-difference interval for any finite-difference scheme that balances the truncation error, which arises from the error in the Taylor series approximation, and the measurement error, which results from noise in the function evaluation. Our procedure produces reliable estimates of the finite-difference interval at low cost without explicitly approximating higher-order derivatives. We show its numerical reliability and accuracy on a set of test problems. When combined with L-BFGS, we obtain a robust method for minimizing noisy black-box functions, as illustrated on a subset of unconstrained CUTEst problems with synthetically added noise.


title: Meta Learning Low Rank Covariance Factors for Energy-Based Deterministic Uncertainty

abstract: Numerous recent works utilize bi-Lipschitz regularization of neural network layers to preserve relative distances between data instances in the feature spaces of each layer. This distance sensitivity with respect to the data aids in tasks such as uncertainty calibration and out-of-distribution (OOD) detection. In previous works, features extracted with a distance sensitive model are used to construct feature covariance matrices which are used in deterministic uncertainty estimation or OOD detection. However, in cases where there is a distribution over tasks, these methods result in covariances which are sub-optimal, as they may not leverage all of the meta information which can be shared among tasks. With the use of an attentive set encoder, we propose to meta learn either diagonal or diagonal plus low-rank factors to efficiently construct task specific covariance matrices. Additionally, we propose an inference procedure which utilizes scaled energy to achieve a final predictive distribution which is well calibrated under a distributional dataset shift.


title: A Survey of Open Source User Activity Traces with Applications to User Mobility Characterization and Modeling

abstract: The current state-of-the-art in user mobility research has extensively relied on open-source mobility traces captured from pedestrian and vehicular activity through a variety of communication technologies as users engage in a wide-range of applications, including connected healthcare, localization, social media, e-commerce, etc. Most of these traces are feature-rich and diverse, not only in the information they provide, but also in how they can be used and leveraged. This diversity poses two main challenges for researchers and practitioners who wish to make use of available mobility datasets. First, it is quite difficult to get a bird's eye view of the available traces without spending considerable time looking them up. Second, once they have found the traces, they still need to figure out whether the traces are adequate to their needs. The purpose of this survey is three-fold. It proposes a taxonomy to classify open-source mobility traces including their mobility mode, data source and collection technology. It then uses the proposed taxonomy to classify existing open-source mobility traces and finally, highlights three case studies using popular publicly available datasets to showcase how our taxonomy can tease out feature sets in traces to help determine their applicability to specific use-cases.


title: Real-time Drift Detection on Time-series Data

abstract: Practical machine learning applications involving time series data, such as firewall log analysis to proactively detect anomalous behavior, are concerned with real time analysis of streaming data. Consequently, we need to update the ML models as the statistical characteristics of such data may shift frequently with time. One alternative explored in the literature is to retrain models with updated data whenever the models accuracy is observed to degrade. However, these methods rely on near real time availability of ground truth, which is rarely fulfilled. Further, in applications with seasonal data, temporal concept drift is confounded by seasonal variation. In this work, we propose an approach called Unsupervised Temporal Drift Detector or UTDD to flexibly account for seasonal variation, efficiently detect temporal concept drift in time series data in the absence of ground truth, and subsequently adapt our ML models to concept drift for better generalization.


title: AutoNLU: Detecting, root-causing, and fixing NLU model errors

abstract: Improving the quality of Natural Language Understanding (NLU) models, and more specifically, task-oriented semantic parsing models, in production is a cumbersome task. In this work, we present a system called AutoNLU, which we designed to scale the NLU quality improvement process. It adds automation to three key steps: detection, attribution, and correction of model errors, i.e., bugs. We detected four times more failed tasks than with random sampling, finding that even a simple active learning sampling method on an uncalibrated model is surprisingly effective for this purpose. The AutoNLU tool empowered linguists to fix ten times more semantic parsing bugs than with prior manual processes, auto-correcting 65% of all identified bugs.


title: Evaluation of computer networking methods for interaction with remote robotic systems

abstract: Use of robotic infrastructures can significantly increase with remote access. This would open up the possibility to use costly equipment without the need to buy them, or to simply access those assets remotely when actual travel is not possible or recommended - for example in pandemic times. In this paper we present an analysis of several networking techniques which allow remote robotics operations, alongside with experimental results with distance ranging from hundreds of meters up to thousands of kilometers.


title: Fully-simulated Integration of Scamp5d Vision System and Robot Simulator

abstract: This paper proposed a fully-simulated environment by integrating an on-sensor visual computing device, SCAMP, and CoppeliaSim robot simulator via interface and remote API. Within this platform, a mobile robot obstacle avoidance and target navigation with pre-set barriers is exploited with on-sensor visual computing, where images are captured in a robot simulator and processed by an on-sensor processing server after being transferred. We made our developed platform and associated algorithms for mobile robot navigation available online.


title: Quantum randomness generation via orbital angular momentum modes crosstalk in a ring-core fiber

abstract: Genuine random numbers can be produced beyond a shadow of doubt through the intrinsic randomness provided by quantum mechanics theory. While many degrees of freedom have been investigated for randomness generation, not adequate attention has been paid to the orbital angular momentum of light. In this work, we present a quantum random number generator based on the intrinsic randomness inherited from the superposition of orbital angular momentum modes caused by the crosstalk inside a ring-core fiber. We studied two possible cases: a first one, device-dependent, where the system is trusted, and a second one, semi-device-independent, where the adversary can control the measurements. We experimentally realized the former, extracted randomness, and, after privacy amplification, we achieved a generation rate higher than 10 Mbit/s. In addition, we presented a possible realization of the semi-device-independent protocol, using a newly introduced integrated silicon photonic chip. Our work can be considered as a starting point for novel investigations of quantum random number generators based on the orbital angular momentum of light.


title: HETFORMER: Heterogeneous Transformer with Sparse Attention for Long-Text Extractive Summarization

abstract: To capture the semantic graph structure from raw text, most existing summarization approaches are built on GNNs with a pre-trained model. However, these methods suffer from cumbersome procedures and inefficient computations for long-text documents. To mitigate these issues, this paper proposes HETFORMER, a Transformer-based pre-trained model with multi-granularity sparse attentions for long-text extractive summarization. Specifically, we model different types of semantic nodes in raw text as a potential heterogeneous graph and directly learn heterogeneous relationships (edges) among nodes by Transformer. Extensive experiments on both single- and multi-document summarization tasks show that HETFORMER achieves state-of-the-art performance in Rouge F1 while using less memory and fewer parameters.


title: Amortized Tree Generation for Bottom-up Synthesis Planning and Synthesizable Molecular Design

abstract: Molecular design and synthesis planning are two critical steps in the process of molecular discovery that we propose to formulate as a single shared task of conditional synthetic pathway generation. We report an amortized approach to generate synthetic pathways as a Markov decision process conditioned on a target molecular embedding. This approach allows us to conduct synthesis planning in a bottom-up manner and design synthesizable molecules by decoding from optimized conditional codes, demonstrating the potential to solve both problems of design and synthesis simultaneously. The approach leverages neural networks to probabilistically model the synthetic trees, one reaction step at a time, according to reactivity rules encoded in a discrete action space of reaction templates. We train these networks on hundreds of thousands of artificial pathways generated from a pool of purchasable compounds and a list of expert-curated templates. We validate our method with (a) the recovery of molecules using conditional generation, (b) the identification of synthesizable structural analogs, and (c) the optimization of molecular structures given oracle functions relevant to drug discovery.


title: Learning ground states of quantum Hamiltonians with graph networks

abstract: Solving for the lowest energy eigenstate of the many-body Schrodinger equation is a cornerstone problem that hinders understanding of a variety of quantum phenomena. The difficulty arises from the exponential nature of the Hilbert space which casts the governing equations as an eigenvalue problem of exponentially large, structured matrices. Variational methods approach this problem by searching for the best approximation within a lower-dimensional variational manifold. In this work we use graph neural networks to define a structured variational manifold and optimize its parameters to find high quality approximations of the lowest energy solutions on a diverse set of Heisenberg Hamiltonians. Using graph networks we learn distributed representations that by construction respect underlying physical symmetries of the problem and generalize to problems of larger size. Our approach achieves state-of-the-art results on a set of quantum many-body benchmark problems and works well on problems whose solutions are not positive-definite. The discussed techniques hold promise of being a useful tool for studying quantum many-body systems and providing insights into optimization and implicit modeling of exponentially-sized objects.


title: Regular projections and regular covers in o-minimal structures

abstract: In this paper we prove that for any definable subset $X\subset \mathbb{R}^{n}$ in a polynomially bounded o-minimal structure, with $dim(X)<n$, there is a finite set of regular projections (in the sense of Mostowski ). We give also a weak version of this theorem in any o-minimal structure, and we give a counter example in o-minimal structures that are not polynomially bounded. As an application we show that in any o-minimal structure there exist a regular cover in the sense of Parusi\'nski.


title: The Origin of the Born Rule from Spacetime Averaging

abstract: The Born rule postulates that the probability of measurement in quantum mechanics is related to the squared modulus of the wave function $\psi$. We rearrange the equation for energy eigenfunctions to define the energy as the real part of $\hat{E}\psi/\psi$. For an eigenstate, this definition gives a constant energy eigenvalue. For a general wave function, the energy fluctuates in space and time. We consider a particle in a one-dimensional square well potential in a superposition of two states and average the energy over space and time. We show that, for most cases, such an energy expectation value differs by only a few percent from that calculated using the Born rule. This difference is consistent with experimental tests of the expectation value and suggests that the Born rule may be an approximation of spacetime averaging.


title: Attention-guided Generative Models for Extractive Question Answering

abstract: We propose a novel method for applying Transformer models to extractive question answering (QA) tasks. Recently, pretrained generative sequence-to-sequence (seq2seq) models have achieved great success in question answering. Contributing to the success of these models are internal attention mechanisms such as cross-attention. We propose a simple strategy to obtain an extractive answer span from the generative model by leveraging the decoder cross-attention patterns. Viewing cross-attention as an architectural prior, we apply joint training to further improve QA performance. Empirical results show that on open-domain question answering datasets like NaturalQuestions and TriviaQA, our method approaches state-of-the-art performance on both generative and extractive inference, all while using much fewer parameters. Furthermore, this strategy allows us to perform hallucination-free inference while conferring significant improvements to the model's ability to rerank relevant passages.


title: Reward-Free Model-Based Reinforcement Learning with Linear Function Approximation

abstract: We study the model-based reward-free reinforcement learning with linear function approximation for episodic Markov decision processes (MDPs). In this setting, the agent works in two phases. In the exploration phase, the agent interacts with the environment and collects samples without the reward. In the planning phase, the agent is given a specific reward function and uses samples collected from the exploration phase to learn a good policy. We propose a new provably efficient algorithm, called UCRL-RFE under the Linear Mixture MDP assumption, where the transition probability kernel of the MDP can be parameterized by a linear function over certain feature mappings defined on the triplet of state, action, and next state. We show that to obtain an $\epsilon$-optimal policy for arbitrary reward function, UCRL-RFE needs to sample at most $\tilde{\mathcal{O}}(H^5d^2\epsilon^{-2})$ episodes during the exploration phase. Here, $H$ is the length of the episode, $d$ is the dimension of the feature mapping. We also propose a variant of UCRL-RFE using Bernstein-type bonus and show that it needs to sample at most $\tilde{\mathcal{O}}(H^4d(H + d)\epsilon^{-2})$ to achieve an $\epsilon$-optimal policy. By constructing a special class of linear Mixture MDPs, we also prove that for any reward-free algorithm, it needs to sample at least $\tilde \Omega(H^2d\epsilon^{-2})$ episodes to obtain an $\epsilon$-optimal policy. Our upper bound matches the lower bound in terms of the dependence on $\epsilon$ and the dependence on $d$ if $H \ge d$.


title: Robust Neural Regression via Uncertainty Learning

abstract: Deep neural networks tend to underestimate uncertainty and produce overly confident predictions. Recently proposed solutions, such as MC Dropout and SDENet, require complex training and/or auxiliary out-of-distribution data. We propose a simple solution by extending the time-tested iterative reweighted least square (IRLS) in generalised linear regression. We use two sub-networks to parametrise the prediction and uncertainty estimation, enabling easy handling of complex inputs and nonlinear response. The two sub-networks have shared representations and are trained via two complementary loss functions for the prediction and the uncertainty estimates, with interleaving steps as in a cooperative game. Compared with more complex models such as MC-Dropout or SDE-Net, our proposed network is simpler to implement and more robust (insensitive to varying aleatoric and epistemic uncertainty).


title: GridLearn: Multiagent Reinforcement Learning for Grid-Aware Building Energy Management

abstract: Increasing amounts of distributed generation in distribution networks can provide both challenges and opportunities for voltage regulation across the network. Intelligent control of smart inverters and other smart building energy management systems can be leveraged to alleviate these issues. GridLearn is a multiagent reinforcement learning platform that incorporates both building energy models and power flow models to achieve grid level goals, by controlling behind-the-meter resources. This study demonstrates how multi-agent reinforcement learning can preserve building owner privacy and comfort while pursuing grid-level objectives. Building upon the CityLearn framework which considers RL for building-level goals, this work expands the framework to a network setting where grid-level goals are additionally considered. As a case study, we consider voltage regulation on the IEEE-33 bus network using controllable building loads, energy storage, and smart inverters. The results show that the RL agents nominally reduce instances of undervoltages and reduce instances of overvoltages by 34%.


title: An Overview of Ontologies and Tool Support for COVID-19 Analytics

abstract: The outbreak of the SARS-CoV-2 pandemic of the new COVID-19 disease (COVID-19 for short) demands empowering existing medical, economic, and social emergency backend systems with data analytics capabilities. An impediment in taking advantages of data analytics in these systems is the lack of a unified framework or reference model. Ontologies are highlighted as a promising solution to bridge this gap by providing a formal representation of COVID-19 concepts such as symptoms, infections rate, contact tracing, and drug modelling. Ontology-based solutions enable the integration of diverse data sources that leads to a better understanding of pandemic data, management of smart lockdowns by identifying pandemic hotspots, and knowledge-driven inference, reasoning, and recommendations to tackle surrounding issues.


title: CovXR: Automated Detection of COVID-19 Pneumonia in Chest X-Rays through Machine Learning

abstract: Coronavirus disease 2019 (COVID-19) is the highly contagious illness caused by severe acute respiratory syndrome coronavirus 2 (SARS-CoV-2). The standard diagnostic testing procedure for COVID-19 is testing a nasopharyngeal swab for SARS-CoV-2 nucleic acid using a real-time polymerase chain reaction (PCR), which can take multiple days to provide a diagnosis. Another widespread form of testing is rapid antigen testing, which has a low sensitivity compared to PCR, but is favored for its quick diagnosis time of usually 15-30 minutes. Patients who test positive for COVID-19 demonstrate diffuse alveolar damage in 87% of cases. Machine learning has proven to have advantages in image classification problems with radiology. In this work, we introduce CovXR as a machine learning model designed to detect COVID-19 pneumonia in chest X-rays (CXR). CovXR is a convolutional neural network (CNN) trained on over 4,300 chest X-rays. The performance of the model is measured through accuracy, F1 score, sensitivity, and specificity. The model achieves an accuracy of 95.5% and an F1 score of 0.954. The sensitivity is 93.5% and specificity is 97.5%. With accuracy above 95% and F1 score above 0.95, CovXR is highly accurate in predicting COVID-19 pneumonia on CXRs. The model achieves better accuracy than prior work and uses a unique approach to identify COVID-19 pneumonia. CovXR is highly accurate in identifying COVID-19 on CXRs of patients with a PCR confirmed positive diagnosis and provides much faster results than PCR tests.


title: Dynamic Inference with Neural Interpreters

abstract: Modern neural network architectures can leverage large amounts of data to generalize well within the training distribution. However, they are less capable of systematic generalization to data drawn from unseen but related distributions, a feat that is hypothesized to require compositional reasoning and reuse of knowledge. In this work, we present Neural Interpreters, an architecture that factorizes inference in a self-attention network as a system of modules, which we call \emph{functions}. Inputs to the model are routed through a sequence of functions in a way that is end-to-end learned. The proposed architecture can flexibly compose computation along width and depth, and lends itself well to capacity extension after training. To demonstrate the versatility of Neural Interpreters, we evaluate it in two distinct settings: image classification and visual abstract reasoning on Raven Progressive Matrices. In the former, we show that Neural Interpreters perform on par with the vision transformer using fewer parameters, while being transferrable to a new task in a sample efficient manner. In the latter, we find that Neural Interpreters are competitive with respect to the state-of-the-art in terms of systematic generalization


title: CyTran: A Cycle-Consistent Transformer with Multi-Level Consistency for Non-Contrast to Contrast CT Translation

abstract: We propose a novel approach to translate unpaired contrast computed tomography (CT) scans to non-contrast CT scans and the other way around. Solving this task has two important applications: (i) to automatically generate contrast CT scans for patients for whom injecting contrast substance is not an option, and (ii) to enhance the alignment between contrast and non-contrast CT by reducing the differences induced by the contrast substance before registration. Our approach is based on cycle-consistent generative adversarial convolutional transformers, for short, CyTran. Our neural model can be trained on unpaired images, due to the integration of a multi-level cycle-consistency loss. Aside from the standard cycle-consistency loss applied at the image level, we propose to apply additional cycle-consistency losses between intermediate feature representations, which enforces the model to be cycle-consistent at multiple representations levels, leading to superior results. To deal with high-resolution images, we design a hybrid architecture based on convolutional and multi-head attention layers. In addition, we introduce a novel data set, Coltea-Lung-CT-100W, containing 100 3D triphasic lung CT scans (with a total of 37,290 images) collected from 100 female patients (there is one examination per patient). Each scan contains three phases (non-contrast, early portal venous, and late arterial), allowing us to perform experiments to compare our novel approach with state-of-the-art methods for image style transfer. Our empirical results show that CyTran outperforms all competing methods. Moreover, we show that CyTran can be employed as a preliminary step to improve a state-of-the-art medical image alignment method. We release our novel model and data set as open source at https://github.com/ristea/cycle-transformer.


title: Distributed Gaussian Process Mapping for Robot Teams with Time-varying Communication

abstract: Multi-agent mapping is a fundamentally important capability for autonomous robot task coordination and execution in complex environments. While successful algorithms have been proposed for mapping using individual platforms, cooperative online mapping for teams of robots remains largely a challenge. We focus on probabilistic variants of mapping due to its potential utility in downstream tasks such as uncertainty-aware path-planning. A critical question to enabling this capability is how to process and aggregate incrementally observed local information among individual platforms, especially when their ability to communicate is intermittent. We put forth an Incremental Sparse Gaussian Process (GP) methodology for multi-robot mapping, where the regression is over a truncated signed-distance field (TSDF). Doing so permits each robot in the network to track a local estimate of a pseudo-point approximation GP posterior and perform weighted averaging of its parameters with those of its (possibly time-varying) set of neighbors. We establish conditions on the pseudo-point representation, as well as communication protocol, such that robots' local GPs converge to the one with globally aggregated information. We further provide experiments that corroborate our theoretical findings for probabilistic multi-robot mapping.


title: A Feiner Look at the Intermediate Degrees

abstract: We say that a set $S$ is $\Delta^0_{(n)}(X)$ if membership of $n$ in $S$ is a $\Delta^0_{n}(X)$ question, uniformly in $n$. A set $X$ is low for $\Delta$-Feiner if every set $S$ that is $\Delta^0_{(n)}(X)$ is also $\Delta^0_{(n)}(\emptyset)$. It is easy to see that every low$_n$ set is low for $\Delta$-Feiner, but we show that the converse is not true by constructing an intermediate c.e. set that is low for $\Delta$-Feiner. We also study variations on this notion, such as the sets that are $\Delta^0_{(bn+a)}(X)$, $\Sigma^0_{(bn+a)}(X)$, or $\Pi^0_{(bn+a)}(X)$, and the sets that are low, intermediate, and high for these classes. In doing so, we obtain a result on the computability of Boolean algebras, namely that there is a Boolean algebra of intermediate c.e. degree with no computable copy.


title: An Analytical Study of a Two-Sided Mobility Game

abstract: In this paper, we consider a mobility system of travelers and providers, and propose a "mobility game" to study when a traveler is matched to a provider. Each traveler seeks to travel using the services of only one provider, who manages one specific mode of transportation (e.g., car, bus, train, bike). The services of each provider are capacitated and can serve up to a fixed number of travelers at any instant of time. Thus, our problem falls under the category of many-to-one assignment problems, where the goal is to find the conditions that guarantee the stability of assignments. We formulate a linear program of maximizing the social welfare of travelers and providers and show how it is equivalent to the original problem and relate its solutions to stable assignments. We also investigate our results under informational asymmetry and provide a "mechanism" that elicits the information of travelers and providers. Finally, we investigate and validate the advantages of our method by providing a numerical simulation example.


title: The Sierpinski Carpet as a Final Coalgebra

abstract: We advance the program of connections between final coalgebras as sources of circularity in mathematics and fractal sets of real numbers. In particular, we are interested in the Sierpinski carpet, taking it as a fractal subset of the unit square. We construct a category of square sets and an endofunctor on it which corresponds to the operation of gluing copies of a square set along segments. We show that the initial algebra and final coalgebra exist for our functor, and that the final coalgebra is bi-Lipschitz equivalent to the Sierpinski carpet. Along the way, we make connections to topics such as the iterative construction of initial algebras as colimits, corecursive algebras, and the classic treatment of fractal sets due to Hutchinson.


title: Programmable multistability for 3D printed reinforced multifunctional composites with reversible shape change

abstract: 4D printing empowers 3D printed structures made of hydrogels, liquid crystals or shape memory polymers, with reversible morphing capabilities in response to an external stimulus. To apply reversible shape-change to stiff lightweight materials such as microfiber reinforced polymers, we developed a composite ink that can be printed using direct-ink-writing (DIW), and that exhibits multistability around its glass transition temperature. After curing at room temperature, the flat print thermally morphs into a predefined shape upon heating at an actuation temperature and cooling down. The sample can then reversibly snap between multiple stable shapes when heated above its glass transition temperature thanks to prestress-induced multistability. The key that allows thermal morphing and prestress multistability is the microstructuring of the 3D printed composites by shear-induced alignment of reinforcing microfibers. This alignment leads to local anisotropy in thermomechanical properties and the build-up of prestresses. Furthermore, the ink composition can be tuned to generate shape-dependant reversible functional properties, such as electrical conductivity. Based on finite element modelling and experimental results, the method proposed here can be used for variety of compositions and designs, for applications where stiffness, reconfigurability and shape-dependent functionalities can be exploited.


title: Variational setting for cracked beams and shallow arches

abstract: We develop a rigorous mathematical framework for the weak formulation of cracked beams and shallow arches problems. First, we discuss the crack modeling by means of massless rotational springs. Then we introduce Hilbert spaces, which are sufficiently wide to accommodate such representations. Our main result is the introduction of a specially designed linear operator that "absorbs" the boundary conditions at the cracks. We also provide mathematical justification and derivation of the Modified Shifrin's method for an efficient computation of the eigenvalues and the eigenfunctions for cracked beams.


title: Efficient Linearizability Checking for Actor-based Systems

abstract: Recent demand for distributed software had led to a surge in popularity in actor-based frameworks. However, even with the stylized message passing model of actors, writing correct distributed software is still difficult. We present our work on linearizability checking in DS2, an integrated framework for specifying, synthesizing, and testing distributed actor systems. The key insight of our approach is that often subcomponents of distributed actor systems represent common algorithms or data structures (e.g.\ a distributed hash table or tree) that can be validated against a simple sequential model of the system. This makes it easy for developers to validate their concurrent actor systems without complex specifications. DS2 automatically explores the concurrent schedules that system could arrive at, and it compares observed output of the system to ensure it is equivalent to what the sequential implementation could have produced. We describe DS2's linearizability checking and test it on several concurrent replication algorithms from the literature. We explore in detail how different algorithms for enumerating the model schedule space fare in finding bugs in actor systems, and we present our own refinements on algorithms for exploring actor system schedules that we show are effective in finding bugs.


title: The $\Omega_{cc}$ resonances with negative parity in the chiral constituent quark model

abstract: Spectrum of the low-lying $\Omega_{cc}$ resonances with negative parity, which are assumed to be dominated by $sccq\bar{q}$ pentaquark components, is investigated using the chiral constituent quark model. Energies of the $\Omega_{cc}$ resonances are obtained by considering the hyperfine interaction between quarks by exchanging Goldstone boson. Possible $sccq\bar{q}$ configurations with spin-parity $1/2^{-}$, $3/2^{-}$ and $5/2^{-}$ are taken into account. Numerical results show that the lowest $\Omega_{cc}$ resonances with negative parity may lie at $4050 \pm 100$ MeV. In addition, the transitions of the $\Omega_{cc}$ resonance to a pseudoscalar meson and a ground baryon state are also investigated within the chiral Lagrangian approach. We expect that these $\Omega_{cc}$ resonances could be observed in the $\bar{D}\Xi_{c}$ channel by future experiments.


title: Dissipation in Parabolic SPDEs II: Oscillation and decay of the solution

abstract: We consider a stochastic heat equation of the type, $\partial_t u = \partial^2_x u + \sigma(u)\dot{W}$ on $(0\,,\infty)\times[-1\,,1]$ with periodic boundary conditions and on-degenerate positive initial data, where $\sigma:\mathbb{R} \to\mathbb{R}$ is a non-random Lipschitz continuous function and $\dot{W}$ denotes space-time white noise. If additionally $\sigma(0)=0$ then the solution is known to be strictly positive; see Mueller '91. In that case, we prove that the oscillation of the logarithm of the solution decays sublinearly as time tends to infinity. Among other things, it follows that, with probability one, all limit points of $t^{-1}\, \sup_{x\in[-1,1]}\, \log u(t\,,x)$ and $t^{-1}\, \inf_{x\in[-1,1]}\, \log u(t\,,x)$ must coincide. As a consequence of this fact, we prove that, when $\sigma$ is linear, there is a.s. only one such limit point and hence the entire path decays almost surely at an exponential rate.


title: Attributed Graph Modeling with Vertex Replacement Grammars

abstract: Recent work at the intersection of formal language theory and graph theory has explored graph grammars for graph modeling. However, existing models and formalisms can only operate on homogeneous (i.e., untyped or unattributed) graphs. We relax this restriction and introduce the Attributed Vertex Replacement Grammar (AVRG), which can be efficiently extracted from heterogeneous (i.e., typed, colored, or attributed) graphs. Unlike current state-of-the-art methods, which train enormous models over complicated deep neural architectures, the AVRG model is unsupervised and interpretable. It is based on context-free string grammars and works by encoding graph rewriting rules into a graph grammar containing graphlets and instructions on how they fit together. We show that the AVRG can encode succinct models of input graphs yet faithfully preserve their structure and assortativity properties. Experiments on large real-world datasets show that graphs generated from the AVRG model exhibit substructures and attribute configurations that match those found in the input networks.


title: A Teacher-Student Framework with Fourier Augmentation for COVID-19 Infection Segmentation in CT Images

abstract: Automatic segmentation of infected regions in computed tomography (CT) images is necessary for the initial diagnosis of COVID-19. Deep-learning-based methods have the potential to automate this task but require a large amount of data with pixel-level annotations. Training a deep network with annotated lung cancer CT images, which are easier to obtain, can alleviate this problem to some extent. However, this approach may suffer from a reduction in performance when applied to unseen COVID-19 images during the testing phase due to the domain shift. In this paper, we propose a novel unsupervised method for COVID-19 infection segmentation that aims to learn the domain-invariant features from lung cancer and COVID-19 images to improve the generalization ability of the segmentation network for use with COVID-19 CT images. To overcome the intensity shift, our method first transforms annotated lung cancer data into the style of unlabeled COVID-19 data using an effective augmentation approach via a Fourier transform. Furthermore, to reduce the distribution shift, we design a teacher-student network to learn rotation-invariant features for segmentation. Experiments demonstrate that even without getting access to the annotations of COVID-19 CT during training, the proposed network can achieve a state-of-the-art segmentation performance on COVID-19 images.


title: Offset-Symmetric Gaussians for Differential Privacy

abstract: The Gaussian distribution is widely used in mechanism design for differential privacy (DP). Thanks to its sub-Gaussian tail, it significantly reduces the chance of outliers when responding to queries. However, it can only provide approximate $(\epsilon, \delta(\epsilon))$-DP. In practice, $\delta(\epsilon)$ must be much smaller than the size of the dataset, which may limit the use of the Gaussian mechanism for large datasets with strong privacy requirements. In this paper, we introduce and analyze a new distribution for use in DP that is based on the Gaussian distribution, but has improved privacy performance. The so-called offset-symmetric Gaussian tail (OSGT) distribution is obtained through using the normalized tails of two symmetric Gaussians around zero. Consequently, it can still have sub-Gaussian tail and lend itself to analytical derivations. We analytically derive the variance of the OSGT random variable and the $\delta(\epsilon)$ of the OSGT mechanism. We then numerically show that at the same variance, the OSGT mechanism can offer a lower $\delta(\epsilon)$ than the Gaussian mechanism. We extend the OSGT mechanism to $k$-dimensional queries and derive an easy-to-compute analytical upper bound for its zero-concentrated differential privacy (zCDP) performance. We analytically prove that at the same variance, the same global query sensitivity and for sufficiently large concentration orders $\alpha$, the OSGT mechanism performs better than the Gaussian mechanism in terms of zCDP.


title: 3LSAA: A Secure And Privacy-preserving Zero-knowledge-based Data-sharing Approach Under An Untrusted Environment

abstract: As data collection and analysis become critical functions for many cloud applications, proper data sharing with approved parties is required. However, the traditional data sharing scheme through centralized data escrow servers may sacrifice owners' privacy and is weak in security. Mainly, the servers physically own all data while the original data owners have only virtual ownership and lose actual access control. Therefore, we propose a 3-layer SSE-ABE-AES (3LSAA) cryptography-based privacy-protected data-sharing protocol based on the assumption that servers are honest-but-curious. The 3LSAA protocol realizes automatic access control management and convenient file search even if the server is not trustable. Besides achieving data self-sovereignty, our approach also improves system usability, eliminates the defects in the traditional SSE and ABE approaches, and provides a local AES key recovery method for user's availability.


title: Coronal Magnetic Field Measurements along a Partially Erupting Filament in a Solar Flare

abstract: Magnetic flux ropes are the centerpiece of solar eruptions. Direct measurements for the magnetic field of flux ropes are crucial for understanding the triggering and energy release processes, yet they remain heretofore elusive. Here we report microwave imaging spectroscopy observations of an M1.4-class solar flare that occurred on 2017 September 6, using data obtained by the Expanded Owens Valley Solar Array. This flare event is associated with a partial eruption of a twisted filament observed in H{\alpha} by the Goode Solar Telescope at the Big Bear Solar Observatory. The extreme ultraviolet (EUV) and X-ray signatures of the event are generally consistent with the standard scenario of eruptive flares, with the presence of double flare ribbons connected by a bright flare arcade. Intriguingly, this partial eruption event features a microwave counterpart, whose spatial and temporal evolution closely follow the filament seen in H{\alpha} and EUV. The spectral properties of the microwave source are consistent with nonthermal gyrosynchrotron radiation. Using spatially resolved microwave spectral analysis, we derive the magnetic field strength along the filament spine, which ranges from 600-1400 Gauss from its apex to the legs. The results agree well with the non-linear force-free magnetic model extrapolated from the pre-flare photospheric magnetogram. We conclude that the microwave counterpart of the erupting filament is likely due to flare-accelerated electrons injected into the filament-hosting magnetic flux rope cavity following the newly reconnected magnetic field lines.


title: Honeycomb lattice in metal-rich chalcogenide Fe2Te

abstract: Two-dimensional honeycomb crystals have inspired intense research interest for their novel properties and great potential in electronics and optoelectronics. Here, through molecular beam epitaxy on SrTiO3(001), we report successful epitaxial growth of metal-rich chalcogenide Fe2Te, a honeycomb-structured film that has no direct bulk analogue, under Te-limited growth conditions. The structural morphology and electronic properties of Fe2Te are explored with scanning tunneling microscopy and angle resolved photoemission spectroscopy, which reveal electronic bands cross the Fermi level and nearly flat bands. Moreover, we find a weak interfacial interaction between Fe2Te and the underlying substrates, paving a newly developed alternative avenue for honeycomb-based electronic devices.


title: MMIU: Dataset for Visual Intent Understanding in Multimodal Assistants

abstract: In multimodal assistant, where vision is also one of the input modalities, the identification of user intent becomes a challenging task as visual input can influence the outcome. Current digital assistants take spoken input and try to determine the user intent from conversational or device context. So, a dataset, which includes visual input (i.e. images or videos for the corresponding questions targeted for multimodal assistant use cases, is not readily available. The research in visual question answering (VQA) and visual question generation (VQG) is a great step forward. However, they do not capture questions that a visually-abled person would ask multimodal assistants. Moreover, many times questions do not seek information from external knowledge. In this paper, we provide a new dataset, MMIU (MultiModal Intent Understanding), that contains questions and corresponding intents provided by human annotators while looking at images. We, then, use this dataset for intent classification task in multimodal digital assistant. We also experiment with various approaches for combining vision and language features including the use of multimodal transformer for classification of image-question pairs into 14 intents. We provide the benchmark results and discuss the role of visual and text features for the intent classification task on our dataset.


title: Oxygen adsorption induced superconductivity in ultrathin FeTe film on SrTiO3(001)

abstract: The phenomenon of oxygen incorporation induced superconductivity in iron telluride (Fe1+yTe, with antiferromagnetic (AFM) orders) is intriguing and quite different from the case of FeSe. Until now, the microscopic origin of the induced superconductivity and the role of oxygen are far from clear. Here, by combining in-situ scanning tunneling microscopy/spectroscopy (STM/STS) and x-ray photoemission spectroscopy (XPS) on oxygenated FeTe, we found physically adsorbed O2 molecules crystallized into c(2/3x2) structure as an oxygen overlayer at low temperature, which was vital for superconductivity. The O2 overlayer were not epitaxial on the FeTe lattice, which implied weak O2-FeTe interaction but strong molecular interactions. Energy shift observed in the STS and XPS measurements indicated hole doping effect from the O2 overlayer to the FeTe layer, leading to a superconducting gap of 4.5 meV opened across the Fermi level. Our direct microscopic probe clarified the role of oxygen on FeTe and emphasized the importance of charge transfer effect to induce superconductivity in iron-chalcogenide thin films.


title: Stabilizing Dynamical Systems via Policy Gradient Methods

abstract: Stabilizing an unknown control system is one of the most fundamental problems in control systems engineering. In this paper, we provide a simple, model-free algorithm for stabilizing fully observed dynamical systems. While model-free methods have become increasingly popular in practice due to their simplicity and flexibility, stabilization via direct policy search has received surprisingly little attention. Our algorithm proceeds by solving a series of discounted LQR problems, where the discount factor is gradually increased. We prove that this method efficiently recovers a stabilizing controller for linear systems, and for smooth, nonlinear systems within a neighborhood of their equilibria. Our approach overcomes a significant limitation of prior work, namely the need for a pre-given stabilizing control policy. We empirically evaluate the effectiveness of our approach on common control benchmarks.


title: Federated Natural Language Generation for Personalized Dialogue System

abstract: Neural conversational models have long suffered from the problem of inconsistency and lacking coherent personality. To address the issue, persona-based models capturing individual characteristics have been proposed, but they still face the dilemma of model adaption and data privacy. To break this dilemma, we propose a novel Federated Natural Language Generation (FedNLG) framework, which learns personalized representations from various dataset on distributed devices, and thus implements the personalized dialogue system efficiently and safely. FedNLG first pre-trains parameters of standard neural conversational model over a large dialogue corpus, and then fine-tune the model parameters and persona embeddings on specific datasets, in a federated manner. Thus, the model could simultaneously learn the persona embeddings in local clients and learn shared model parameters by federated aggregation, which achieves accuracyprivacy balance. By conducting extensive experiments, we demonstrate the effectiveness of our model by pre-training model over Cornell Movie-Dialogs Corpus and fine-tuning the model over two TV series dataset.


title: Where are the logs?

abstract: The commonly quoted error rates for QMC integration with an infinite low discrepancy sequence is $O(n^{-1}\log(n)^r)$ with $r=d$ for extensible sequences and $r=d-1$ otherwise. Such rates hold uniformly over all $d$ dimensional integrands of Hardy-Krause variation one when using $n$ evaluation points. Implicit in those bounds is that for any sequence of QMC points, the integrand can be chosen to depend on $n$. In this paper we show that rates with any $r<(d-1)/2$ can hold when $f$ is held fixed as $n\to\infty$. This is accomplished following a suggestion of Erich Novak to use some unpublished results of Trojan from the 1980s as given in the information based complexity monograph of Traub, Wasilkowski and Wo\'zniakowski. The proof is made by applying a technique of Roth with the theorem of Trojan. The proof is non constructive and we do not know of any integrand of bounded variation in the sense of Hardy and Krause for which the QMC error exceeds $(\log n)^{1+\epsilon}/n$ for infinitely many $n$ when using a digital sequence such as one of Sobol's. An empirical search when $d=2$ for integrands designed to exploit known weaknesses in certain point sets showed no evidence that $r>1$ is needed. An example with $d=3$ and $n$ up to $2^{100}$ might possibly require $r>1$.


title: Revisiting Latent-Space Interpolation via a Quantitative Evaluation Framework

abstract: Latent-space interpolation is commonly used to demonstrate the generalization ability of deep latent variable models. Various algorithms have been proposed to calculate the best trajectory between two encodings in the latent space. In this work, we show how data labeled with semantically continuous attributes can be utilized to conduct a quantitative evaluation of latent-space interpolation algorithms, for variational autoencoders. Our framework can be used to complement the standard qualitative comparison, and also enables evaluation for domains (such as graph) in which the visualization is difficult. Interestingly, our experiments reveal that the superiority of interpolation algorithms could be domain-dependent. While normalised interpolation works best for the image domain, spherical linear interpolation achieves the best performance in the graph domain. Next, we propose a simple-yet-effective method to restrict the latent space via a bottleneck structure in the encoder. We find that all interpolation algorithms evaluated in this work can benefit from this restriction. Finally, we conduct interpolation-aware training with the labeled attributes, and show that this explicit supervision can improve the interpolation performance.


title: GRB 101225A as Orphan Dipole Radiation of a Newborn Magnetar with Precession Rotation in an Off-Axis Gamma-Ray Burst

abstract: The unusual multiwavelength lightcurves of GRB 101225A are revisited by assuming that it is from an off-axis GRB powered by a newborn magnetar. We show that its optical afterglow lightcurve is fitted with the forward shock model by parameterizing its jet structure as a Gaussian function with a half opening angle of the jet core as $1.67^{\rm o}$. The derived initial Lorentz factor ($\Gamma_0$) is 120, and the viewing angle to the jet axis is $\theta_v=3.7^{\rm o}$. Tentative QPO signatures of $P=488$ seconds and $P=250\sim 300$ seconds are found with a confidence level of 90\% by analysing its X-ray flares observed in the time interval of $[4900,\ 7500]$ seconds. Its global gamma-ray/X-ray lightcurve and the QPO signatures are represented with the magnetar dipole radiation (DR) model by considering the magnetar precession motion, assuming that the magnetar spindown is dominated by the GW emission. The bulk Lorentz factor of the DR ejecta is limited to 8, being much lower than $\Gamma_0$. Comparing GRB 101225A with the extremely off-axis GRB 170817A, we suspect that the nature of the two-component jet in GRB 170817A is a combination of a co-axial GRB jet and a DR ejecta. GRB 101225A would be among the brightest ones of the CDF-S XT2 like X-ray transient population driven by newborn magnetars. Discussion on detectability of its gravitational wave emission is also presented.


title: On the Behaviour of Under-tuned Super-Twisting Sliding Mode Control Loops

abstract: This paper investigates the stability properties and performance of super-twisting sliding-mode control loops subject to periodic perturbations. Although there exist conditions on the control gains that guarantee finite-time stability of the closed-loop system, such conditions are often too restrictive from a practical standpoint, especially in relation to actuator limitations and induced chatter. Using regularisation and averaging theory, it is proven that under milder conditions for the control gains, the trajectories of the periodically perturbed closed-loop system converge to a stable limit cycle of the same period containing the origin. Additionally, guidelines for selecting the controller gains are provided based on bounds of the closed-loop system states. Finally, the theoretical findings are validated through simulations.


title: Axially-deformed solution of the Skyrme-Hartree-Fock-Bogoliubov equations using the transformed harmonic oscillator basis (IV) hfbtho (v4.0): A new version of the program

abstract: We describe the new version 4.0 of the code hfbtho that solves the nuclear Hartree-Fock-Bogoliubov problem by using the deformed harmonic oscillator basis in cylindrical coordinates. In the new version, we have implemented the restoration of rotational, particle number, and reflection symmetry. The restoration of rotational symmetry does not require using bases closed under rotation. Furthermore, the SeaLL1 functional was added and the calculation of the Coulomb potential was improved. Finally, the code has been refactored to facilitate maintenance and future developments.


title: A Well-Posed Multidimensional Rational Covariance and Generalized Cepstral Extension Problem

abstract: In the present paper we consider the problem of estimating the multidimensional power spectral density which describes a second-order stationary random field from a finite number of covariance and generalized cepstral coefficients. The latter can be framed as an optimization problem subject to multidimensional moment constraints, i.e., to search a spectral density maximizing an entropic index and matching the moments. In connection with systems and control, such a problem can also be posed as finding a multidimensional shaping filter (i.e., a linear time-invariant system) which can output a random field that has identical moments with the given data when fed with a white noise, a fundamental problem in system identification. In particular, we consider the case where the dimension of the random field is greater than two for which a satisfying theory is still missing. We propose a multidimensional moment problem which takes into account a generalized definition of the cepstral moments, together with a consistent definition of the entropy. We show that it is always possible to find a rational power spectral density matching exactly the covariances and approximately the generalized cepstral coefficients, from which a shaping filter can be constructed via spectral factorization. In plain words, our theory allows to construct a well-posed spectral estimator for any finite dimension.


title: High-Dimensional Varying Coefficient Models with Functional Random Effects

abstract: We consider a sparse high-dimensional varying coefficients model with random effects, a flexible linear model allowing covariates and coefficients to have a functional dependence with time. For each individual, we observe discretely sampled responses and covariates as a function of time as well as time invariant covariates. Under sampling times that are either fixed and common or random and independent amongst individuals, we propose a projection procedure for the empirical estimation of all varying coefficients. We extend this estimator to construct confidence bands for a fixed number of varying coefficients.


title: Dense Uncertainty Estimation

abstract: Deep neural networks can be roughly divided into deterministic neural networks and stochastic neural networks.The former is usually trained to achieve a mapping from input space to output space via maximum likelihood estimation for the weights, which leads to deterministic predictions during testing. In this way, a specific weights set is estimated while ignoring any uncertainty that may occur in the proper weight space. The latter introduces randomness into the framework, either by assuming a prior distribution over model parameters (i.e. Bayesian Neural Networks) or including latent variables (i.e. generative models) to explore the contribution of latent variables for model predictions, leading to stochastic predictions during testing. Different from the former that achieves point estimation, the latter aims to estimate the prediction distribution, making it possible to estimate uncertainty, representing model ignorance about its predictions. We claim that conventional deterministic neural network based dense prediction tasks are prone to overfitting, leading to over-confident predictions, which is undesirable for decision making. In this paper, we investigate stochastic neural networks and uncertainty estimation techniques to achieve both accurate deterministic prediction and reliable uncertainty estimation. Specifically, we work on two types of uncertainty estimations solutions, namely ensemble based methods and generative model based methods, and explain their pros and cons while using them in fully/semi/weakly-supervised framework. Due to the close connection between uncertainty estimation and model calibration, we also introduce how uncertainty estimation can be used for deep model calibration to achieve well-calibrated models, namely dense model calibration. Code and data are available at https://github.com/JingZhang617/UncertaintyEstimation.


title: All-neural beamformer for continuous speech separation

abstract: Continuous speech separation (CSS) aims to separate overlapping voices from a continuous influx of conversational audio containing an unknown number of utterances spoken by an unknown number of speakers. A common application scenario is transcribing a meeting conversation recorded by a microphone array. Prior studies explored various deep learning models for time-frequency mask estimation, followed by a minimum variance distortionless response (MVDR) filter to improve the automatic speech recognition (ASR) accuracy. The performance of these methods is fundamentally upper-bounded by MVDR's spatial selectivity. Recently, the all deep learning MVDR (ADL-MVDR) model was proposed for neural beamforming and demonstrated superior performance in a target speech extraction task using pre-segmented input. In this paper, we further adapt ADL-MVDR to the CSS task with several enhancements to enable end-to-end neural beamforming. The proposed system achieves significant word error rate reduction over a baseline spectral masking system on the LibriCSS dataset. Moreover, the proposed neural beamformer is shown to be comparable to a state-of-the-art MVDR-based system in real meeting transcription tasks, including AMI, while showing potentials to further simplify the runtime implementation and reduce the system latency with frame-wise processing.


title: The geometry of three sections on certain rational elliptic surfaces and Mumford representations

abstract: In this article, we study the geometry of plane curves obtained by three sections and another section given as their sum on certain rational elliptic surfaces. We make use of Mumford representations of semi-reduced divisors in order to study the geometry of sections. As a result, we are able to give new proofs for some classical results on singular plane quartics and their bitangent lines.


title: Random batch particle methods for the homogeneous Landau equation

abstract: We consider in this paper random batch particle methods for efficiently solving the homogeneous Landau equation in plasma physics. The methods are stochastic variations of the particle methods proposed by Carrillo et al. [J. Comput. Phys.: X 7: 100066, 2020] using the random batch strategy. The collisions only take place inside the small but randomly selected batches so that the computational cost is reduced to $O(N)$ per time step. Meanwhile, our methods can preserve the conservation of mass, momentum, energy and the decay of entropy. Several numerical examples are performed to validate our methods.


title: Stellar Rotation of T Tauri stars in the Orion Star-Forming Complex

abstract: We present a large-scale study of stellar rotation for T Tauri stars in the Orion Star-Forming Complex. We use the projected rotational velocity ($v\sin(i)$) estimations reported by the APOGEE-2 collaboration as well as individual masses and ages derived from the position of the stars in the HR diagram, considering Gaia-EDR3 parallaxes and photometry plus diverse evolutionary models. We find an empirical trend for $v\sin(i)$ decreasing with age for low-mass stars ($0.4 M_{\odot} < M_{\ast} < 1.2 M_{\odot}$). Our results support the existence of a mechanism linking $v\sin(i)$ to the presence of accreting protoplanetary disks, responsible for regulating stellar rotation in timescales of about 6 Myr, which is the timescale in which most of the T Tauri stars lose their inner disk. Our results provide important constraints to models of rotation in the early phases of evolution of young stars and their disks.


title: A Nuclear Equation of State Inferred from Stellar r-process Abundances

abstract: Binary neutron star mergers (NSMs) have been confirmed as one source of the heaviest observable elements made by the rapid neutron-capture (r-) process. However, modeling NSM outflows -- from the total ejecta masses to their elemental yields -- depends on the unknown nuclear equation of state (EOS) that governs neutron-star structure. In this work, we derive a phenomenological EOS by assuming that NSMs are the dominant sources of the heavy element material in metal-poor stars with r-process abundance patterns. We start with a population synthesis model to obtain a population of merging neutron star binaries and calculate their EOS-dependent elemental yields. Under the assumption that these mergers were responsible for the majority of r-process elements in the metal-poor stars, we find parameters representing the EOS for which the theoretical NSM yields reproduce the derived abundances from observations of metal-poor stars. For our proof-of-concept assumptions, we find an EOS that is slightly softer than, but still in agreement with, current constraints, e.g., by the Neutron Star Interior Composition Explorer, with $R_{1.4}=12.25\pm 0.03$~km and $M_{\textrm TOV}$ of $2.17\pm 0.03$~M$_\odot$(statistical uncertainties, neglecting modeling systematics).


title: Valley polarization control in WSe2 monolayer by a single-cycle laser pulse

abstract: Abstract The valley degree of freedom in two-dimensional materials provides an opportunity to extend the functionalities of valleytronics devices. Very short valley lifetimes demand the ultrafast control of valley pseudospin. Here, we theoretically demonstrate the control of valley pseudospin in WSe2 monolayer by single-cycle linearly polarized laser pulse. We use the asymmetric electric field controlled by the carrier-envelope phase (CEP) to make the valley polarization between K and K'-point in the Brillouin zone (BZ). Time-dependent density functional theory with spin-orbit interaction reveals that no valley asymmetry and its CEP dependence is observed within the linear-optical limit. In the nonlinear-optical regime, linearly polarized pulse induces a high degree of valley polarization and this polarization is robust against the field strength. Valley polarization strongly depends and oscillates as a function of CEP. The carrier density distribution forms nodes as the laser intensity increases, our results indicate that the position of the carrier density in the BZ can be controlled by the laser intensity. From the analysis by the massive Dirac Hamiltonian model, the nodes of the carrier density can be attributed to the Landau-Zener-St\"uckelberg interference of wave packets of the electron wave function.


title: DeepA: A Deep Neural Analyzer For Speech And Singing Vocoding

abstract: Conventional vocoders are commonly used as analysis tools to provide interpretable features for downstream tasks such as speech synthesis and voice conversion. They are built under certain assumptions about the signals following signal processing principle, therefore, not easily generalizable to different audio, for example, from speech to singing. In this paper, we propose a deep neural analyzer, denoted as DeepA - a neural vocoder that extracts F0 and timbre/aperiodicity encoding from the input speech that emulate those defined in conventional vocoders. Therefore, the resulting parameters are more interpretable than other latent neural representations. At the same time, as the deep neural analyzer is learnable, it is expected to be more accurate for signal reconstruction and manipulation, and generalizable from speech to singing. The proposed neural analyzer is built based on a variational autoencoder (VAE) architecture. We show that DeepA improves F0 estimation over the conventional vocoder (WORLD). To our best knowledge, this is the first study dedicated to the development of a neural framework for extracting learnable vocoder-like parameters.


title: Dropout Prediction Uncertainty Estimation Using Neuron Activation Strength

abstract: Dropout has been commonly used to quantify prediction uncertainty, i.e, the variations of model predictions on a given input example. However, using dropout in practice can be expensive as it requires running dropout inferences many times. In this paper, we study how to estimate dropout prediction uncertainty in a resource-efficient manner. We demonstrate that we can use neuron activation strengths to estimate dropout prediction uncertainty under different dropout settings and on a variety of tasks using three large datasets, MovieLens, Criteo, and EMNIST. Our approach provides an inference-once method to estimate dropout prediction uncertainty as a cheap auxiliary task. We also demonstrate that using activation features from a subset of the neural network layers can be sufficient to achieve uncertainty estimation performance almost comparable to that of using activation features from all layers, thus reducing resources even further for uncertainty estimation.


title: Non-local Recurrent Regularization Networks for Multi-view Stereo

abstract: In deep multi-view stereo networks, cost regularization is crucial to achieve accurate depth estimation. Since 3D cost volume filtering is usually memory-consuming, recurrent 2D cost map regularization has recently become popular and has shown great potential in reconstructing 3D models of different scales. However, existing recurrent methods only model the local dependencies in the depth domain, which greatly limits the capability of capturing the global scene context along the depth dimension. To tackle this limitation, we propose a novel non-local recurrent regularization network for multi-view stereo, named NR2-Net. Specifically, we design a depth attention module to capture non-local depth interactions within a sliding depth block. Then, the global scene context between different blocks is modeled in a gated recurrent manner. This way, the long-range dependencies along the depth dimension are captured to facilitate the cost regularization. Moreover, we design a dynamic depth map fusion strategy to improve the algorithm robustness. Our method achieves state-of-the-art reconstruction results on both DTU and Tanks and Temples datasets.