title: Software Architecture for Next-Generation AI Planning Systems

abstract: Artificial Intelligence (AI) planning is a flourishing research and development discipline that provides powerful tools for searching a course of action that achieves some user goal. While these planning tools show excellent performance on benchmark planning problems, they represent challenging software systems when it comes to their use and integration in real-world applications. In fact, even in-depth understanding of their internal mechanisms does not guarantee that one can successfully set up, use and manipulate existing planning tools. We contribute toward alleviating this situation by proposing a service-oriented planning architecture to be at the core of the ability to design, develop and use next-generation AI planning systems. We collect and classify common planning capabilities to form the building blocks of the planning architecture. We incorporate software design principles and patterns into the architecture to allow for usability, interoperability and reusability of the planning capabilities. Our prototype planning system demonstrates the potential of our approach for rapid prototyping and flexibility of system composition. Finally, we provide insight into the qualitative advantages of our approach when compared to a typical planning tool.


title: Flat-band full localization and symmetry-protected topological phase on bilayer lattice systems

abstract: In this work, we present bilayer flat-band Hamiltonians, in which all bulk states are localized and specified by extensive local integrals of motion (LIOMs). The present systems are bilayer extension of Creutz ladder, which is studied previously. In order to construct models, we employ building blocks, cube operators, which are linear combinations of fermions defined in each cube of the bilayer lattice. There are eight cubic operators, and the Hamiltonians are composed of the number operators of them, the LIOMs. A suitable arrangement of locations of the cube operators is needed to have exact projective Hamiltonians. The projective Hamiltonians belong to a topological classification class, BDI class. With the open boundary condition, the constructed Hamiltonians have gapless edge modes, which commute with each other as well as the Hamiltonian. This result comes from a symmetry analogous to the one-dimensional chiral symmetry of the BDI class. These results indicate that the projective Hamiltonians describe a kind of symmetry protected topological phase matter. Careful investigation of topological indexes, such as Berry phase, string operator, is given. We also show that by using the gapless edge modes, a generalized Sachdev-Ye-Kitaev (SYK) model is constructed.


title: Concurrence of anomalous Hall effect and charge density wave in a superconducting topological kagome metal

abstract: As one of the most fundamental physical phenomena, the anomalous Hall effect (AHE) typically occurs in ferromagnetic materials but is not expected in the conventional superconductors. Here, we have observed a giant AHE in kagome superconductor CsV3Sb5 with transition temperature (Tc) of 2.7 K. The anomalous Hall conductivity reaches up to 2.1*10^4 {\Omega}-1 cm-1 which is larger than those observed in most of the ferromagnetic metals. Strikingly, the emergence of AHE exactly follows the higher-temperature charge-density-wave (CDW) transition with TCDW ~ 94 K, indicating a strong correlation between the CDW state and AHE. Furthermore, AHE disappears when the CDW transition is completely suppressed at high pressure. The origin for AHE is attributed to enhanced skew scattering in CDW state and large Berry curvature arose from the kagome lattice. These discoveries make CsV3Sb5 as an ideal platform to study the interplay among nontrivial band topology, CDW and unconventional superconductivity.


title: Energy stable arbitrary order ETD-MS method for gradient flows with Lipschitz nonlinearity

abstract: We present a methodology to construct efficient high-order in time accurate numerical schemes for a class of gradient flows with appropriate Lipschitz continuous nonlinearity. There are several ingredients to the strategy: the exponential time differencing (ETD), the multi-step (MS) methods, the idea of stabilization, and the technique of interpolation. They are synthesized to develop a generic $k^{th}$ order in time efficient linear numerical scheme with the help of an artificial regularization term of the form $A\tau^k\frac{\partial}{\partial t}\mathcal{L}^{p(k)}u$ where $\mathcal{L}$ is the positive definite linear part of the flow, $\tau$ is the uniform time step-size. The exponent $p(k)$ is determined explicitly by the strength of the Lipschitz nonlinear term in relation to $\mathcal{L}$ together with the desired temporal order of accuracy $k$. To validate our theoretical analysis, the thin film epitaxial growth without slope selection model is examined with a fourth-order ETD-MS discretization in time and Fourier pseudo-spectral in space discretization. Our numerical results on convergence and energy stability are in accordance with our theoretical results.


title: UPRec: User-Aware Pre-training for Recommender Systems

abstract: Existing sequential recommendation methods rely on large amounts of training data and usually suffer from the data sparsity problem. To tackle this, the pre-training mechanism has been widely adopted, which attempts to leverage large-scale data to perform self-supervised learning and transfer the pre-trained parameters to downstream tasks. However, previous pre-trained models for recommendation focus on leverage universal sequence patterns from user behaviour sequences and item information, whereas ignore capturing personalized interests with the heterogeneous user information, which has been shown effective in contributing to personalized recommendation. In this paper, we propose a method to enhance pre-trained models with heterogeneous user information, called User-aware Pre-training for Recommendation (UPRec). Specifically, UPRec leverages the user attributes andstructured social graphs to construct self-supervised objectives in the pre-training stage and proposes two user-aware pre-training tasks. Comprehensive experimental results on several real-world large-scale recommendation datasets demonstrate that UPRec can effectively integrate user information into pre-trained models and thus provide more appropriate recommendations for users.


title: Inclusive education and research through African Network of Women in Astronomy and STEM for GIRLS in Ethiopia initiatives

abstract: The African Network of Women in Astronomy and STEM for GIRLS in Ethiopia initiatives have been established with aim to strengthen the participation of girls and women in astronomy and science in Africa and Ethiopia. We will not be able to achieve the UN Sustainable Development Goals without full participation of women and girls in all aspects of our society and without giving in future the same opportunity to all children to access education independently on their socio-economical status. In this paper both initiatives are briefly introduced.


title: Vector-Boson Scattering at the LHC: unravelling the Electroweak sector

abstract: Vector-boson scattering (VBS) processes probe the innermost structure of electroweak interactions in the Standard Model, and provide a unique sensitivity for new physics phenomena affecting the gauge sector. In this review, we report on the salient aspects of this class of processes, both from the theory and experimental point of view. We start by discussing recent achievements relevant for their theoretical description, some of which have set important milestones in improving the precision and accuracy of the corresponding simulations. We continue by covering the development of experimental techniques aimed at detecting these rare processes and improving the signal sensitivity over large backgrounds. We then summarise the details of the most relevant VBS signatures and review the related measurements available to date, along with their comparison with Standard-Model predictions. We conclude by discussing the perspective at the upcoming Large Hadron Collider runs and at future hadron facilities.


title: Word frequency-rank relationship in tagged texts

abstract: We analyze the frequency-rank relationship in sub-vocabularies corresponding to three different grammatical classes (nouns, verbs, and others) in a collection of literary works in English, whose words have been automatically tagged according to their grammatical role. Comparing with a null hypothesis which assumes that words belonging to each class are uniformly distributed across the frequency-ranked vocabulary of the whole work, we disclose statistically significant differences between the three classes. This results point to the fact that frequency-rank relationships may reflect linguistic features associated with grammatical function.


abstract: Is there any theoretical guarantee for the approximation ability of neural networks? The answer to this question is the "Universal Approximation Theorem for Neural Networks". This theorem states that a neural network is dense in a certain function space under an appropriate setting. This paper is a comprehensive explanation of the universal approximation theorem for feedforward neural networks, its approximation rate problem (the relation between the number of intermediate units and the approximation error), and Barron space in Japanese.


title: Coherence of Working Memory Study Between Deep Neural Network and Neurophysiology

abstract: The auto feature extraction capability of deep neural networks (DNN) endows them the potentiality for analysing complicated electroencephalogram (EEG) data captured from brain functionality research. This work investigates the potential coherent correspondence between the region-of-interest (ROI) for DNN to explore, and ROI for conventional neurophysiological oriented methods to work with, exemplified in the case of working memory study. The attention mechanism induced by global average pooling (GAP) is applied to a public EEG dataset of working memory, to unveil these coherent ROIs via a classification problem. The result shows the alignment of ROIs from different research disciplines. This work asserts the confidence and promise of utilizing DNN for EEG data analysis, albeit in lack of the interpretation to network operations.


title: Measurement of the miscut angle in the determination of the Si lattice parameter

abstract: The measurement of the angle between the interferometer front mirror and the diffracting planes is a critical aspect of the Si lattice-parameter measurement by combined x-ray and optical interferometry. In addition to being measured off-line by x-ray diffraction, it was checked on-line by transversely moving the analyser crystal and observing the phase shift of the interference fringe. We describe the measurement procedure and give the miscut angle of the $^{28}$Si crystal whose lattice parameter was an essential input-datum for, yesterday, the determination of the Avogadro constant and, today, the kilogram realisation by counting atoms. These data are a kindness to others that might wish to repeat the measurement of the lattice-parameter of this unique crystal.


title: Opportunities for DOE National Laboratory-led QuantISED Experiments

abstract: A subset of QuantISED Sensor PIs met virtually on May 26, 2020 to discuss a response to a charge by the DOE Office of High Energy Physics. In this document, we summarize the QuantISED sensor community discussion, including a consideration of HEP science enabled by quantum sensors, describing the distinction between Quantum 1.0 and Quantum 2.0, and discussing synergies/complementarity with the new DOE NQI centers and with research supported by other SC offices. Quantum 2.0 advances in sensor technology offer many opportunities and new approaches for HEP experiments. The DOE HEP QuantISED program could support a portfolio of small experiments based on these advances. QuantISED experiments could use sensor technologies that exemplify Quantum 2.0 breakthroughs. They would strive to achieve new HEP science results, while possibly spinning off other domain science applications or serving as pathfinders for future HEP science targets. QuantISED experiments should be led by a DOE laboratory, to take advantage of laboratory technical resources, infrastructure, and expertise in the safe and efficient construction, operation, and review of experiments. The QuantISED PIs emphasized that the quest for HEP science results under the QuantISED program is distinct from the ongoing DOE HEP programs on the energy, intensity, and cosmic frontiers. There is robust evidence for the existence of particles and phenomena beyond the Standard Model, including dark matter, dark energy, quantum gravity, and new physics responsible for neutrino masses, cosmic inflation, and the cosmic preference for matter over antimatter. Where is this physics and how do we find it? The QuantISED program can exploit new capabilities provided by quantum technology to probe these kinds of science questions in new ways and over a broader range of science parameters than can be achieved with conventional techniques.


title: Trust Computational Heuristic for Social Internet of Things: A Machine Learning-based Approach

abstract: The Internet of Things (IoT) is an evolving network of billions of interconnected physical objects, such as numerous sensors, smartphones, wearables, and embedded devices. These physical objects, generally referred to as the smart objects, when deployed in the real-world aggregates useful information from their surrounding environment. As-of-late, this notion of IoT has been extended to incorporate the social networking facets which have led to the promising paradigm of the `Social Internet of Things' (SIoT). In SIoT, the devices operate as an autonomous agent and provide an exchange of information and service discovery in an intelligent manner by establishing social relationships among them with respect to their owners. Trust plays an important role in establishing trustworthy relationships among the physical objects and reduces probable risks in the decision-making process. In this paper, a trust computational model is proposed to extract individual trust features in a SIoT environment. Furthermore, a machine learning-based heuristic is used to aggregate all the trust features in order to ascertain an aggregate trust score. Simulation results illustrate that the proposed trust-based model isolates the trustworthy and untrustworthy nodes within the network in an efficient manner.


title: Towards a Machine Learning-driven Trust Evaluation Model for Social Internet of Things: A Time-aware Approach

abstract: The emerging paradigm of the Social Internet of Things (SIoT) has transformed the traditional notion of the Internet of Things (IoT) into a social network of billions of interconnected smart objects by integrating social networking facets into the same. In SIoT, objects can establish social relationships in an autonomous manner and interact with the other objects in the network based on their social behaviour. A fundamental problem that needs attention is establishing of these relationships in a reliable and trusted way, i.e., establishing trustworthy relationships and building trust amongst objects. In addition, it is also indispensable to ascertain and predict an object's behaviour in the SIoT network over a period of time. Accordingly, in this paper, we have proposed an efficient time-aware machine learning-driven trust evaluation model to address this particular issue. The envisaged model deliberates social relationships in terms of friendship and community-interest, and further takes into consideration the working relationships and cooperativeness (object-object interactions) as trust parameters to quantify the trustworthiness of an object. Subsequently, in contrast to the traditional weighted sum heuristics, a machine learning-driven aggregation scheme is delineated to synthesize these trust parameters to ascertain a single trust score. The experimental results demonstrate that the proposed model can efficiently segregates the trustworthy and untrustworthy objects within a network, and further provides the insight on how the trust of an object varies with time along with depicting the effect of each trust parameter on a trust score.


title: Conditional Value at Risk and Partial Moments for the Metalog Distributions

abstract: The metalog distributions represent a convenient way to approach many practical applications. Their distinctive feature is simple closed-form expressions for quantile functions. This paper contributes to further development of the metalog distributions by deriving the closed-form expressions for the Conditional Value at Risk, a risk measure that is closely related to the tail conditional expectations. It also addressed the derivation of the first-order partial moments and shows that they are convex with respect to the vector of the metalog distribution parameters.


title: An open access NLP dataset for Arabic dialects : Data collection, labeling, and model construction

abstract: Natural Language Processing (NLP) is today a very active field of research and innovation. Many applications need however big sets of data for supervised learning, suitably labelled for the training purpose. This includes applications for the Arabic language and its national dialects. However, such open access labeled data sets in Arabic and its dialects are lacking in the Data Science ecosystem and this lack can be a burden to innovation and research in this field. In this work, we present an open data set of social data content in several Arabic dialects. This data was collected from the Twitter social network and consists on +50K twits in five (5) national dialects. Furthermore, this data was labeled for several applications, namely dialect detection, topic detection and sentiment analysis. We publish this data as an open access data to encourage innovation and encourage other works in the field of NLP for Arabic dialects and social media. A selection of models were built using this data set and are presented in this paper along with their performances.


title: Development of an Array of Kinetic Inductance Magnetometers (KIMs)

abstract: We describe optimization of a cryogenic magnetometer that uses nonlinear kinetic inductance in superconducting nanowires as the sensitive element instead of a superconducting quantum interference device (SQUID). The circuit design consists of a loop geometry with two nanowires in parallel, serving as the inductive section of a lumped LC resonator similar to a kinetic inductance detector (KID). This device takes advantage of the multiplexing capability of the KID, allowing for a natural frequency multiplexed readout. The Kinetic Inductance Magnetometer (KIM) is biased with a DC magnetic flux through the inductive loop. A perturbing signal will cause a flux change through the loop, and thus a change in the induced current, which alters the kinetic inductance of the nanowires, causing the resonant frequency of the KIM to shift. This technology has applications in astrophysics, material science, and the medical field for readout of Metallic Magnetic Calorimeters (MMCs), axion detection, and magnetoencephalography (MEG).


title: uFLIM -- Unsupervised analysis of FLIM-FRET microscopy data

abstract: Despite their widespread use in cell biology, fluorescence lifetime imaging microscopy (FLIM) data-sets are challenging to analyse, because each spatial position can contain a superposition of multiple fluorescent components. Here, we present a data analysis method employing all information in the available photon budget, as well as being fast. The method, called uFLIM, determines spatial distributions and temporal dynamics of multiple fluorescent components with no prior knowledge. It goes significantly beyond current approaches which either assume the functional dependence of the dynamics, e.g. an exponential decay, or require dynamics to be known, or calibrated. Its efficient non-negative matrix factorization algorithm allows for real-time data processing. We validate in silico that uFLIM is capable to disentangle the spatial distribution and spectral properties of five fluorescing probes, from only two excitation and detection channels and a photon budget of 100 detected photons per pixel. By adapting the method to data exhibiting Forster resonant energy transfer (FRET), we retrieve the spatial and transfer rate distribution of the bound species, without constrains on donor and acceptor dynamics.


title: DROID: Minimizing the Reality Gap using Single-Shot Human Demonstration

abstract: Reinforcement learning (RL) has demonstrated great success in the past several years. However, most of the scenarios focus on simulated environments. One of the main challenges of transferring the policy learned in a simulated environment to real world, is the discrepancy between the dynamics of the two environments. In prior works, Domain Randomization (DR) has been used to address the reality gap for both robotic locomotion and manipulation tasks. In this paper, we propose Domain Randomization Optimization IDentification (DROID), a novel framework to exploit single-shot human demonstration for identifying the simulator's distribution of dynamics parameters, and apply it to training a policy on a door opening task. Our results show that the proposed framework can identify the difference in dynamics between the simulated and the real worlds, and thus improve policy transfer by optimizing the simulator's randomization ranges. We further illustrate that based on these same identified parameters, our method can generalize the learned policy to different but related tasks.


title: A review of modelling in ferrimagnetic spintronics

abstract: In this review we introduce computer modelling and simulation techniques which are used for ferrimagnetic materials. We focus on models where thermal effects are accounted for, atomistic spin dynamics and finite temperature macrospin approaches. We survey the literature of two of the most commonly modelled ferrimagnets in the field of spintronics--the amorphous alloy GdFeCo and the magnetic insulator yttrium iron garnet. We look at how generic models and material specific models have been applied to predict and understand spintronic experiments, focusing on the fields of ultrafast magnetisation dynamics, spincaloritronics and magnetic textures dynamics and give an outlook for modelling in ferrimagnetic spintronics.


title: LogME: Practical Assessment of Pre-trained Models for Transfer Learning

abstract: This paper studies task adaptive pre-trained model selection, an underexplored problem of assessing pre-trained models for the target task and select best ones from the model zoo \emph{without fine-tuning}. A few pilot works addressed the problem in transferring supervised pre-trained models to classification tasks, but they cannot handle emerging unsupervised pre-trained models or regression tasks. In pursuit of a practical assessment method, we propose to estimate the maximum value of label evidence given features extracted by pre-trained models. Unlike the maximum likelihood, the maximum evidence is \emph{immune to over-fitting}, while its expensive computation can be dramatically reduced by our carefully designed algorithm. The Logarithm of Maximum Evidence (LogME) can be used to assess pre-trained models for transfer learning: a pre-trained model with a high LogME value is likely to have good transfer performance. LogME is \emph{fast, accurate, and general}, characterizing itself as the first practical method for assessing pre-trained models. Compared with brute-force fine-tuning, LogME brings at most $3000\times$ speedup in wall-clock time and requires only $1\%$ memory footprint. It outperforms prior methods by a large margin in their setting and is applicable to new settings. It is general enough for diverse pre-trained models (supervised pre-trained and unsupervised pre-trained), downstream tasks (classification and regression), and modalities (vision and language). Code is available at this repository: \href{https://github.com/thuml/LogME}{https://github.com/thuml/LogME}.


title: The relation between the radii and the densities of magnetic skyrmions

abstract: Compared with the traditional magnetic bubble, skyrmion has smaller size, better stability therefore is considered as a very promising candidate for future memory devices. When skyrmions are manipulated, erased and created, the density of skyrmions can be varied, however the relationship between the radii and the densities of skyrmions needs more exploration. In this paper, we study this problem both theoretically and by using the lattice simulation. The average radius of skyrmions as a function of material parameters, the strength of external magnetic field and the density of skyrmions is obtained and verified. With this explicit function, the skyrmion radius can be easily predicted, which is helpful for the future study of skyrmion memory devices.


title: Linear stability of flow in a 90-degree bend

abstract: The paper considers a two-dimensional flow in a channel, which consists of straight inlet and outlet branches and a circularly 90-degree curved bend. An incompressible viscous fluid flows through the elbow under the action of a constant pressure gradient between the inlet and outlet. Navier-Stokes equations were solved numerically using a high-fidelity spectral/hp element method. In a range of Reynolds numbers, an adaptive selective frequency dumping method was used to get a steady-state flow. It was found that three separation bubbles and vortex shedding can exist in the bend. The modal stability of two- and three-dimensional perturbations was investigated. Critical Reynolds number of the two-dimensional disturbances was found as extrapolation by lower Reynolds number results. It is much greater than three-dimensional one, but the two-dimensional flow could subcritically unstable with respect to the imposed small-amplitude white noise. For three-dimensional perturbations, the dependence of the critical Reynolds numbers on the bending radius is obtained. For a case of a moderate bending radius the neutral curve is provided and eigenfunctions are studied in detail: three-dimensional instability can be caused by periodic or monotonically growing mode, these unstable modes regard to the recirculation bubbles that occur after the bend.


title: InsNet: An Efficient, Flexible, and Performant Insertion-based Text Generation Model

abstract: We propose InsNet, an expressive insertion-based text generator with efficient training and flexible decoding (parallel or sequential). Unlike most existing insertion-based text generation works that require re-encoding of the context after each insertion operation and thus are inefficient to train, InsNet only requires one pass of context encoding for the entire sequence during training by introducing a novel insertion-oriented position encoding and a light-weighted slot representation strategy to enable computation sharing. Furthermore, we propose an algorithm InsNet-Dinic to better determine the parallelization of insertion operations that provides a controllable switch between parallel and sequential decoding, making it flexible to handle more parallelizable tasks such as machine translation with efficient decoding, or less parallelizable tasks such as open-domain text generation to guarantee high-quality outputs. Experiments on two lexically constrained text generation datasets and three machine translation datasets demonstrate InsNet's advantages over previous insertion-based methods in terms of training speed, inference efficiency, and generation quality.


title: The Moral Foundations of Left-Wing Authoritarianism: On the Character, Cohesion, and Clout of Tribal Equalitarian Discourse

abstract: Left-wing authoritarianism remains far less understood than right-wing authoritarianism. We contribute to the literature on the former, which typically relies on surveys, using a new social media analytics approach. We use a list of 60 terms to provide an exploratory sketch of the outlines of a political ideology (tribal equalitarianism) with origins in 19th and 20th century social philosophy. We then use analyses of the English Corpus of Google Books (over 8 million books) and scraped unique tweets from Twitter (n = 202,852) to conduct a series of investigations to discern the extent to which this ideology is cohesive amongst the public, reveals signatures of authoritarianism and has been growing in popularity. Though exploratory, our results provide some evidence of left-wing authoritarianism in two forms (1) a uniquely conservative moral signature amongst ostensible liberals using measures from Moral Foundations Theory and (2) a substantial prevalence of anger, relative to anxiety or sadness. In general, results indicate that this worldview is growing in popularity, is increasingly cohesive, and shows signatures of authoritarianism.


title: Resilience of Bayesian Layer-Wise Explanations under Adversarial Attacks

abstract: We consider the problem of the stability of saliency-based explanations of Neural Network predictions under adversarial attacks in a classification task. Saliency interpretations of deterministic Neural Networks are remarkably brittle even when the attacks fail, i.e. for attacks that do not change the classification label. We empirically show that interpretations provided by Bayesian Neural Networks are considerably more stable under adversarial perturbations of the inputs and even under direct attacks to the explanations. By leveraging recent results, we also provide a theoretical explanation of this result in terms of the geometry of the data manifold. Additionally, we discuss the stability of the interpretations of high level representations of the inputs in the internal layers of a Network. Our results demonstrate that Bayesian methods, in addition to being more robust to adversarial attacks, have the potential to provide more stable and interpretable assessments of Neural Network predictions.


title: The Uncanny Similarity of Recurrence and Depth

abstract: It is widely believed that deep neural networks contain layer specialization, wherein neural networks extract hierarchical features representing edges and patterns in shallow layers and complete objects in deeper layers. Unlike common feed-forward models that have distinct filters at each layer, recurrent networks reuse the same parameters at various depths. In this work, we observe that recurrent models exhibit the same hierarchical behaviors and the same performance benefits with depth as feed-forward networks despite reusing the same filters at every recurrence. By training models of various feed-forward and recurrent architectures on several datasets for image classification as well as maze solving, we show that recurrent networks have the ability to closely emulate the behavior of non-recurrent deep models, often doing so with far fewer parameters.


title: Multimodal Punctuation Prediction with Contextual Dropout

abstract: Automatic speech recognition (ASR) is widely used in consumer electronics. ASR greatly improves the utility and accessibility of technology, but usually the output is only word sequences without punctuation. This can result in ambiguity in inferring user-intent. We first present a transformer-based approach for punctuation prediction that achieves 8% improvement on the IWSLT 2012 TED Task, beating the previous state of the art [1]. We next describe our multimodal model that learns from both text and audio, which achieves 8% improvement over the text-only algorithm on an internal dataset for which we have both the audio and transcriptions. Finally, we present an approach to learning a model using contextual dropout that allows us to handle variable amounts of future context at test time.


title: Multiple-shooting adjoint method for whole-brain dynamic causal modeling

abstract: Dynamic causal modeling (DCM) is a Bayesian framework to infer directed connections between compartments, and has been used to describe the interactions between underlying neural populations based on functional neuroimaging data. DCM is typically analyzed with the expectation-maximization (EM) algorithm. However, because the inversion of a large-scale continuous system is difficult when noisy observations are present, DCM by EM is typically limited to a small number of compartments ($<10$). Another drawback with the current method is its complexity; when the forward model changes, the posterior mean changes, and we need to re-derive the algorithm for optimization. In this project, we propose the Multiple-Shooting Adjoint (MSA) method to address these limitations. MSA uses the multiple-shooting method for parameter estimation in ordinary differential equations (ODEs) under noisy observations, and is suitable for large-scale systems such as whole-brain analysis in functional MRI (fMRI). Furthermore, MSA uses the adjoint method for accurate gradient estimation in the ODE; since the adjoint method is generic, MSA is a generic method for both linear and non-linear systems, and does not require re-derivation of the algorithm as in EM. We validate MSA in extensive experiments: 1) in toy examples with both linear and non-linear models, we show that MSA achieves better accuracy in parameter value estimation than EM; furthermore, MSA can be successfully applied to large systems with up to 100 compartments; and 2) using real fMRI data, we apply MSA to the estimation of the whole-brain effective connectome and show improved classification of autism spectrum disorder (ASD) vs. control compared to using the functional connectome. The package is provided \url{https://jzkay12.github.io/TorchDiffEqPack}


title: Battery characterization via eddy-current imaging with nitrogen-vacancy centers in diamond

abstract: Sensitive and accurate diagnostic technologies with magnetic sensors are of great importance for identifying and localizing defects of rechargeable solid batteries in a noninvasive detection. We demonstrate a microwave-free AC magnetometry method with negatively charged NV centers in diamond based on a cross-relaxation feature between NV centers and individual substitutional nitrogen (P1) centers occurring at 51.2 mT. We apply the technique to non-destructive solid-state battery imaging. By detecting the eddy-current-induced magnetic field of the battery, we distinguish a defect on the external electrode and identify structural anomalies within the battery body. The achieved spatial resolution is $360\,\mu\rm m$. The maximum magnetic field and phase shift generated by the battery at the modulation frequency of 5 kHz are estimated as 0.04 mT and 0.03 rad respectively.


title: Efficient and quantitative phase field simulations of polycrystalline solidification using a vector order parameter

abstract: A vector order parameter phase field model derived from a grand potential functional is presented as a new approach for modeling polycrystalline solidification of alloys. In this approach, the grand potential density is designed to contain a discrete set of finite wells, a feature that naturally allows for the growth and controlled interaction of multiple grains using a single vector field. We verify that dendritic solidification in binary alloys follows the well-established quantitative behavior in the thin interface limit. In addition, it is shown that grain boundary energy and solute back-diffusion are quantitatively consistent with earlier theoretical work, with grain boundary energy being controlled through a simple solid-solid interaction parameter. Moreover, when considering polycrystalline aggregates and their coarsening, we show that the kinetics follow the expected parabolic growth law. Finally, we demonstrate how this new vector order parameter model can be used to describe nucleation in polycrystalline systems via thermal fluctuations of the vector order parameter, a feature which has been thus far lacking from multi-phase or multi-order parameter based phase field models. The presented vector order parameter model serves as a practical and efficient computational tool for simulating polycrystalline materials. We also discuss the extension of the order parameter to higher dimensions as a simple method for modeling multiple solid phases.


title: Population Control Bias and Importance Sampling in Full Configuration Interaction Quantum Monte Carlo

abstract: Population control is an essential component of any projector Monte Carlo algorithm. This control mechanism usually introduces a bias in the sampled quantities that is inversely proportional to the population size. In this paper, we investigate the population control bias in the full configuration interaction quantum Monte Carlo method. We identify the precise origin of this bias and quantify it in general. We show that it has different effects on different estimators and that the shift estimator is particularly susceptible. We derive a re-weighting technique, similar to the one used in diffusion Monte Carlo, for correcting this bias and apply it to the shift estimator. We also show that by using importance sampling, the bias can be reduced substantially. We demonstrate the necessity and the effectiveness of applying these techniques for sign-problem-free systems where this bias is especially notable. Specifically, we show results for large one-dimensional Hubbard models and the two-dimensional Heisenberg model, where corrected FCIQMC results are comparable to the other high-accuracy results.


title: Atomic Force Extrema Induced by the Bending of a CO-Functionalized Probe

abstract: The control and observation of reactants forming a chemical bond at the single-molecule level is a longstanding challenge in quantum physics and chemistry. Using a single CO molecule adsorbed at the apex of an atomic force microscope tip together with a Cu(111) surface, the molecular bending is induced by torques due to van der Waals attraction and Pauli repulsion. As a result, the vertical force exhibits a characteristic dip-hump evolution with the molecule-surface separation, which depends sensitively on the initial tilt angle the CO axis encloses with the surface normal. The experimental force data are reproduced by model calculations that consider the CO deflection in a harmonic potential and the molecular orientation in the Pauli repulsion term of the Lennard-Jones potential. The presented findings shed new light on vertical-force extrema that can occur in scanning probe experiments with functionalized tips.


title: Intragranular Strain Estimation in Far-Field Scanning X-ray Diffraction using a Gaussian Processes

abstract: A new method for estimation of intragranular strain fields in polycrystalline materials based on scanning three-dimensional X-ray diffraction data (scanning-3DXRD) is presented and evaluated. Given an apriori known anisotropic compliance, the regression method enforces the balance of linear and angular momentum in the linear elastic strain field reconstruction. By using a Gaussian Process (GP), the presented method can yield a spatial estimate of the uncertainty of the reconstructed strain field. Furthermore, constraints on spatial smoothness can be optimised with respect to measurements through hyperparameter estimation. These three features address weaknesses discussed for previously existing scanning-3DXRD reconstruction methods and, thus, offers a more robust strain field estimation. The method is twofold validated; firstly by reconstruction from synthetic diffraction data and, secondly, by reconstruction of previously studied tin (Sn) grain embedded in a polycrystalline specimen. Comparison against reconstructions achieved by a recently proposed algebraic inversion technique is also presented. It is found that the GP regression consistently produces reconstructions with lower root mean squared errors, mean absolute errors and maximum absolute errors across all six components of strain.


title: Shaping liquid films by dielectrophoresis

abstract: We present a theoretical model and experimental demonstration of thin liquid film deformations due to a dielectric force distribution established by surface electrodes. We model the spatial electric field produced by a pair of parallel electrodes and use it to evaluate the stress on the interface through Maxwell stresses. By coupling this force with the Young-Laplace equation, we obtain the deformation of the interface. To validate our theory, we design an experimental setup which uses microfabricated electrodes to achieve spatial dielectrophoretic actuation of a thin liquid film, while providing measurements of microscale deformations through digital holographic microscopy. We characterize the deformation as a function of the electrode-pair geometry and film thickness, showing very good agreement with the model. Based on the insights from the characterization of the system, we pattern conductive lines of electrode pairs on the surface of a microfluidic chamber and demonstrate the ability to produce complex two-dimensional deformations. The films can remain in liquid form and be dynamically modulated between different configurations or polymerized to create solid structures with high surface quality.


title: Chaotic Dynamics of Polyatomic Systems with an Emphasis on DNA Models

abstract: We investigate the chaotic behaviour of multiparticle systems, in particular DNA and graphene models, by applying methods of nonlinear dynamics. Using symplectic integration techniques, we present an extensive analysis of chaos in the Peyrard-Bishop-Dauxois (PBD) model of DNA. The chaoticity is quantified by the maximum Lyapunov exponent (mLE) across a spectrum of temperatures, and the effect of base pair (BP) disorder on the dynamics is studied. In addition to heterogeneity due to the ratio of adenine-thymine (AT) and guanine-cytosine (GC) BPs, the distribution of BPs in the sequence is analysed by introducing the alternation index $\alpha$. An exact probability distribution for BP arrangements and $\alpha$ is derived using P\'olya counting. The value of the mLE depends on the composition and arrangement of BPs in the strand, with a dependence on temperature. We probe regions of strong chaoticity using the deviation vector distribution, studying links between strongly nonlinear behaviour and the formation of bubbles. Randomly generated sequences and biological promoters are both studied. Further, properties of bubbles are analysed through molecular dynamics simulations. The distributions of bubble lifetimes and lengths are obtained, fitted with analytical expressions, and a physically justified threshold for considering a BP to be open is successfully implemented. In addition to DNA, we present analysis of the dynamical stability of a planar model of graphene, studying the mLE in bulk graphene as well as in graphene nanoribbons (GNRs). The stability of the material manifests in a very small mLE, with chaos being a slow process in graphene. For both armchair and zigzag edge GNRs, the mLE decreases with increasing width, asymptotically reaching the bulk behaviour. This dependence of the mLE on both energy density and ribbon width is fitted accurately with empirical expressions.


title: Modeling COVID-19 hospital admissions and occupancy in the Netherlands

abstract: We describe the models we built for hospital admissions and occupancy of COVID-19 patients in the Netherlands. These models were used to make short-term decisions about transfers of patients between regions and for long-term policy making. We motivate and describe the model we used for predicting admissions and how we use this to make predictions on occupancy.


title: What is the probability that a vaccinated person is shielded from Covid-19? A Bayesian MCMC based reanalysis of published data with emphasis on what should be reported as 'efficacy'

abstract: Based on the information communicated in press releases, and finally published towards the end of 2020 by Pfizer, Moderna and AstraZeneca, we have built up a simple Bayesian model, in which the main quantity of interest plays the role of {\em vaccine efficacy} (`$\epsilon$'). The resulting Bayesian Network is processed by a Markov Chain Monte Carlo (MCMC), implemented in JAGS interfaced to R via rjags. As outcome, we get several probability density functions (pdf's) of $\epsilon$, each conditioned on the data provided by the three pharma companies. The result is rather stable against large variations of the number of people participating in the trials and it is `somehow' in good agreement with the results provided by the companies, in the sense that their values correspond to the most probable value (`mode') of the pdf's resulting from MCMC, thus reassuring us about the validity of our simple model. However we maintain that the number to be reported as `vaccine efficacy' should be the mean of the distribution, rather than the mode, as it was already very clear to Laplace about 250 years ago (its `rule of succession' follows from the simplest problem of the kind). This is particularly important in the case in which the number of successes equals the numbers of trials, as it happens with the efficacy against `severe forms' of infection, claimed by Moderna to be 100%. The implication of the various uncertainties on the predicted number of vaccinated infectees is also shown, using both MCMC and approximated formulae.


title: Predicting Material Properties Using a 3D Graph Neural Network with Invariant Local Descriptors

abstract: Accurate prediction of physical properties is critical for discovering and designing novel materials. Machine learning technologies have attracted significant attention in the materials science community for their potential for large-scale screening. Graph Convolution Neural Network (GCNN) is one of the most successful machine learning methods because of its flexibility and effectiveness in describing 3D structural data. Most existing GCNN models focus on the topological structure but overly simplify the three-dimensional geometric structure. However, in materials science, the 3D-spatial distribution of atoms is crucial for determining the atomic states and interatomic forces. This paper proposes an adaptive GCNN with a novel convolution mechanism that simultaneously models atomic interactions among all neighbor atoms in three-dimensional space. We apply the proposed model to two distinctly challenging problems on predicting material properties. The first is Henry's constant for gas adsorption in Metal-Organic Frameworks (MOFs), which is notoriously difficult because of its high sensitivity to atomic configurations. The second is the ion conductivity in solid-state crystal materials, which is difficult because of few labeled data available for training. The new model outperforms existing graph-based models on both data sets, suggesting that the critical three-dimensional geometric information is indeed captured.


title: Convolutional neural network-assisted recognition of nanoscale L12 ordered structures in face-centred cubic alloys

abstract: Nanoscale L12-type ordered structures are widely used in face-centred cubic (FCC) alloys to exploit their hardening capacity and thereby improve mechanical properties. These fine-scale particles are typically fully coherent with matrix with the same atomic configuration disregarding chemical species, which makes them challenging to be characterized. Spatial distribution maps (SDMs) are used to probe local order by interrogating the three-dimensional (3D) distribution of atoms within reconstructed atom probe tomography (APT) data. However, it is almost impossible to manually analyse the complete point cloud ($>10$ million) in search for the partial crystallographic information retained within the data. Here, we proposed an intelligent L12-ordered structure recognition method based on convolutional neural networks (CNNs). The SDMs of a simulated L12-ordered structure and the FCC matrix were firstly generated. These simulated images combined with a small amount of experimental data were used to train a CNN-based L12-ordered structure recognition model. Finally, the approach was successfully applied to reveal the 3D distribution of L12-type $\delta^\prime$-Al3(LiMg) nanoparticles with an average radius of 2.54 nm in a FCC Al-Li-Mg system. The minimum radius of detectable nanodomain is even down to 5 \r{A}. The proposed CNN-APT method is promising to be extended to recognize other nanoscale ordered structures and even more-challenging short-range ordered phenomena in the near future.


title: A Qualitative Theory of Cognitive Attitudes and their Change

abstract: We present a general logical framework for reasoning about agents' cognitive attitudes of both epistemic type and motivational type. We show that it allows us to express a variety of relevant concepts for qualitative decision theory including the concepts of knowledge, belief, strong belief, conditional belief, desire, conditional desire, strong desire and preference. We also present two extensions of the logic, one by the notion of choice and the other by dynamic operators for belief change and desire change, and we apply the former to the analysis of single-stage games under incomplete information. We provide sound and complete axiomatizations for the basic logic and for its two extensions. The paper is under consideration in Theory and Practice of Logic Programming (TPLP).


title: High-order Differentiable Autoencoder for Nonlinear Model Reduction

abstract: This paper provides a new avenue for exploiting deep neural networks to improve physics-based simulation. Specifically, we integrate the classic Lagrangian mechanics with a deep autoencoder to accelerate elastic simulation of deformable solids. Due to the inertia effect, the dynamic equilibrium cannot be established without evaluating the second-order derivatives of the deep autoencoder network. This is beyond the capability of off-the-shelf automatic differentiation packages and algorithms, which mainly focus on the gradient evaluation. Solving the nonlinear force equilibrium is even more challenging if the standard Newton's method is to be used. This is because we need to compute a third-order derivative of the network to obtain the variational Hessian. We attack those difficulties by exploiting complex-step finite difference, coupled with reverse automatic differentiation. This strategy allows us to enjoy the convenience and accuracy of complex-step finite difference and in the meantime, to deploy complex-value perturbations as collectively as possible to save excessive network passes. With a GPU-based implementation, we are able to wield deep autoencoders (e.g., $10+$ layers) with a relatively high-dimension latent space in real-time. Along this pipeline, we also design a sampling network and a weighting network to enable \emph{weight-varying} Cubature integration in order to incorporate nonlinearity in the model reduction. We believe this work will inspire and benefit future research efforts in nonlinearly reduced physical simulation problems.


title: Investigating Underlying Drivers of Variability in Residential Energy Usage Patterns with Daily Load Shape Clustering of Smart Meter Data

abstract: Residential customers have traditionally not been treated as individual entities due to the high volatility in residential consumption patterns as well as a historic focus on aggregated loads from the utility and system feeder perspective. Large-scale deployment of smart meters has motivated increasing studies to explore disaggregated daily load patterns, which can reveal important heterogeneity across different time scales, weather conditions, as well as within and across individual households. This paper aims to shed light on the mechanisms by which electricity consumption patterns exhibit variability and the different constraints that may affect demand-response (DR) flexibility. We systematically evaluate the relationship between daily time-of-use patterns and their variability to external and internal influencing factors, including time scales of interest, meteorological conditions, and household characteristics by application of an improved version of the adaptive K-means clustering method to profile "household-days" of a summer peaking utility. We find that for this summer-peaking utility, outdoor temperature is the most important external driver of the load shape variability relative to seasonality and day-of-week. The top three consumption patterns represent approximately 50% of usage on the highest temperature days. The variability in summer load shapes across customers can be explained by the responsiveness of the households to outside temperature. Our results suggest that depending on the influencing factors, not all the consumption variability can be readily translated to consumption flexibility. Such information needs to be further explored in segmenting customers for better program targeting and tailoring to meet the needs of the rapidly evolving electricity grid.


title: Automated real-time spectral characterization of phase-change tunable optical filters using a linear variable filter and infrared camera

abstract: Actively tunable optical filters based on chalcogenide phase-change materials (PCMs) are an emerging technology with applications across chemical spectroscopy and thermal imaging. The refractive index of an embedded PCM thin film is modulated through an amorphous-to-crystalline phase transition induced through thermal stimulus. Performance metrics include transmittance, passband center wavelength (CWL), and bandwidth; ideally monitored during operation (in situ) or after a set number of tuning cycles to validate real-time operation. Measuring these aforementioned metrics in real-time is challenging. Fourier-transform infrared spectroscopy (FTIR) provides the gold-standard for performance characterization, yet is expensive and inflexible -- incorporating the PCM tuning mechanism is not straightforward, hence in situ electro-optical measurements are challenging. In this work, we implement an open-source MATLAB-controlled real-time performance characterization system consisting of an inexpensive linear variable filter (LVF) and mid-wave infrared camera, capable of switching the PCM-based filters while simultaneously recording in situ filter performance metrics and spectral filtering profile. These metrics are calculated through pixel intensity measurements and displayed on a custom-developed graphical user interface in real-time. The CWL is determined through spatial position of intensity maxima along the LVF's longitudinal axis. Furthermore, plans are detailed for a future experimental system that further reduces cost, is compact, and utilizes a near-infrared camera.


title: Surface Processing and Discharge-Conditioning of High Voltage Electrodes for the Ra EDM Experiment

abstract: The Ra EDM experiment uses a pair of high voltage electrodes to search for the atomic electric dipole moment of $^{225}$Ra. We use identical, plane-parallel electrodes with a primary high gradient surface of 200 mm$^2$ to generate reversible DC electric fields. Our statistical sensitivity is linearly proportional to the electric field strength in the electrode gap. We adapted surface decontamination and processing techniques from accelerator physics literature to chemical polish and clean a suite of newly fabricated large-grain niobium and grade-2 titanium electrodes. Three pairs of niobium electrodes and one pair of titanium electrodes were discharge-conditioned with a custom high voltage test station at electric field strengths as high as $+52.5$ kV/mm and $-51.5$ kV/mm over electrode gap sizes ranging from 0.4 mm to 2.5 mm. One pair of large-grain niobium electrodes was discharge-conditioned and validated to operate at $\pm 20$ kV/mm with steady-state leakage current $\leq 25$ pA ($1\sigma$) and a polarity-averaged $98 \pm 19$ discharges per hour. These electrodes were installed in the Ra EDM experimental apparatus, replacing a copper electrode pair, and were revalidated to $\pm 20$ kV/mm. The niobium electrodes perform at an electric field strength 3.1 times larger than the legacy copper electrodes and are ultimately limited by the maximum output of our 30 kV bipolar power supply.


title: Energy stability of the Charney-DeVore quasi-geostrophic equation for atmospheric blocking

abstract: Charney and DeVore [J. Atmos. Sci. 36 (1979), 1205-1216] found multiple equilibrium states as a consequence of bottom topography in their pioneering work on the quasi-geostrophic barotropic flow over topography in a $\beta$-plane channel. In the present paper, we prove that the basic flow is asymptotically stable in a parameter region, including the flat topography situation, which excludes the existence of multiple equilibrium states therein. Moreover, we show that an additional condition on the average zonal force or the average zonal velocity is indispensable to the well-posedness of the Charney-DeVore quasi-geostrophic equation. Coexistence of at least three equilibrium states is confirmed by a pseudo-arclength continuation method for different topographic amplitudes. The stabilities of the equilibrium states are examined by high-resolution direct numerical simulations.


title: Jointly Learning Clinical Entities and Relations with Contextual Language Models and Explicit Context

abstract: We hypothesize that explicit integration of contextual information into an Multi-task Learning framework would emphasize the significance of context for boosting performance in jointly learning Named Entity Recognition (NER) and Relation Extraction (RE). Our work proves this hypothesis by segmenting entities from their surrounding context and by building contextual representations using each independent segment. This relation representation allows for a joint NER/RE system that achieves near state-of-the-art (SOTA) performance on both NER and RE tasks while beating the SOTA RE system at end-to-end NER & RE with a 49.07 F1.


title: Performance of Automatic De-identification Across Different Note Types

abstract: Free-text clinical notes detail all aspects of patient care and have great potential to facilitate quality improvement and assurance initiatives as well as advance clinical research. However, concerns about patient privacy and confidentiality limit the use of clinical notes for research. As a result, the information documented in these notes remains unavailable for most researchers. De-identification (de-id), i.e., locating and removing personally identifying protected health information (PHI), is one way of improving access to clinical narratives. However, there are limited off-the-shelf de-identification systems able to consistently detect PHI across different data sources and medical specialties. In this abstract, we present the performance of a state-of-the art de-id system called NeuroNER1 on a diverse set of notes from University of Washington (UW) when the models are trained on data from an external institution (Partners Healthcare) vs. from the same institution (UW). We present results at the level of PHI and note types.


title: IFoodCloud: A Platform for Real-time Sentiment Analysis of Public Opinion about Food Safety in China

abstract: The Internet contains a wealth of public opinion on food safety, including views on food adulteration, food-borne diseases, agricultural pollution, irregular food distribution, and food production issues. In order to systematically collect and analyse public opinion on food safety, we developed IFoodCloud, a platform for the real-time sentiment analysis of public opinion on food safety in China. It collects data from more than 3,100 public sources that can be used to explore public opinion trends, public sentiment, and regional attention differences of food safety incidents. At the same time, we constructed a sentiment classification model using multiple lexicon-based and deep learning-based algorithms integrated with IFoodCloud that provide an unprecedented rapid means of understanding the public sentiment toward specific food safety incidents. Our best model's F1-score achieved 0.9737. Further, three real-world cases are presented to demonstrate the application and robustness. IFoodCloud could be considered a valuable tool for promote scientisation of food safety supervision and risk communication.


title: Periodic Orbit can be Evolutionarily Stable: Case Study of Discrete Replicator Dynamics

abstract: In evolutionary game theory, it is customary to be partial to the dynamical models possessing fixed points so that they may be understood as the attainment of evolutionary stability, and hence, Nash equilibrium. Any show of periodic or chaotic solution is many a time perceived as a shortcoming of the corresponding game dynamic because (Nash) equilibrium play is supposed to be robust and persistent behaviour, and any other behaviour in nature is deemed transient. Consequently, there is a lack of attempt to connect the non-fixed point solutions with the game theoretic concepts. Here we provide a way to render game theoretic meaning to periodic solutions. To this end, we consider a replicator map that models Darwinian selection mechanism in unstructured infinite-sized population whose individuals reproduce asexually forming non-overlapping generations. This is one of the simplest evolutionary game dynamic that exhibits periodic solutions giving way to chaotic solutions (as parameters related to reproductive fitness change) and also obeys the folk theorems connecting fixed point solutions with Nash equilibrium. Interestingly, we find that a modified Darwinian fitness -- termed heterogeneity payoff -- in the corresponding population game must be put forward as (conventional) fitness times the probability that two arbitrarily chosen individuals of the population adopt two different strategies. The evolutionary dynamics proceeds as if the individuals optimize the heterogeneity payoff to reach an evolutionarily stable orbit, should it exist. We rigorously prove that a locally asymptotically stable period orbit must be heterogeneity stable orbit -- a generalization of evolutionarily stable state.


title: Transport Services: A Modern API for an Adaptive Internet Transport Layer

abstract: Transport services (TAPS) is a working group of the Internet's standardization body, the Internet Engineering Task Force (IETF). TAPS defines a new recommended API for the Internet's transport layer. This API gives access to a wide variety of services from various protocols, and it is protocol-independent: the transport layer becomes adaptive, and applications are no longer statically bound to a particular protocol and/or network interface. We give an overview of the TAPS API, and we demonstrate its flexibility and ease of use with an example using a Python-based open-source implementation.


title: Electromagnetic induction: physics, historical breakthroughs, epistemological issues and textbooks

abstract: The discovery of Electromagnetism by Oersted (1820) started an 'extraordinary decennium' ended by the discovery of electromagnetic induction by Faraday (1831). During this decennium, in several experiments, the electromagnetic induction was there, but it was not seen or recognized. Faraday built up a local theory of electromagnetic induction based on the idea that there is an induced current when there is an intersection between lines of magnetic force and a conductor in relative motion. In 1873, Maxwell, within a Lagrangian description of electric currents, wrote down a 'general law of electromagnetic induction' in which a fundamental role is played by the vector potential. A modern reformulation of Maxwell's general law is based on the definition of the induced emf as the line integral of the Lorentz force on a unit positive charge and the use of the equation that relates the electric field to the potentials. Maxwell's general law has been rapidly forgotten; instead, the "flux rule" has deeply taken root. The "flux rule" not always yields the correct prediction, it does not say where the induced emf is localized, it requires ad hoc choices of the integration paths. It is not a physical law but only a calculation tool. To understand why Maxwell's `general law' has been forgotten, also a sample of representative textbooks, distributed over about a century, has been analyzed. In this framework, a part of the paper deals with the idea of rotating lines of magnetic force, falsified by Faraday, but common in the first decades of the Twentieth century and astonishingly resumed recently. It is shown that this hypothesis is incompatible with Maxwell - Lorentz - Einstein electromagnetism and that it is falsified also by recent experiments. Finally, the electromagnetic induction in some recent research papers is briefly discussed.


title: Highly Fast Text Segmentation With Pairwise Markov Chains

abstract: Natural Language Processing (NLP) models' current trend consists of using increasingly more extra-data to build the best models as possible. It implies more expensive computational costs and training time, difficulties for deployment, and worries about these models' carbon footprint reveal a critical problem in the future. Against this trend, our goal is to develop NLP models requiring no extra-data and minimizing training time. To do so, in this paper, we explore Markov chain models, Hidden Markov Chain (HMC) and Pairwise Markov Chain (PMC), for NLP segmentation tasks. We apply these models for three classic applications: POS Tagging, Named-Entity-Recognition, and Chunking. We develop an original method to adapt these models for text segmentation's specific challenges to obtain relevant performances with very short training and execution times. PMC achieves equivalent results to those obtained by Conditional Random Fields (CRF), one of the most applied models for these tasks when no extra-data are used. Moreover, PMC has training times 30 times shorter than the CRF ones, which validates this model given our objectives.


title: Introducing the Hidden Neural Markov Chain framework

abstract: Nowadays, neural network models achieve state-of-the-art results in many areas as computer vision or speech processing. For sequential data, especially for Natural Language Processing (NLP) tasks, Recurrent Neural Networks (RNNs) and their extensions, the Long Short Term Memory (LSTM) network and the Gated Recurrent Unit (GRU), are among the most used models, having a "term-to-term" sequence processing. However, if many works create extensions and improvements of the RNN, few have focused on developing other ways for sequential data processing with neural networks in a "term-to-term" way. This paper proposes the original Hidden Neural Markov Chain (HNMC) framework, a new family of sequential neural models. They are not based on the RNN but on the Hidden Markov Model (HMM), a probabilistic graphical model. This neural extension is possible thanks to the recent Entropic Forward-Backward algorithm for HMM restoration. We propose three different models: the classic HNMC, the HNMC2, and the HNMC-CN. After describing our models' whole construction, we compare them with classic RNN and Bidirectional RNN (BiRNN) models for some sequence labeling tasks: Chunking, Part-Of-Speech Tagging, and Named Entity Recognition. For every experiment, whatever the architecture or the embedding method used, one of our proposed models has the best results. It shows this new neural sequential framework's potential, which can open the way to new models, and might eventually compete with the prevalent BiLSTM and BiGRU.


title: A novel method to calculate the electric field using solid angles

abstract: A new method to calculate the electric field inside a spherical shell with surface charge in terms of solid angle is presented. The integral can be readily carried out without invoking special functions typically used for this classical problem. For a flat surface of uniform charge density, the electric field normal to the surface is shown to be proportional to the solid angle subtended by the surface only.


title: Information and Helical Mechanism of Entropy Increase

abstract: The principle of entropy increase is not only the basis of statistical mechanics, but also closely related to the irreversibility of time, the origin of life, chaos and turbulence. In this paper, we first discuss the dynamic system definition of entropy from the perspective of symbol and partition of information, and propose the entropy transfer characteristics based on the set partition. By introducing the hypothesis of limited accuracy of measurement into the continuous dynamical system, two necessary mechanisms for the formation of chaos are obtained: the transfer of entropy from small scale to macro scale (i.e. the increase of local entropy) and the dissipation of macro information. The relationship between the local entropy increase and Lyapunov exponent of dynamical system is established. And then the entropy increase and abnormal dissipation mechanism in physical system are analyzed and discussed.


title: Tuning the range separation parameter in periodic systems

abstract: Kohn-Sham DFT with optimally tuned range-separated hybrid (RSH) functionals provides accurate and nonempirical fundamental gaps for a wide variety of finite-size systems. The standard tuning procedure relies on calculation of total energies of charged systems and thus cannot be applied to periodic solids. Here, we develop a framework for tuning the range separation parameter that can be used for periodic and open boundary conditions. The basic idea is to choose the range parameter that results in a stationary point where the fundamental gap obtained by RSH matches the gap obtained from a G0W0 over RSH calculation. The proposed framework is therefore analogous to eigenvalue self-consistent GW (scGW). We assess the method for various solids and obtain very good agreement with scGW results.


title: Learning the Subsystem of Local Planning for Autonomous Racing

abstract: The problem of autonomous racing is to navigate through a race course as quickly as possible while not colliding with any obstacles. We approach the autonomous racing problem with the added constraint of not maintaining an updated obstacle map of the environment. Several current approaches to this problem use end-to-end learning systems where an agent replaces the entire navigation pipeline. This paper presents a hierarchical planning architecture that combines a high level planner and path following system with a reinforcement learning agent that learns that subsystem of obstacle avoidance. The novel "modification planner" uses the path follower to track the global plan and the deep reinforcement learning agent to modify the references generated by the path follower to avoid obstacles. Importantly, our architecture does not require an updated obstacle map and only 10 laser range finders to avoid obstacles. The modification planner is evaluated in the context of F1/10th autonomous racing and compared to a end-to-end learning baseline, the Follow the Gap Method and an optimisation based planner. The results show that the modification planner can achieve faster average times compared to the baseline end-to-end planner and a 94% success rate which is similar to the baseline.


title: How are journals cited? characterizing journal citations by type of citation

abstract: Evaluation of journals for quality is one of the dominant themes of bibliometrics since journals are the primary venue of vetting and distribution of scholarship. There are many criticisms of quantifying journal impact with bibliometrics including disciplinary differences among journals, what source materials are used, time windows for the inclusion of works to measure, and skewness of citation distributions (Lariviere & Sugimoto, 2019). However, despite various attempts to remediate these in newly proposed indicators such as SJR, SNIP, and Eigenfactor (Walters, 2017) indicators still remain based on citation counts and fail to acknowledge the critical differences that the type of citation made, whether it's supporting or disputing a work when quantifying journal impact. While various programs have been suggested to apply and encompass citation content analysis within bibliometrics projects, citation content analysis has not been done at the scale needed in order to supplement quantitate journal citation analysis until the scite citation index was produced. Using this citation index containing citation types based on citation function (supporting, disputing, or mentioning) we present initial results on the statistical characterization of citations to journals based on citation function. We also present initial results of characterizing the ratio of supports and disputes received by a journal as a potential indicator of quality and show two interesting results: the ratio of supports and disputes do not correlate with total citations and that the distribution of this ratio is not skewed showing a normal distribution. We conclude with a proposal for future research using citation analysis qualified by citation function as well as the implications of performing bibliometrics tasks such as research evaluation and information retrieval using citation function.


title: A Python toolbox for unbiased statistical analysis of fluorescence intermittency of multi-level emitters

abstract: We report on a Python-toolbox for unbiased statistical analysis of fluorescence intermittency properties of single emitters. Intermittency, i.e., step-wise temporal variations in the instantaneous emission intensity and fluorescence decay rate properties are common to organic fluorophores, II-VI quantum dots and perovskite quantum dots alike. Unbiased statistical analysis of intermittency switching time distributions, involved levels and lifetimes is important to avoid interpretation artefacts. This work provides an implementation of Bayesian changepoint analysis and level clustering applicable to time-tagged single-photon detection data of single emitters that can be applied to real experimental data and as tool to verify the ramifications of hypothesized mechanistic intermittency models. We provide a detailed Monte Carlo analysis to illustrate these statistics tools, and to benchmark the extent to which conclusions can be drawn on the photophysics of highly complex systems, such as perovskite quantum dots that switch between a plethora of states instead of just two.


title: Coupled Contagion: A Two-Fears Epidemic Model

abstract: We present a differential equations model in which contagious disease transmission is affected by contagious fear of the disease and contagious fear of the control, in this case vaccine. The three contagions are coupled. The two fears evolve and interact in ways that shape distancing behavior, vaccine uptake, and their relaxation. These behavioral dynamics in turn can amplify or suppress disease transmission, which feeds back to affect behavior. The model reveals several coupled contagion mechanisms for multiple epidemic waves. Methodologically, the paper advances infectious disease modeling by including human behavioral adaptation, drawing on the neuroscience of fear learning, extinction, and transmission.


title: Gradient-index nanophotonics

abstract: It is demonstrated that a new kind of low-loss surface electromagnetic wave may propagate along a planar surface inside a lossy medium if the medium permittivity changes continuously across such surface. Similar to surface plasmons, the wavelength of this wave may be considerably shorter than the light wavelength in free space, which may enable its applications in super-resolution microscopy and nanolithography techniques. However, unlike plasmonics-based nanophotonic devices, which are typically built using a very limited number of low loss optical materials, the newly found class of surface waves may be supported by a much broader range of lossy media. Such materials as graphite seems to be ideal in UV nanophotonics applications. On the opposite side of the electromagnetic spectrum, similar long-range surface electromagnetic radio waves are capable of propagating underwater along a sandy seabed, which may enable efficient underwater radio communication and imaging.


title: Semantic Parsing to Manipulate Relational Database For a Management System

abstract: Chatbots and AI assistants have claimed their importance in today life. The main reason behind adopting this technology is to connect with the user, understand their requirements, and fulfill them. This has been achieved but at the cost of heavy training data and complex learning models. This work is carried out proposes a simple algorithm, a model which can be implemented in different fields each with its own work scope. The proposed model converts human language text to computer-understandable SQL queries. The model requires data only related to the specific field, saving data space. This model performs linear computation hence solving the computational complexity. This work also defines the stages where a new methodology is implemented and what previous method was adopted to fulfill the requirement at that stage. Two datasets available online will be used in this work, the ATIS dataset, and WikiSQL. This work compares the computation time among the 2 datasets and also compares the accuracy of both. This paper works over basic Natural language processing tasks like semantic parsing, NER, parts of speech and tends to achieve results through these simple methods.


title: JST-RR Model: Joint Modeling of Ratings and Reviews in Sentiment-Topic Prediction

abstract: Analysis of online reviews has attracted great attention with broad applications. Often times, the textual reviews are coupled with the numerical ratings in the data. In this work, we propose a probabilistic model to accommodate both textual reviews and overall ratings with consideration of their intrinsic connection for a joint sentiment-topic prediction. The key of the proposed method is to develop a unified generative model where the topic modeling is constructed based on review texts and the sentiment prediction is obtained by combining review texts and overall ratings. The inference of model parameters are obtained by an efficient Gibbs sampling procedure. The proposed method can enhance the prediction accuracy of review data and achieve an effective detection of interpretable topics and sentiments. The merits of the proposed method are elaborated by the case study from Amazon datasets and simulation studies.


title: Calculating box dimension with the method of types

abstract: This paper presents a general procedure based on using the method of types to calculate the box dimension of sets. The approach unifies and simplifies multiple box counting arguments. In particular, we use it to generalize the formula for the box dimension of self-affine carpets of Gatzouras-Lalley and of Bara\'nski type to their higher dimensional sponge analogues. In addition to a closed form, we also obtain a variational formula which resembles the Ledrappier-Young formula for Hausdorff dimension.


title: Online Learning via Offline Greedy Algorithms: Applications in Market Design and Optimization

abstract: Motivated by online decision-making in time-varying combinatorial environments, we study the problem of transforming offline algorithms to their online counterparts. We focus on offline combinatorial problems that are amenable to a constant factor approximation using a greedy algorithm that is robust to local errors. For such problems, we provide a general framework that efficiently transforms offline robust greedy algorithms to online ones using Blackwell approachability. We show that the resulting online algorithms have $O(\sqrt{T})$ (approximate) regret under the full information setting. We further introduce a bandit extension of Blackwell approachability that we call Bandit Blackwell approachability. We leverage this notion to transform greedy robust offline algorithms into a $O(T^{2/3})$ (approximate) regret in the bandit setting. Demonstrating the flexibility of our framework, we apply our offline-to-online transformation to several problems at the intersection of revenue management, market design, and online optimization, including product ranking optimization in online platforms, reserve price optimization in auctions, and submodular maximization. We also extend our reduction to greedy-like first order methods used in continuous optimization, such as those used for maximizing continuous strong DR monotone submodular functions subject to convex constraints. We show that our transformation, when applied to these applications, leads to new regret bounds or improves the current known bounds. We complement our theoretical studies by conducting numerical simulations for two of our applications, in both of which we observe that the numerical performance of our transformations outperforms the theoretical guarantees in practical instances.


title: Improved Learning of Robot Manipulation Tasks via Tactile Intrinsic Motivation

abstract: In this paper we address the challenge of exploration in deep reinforcement learning for robotic manipulation tasks. In sparse goal settings, an agent does not receive any positive feedback until randomly achieving the goal, which becomes infeasible for longer control sequences. Inspired by touch-based exploration observed in children, we formulate an intrinsic reward based on the sum of forces between a robot's force sensors and manipulation objects that encourages physical interaction. Furthermore, we introduce contact-prioritized experience replay, a sampling scheme that prioritizes contact rich episodes and transitions. We show that our solution accelerates the exploration and outperforms state-of-the-art methods on three fundamental robot manipulation benchmarks.


title: Bose-Einstein Condensation with Optimal Rate for Trapped Bosons in the Gross-Pitaevskii Regime

abstract: We consider a Bose gas consisting of $N$ particles in $\mathbb{R}^3$, trapped by an external field and interacting through a two-body potential with scattering length of order $N^{-1}$. We prove that low energy states exhibit complete Bose-Einstein condensation with optimal rate, generalizing previous work in \cite{BBCS1, BBCS4}, restricted to translation invariant systems. This extends recent results in \cite{NNRT}, removing the smallness assumption on the size of the scattering length.


title: Interpretation of the Area Under the ROC Curve for Risk Prediction Models

abstract: The area under the curve (AUC) of the receiver operating characteristics curve (ROC) evaluates the separation between patients and nonpatients or discrimination. For risk prediction models these risk distributions can be derived from the population risk distribution so are not independent as in diagnosis. A ROC curve AUC formula based on the underlying population risk distribution clarifies how discrimination is defined mathematically and that generation of the equivalent c-statistic effects a Monte Carlo integration of the formula. For a selection of continuous risk distributions, exact analytic formulas or numerical results for the ROC curve AUC and overlap measure are presented and demonstrate a linear or near-linear dependence on their standard deviation. The ROC curve AUC is also shown to be highly dependent on the mean population risk, a distinction from the independence from disease prevalence for diagnostic tests. The converse of discrimination, overlap, has been quantified by the overlap measure, which appears to provide equivalent information. As achieving wider population risk distributions is the goal of risk prediction modeling for clinical risk stratification, interpreting the ROC curve AUC as a measure of dispersion, rather than discrimination, when comparing risk prediction models may be more relevant.


title: Vortex pinning in the superfluid core of relativistic neutron stars

abstract: Our recent Newtonian treatment of the smooth-averaged mutual-friction force acting on the neutron superfluid and locally induced by the pinning of quantized neutron vortices to proton fluxoids in the outer core of superfluid neutron stars is here adapted to the general-relativistic framework. We show how the local nonrelativistic motion of individual vortices can be matched to the global dynamics of the star using the fully 4D covariant Newtonian formalism of Carter & Chamel (2004). We derive all the necessary dynamical equations for carrying out realistic simulations of superfluid rotating neutron stars in full general relativity, as required for the interpretation of pulsar frequency glitches. The role of vortex pinning on the global dynamics appears to be nontrivial.


title: Escaping from Zero Gradient: Revisiting Action-Constrained Reinforcement Learning via Frank-Wolfe Policy Optimization

abstract: Action-constrained reinforcement learning (RL) is a widely-used approach in various real-world applications, such as scheduling in networked systems with resource constraints and control of a robot with kinematic constraints. While the existing projection-based approaches ensure zero constraint violation, they could suffer from the zero-gradient problem due to the tight coupling of the policy gradient and the projection, which results in sample-inefficient training and slow convergence. To tackle this issue, we propose a learning algorithm that decouples the action constraints from the policy parameter update by leveraging state-wise Frank-Wolfe and a regression-based policy update scheme. Moreover, we show that the proposed algorithm enjoys convergence and policy improvement properties in the tabular case as well as generalizes the popular DDPG algorithm for action-constrained RL in the general case. Through experiments, we demonstrate that the proposed algorithm significantly outperforms the benchmark methods on a variety of control tasks.


title: Nested Sampling with Normalising Flows for Gravitational-Wave Inference

abstract: We present a novel method for sampling iso-likelihood contours in nested sampling using a type of machine learning algorithm known as normalising flows and incorporate it into our sampler nessai. Nessai is designed for problems where computing the likelihood is computationally expensive and therefore the cost of training a normalising flow is offset by the overall reduction in the number of likelihood evaluations. We validate our sampler on 128 simulated gravitational wave signals from compact binary coalescence and show that it produces unbiased estimates of the system parameters. Subsequently, we compare our results to those obtained with dynesty and find good agreement between the computed log-evidences whilst requiring 2.07 times fewer likelihood evaluations. We also highlight how the likelihood evaluation can be parallelised in nessai without any modifications to the algorithm. Finally, we outline diagnostics included in nessai and how these can be used to tune the sampler's settings.


title: Hierarchical Graph Representations in Digital Pathology

abstract: Cancer diagnosis, prognosis, and therapy response predictions from tissue specimens highly depend on the phenotype and topological distribution of constituting histological entities. Thus, adequate tissue representations for encoding histological entities is imperative for computer aided cancer patient care. To this end, several approaches have leveraged cell-graphs that encode cell morphology and organization to denote the tissue information. These allow for utilizing machine learning to map tissue representations to tissue functionality to help quantify their relationship. Though cellular information is crucial, it is incomplete alone to comprehensively characterize complex tissue structure. We herein treat the tissue as a hierarchical composition of multiple types of histological entities from fine to coarse level, capturing multivariate tissue information at multiple levels. We propose a novel multi-level hierarchical entity-graph representation of tissue specimens to model hierarchical compositions that encode histological entities as well as their intra- and inter-entity level interactions. Subsequently, a graph neural network is proposed to operate on the hierarchical entity-graph representation to map the tissue structure to tissue functionality. Specifically, for input histology images we utilize well-defined cells and tissue regions to build HierArchical Cell-to-Tissue (HACT) graph representations, and devise HACT-Net, a graph neural network, to classify such HACT representations. As part of this work, we introduce the BReAst Carcinoma Subtyping (BRACS) dataset, a large cohort of H&E stained breast tumor images, to evaluate our proposed methodology against pathologists and state-of-the-art approaches. Through comparative assessment and ablation studies, our method is demonstrated to yield superior classification results compared to alternative methods as well as pathologists.


title: Anyone GAN Sing

abstract: The problem of audio synthesis has been increasingly solved using deep neural networks. With the introduction of Generative Adversarial Networks (GAN), another efficient and adjective path has opened up to solve this problem. In this paper, we present a method to synthesize the singing voice of a person using a Convolutional Long Short-term Memory (ConvLSTM) based GAN optimized using the Wasserstein loss function. Our work is inspired by WGANSing by Chandna et al. Our model inputs consecutive frame-wise linguistic and frequency features, along with singer identity and outputs vocoder features. We train the model on a dataset of 48 English songs sung and spoken by 12 non-professional singers. For inference, sequential blocks are concatenated using an overlap-add procedure. We test the model using the Mel-Cepstral Distance metric and a subjective listening test with 18 participants.


title: A precision on the concept of strict convexity in non-Archimedean analysis

abstract: We prove that the only non-Archimedean strictly convex spaces are the zero space and the one-dimensional linear space over $\, \mathbb{Z}/3\mathbb{Z}$, with any of its trivial norms.


title: Effect of Precursors and Radiation on Soot Formation in Turbulent Diffusion Flame

abstract: Soot formation in Delft flame III, a pilot stabilized turbulent diffusion flame burning natural gas/air, is investigated using ANSYS FLUENT by considering two different approaches for soot inception. In the first approach soot inception is based on the formation rate of acetylene, while the second approach considers the formation rate of two and three-ringed aromatics to describe the soot inception [1]. Transport equations are solved for soot mass fraction and radical nuclei concentration to describe inception, coagulation, surface growth, and oxidation processes. The turbulent-chemistry interactions and soot precursors are described by the steady laminar flamelet model (SLFM). Two chemical mechanisms GRI 3.0 [2] and POLIMI [3] are used to represent the effect of species concentration on soot formation. The radiative properties of the medium are included based on the non-gray modeling approach by considering four factious gases; the weighted sum of gray gas (WSGGM) approach is used to model the absorption coefficient. The effect of soot on radiative transfer is modeled in terms of effective absorption coefficient of the medium. A beta probability density function (\b{eta}-PDF) in terms of normalized temperature is used to describe the effect of turbulence on soot formation. The results clearly elucidate the strong effect of radiation and species concentration on soot volume fraction predictions. Due to increase in radiative heat loss with soot, flame temperature decreases slightly. The inclusion of ethylene has less synergic effect than that of both benzene and ethylene. Both cases have less impact on the nucleation of soot. The increase in soot volume fraction with soot-turbulence interaction is in consistence with the DNS predictions.


title: Aubry-Mather theory on graphs

abstract: We formulate Aubry-Mather theory for Hamiltonians/Lagrangians defined on graphs and discuss its relationship with weak KAM theory developed in [24].


title: On the Effects of Quantisation on Model Uncertainty in Bayesian Neural Networks

abstract: Bayesian neural networks (BNNs) are making significant progress in many research areas where decision-making needs to be accompanied by uncertainty estimation. Being able to quantify uncertainty while making decisions is essential for understanding when the model is over-/under-confident, and hence BNNs are attracting interest in safety-critical applications, such as autonomous driving, healthcare, and robotics. Nevertheless, BNNs have not been as widely used in industrial practice, mainly because of their increased memory and compute costs. In this work, we investigate quantisation of BNNs by compressing 32-bit floating-point weights and activations to their integer counterparts, that has already been successful in reducing the compute demand in standard pointwise neural networks. We study three types of quantised BNNs, we evaluate them under a wide range of different settings, and we empirically demonstrate that a uniform quantisation scheme applied to BNNs does not substantially decrease their quality of uncertainty estimation.


title: Corrigendum to "On the Mazur-Ulam theorem in non-Archimedean fuzzy anti-2-normed spaces"

abstract: In this note we correct a paper by D. Kang ("On the Mazur-Ulam theorem in non-Archimedean fuzzy anti-2-normed spaces", Filomat, 2017). The research in that paper applies to what the author calls strictly convex spaces. Nevertheless, we prove that this notion is void: there is no single space that satisfies the definition.


title: Mathematical modeling of the vascular system

abstract: In this article, we review the mathematical modeling for the vascular system.


title: Low Noise Microwaves for Testing Fundamental Physics

abstract: We studied noise properties of microwave signals transmitted through the cryogenic resonator. The experiments were performed with the 11.342 GHz sapphire loaded cavity resonator cooled to 6.2 K. Based on the measured transmission coefficient of the cryogenic resonator we computed its noise suppression function. This was done via Monte-Carlo simulations some details of which are discussed in this Letter. Next, we measured technical fluctuations of a signal incident on the cryogenic resonator. Having processed these data with the previously computed noise filtering "template" we inferred noise spectra of the transmitted signal. We found that spectral densities of both phase and amplitude fluctuations of the transmitted signal were close to the thermal noise limit of -180 dB/Hz at Fourier frequencies F $\ge$ 10 kHz. Such thermal noise limited microwaves allow more precise tests of special relativity and could be useful at some stages of quantum signal processing.


title: Epidemic spreading under mutually independent intra- and inter-host pathogen evolution

abstract: The dynamics of epidemic spreading is often reduced to the single control parameter $R_0$, whose value, above or below unity, determines the state of the contagion. If, however, the pathogen evolves as it spreads, $R_0$ may change over time, potentially leading to a mutation-driven spread, in which an initially sub-pandemic pathogen undergoes a breakthrough mutation. To predict the boundaries of this pandemic phase, we introduce here a modeling framework to couple the network spreading patterns with the intra-host evolutionary dynamics. For many pathogens these two processes, intra- and inter-host, are driven by different selection forces. And yet here we show that even in the extreme case when these two forces are mutually independent, mutations can still fundamentally alter the pandemic phase-diagram, whose transitions are now shaped, not just by $R_0$, but also by the balance between the epidemic and the evolutionary timescales. If mutations are too slow, the pathogen prevalence decays prior to the appearance of a critical mutation. On the other hand, if mutations are too rapid, the pathogen evolution becomes volatile and, once again, it fails to spread. Between these two extremes, however, we identify a broad range of conditions in which an initially sub-pandemic pathogen can break through to gain widespread prevalence.


title: A Camera free fiber speckle wavemeter

abstract: Recovering the wavelength from disordered speckle patterns has become an exciting prospect as a wavelength measurement method due to its high resolution and simple design. In previous studies, panel cameras have been used to detect the subtle differences between speckle patterns. However, the volume, bandwidth, sensitivity, and cost (in non-visible bands) associated with panel cameras have hindered their utility in broader applications, especially in high speed and low-cost measurements. In this work, we broke the limitations imposed by panel cameras by using a quadrant detector (QD) to capture the speckle images. In the scheme of QD detection, speckle images are directly filtered by convolution, where the kernel is equal to one quarter of a speckle pattern. First, we proposed an up-sampling algorithm to pre-process the QD data. Then a new convolution neural network (CNN) based algorithm, shallow residual network (SRN), was proposed to train the up-sampled images. The experimental results show that a resolution of 4 fm (~ 0.5 MHz) was achieved at 1550nm with an updating speed of ~ 1 kHz. More importantly, the SRN shows excellent robustness. The wavelength can be precisely reconstructed from raw QD data without any averaging, even where there exists apparent noise. The low-cost, simple structure, high speed and robustness of this design promote the speckle-based wavemeter to the industrial grade. In addition, without the restriction of panel cameras, it is believed that this wavemeter opens new routes in many other fields, such as distributed optical fiber sensors, optical communications, and laser frequency stabilization.