title: X-SRL: A Parallel Cross-Lingual Semantic Role Labeling Dataset

abstract: Even though SRL is researched for many languages, major improvements have mostly been obtained for English, for which more resources are available. In fact, existing multilingual SRL datasets contain disparate annotation styles or come from different domains, hampering generalization in multilingual learning. In this work, we propose a method to automatically construct an SRL corpus that is parallel in four languages: English, French, German, Spanish, with unified predicate and role annotations that are fully comparable across languages. We apply high-quality machine translation to the English CoNLL-09 dataset and use multilingual BERT to project its high-quality annotations to the target languages. We include human-validated test sets that we use to measure the projection quality, and show that projection is denser and more precise than a strong baseline. Finally, we train different SOTA models on our novel corpus for mono- and multilingual SRL, showing that the multilingual annotations improve performance especially for the weaker languages.


title: A Novel Actor Dual-Critic Model for Remote Sensing Image Captioning

abstract: We deal with the problem of generating textual captions from optical remote sensing (RS) images using the notion of deep reinforcement learning. Due to the high inter-class similarity in reference sentences describing remote sensing data, jointly encoding the sentences and images encourages prediction of captions that are semantically more precise than the ground truth in many cases. To this end, we introduce an Actor Dual-Critic training strategy where a second critic model is deployed in the form of an encoder-decoder RNN to encode the latent information corresponding to the original and generated captions. While all actor-critic methods use an actor to predict sentences for an image and a critic to provide rewards, our proposed encoder-decoder RNN guarantees high-level comprehension of images by sentence-to-image translation. We observe that the proposed model generates sentences on the test data highly similar to the ground truth and is successful in generating even better captions in many critical cases. Extensive experiments on the benchmark Remote Sensing Image Captioning Dataset (RSICD) and the UCM-captions dataset confirm the superiority of the proposed approach in comparison to the previous state-of-the-art where we obtain a gain of sharp increments in both the ROUGE-L and CIDEr measures.


title: Solutions to a nonlinear Maxwell equation with two competing nonlinearities in $\mathbb{R}^3$

abstract: We are interested in the nonlinear, time-harmonic Maxwell equation $$ \nabla \times (\nabla \times \mathbf{E} ) + V(x) \mathbf{E} = h(x, \mathbf{E})\mbox{ in } \mathbb{R}^3 $$ with sign-changing nonlinear term $h$, i.e. we assume that $h$ is of the form $$ h(x, \alpha w) = f(x, \alpha) w - g(x, \alpha) w $$ for $w \in \mathbb{R}^3$, $|w|=1$ and $\alpha \in \mathbb{R}$. In particular, we can consider the nonlinearity consisting of two competing powers $h(x, \mathbf{E}) = |\mathbf{E}|^{p-2}\mathbf{E} - |\mathbf{E}|^{q-2}\mathbf{E}$ with $2 < q < p < 6$. Under appriopriate assumptions, we show that weak, cylindrically equivariant solutions of the special form are in one-to-one correspondence with weak solutions to a Schr\"odinger equation with a singular potential. Using this equivalence result we show the existence of the least energy solution among cylindrically equivariant solutions of the particular form to the Maxwell equation, as well as to the Schr\"odinger equation.


title: Evidence for a gapless Dirac spin-liquid ground state in a spin-3/2 triangular-lattice antiferromagnet

abstract: We report a comprehensive investigation of the magnetism of the $S$ = 3/2 triangular-lattice antiferromagnet, $\alpha$-CrOOH(D) (delafossites green-grey powder). The nearly Heisenberg antiferromagnetic Hamiltonian ($J_1$ $\sim$ 23.5 K) with a weak single-ion anisotropy of $|D|$/$J_1$ $\sim$ 4.6% is quantitatively determined by fitting to the electron spin resonance (ESR) linewidth and susceptibility measured at high temperatures. The weak single-ion anisotropy interactions, possibly along with other perturbations, e.g. next-nearest-neighbor interactions, suppress the long-range magnetic order and render the system disordered, as evidenced by both the absence of any clear magnetic reflections in neutron diffraction and the presence of the dominant paramagnetic ESR signal down to 2 K ($\sim$ 0.04$J_1$$S^2$), where the magnetic entropy is almost zero. The power-law behavior of specific heat ($C_m$ $\sim$ $T^{2.2}$) observed below the freezing temperature of $T_f$ = 25 K in $\alpha$-CrOOH or below $T_f$ = 22 K in $\alpha$-CrOOD is insensitive to the external magnetic field, and thus is consistent with the theoretical prediction of a gapless U(1) Dirac quantum spin liquid (QSL) ground state. At low temperatures, the spectral weight of the low-energy continuous spin excitations accumulates at the K points of the Brillouin zone, e.g. $|\mathbf{Q}|$ = 4$\pi$/(3$a$), and the putative Dirac cones are clearly visible. Our work is a first step towards the understanding of the possible Dirac QSL ground state in this triangular-lattice magnet with $S$ = 3/2.


title: Enhancing Haptic Distinguishability of Surface Materials with Boosting Technique

abstract: Discriminative features are crucial for several learning applications, such as object detection and classification. Neural networks are extensively used for extracting discriminative features of images and speech signals. However, the lack of large datasets in the haptics domain often limits the applicability of such techniques. This paper presents a general framework for the analysis of the discriminative properties of haptic signals. We demonstrate the effectiveness of spectral features and a boosted embedding technique in enhancing the distinguishability of haptic signals. Experiments indicate our framework needs less training data, generalizes well for different predictors, and outperforms the related state-of-the-art.


title: Second-order discontinuous Galerkin flood model: comparison with industry-standard finite volume models

abstract: Finite volume (FV) numerical solvers of the two-dimensional shallow water equations are core to industry-standard flood models. The second-order Discontinuous Galerkin (DG2) alternative, although a viable way forward to improve current FV-based flood models, is yet under-studied and rarely used to support flood modelling applications. This paper systematically explores and compares the predictive properties of a robust DG2 flood model to those of prominent FV-based industrial flood models. To identify the simplest and most efficient DG2 configuration suitable for flood inundation modelling, two variants - with and without local slope limiting - are considered. The numerical conservation properties of the DG2 variants are compared to those of a first-order FV (FV1) and a second-order FV (FV2) counterparts. The DG2 variants are then tested over five realistic flooding scenarios, recommended by the UK Environment Agency to validate 2D flood model capabilities, while comparing their performance against that of four FV-based commercial models (i.e. TUFLOW-FV1, TUFLOW-FV2, TUFLOW-HPC and Infoworks ICM). Results reveal that the DG2 variant without local limiting (DG2-NL) is capable to simulate shockless flood flows featured in a wide range of flood modelling applications. The DG2-NL shows closer predictions to commercial model outputs at twice-coarser spatial resolution, and can run twice faster to produce more informative hydrograph with small-scale transients over long-range simulations, even when the sampling is far away from the flooding source.


title: Assessing Robustness of Text Classification through Maximal Safe Radius Computation

abstract: Neural network NLP models are vulnerable to small modifications of the input that maintain the original meaning but result in a different prediction. In this paper, we focus on robustness of text classification against word substitutions, aiming to provide guarantees that the model prediction does not change if a word is replaced with a plausible alternative, such as a synonym. As a measure of robustness, we adopt the notion of the maximal safe radius for a given input text, which is the minimum distance in the embedding space to the decision boundary. Since computing the exact maximal safe radius is not feasible in practice, we instead approximate it by computing a lower and upper bound. For the upper bound computation, we employ Monte Carlo Tree Search in conjunction with syntactic filtering to analyse the effect of single and multiple word substitutions. The lower bound computation is achieved through an adaptation of the linear bounding techniques implemented in tools CNN-Cert and POPQORN, respectively for convolutional and recurrent network models. We evaluate the methods on sentiment analysis and news classification models for four datasets (IMDB, SST, AG News and NEWS) and a range of embeddings, and provide an analysis of robustness trends. We also apply our framework to interpretability analysis and compare it with LIME.


title: Gender prediction using limited Twitter Data

abstract: Transformer models have shown impressive performance on a variety of NLP tasks. Off-the-shelf, pre-trained models can be fine-tuned for specific NLP classification tasks, reducing the need for large amounts of additional training data. However, little research has addressed how much data is required to accurately fine-tune such pre-trained transformer models, and how much data is needed for accurate prediction. This paper explores the usability of BERT (a Transformer model for word embedding) for gender prediction on social media. Forensic applications include detecting gender obfuscation, e.g. males posing as females in chat rooms. A Dutch BERT model is fine-tuned on different samples of a Dutch Twitter dataset labeled for gender, varying in the number of tweets used per person. The results show that finetuning BERT contributes to good gender classification performance (80% F1) when finetuned on only 200 tweets per person. But when using just 20 tweets per person, the performance of our classifier deteriorates non-steeply (to 70% F1). These results show that even with relatively small amounts of data, BERT can be fine-tuned to accurately help predict the gender of Twitter users, and, consequently, that it is possible to determine gender on the basis of just a low volume of tweets. This opens up an operational perspective on the swift detection of gender.


title: Interpretable Machine Learning for COVID-19: An Empirical Study on Severity Prediction Task

abstract: The black-box nature of machine learning models hinders the deployment of some high-accuracy models in medical diagnosis. It is risky to put one's life in the hands of models that medical researchers do not fully understand. However, through model interpretation, black-box models can promptly reveal significant biomarkers that medical practitioners may have overlooked due to the surge of infected patients in the COVID-19 pandemic. This research leverages a database of 92 patients with confirmed SARS-CoV-2 laboratory tests between 18th Jan. 2020 and 5th Mar. 2020, in Zhuhai, China, to identify biomarkers indicative of severity prediction. Through the interpretation of four machine learning models, decision tree, random forests, gradient boosted trees, and neural networks using permutation feature importance, Partial Dependence Plot (PDP), Individual Conditional Expectation (ICE), Accumulated Local Effects (ALE), Local Interpretable Model-agnostic Explanations (LIME), and Shapley Additive Explanation (SHAP), we identify an increase in N-Terminal pro-Brain Natriuretic Peptide (NTproBNP), C-Reaction Protein (CRP), and lactic dehydrogenase (LDH), a decrease in lymphocyte (LYM) is associated with severe infection and an increased risk of death, which is consistent with recent medical research on COVID-19 and other research using dedicated models. We further validate our methods on a large open dataset with 5644 confirmed patients from the Hospital Israelita Albert Einstein, at S\~ao Paulo, Brazil from Kaggle, and unveil leukocytes, eosinophils, and platelets as three indicative biomarkers for COVID-19.


title: Ensembles of Convolutional Neural Networks models for pediatric pneumonia diagnosis

abstract: Pneumonia is a lung infection that causes 15% of childhood mortality, over 800,000 children under five every year, all over the world. This pathology is mainly caused by viruses or bacteria. X-rays imaging analysis is one of the most used methods for pneumonia diagnosis. These clinical images can be analyzed using machine learning methods such as convolutional neural networks (CNN), which learn to extract critical features for the classification. However, the usability of these systems is limited in medicine due to the lack of interpretability, because of these models cannot be used to generate an understandable explanation (from a human-based perspective), about how they have reached those results. Another problem that difficults the impact of this technology is the limited amount of labeled data in many medicine domains. The main contributions of this work are two fold: the first one is the design of a new explainable artificial intelligence (XAI) technique based on combining the individual heatmaps obtained from each model in the ensemble. This allows to overcome the explainability and interpretability problems of the CNN "black boxes", highlighting those areas of the image which are more relevant to generate the classification. The second one is the development of new ensemble deep learning models to classify chest X-rays that allow highly competitive results using small datasets for training. We tested our ensemble model using a small dataset of pediatric X-rays (950 samples) with low quality and anatomical variability (which represents one of the biggest challenges). We also tested other strategies such as single CNNs trained from scratch and transfer learning using CheXNet. Our results show that our ensemble model outperforms these strategies obtaining highly competitive results. Finally, we confirmed the robustness of our approach using another pneumonia diagnosis dataset [1].


title: A frequency-dependent $p$-adaptive technique for spectral methods

abstract: When using spectral methods, a question arises as how to determine the expansion order, especially for time-dependent problems in which emerging oscillations may require adjusting the expansion order. In this paper, we propose a frequency-dependent $p$-adaptive technique that adaptively adjusts the expansion order based on a frequency indicator. Using this $p$-adaptive technique, combined with recently proposed scaling and moving techniques, we are able to devise an adaptive spectral method in unbounded domains that can capture and handle diffusion, advection, and oscillations. As an application, we use this adaptive spectral method to numerically solve the Schr\"{o}dinger equation in the whole domain and successfully capture the solution's oscillatory behavior at infinity.


title: Stochastic completeness of graphs: bounded Laplacians, intrinsic metrics, volume growth and curvature

abstract: The goal of this article is to survey various results concerning stochastic completeness of graphs. In particular, we present a variety of formulations of stochastic completeness and discuss how a discrepancy between uniqueness class and volume growth criteria in the continuous and discrete settings was ultimately resolved via the use of intrinsic metrics. Along the way, we discuss some equivalent notions of boundedness in the sense of geometry and of analysis. We also discuss various curvature criteria for stochastic completeness and discuss how weakly spherically symmetric graphs establish the sharpness of results.


title: Zero-Shot Clinical Acronym Expansion via Latent Meaning Cells

abstract: We introduce Latent Meaning Cells, a deep latent variable model which learns contextualized representations of words by combining local lexical context and metadata. Metadata can refer to granular context, such as section type, or to more global context, such as unique document ids. Reliance on metadata for contextualized representation learning is apropos in the clinical domain where text is semi-structured and expresses high variation in topics. We evaluate the LMC model on the task of zero-shot clinical acronym expansion across three datasets. The LMC significantly outperforms a diverse set of baselines at a fraction of the pre-training cost and learns clinically coherent representations. We demonstrate that not only is metadata itself very helpful for the task, but that the LMC inference algorithm provides an additional large benefit.


title: A Physics-Informed Machine Learning Approach for Solving Heat Transfer Equation in Advanced Manufacturing and Engineering Applications

abstract: A physics-informed neural network is developed to solve conductive heat transfer partial differential equation (PDE), along with convective heat transfer PDEs as boundary conditions (BCs), in manufacturing and engineering applications where parts are heated in ovens. Since convective coefficients are typically unknown, current analysis approaches based on trial and error finite element (FE) simulations are slow. The loss function is defined based on errors to satisfy PDE, BCs and initial condition. An adaptive normalizing scheme is developed to reduce loss terms simultaneously. In addition, theory of heat transfer is used for feature engineering. The predictions for 1D and 2D cases are validated by comparing with FE results. It is shown that using engineered features, heat transfer beyond the training zone can be predicted. Trained model allows for fast evaluation of a range of BCs to develop feedback loops, realizing Industry 4.0 concept of active manufacturing control based on sensor data.


title: Deep Representational Similarity Learning for analyzing neural signatures in task-based fMRI dataset

abstract: Similarity analysis is one of the crucial steps in most fMRI studies. Representational Similarity Analysis (RSA) can measure similarities of neural signatures generated by different cognitive states. This paper develops Deep Representational Similarity Learning (DRSL), a deep extension of RSA that is appropriate for analyzing similarities between various cognitive tasks in fMRI datasets with a large number of subjects, and high-dimensionality -- such as whole-brain images. Unlike the previous methods, DRSL is not limited by a linear transformation or a restricted fixed nonlinear kernel function -- such as Gaussian kernel. DRSL utilizes a multi-layer neural network for mapping neural responses to linear space, where this network can implement a customized nonlinear transformation for each subject separately. Furthermore, utilizing a gradient-based optimization in DRSL can significantly reduce runtime of analysis on large datasets because it uses a batch of samples in each iteration rather than all neural responses to find an optimal solution. Empirical studies on multi-subject fMRI datasets with various tasks -- including visual stimuli, decision making, flavor, and working memory -- confirm that the proposed method achieves superior performance to other state-of-the-art RSA algorithms.


title: Towards ML Engineering: A Brief History Of TensorFlow Extended (TFX)

abstract: Software Engineering, as a discipline, has matured over the past 5+ decades. The modern world heavily depends on it, so the increased maturity of Software Engineering was an eventuality. Practices like testing and reliable technologies help make Software Engineering reliable enough to build industries upon. Meanwhile, Machine Learning (ML) has also grown over the past 2+ decades. ML is used more and more for research, experimentation and production workloads. ML now commonly powers widely-used products integral to our lives. But ML Engineering, as a discipline, has not widely matured as much as its Software Engineering ancestor. Can we take what we have learned and help the nascent field of applied ML evolve into ML Engineering the way Programming evolved into Software Engineering [1]? In this article we will give a whirlwind tour of Sibyl [2] and TensorFlow Extended (TFX) [3], two successive end-to-end (E2E) ML platforms at Alphabet. We will share the lessons learned from over a decade of applied ML built on these platforms, explain both their similarities and their differences, and expand on the shifts (both mental and technical) that helped us on our journey. In addition, we will highlight some of the capabilities of TFX that help realize several aspects of ML Engineering. We argue that in order to unlock the gains ML can bring, organizations should advance the maturity of their ML teams by investing in robust ML infrastructure and promoting ML Engineering education. We also recommend that before focusing on cutting-edge ML modeling techniques, product leaders should invest more time in adopting interoperable ML platforms for their organizations. In closing, we will also share a glimpse into the future of TFX.


title: Self-Supervised Variational Auto-Encoders

abstract: Density estimation, compression and data generation are crucial tasks in artificial intelligence. Variational Auto-Encoders (VAEs) constitute a single framework to achieve these goals. Here, we present a novel class of generative models, called self-supervised Variational Auto-Encoder (selfVAE), that utilizes deterministic and discrete variational posteriors. This class of models allows to perform both conditional and unconditional sampling, while simplifying the objective function. First, we use a single self-supervised transformation as a latent variable, where a transformation is either downscaling or edge detection. Next, we consider a hierarchical architecture, i.e., multiple transformations, and we show its benefits compared to the VAE. The flexibility of selfVAE in data reconstruction finds a particularly interesting use case in data compression tasks, where we can trade-off memory for better data quality, and vice-versa. We present performance of our approach on three benchmark image data (Cifar10, Imagenette64, and CelebA).


title: Combined Hapto-Visual and Auditory Rendering of Cultural Heritage Objects

abstract: In this work, we develop a multi-modal rendering framework comprising of hapto-visual and auditory data. The prime focus is to haptically render point cloud data representing virtual 3-D models of cultural significance and also to handle their affine transformations. Cultural heritage objects could potentially be very large and one may be required to render the object at various scales of details. Further, surface effects such as texture and friction are incorporated in order to provide a realistic haptic perception to the users. Moreover, the proposed framework includes an appropriate sound synthesis to bring out the acoustic properties of the object. It also includes a graphical user interface with varied options such as choosing the desired orientation of 3-D objects and selecting the desired level of spatial resolution adaptively at runtime. A fast, point proxy-based haptic rendering technique is proposed with proxy update loop running 100 times faster than the required haptic update frequency of 1 kHz. The surface properties are integrated in the system by applying a bilateral filter on the depth data of the virtual 3-D models. Position dependent sound synthesis is incorporated with the incorporation of appropriate audio clips.


title: On Free Energy for Deformed JT Gravity

abstract: In this paper, we study a particular deformation of the Jackiw-Teitelboim gravity recently considered by Maxfield, Turiaci and independently by Witten. We will compute the partition function of this model as well as its higher order correlators to all orders in genus expansion in the low temperature limit for small perturbations. In this limit, the results match with those obtained from the Airy limit of a Hermitian random matrix ensemble. Using this result, we will also study the free energy of the model. One observes that although the annealed free energy has pathological behaviors, under certain assumptions, the quenched free energy evaluated by replica trick exhibits the desired properties at low temperatures.


title: Synchronizer-Free Digital Link Controller

abstract: This work presents a producer-consumer link between two independent clock domains. The link allows for metastability-free, low-latency, high-throughput communication by slight adjustments to the clock frequencies of the producer and consumer domains steered by a controller circuit. Any such controller cannot deterministically avoid, detect, nor resolve metastability. Typically, this is addressed by synchronizers, incurring a larger dead time in the control loop. We follow the approach of Friedrichs et al. (TC 2018) who proposed metastability-containing circuits. The result is a simple control circuit that may become metastable, yet deterministically avoids buffer underrun or overflow. More specifically, the controller output may become metastable, but this may only affect oscillator speeds within specific bounds. In contrast, communication is guaranteed to remain metastability-free. We formally prove correctness of the producer-consumer link and a possible implementation that has only small overhead. With SPICE simulations of the proposed implementation we further substantiate our claims. The simulation uses 65nm process running at roughly 2GHz.


title: Gravitational spin-orbit and aligned spin$_1$-spin$_2$ couplings through third-subleading post-Newtonian orders

abstract: The study of scattering encounters continues to provide new insights into the general relativistic two-body problem. The local-in-time conservative dynamics of an aligned-spin binary, for both unbound and bound orbits, is fully encoded in the gauge-invariant scattering-angle function, which is most naturally expressed in a post-Minkowskian (PM) expansion, and which exhibits a remarkably simple dependence on the masses of the two bodies (in terms of appropriate geometric variables). This dependence links the PM and small-mass-ratio approximations, allowing gravitational self-force results to determine new post-Newtonian (PN) information to all orders in the mass ratio. In this paper, we exploit this interplay between relativistic scattering and self-force theory to obtain the third-subleading (4.5PN) spin-orbit dynamics for generic spins, and the third-subleading (5PN) spin$_1$-spin$_2$ dynamics for aligned spins. We further implement these novel PN results in an effective-one-body framework, and demonstrate the improvement in accuracy by comparing against numerical-relativity simulations.


title: Fast Vacuum Fluctuations and the Emergence of Quantum Mechanics

abstract: Fast moving classical variables can generate quantum mechanical behavior. We demonstrate how this can happen in a model. The key point is that in classically (ontologically) evolving systems one can still define a conserved quantum energy. For the fast variables, the energy levels are far separated, such that one may assume these variables to stay in their ground state. This forces them to be entangled, so that, consequently, the slow variables are entangled as well. The fast variables could be the vacuum fluctuations caused by unknown super heavy particles. The emerging quantum effects in the light particles are expressed by a Hamiltonian that can have almost any form. The entire system is ontological, and yet allows one to generate interference effects in computer models. This seemed to lead to an unsolvable paradox, which is now resolved: exactly what happens in our models if we run a quantum interference experiment in a classical computer is explained. The restriction that very fast variables stay predominantly in their ground state appears to be due to smearing of the physical states in the time direction, preventing their direct detection. Discussions are added of the emergence of quantum mechanics, and the ontology of an EPR/Bell Gedanken experiment.


title: Convolution of Persistence Modules

abstract: We conduct a study of real-valued multi-parameter persistence modules as sheaves and cosheaves. Using the recent work on the homological algebra for persistence modules, we define two different convolution operations between derived complexes of persistence modules. We show that one of these operations is canonically isomorphic to the derived tensor product of graded modules. We give formulas for computing convolutions between single-parameter interval decomposable modules. Our convolution operations are analogous to the convolution of derived complexes of constructible sheaves on $\mathbb{R}^n$ introduced by Schapira and Kashiwara. In our setting, $\mathbb{R}^n$ has a non-standard topology. We show our convolution operation satisfies analogous properties to the convolution of constructible sheaves on $\mathbb{R}^n$ with the standard topology. We define a convolution distance for derived complexes of persistence modules and show that it extends the classical interleaving distance. We also prove stability results from the sheaf and cosheaf points of view.


title: Numerical Simulation of Iced Wing Using Separating Shear Layer Fixed Turbulence Models

abstract: Aerodynamic prediction of glaze ice accretion on airfoils and wing is studied using the Reynolds-averaged Navier-Stokes method. Two separation fixed turbulence models are developed considering the nonequilibrium characteristics of turbulence. The key ad hoc fix is a term of the local ratio of turbulent production to dissipation, which is used to amplify the destruction term of the {\omega}-equation to increase the eddy viscosity in a separating shear layer of the fully turbulent region. A shear stress limiter is adopted to appropriately simulate the beginning process of the shear layer transition when the turbulence is under development. The proposed separation fixed terms can be easily implemented into current solvers. Two airfoils and a three-dimensional swept wing with ice accretions are numerically tested using the modified models. The results indicate that the separating shear layer fixes improve the ability of the models in predicting the stall behavior at large angles of attack. The simulated averaged flow field and turbulence intensity distribution are consistent with experimental data.


title: An unconventional robust integrator for dynamical low-rank approximation

abstract: We propose and analyse a numerical integrator that computes a low-rank approximation to large time-dependent matrices that are either given explicitly via their increments or are the unknown solution to a matrix differential equation. Furthermore, the integrator is extended to the approximation of time-dependent tensors by Tucker tensors of fixed multilinear rank. The proposed low-rank integrator is different from the known projector-splitting integrator for dynamical low-rank approximation, but it retains the important robustness to small singular values that has so far been known only for the projector-splitting integrator. The new integrator also offers some potential advantages over the projector-splitting integrator: It avoids the backward time integration substep of the projector-splitting integrator, which is a potentially unstable substep for dissipative problems. It offers more parallelism, and it preserves symmetry or anti-symmetry of the matrix or tensor when the differential equation does. Numerical experiments illustrate the behaviour of the proposed integrator.


title: Boosting GWs in Supersolid Inflation

abstract: Inflation driven by a generic self-gravitating medium is an interesting alternative to study the impact of spontaneous spacetime symmetry breaking during a quasi de-Sitter phase, in particular the 4-dimensional diffeomorphism invariance of GR is spontaneously broken down to $ISO(3)$. The effective description is based on four scalar fields that describe the excitations of a supersolid. There are two phonon-like propagating scalar degrees of freedom that mix non-trivially both at early and late times and, after exiting the horizon, give rise to non-trivial correlations among the different scalar power spectra. The non-linear structure of the theory allows a secondary gravitational waves production during inflation, efficient enough to saturate the present experimental bound and with a blue-tilted spectral index.


title: Deep Incomplete Multi-View Multiple Clusterings

abstract: Multi-view clustering aims at exploiting information from multiple heterogeneous views to promote clustering. Most previous works search for only one optimal clustering based on the predefined clustering criterion, but devising such a criterion that captures what users need is difficult. Due to the multiplicity of multi-view data, we can have meaningful alternative clusterings. In addition, the incomplete multi-view data problem is ubiquitous in real world but has not been studied for multiple clusterings. To address these issues, we introduce a deep incomplete multi-view multiple clusterings (DiMVMC) framework, which achieves the completion of data view and multiple shared representations simultaneously by optimizing multiple groups of decoder deep networks. In addition, it minimizes a redundancy term to simultaneously %uses Hilbert-Schmidt Independence Criterion (HSIC) to control the diversity among these representations and among parameters of different networks. Next, it generates an individual clustering from each of these shared representations. Experiments on benchmark datasets confirm that DiMVMC outperforms the state-of-the-art competitors in generating multiple clusterings with high diversity and quality.


title: $q$-Supercongruences with parameters

abstract: In terms of the creative microscoping method recently introduced by Guo and Zudilin [Adv. Math. 346 (2019), 329--358], we find a $q$-supercongruence with four parameters modulo $\Phi_n(q)(1-aq^n)(a-q^n)$, where $\Phi_n(q)$ denotes the $n$-th cyclotomic polynomial in $q$. Then we empoly it and the Chinese remainder theorem for coprime polynomials to derive a $q$-supercongruence with two parameters modulo $[n]\Phi_n(q)^3$, where $[n]=(1-q^n)/(1-q)$ is the $q$-integer.


title: High Aptitude Motor Imagery BCI Users Have Better Visuospatial Memory

abstract: Brain computer interfaces (BCI) decode the electrophysiological signals from the brain into an action that is carried out by a computer or robotic device. Motor imagery BCIs (MI BCI) rely on the user s imagination of bodily movements, however not all users can generate the brain activity needed to control MI BCI. This difference in MI BCI performance among novice users could be due to their cognitive abilities. In this study, the impact of spatial abilities and visuospatial memory on MI BCI performance is investigated. Fifty four novice users participated in a MI BCI task and two cognitive tests. The impact of spatial abilities and visuospatial memory on BCI task error rate in three feedback sessions was measured. Our results showed that spatial abilities, as assessed by the Mental Rotation Test, were not related to MI BCI performance, however visuospatial memory, assessed by the design organization test, was higher in high aptitude users. Our findings can contribute to optimization of MI BCI training paradigms through participant screening and cognitive skill training.


title: Approaching the Full Configuration Interaction Ground State from an Arbitrary Wavefunction with Gradient Descent and Quasi-Newton Algorithms

abstract: We consider gradient descent and quasi-Newton algorithms to optimize the full configuration interaction (FCI) ground state wavefunction starting from an arbitrary reference state $|0 \rangle$. We show that the energies obtained along the optimization path can be evaluated in terms of expectation values of $|0 \rangle$, thus avoiding explicit storage of intermediate wavefunctions. This allows us to find the energies after the first few steps of the FCI algorithm for systems much larger than what standard, deterministic FCI codes can handle at present. We show an application of the algorithm with reference wavefunctions constructed as linear combinations of non-orthogonal determinants.


title: Symplectic structure for general relativity and Einstein-Brillouin-Keller quantization

abstract: The Hamiltonian system of general relativity and its quantization without any matter or gauge fields are discussed on the basis of the symplectic geometrical theory. A symplectic geometry of classical general relativity is constructed using a generalized phase space for pure gravity. Prequantization of the symplectic manifold is performed according to the standard procedure of geometrical quantization. Quantum vacuum solutions are chosen from among the classical solutions under the Einstein-Brillouin-Keller quantization condition. A topological correction of quantum solutions, namely the Maslov index, is realized using a prequantization bundle. In addition, a possible mass spectrum of Schwarzschild black holes is discussed.


title: MCMC-Interactive Variational Inference

abstract: Leveraging well-established MCMC strategies, we propose MCMC-interactive variational inference (MIVI) to not only estimate the posterior in a time constrained manner, but also facilitate the design of MCMC transitions. Constructing a variational distribution followed by a short Markov chain that has parameters to learn, MIVI takes advantage of the complementary properties of variational inference and MCMC to encourage mutual improvement. On one hand, with the variational distribution locating high posterior density regions, the Markov chain is optimized within the variational inference framework to efficiently target the posterior despite a small number of transitions. On the other hand, the optimized Markov chain with considerable flexibility guides the variational distribution towards the posterior and alleviates its underestimation of uncertainty. Furthermore, we prove the optimized Markov chain in MIVI admits extrapolation, which means its marginal distribution gets closer to the true posterior as the chain grows. Therefore, the Markov chain can be used separately as an efficient MCMC scheme. Experiments show that MIVI not only accurately and efficiently approximates the posteriors but also facilitates designs of stochastic gradient MCMC and Gibbs sampling transitions.


title: Analysis of soliton gas with large-scale video-based wave measurements

abstract: An experimental procedure for studying soliton gases in shallow water is devised. Nonlinear waves propagate at constant depth in a 34\,m-long wave flume. At one end of the flume, the waves are generated by a piston-type wave-maker. The opposite end is a vertical wall. Wave interactions are recorded with a video system using seven side-looking cameras with a pixel resolution of 1\,mm, covering 14\,m of the flume. The accuracy in the detection of the water surface elevation is shown to be better than 0.1 mm. A continuous monochromatic forcing can lead to a random state such as a soliton gas. The measured wave field is separated into right- and left-propagating waves in the Radon space and solitary pulses are identified as solitons of KdV or Rayleigh types. Both weak and strong interactions of solitons are detected. These interactions induce phase shifts that constitute the seminal mechanism for disorganization and soliton gas formation.


title: Rapid online solid-state battery diagnostics with optically pumped magnetometers

abstract: Solid state battery technology is motivated by the desire to deliver flexible power storage in a safe and efficient manner. The increasingly widespread use of batteries from mass-production facilities highlights the need for a rapid and sensitive diagnostic for identifying battery defects. We demonstrate the use of atomic magnetometry to measure the magnetic fields around miniature solid-state battery cells. These fields encode information about battery manufacturing defects, state of charge, impurities, or can provide important insights into ageing processes. Compared with SQUID-based magnetometry, the availability of atomic magnetometers, however, highlights the possibility for a low-cost, portable, and flexible implementation of battery quality-control and characterization technology.


title: Small-signal parameters extraction and noise analysis of CNTFETs

abstract: The use of carbon nanotube (CNT) field-effect transistors (FETs) in microwave circuit design requires an appropriate, immediate and efficient description of their performance. This work describes a technique to extract the parameters of an electrical equivalent circuit for CNTFETs. The equivalent circuit is used to model the dynamic and noise performance at low- and high-frequency of different CNTFET technologies, considering extrinsic and intrinsic device parameters as well as the contact resistance. The estimation of the contact resistance at the metal/CNTs interfaces is obtained from a Y-function based extraction method. The noise model includes four noise sources: thermal noise, thermal channel noise, shot channel noise and flicker noise. The proposed model is compared with a compact model calibrated to hysteresis-free experimental data from a high-frequency multi-tube (MT)-CNTFET technology. Additionally, it has been applied to experimental data from another fabricated MT-CNTFET technology. The comparison in both cases shows a good agreement between reference data (simulation and experimental) and results from the proposed model. Low- and high-frequency noise projections of the fabricated reference device are further studied. Noise results from both studied technologies show that shot noise mainly contributes to the total noise due to the presence of Schottky barriers at contacts and along the channel.


title: Single-stage gradient-based stellarator coil design: Optimization for near-axis quasi-symmetry

abstract: We present a new coil design paradigm for magnetic confinement in stellarators. Our approach directly optimizes coil shapes and coil currents to produce a vacuum quasi-symmetric magnetic field with a target rotational transform on the magnetic axis. This approach differs from the traditional two-stage approach in which first a magnetic configuration with desirable physics properties is found, and then coils to approximately realize this magnetic configuration are designed. The proposed single-stage approach allows us to find a compromise between confinement and engineering requirements, i.e., find easy-to-build coils with good confinement properties. Using forward and adjoint sensitivities, we derive derivatives of the physical quantities in the objective, which is constrained by a nonlinear periodic differential equation. In two numerical examples, we compare different gradient-based descent algorithms and find that incorporating approximate second-order derivative information through a quasi-Newton method is crucial for convergence. We also explore the optimization landscape in the neighborhood of a minimizer and find many directions in which the objective is mostly flat, indicating ample freedom to find simple and thus easy-to-build coils.

categories: physics.plasm-ph cs.NA math.NA math.OC physics.comp-ph


title: Fraisse classes with simply characterized big Ramsey degrees

abstract: We formulate a property strengthening the Disjoint Amalgamation Property and prove that every Fraisse structure in a finite relational language with relation symbols of arity at most two having this property has finite big Ramsey degrees which have a simple characterization. It follows that any such Fraisse structure admits a big Ramsey structure. Furthermore, we prove indivisibility for every Fraisse structure in an arbitrary finite relational language satisfying this property. This work offers a streamlined and unifying approach to Ramsey theory on some seemingly disparate classes of Fraisse structures. Novelties include a new formulation of coding trees in terms of 1-types over initial segments of the Fraisse structure, and a direct characterization of the degrees without appeal to the standard method of "envelopes".


title: Sample weighting as an explanation for mode collapse in generative adversarial networks

abstract: Generative adversarial networks were introduced with a logistic MiniMax cost formulation, which normally fails to train due to saturation, and a Non-Saturating reformulation. While addressing the saturation problem, NS-GAN also inverts the generator's sample weighting, implicitly shifting emphasis from higher-scoring to lower-scoring samples when updating parameters. We present both theory and empirical results suggesting that this makes NS-GAN prone to mode dropping. We design MM-nsat, which preserves MM-GAN sample weighting while avoiding saturation by rescaling the MM-GAN minibatch gradient such that its magnitude approximates NS-GAN's gradient magnitude. MM-nsat has qualitatively different training dynamics, and on MNIST and CIFAR-10 it is stronger in terms of mode coverage, stability and FID. While the empirical results for MM-nsat are promising and favorable also in comparison with the LS-GAN and Hinge-GAN formulations, our main contribution is to show how and why NS-GAN's sample weighting causes mode dropping and training collapse.


title: BalaGAN: Image Translation Between Imbalanced Domains via Cross-Modal Transfer

abstract: State-of-the-art image-to-image translation methods tend to struggle in an imbalanced domain setting, where one image domain lacks richness and diversity. We introduce a new unsupervised translation network, BalaGAN, specifically designed to tackle the domain imbalance problem. We leverage the latent modalities of the richer domain to turn the image-to-image translation problem, between two imbalanced domains, into a balanced, multi-class, and conditional translation problem, more resembling the style transfer setting. Specifically, we analyze the source domain and learn a decomposition of it into a set of latent modes or classes, without any supervision. This leaves us with a multitude of balanced cross-domain translation tasks, between all pairs of classes, including the target domain. During inference, the trained network takes as input a source image, as well as a reference or style image from one of the modes as a condition, and produces an image which resembles the source on the pixel-wise level, but shares the same mode as the reference. We show that employing modalities within the dataset improves the quality of the translated images, and that BalaGAN outperforms strong baselines of both unconditioned and style-transfer-based image-to-image translation methods, in terms of image quality and diversity.


title: Conditional Negative Sampling for Contrastive Learning of Visual Representations

abstract: Recent methods for learning unsupervised visual representations, dubbed contrastive learning, optimize the noise-contrastive estimation (NCE) bound on mutual information between two views of an image. NCE uses randomly sampled negative examples to normalize the objective. In this paper, we show that choosing difficult negatives, or those more similar to the current instance, can yield stronger representations. To do this, we introduce a family of mutual information estimators that sample negatives conditionally -- in a "ring" around each positive. We prove that these estimators lower-bound mutual information, with higher bias but lower variance than NCE. Experimentally, we find our approach, applied on top of existing models (IR, CMC, and MoCo) improves accuracy by 2-5% points in each case, measured by linear evaluation on four standard image datasets. Moreover, we find continued benefits when transferring features to a variety of new image distributions from the Meta-Dataset collection and to a variety of downstream tasks such as object detection, instance segmentation, and keypoint detection.


title: A Simple Framework for Uncertainty in Contrastive Learning

abstract: Contrastive approaches to representation learning have recently shown great promise. In contrast to generative approaches, these contrastive models learn a deterministic encoder with no notion of uncertainty or confidence. In this paper, we introduce a simple approach based on "contrasting distributions" that learns to assign uncertainty for pretrained contrastive representations. In particular, we train a deep network from a representation to a distribution in representation space, whose variance can be used as a measure of confidence. In our experiments, we show that this deep uncertainty model can be used (1) to visually interpret model behavior, (2) to detect new noise in the input to deployed models, (3) to detect anomalies, where we outperform 10 baseline methods across 11 tasks with improvements of up to 14% absolute, and (4) to classify out-of-distribution examples where our fully unsupervised model is competitive with supervised methods.


title: Motion-Encoded Particle Swarm Optimization for Moving Target Search Using UAVs

abstract: This paper presents a novel algorithm named the motion-encoded particle swarm optimization (MPSO) for finding a moving target with unmanned aerial vehicles (UAVs). From the Bayesian theory, the search problem can be converted to the optimization of a cost function that represents the probability of detecting the target. Here, the proposed MPSO is developed to solve that problem by encoding the search trajectory as a series of UAV motion paths evolving over the generation of particles in a PSO algorithm. This motion-encoded approach allows for preserving important properties of the swarm including the cognitive and social coherence, and thus resulting in better solutions. Results from extensive simulations with existing methods show that the proposed MPSO improves the detection performance by 24\% and time performance by 4.71 times compared to the original PSO, and moreover, also outperforms other state-of-the-art metaheuristic optimization algorithms including the artificial bee colony (ABC), ant colony optimization (ACO), genetic algorithm (GA), differential evolution (DE), and tree-seed algorithm (TSA) in most search scenarios. Experiments have been conducted with real UAVs in searching for a dynamic target in different scenarios to demonstrate MPSO merits in a practical application.


title: An Efficient Numerical Approach for Solving Two-Point Fractional Order Nonlinear Boundary Value Problems with Robin Boundary Conditions

abstract: This article proposes new strategies for solving two-point Fractional order Nonlinear Boundary Value Problems(FN-BVPs) with Robin Boundary Conditions(RBCs). In the new numerical schemes, a two-point FNBVP is transformed into a system of Fractional order Initial Value Problems(FIVPs) with unknown Initial Conditions(ICs). To approximate ICs in the system of FIVPs, we develop nonlinear shooting methods based on Newton's method and Halley's method using the RBC at the right end point. To deal with FIVPs in a system, we mainly employ High-order Predictor-Corrector Methods(HPCMs) with linear interpolation and quadratic interpolation into Volterra integral equations which are equivalent to FIVPs. The advantage of proposed schemes with HPCMs is that even though they are designed for solving two-point FNBVPs, they can handle both linear and nonlinear two-point Fractional order Boundary Value Problems(FBVPs) with RBCs and have uniform convergence rates of HPCMs, $O(h^2)$ and $O(h^3)$ for shooting techniques with Newton's method and Halley's method, respectively. A variety of numerical examples are demonstrated to confirm the effectiveness and performance of the proposed schemes. Also we compare the accuracy and performance of our schemes with another method.


title: Probabilistic 3D surface reconstruction from sparse MRI information

abstract: Surface reconstruction from magnetic resonance (MR) imaging data is indispensable in medical image analysis and clinical research. A reliable and effective reconstruction tool should: be fast in prediction of accurate well localised and high resolution models, evaluate prediction uncertainty, work with as little input data as possible. Current deep learning state of the art (SOTA) 3D reconstruction methods, however, often only produce shapes of limited variability positioned in a canonical position or lack uncertainty evaluation. In this paper, we present a novel probabilistic deep learning approach for concurrent 3D surface reconstruction from sparse 2D MR image data and aleatoric uncertainty prediction. Our method is capable of reconstructing large surface meshes from three quasi-orthogonal MR imaging slices from limited training sets whilst modelling the location of each mesh vertex through a Gaussian distribution. Prior shape information is encoded using a built-in linear principal component analysis (PCA) model. Extensive experiments on cardiac MR data show that our probabilistic approach successfully assesses prediction uncertainty while at the same time qualitatively and quantitatively outperforms SOTA methods in shape prediction. Compared to SOTA, we are capable of properly localising and orientating the prediction via the use of a spatially aware neural network.


title: Overhaul and Installation of the ICARUS-T600 Liquid Argon TPC Electronics for the FNAL Short Baseline Neutrino Program

abstract: The ICARUS T600 liquid argon (LAr) time projection chamber (TPC) underwent a major overhaul at CERN in 2016-2017 to prepare for the operation at FNAL in the Short Baseline Neutrino (SBN) program. This included a major upgrade of the photo-multiplier system and of the TPC wire read-out electronics. The full TPC wire read-out electronics together with the new wire biasing and interconnection scheme are described. The design of a new signal feed-through flange is also a fundamental piece of this overhaul whose major feature is the integration of all electronics components onto the signal flange. Initial functionality tests of the full TPC electronics chain installed in the T600 detector at FNAL are also described.


title: A Discrete and Continuous Study of the Max-Chain-Formation Problem

abstract: Most existing robot formation problems seek a target formation of a certain \emph{minimal} and, thus, efficient structure. Examples include the Gathering and the Chain-Formation problem. In this work, we study formation problems that try to reach a \emph{maximal} structure, supporting for example an efficient coverage in exploration scenarios. A recent example is the NASA Shapeshifter project, which describes how the robots form a relay chain along which gathered data from extraterrestrial cave explorations may be sent to a home base. As a first step towards understanding such maximization tasks, we introduce and study the Max-Chain-Formation problem, where $n$ robots are ordered along a winding, potentially self-intersecting chain and must form a connected, straight line of maximal length connecting its two endpoints. We propose and analyze strategies in a discrete and in a continuous time model. In the discrete case, we give a complete analysis if all robots are initially collinear, showing that the worst-case time to reach an $\varepsilon$-approximation is upper bounded by $\mathcal{O}(n^2 \cdot \log (n/\varepsilon))$ and lower bounded by $\Omega(n^2 \cdot~\log (1/\varepsilon))$. If one endpoint of the chain remains stationary, this result can be extended to the non-collinear case. If both endpoints move, we identify a family of instances whose runtime is unbounded. For the continuous model, we give a strategy with an optimal runtime bound of $\Theta(n)$. Avoiding an unbounded runtime similar to the discrete case relies crucially on a counter-intuitive aspect of the strategy: slowing down the endpoints while all other robots move at full speed. Surprisingly, we can show that a similar trick does not work in the discrete model.


title: Flat Band Quantum Scar

abstract: We show that a quantum scar state, an atypical eigenstate breaking eigenstate thermalization hypothesis embedded in a many-body energy spectrum, can be constructed in flat band systems. The key idea of our construction is to make use of orthogonal compact localized states. We concretely discuss our construction scheme, taking a saw-tooth flat lattice system as an example, and numerically demonstrate the presence of a quantum scar state. Examples of higher-dimensional systems are also addressed. Our construction method of quantum scar has broad applications to various flat band systems.

categories: cond-mat.quant-gas cond-mat.dis-nn cond-mat.mtrl-sci cond-mat.stat-mech cond-mat.str-el


title: Spectrahedral representation of polar orbitopes

abstract: Let $K$ be a compact Lie group and $V$ a finite-dimensional representation of $K$. The orbitope of a vector $x\in V$ is the convex hull $\mathscr O_x$ of the orbit $Kx$ in $V$. We show that if $V$ is polar then $\mathscr O_x$ is a spectrahedron, and we produce an explicit linear matrix inequality representation. We also consider the coorbitope $\mathscr O_x^o$, which is the convex set polar to $\mathscr O_x$. We prove that $\mathscr O_x^o$ is the convex hull of finitely many $K$-orbits, and we identify the cases in which $\mathscr O_x^o$ is itself an orbitope. In these cases one has $\mathscr O_x^o=c\cdot\mathscr O_x$ with $c>0$. Moreover we show that if $x$ has "rational coefficients" then $\mathscr O_x^o$ is again a spectrahedron. This provides many new families of doubly spectrahedral orbitopes. All polar orbitopes that are derived from classical semisimple Lie can be described in terms of conditions on singular values and Ky Fan matrix norms.


title: A note on parabolic-like maps

abstract: We show that the definition of parabolic-like map can be slightly modified, by asking $\partial \Delta$ to be a quasiarc out of the parabolic fixed point, instead of the dividing arcs to be $C^1$ on $[-1,0]$ and $[0,1]$.


title: Discovering Object-Centric Petri Nets

abstract: Techniques to discover Petri nets from event data assume precisely one case identifier per event. These case identifiers are used to correlate events, and the resulting discovered Petri net aims to describe the life-cycle of individual cases. In reality, there is not one possible case notion, but multiple intertwined case notions. For example, events may refer to mixtures of orders, items, packages, customers, and products. A package may refer to multiple items, multiple products, one order, and one customer. Therefore, we need to assume that each event refers to a collection of objects, each having a type (instead of a single case identifier). Such object-centric event logs are closer to data in real-life information systems. From an object-centric event log, we want to discover an object-centric Petri net with places that correspond to object types and transitions that may consume and produce collections of objects of different types. Object-centric Petri nets visualize the complex relationships among objects from different types. This paper discusses a novel process discovery approach implemented in PM4Py. As will be demonstrated, it is indeed feasible to discover holistic process models that can be used to drill-down into specific viewpoints if needed.


title: cashocs: A Computational, Adjoint-Based Shape Optimization and Optimal Control Software

abstract: The solution of optimization problems constrained by partial differential equations (PDEs) plays an important role in many areas of science and industry. In this work we present cashocs, a new software package written in Python, which automatically solves such problems in the context of optimal control and shape optimization. The software cashocs implements a discretization of the continuous adjoint approach, which derives the necessary adjoint systems and (shape) derivatives in an automated fashion. As cashocs is based on the finite element software FEniCS, it inherits its simple, high-level user interface. This makes it straightforward to define and solve PDE constrained optimization problems with our software. In this paper, we discuss the design and functionalities of cashocs and also demonstrate its straightforward usability and applicability.


title: Electron Dynamics with the Time-Dependent Density Matrix Renormalization Group

abstract: In this work, we simulate the electron dynamics in molecular systems with the Time-Dependent Density Matrix Renormalization Group (TD-DMRG) algorithm. We leverage the generality of the so-called tangent-space TD-DMRG formulation and design a computational framework in which the dynamics is driven by the exact non-relativistic electronic Hamiltonian. We show that, by parametrizing the wave function as a matrix product state, we can accurately simulate the dynamics of systems including up to 20 electrons and 32 orbitals. We apply the TD-DMRG algorithm to three problems that are hardly targeted by time-independent methods: the calculation of molecular (hyper)polarizabilities, the simulation of electronic absorption spectra, and the study of ultrafast ionization dynamics.


title: Sums, products and dilates on sparse graphs

abstract: Let $A \subset \mathbb R$ and $G \subset A \times A$. We prove that, for any $\lambda \in \mathbb R \setminus \{-1,0,1\}$, \[ \max \{|A+_G A|, |A+_G \lambda A|, |A\cdot_G A|\} \gg |G|^{6/11}. \]


title: Feature selection and processing of turbulence modeling based on an artificial neural network

abstract: Data-driven turbulence modeling has been considered an effective method for improving the prediction accuracy of Reynolds-averaged Navier-Stokes equations. Related studies aimed to solve the discrepancy of traditional turbulence modeling by acquiring specific patterns from high-fidelity data through machine learning methods, such as artificial neural networks. The present study focuses on the unsmoothness and prediction error problems from the aspect of feature selection and processing. The selection criteria for the input features are summarized, and an effective input set is constructed. The effect of the computation grid on the smoothness is studied. A modified feature decomposition method for the spatial orientation feature of the Reynolds stress is proposed. The improved machine learning framework is then applied to the periodic hill database with notably varying geometries. The results of the modified method show significant enhancement in the prediction accuracy and smoothness, including the shape and size of separation areas and the friction and pressure distributions on the wall, which confirms the validity of the approach.


title: Fast transient charge trapping in salt-aided CVD synthesized monolayer MoS2 field-effect transistor

abstract: Atomically thin semiconductors have versatile future applications in the information and communication technologies for the ultimate miniaturization of electronic components. In particular, the ongoing research demands not only a large-scale synthesis of pristine quality monolayer MoS2 but also advanced nanofabrication and characterization methods for investigation of intrinsic device performances. Here, we conduct a meticulous investigation of the fast transient charge trapping mechanisms in field-effect transistors (FETs) of high-quality CVD MoS2 monolayers grown by a salt-driven method. To unfold the intrinsic transistor behavior, an amplitude sweep pulse I~V methodology is adapted with varying pulse widths. A significant increase in the field-effect mobility up to ~100% is achieved along with a hysteresis-free transfer characteristic by applying the shortest pulse. Moreover, to correlate these results, a single pulse time-domain drain current analysis is carried out to unleash the fast and slow transient charge trapping phenomena. Furthermore, rigorous density functional theory (DFT) calculations are implemented to inspect the effects of the Schottky barrier and metal-induced gap states between drain/source electrode and MoS2 for the superior carrier transport. Our findings on the controllable transient charge trapping mechanisms for estimation of intrinsic field-effect mobility and hysteresis-free transfer characteristic in salt-assisted CVD-grown MoS2 FETs will be beneficial for future device applications in complex memory, logic, and sensor systems.


title: A Fully Hyperbolic Neural Model for Hierarchical Multi-Class Classification

abstract: Label inventories for fine-grained entity typing have grown in size and complexity. Nonetheless, they exhibit a hierarchical structure. Hyperbolic spaces offer a mathematically appealing approach for learning hierarchical representations of symbolic data. However, it is not clear how to integrate hyperbolic components into downstream tasks. This is the first work that proposes a fully hyperbolic model for multi-class multi-label classification, which performs all operations in hyperbolic space. We evaluate the proposed model on two challenging datasets and compare to different baselines that operate under Euclidean assumptions. Our hyperbolic model infers the latent hierarchy from the class distribution, captures implicit hyponymic relations in the inventory, and shows performance on par with state-of-the-art methods on fine-grained classification with remarkable reduction of the parameter size. A thorough analysis sheds light on the impact of each component in the final prediction and showcases its ease of integration with Euclidean layers.


title: Improving Generative Imagination in Object-Centric World Models

abstract: The remarkable recent advances in object-centric generative world models raise a few questions. First, while many of the recent achievements are indispensable for making a general and versatile world model, it is quite unclear how these ingredients can be integrated into a unified framework. Second, despite using generative objectives, abilities for object detection and tracking are mainly investigated, leaving the crucial ability of temporal imagination largely under question. Third, a few key abilities for more faithful temporal imagination such as multimodal uncertainty and situation-awareness are missing. In this paper, we introduce Generative Structured World Models (G-SWM). The G-SWM achieves the versatile world modeling not only by unifying the key properties of previous models in a principled framework but also by achieving two crucial new abilities, multimodal uncertainty and situation-awareness. Our thorough investigation on the temporal generation ability in comparison to the previous models demonstrates that G-SWM achieves the versatility with the best or comparable performance for all experiment settings including a few complex settings that have not been tested before.


title: Automata-based Quantitative Verification

abstract: Quantitative analysis of computing systems is an emerging area in automated formal analysis. Such properties address aspects such as costs and rewards, quality measures, resource consumption, distance metrics, etc. Existing solutions for problems in quantitative analysis face two challenges, namely lack of generalizability and separation-of-techniques. Lack of generalizability refers to the issue that solution approaches are specialized to cost model. Different cost models deploy such disparate algorithms that there is no transfer of knowledge from one cost model to another. Separation-of-techniques refers to the inherent dichotomy in solving problems in quantitative analysis. Most algorithms comprise of a structural phase which reasons about the structure of the quantitative system(s) using techniques from automata or graphs, and a numerical phase, which reasons about the quantitative dimension/cost model using numerical methods. The techniques used in both phases are so unlike each other that they are difficult to combine, thereby impacting scalability. This thesis contributes to a novel framework that addresses these challenges. The introduced framework, called comparator automata or comparators in short, builds on automata-theoretic foundations to generalize across a variety of cost models. Comparators enable automata-based methods in the numerical phase, hence eradicating the dependence on numerical methods. In doing so, comparators are able to integrate the structural and numerical phases. On the theoretical front, we demonstrate that these have the advantage of generalizable results, and yield complexity-theoretic improvements over a range of problems in quantitative analysis. On the empirical front, we demonstrate that comparator-based solutions render more efficient, scalable, and robust performance, and are able to integrate quantitative with qualitative objectives.


title: Specialized federated learning using a mixture of experts

abstract: In federated learning, clients share a global model that has been trained on decentralized local client data. Although federated learning shows significant promise as a key approach when data cannot be shared or centralized, current methods show limited privacy properties and have shortcomings when applied to common real-world scenarios, especially when client data is heterogeneous. In this paper, we propose an alternative method to learn a personalized model for each client in a federated setting, with greater generalization abilities than previous methods. To achieve this personalization we propose a federated learning framework using a mixture of experts to combine the specialist nature of a locally trained model with the generalist knowledge of a global model. We evaluate our method on a variety of datasets with different levels of data heterogeneity, and our results show that the mixture of experts model is better suited as a personalized model for devices in these settings, outperforming both fine-tuned global models and local specialists.


title: Modulated Fusion using Transformer for Linguistic-Acoustic Emotion Recognition

abstract: This paper aims to bring a new lightweight yet powerful solution for the task of Emotion Recognition and Sentiment Analysis. Our motivation is to propose two architectures based on Transformers and modulation that combine the linguistic and acoustic inputs from a wide range of datasets to challenge, and sometimes surpass, the state-of-the-art in the field. To demonstrate the efficiency of our models, we carefully evaluate their performances on the IEMOCAP, MOSI, MOSEI and MELD dataset. The experiments can be directly replicated and the code is fully open for future researches.


title: Chemical diversity among A-B stars with low rotational velocities: non-LTE abundance analysis

abstract: We present accurate element abundance patterns based on the non-local thermodynamic equilibrium (non-LTE, NLTE) line formation for 14 chemical elements from He to Nd for a sample of nine A9 to B3 type stars with well determined atmospheric parameters and low rotational velocities. We constructed new model atom of Zr II-III and updated model atoms for Sr II and Ba II by implementing the photoionization cross sections from calculations with the Dirac B-spline R-matrix method. The NLTE abundances of He to Fe in the stars HD~17081, HD~32115, HD~160762, and HD~209459 are found to be consistent with the solar abundances, and HD~73666 being a Blue Struggler does not reveal deviations from chemical composition of the Praesepe cluster. Three of these stars with an effective temperature of lower than 10500~K have supersolar abundances of Sr, Zr, Ba, and Nd, and our results suggest the presence of a positive correlation between stellar effective temperature and abundance. For each star, enhancement of Ba is higher than that for any other heavy element. We propose that the solar Ba abundance is not representative of the galactic Ba abundance at modern epoch. The status of HD~145788 was not clarified: this star has solar abundances of C to Si and enhancements of Sr to Ba similar to that for superficially normal stars of similar temperature, while overabundant Ca, Ti, and Fe. The NLTE abundances of Vega support its status of a mild lambda~Bootis star.


title: Non-anchor-based vehicle detection for traffic surveillance using bounding ellipses

abstract: Cameras for traffic surveillance are usually pole-mounted and produce images that reflect a birds-eye view. Vehicles in such images, in general, assume an ellipse form. A bounding box for the vehicles usually includes a large empty space when the vehicle orientation is not parallel to the edges of the box. To circumvent this problem, the present study applied bounding ellipses to a non-anchor-based, single-shot detection model (CenterNet). Since this model does not depend on anchor boxes, non-max suppression (NMS) that requires computing the intersection over union (IOU) between predicted bounding boxes is unnecessary for inference. The SpotNet that extends the CenterNet model by adding a segmentation head was also tested with bounding ellipses. Two other anchor-based, single-shot detection models (YOLO4 and SSD) were chosen as references for comparison. The model performance was compared based on a local dataset that was doubly annotated with bounding boxes and ellipses. As a result, the performance of the two models with bounding ellipses exceeded that of the reference models with bounding boxes. When the backbone of the ellipse models was pretrained on an open dataset (UA-DETRAC), the performance was further enhanced. The data augmentation schemes developed for YOLO4 also improved the performance of the proposed models. As a result, the best mAP score of a CenterNet with bounding ellipses exceeds 0.9.


title: Direct Spectroscopic Observation of Berry Phase Interference in the Ni$_4$ Single-Molecule Magnet

abstract: Berry phase effects in spin systems lead to the suppression of tunneling effects when different tunneling paths interfere destructively. Such effects have been seen in several single-molecule magnets (SMMs) through measurements of magnetization dynamics, where the experimental signal may arise from the contributions of numerous energy levels. Here we present experimental measurements of Berry phase interference effects that are determined through electron-spin resonance on a four-fold symmetric SMM. Specifically, we measure transitions between tunnel-split excited states in the Ni$_4$ SMM in the presence of a transverse field in the hard plane of the crystalline sample. By using a home-built rotation apparatus, the direction of the sample can be changed \textit{in situ} so that that the field direction can be swept through the entire hard plane of the sample. When the field is in certain directions in the plane, we observe a splitting of the transition, a hallmark of Berry phase interference. The experimental results are well reproduced by theoretical predictions, and fitting of the data provides information about the effects of dipolar interactions and sample misalignment.


title: Hierarchy of Supersymmetric Higher Spin Connections

abstract: We focus on the geometrical reformulation of free higher spin supermultiplets in $4\rm{D},~\mathcal{N}=1$ flat superspace. We find that there is a de Wit-Freedman like hierarchy of superconnections with simple gauge transformations. The requirement for sensible free equations of motion imposes constraints on the gauge parameter superfields. Unlike the nonsupersymmetric case, we find several different constraints that can decouple the higher superconnections. By lifting these constraints nongeometrically via compensators we recover all known descriptions of arbitrary integer and half-integer gauge supermultiplets. In the constrained formulation we find a new description of half-integer supermultiplets, generalizing the new-minimal and virial formulations of linearized supergravity to higher spins. However this description can be formulated using compensators. The various descriptions can be labeled as geometrical or nongeometrical if the equations of motion can be expressed purely in terms of superconnections or not.


title: Two-loop renormalization and mixing of gluon and quark energy-momentum tensor operators

abstract: In this paper, we present one- and two-loop results for the renormalization of the gluon and quark gauge-invariant operators which appear in the definition of the QCD energy-momentum tensor, in dimensional regularization. To this end, we consider a variety of Green's functions with different incoming momenta. We identify the set of twist-2 symmetric traceless and flavor singlet operators which mix among themselves and we calculate the corresponding mixing coefficients for the nondiagonal components. We also provide results for some appropriate regularization-independent (RI')-like schemes, which address this mixing, and we discuss their application to nonperturbative studies via lattice simulations. Finally, we extract the one- and two-loop expressions of the conversion factors between the proposed RI' and the MSbar schemes. From our results regarding the MSbar-renormalized Green's functions, one can easily derive conversion factors relating numerous variants of RI'-like schemes to MSbar. To make our results easily accessible, we also provide them as Supplemental Material, in the form of a Mathematica input file and, also, an equivalent text file.


title: The Attractor Conjecture for Calabi-Yau variations of Hodge structures

abstract: We study attractor points for Calabi-Yau variations of Hodge structures. In particular, for certain moduli spaces which are Shimura varieties, we prove that the attractor points are CM points, thus proving Moore's Attractor Conjecture in these cases. We also study non-BPS examples of attractors, obtaining special points on locally symmetric spaces without hermitian structures, as well as locally symmetric spaces inside Shimura varieties; for the latter we point out a possible analogy with subspaces studied by Goresky-Tai. Finally we give an explicit geometric description of non-BPS attractors in the simplest case.


title: Implementing conventional and unconventional nonadiabatic geometric quantum gates via SU(2) transformations

abstract: We propose a simple but versatile protocol to engineer time-dependent Hamiltonians inversely for geometric quantum computation. By utilizing SU(2) transformation, a speedup goal on gate operation is achieved with more freedom to design the control parameters. As an application, this protocol enables the conventional and unconventional nonadiabatic geometric quantum gates with desired evolution paths by controlling the microwave pulses in the diamond nitrogen-vacancy center system. We show that the inversely designed Hamiltonian can fulfill the geometric gate with more economical evolution time and further reduces the influence of the environment noise on gate fidelity.


title: Detecting Misclassification Errors in Neural Networks with a Gaussian Process Model

abstract: As neural network classifiers are deployed in real-world applications, it is crucial that their failures can be detected reliably. One practical solution is to assign confidence scores to each prediction, then use these scores to filter out possible misclassifications. However, existing confidence metrics are not yet sufficiently reliable for this role. This paper presents a new framework that produces a quantitative metric for detecting misclassification errors. This framework, RED, builds an error detector on top of the base classifier and estimates uncertainty of the detection scores using Gaussian Processes. Experimental comparisons with other error detection methods on 125 UCI datasets demonstrate that this approach is effective. Further implementations on two probabilistic base classifiers and two large deep learning architecture in vision tasks further confirm that the method is robust and scalable. Third, an empirical analysis of RED with out-of-distribution and adversarial samples shows that the method can be used not only to detect errors but also to understand where they come from. RED can thereby be used to improve trustworthiness of neural network classifiers more broadly in the future.


title: Are Neural Nets Modular? Inspecting Functional Modularity Through Differentiable Weight Masks

abstract: Neural networks (NNs) whose subnetworks implement reusable functions are expected to offer numerous advantages, including compositionality through efficient recombination of functional building blocks, interpretability, preventing catastrophic interference, etc. Understanding if and how NNs are modular could provide insights into how to improve them. Current inspection methods, however, fail to link modules to their functionality. In this paper, we present a novel method based on learning binary weight masks to identify individual weights and subnets responsible for specific functions. Using this powerful tool, we contribute an extensive study of emerging modularity in NNs that covers several standard architectures and datasets. We demonstrate how common NNs fail to reuse submodules and offer new insights into the related issue of systematic generalization on language tasks.


title: Sums of four squares with a certain restriction

abstract: In 2016, while studying restricted sums of integral squares, Sun posed the following conjecture: Every positive integer $n$ can be written as $x^2+y^2+z^2+w^2$ $(x,y,z,w\in\mathbb{N}=\{0,1,\cdots\})$ with $x+3y$ a square. Meanwhile, he also conjectured that for each positive integer $n$ there exist integers $x,y,z,w$ such that $n=x^2+y^2+z^2+w^2$ and $x+3y\in\{4^k:k\in\mathbb{N}\}$. In this paper, we confirm these conjectures via some arithmetic theory of ternary quadratic forms.


title: Deep Reinforcement Learning for Electric Vehicle Routing Problem with Time Windows

abstract: The past decade has seen a rapid penetration of electric vehicles (EV) in the market, more and more logistics and transportation companies start to deploy EVs for service provision. In order to model the operations of a commercial EV fleet, we utilize the EV routing problem with time windows (EVRPTW). In this research, we propose an end-to-end deep reinforcement learning framework to solve the EVRPTW. In particular, we develop an attention model incorporating the pointer network and a graph embedding technique to parameterize a stochastic policy for solving the EVRPTW. The model is then trained using policy gradient with rollout baseline. Our numerical studies show that the proposed model is able to efficiently solve EVRPTW instances of large sizes that are not solvable with any existing approaches.


title: The Grammar of Emergent Languages

abstract: In this paper, we consider the syntactic properties of languages emerged in referential games, using unsupervised grammar induction (UGI) techniques originally designed to analyse natural language. We show that the considered UGI techniques are appropriate to analyse emergent languages and we then study if the languages that emerge in a typical referential game setup exhibit syntactic structure, and to what extent this depends on the maximum message length and number of symbols that the agents are allowed to use. Our experiments demonstrate that a certain message length and vocabulary size are required for structure to emerge, but they also illustrate that more sophisticated game scenarios are required to obtain syntactic properties more akin to those observed in human language. We argue that UGI techniques should be part of the standard toolkit for analysing emergent languages and release a comprehensive library to facilitate such analysis for future researchers.


title: Vertex-transitive graphs with local action the symmetric group on ordered pairs

abstract: We consider a finite, connected and simple graph $\Gamma$ that admits a vertex-transitive group of automorphisms $G$. Under the assumption that, for all $x \in V(\Gamma)$, the local action $G_x^{\Gamma(x)}$ is the action of $\mathrm{Sym}(n)$ on ordered pairs, we show that the group $G_x^{[3]}$, the pointwise stabiliser of a ball of radius three around $x$, is trivial.


title: The use of restricted mean time lost under competing risks data

abstract: Background: Under competing risks, the commonly used sub-distribution hazard ratio (SHR) is not easy to interpret clinically and is valid only under the proportional sub-distribution hazard (SDH) assumption. This paper introduces an alternative statistical measure: the restricted mean time lost (RMTL). Methods: First, the definition and estimation methods of the measures are introduced. Second, based on the differences in RMTLs, a basic difference test (Diff) and a supremum difference test (sDiff) are constructed. Then, the corresponding sample size estimation method is proposed. The statistical properties of the methods and the estimated sample size are evaluated using Monte Carlo simulations, and these methods are also applied to two real examples. Results: The simulation results show that sDiff performs well and has relatively high test efficiency in most situations. Regarding sample size calculation, sDiff exhibits good performance in various situations. The methods are illustrated using two examples. Conclusions: RMTL can meaningfully summarize treatment effects for clinical decision making, which can then be reported with the SDH ratio for competing risks data. The proposed sDiff test and the two calculated sample size formulas have wide applicability and can be considered in real data analysis and trial design.


title: Numerical tests of magnetoreception models assisted with behavioral experiments on American cockroaches

abstract: Many animals display sensitivity to external magnetic field, but only in the simplest organisms the sensing mechanism is understood. Here we report on behavioural experiments where American cockroaches (Periplaneta americana) were subjected to rotating external magnetic fields with a period of 10 minutes. The insects show increased activity when placed in a rotating Earth-strength field, whereas this effect is diminished in ten times stronger rotating field. We analyse established models of magnetoreception, the magnetite model and the radical pair model, in light of this adaptation result. Our findings show that the magnetite model is excluded and the radical pair model requires strong additional assumptions to be compatible with the data.


title: Operator representation and logistic extension of elementary cellular automata

abstract: We redefine the transition function of elementary cellular automata (ECA) in terms of discrete operators. The operator representation provides a clear hint about the way systems behave both at the local and the global scale. We show that mirror and complementary symmetric rules are connected to each other via simple operator transformations. It is possible to decouple the representation into two pairs of operators which are used to construct a periodic table of ECA that maps all unique rules in such a way that rules having similar behavior are clustered together. Finally, the operator representation is used to implement a generalized logistic extension to ECA. Here a single tuning parameter scales the pace with which operators iterate the rules. We show that, as this parameter is tuned, many rules of ECA undergo multiple phase transitions between periodic, locally chaotic, chaotic and complex (Class 4) behavior.


title: Efficient and flexible approach to ptychography using an optimization framework based on automatic differentiation

abstract: Ptychography is a lensless imaging method that allows for wavefront sensing and phase-sensitive microscopy from a set of diffraction patterns. Recently, it has been shown that the optimization task in ptychography can be achieved via automatic differentiation (AD). Here, we propose an open-access AD-based framework implemented with TensorFlow, a popular machine learning library. Using simulations, we show that our AD-based framework performs comparably to a state-of-the-art implementation of the momentum-accelerated ptychographic iterative engine (mPIE) in terms of reconstruction speed and quality. AD-based approaches provide great flexibility, as we demonstrate by setting the reconstruction distance as a trainable parameter. Lastly, we experimentally demonstrate that our framework faithfully reconstructs a biological specimen.


title: Learned Hardware/Software Co-Design of Neural Accelerators

abstract: The use of deep learning has grown at an exponential rate, giving rise to numerous specialized hardware and software systems for deep learning. Because the design space of deep learning software stacks and hardware accelerators is diverse and vast, prior work considers software optimizations separately from hardware architectures, effectively reducing the search space. Unfortunately, this bifurcated approach means that many profitable design points are never explored. This paper instead casts the problem as hardware/software co-design, with the goal of automatically identifying desirable points in the joint design space. The key to our solution is a new constrained Bayesian optimization framework that avoids invalid solutions by exploiting the highly constrained features of this design space, which are semi-continuous/semi-discrete. We evaluate our optimization framework by applying it to a variety of neural models, improving the energy-delay product by 18% (ResNet) and 40% (DQN) over hand-tuned state-of-the-art systems, as well as demonstrating strong results on other neural network architectures, such as MLPs and Transformers.


title: Average-case Acceleration for Bilinear Games and Normal Matrices

abstract: Advances in generative modeling and adversarial learning have given rise to renewed interest in smooth games. However, the absence of symmetry in the matrix of second derivatives poses challenges that are not present in the classical minimization framework. While a rich theory of average-case analysis has been developed for minimization problems, little is known in the context of smooth games. In this work we take a first step towards closing this gap by developing average-case optimal first-order methods for a subset of smooth games. We make the following three main contributions. First, we show that for zero-sum bilinear games the average-case optimal method is the optimal method for the minimization of the Hamiltonian. Second, we provide an explicit expression for the optimal method corresponding to normal matrices, potentially non-symmetric. Finally, we specialize it to matrices with eigenvalues located in a disk and show a provable speed-up compared to worst-case optimal algorithms. We illustrate our findings through benchmarks with a varying degree of mismatch with our assumptions.


title: Study of the Dependence of the Plateau Shape for Type II Supernovae on Metallicity

abstract: We consider the effect of a change in the rate of flux decline in the U band for type II-P supernovae (SNe IIP) as a function of metallicity $Z$. Based on this effect, we propose a new method to determine the photometric redshift from the SN IIP light curve in the U band. Using the STELLA code, we have constructed model light curves in different bands for different redshifts $z = 0.0, 0.1$, and $0.3$ as the metallicity in the models decreases from $Z \sim 10^{-3}$ to $\sim 10^{-6}$. The flux in the U band is shown to reach a plateau at the lowest metallicities. We consider the influence of other parameters as well: the presupernova mass and the mass of radioactive nickel-56.


title: Rank 2 B\"acklund Transformations of Hyperbolic Monge-Amp\`ere Systems

abstract: There are two main types of rank 2 B\"acklund transformations relating a pair of hyperbolic Monge-Amp\`ere systems, which we call Type $\mathscr{A}$ and Type $\mathscr{B}$. For Type $\mathscr{A}$, we completely determine a subclass whose local invariants satisfy a specific but simple algebraic constraint; such B\"acklund transformations are parametrized by a finite number of constants, whose cohomogeneity can be either 2, 3 or 4. In addition, we present an invariantly formulated condition that determines whether a generic Type $\mathscr{B}$ B\"acklund transformation is one that, under suitable choices of local coordinates, relates solutions of two PDEs of the form $z_{xy} = F(x,y,z,z_x,z_y)$ and preserves the $x,y$ variables on solutions.


title: NATSA: A Near-Data Processing Accelerator for Time Series Analysis

abstract: Time series analysis is a key technique for extracting and predicting events in domains as diverse as epidemiology, genomics, neuroscience, environmental sciences, economics, and more. Matrix profile, the state-of-the-art algorithm to perform time series analysis, computes the most similar subsequence for a given query subsequence within a sliced time series. Matrix profile has low arithmetic intensity, but it typically operates on large amounts of time series data. In current computing systems, this data needs to be moved between the off-chip memory units and the on-chip computation units for performing matrix profile. This causes a major performance bottleneck as data movement is extremely costly in terms of both execution time and energy. In this work, we present NATSA, the first Near-Data Processing accelerator for time series analysis. The key idea is to exploit modern 3D-stacked High Bandwidth Memory (HBM) to enable efficient and fast specialized matrix profile computation near memory, where time series data resides. NATSA provides three key benefits: 1) quickly computing the matrix profile for a wide range of applications by building specialized energy-efficient floating-point arithmetic processing units close to HBM, 2) improving the energy efficiency and execution time by reducing the need for data movement over slow and energy-hungry buses between the computation units and the memory units, and 3) analyzing time series data at scale by exploiting low-latency, high-bandwidth, and energy-efficient memory access provided by HBM. Our experimental evaluation shows that NATSA improves performance by up to 14.2x (9.9x on average) and reduces energy by up to 27.2x (19.4x on average), over the state-of-the-art multi-core implementation. NATSA also improves performance by 6.3x and reduces energy by 10.2x over a general-purpose NDP platform with 64 in-order cores.


title: Sampling Optimized Code for Type Feedback

abstract: To efficiently execute dynamically typed languages, many language implementations have adopted a two-tier architecture. The first tier aims for low-latency startup times and collects dynamic profiles, such as the dynamic types of variables. The second tier provides high-throughput using an optimizing compiler that specializes code to the recorded type information. If the program behavior changes to the point that not previously seen types occur in specialized code, that specialized code becomes invalid, it is deoptimized, and control is transferred back to the first tier execution engine which will start specializing anew. However, if the program behavior becomes more specific, for instance, if a polymorphic variable becomes monomorphic, nothing changes. Once the program is running optimized code, there are no means to notice that an opportunity for optimization has been missed. We propose to employ a sampling-based profiler to monitor native code without any instrumentation. The absence of instrumentation means that when the profiler is not active, no overhead is incurred. We present an implementation is in the context of the \v{R} just-in-time, optimizing compiler for the R language. Based on the sampled profiles, we are able to detect when the native code produced by \v{R} is specialized for stale type feedback and recompile it to more type-specific code. We show that sampling adds an overhead of less than 3% in most cases and up to 9% in few cases and that it reliably detects stale type feedback within milliseconds.


title: Integrated Optofluidic Sensor for Coagulation Risk Monitoring in COVID-19 Patients at Point-of-Care

abstract: While the pathophysiology underlying the COVID-19 infection remains incompletely understood, there is growing evidence to indicate that it is closely correlated to hypercoagulation among severely ill patients. Doctors may choose for use anti-coagulation doses to treat the patients at intensive care units. A rapid, easy, and low-cost solution to monitor the coagulation status at the point-of-care may help with treatment by enabling the administration of controlled doses of medication to patients and to understand the disease's underlying pathophysiology. Thromboelastography, the clinical standard is accurate; it suffers from limited portability and low sensitivity when miniaturized to handheld form factor. In the article, we summarize research helping to advance towards an integrated optofluidic device combining microfluidics and photonic sensor technology. Microfluidics are used to perform blood pre-processing, and a photonic sensor measures blood coagulation status in real-time readout on the device itself. These techniques make it portable and scalable, potentially serving as technology foundation for the development of a disposable sensor for point-of-care diagnostics in COVID-19 patients and coagulopathy in general.