title: Words are all you need? Language as an approximation for human similarity judgments

abstract: Human similarity judgments are a powerful supervision signal for machine learning applications based on techniques such as contrastive learning, information retrieval, and model alignment, but classical methods for collecting human similarity judgments are too expensive to be used at scale. Recent methods propose using pre-trained deep neural networks (DNNs) to approximate human similarity, but pre-trained DNNs may not be available for certain domains (e.g., medical images, low-resource languages) and their performance in approximating human similarity has not been extensively tested. We conducted an evaluation of 611 pre-trained models across three domains -- images, audio, video -- and found that there is a large gap in performance between human similarity judgments and pre-trained DNNs. To address this gap, we propose a new class of similarity approximation methods based on language. To collect the language data required by these new methods, we also developed and validated a novel adaptive tag collection pipeline. We find that our proposed language-based methods are significantly cheaper, in the number of human judgments, than classical methods, but still improve performance over the DNN-based methods. Finally, we also develop `stacked' methods that combine language embeddings with DNN embeddings, and find that these consistently provide the best approximations for human similarity across all three of our modalities. Based on the results of this comprehensive study, we provide a concise guide for researchers interested in collecting or approximating human similarity data. To accompany this guide, we also release all of the similarity and language data, a total of 206,339 human judgments, that we collected in our experiments, along with a detailed breakdown of all modeling results.


title: Characterization of Blast Waveforms Produced by Different Driver Gasses in an Open-Ended Shock Tube Model

abstract: With the evolution of modern warfare and the increased use of improvised explosive devices (IEDs), there has been an increase in blast-induced traumatic brain injuries (bTBI) among military personnel and civilians. The increased prevalence of bTBI necessitates bTBI models that result in a properly scaled injury for the model organism being used. The primary laboratory model for bTBI is the shock tube, wherein a compressed gas ruptures a thin membrane, generating a shockwave. To generate a shock wave that is properly scaled from human to rodent subjects the shock wave must have a short duration and high peak overpressure while fitting a Friedlander waveform, the ideal representation of a blast wave. A large variety of factors have been experimentally characterized in attempts to create an ideal waveform, however we found current research on the gas composition being used to drive shock wave formation to be lacking. To better understand the effect the driver gas has on the waveform being produced, we utilized a previously established murine shock tube bTBI model in conjunction with several distinct driver gasses. In agreement with previous findings, helium produced a shock wave most closely fitting the Friedlander waveform in contrast to the plateau-like waveforms produced by some other gases. The peak pressure at the exit of the shock tube and 5 cm from the exit have a strong negative correlation with the density of the gas being used: helium the least dense gas used produces the highest peak overpressure. Density of the driver gas also exerts a strong positive effect on the duration of the shock wave, with helium producing the shortest duration wave. Due to its ability to produce a Friedlander waveform and produce a waveform following proper injury scaling guidelines, helium is an ideal gas for use in shock tube models for bTBI.


title: Optimal cash management using impulse control

abstract: We consider the impulse control of Levy processes under the infinite horizon, discounted cost criterion. Our motivating example is the cash management problem in which a controller is charged a fixed plus proportional cost for adding to or withdrawing from his/her reserve, plus an opportunity cost for keeping any cash on hand. Our main result is to provide a verification theorem for the optimality of control band policies in this scenario. We also analyze the transient and steady-state behavior of the controlled process under control band policies and explicitly solve for the optimal policy in the case in which the Levy process to be controlled is the sum of a Brownian motion with drift and a compound Poisson process with exponentially distributed jump sizes.


title: Modeling Defect-Level Switching for Highly-Nonlinear and Hysteretic Electronic Devices

abstract: Many semiconductors feature defects with charge state transition levels that can switch due to structure changes following defect ionization: we call this defect-level switching (DLS). For example, DX centers in III-V compounds, and oxygen vacancies in ZnO, can switch between deep and shallow donor configurations, and these bistable dynamics are responsible for persistent photoconductivity. We recently demonstrated highly-nonlinear, hysteretic, two-terminal electronic devices using DLS in CdS [H. Yin, A. Kumar, J.M. LeBeau, and R. Jaramillo, Phys. Rev. Applied 15, 014014 (2021).] The resulting devices operate without mass transport, and in the opposite sense to most resistive switches: they are in a high-conductivity state at equilibrium, and switch to a low-conductivity state at forward bias. Although DLS uses the same defect transitions that are responsible for persistent photoconductivity, DLS devices operate without light and can be orders-of-magnitude faster due to exponential tuning of transition rates with voltage. In this work we use theory and numerical simulation to explore the design space of DLS devices, emphasizing the tradeoff between speed and on/off ratio. Our results will be useful to guide future applications of these unusual devices.


title: Self-supervised graph neural networks for accurate prediction of N\'{e}el temperature

abstract: Antiferromagnetic materials are exciting quantum materials with rich physics and great potential for applications. It is highly demanded of the accurate and efficient theoretical method for determining the critical transition temperatures, N\'{e}el temperatures, of antiferromagnetic materials. The powerful graph neural networks (GNN) that succeed in predicting material properties lose their advantage in predicting magnetic properties due to the small dataset of magnetic materials, while conventional machine learning models heavily depend on the quality of material descriptors. We propose a new strategy to extract high-level material representations by utilizing self-supervised training of GNN on large-scale unlabeled datasets. According to the dimensional reduction analysis, we find that the learned knowledge about elements and magnetism transfers to the generated atomic vector representations. Compared with popular manually constructed descriptors and crystal graph convolutional neural networks, self-supervised material representations can help us obtain a more accurate and efficient model for N\'{e}el temperatures, and the trained model can successfully predict high N\'{e}el temperature antiferromagnetic materials. Our self-supervised GNN may serve as a universal pre-training framework for various material properties.


title: Likelihood-free Model Choice for Simulator-based Models with the Jensen--Shannon Divergence

abstract: Choice of appropriate structure and parametric dimension of a model in the light of data has a rich history in statistical research, where the first seminal approaches were developed in 1970s, such as the Akaike's and Schwarz's model scoring criteria that were inspired by information theory and embodied the rationale called Occam's razor. After those pioneering works, model choice was quickly established as its own field of research, gaining considerable attention in both computer science and statistics. However, to date, there have been limited attempts to derive scoring criteria for simulator-based models lacking a likelihood expression. Bayes factors have been considered for such models, but arguments have been put both for and against use of them and around issues related to their consistency. Here we use the asymptotic properties of Jensen--Shannon divergence (JSD) to derive a consistent model scoring criterion for the likelihood-free setting called JSD-Razor. Relationships of JSD-Razor with established scoring criteria for the likelihood-based approach are analyzed and we demonstrate the favorable properties of our criterion using both synthetic and real modeling examples.


title: Functionalization of graphene sponge electrodes with two-dimensional materials for tailored electrocatalytic activity towards specific contaminants of emerging concern

abstract: Low-cost graphene sponge electrodes were functionalized with two-dimensional (2D) materials, i.e., borophene and hexagonal boron nitride (hBN), using a one-step, hydrothermal self-assembly method. Borophene and hBN-modified graphene sponge anode and N-doped graphene sponge cathode were employed for electrochemical degradation of model persistent contaminants of emerging concern in one-pass, flow through mode, and using low-conductivity supporting electrolyte. Functionalization of the reduced graphene oxide (RGO) coating with 2D materials led to specific modifications in the electrode electrocatalytic performance and interactions with the target contaminants. For instance, addition of hBN promoted the adsorption of more hydrophobic organic contaminants via van der Waals and {\pi}-{\pi} interactions. Functionalization of the graphene sponge anode with borophene enhanced the generation of oxidant species such as H2O2 and O3 and yielded an order of magnitude higher concentration of hydroxyl radicals (HO) compared with the non-functionalized graphene sponge anode, thus enhancing the removal of target contaminants. Experiments conducted with the selective radical scavengers indicated the key role of surface-bound hydroxyl radicals (HOads) and singlet oxygen (1O2) in electrochemical degradation. The study demonstrates that functionalization of graphene sponge electrodes with 2D materials can enhance their electrocatalytic activity and modulate the interaction with specific organic contaminants, thus opening new possibilities for designing electrodes tailored to remove specific groups of pollutants.


title: On Benford's Law and the Coefficients of the Riemann Mapping Function for the Exterior of the Mandelbrot Set

abstract: We investigate Benford's law in relation to fractal geometry. Basic fractals, such as the Cantor set and Sierpinski triangle are obtained as the limit of iterative sets, and the unique measures of their components follow a geometric distribution, which is Benford in most bases. Building on this intuition, we aim to study this distribution in more complicated fractals. We examine the Laurent coefficients of a Riemann mapping and the Taylor coefficients of its reciprocal function from the exterior of the Mandelbrot set to the complement of the unit disk. These coefficients are 2-adic rational numbers, and through statistical testing, we demonstrate that the numerators and denominators are a good fit for Benford's law. We offer additional conjectures and observations about these coefficients. In particular, we highlight certain arithmetic subsequences related to the coefficients' denominators, provide an estimate for their slope, and describe efficient methods to compute them.


title: Push--Pull with Device Sampling

abstract: We consider decentralized optimization problems in which a number of agents collaborate to minimize the average of their local functions by exchanging over an underlying communication graph. Specifically, we place ourselves in an asynchronous model where only a random portion of nodes perform computation at each iteration, while the information exchange can be conducted between all the nodes and in an asymmetric fashion. For this setting, we propose an algorithm that combines gradient tracking with a network-level variance reduction (in contrast to variance reduction within each node). This enables each node to track the average of the gradients of the objective functions. Our theoretical analysis shows that the algorithm converges linearly, when the local objective functions are strongly convex, under mild connectivity conditions on the expected mixing matrices. In particular, our result does not require the mixing matrices to be doubly stochastic. In the experiments, we investigate a broadcast mechanism that transmits information from computing nodes to their neighbors, and confirm the linear convergence of our method on both synthetic and real-world datasets.


title: Deep Hierarchical Planning from Pixels

abstract: Intelligent agents need to select long sequences of actions to solve complex tasks. While humans easily break down tasks into subgoals and reach them through millions of muscle commands, current artificial intelligence is limited to tasks with horizons of a few hundred decisions, despite large compute budgets. Research on hierarchical reinforcement learning aims to overcome this limitation but has proven to be challenging, current methods rely on manually specified goal spaces or subtasks, and no general solution exists. We introduce Director, a practical method for learning hierarchical behaviors directly from pixels by planning inside the latent space of a learned world model. The high-level policy maximizes task and exploration rewards by selecting latent goals and the low-level policy learns to achieve the goals. Despite operating in latent space, the decisions are interpretable because the world model can decode goals into images for visualization. Director outperforms exploration methods on tasks with sparse rewards, including 3D maze traversal with a quadruped robot from an egocentric camera and proprioception, without access to the global position or top-down view that was used by prior work. Director also learns successful behaviors across a wide range of environments, including visual control, Atari games, and DMLab levels.


title: Simplifying Polylogarithms with Machine Learning

abstract: Polylogrithmic functions, such as the logarithm or dilogarithm, satisfy a number of algebraic identities. For the logarithm, all the identities follow from the product rule. For the dilogarithm and higher-weight classical polylogarithms, the identities can involve five functions or more. In many calculations relevant to particle physics, complicated combinations of polylogarithms often arise from Feynman integrals. Although the initial expressions resulting from the integration usually simplify, it is often difficult to know which identities to apply and in what order. To address this bottleneck, we explore to what extent machine learning methods can help. We consider both a reinforcement learning approach, where the identities are analogous to moves in a game, and a transformer network approach, where the problem is viewed analogously to a language-translation task. While both methods are effective, the transformer network appears more powerful and holds promise for practical use in symbolic manipulation tasks in mathematical physics.


title: Interpolating between small- and large-$g$ expansions using Bayesian Model Mixing

abstract: Bayesian Model Mixing (BMM) is a statistical technique that can be used to combine models that are predictive in different input domains into a composite distribution that has improved predictive power over the entire input space. We explore the application of BMM to the mixing of two expansions of a function of a coupling constant $g$ that are valid at small and large values of $g$ respectively. This type of problem is quite common in nuclear physics, where physical properties are straightforwardly calculable in strong and weak interaction limits or at low and high densities or momentum transfers, but difficult to calculate in between. Interpolation between these limits is often accomplished by a suitable interpolating function, e.g., Pad\'e approximants, but it is then unclear how to quantify the uncertainty of the interpolant. We address this problem in the simple context of the partition function of zero-dimensional $\phi^4$ theory, for which the (asymptotic) expansion at small $g$ and the (convergent) expansion at large $g$ are both known. We consider three mixing methods: linear mixture BMM, localized bivariate BMM, and localized multivariate BMM with Gaussian processes. We find that employing a Gaussian process in the intermediate region between the two predictive models leads to the best results of the three methods. The methods and validation strategies we present here should be generalizable to other nuclear physics settings.


title: Physics-guided descriptors for prediction of structural polymorphs

abstract: We develop a method combining machine learning (ML) and density functional theory (DFT) to predict low-energy polymorphs by introducing physics-guided descriptors based on structural distortion modes. We systematically generate crystal structures utilizing the distortion modes and compute their energies with single-point DFT calculations. We then train a ML model to identify low-energy configurations on the material's high-dimensional potential energy surface. Here, we use BiFeO3 as a case study and explore its phase space by tuning the amplitudes of linear combinations of a finite set of distinct distortion modes. Our procedure is validated by rediscovering several known metastable phases of BiFeO3 with complex crystal structures, and its efficiency is proved by identifying 21 new low-energy polymorphs. This approach proposes a new avenue toward accelerating the prediction of low-energy polymorphs in solid-state materials.


title: Spatial Games of Fake News

abstract: To curb the spread of fake news on social media platforms, recent studies have considered an online crowdsourcing fact-checking approach as one possible intervention method to reduce misinformation. However, it remains unclear under what conditions crowdsourcing fact-checking efforts deter the spread of misinformation. To address this issue, we model such distributed fact-checking as `peer policing' that will reduce the perceived payoff to share or disseminate false information (fake news) and also reward the spread of trustworthy information (real news). By simulating our model on synthetic square lattices and small-world networks, we show that the presence of social network structure enables fake news spreaders to be self-organized into echo chambers, thereby providing a boost to the efficacy of fake news and thus its resistance to fact-checking efforts. Additionally, to study our model in a more realistic setting, we utilize a Twitter network dataset and study the effectiveness of deliberately choosing specific individuals to be fact-checkers. We find that targeted fact-checking efforts can be highly effective, seeing the same level of success with as little as a fifth of the number of fact-checkers, but it depends on the structure of the network in question. In the limit of weak selection, we obtain closed-form analytical conditions for critical threshold of crowdsourced fact-checking in terms of the payoff values in our fact-checker/fake news game. Our work has practical implications for developing model-based mitigation strategies for controlling the spread of misinformation that interferes with the political discourse.


title: Diffusion probabilistic modeling of protein backbones in 3D for the motif-scaffolding problem

abstract: Construction of a scaffold structure that supports a desired motif, conferring protein function, shows promise for the design of vaccines and enzymes. But a general solution to this motif-scaffolding problem remains open. Current machine-learning techniques for scaffold design are either limited to unrealistically small scaffolds (up to length 20) or struggle to produce multiple diverse scaffolds. We propose to learn a distribution over diverse and longer protein backbone structures via an E(3)-equivariant graph neural network. We develop SMCDiff to efficiently sample scaffolds from this distribution conditioned on a given motif; our algorithm is the first to theoretically guarantee conditional samples from a diffusion model in the large-compute limit. We evaluate our designed backbones by how well they align with AlphaFold2-predicted structures. We show that our method can (1) sample scaffolds up to 80 residues and (2) achieve structurally diverse scaffolds for a fixed motif.


title: Structure of primitive axial algebras

abstract: "Fusion rules" are laws of multiplication among eigenspaces of an idempotent. This terminology is relatively new and is closely related to primitive axial algebras, introduced recently by Hall, Rehren, and Shpectorov. Axial algebras, in turn, are closely related to $3$-transposition groups and vertex operator algebras. In earlier work we studied primitive axial algebras, not necessarily commutative, and showed that they all have Jordan type. In this paper, we show that all finitely generated primitive axial algebras are direct sums of specifically described flexible finite dimensional noncommutative algebras, and commutative axial algebras generated by primitive axes of the same type. In particular,all primitive axial algebras are flexible. They also have Frobenius forms. We give a precise description of all the primitive axes of axial algebras generated by two primitive axes.


title: Symmetries and Casimirs of radial compressible fluid flow and gas dynamics in n>1 dimensions

abstract: Symmetries and Casimirs are studied for the Hamiltonian equations of radial compressible fluid flow in n>1 dimensions. An explicit determination of all Lie point symmetries is carried out, from which a complete classification of all maximal Lie symmetry algebras is obtained. The classification includes all Lie point symmetries that exist only for special equations of state. For a general equation of state, the hierarchy of advected conserved integrals found in recent work is proved to consist of Hamiltonian Casimirs. A second hierarchy that holds only for an entropic equation of state is explicitly shown to comprise non-Casimirs which yield a corresponding hierarchy of generalized symmetries through the Hamiltonian structure of the equations of radial fluid flow. The first-order symmetries are shown to generate a non-abelian Lie algebra. Two new kinematic conserved integrals found in recent work are likewise shown to yield additional first-order generalized symmetries holding for a barotropic equation of state and an entropic equation of state. These symmetries produce an explicit transformation group acting on solutions of the fluid equations. Since these equations are well known to be equivalent to the equations of gas dynamics, all of the results obtained for n-dimensional radial fluid flow carry over to radial gas dynamics.


title: ESCHER: Eschewing Importance Sampling in Games by Computing a History Value Function to Estimate Regret

abstract: Recent techniques for approximating Nash equilibria in very large games leverage neural networks to learn approximately optimal policies (strategies). One promising line of research uses neural networks to approximate counterfactual regret minimization (CFR) or its modern variants. DREAM, the only current CFR-based neural method that is model free and therefore scalable to very large games, trains a neural network on an estimated regret target that can have extremely high variance due to an importance sampling term inherited from Monte Carlo CFR (MCCFR). In this paper we propose an unbiased model-free method that does not require any importance sampling. Our method, ESCHER, is principled and is guaranteed to converge to an approximate Nash equilibrium with high probability. We show that the variance of the estimated regret of ESCHER is orders of magnitude lower than DREAM and other baselines. We then show that ESCHER outperforms the prior state of the art -- DREAM and neural fictitious self play (NFSP) -- on a number of games and the difference becomes dramatic as game size increases. In the very large game of dark chess, ESCHER is able to beat DREAM and NFSP in a head-to-head competition over $90\%$ of the time.


title: Nitriding: A tool kit for building scalable, networked, secure enclaves

abstract: Enclave deployments often fail to simultaneously be secure (e.g., resistant to side channel attacks), powerful (i.e., as fast as an off-the-shelf server), and flexible (i.e., unconstrained by development hurdles). In this paper, we present nitriding, an open tool kit that enables the development of enclave applications that satisfy all three properties. We build nitriding on top of the recently-proposed AWS Nitro Enclaves whose architecture prevents side channel attacks by design, making nitriding more secure than comparable frameworks. We abstract away the constrained development model of Nitro Enclaves, making it possible to run unmodified applications inside an enclave that have seamless and secure Internet connectivity, all while making our code user-verifiable. To demonstrate nitriding's flexibility, we design three enclave applications, each a research contribution in its own right: (i) we run a Tor bridge inside an enclave, making it resistant to protocol-level deanonymization attacks; (ii) we built a service for securely revealing infrastructure configuration, empowering users to verify privacy promises like the discarding of IP addresses at the edge; (iii) and we move a Chromium browser into an enclave, thereby isolating its attack surface from the user's system. We find that nitriding enables rapid prototyping and alleviates the deployment of production-quality systems, paving the way toward usable and secure enclaves.


title: DRHDR: A Dual branch Residual Network for Multi-Bracket High Dynamic Range Imaging

abstract: We introduce DRHDR, a Dual branch Residual Convolutional Neural Network for Multi-Bracket HDR Imaging. To address the challenges of fusing multiple brackets from dynamic scenes, we propose an efficient dual branch network that operates on two different resolutions. The full resolution branch uses a Deformable Convolutional Block to align features and retain high-frequency details. A low resolution branch with a Spatial Attention Block aims to attend wanted areas from the non-reference brackets, and suppress displaced features that could incur on ghosting artifacts. By using a dual branch approach we are able to achieve high quality results while constraining the computational resources required to estimate the HDR results.


title: Towards Self-supervised and Weight-preserving Neural Architecture Search

abstract: Neural architecture search (NAS) algorithms save tremendous labor from human experts. Recent advancements further reduce the computational overhead to an affordable level. However, it is still cumbersome to deploy the NAS techniques in real-world applications due to the fussy procedures and the supervised learning paradigm. In this work, we propose the self-supervised and weight-preserving neural architecture search (SSWP-NAS) as an extension of the current NAS framework by allowing the self-supervision and retaining the concomitant weights discovered during the search stage. As such, we simplify the workflow of NAS to a one-stage and proxy-free procedure. Experiments show that the architectures searched by the proposed framework achieve state-of-the-art accuracy on CIFAR-10, CIFAR-100, and ImageNet datasets without using manual labels. Moreover, we show that employing the concomitant weights as initialization consistently outperforms the random initialization and the two-stage weight pre-training method by a clear margin under semi-supervised learning scenarios. Codes are publicly available at https://github.com/LzVv123456/SSWP-NAS.


title: Generalised power series determined by linear recurrence relations

abstract: In 1882, Kronecker established that a given univariate formal Laurent series over a field can be expressed as a fraction of two univariate polynomials if and only if the coefficients of the series satisfy a linear recurrence relation. We introduce the notion of generalised linear recurrence relations for power series with exponents in an arbitrary ordered abelian group, and generalise Kronecker's original result. In particular, we obtain criteria for determining whether a multivariate formal Laurent series lies in the fraction field of the corresponding polynomial ring. Moreover, we study distinguished algebraic substructures of a power series field, which are determined by generalised linear recurrence relations. In particular, we identify generalised linear recurrence relations that determine power series fields satisfying additional properties which are essential for the study of their automorphism groups.


title: Open questions asked to analysis and numerics concerning the Hausdorff moment problem

abstract: We address facts and open questions concerning the degree of ill-posedness of the composite Hausdorff moment problem aimed at the recovery of a function $x \in L^2(0,1)$ from elements of the infinite dimensional sequence space $\ell^2$ that characterize moments applied to the antiderivative of $x$. This degree, unknown by now, results from the decay rate of the singular values of the associated compact forward operator $A$, which is the composition of the compact simple integration operator mapping in $L^2(0,1)$ and the non-compact Hausdorff moment operator $B^{(H)}$ mapping from $L^2(0,1)$ to $\ell^2$. There is a seeming contradiction between (a) numerical computations, which show (even for large $n$) an exponential decay of the singular values for $n$-dimensional matrices obtained by discretizing the operator $A$, and \linebreak (b) a strongly limited smoothness of the well-known kernel $k$ of the Hilbert-Schmidt operator $A^*A$. Fact (a) suggests severe ill-posedness of the infinite dimensional Hausdorff moment problem, whereas fact (b) lets us expect the opposite, because exponential ill-posedness occurs in common just for $C^\infty$-kernels $k$. We recall arguments for the possible occurrence of a polynomial decay of the singular values of $A$, even if the numerics seems to be against it, and discuss some issues in the numerical approximation of non-compact operators.


title: Constraints on Sub-GeV Dark Matter--Electron Scattering from the CDEX-10 Experiment

abstract: We present improved germanium-based constraints on sub-GeV dark matter via dark matter--electron ($\chi$-$e$) scattering using the 205.4 kg$\cdot$day dataset from the CDEX-10 experiment. Using a novel calculation technique, we attain predicted $\chi$-$e$ scattering spectra observable in high-purity germanium detectors. In the heavy mediator scenario, our results achieve 3 orders of magnitude of improvement for $m_{\chi}$ larger than 80 MeV/c$^2$ compared to previous germanium-based $\chi$-$e$ results. We also present the most stringent $\chi$-$e$ cross-section limit to date among experiments using solid-state detectors for $m_{\chi}$ larger than 90 MeV/c$^2$ with heavy mediators and $m_{\chi}$ larger than 100 MeV/c$^2$ with electric dipole coupling. The result proves the feasibility and demonstrates the vast potential of a new $\chi$-$e$ detection method with high-purity germanium detectors in ultralow radioactive background.


title: Receding Moving Object Segmentation in 3D LiDAR Data Using Sparse 4D Convolutions

abstract: A key challenge for autonomous vehicles is to navigate in unseen dynamic environments. Separating moving objects from static ones is essential for navigation, pose estimation, and understanding how other traffic participants are likely to move in the near future. In this work, we tackle the problem of distinguishing 3D LiDAR points that belong to currently moving objects, like walking pedestrians or driving cars, from points that are obtained from non-moving objects, like walls but also parked cars. Our approach takes a sequence of observed LiDAR scans and turns them into a voxelized sparse 4D point cloud. We apply computationally efficient sparse 4D convolutions to jointly extract spatial and temporal features and predict moving object confidence scores for all points in the sequence. We develop a receding horizon strategy that allows us to predict moving objects online and to refine predictions on the go based on new observations. We use a binary Bayes filter to recursively integrate new predictions of a scan resulting in more robust estimation. We evaluate our approach on the SemanticKITTI moving object segmentation challenge and show more accurate predictions than existing methods. Since our approach only operates on the geometric information of point clouds over time, it generalizes well to new, unseen environments, which we evaluate on the Apollo dataset.


title: Sampling constrained stochastic trajectories using Brownian bridges

abstract: We present a new method to sample conditioned trajectories of a system evolving under Langevin dynamics, based on Brownian bridges. The trajectories are conditioned to end at a certain point (or in a certain region) in space. The bridge equations can be recast exactly in the form of a non linear stochastic integro-differential equation. This equation can be very well approximated when the trajectories are closely bundled together in space, i.e. at low temperature, or for transition paths. The approximate equation can be solved iteratively, using a fixed point method. We discuss how to choose the initial trajectories and show some examples of the performance of this method on some simple problems. The method allows to generate conditioned trajectories with a high accuracy.


title: Efficient computation of temporal exceeding probability of ship responses in a random wave field

abstract: In this work, we develop a computational framework to efficiently quantify the temporal exceeding probability of ship responses in a random wave field, i.e., the fraction of time that ship responses exceed a given threshold. In particular, we consider large thresholds so that the response exceedance needs to be treated as rare events. Our computational framework builds on the parameterization of wave field into wave groups and efficient sampling in the group parameter space through Bayesian experimental design (BED). Previous works following this framework exclusively studied extreme statistics of group-maximum response, i.e., the maximum response within a wave group, which is however not straightforward to interpret in practice (e.g., its value depends on the subjective definition of the wave group). In order to adapt the framework to the more robust measure by the temporal exceeding probability, novel developments need to be introduced to the two components of BED (on surrogate model and acquisition function), which are detailed in the paper. We validate our framework for a case of ship roll motion calculated by a nonlinear roll equation, in terms of the agreement of our results to the true solution and the independence of our results to the criterion of defining groups. Finally, we demonstrate the coupling of the framework with CFD models to handle more realistic and general ship response problems.


title: Forecasting AI Progress: Evidence from a Survey of Machine Learning Researchers

abstract: Advances in artificial intelligence (AI) are shaping modern life, from transportation, health care, science, finance, to national defense. Forecasts of AI development could help improve policy- and decision-making. We report the results from a large survey of AI and machine learning (ML) researchers on their beliefs about progress in AI. The survey, fielded in late 2019, elicited forecasts for near-term AI development milestones and high- or human-level machine intelligence, defined as when machines are able to accomplish every or almost every task humans are able to do currently. As part of this study, we re-contacted respondents from a highly-cited study by Grace et al. (2018), in which AI/ML researchers gave forecasts about high-level machine intelligence and near-term milestones in AI development. Results from our 2019 survey show that, in aggregate, AI/ML researchers surveyed placed a 50% likelihood of human-level machine intelligence being achieved by 2060. The results show researchers newly contacted in 2019 expressed similar beliefs about the progress of advanced AI as respondents in the Grace et al. (2018) survey. For the recontacted participants from the Grace et al. (2018) study, the aggregate forecast for a 50% likelihood of high-level machine intelligence shifted from 2062 to 2076, although this change is not statistically significant, likely due to the small size of our panel sample. Forecasts of several near-term AI milestones have reduced in time, suggesting more optimism about AI progress. Finally, AI/ML researchers also exhibited significant optimism about how human-level machine intelligence will impact society.


title: Bayesian multivariate logistic regression for superiority and inferiority decision-making under observable treatment heterogeneity

abstract: The effects of treatments may differ between persons with different characteristics. Addressing such treatment heterogeneity is crucial to investigate whether patients with specific characteristics are likely to benefit from a new treatment. The current paper presents a novel Bayesian method for superiority decision-making in the context of randomized controlled trials with multivariate binary responses and heterogeneous treatment effects. The framework is based on three elements: a) Bayesian multivariate logistic regression analysis with a P\'olya-Gamma expansion; b) a transformation procedure to transfer obtained regression coefficients to a more intuitive multivariate probability scale (i.e., success probabilities and the differences between them); and c) a compatible decision procedure for treatment comparison with prespecified decision error rates. Procedures for a priori sample size estimation under a non-informative prior distribution are included. A numerical evaluation demonstrated that decisions based on a priori sample size estimation resulted in anticipated error rates among the trial population as well as subpopulations. Further, average and conditional treatment effect parameters could be estimated unbiasedly when the sample was large enough. Illustration with the International Stroke Trial dataset revealed a trend towards heterogeneous effects among stroke patients: Something that would have remained undetected when analyses were limited to average treatment effects.


title: Shock Breakout in 3-Dimensional Red Supergiant Envelopes

abstract: Using Athena++, we perform 3D Radiation-Hydrodynamic calculations of the radiative breakout of the shock wave in the outer envelope of a red supergiant (RSG) which has suffered core collapse and will become a Type IIP supernova. The intrinsically 3D structure of the fully convective RSG envelope yields key differences in the brightness and duration of the shock breakout (SBO) from that predicted in a 1D stellar model. First, the lower-density `halo' of material outside of the traditional photosphere in 3D models leads to a shock breakout at lower densities than 1D models. This would prolong the duration of the shock breakout flash at any given location on the surface to $\approx$1-2 hours. However, we find that the even larger impact is the intrinsically 3D effect associated with large-scale fluctuations in density that cause the shock to break out at different radii at different times. This substantially prolongs the SBO duration to $\approx$3-6 hours and implies a diversity of radiative temperatures, as different patches across the stellar surface are at different stages of their radiative breakout and cooling at any given time. These predicted durations are in better agreement with existing observations of SBO. The longer durations lower the predicted luminosities by a factor of 3-10 ($L_\mathrm{bol}\sim10^{44}\mathrm{erg\ s^{-1}}$), and we derive the new scalings of brightness and duration with explosion energies and stellar properties. These intrinsically 3D properties eliminate the possibility of using observed rise times to measure the stellar radius via light-travel time effects.


title: Heat Generation using Lorentzian Nanoparticles: Estimation via Time-Domain Techniques

abstract: We analyze the mathematical model that describes the heat generated by electromagnetic nanoparticles. We use the known optical properties of the nanoparticles to control the support and amount of the heat needed around a nanoparticle. Precisely, we show that the dominant part of the heat around the nanoparticle is the electric field multiplied by a constant dependent, explicitly and only, on the permittivity and quantities related to the eigenvalues and eigenfunctions of the Magnetization (or the Newtonian) operator, defined on the nanoparticle, and inversely proportional to the distance to the nanoparticle. The nanoparticles are described via the Lorentz model. If the used incident frequency is chosen related to the plasmonic frequency $\omega_p$ (via the Magnetization operator) then the nanoparticle behaves as a plasmonic one while if it is chosen related to the undamped resonance frequency $\omega_0$ (via the Newtonian operator), then it behaves as a dielectric one. The two regimes exhibit different optical behaviors. In both cases, we estimate the generated heat and discuss advantages of each incident frequency regime. The analysis is based on time-domain integral equation techniques avoiding the use of (formal) Fourier type transformations.


title: On the time evolution of the $M_{\rm d} - M_\star$ and $\dot M - M_\star$ correlations for protoplanetary discs: the viscous timescale increases with stellar mass

abstract: Large surveys of star-forming regions have unveiled power-law correlations between the stellar mass and the disc parameters, such as the disc mass $M_{\mathrm{d}} \propto {M_{\star}}^{\lambda_{\mathrm{m}}}$ and the accretion rate $\dot M \propto {M_{\star}}^{\lambda_{\mathrm{acc}}}$. The observed slopes appear to be increasing with time, but the reason behind the establishment of these correlations and their subsequent evolution is still uncertain. We conduct a theoretical analysis of the impact of viscous evolution on power-law initial conditions for a population of protoplanetary discs. We find that, for evolved populations, viscous evolution enforces the two correlations to have the same slope, $\lambda_{\mathrm{m}}$ = $\lambda_{\mathrm{acc}}$, and that this limit is uniquely determined by the initial slopes $\lambda_{\mathrm{m}, 0}$ and $\lambda_{\mathrm{acc}, 0}$. We recover the increasing trend claimed from the observations when the difference in the initial values, $\delta_0 = \lambda_{\mathrm{m}, 0} - \lambda_{\mathrm{acc}, 0}$, is larger than $1/2$; moreover, we find that this increasing trend is a consequence of a positive correlation between the viscous timescale and the stellar mass. We also present the results of disc population synthesis numerical simulations, that allow us to introduce a spread and analyse the effect of sampling, which show a good agreement with our analytical predictions. Finally, we perform a preliminary comparison of our numerical results with observational data, which allows us to constrain the parameter space of the initial conditions to $\lambda_{\mathrm{m}, 0} \in [1.2, 2.1]$, $\lambda_{\mathrm{acc}, 0} \in [0.7, 1.5]$.


title: Adversarial Text Normalization

abstract: Text-based adversarial attacks are becoming more commonplace and accessible to general internet users. As these attacks proliferate, the need to address the gap in model robustness becomes imminent. While retraining on adversarial data may increase performance, there remains an additional class of character-level attacks on which these models falter. Additionally, the process to retrain a model is time and resource intensive, creating a need for a lightweight, reusable defense. In this work, we propose the Adversarial Text Normalizer, a novel method that restores baseline performance on attacked content with low computational overhead. We evaluate the efficacy of the normalizer on two problem areas prone to adversarial attacks, i.e. Hate Speech and Natural Language Inference. We find that text normalization provides a task-agnostic defense against character-level attacks that can be implemented supplementary to adversarial retraining solutions, which are more suited for semantic alterations.


title: Horizon physics of quasi-one-dimensional tilted Weyl cones on a lattice

abstract: To simulate the dynamics of massless Dirac fermions in curved spacetimes with one, two, and three spatial dimensions we construct tight-binding Hamiltonians with spatially varying hoppings. These models represent tilted Weyl semimetals where the tilting varies with position, in a manner similar to the light cones near the horizon of a black hole. We illustrate the gravitational analogies in these models by numerically evaluating the propagation of wave packets on the lattice and then comparing them to the geodesics of the corresponding curved spacetime. We also show that the motion of electrons in these spatially varying systems can be understood through the conservation of energy and the quasi-conservation of quasimomentum. This picture is confirmed by calculations of the scattering matrix, which indicate an exponential suppression of any noncontinuous change in the quasimomentum. Finally, we show that horizons in the lattice models can be constructed also at finite energies using specially designed tilting profiles.


title: Rotating anisotropic stringy spheroid in a modified Hartle formalism

abstract: Here we look at an application of the Hartle metric to describe a rotating version of the spherical string cloud/ global monopole solution. While rotating versions of this solution have previously been constructed via the Newman-Janis algorithm, that process does not preserve the equation of state. The Hartle method allows for preservation of equation of state, at least in the sense of a slowly rotating perturbative solution. In addition to the direct utility of generating equations which could be used to model a region of a rotating string cloud or similar system, this work shows that it is possible to adapt the Hartle metric to slowly rotating anisotropic systems with Segre type [(11)(1,1)] following an equation of state between the distinct eigenvalues.


title: TreeFlow: Going beyond Tree-based Gaussian Probabilistic Regression

abstract: The tree-based ensembles are known for their outstanding performance in classification and regression problems characterized by feature vectors represented by mixed-type variables from various ranges and domains. However, considering regression problems, they are primarily designed to provide deterministic responses or model the uncertainty of the output with Gaussian or parametric distribution. In this work, we introduce TreeFlow, the tree-based approach that combines the benefits of using tree ensembles with the capabilities of modeling flexible probability distributions using normalizing flows. The main idea of the solution is to use a tree-based model as a feature extractor and combine it with a conditional variant of normalizing flow. Consequently, our approach is capable of modeling complex distributions for the regression outputs. We evaluate the proposed method on challenging regression benchmarks with varying volume, feature characteristics, and target dimensionality. We obtain the SOTA results for both probabilistic and deterministic metrics on datasets with multi-modal target distributions and competitive results on unimodal ones compared to tree-based regression baselines.


title: Role of Blockchain in Revolutionizing Online Transactional Security

abstract: This paper highlights the necessity to use modern blockchain technology in traditional banking sector to reduce frauds and enable high-security transactions on a permanent blockchain ledger. Reviewing different channels through which the traditional banking servers could integrate blockchain use, it is signified how a huge anti-fraud stand can be taken against bank servers allowing fraudulent transactions daily. Usage of a blockchain-based ledger is highly impactful in terms of security of a banking organization. Blockchain-based currency tokens, also referred to as Cryptocurrencies are not regulated by the government, highly volatile, and anonymous to use. Furthermore, there is no security for any funds invested in a cryptocurrency market. However, the integration of a blockchain ledger in a traditional banking organization would strengthen the security to provide more stability and confidence to its customers and at the same time, make blockchain a more reliable method to consider due to being trusted by large financial organizations.


title: Characteristics of Kepler Eclipsing Binaries Displaying a Significant O'Connell Effect

abstract: The O'Connell effect - the presence of unequal maxima in eclipsing binaries - remains an unsolved riddle in the study of close binary systems. The Kepler space telescope produced high precision photometry of nearly 3,000 eclipsing binary systems, providing a unique opportunity to study the O'Connell effect in a large sample and in greater detail than in previous studies. We have characterized the observational properties - including temperature, luminosity, and eclipse depth - of a set of 212 systems (7.3% of Kepler eclipsing binaries) that display a maxima flux difference of at least 1%, representing the largest sample of O'Connell effect systems yet studied. We explored how these characteristics correlate with each other to help understand the O'Connell effect's underlying causes. We also describe some system classes with peculiar light curve features aside from the O'Connell effect (~30% of our sample), including temporal variation and asymmetric minima. We found that the O'Connell effect size's correlations with period and temperature are inconsistent with Kouzuma's starspot study. Up to 20% of systems display the parabolic eclipse timing variation signal expected for binaries undergoing mass transfer. Most systems displaying the O'Connell effect have the brighter maximum following the primary eclipse, suggesting a fundamental link between which maximum is brighter and the O'Connell effect's physical causes. Most importantly, we find that the O'Connell effect occurs exclusively in systems where the components are close enough to significantly affect each other, suggesting that the interaction between the components is ultimately responsible for causing the O'Connell effect.


title: The $L^\infty$-isodelaunay decomposition of strata of abelian differentials

abstract: We study the decomposition of a stratum $\mathcal H(\kappa)$ of abelian differentials into regions of differentials that share a common $L^\infty$-Delaunay triangulation. In particular, we classify the infinitely many adjacencies between these isodelaunay regions, a phenomenon whose observation is attributed to Filip in work of Frankel. This classification allows us to construct a finite simplicial complex with the same homotopy type as $\mathcal H(\kappa)$, and we outline a method for its computation. We also require a stronger equivariant version of the traditional Nerve Lemma than currently exists in the literature, which we prove.


title: Spatially Resolved Observations of Betelgeuse at 7mm and 1.3cm Just Prior to the Great Dimming

abstract: We present spatially resolved observations of Betelgeuse (Alpha Orionis) obtained with the Karl G. Jansky Very Large Array (VLA) at wavelengths of ~7mm (44~GHz) and ~1.3cm (22~GHz) on 2019 August 2, just prior to the onset of the historical optical dimming that occurred between late 2019 and early 2020. Our measurements suggest recent changes in the temperature and density structure of the atmosphere between radii r~2-3R*. At 7mm the star is ~20% dimmer than in previously published observing epochs between 1996--2004. We measure a mean gas temperature of T_B = 2270 +\- 260 K at r~2.1R*, where R* is the canonical photospheric radius. This is ~2 sigma lower than previously reported temperatures at comparable radii and >1200K lower than predicted by previous semi-empirical models of the atmosphere. The measured brightness temperature at r~2.6R* (T_B = 2580 +\- 260 K) is also cooler than expected based on trends in past measurements. The stellar brightness profile in our current measurements appears relatively smooth and symmetric, with no obvious signatures of giant convective cells or other surface features. However, the azimuthally averaged brightness profile is found to be more complex than a uniform elliptical disk. Our observations were obtained approximately six weeks before spectroscopic measurements in the ultraviolet revealed evidence of increases in the chromospheric electron density in the southern hemisphere of Betelgeuse, coupled with a large-scale outflow. We discuss possible scenarios linking these events with the observed radio properties of the star, including the passage of a strong shock wave.


title: Deep Estimation of Speckle Statistics Parametric Images

abstract: Quantitative Ultrasound (QUS) provides important information about the tissue properties. QUS parametric image can be formed by dividing the envelope data into small overlapping patches and computing different speckle statistics such as parameters of the Nakagami and Homodyned K-distributions (HK-distribution). The calculated QUS parametric images can be erroneous since only a few independent samples are available inside the patches. Another challenge is that the envelope samples inside the patch are assumed to come from the same distribution, an assumption that is often violated given that the tissue is usually not homogenous. In this paper, we propose a method based on Convolutional Neural Networks (CNN) to estimate QUS parametric images without patching. We construct a large dataset sampled from the HK-distribution, having regions with random shapes and QUS parameter values. We then use a well-known network to estimate QUS parameters in a multi-task learning fashion. Our results confirm that the proposed method is able to reduce errors and improve border definition in QUS parametric images.


title: Stability and distortion of fcc-LaH$_{10}$ with path-integral molecular dynamics

abstract: The synthesis of the high temperature superconductor LaH$_{10}$ requires pressures in excess of 100 GPa, wherein it adopts a face-centered cubic structure. Upon decompression, this structure undergoes a distortion which still supports superconductivity, but with a much lower critical temperature. Previous calculations have shown that quantum and anharmonic effects are necessary to stabilize the cubic structure, but have not resolved the low pressure distortion. Using large scale path-integral molecular dynamics enabled by a machine learned potential, we show that a rhombohedral distortion appears at sufficiently low pressures, even with quantum and anharmonic effects. We also highlight the importance of quantum zero point motion in stabilizing the cubic structure.


title: Vectorial Bulk-Boundary Correspondence for 3D Photonic Chern Insulators

abstract: In 2D Chern insulators (2D CI), the topology of the bulk states is captured by a topological invariant, the Chern number. The scalar bulk-boundary correspondence (sBBC) relates the change in Chern number across an interface with the number of 1D chiral edge modes at the interface. However, 3D Chern insulators (3D CI) can be characterized by a Chern vector C = (Cx, Cy, Cz) and a more general vector bulk-boundary correspondence (vBBC) is needed to correctly predict the propagation of the surface modes. In this work the possible interfaces between 3D photonic CIs are explored, focusing on possible changes in Chern vector orientation. To formulate a 3D vBBC, a link is derived between the Chern vector discontinuity across an interface and the winding of the surface equifrequency loops on the boundary. Lastly, it is demonstrated how to correctly predict the number and the propagation direction of topological photonic surface modes in 3D CIs.


title: Quasars with Proper Motions and the Link to Double and Multiple AGNs

abstract: Gaia used a large sample of photometrically selected active galactic nuclei (AGNs) and quasars to remove the residual spin of its global proper motion system in order to achieve a maximally inertial reference frame. A small fraction of these reference objects have statistically significant astrometric proper motions in Gaia EDR3. We compile a source sample of $105,593$ high-fidelity AGNs with accurate spectroscopically determined redshifts above 0.5 from the SDSS and normalized proper motions below 4. The rate of genuinely perturbed proper motions is at least 0.17\%. A smaller high completeness sample of 152 quasars with excess proper motions at a confidence level of 0.9995 is examined in detail. Pan-STARRS images and Gaia-resolved pairs reveal that 29\% of the sample are either double sources or gravitationally lensed quasars. An Anderson--Darling test on parameters of a smaller high-reliability sample and their statistical controls reveals 17 significant factors that favor multiplicity and multi-source structure as the main cause of perturbed astrometry. Using a nearest neighbor distance statistical analysis and counts of close companions in Gaia on a much larger initial sample of AGNs, an excess of closely separated sources in Gaia is detected. At least 0.33\% of all optical quasars are genuinely double or multiply imaged. We provide a list of 44 candidate double or multiple AGNs and four previously known gravitational lenses. Many proper motion quasars may be more closely separated, unresolved doubles exhibiting the variability imposed motion (VIM) effect, and a smaller fraction may be chance alignments with foreground stars causing weak gravitational lensing.


title: A Survey of Graph-based Deep Learning for Anomaly Detection in Distributed Systems

abstract: Anomaly detection is a crucial task in complex distributed systems. A thorough understanding of the requirements and challenges of anomaly detection is pivotal to the security of such systems, especially for real-world deployment. While there are many works and application domains that deal with this problem, few have attempted to provide an in-depth look at such systems. In this survey, we explore the potentials of graph-based algorithms to identify anomalies in distributed systems. These systems can be heterogeneous or homogeneous, which can result in distinct requirements. One of our objectives is to provide an in-depth look at graph-based approaches to conceptually analyze their capability to handle real-world challenges such as heterogeneity and dynamic structure. This study gives an overview of the State-of-the-Art (SotA) research articles in the field and compare and contrast their characteristics. To facilitate a more comprehensive understanding, we present three systems with varying abstractions as use cases. We examine the specific challenges involved in anomaly detection within such systems. Subsequently, we elucidate the efficacy of graphs in such systems and explicate their advantages. We then delve into the SotA methods and highlight their strength and weaknesses, pointing out the areas for possible improvements and future works.


title: Theoretical Uncertainty Quantification for Heavy-ion Fusion

abstract: Despite recent advances and focus on rigorous uncertainty quantification for microscopic models of quantum many-body systems, the uncertainty on the dynamics of those systems has been under-explored. To address this, we have used time-dependent Hartree-Fock to examine the model uncertainty for a collection of low-energy, heavy-ion fusion reactions. Fusion reactions at near-barrier energies represent a rich test-bed for the dynamics of quantum many-body systems owing to the complex interplay of collective excitation, transfer, and static effects that determine the fusion probability of a given system. While the model uncertainty is sizable for many of the systems studied, the primary contribution comes from ill-constrained static properties, such as the neutron radius of neutron-rich nuclei. These large uncertainties motivate the use of information from reactions to better constrain existing models and to infer static properties from reaction data.


title: Entanglement transition through Hilbert-space localization

abstract: We study Hilbert-space localization of the many-body dynamics due to ergodicity breaking and analyze this effect in terms of the entanglement entropy and the entanglement spectrum. We find a transition from a regime driven by quantum tunneling to a regime that is dominated by boson-boson interaction, where the latter exhibits ergodicity breaking. Properties of this transition are captured by observation time averaging, which effectively suppresses the large dynamical entanglement fluctuations near the critical point. We employ this approach to the experimentally available Bosonic Josephson Junction. In this example the transition from a tunneling regime to Hilbert-space localization reveals clear signatures in the entanglement entropy and entanglement spectrum. Interestingly, the transition point is reduced by quantum effects in comparison to the well-known result of the mean-field approximation in the form of self-trapping. This indicates that quantum fluctuations reduce the classical self-trapping. Different scaling with the respect to the number of bosons $N$ are found in the tunneling and the localization regime: While the entanglement entropy grows {\it logarithmically} with $N$ in the tunneling regime, it increases {\it linearly} in the localized regime. Our results indicate that entanglement provides a concept for a sensitive diagnosis for the transition from a quantum tunneling regime to Hilbert-space localization.


title: Near Ascending HNN-Extensions and a Combination Result for Semistability at Infinity

abstract: Semistability at infinity is an asymptotic property of finitely presented groups that is needed in order to effectively define the fundamental group at infinity for a 1-ended group. It is an open problem whether or not all finitely presented groups have semistable fundamental group at infinity. While many classes of groups are known to contain only semistable at infinity groups, there are only a few combination results for such groups. Our main theorem is such a result. Main Theorem. Suppose $G$ is the fundamental group of a connected reduced graph of groups, where each edge group is infinite and finitely generated, and each vertex group is finitely presented and either 1-ended and semistable at infinity or has an edge group of finite index. Then $G$ is 1-ended and semistable at infinity. An important part of the proof of this result is the semistability part of the following: Theorem. Suppose $H_0$ is an infinite finitely presented group, $H_1$ is a subgroup of finite index in $H_0$, $\phi:H_1\to H_0$ is a monomorphism and $G=H_0\ast_\phi$ is the resulting HNN extension. Then $G$ is 1-ended and semistable at infinity. If additionally, $H_0$ is 1-ended, then $G$ is simply connected at infinity.


title: Unsupervised Key Event Detection from Massive Text Corpora

abstract: Automated event detection from news corpora is a crucial task towards mining fast-evolving structured knowledge. As real-world events have different granularities, from the top-level themes to key events and then to event mentions corresponding to concrete actions, there are generally two lines of research: (1) theme detection identifies from a news corpus major themes (e.g., "2019 Hong Kong Protests" vs. "2020 U.S. Presidential Election") that have very distinct semantics; and (2) action extraction extracts from one document mention-level actions (e.g., "the police hit the left arm of the protester") that are too fine-grained for comprehending the event. In this paper, we propose a new task, key event detection at the intermediate level, aiming to detect from a news corpus key events (e.g., "HK Airport Protest on Aug. 12-14"), each happening at a particular time/location and focusing on the same topic. This task can bridge event understanding and structuring and is inherently challenging because of the thematic and temporal closeness of key events and the scarcity of labeled data due to the fast-evolving nature of news articles. To address these challenges, we develop an unsupervised key event detection framework, EvMine, that (1) extracts temporally frequent peak phrases using a novel ttf-itf score, (2) merges peak phrases into event-indicative feature sets by detecting communities from our designed peak phrase graph that captures document co-occurrences, semantic similarities, and temporal closeness signals, and (3) iteratively retrieves documents related to each key event by training a classifier with automatically generated pseudo labels from the event-indicative feature sets and refining the detected key events using the retrieved documents. Extensive experiments and case studies show EvMine outperforms all the baseline methods and its ablations on two real-world news corpora.


title: Common kings of a chain of cycles in a strong tournament

abstract: It is known that every strong tournament has directed cycles of any length, and thereby strong subtournaments of any size. In this note, we prove that they also can share a common vertex which is a king of all of them. This common vertex can be any king in the whole tournament. Further, the Hamiltonian cycles in them can be recursively constructed by inserting an additional vertex to one directed edge.


title: Entropy Production in the Inflationary Epoch Using the Gouy-Stodola Theorem

abstract: In this work, we use the Gouy-Stodola theorem to calculate the entropy production rate in the inflationary epoch of the universe. This theorem allows us the simple calculation of entropy and entropy production rate occasioned by the decaying of the inflaton scalar field. Both the entropy and entropy production rate achieve large values, agreeing with the expected values present in the literature.


title: Feedback cooled Bose-Einstein condensation: near and far from equilibrium

abstract: Continuously measured interacting quantum systems almost invariably heat, causing loss of quantum coherence. Here, we study Bose-Einstein condensates (BECs) subject to repeated weak measurement of the atomic density and describe several protocols for generating a feedback signal designed to remove excitations created by measurement backaction. We use a stochastic Gross-Pitaevskii equation to model the system dynamics and find that a feedback protocol utilizing momentum dependant gain and filtering can effectively cool both 1D and 2D systems. The performance of these protocols is quantified in terms of the steady state energy, entropy, and condensed fraction. These are the first feedback cooling protocols demonstrated in 2D, and in 1D our optimal protocol reduces the equilibrium energy by more than a factor of 100 as compared with a previous cooling protocol developed using the same methodology. We also use this protocol to quench-cool 1D BECs from non-condensed highly excited states and find that they rapidly condense into a far from equilibrium state with energy orders of magnitude higher than the equilibrium ground state energy for that condensate fraction. We explain this in terms of the near-integrability of our 1D system, whereby efficiently cooled low momentum modes are effectively decoupled from the energetic `reservoir' of the higher momentum modes. We observe that the quench-cooled condensed states can have non-zero integer winding numbers described by quantized supercurrents.


title: Inference for Matched Tuples and Fully Blocked Factorial Designs

abstract: This paper studies inference in randomized controlled trials with multiple treatments, where treatment status is determined according to a "matched tuples" design. Here, by a matched tuples design, we mean an experimental design where units are sampled i.i.d. from the population of interest, grouped into "homogeneous" blocks with cardinality equal to the number of treatments, and finally, within each block, each treatment is assigned exactly once uniformly at random. We first study estimation and inference for matched tuples designs in the general setting where the parameter of interest is a vector of linear contrasts over the collection of average potential outcomes for each treatment. Parameters of this form include standard average treatment effects used to compare one treatment relative to another, but also include parameters which may be of interest in the analysis of factorial designs. We first establish conditions under which a sample analogue estimator is asymptotically normal and construct a consistent estimator of its corresponding asymptotic variance. Combining these results establishes the asymptotic exactness of tests based on these estimators. In contrast, we show that, for two common testing procedures based on t-tests constructed from linear regressions, one test is generally conservative while the other generally invalid. We go on to apply our results to study the asymptotic properties of what we call "fully-blocked" 2^K factorial designs, which are simply matched tuples designs applied to a full factorial experiment. Leveraging our previous results, we establish that our estimator achieves a lower asymptotic variance under the fully-blocked design than that under any stratified factorial design which stratifies the experimental sample into a finite number of "large" strata. A simulation study and empirical application illustrate the practical relevance of our results.


title: Texture Extraction Methods Based Ensembling Framework for Improved Classification

abstract: Texture-based classification solutions have proven their significance in many domains, from industrial inspections to health-related applications. New methods have been developed based on texture feature learning and CNN-based architectures to address computer vision use cases for images with rich texture-based features. In recent years, architectures solving texture-based classification problems and demonstrating state-of-the-art results have emerged. Yet, one limitation of these approaches is that they cannot claim to be suitable for all types of image texture patterns. Each technique has an advantage for a specific texture type only. To address this shortcoming, we propose a framework that combines more than one texture-based techniques together, uniquely, with a CNN backbone to extract the most relevant texture features. This enables the model to be trained in a self-selective manner and produce improved results over current published benchmarks -- with almost same number of model parameters. Our proposed framework works well on most texture types simultaneously and allows flexibility for additional texture-based methods to be accommodated to achieve better results than existing architectures. In this work, firstly, we present an analysis on the relative importance of existing techniques when used alone and in combination with other TE methods on benchmark datasets. Secondly, we show that Global Average Pooling which represents the spatial information -- is of less significance in comparison to the TE method(s) applied in the network while training for texture-based classification tasks. Finally, we present state-of-the-art results for several texture-based benchmark datasets by combining three existing texture-based techniques using our proposed framework.


title: Positivity of the Lyapunov exponent for analytic quasiperiodic operators with arbitrary finite-valued background

abstract: We study lower bounds on the Lyapunov exponent associated with one-frequency quasiperiodic Schr\"odinger operators with an added finite valued background potential. We prove that, for sufficiently large coupling constant, the Lyapunov exponent is positive with a uniform (in energy and background) minoration.


title: Alternating Mirror Descent for Constrained Min-Max Games

abstract: In this paper we study two-player bilinear zero-sum games with constrained strategy spaces. An instance of natural occurrences of such constraints is when mixed strategies are used, which correspond to a probability simplex constraint. We propose and analyze the alternating mirror descent algorithm, in which each player takes turns to take action following the mirror descent algorithm for constrained optimization. We interpret alternating mirror descent as an alternating discretization of a skew-gradient flow in the dual space, and use tools from convex optimization and modified energy function to establish an $O(K^{-2/3})$ bound on its average regret after $K$ iterations. This quantitatively verifies the algorithm's better behavior than the simultaneous version of mirror descent algorithm, which is known to diverge and yields an $O(K^{-1/2})$ average regret bound. In the special case of an unconstrained setting, our results recover the behavior of alternating gradient descent algorithm for zero-sum games which was studied in (Bailey et al., COLT 2020).


title: Toric multisections and curves in rational surfaces

abstract: We study multisections of embedded surfaces in 4-manifolds admitting effective torus actions. We show that a simply-connected 4-manifold admits a genus one multisection if and only if it admits an effective torus action. Orlik and Raymond showed that these 4-manifolds are precisely the connected sums of copies of $\mathbb{CP}^2$, $\overline{\mathbb{CP}^2}$, and $S^2\times S^2$. Therefore, embedded surfaces in these 4-manifolds can be encoded diagrammatically on a genus one surface. Our main result is that every smooth, complex curve in $\mathbb{CP}^1\times\mathbb{CP}^1$ can be put in efficient bridge position with respect to a genus one 4-section. We also analyze the algebraic topology of genus one multisections.


title: Improved two-stage hate speech classification for twitter based on Deep Neural Networks

abstract: Hate speech is a form of online harassment that involves the use of abusive language, and it is commonly seen in social media posts. This sort of harassment mainly focuses on specific group characteristics such as religion, gender, ethnicity, etc and it has both societal and economic consequences nowadays. The automatic detection of abusive language in text postings has always been a difficult task, but it is lately receiving much interest from the scientific community. This paper addresses the important problem of discerning hateful content in social media. The model we propose in this work is an extension of an existing approach based on LSTM neural network architectures, which we appropriately enhanced and fine-tuned to detect certain forms of hatred language, such as racism or sexism, in a short text. The most significant enhancement is the conversion to a two-stage scheme consisting of Recurrent Neural Network (RNN) classifiers. The output of all One-vs-Rest (OvR) classifiers from the first stage are combined and used to train the second stage classifier, which finally determines the type of harassment. Our study includes a performance comparison of several proposed alternative methods for the second stage evaluated on a public corpus of 16k tweets, followed by a generalization study on another dataset. The reported results show the superior classification quality of the proposed scheme in the task of hate speech detection as compared to the current state-of-the-art.


title: Skyrmion crystal with integer and fractional skyrmion numbers in a nonsymmorphic lattice structure with the screw axis

abstract: The emergence of a magnetic skyrmion crystal in a nonsymmorphic lattice system with the screw symmetry is numerically investigated. By performing the simulated annealing for a layered spin model with the isotropic exchange interaction and the antisymmetric Dzyaloshinskii-Moriya interaction, and then constructing a low-temperature phase diagram, we reveal that the skyrmion crystal is stabilized in both zero and nonzero fields even without the threefold rotational symmetry in the two-dimensional plane. We show that a competition between the ferromagnetic interlayer exchange interaction and the layer- and momentum-dependent anisotropic interactions is a source of the skyrmion crystals in the presence of the screw axis. Moreover, we find two types of layer-dependent skyrmion crystals, which are characterized as a coexisting state of the skyrmion crystal and the spiral state, in the narrow field region. Our result provides a reference for further search of the skyrmion crystals in nonsymmorphic lattice systems.


title: The effects of intra-detector Compton scatter on zero-frequency DQE for photon-counting CT using edge-on-irradiated silicon detectors

abstract: Background: Edge-on-irradiated silicon detectors are currently being investigated for use in photon-counting CT applications. The low atomic number of silicon leads to a significant number of incident photons being Compton scattered in the detector, depositing a part of their energy and potentially being counted multiple times. Although the physics of Compton scatter is well established, the effects of Compton interactions in the detector on image quality for an edge-on-irradiated silicon detector have still not been thoroughly investigated. Purpose: To investigate and explain effects of Compton scatter on zero-frequency DQE for photon-counting CT using edge-on-irradiated silicon detectors. Methods: We extend an existing Monte Carlo model of an edge-on-irradiated silicon detector to develop projection and image domain performance metrics for pure density and pure spectral imaging tasks. We show that the lowest energy threshold of the detector can be used as an effective discriminator of primary counts and cross-talk caused by Compton scatter. We study the developed metrics as functions of the lowest threshold energy. Results: Density imaging performance decreases monotonically as a function of the lowest threshold in both projection and image domains. Spectral imaging performance has a plateau between 0 and 10 keV and decreases monotonically thereafter, in both projection and image domain. Conclusions: Compton interactions contribute significantly to the density imaging performance of edge-on-irradiated silicon detectors. With the studied detector topology, the benefit of counting primary Compton interactions outweighs the penalty of multiple counting at all lower threshold energies. Compton interactions also contribute significantly to the spectral imaging performance for measured energies above 10 keV.


title: Strong probabilistic stability in holomorphic families of endomorphisms of $\mathbb{P}^k(\mathbb{C})$ and polynomial-like maps

abstract: We prove that, in stable families of endomorphisms of $\mathbb{P}^k(\mathbb{C})$, all invariant measures whose measure-theoretic entropy is strictly larger than $(k-1)\log d$ at a given parameter can be followed holomorphically with the parameter in all the parameter space. As a consequence, almost all points (with respect to any such measure at any parameter) in the Julia set can be followed holomorphically without intersections. This generalizes previous results by Berteloot, Dupont, and the first author for the measure of maximal entropy, and provides a parallel in this setting to the probabilistic stability of H\'enon maps by Berger-Dujardin-Lyubich. Our proof relies both on techniques from the theory of stability/bifurcation in any dimension and on an explicit lower bound for the Lyapunov exponents for an ergodic measure in terms of its measure-theoretic entropy, due to de Th\'elin and Dupont. A local version of our result holds also for all measures supported on the Julia set with just strictly positive Lyapunov exponents and not charging the post-critical set. Analogous results hold in families of polynomial-like maps of large topological degree. In this case, as part of our proof, we also give a sufficient condition for the positivity of the Lyapunov exponents of an ergodic measure for a polynomial-like map in any dimension in term of its measure-theoretic entropy, generalizing to this setting the analogous result by de Th\'elin and Dupont valid on $\mathbb{P}^k(\mathbb{C})$.


title: Planning with Dynamically Estimated Action Costs

abstract: Information about action costs is critical for real-world AI planning applications. Rather than rely solely on declarative action models, recent approaches also use black-box external action cost estimators, often learned from data, that are applied during the planning phase. These, however, can be computationally expensive, and produce uncertain values. In this paper we suggest a generalization of deterministic planning with action costs that allows selecting between multiple estimators for action cost, to balance computation time against bounded estimation uncertainty. This enables a much richer -- and correspondingly more realistic -- problem representation. Importantly, it allows planners to bound plan accuracy, thereby increasing reliability, while reducing unnecessary computational burden, which is critical for scaling to large problems. We introduce a search algorithm, generalizing $A^*$, that solves such planning problems, and additional algorithmic extensions. In addition to theoretical guarantees, extensive experiments show considerable savings in runtime compared to alternatives.


title: The impact of $^{17}$O$+\alpha$ reaction rate uncertainties on the s-process in rotating massive stars

abstract: Massive stars are crucial to galactic chemical evolution for elements heavier than iron. Their contribution at early times in the evolution of the Universe, however, is unclear due to poorly constrained nuclear reaction rates. The competing $^{17}$O($\alpha,\gamma$)$^{21}$Ne and $^{17}$O($\alpha,n$)$^{20}$Ne reactions strongly impact weak s-process yields from rotating massive stars at low metallicities. Abundant $^{16}$O absorbs neutrons, removing flux from the s-process, and producing $^{17}$O. The $^{17}$O($\alpha,n$)$^{20}$Ne reaction releases neutrons, allowing continued s-process nucleosynthesis, if the $^{17}$O($\alpha,\gamma$)$^{21}$Ne reaction is sufficiently weak. While published rates are available, they are based on limited indirect experimental data for the relevant temperatures and, more importantly, no uncertainties are provided. The available nuclear physics has been evaluated, and combined with data from a new study of astrophysically relevant $^{21}$Ne states using the $^{20}$Ne($d,p$)$^{21}$Ne reaction. Constraints are placed on the ratio of the ($\alpha,n$)/($\alpha,\gamma$) reaction rates with uncertainties on the rates provided for the first time. The new rates favour the ($\alpha,n$) reaction and suggest that the weak s-process in rotating low-metallicity stars is likely to continue up to barium and, within the computed uncertainties, even to lead.


title: Incremental Recursive Ranking Grouping for Large Scale Global Optimization

abstract: Real-world optimization problems may have a different underlying structure. In black-box optimization, the dependencies between decision variables remain unknown. However, some techniques can discover such interactions accurately. In Large Scale Global Optimization (LSGO), problems are high-dimensional. It was shown effective to decompose LSGO problems into subproblems and optimize them separately. The effectiveness of such approaches may be highly dependent on the accuracy of problem decomposition. Many state-of-the-art decomposition strategies are derived from Differential Grouping (DG). However, if a given problem consists of non-additively separable subproblems, DG-based strategies may discover many non-existing interactions. On the other hand, monotonicity checking strategies proposed so far do not report non-existing interactions for any separable subproblems but may miss discovering many of the existing ones. Therefore, we propose Incremental Recursive Ranking Grouping (IRRG) that suffers from none of these flaws. IRRG consumes more fitness function evaluations than the recent DG-based propositions, e.g., Recursive DG 3 (RDG3). Nevertheless, the effectiveness of the considered Cooperative Co-evolution frameworks after embedding IRRG or RDG3 was similar for problems with additively separable subproblems that are suitable for RDG3. After replacing the additive separability with non-additive, embedding IRRG leads to results of significantly higher quality.


title: Quarkonium in a spin dependent quark anti-quark potential at finite temperature

abstract: We study the states of $c\bar{c}$ and $b\bar{b}$ system in a non-relativistic a spin dependent potential model at finite temperature. The potential incorporate color screening effect through a parameter $\mu$. The parameter $\mu$ along with strong coupling constant $\alpha_s$ and string tension $\sigma$ are taken temperature dependent and their values are fitted to the Lattice data of quark anti-quark potential available at different values of temperature. The applied potential include spin-spin, spin-orbital, tensor interactions which allow us to study spin singlet and triplet states of quarkonia. By solving non-relativistic Schr{\"o}dinger equation, we find the spectrum of quarkonium states at different temperature and also determine the critical temperature at which each state is dissolved. We find the critical temperature is decreased with orbital and radial excitations, however, for spin singlet and triplet states it remains same.


title: CASS: Cross Architectural Self-Supervision for Medical Image Analysis

abstract: Recent advances in deep learning and computer vision have reduced many barriers to automated medical image analysis, allowing algorithms to process label-free images and improve performance. However, existing techniques have extreme computational requirements and drop a lot of performance with a reduction in batch size or training epochs. This paper presents Cross Architectural - Self Supervision (CASS), a novel self-supervised learning approach that leverages Transformer and CNN simultaneously. Compared to the existing state of the art self-supervised learning approaches, we empirically show that CASS-trained CNNs and Transformers across four diverse datasets gained an average of 3.8% with 1% labeled data, 5.9% with 10% labeled data, and 10.13% with 100% labeled data while taking 69% less time. We also show that CASS is much more robust to changes in batch size and training epochs. Notably, one of the test datasets comprised histopathology slides of an autoimmune disease, a condition with minimal data that has been underrepresented in medical imaging. The code is open source and is available on GitHub.


title: Probing shapes of microbes using liquid crystal textures

abstract: We propose a novel technique to probe shape of a single microbe embedded in a nematic liquid crystal (NLC) sample by observing geometry of dark brushes with optical microscope using a cross-polarizer set up. Assuming certain anchoring conditions for the NLC director at the surface of the microbe, we determine the resulting shapes of brushes using numerical simulations. Our results suggest that for asymmetrical microbes (such as cylindrical shaped bacteria/viruses), resulting brushes may carry the imprints of this asymmetry (e.g. the aspect ratio of cylindrical shape) at relatively large distances to be able to be seen using simple optical microscopy even for microbe sizes in few tens to few hundred nanometer range.


title: Beyond the Edge of Stability via Two-step Gradient Updates

abstract: Gradient Descent (GD) is a powerful workhorse of modern machine learning thanks to its scalability and efficiency in high-dimensional spaces. Its ability to find local minimisers is only guaranteed for losses with Lipschitz gradients, where it can be seen as a `bona-fide' discretisation of an underlying gradient flow. Yet, many ML setups involving overparametrised models do not fall into this problem class, which has motivated research beyond the so-called ``Edge of Stability'' (EoS), where the step-size crosses the admissibility threshold inversely proportional to the Lipschitz constant above. Perhaps surprisingly, GD has been empirically observed to still converge regardless of local instability and oscillatory behavior. The incipient theoretical analysis of this phenomena has mainly focused in the overparametrised regime, where the effect of choosing a large learning rate may be associated to a `Sharpness-Minimisation' implicit regularisation within the manifold of minimisers, under appropriate asymptotic limits. In contrast, in this work we directly examine the conditions for such unstable convergence, focusing on simple, yet representative, learning problems, via analysis of two-step gradient updates. Specifically, we characterize a local condition involving third-order derivatives that guarantees existence and convergence to fixed points of the two-step updates, and leverage such property in a teacher-student setting, under population loss. Finally, starting from Matrix Factorization, we provide observations of period-2 orbit of GD in high-dimensional settings with intuition of its dynamics, along with exploration into more general settings.


title: Design of electrostatic feedback for an experiment to measure $G$

abstract: The torsion pendulum at the heart of the apparatus to measure the gravitational constant, $G$ at the Bureau International des Poids et Mesures (BIPM) is used to measure the gravitational torque between source and test-mass assemblies with two methods. In the Cavendish method, the pendulum moves freely. In the electrostatic-servo method, the pendulum is maintained at a constant angle by applying an electrostatic torque equal and opposite to any gravitational torque on the pendulum. The electrostatic torque is generated by a servo. This article describes the design and implementation of this servo at the National Institute of Standards and Technology. We use a digital servo loop with a Kalman filter to achieve measurement performance comparable to the one in an open loop. We show that it is possible to achieve small measurement uncertainty with an experiment that uses three electrodes for feedback control.


title: Observation of Photoluminescence from a Natural van der Waals Heterostructure

abstract: Van der Waals heterostructures comprised of two-dimensional (2D) materials offer a platform to obtain materials by design with unique electronic properties. Franckeite (Fr) is a naturally occurring van der Waals heterostructure comprised of two distinct alternately stacked semiconducting layers; (i) SnS$_2$ layer and (ii) Pb$_3$SbS$_4$. Though both layers in the heterostructure are semiconductors, the photoluminescence from Franckeite remains elusive. Here, we report the observation of photoluminescence (PL) from Franckeite for the first time. We observed two PL peaks at ~ 1.93 eV and ~ 2.11 eV. By varying the temperature from 1.5 K to 80 K, we found that the PL peak position redshifts and the integrated intensity decreases slowly as we increase the temperature. We observed linear dependence of photoluminescence integrated intensity on excitation laser power indicating that the photoluminescence is originating from free excitons in the SnS$_2$ layer of Fr. By comparing the PL from Fr with the PL from a monolayer MoS$_2$, we determined that the PL quantum efficiency from Fr is an order of magnitude lower than that of a monolayer MoS$_2$. Our study provides a fundamental understanding of the optical behavior in a complex naturally occurring van der Waals heterostructure, and may pave an avenue toward developing nanoscale optical and optoelectronic devices with tailored properties.


title: Boundary $h^\ast$-polynomials of rational polytopes

abstract: If $P$ is a lattice polytope (i.e., $P$ is the convex hull of finitely many integer points in $\mathbb{R}^d$) of dimension $d$, Ehrhart's famous theorem (1962) asserts that the integer-point counting function $|nP \cap \mathbb{Z}^d|$ is a degree-$d$ polynomial in the integer variable $n$. Equivalently, the generating function $1 + \sum_{n\geq 1} |nP \cap \mathbb{Z}^d| \, z^n$ is a rational function of the form $\frac{ h^\ast(z) }{ (1-z)^{ d+1 } }$; we call $h^\ast(z)$ the $h^\ast$-polynomial of $P$. There are several known necessary conditions for $h^\ast$-polynomials, including results by Hibi (1990), Stanley (1991), and Stapledon (2009), who used an interplay of arithmetic (integer-point structure) and topological (local $h$-vectors of triangulations) data of a given polytope. We introduce an alternative ansatz to understand Ehrhart theory through the $h^\ast$-polynomial of the boundary of a polytope, recovering all of the above results and their extensions for rational polytopes in a unifying manner. We include applications for (rational) Gorenstein polytopes and rational Ehrhart dilations.


title: VN-Transformer: Rotation-Equivariant Attention for Vector Neurons

abstract: Rotation equivariance is a desirable property in many practical applications such as motion forecasting and 3D perception, where it can offer benefits like sample efficiency, better generalization, and robustness to input perturbations. Vector Neurons (VN) is a recently developed framework offering a simple yet effective approach for deriving rotation-equivariant analogs of standard machine learning operations by extending one-dimensional scalar neurons to three-dimensional "vector neurons." We introduce a novel "VN-Transformer" architecture to address several shortcomings of the current VN models. Our contributions are: $(i)$ we derive a rotation-equivariant attention mechanism which eliminates the need for the heavy feature preprocessing required by the original Vector Neurons models; $(ii)$ we extend the VN framework to support non-spatial attributes, expanding the applicability of these models to real-world datasets; $(iii)$ we derive a rotation-equivariant mechanism for multi-scale reduction of point-cloud resolution, greatly speeding up inference and training; $(iv)$ we show that small tradeoffs in equivariance ($\epsilon$-approximate equivariance) can be used to obtain large improvements in numerical stability and training robustness on accelerated hardware, and we bound the propagation of equivariance violations in our models. Finally, we apply our VN-Transformer to 3D shape classification and motion forecasting with compelling results.


title: Towards Continuous Systematic Literature Review in Software Engineering

abstract: Context: New scientific evidence continuously arises with advances in Software Engineering (SE) research. Conventionally, Systematic Literature Reviews (SLRs) are not updated or updated intermittently, leaving gaps between updates, during which time the SLR may be missing crucial new evidence. Goal: We propose and evaluate a concept and process called Continuous Systematic Literature Review (CSLR) in SE. Method: To elaborate on the CSLR concept and process, we performed a synthesis of evidence by conducting a meta-ethnography, addressing knowledge from varied research areas. Furthermore, we conducted a case study to evaluate the CSLR process. Results: We describe the resulting CSLR process in BPMN format. The case study results provide indications on the importance and feasibility of applying CSLR in practice to continuously update SLR evidence in SE. Conclusion: The CSLR concept and process provide a feasible and systematic way to continuously incorporate new evidence into SLRs, supporting trustworthy and up-to-date evidence for SLRs in SE.


title: Determination of $m_c$ from $N_f = 2+1$ QCD with Wilson fermions

abstract: We present preliminary results for the charm quark mass in the $N_f=4$ RGI scheme. These were obtained using $N_f=2+1$ CLS ensembles with $\mathcal{O}(a)$ non-perturbatively improved Wilson fermions. We employed five different lattice spacings, ranging down to $a\lesssim 0.04$ fm and realized approximately physical pion and kaon masses, with ensembles spread out along three different trajectories in the quark mass plane, enabling a thorough study of the dependence on the lattice spacing and the light and strange sea quark masses. We sketch our analysis strategy and find that the dominant errors at present are due to the renormalization and scale setting uncertainties.


title: Automating Ambiguity: Challenges and Pitfalls of Artificial Intelligence

abstract: Machine learning (ML) and artificial intelligence (AI) tools increasingly permeate every possible social, political, and economic sphere; sorting, taxonomizing and predicting complex human behaviour and social phenomena. However, from fallacious and naive groundings regarding complex adaptive systems to datasets underlying models, these systems are beset by problems, challenges, and limitations. They remain opaque and unreliable, and fail to consider societal and structural oppressive systems, disproportionately negatively impacting those at the margins of society while benefiting the most powerful. The various challenges, problems and pitfalls of these systems are a hot topic of research in various areas, such as critical data/algorithm studies, science and technology studies (STS), embodied and enactive cognitive science, complexity science, Afro-feminism, and the broadly construed emerging field of Fairness, Accountability, and Transparency (FAccT). Yet, these fields of enquiry often proceed in silos. This thesis weaves together seemingly disparate fields of enquiry to examine core scientific and ethical challenges, pitfalls, and problems of AI. In this thesis I, a) review the historical and cultural ecology from which AI research emerges, b) examine the shaky scientific grounds of machine prediction of complex behaviour illustrating how predicting complex behaviour with precision is impossible in principle, c) audit large scale datasets behind current AI demonstrating how they embed societal historical and structural injustices, d) study the seemingly neutral values of ML research and put forward 67 prominent values underlying ML research, e) examine some of the insidious and worrying applications of computer vision research, and f) put forward a framework for approaching challenges, failures and problems surrounding ML systems as well as alternative ways forward.