title: Variance-Aware Machine Translation Test Sets

abstract: We release 70 small and discriminative test sets for machine translation (MT) evaluation called variance-aware test sets (VAT), covering 35 translation directions from WMT16 to WMT20 competitions. VAT is automatically created by a novel variance-aware filtering method that filters the indiscriminative test instances of the current MT test sets without any human labor. Experimental results show that VAT outperforms the original WMT test sets in terms of the correlation with human judgement across mainstream language pairs and test sets. Further analysis on the properties of VAT reveals the challenging linguistic features (e.g., translation of low-frequency words and proper nouns) for competitive MT systems, providing guidance for constructing future MT test sets. The test sets and the code for preparing variance-aware MT test sets are freely available at https://github.com/NLP2CT/Variance-Aware-MT-Test-Sets .


title: Cross-modal Zero-shot Hashing by Label Attributes Embedding

abstract: Cross-modal hashing (CMH) is one of the most promising methods in cross-modal approximate nearest neighbor search. Most CMH solutions ideally assume the labels of training and testing set are identical. However, the assumption is often violated, causing a zero-shot CMH problem. Recent efforts to address this issue focus on transferring knowledge from the seen classes to the unseen ones using label attributes. However, the attributes are isolated from the features of multi-modal data. To reduce the information gap, we introduce an approach called LAEH (Label Attributes Embedding for zero-shot cross-modal Hashing). LAEH first gets the initial semantic attribute vectors of labels by word2vec model and then uses a transformation network to transform them into a common subspace. Next, it leverages the hash vectors and the feature similarity matrix to guide the feature extraction network of different modalities. At the same time, LAEH uses the attribute similarity as the supplement of label similarity to rectify the label embedding and common subspace. Experiments show that LAEH outperforms related representative zero-shot and cross-modal hashing methods.


title: Absence of temperature-dependent phonon anomalies in Sr2IrO4 and Sr3Ir2O7

abstract: Following previous works reporting an anomalous behavior of several zone-center optical phonons across the magnetic transition of square lattice iridates Sr2IrO4 and Sr3Ir2O7, we have investigated the lattice dynamics as a function of momentum in these materials by means of high-resolution inelastic x-ray scattering (IXS). The observed phonon energies and scattering intensities across the Brillouin zone are in excellent agreement with ab-initio lattice dynamical calculations based on non-magnetic density-functional-perturbation theory (DFPT). Our results do not evidence any renormalization of the phonons at finite momentum across the magnetic transition of Sr2IrO4. The only anomalous behavior was detected for the in-plane polarized longitudinal-acoustic phonon branch in Sr3Ir2O7, which anomalously softens towards low temperatures and might be related to anisotropic negative thermal expansion in this compound. No anomalies related to potential charge ordering were observed.


title: Pattern-based Subterm Selection in Isabelle

abstract: This article presents a pattern-based language designed to select (a set of) subterms of a given term in a concise and robust way. Building on this language, we implement a single-step rewriting tactic in the Isabelle theorem prover, which removes the need for obscure "occurrence numbers" for subterm selection. The language was inspired by the \emph{language of patterns} of Gonthier and Tassi, but provides an elegant way of handling bound variables and a modular semantics.


title: Order-theoretic trees: monadic second-order descriptions and regularity

abstract: An order-theoretic forest is a countable partial order such that the set of elements larger than any element is linearly ordered. It is an order-theoretic tree if any two elements have an upper-bound. The order type of a branch can be any countable linear order. Such generalized infinite trees yield convenient definitions of the rank-width and the modular decomposition of countable graphs. We define an algebra based on only four operations that generate up to isomorphism and via infinite terms these order-theoretic trees and forests. We prove that the associated regular objects, those defined by regular terms, are exactly the ones that are the unique models of monadic second-order sentences.


title: Statistical physics of exchangeable sparse simple networks, multiplex networks and simplicial complexes

abstract: Exchangeability is a desired statistical property of network ensembles requiring their invariance upon relabelling of the nodes. However combining sparsity of network ensembles with exchangeability is challenging. Here we propose a statistical physics framework and a Metropolis-Hastings algorithm defining exchangeable sparse network ensembles. The model generates networks with heterogeneous degree distributions by enforcing only global constraints while existing (non exchangeable) exponential random graphs enforce an extensive number of local constraints. This very general theoretical framework to describe exchangeable networks is here first formulated for uncorrelated simple networks and then it is extended to treat simple networks with degree correlations, directed networks, bipartite networks and generalized network structures including multiplex networks and simplicial complexes. In particular here we formulate and treat both uncorrelated and correlated exchangeable ensembles of simplicial complexes using statistical mechanics approaches.


title: Modelling and Optimisation of Resource Usage in an IoT Enabled Smart Campus

abstract: University campuses are essentially a microcosm of a city. They comprise diverse facilities such as residences, sport centres, lecture theatres, parking spaces, and public transport stops. Universities are under constant pressure to improve efficiencies while offering a better experience to various stakeholders including students, staff, and visitors. Nonetheless, anecdotal evidence indicates that campus assets are not being utilised efficiently, often due to the lack of data collection and analysis, thereby limiting the ability to make informed decisions on the allocation and management of resources. Advances in the Internet of Things (IoT) technologies that can sense and communicate data from the physical world, coupled with data analytics and Artificial intelligence (AI) that can predict usage patterns, have opened up new opportunities for organisations to lower cost and improve user experience. This thesis explores this opportunity via theory and experimentation using UNSW Sydney as a living laboratory.


title: Meta Cross-Modal Hashing on Long-Tailed Data

abstract: Due to the advantage of reducing storage while speeding up query time on big heterogeneous data, cross-modal hashing has been extensively studied for approximate nearest neighbor search of multi-modal data. Most hashing methods assume that training data is class-balanced.However, in practice, real world data often have a long-tailed distribution. In this paper, we introduce a meta-learning based cross-modal hashing method (MetaCMH) to handle long-tailed data. Due to the lack of training samples in the tail classes, MetaCMH first learns direct features from data in different modalities, and then introduces an associative memory module to learn the memory features of samples of the tail classes. It then combines the direct and memory features to obtain meta features for each sample. For samples of the head classes of the long tail distribution, the weight of the direct features is larger, because there are enough training data to learn them well; while for rare classes, the weight of the memory features is larger. Finally, MetaCMH uses a likelihood loss function to preserve the similarity in different modalities and learns hash functions in an end-to-end fashion. Experiments on long-tailed datasets show that MetaCMH performs significantly better than state-of-the-art methods, especially on the tail classes.


title: Cosmological Dependence of Sterile Neutrino Dark Matter With Self-Interacting Neutrinos

abstract: Unexplored interactions of neutrinos could be the key to understanding the nature of the dark matter (DM). In particular, active neutrinos with new self-interactions can produce keV-mass sterile neutrinos that account for the whole of the DM through the Dodelson-Widrow mechanism for a large range of active-sterile mixing values. This production typically occurs before Big-Bang Nucleosynthesis (BBN) in a yet uncharted era of the Universe. We assess how the mixing range for keV-mass sterile neutrino DM is affected by the uncertainty in the early Universe pre-BBN cosmology. This is particularly relevant for identifying the viable parameter space of sterile neutrino searches allowed by all astrophysical limits, as well as for cosmology, since the detection of a sterile neutrino could constitute the first observation of a particle providing information about the pre-BBN epoch. We find that the combined uncertainties in the early Universe cosmology and neutrino interactions significantly expand the allowed parameter space for sterile neutrinos that can constitute the whole of the DM.


title: Neutrino and Axion Astronomy with Dark Matter Experiments

abstract: Sensitive dark matter (DM) experiments can be well exploited beyond their designated targets, allowing to explore a breadth of physics topics. As we discuss, future large direct DM detection experiments constitute impressive telescopes, complementary to conventional neutrino detectors. This opens a new window into neutrino astronomy, including puzzles such as the origin of supermassive black holes and topics like supernova forecast. Furthermore, DM experiments can act as effective instruments for multimessenger astronomy. This is well illustrated by exploration of relativistic axions from transient astrophysical sources (e.g. axion star explosions), providing novel signatures as well as possible insights into the axion potential.


title: Sampling from Log-Concave Distributions with Infinity-Distance Guarantees

abstract: For a $d$-dimensional log-concave distribution $\pi(\theta) \propto e^{-f(\theta)}$ constrained to a convex body $K$, the problem of outputting samples from a distribution $\nu$ which is $\varepsilon$-close in infinity-distance $\sup_{\theta \in K} |\log \frac{\nu(\theta)}{\pi(\theta)}|$ to $\pi$ arises in differentially private optimization. While sampling within total-variation distance $\varepsilon$ of $\pi$ can be done by algorithms whose runtime depends polylogarithmically on $\frac{1}{\varepsilon}$, prior algorithms for sampling in $\varepsilon$ infinity distance have runtime bounds that depend polynomially on $\frac{1}{\varepsilon}$. We bridge this gap by presenting an algorithm that outputs a point $\varepsilon$-close to $\pi$ in infinity distance that requires at most $\mathrm{poly}(\log \frac{1}{\varepsilon}, d)$ calls to a membership oracle for $K$ and evaluation oracle for $f$, when $f$ is Lipschitz. Our approach departs from prior works that construct Markov chains on a $\frac{1}{\varepsilon^2}$-discretization of $K$ to achieve a sample with $\varepsilon$ infinity-distance error, and present a method to directly convert continuous samples from $K$ with total-variation bounds to samples with infinity bounds. This approach also allows us to obtain an improvement on the dimension $d$ in the running time for the problem of sampling from a log-concave distribution on polytopes $K$ with infinity distance $\varepsilon$, by plugging in TV-distance running time bounds for the Dikin Walk Markov chain.


title: Learn-Morph-Infer: a new way of solving the inverse problem for brain tumor modeling

abstract: Current treatment planning of patients diagnosed with a brain tumor, such as glioma, could significantly benefit by accessing the spatial distribution of tumor cell concentration. Existing diagnostic modalities, e.g. magnetic resonance imaging (MRI), contrast sufficiently well areas of high cell density. In gliomas, however, they do not portray areas of low cell concentration, which can often serve as a source for the secondary appearance of the tumor after treatment. To estimate tumor cell densities beyond the visible boundaries of the lesion, numerical simulations of tumor growth could complement imaging information by providing estimates of full spatial distributions of tumor cells. Over recent years a corpus of literature on medical image-based tumor modeling was published. It includes different mathematical formalisms describing the forward tumor growth model. Alongside, various parametric inference schemes were developed to perform an efficient tumor model personalization, i.e. solving the inverse problem. However, the unifying drawback of all existing approaches is the time complexity of the model personalization which prohibits a potential integration of the modeling into clinical settings. In this work, we introduce a deep learning based methodology for inferring the patient-specific spatial distribution of brain tumors from T1Gd and FLAIR MRI medical scans. Coined as Learn-Morph-Infer the method achieves real-time performance in the order of minutes on widely available hardware and the compute time is stable across tumor models of different complexity, such as reaction-diffusion and reaction-advection-diffusion models. We believe the proposed inverse solution approach not only bridges the way for clinical translation of brain tumor personalization but can also be adopted to other scientific and engineering domains.


title: Compactified AdS black holes, Chamblin-Reall background, and their dual non-conformal relativistic fluids

abstract: The Chamblin-Reall background is a static solution of Einstein gravity coupled with a background scalar field and a dynamical domain wall, with the potential of the scalar field being of Liouville type. It can be got by dimensionally reducing a higher dimensional background with a constant potential. Compactified AdS black holes are black hole backgrounds constructed by wrapping one or more spatial directions of a higher dimensional AdS black hole on a torus and then integrating them out. The compactified AdS black hole background is asymptotically flat, non-conformal, and of Chamblin-Reall type. In this work, we derive all the 7 dynamical second-order transport coefficients for the relativistic fluids dual to compactified AdS black holes of various dimensions via fluid/gravity correspondence. Through this work, we achieve three main goals: (1) We prove that all the gravitational backgrounds that can be used to extract analytical results for second-order transport coefficients hitherto are all Chamblin-Reall type backgrounds. (2) We generalize the results in previous studies on the second-order transport coefficients of the relativistic fluids dual to 5-dimensional Chamblin-Reall model into general dimensions. (3) We offer a thorough study on the Kanitscheider-Skenderis proposal and find its physical accounts.


title: Consistency and Consensus Driven for Hesitant Fuzzy Linguistic Decision Making with Pairwise Comparisons

abstract: Hesitant fuzzy linguistic preference relation (HFLPR) is of interest because it provides an efficient way for opinion expression under uncertainty. For enhancing the theory of decision making with HFLPR, the paper introduces an algorithm for group decision making with HFLPRs based on the acceptable consistency and consensus measurements, which involves (1) defining a hesitant fuzzy linguistic geometric consistency index (HFLGCI) and proposing a procedure for consistency checking and inconsistency improving for HFLPR; (2) measuring the group consensus based on the similarity between the original individual HFLPRs and the overall perfect HFLPR, then establishing a procedure for consensus ensuring including the determination of decision-makers weights. The convergence and monotonicity of the proposed two procedures have been proved. Some experiments are furtherly performed to investigate the critical values of the defined HFLGCI, and comparative analyses are conducted to show the effectiveness of the proposed algorithm. A case concerning the performance evaluation of venture capital guiding funds is given to illustrate the availability of the proposed algorithm. As an application of our work, an online decision-making portal is finally provided for decision-makers to utilize the proposed algorithms to solve decision-making problems.


title: Theme Transformer: Symbolic Music Generation with Theme-Conditioned Transformer

abstract: Attention-based Transformer models have been increasingly employed for automatic music generation. To condition the generation process of such a model with a user-specified sequence, a popular approach is to take that conditioning sequence as a priming sequence and ask a Transformer decoder to generate a continuation. However, this prompt-based conditioning cannot guarantee that the conditioning sequence would develop or even simply repeat itself in the generated continuation. In this paper, we propose an alternative conditioning approach, called theme-based conditioning, that explicitly trains the Transformer to treat the conditioning sequence as a thematic material that has to manifest itself multiple times in its generation result. This is achieved with two main technical contributions. First, we propose a deep learning-based approach that uses contrastive representation learning and clustering to automatically retrieve thematic materials from music pieces in the training data. Second, we propose a novel gated parallel attention module to be used in a sequence-to-sequence (seq2seq) encoder/decoder architecture to more effectively account for a given conditioning thematic material in the generation process of the Transformer decoder. We report on objective and subjective evaluations of variants of the proposed Theme Transformer and the conventional prompt-based baseline, showing that our best model can generate, to some extent, polyphonic pop piano music with repetition and plausible variations of a given condition.


title: Acquisition-invariant brain MRI segmentation with informative uncertainties

abstract: Combining multi-site data can strengthen and uncover trends, but is a task that is marred by the influence of site-specific covariates that can bias the data and therefore any downstream analyses. Post-hoc multi-site correction methods exist but have strong assumptions that often do not hold in real-world scenarios. Algorithms should be designed in a way that can account for site-specific effects, such as those that arise from sequence parameter choices, and in instances where generalisation fails, should be able to identify such a failure by means of explicit uncertainty modelling. This body of work showcases such an algorithm, that can become robust to the physics of acquisition in the context of segmentation tasks, while simultaneously modelling uncertainty. We demonstrate that our method not only generalises to complete holdout datasets, preserving segmentation quality, but does so while also accounting for site-specific sequence choices, which also allows it to perform as a harmonisation tool.


title: Iterative Causal Discovery in the Possible Presence of Latent Confounders and Selection Bias

abstract: We present a sound and complete algorithm, called iterative causal discovery (ICD), for recovering causal graphs in the presence of latent confounders and selection bias. ICD relies on the causal Markov and faithfulness assumptions and recovers the equivalence class of the underlying causal graph. It starts with a complete graph, and consists of a single iterative stage that gradually refines this graph by identifying conditional independence (CI) between connected nodes. Independence and causal relations entailed after any iteration are correct, rendering ICD anytime. Essentially, we tie the size of the CI conditioning set to its distance on the graph from the tested nodes, and increase this value in the successive iteration. Thus, each iteration refines a graph that was recovered by previous iterations having smaller conditioning sets -- a higher statistical power -- which contributes to stability. We demonstrate empirically that ICD requires significantly fewer CI tests and learns more accurate causal graphs compared to FCI, FCI+, and RFCI algorithms (code is available at https://github.com/IntelLabs/causality-lab).


title: Online Mutual Adaptation of Deep Depth Prediction and Visual SLAM

abstract: The ability of accurate depth prediction by a convolutional neural network (CNN) is a major challenge for its wide use in practical visual simultaneous localization and mapping (SLAM) applications, such as enhanced camera tracking and dense mapping. This paper is set out to answer the following question: Can we tune a depth prediction CNN with the help of a visual SLAM algorithm even if the CNN is not trained for the current operating environment in order to benefit the SLAM performance? To this end, we propose a novel online adaptation framework consisting of two complementary processes: a SLAM algorithm that is used to generate keyframes to fine-tune the depth prediction and another algorithm that uses the online adapted depth to improve map quality. Once the potential noisy map points are removed, we perform global photometric bundle adjustment (BA) to improve the overall SLAM performance. Experimental results on both benchmark datasets and a real robot in our own experimental environments show that our proposed method improves the overall SLAM accuracy. While regularization has been shown to be effective in multi-task classification problems, we present experimental results and an ablation study to show the effectiveness of regularization in preventing catastrophic forgetting in the online adaptation of depth prediction, a single-task regression problem. In addition, we compare our online adaptation framework against the state-of-the-art pre-trained depth prediction CNNs to show that our online adapted depth prediction CNN outperforms the depth prediction CNNs that have been trained on a large collection of datasets.


title: How to use Unimodular Quantum Cosmology for the Prediction of a late-time Classical Universe?

abstract: Unimodular quantum cosmology admits wavepacket solutions that evolve according to a kind of Schr\"odinger equation. Though this theory is equivalent to general relativity on the classical level, its canonical structure is different and the problem of time does not occur. We present an Ehrenfest theorem for the long term evolution of the expectation value of the scale factor for a spatially flat Friedmann universe with a scalar field. We find that the classical and the quantum behaviour in the asymptotic future coincide for the special case of a massless scalar field. We examine the general behaviour of uncertainties in order to single out models that can lead to a classical universe.


title: The Gessel Correspondence and the Partial $\gamma$-Positivity of the Eulerian Polynomials on Multiset Stirling Permutations

abstract: Pondering upon the grammatical labeling of 0-1-2 increasing plane trees, we come to the realization that the grammatical labels play a role as records of chopped off leaves of the original increasing binary trees. While such an understanding is purely psychological, it does give rise to an efficient apparatus to tackle the partial $\gamma$-positivity of the Eulearian polynomials on multiset Stirling permutations, as long as we bear in mind the combinatorial meanings of the labels $x$ and $y$ in the Gessel representation of a $k$-Stirling permutation by means of an increasing $(k+1)$-ary tree. More precisely, we introduce a Foata-Strehl action on the Gessel trees resulting in an interpretation of the partial $\gamma$-coefficients of the aforementioned Eulerian polynomials, different from the ones found by Lin-Ma-Zhang and Yan-Huang-Yang. In particular, our strategy can be adapted to deal with the partial $\gamma$-coefficients of the second order Eulerian polynomials, which in turn can be readily converted to the combinatorial formulation due to Ma-Ma-Yeh in connection with certain statistics of Stirling permutations.


title: Developing neural machine translation models for Hungarian-English

abstract: I train models for the task of neural machine translation for English-Hungarian and Hungarian-English, using the Hunglish2 corpus. The main contribution of this work is evaluating different data augmentation methods during the training of NMT models. I propose 5 different augmentation methods that are structure-aware, meaning that instead of randomly selecting words for blanking or replacement, the dependency tree of sentences is used as a basis for augmentation. I start my thesis with a detailed literature review on neural networks, sequential modeling, neural machine translation, dependency parsing and data augmentation. After a detailed exploratory data analysis and preprocessing of the Hunglish2 corpus, I perform experiments with the proposed data augmentation techniques. The best model for Hungarian-English achieves a BLEU score of 33.9, while the best model for English-Hungarian achieves a BLEU score of 28.6.


title: Quantum-assisted Distortion-free audio signal sensing

abstract: Quantum sensors are keeping the cutting-edge sensitivities in metrology. However, for high-sensitive measurements of arbitrary signals, limitations in linear dynamic range could introduce distortions when sensing the frequency, magnitude and phase of unknown signals. Here, we overcome these limitations with advanced sensing protocol that combines quantum phase-sensitive detection with heterodyne readout. We present theoretical and experimental investigations using nitrogen-vacancy centers in diamond, showing the ability to sense radio signals with a 98 dB linear dynamic range, a 31 pT/Hz$^{1/2}$ sensitivity, and arbitrary frequency resolution. Further, we perform the quantum-assisted distortion-free audio signal (melody, speech) sensing with high fidelity. The methods developed here could broaden the horizon for quantum sensors towards applications in telecommunication, where high-fidelity and low-distortion at multiple frequency bands within small sensing volumes are required.


title: Hierarchical Segment-based Optimization for SLAM

abstract: This paper presents a hierarchical segment-based optimization method for Simultaneous Localization and Mapping (SLAM) system. First we propose a reliable trajectory segmentation method that can be used to increase efficiency in the back-end optimization. Then we propose a buffer mechanism for the first time to improve the robustness of the segmentation. During the optimization, we use global information to optimize the frames with large error, and interpolation instead of optimization to update well-estimated frames to hierarchically allocate the amount of computation according to error of each frame. Comparative experiments on the benchmark show that our method greatly improves the efficiency of optimization with almost no drop in accuracy, and outperforms existing high-efficiency optimization method by a large margin.


title: Transport of condensing droplets in Taylor-Green vortex flow in the presence of thermal noise

abstract: We study the role of phase change and thermal noise in particle transport in turbulent flows. We employ a toy model to extract the main physics: condensing droplets are modelled as heavy particles which grow in size, the ambient flow is modelled as a two-dimensional Taylor-Green (TG) flow consisting of an array of vortices delineated by separatrices, and thermal noise are modelled as uncorrelated Gaussian white noise. In general, heavy inertial particles are centrifuged out of regions of high vorticity and into regions of high strain. In cellular flows, we find, in agreement with earlier results, that droplets with Stokes numbers smaller than a critical value, $St < St_{\rm{cr}}$, remain trapped in the vortices in which they are initialised, while larger droplets move ballistically away from their initial positions by crossing separatrices. We independently vary the P\'eclet number $Pe$ characterising the amplitude of thermal noise and the condensation rate $\Pi$ to study their effects on the critical Stokes number for droplet trapping, as well as on the final states of motion of the droplets. We find that the imposition of thermal noise, or of a finite condensation rate, allows droplets of $St < St_{\rm{cr}}$ to leave their initial vortices. We find that the effects of thermal noise become negligible for growing droplets, and that growing droplets achieve ballistic motion when their Stokes numbers become $\mathcal{O}(1)$. We also find an intermediate regime prior to attaining the ballistic state, in which droplets move diffusively away from their initial vortices in the presence of thermal noise.


title: Dynamics of unfolded protein aggregation

abstract: Unfolded protein aggregation in cellular system is a problem causing various types of diseases depending on which type unfolded proteins aggregate. This phenomenon of aggregation may take place during production, storage, shipment or delivery in the cellular medium. In the present work, we studied a simplified and extended version of unfolded protein aggregation model by Lumry and Eyring using stochastic approach. We solved analytically the Master equation of the model for the probability distribution $P(x,t)$ of the unfolded protein population and the solution was found to be time dependent complex binomial distribution. In the large population limit $P(x,t)\sim \Lambda(x,t)\times Pois(x,t)$. Further, the distribution became Normal distribution at large population and mean of the distribution limit: $P(x,t)\sim\Lambda(x,t)\times N(\langle qx\rangle,\langle qx\rangle)$. The fluctuations inherent in the dynamics measured by Fano factor can have sub-Poisson, Poisson and super-Poisson at different situations.


title: Uncertainty Calibration for Ensemble-Based Debiasing Methods

abstract: Ensemble-based debiasing methods have been shown effective in mitigating the reliance of classifiers on specific dataset bias, by exploiting the output of a bias-only model to adjust the learning target. In this paper, we focus on the bias-only model in these ensemble-based methods, which plays an important role but has not gained much attention in the existing literature. Theoretically, we prove that the debiasing performance can be damaged by inaccurate uncertainty estimations of the bias-only model. Empirically, we show that existing bias-only models fall short in producing accurate uncertainty estimations. Motivated by these findings, we propose to conduct calibration on the bias-only model, thus achieving a three-stage ensemble-based debiasing framework, including bias modeling, model calibrating, and debiasing. Experimental results on NLI and fact verification tasks show that our proposed three-stage debiasing framework consistently outperforms the traditional two-stage one in out-of-distribution accuracy.


title: DQRE-SCnet: A novel hybrid approach for selecting users in Federated Learning with Deep-Q-Reinforcement Learning based on Spectral Clustering

abstract: Machine learning models based on sensitive data in the real-world promise advances in areas ranging from medical screening to disease outbreaks, agriculture, industry, defense science, and more. In many applications, learning participant communication rounds benefit from collecting their own private data sets, teaching detailed machine learning models on the real data, and sharing the benefits of using these models. Due to existing privacy and security concerns, most people avoid sensitive data sharing for training. Without each user demonstrating their local data to a central server, Federated Learning allows various parties to train a machine learning algorithm on their shared data jointly. This method of collective privacy learning results in the expense of important communication during training. Most large-scale machine-learning applications require decentralized learning based on data sets generated on various devices and places. Such datasets represent an essential obstacle to decentralized learning, as their diverse contexts contribute to significant differences in the delivery of data across devices and locations. Researchers have proposed several ways to achieve data privacy in Federated Learning systems. However, there are still challenges with homogeneous local data. This research approach is to select nodes (users) to share their data in Federated Learning for independent data-based equilibrium to improve accuracy, reduce training time, and increase convergence. Therefore, this research presents a combined Deep-QReinforcement Learning Ensemble based on Spectral Clustering called DQRE-SCnet to choose a subset of devices in each communication round. Based on the results, it has been displayed that it is possible to decrease the number of communication rounds needed in Federated Learning.


title: Learning-based Remote Radio Head Selection and Localization in Distributed Antenna System

abstract: In this work, we consider estimating user positions in a spatially distributed antenna system (DAS) from the uplink channel state information (CSI). However, with the increased number of remote radio heads (RRHs), collecting CSI at a central unit (CU) can significantly increase the fronthaul overhead and computational complexity of the CU. This problem can be mitigated by selecting a subset of RRHs. Thus, we present a deep learning-based approach to select a subset of RRHs for wireless localization. We employ an RRH selection layer that is jointly trained with the rest of the network and learn the model parameters as well as the set of selected RRHs. We show that the selection strategy comes at a relatively small cost of localization performance. Nonetheless, by comparison to a trivial approach based on the maximization of the channel gain, we show that the proposed method leads to significant performance gains in a propagation environment dominated by non-line-of-sight.


title: Structure-aware generation of drug-like molecules

abstract: Structure-based drug design involves finding ligand molecules that exhibit structural and chemical complementarity to protein pockets. Deep generative methods have shown promise in proposing novel molecules from scratch (de-novo design), avoiding exhaustive virtual screening of chemical space. Most generative de-novo models fail to incorporate detailed ligand-protein interactions and 3D pocket structures. We propose a novel supervised model that generates molecular graphs jointly with 3D pose in a discretised molecular space. Molecules are built atom-by-atom inside pockets, guided by structural information from crystallographic data. We evaluate our model using a docking benchmark and find that guided generation improves predicted binding affinities by 8% and drug-likeness scores by 10% over the baseline. Furthermore, our model proposes molecules with binding scores exceeding some known ligands, which could be useful in future wet-lab studies.


title: The Witten index for one-dimensional split-step quantum walks under the non-Fredholm condition

abstract: It is recently shown that a split-step quantum walk possesses a chiral symmetry, and that a certain well-defined index can be naturally assigned to it. The index is a well-defined Fredholm index if and only if the associated unitary time-evolution operator has spectral gaps at both $+1$ and $-1.$ In this paper we extend the existing index formula for the Fredholm case to encompass the non-Fredholm case (i.e., gapless case). We make use of a natural extension of the Fredholm index to the non-Fredholm case, known as the Witten index. The aim of this paper is to fully classify the Witten index of the split-step quantum walk by employing the spectral shift function for a rank one perturbation of a fourth order difference operator. It is also shown in this paper that the Witten index can take half-integer values in the non-Fredholm case.


title: Perturbed Bessel operators

abstract: We study perturbed Bessel operators $L_{m^2}=- \partial^2_x + ( m^2 - \frac14 )\frac{1}{x^2} + Q(x)$ on $L^2]0,\infty[$, where $m\in\mathbb{C}$ and $Q$ is a complex locally integrable potential. Assuming that $Q$ is integrable near $\infty$ and $x\mapsto x^{1-\varepsilon}Q(x)$ is integrable near $0$, with $\varepsilon\ge0$, we construct solutions to $L_{m^2} f = - k^2 f$ with prescribed behaviors near $0$. The special cases $m=0$ and $k=0$ are included in our analysis. Our proof relies on mapping properties of various Green's operators of the unperturbed Bessel operator. Then we determine all closed realizations of $L_{m^2}$ and show that they can be organized as holomorphic families of closed operators.


title: Endemic state equivalence between non-Markovian SEIS and Markov SIS model in complex networks

abstract: In the light of several major epidemic events that emerged in the past two decades, and emphasized by the COVID-19 pandemics, the non-Markovian spreading models occurring on complex networks gained significant attention from the scientific community. Following this interest, in this article, we explore the relations that exist between the non-Markovian SEIS (Susceptible--Exposed--Infectious--Susceptible) and the classical Markov SIS, as basic re-occurring virus spreading models in complex networks. We investigate the similarities and seek for equivalences both for the discrete-time and the continuous-time forms. First, we formally introduce the continuous-time non-Markovian SEIS model, and derive the epidemic threshold in a strict mathematical procedure. Then we present the main result of the paper that, providing certain relations between process parameters hold, the stationary-state solutions of the status probabilities in the non-Markovian SEIS may be found from the stationary state probabilities of the Markov SIS model. This result has a two-fold significance. First, it simplifies the computational complexity of the non-Markovian model in practical applications, where only the stationary distribution of the state probabilities is required. Next, it defines the epidemic threshold of the non-Markovian SEIS model, without the necessity of a thrall mathematical analysis. We present this result both in analytical form, and confirm the result trough numerical simulations. Furthermore, as of secondary importance, in an analytical procedure we show that each Markov SIS may be represented as non-Markovian SEIS model.


title: Configuration entropy and confinement-deconfinement transition in higher-dimensional hard wall model

abstract: We consider a higher-dimensional hard wall model with an infrared (IR) cut-off in asymptotically AdS space and investigate its thermodynamics via the holographic renormalization method. We find a relation between the confinement temperature and the IR cut-off for any dimension. It is also shown that the entropy of $p$-branes with the number of coincident branes (the number of the gauge group) $N$ jumps from leading order in $\cal O$($N^0$) at the confining low temperature phase to $\cal O$($N^{\frac{p+1}{2}}$) at the deconfining high temperature phase like $D3$-branes ($p=3$) case. On the other hand, we calculate the configuration entropy (CE) of various magnitudes of an inverse temperature at an given IR cut-off scale. It is shown that as the inverse temperature grows up, the CE above the critical temperature decreases and AdS black hole (BH) is stable while it below the critical temperature is constant and thermal AdS (ThAdS) is stable. In particular, we also find that the CE below the critical temperature becomes constant and its magnitude increases as a dimension of AdS space increases.


title: MetaMIML: Meta Multi-Instance Multi-Label Learning

abstract: Multi-Instance Multi-Label learning (MIML) models complex objects (bags), each of which is associated with a set of interrelated labels and composed with a set of instances. Current MIML solutions still focus on a single-type of objects and assumes an IID distribution of training data. But these objects are linked with objects of other types, %(i.e., pictures in Facebook link with various users), which also encode the semantics of target objects. In addition, they generally need abundant labeled data for training. To effectively mine interdependent MIML objects of different types, we propose a network embedding and meta learning based approach (MetaMIML). MetaMIML introduces the context learner with network embedding to capture semantic information of objects of different types, and the task learner to extract the meta knowledge for fast adapting to new tasks. In this way, MetaMIML can naturally deal with MIML objects at data level improving, but also exploit the power of meta-learning at the model enhancing. Experiments on benchmark datasets demonstrate that MetaMIML achieves a significantly better performance than state-of-the-art algorithms.


title: Stable Lifelong Learning: Spiking neurons as a solution to instability in plastic neural networks

abstract: Synaptic plasticity poses itself as a powerful method of self-regulated unsupervised learning in neural networks. A recent resurgence of interest has developed in utilizing Artificial Neural Networks (ANNs) together with synaptic plasticity for intra-lifetime learning. Plasticity has been shown to improve the learning capabilities of these networks in generalizing to novel environmental circumstances. However, the long-term stability of these trained networks has yet to be examined. This work demonstrates that utilizing plasticity together with ANNs leads to instability beyond the pre-specified lifespan used during training. This instability can lead to the dramatic decline of reward seeking behavior, or quickly lead to reaching environment terminal states. This behavior is shown to hold consistent for several plasticity rules on two different environments across many training time-horizons: a cart-pole balancing problem and a quadrupedal locomotion problem. We present a solution to this instability through the use of spiking neurons.


title: Formal Barriers to Simple Algorithms for the Matroid Secretary Problem

abstract: Babaioff et al. [BIK2007] introduced the matroid secretary problem in 2007, a natural extension of the classic single-choice secretary problem to matroids, and conjectured that a constant-competitive online algorithm exists. The conjecture still remains open despite substantial partial progress, including constant-competitive algorithms for numerous special cases of matroids, and an $O(\log \log \text{rank})$-competitive algorithm in the general case. Many of these algorithms follow principled frameworks. The limits of these frameworks are previously unstudied, and prior work establishes only that a handful of particular algorithms cannot resolve the matroid secretary conjecture. We initiate the study of impossibility results for frameworks to resolve this conjecture. We establish impossibility results for a natural class of greedy algorithms and for randomized partition algorithms, both of which contain known algorithms that resolve special cases.


title: A survey of two analytical wake models for crosswind kite power systems

abstract: This paper presents two novel analytical wake models for crosswind kite power systems. One is developed based on the continuity equation, and the other based on both the continuity and momentum equations. For each model, equations for the wake flow speed as well as the wake shape are obtained through a rigorous theoretical approach. Wake models for crosswind kites provide a first step in the understanding of the effects of kite-to-kite aerodynamic interactions on prospective wind energy kite farms. Despite a fair number of computational studies on these wakes, few studies have attempted to provide a concrete analytical solution. Indeed, the primary motivation of this study comes from the fact that analytical models are simple in form and require very little computational power when being solved. The results from the two analytical models are compared with each other and are validated against computational results. Bearing several assumptions, these models are meant to simply offer a preliminary insight that will hopefully see many improvements with added complexity in the near future.


title: Correlation between plastic rearrangements and local structure in a cyclically driven glass

abstract: The correlation between local structure and the propensity for structural rearrangements has been widely investigated in glass forming liquids and glasses. In this paper we use the excess two-body entropy $S_2$ and tetrahedrality $\n_{tet}$ as the per-particle local structural order parameters to explore such correlations in a three-dimensional model glass subjected to cyclic shear deformation. We first show that for both liquid configurations and the corresponding inherent structures, local ordering increases upon lowering temperature, signaled by a decrease in the two-body entropy and an increase in tetrahedrality. When the inherent structures, or glasses, are periodically sheared athermally, they eventually reach absorbing states for small shear amplitudes, which do not change from one cycle to the next. Large strain amplitudes result in the formation of shear bands, within which particle motion is diffusive. We show that in the steady state, there is a clear difference in the local structural environment of particles that will be part of plastic rearrangements during the next shear cycle and that of particles that are immobile. In particular, particles with higher $S_2$ and lower $n_{tet}$ are more likely to go through rearrangements irrespective of the average energies of the configurations and strain amplitude. For high shear, we find very distinctive local order outside the mobile shear band region, where almost $30\%$ of the particles are involved in icosahedral clusters, contrasting strongly with the fraction of $<5\%$ found inside the shear band.


title: Variational principle for optimal quantum controls in quantum metrology

abstract: We develop a variational principle to determine the quantum controls and initial state which optimizes the quantum Fisher information, the quantity characterizing the precision in quantum metrology. When the set of available controls is limited, the exact optimal initial state and the optimal controls are in general dependent on the probe time, a feature missing in the unrestricted case. Yet, for time-independent Hamiltonians with restricted controls, the problem can be approximately reduced to the unconstrained case via the Floquet engineering. In particular, we find for magnetometry with a time-independent spin chain containing three-body interactions, even when the controls are restricted to one and two-body interaction, that the Heisenberg scaling can still be approximately achieved. Our results open the door to investigate quantum metrology under a limited set of available controls, of relevance to many-body quantum metrology in realistic scenarios.


title: Ballistic Multibody Estimator for 2D Open Kinematic Chain

abstract: Applications of free-flying robots range from entertainment purposes to aerospace applications. The control algorithm for such systems requires accurate estimation of their states based on sensor feedback. The objective of this paper is to design and verify a lightweight state estimation algorithm for a free-flying open kinematic chain that estimates the state of its center-of-mass and its posture. Instead of utilizing a nonlinear dynamics model, this research proposes a cascade structure of two Kalman filters (KF), which relies on the information from the ballistic motion of free-falling multibody systems together with feedback from an inertial measurement unit (IMU) and encoders. Multiple algorithms are verified in the simulation that mimics real-world circumstances with Simulink. Several uncertain physical parameters are varied, and the result shows that the proposed estimator outperforms EKF and UKF in terms of tracking performance and computational time.


title: Nature of the 1/f Noise in Graphene, Direct Evidence for the Mobility Fluctuations Mechanism

abstract: The nature of the low-frequency current fluctuations, i.e. carrier number vs. mobility, defines the strategies for noise reduction in electronic devices. While the 1/f noise in metals has been attributed to the electron mobility fluctuations, the direct evidence is lacking (f is the frequency). Here we measured noise in h-BN encapsulated graphene transistor under the condition of geometrical magnetoresistance to directly assess the mechanism of low-frequency electronic current fluctuations. It was found that the relative noise spectral density of the graphene resistance fluctuations depends non-monotonically on the magnetic field (B) with a minimum at approximately uB=1 (u is the electron mobility). This observation proves unambiguously that the mobility fluctuations are the dominant mechanism of the electronic noise in high-quality graphene. Our results are important for all proposed applications of graphene in electronics and add to the fundamental understanding of the 1/f noise origin in any electronic device.


title: Automatic Goal Generation using Dynamical Distance Learning

abstract: Reinforcement Learning (RL) agents can learn to solve complex sequential decision making tasks by interacting with the environment. However, sample efficiency remains a major challenge. In the field of multi-goal RL, where agents are required to reach multiple goals to solve complex tasks, improving sample efficiency can be especially challenging. On the other hand, humans or other biological agents learn such tasks in a much more strategic way, following a curriculum where tasks are sampled with increasing difficulty level in order to make gradual and efficient learning progress. In this work, we propose a method for automatic goal generation using a dynamical distance function (DDF) in a self-supervised fashion. DDF is a function which predicts the dynamical distance between any two states within a markov decision process (MDP). With this, we generate a curriculum of goals at the appropriate difficulty level to facilitate efficient learning throughout the training process. We evaluate this approach on several goal-conditioned robotic manipulation and navigation tasks, and show improvements in sample efficiency over a baseline method which only uses random goal sampling.


title: Neutrino emission from FRB-emitting magnetars

abstract: The detection of a bright radio burst (hereafter FRB 200428) in association with a hard X-ray burst from the Galactic magnetar SGR 1935+2154 suggests that magnetars can make FRBs. We study possible neutrino emission from FRB-emitting magnetars by developing a general theoretical framework. We consider three different sites for proton acceleration and neutrino emission, i.e. within the magnetosphere, in the current sheet region beyond the light cylinder, and in relativistic shocks far away from the magnetosphere. Different cooling processes for protons and pions are considered to calculate the neutrino emission suppression factor within each scenario. We find that the flux of the neutrino emission decreases with increasing radius from the magnetar due to the decrease of the target photon number density. We calculate the neutrino flux from FRB 200428 and its associated X-ray burst. The flux of the most optimistic case invoking magnetospheric proton acceleration is still $\sim4$ orders of magnitude below the IceCube sensitivity. We also estimate the diffuse neutrino background from all FRB-emitting magnetars in the universe. The total neutrino flux of magnetars during their FRB emission phases is a negligible fraction of observed diffuse emission even under the most optimistic magnetospheric scenario for neutrino emission. However, if one assumes that many more X-ray bursts without FRB associations can also produce neutrinos with similar mechanisms, magnetars can contribute up to $10^{-8} \ {\rm GeV \ s^{-1} \ sr^{-1} \ cm^{-2}}$ diffuse neutrino background flux in the GeV to multi-TeV range.


title: Dynamical fixed points in holography

abstract: Typically, an interactive system evolves towards thermal equilibrium, with hydrodynamics representing a universal framework for its late-time dynamics. Classification of the dynamical fixed points (DFPs) of a driven Quantum Field Theory (with time dependent coupling constants, masses, external background fields, etc.) is unknown. We use holographic framework to analyze such fixed points in one example of strongly coupled gauge theory, driven by homogeneous and isotropic expansion of the background metric - equivalently, a late-time dynamics of the corresponding QFT in Friedmann-Lemaitre-Robertson-Walker Universe. We identify DFPs that are perturbatively stable, and those that are perturbatively unstable, computing the spectrum of the quasinormal modes in the corresponding holographic dual. We further demonstrate that a stable DFP can be unstable non-perturbatively, and explain the role of the entanglement entropy density as a litmus test for a non-perturbative stability. Finally, we demonstrated that a driven evolution might not have a fixed point at all: the entanglement entropy density of a system can grow without bounds.


title: NeurInt : Learning to Interpolate through Neural ODEs

abstract: A wide range of applications require learning image generation models whose latent space effectively captures the high-level factors of variation present in the data distribution. The extent to which a model represents such variations through its latent space can be judged by its ability to interpolate between images smoothly. However, most generative models mapping a fixed prior to the generated images lead to interpolation trajectories lacking smoothness and containing images of reduced quality. In this work, we propose a novel generative model that learns a flexible non-parametric prior over interpolation trajectories, conditioned on a pair of source and target images. Instead of relying on deterministic interpolation methods (such as linear or spherical interpolation in latent space), we devise a framework that learns a distribution of trajectories between two given images using Latent Second-Order Neural Ordinary Differential Equations. Through a hybrid combination of reconstruction and adversarial losses, the generator is trained to map the sampled points from these trajectories to sequences of realistic images that smoothly transition from the source to the target image. Through comprehensive qualitative and quantitative experiments, we demonstrate our approach's effectiveness in generating images of improved quality as well as its ability to learn a diverse distribution over smooth interpolation trajectories for any pair of real source and target images.


title: Equivalent $SU(3)_f$ approaches for two-body anti-triplet charmed baryon decays

abstract: For the two-body ${\bf B}_c\to{\bf B}M$ decays, where ${\bf B}_c$ denotes the anti-triplet charm baryon and ${\bf B}(M)$ the octet baryon (meson), there exist two theoretical studies based on the $SU(3)$ flavor [$SU(3)_f$] symmetry. One is the irreducible $SU(3)_f$ approach (IRA). In the irreducible $SU(3)_f$ representation, the effective Hamiltonian related to the initial and final states forms the amplitudes for ${\bf B}_c\to{\bf B}M$. The other is the topological-diagram approach (TDA), where the $W$-boson emission and $W$-boson exchange topologies are drawn and parameterized for the decays. As required by the group theoretical consideration, we present the same number of the IRA and TDA amplitudes. We can hence relate the two kinds of the amplitudes, and demonstrate the equivalence of the two $SU(3)_f$ approaches. We find a specific $W$-boson exchange topology only contributing to $\Xi_c^0\to{\bf B}M$. Denoted by $E_M$, it plays a key role in explaining ${\cal B}(\Xi_c^0\to \Lambda^0 K_S^0,\Sigma^0 K_S^0,\Sigma^+ K^-)$. We consider that $\Lambda_c^+ \to n \pi^+$ and $\Lambda_c^+ \to p\pi^0$ proceed through the constructive and destructive interfering effects, respectively, which leads to ${\cal B}(\Lambda_c^+ \to n \pi^+)\gg{\cal B}(\Lambda_c^+ \to p\pi^0)$ in agreement with the data. With the exact and broken $SU(3)_f$ symmetries, we predict the branching fractions of ${\bf B}_c\to{\bf B}M$ to be tested by future measurements.


title: Determining functionals and finite-dimensional reduction for dissipative PDEs revisited

abstract: We study the properties of linear and non-linear determining functionals for dissipative dynamical systems generated by PDEs. The main attention is payed to the lower bounds for the number of such functionals. In contradiction to the common paradigm, it is shown that the optimal number of determining functionals (the so-called determining dimension) is strongly related to the proper dimension of the set of equilibria of the considered dynamical system rather than to the dimensions of the global attractors and the complexity of the dynamics on it. In particular, in the generic case where the set of equilibria is finite, the determining dimension equals to one (in complete agreement with the Takens delayed embedding theorem) no matter how complex the underlying dynamics is. The obtained results are illustrated by a number of explicit examples.


title: A selection function toolbox for subsets of astronomical catalogues

abstract: Large catalogues are ubiquitous throughout astronomy, but most scientific analyses are carried out on smaller samples selected from these catalogues by chosen cuts on catalogued quantities. The selection function of that scientific sample - the probability that a star in the catalogue will satisfy these cuts and so make it into the sample - is thus unique to each scientific analysis. We have created a general framework that can flexibly estimate the selection function of a sample drawn from a catalogue in terms of position, magnitude and colour. Our method is unique in using the binomial likelihood and accounting for correlations in the selection function across position, magnitude and colour using Gaussian processes and spherical harmonics. We have created a new open-source Python package selectionfunctiontoolbox that implements this framework and used it to make three different estimates of the APOGEE DR16 red giant sample selection function, as a subset of 2MASS, with each estimate using an increasing amount of technical knowledge of the APOGEE targeting. In a companion paper we applied our methodology to derive estimates of the astrometric and spectroscopic selection functions of Gaia EDR3. Our framework will make it trivial for astrophysicists to estimate the selection function that they should be using with the custom sample of stars that they have chosen to answer their scientific question.


title: Completeness of the Gaia-verse V: Astrometry and Radial Velocity sample selection functions in Gaia EDR3

abstract: We risk reaching false scientific conclusions if we test our physical theories against subsets of the Gaia catalogue without correcting for the biased process by which stars make it into our sample. In this paper we produce selection functions for three Gaia science samples to enable the community to correct for this bias. We estimate the probability that a source in Gaia EDR3 will have i) a reported parallax and proper motion, ii) an astrometric renormalised unit weight error below 1.4, or iii) a reported radial velocity. These selection functions are estimated as a function of $G$-band apparent magnitude and position on the sky, with the latter two also being dependent on $G-G_\mathrm{RP}$ colour. The inferred selection functions have a non-trivial dependence on these observable parameters, demonstrating the importance of empirically estimating selection functions. We also produce a simple estimate for the selection function of the full Gaia EDR3 source catalogue to be used with the subset selection functions. We make all of our selection functions easily accessible through the GitHub repository \textsc{selectionfunctions}.


title: Unraveling complex magnetism in two-dimensional FeS$_2$

abstract: Atomically thin two dimensional magnets have given rise to emergent phenomena due to magnetic exchange and spin-orbit coupling showing a great promise for realizing ultrathin device structures. In this paper, we critically examine the magnetic properties of 2D FeS$_2$, which has been recently claimed to exhibit room temperature ferromagnetism in the (111) orientation. Our ab initio study based on collinear density functional theory has revealed the ground state as an antiferromagnetic one with an ordering temperature of around 100K along with a signature of spin-phonon coupling, which may trigger a ferromagnetic coupling via strain. Moreover, our calculations based on spin-spirals indicate the possibility of non-collinear magnetic structures, which is also supported by Monte Carlo simulations based on ab initio magnetic exchange parameters. This opens up an excellent possibility to manipulate magnetic structures by the application of directional strain.


title: Global-Local Attention for Emotion Recognition

abstract: Human emotion recognition is an active research area in artificial intelligence and has made substantial progress over the past few years. Many recent works mainly focus on facial regions to infer human affection, while the surrounding context information is not effectively utilized. In this paper, we proposed a new deep network to effectively recognize human emotions using a novel global-local attention mechanism. Our network is designed to extract features from both facial and context regions independently, then learn them together using the attention module. In this way, both the facial and contextual information is used to infer human emotions, therefore enhancing the discrimination of the classifier. The intensive experiments show that our method surpasses the current state-of-the-art methods on recent emotion datasets by a fair margin. Qualitatively, our global-local attention module can extract more meaningful attention maps than previous methods. The source code and trained model of our network are available at https://github.com/minhnhatvt/glamor-net


title: NLP From Scratch Without Large-Scale Pretraining: A Simple and Efficient Framework

abstract: Pretrained language models have become the standard approach for many NLP tasks due to strong performance, but they are very expensive to train. We propose a simple and efficient learning framework, TLM, that does not rely on large-scale pretraining. Given some labeled task data and a large general corpus, TLM uses task data as queries to retrieve a tiny subset of the general corpus and jointly optimizes the task objective and the language modeling objective from scratch. On eight classification datasets in four domains, TLM achieves results better than or similar to pretrained language models (e.g., RoBERTa-Large) while reducing the training FLOPs by two orders of magnitude. With high accuracy and efficiency, we hope TLM will contribute to democratizing NLP and expediting its development.


title: Plumber: Diagnosing and Removing Performance Bottlenecks in Machine Learning Data Pipelines

abstract: Input pipelines, which ingest and transform input data, are an essential part of training Machine Learning (ML) models. However, it is challenging to implement efficient input pipelines, as it requires reasoning about parallelism, asynchrony, and variability in fine-grained profiling information. Our analysis of over two million ML jobs in Google datacenters reveals that a significant fraction of model training jobs could benefit from faster input data pipelines. At the same time, our analysis indicates that most jobs do not saturate host hardware, pointing in the direction of software-based bottlenecks. Motivated by these findings, we propose Plumber, a tool for finding bottlenecks in ML input pipelines. Plumber uses an extensible and interpretable operational analysis analytical model to automatically tune parallelism, prefetching, and caching under host resource constraints. Across five representative ML pipelines, Plumber obtains speedups of up to 47x for misconfigured pipelines. By automating caching, Plumber obtains end-to-end speedups of over 50% compared to state-of-the-art tuners.


title: Universality of Z3 parafermions via edge mode interaction and quantum simulation of topological space evolution with Rydberg atoms

abstract: Parafermions are Zn generalisations of Majorana quasiparticles, with fractional non-Abelian statistics. They can be used to encode topological qudits and perform Clifford operations by their braiding. We study the simplest case of the Z3 parafermion chain and investigate the form of the non-topological gate that arises through direct short-range interaction of the parafermion edge modes. We show that such an interaction gives rise to a dynamical phase gate on the encoded ground space, with the strongest order of the interaction generating a non-Clifford gate which can be tuned to belong to even levels of the Clifford hierarchy. We also illustrate the accessibility of highly non-contextual states using this dynamical gate. Finally, we propose an experiment that simulates the braiding and dynamical evolutions of the Z3 topological states with Rydberg atom technology.


title: Applications of Convolutional Codes to DNA Codes and Error-Correction

abstract: Convolutional codes are error-correcting linear codes that utilize shift registers to encode. These codes have an arbitrary block size and they can incorporate both past and current information bits. DNA codes represent DNA sequences and are defined as sets of words comprised of the alphabet A, C, T, G satisfying certain mathematical bounds and constraints. The application of convolutional code models to DNA codes is a growing field of biocomputation. As opposed to block codes, convolutional codes factor in nearby information bits, which makes them an optimal model for representing biological phenomena. This study explores the properties of both convolutional codes and DNA codes, as well as how convolutional codes are applied to DNA codes. It also proposes revisions to improve a current convolutional code model for DNA sequences.


title: Mapping Access to Water and Sanitation in Colombia using Publicly Accessible Satellite Imagery, Crowd-sourced Geospatial Information and RandomForests

abstract: Up-to-date, granular, and reliable quality of life data is crucial for humanitarian organizations to develop targeted interventions for vulnerable communities, especially in times of crisis. One such quality of life data is access to water, sanitation and hygeine (WASH). Traditionally, data collection is done through door-to-door surveys sampled over large areas. Unfortunately, the huge costs associated with collecting these data deter more frequent and large-coverage surveys. To address this challenge, we present a scalable and inexpensive end-to-end WASH estimation workflow using a combination of machine learning and census data, publicly available satellite images, and crowd-sourced geospatial information. We generate a map of WASH estimates at a granularity of 250m x 250m across the entire country of Colombia. The model was able to explain up to 65% of the variation in predicting access to water supply, sewage, and toilets. The code is made available with MIT License at https://github.com/thinkingmachines/geoai-immap-wash.


title: Population inference of spin-induced quadrupole moments as a probe for non-black hole compact binaries

abstract: Gravitational-wave (GW) measurements of physical effects such as spin-induced quadrupole moments can distinguish binaries consisting of black holes from non-black hole binaries. While these effects may be poorly constrained for single-event inferences with the second-generation detectors, combining information from multiple detections can help uncover features of non-black hole binaries. The spin-induced quadrupole moment has specific predictions for different types of compact objects, and a generalized formalism must consider a population where different types of compact objects co-exist. In this study, we introduce a hierarchical mixture-likelihood formalism to estimate the {\it fraction of non-binary black holes in the population}. We demonstrate the applicability of this method using simulated GW signals injected into Gaussian noise following the design sensitivities of the Advanced LIGO Advanced Virgo detectors. We compare the performance of this method with a traditionally-followed hierarchical inference approach. Both the methods are equally effective to hint at inhomogeneous populations, however, we find the mixture-likelihood approach to be more natural for mixture populations comprising compact objects of diverse classes. We also discuss the possible systematics in the mixture-likelihood approach, caused by several reasons, including the limited sensitivity of the second-generation detectors, specific features of the astrophysical population distributions, and the limitations posed by the waveform models employed. Finally, we apply this method to the LIGO-Virgo detections published in the second GW transient catalog (GWTC-2) and find them consistent with a binary black hole population within the statistical precision.


title: Prime values of $f(a,b^2)$ and $f(a,p^2)$, $f$ quadratic

abstract: We prove an asymptotic formula for primes of the shape $f(a,b^2)$ with $a,b$ integers and of the shape $f(a,p^2)$ with $p$ prime. Here $f$ is a binary quadratic form with integer coefficients, irreducible over $\mathbb{Q}$ and has no local obstructions. This refines the seminal work of Friedlander and Iwaniec on primes of the form $x^2 + y^4$ and Heath-Brown and Li on primes of the form $a^2 + p^4$, as well as earlier work of the author with Lam and Schindler on primes of the form $f(a,p)$ with $f$ a positive definite form.


title: Varying fundamental constants and dark energy in the ESPRESSO era

abstract: The observational evidence for the recent acceleration of the universe shows that canonical theories of cosmology and particle physics are incomplete and that new physics is out there, waiting to be discovered. A compelling task for astrophysical facilities is to search for, identify and ultimately characterize this new physics. I present very recent developments in tests of the stability of nature's fundamental constants, as well as their impact on physics paradigms beyond the standard model. Specifically I discuss new observational constraints at low redshifts and at the BBN epoch, and highlight their different implications for canonical quintessence-type models and for non-canonical string-theory inspired models. Finally I also present new forecasts, based on realistic simulated data, of the gains in sensitivity for these constraints expected from ELT-HIRES, on its own and in combination with Euclid.


title: Look at the Variance! Efficient Black-box Explanations with Sobol-based Sensitivity Analysis

abstract: We describe a novel attribution method which is grounded in Sensitivity Analysis and uses Sobol indices. Beyond modeling the individual contributions of image regions, Sobol indices provide an efficient way to capture higher-order interactions between image regions and their contributions to a neural network's prediction through the lens of variance. We describe an approach that makes the computation of these indices efficient for high-dimensional problems by using perturbation masks coupled with efficient estimators to handle the high dimensionality of images. Importantly, we show that the proposed method leads to favorable scores on standard benchmarks for vision (and language models) while drastically reducing the computing time compared to other black-box methods -- even surpassing the accuracy of state-of-the-art white-box methods which require access to internal representations. Our code is freely available: https://github.com/fel-thomas/Sobol-Attribution-Method


title: SPACE: 3D Parallel Solvers for Vlasov-Maxwell and Vlasov-Poisson Equations for Relativistic Plasmas with Atomic Transformations

abstract: A parallel, relativistic, three-dimensional particle-in-cell code SPACE has been developed for the simulation of electromagnetic fields, relativistic particle beams, and plasmas. In addition to the standard second-order Particle-in-Cell (PIC) algorithm, SPACE includes efficient novel algorithms to resolve atomic physics processes such as multi-level ionization of plasma atoms, recombination, and electron attachment to dopants in dense neutral gases. SPACE also contains a highly adaptive particle-based method, called Adaptive Particle-in-Cloud (AP-Cloud), for solving the Vlasov-Poisson problems. It eliminates the traditional Cartesian mesh of PIC and replaces it with an adaptive octree data structure. The code's algorithms, structure, capabilities, parallelization strategy and performances have been discussed. Typical examples of SPACE applications to accelerator science and engineering problems are also presented.


title: The Main Sequence of quasars: the taming of the extremes

abstract: The last few years have seen the confirmation of several trends associated with the quasar main sequence. The idea of a main sequence for quasars is relatively recent, and its full potential for the observational classification and contextualization of quasar properties has yet to be fully exploited. The main sequence drivers are discussed in terms of the properties of extreme objects. We briefly summarize developments that constrain the viewing angle of the accretion disk in a particular class of quasars (extreme Population B, radiating at low Eddington ratio), as well as inferences on the chemical composition of the broad line emitting gas, and on the nature of radio emission along the quasar main sequence.


title: High-Performance Gridding For Radio Interferometric Image Synthesis

abstract: Convolutional Gridding is a technique (algorithm) extensively used in Radio Interferometric Image Synthesis for fast inversion of functions sampled with irregular intervals on the Fourier plane. In this thesis, we propose some modifications to the technique to execute faster on a GPU. These modifications give rise to \textit{Hybrid Gridding} and \textit{Pruned NN Interpolation}, which take advantage of the oversampling of the Gridding Convolutional Function in Convolutional Gridding to try to make gridding faster with no reduction in the quality of the output. Our experiments showed that given the right conditions, Hybrid Gridding executes up to $6.8\times$ faster than Convolutional Gridding, and Pruned NN Interpolation is generally slower than Hybrid Gridding. The two new techniques feature the downsampling of an oversampled grid through convolution to accelerate the Fourier inversion. It is a well-known approximate technique which suffers from aliasing. In this thesis, we are re-proposing the technique as a \textit{Convolution-Based FFT Pruning} algorithm able to suppress aliasing below arithmetic noise. The algorithm uses the recently discovered least-misfit gridding functions, which through our experiments gave promising results, although not as good as expected from the related published work on the stated gridding functions. Nevertheless, our experiments showed that, given the right conditions, Convolutional-Based Pruning reduces the Fourier inversion execution time on a GPU by approximately a factor of $8\times$.


title: Spaces of harmonic surfaces in non-positive curvature

abstract: Let $\mathfrak{M}(\Sigma)$ be an open and connected subset of the space of hyperbolic metrics on a closed orientable surface, and $\mathfrak{M}(M)$ an open and connected subset of the space of metrics on an orientable manifold of dimension at least $3$. We impose conditions on $M$ and $\mathfrak{M}(M)$, which are often satisfied when the metrics in $\mathfrak{M}(M)$ have non-positive curvature. Under these conditions, the data of a homotopy class of maps from $\Sigma$ to $M$ gives $\mathfrak{M}(\Sigma)\times \mathfrak{M}(M)$ the structure of a space of harmonic maps. Using transversality theory for Banach manifolds, we prove that the set of somewhere injective harmonic maps is open, dense, and connected in the moduli space. We also prove some results concerning the distribution of harmonic immersions and embeddings in the moduli space.


title: Interfacial thermal conductance between TiO2 nanoparticle and water: A molecular dynamics study

abstract: The interfacial thermal conductance (Kapitza conductance) between a TiO2 nanoparticle and water is investigated using transient non-equilibrium molecular dynamics. It is found that Kapitza conductance of TiO2 nanoparticles is one order of magnitude greater than other conventional nanoparticles such as gold, silver, silicon, platinum and also carbon nanotubes and graphene flakes. This difference can be explained by comparing the contribution of electrostatic interactions between the partially charged titanium and oxygen atoms and water atoms to the van der Waals interactions, which increases the cooling time by about 10 times. The effects of diameter and temperature of nanoparticle, surface wettability on the interfacial thermal conductance are also investigated. The results showed that by increasing the diameter of the nanoparticle from 4 to 9 nm, Kapitza conductance decreased slightly. Also, increasing the temperature of the heated nanoparticle from 400 K to 600 K led to thermal conductance enhancement. It has been found that increasing the coupling strength of Lennard-Jones (LJ) potential from 0.5 to 4 caused the increment of the Kapitza conductance about 20%. It is also shown that a continuum model which its input is provided by molecular dynamics can be a suitable approximation to describe the thermal relaxation of a nanoparticle in a liquid medium.


title: Low-loss tunable infrared plasmons in the high-mobility perovskite (Ba,La)SnO$_3$

abstract: BaSnO$_3$ exhibits the highest carrier mobility among perovskite oxides, making it ideal for oxide electronics. Collective charge carrier oscillations, plasmons, are expected to arise in this material, thus providing a tool to control the nanoscale optical field for optoelectronics applications. Here, we demonstrate the existence of relatively long-lived plasmons supported by high-mobility charge carriers in La-doped BaSnO$_3$ (BLSO). By exploiting the high spatial and energy resolution of electron energy-loss spectroscopy with a focused beam in a scanning transmission electron microscope, we systematically investigate the dispersion, confinement ratio, and damping of infrared localized surface plasmons (LSP) in BLSO nanoparticles. We find that the LSPs in BLSO are highly spatially confined compared to those sustained by noble metals and have relatively low loss and high quality factor compared to other doped oxides. Further analysis clarifies the relation between plasmon damping and carrier mobility in BLSO. Our results support the use of nanostructured degenerate semiconductors for plasmonic applications in the infrared region and establish a relevant alternative to more traditional plasmonic materials.


title: Humble planar defects in SiGe nanopillars

abstract: We report a new \{001\} planar defect found in SiGe nanopillars. The defect structure, determined by atomic resolution electron microscopy, matches the Humble defect model proposed for diamond. We also investigated several possible variants of the Humble structure using first principles calculations and found that the one lowest in energy was also in best agreement with the STEM images. The pillar composition has been analyzed with electron energy loss spectroscopy, which hints at how the defect is formed. Our results show that the structure and formation process of defects in nanostructured group IV semiconductors can be different from their bulk counterparts.


title: Optimization of the Model Predictive Control Meta-Parameters Through Reinforcement Learning

abstract: Model predictive control (MPC) is increasingly being considered for control of fast systems and embedded applications. However, the MPC has some significant challenges for such systems. Its high computational complexity results in high power consumption from the control algorithm, which could account for a significant share of the energy resources in battery-powered embedded systems. The MPC parameters must be tuned, which is largely a trial-and-error process that affects the control performance, the robustness and the computational complexity of the controller to a high degree. In this paper, we propose a novel framework in which any parameter of the control algorithm can be jointly tuned using reinforcement learning(RL), with the goal of simultaneously optimizing the control performance and the power usage of the control algorithm. We propose the novel idea of optimizing the meta-parameters of MPCwith RL, i.e. parameters affecting the structure of the MPCproblem as opposed to the solution to a given problem. Our control algorithm is based on an event-triggered MPC where we learn when the MPC should be re-computed, and a dual mode MPC and linear state feedback control law applied in between MPC computations. We formulate a novel mixture-distribution policy and show that with joint optimization we achieve improvements that do not present themselves when optimizing the same parameters in isolation. We demonstrate our framework on the inverted pendulum control task, reducing the total computation time of the control system by 36% while also improving the control performance by 18.4% over the best-performing MPC baseline.


title: Learning Finite Linear Temporal Logic Specifications with a Specialized Neural Operator

abstract: Finite linear temporal logic ($\mathsf{LTL}_f$) is a powerful formal representation for modeling temporal sequences. We address the problem of learning a compact $\mathsf{LTL}_f$ formula from labeled traces of system behavior. We propose a novel neural network operator and evaluate the resulting architecture, Neural$\mathsf{LTL}_f$. Our approach includes a specialized recurrent filter, designed to subsume $\mathsf{LTL}_f$ temporal operators, to learn a highly accurate classifier for traces. Then, it discretizes the activations and extracts the truth table represented by the learned weights. This truth table is converted to symbolic form and returned as the learned formula. Experiments on randomly generated $\mathsf{LTL}_f$ formulas show Neural$\mathsf{LTL}_f$ scales to larger formula sizes than existing approaches and maintains high accuracy even in the presence of noise.


title: Solving Gauge Anomaly Equations in the Standard Model using the Method of Chords

abstract: In a recent paper, Allanach et al introduced a geometric method to solve the anomaly cancellation equations for a $U(1)$ gauge theory with an arbitrary number of charges - the Method of Chords known in Diophantine analysis. We extend their result to non-Abelian gauge groups, and show that this method can be used to find the general solution to the anomaly cancellation equations for a theory with the Standard Model gauge group on a curved background. Given $K$ charges in $(\textbf{2}, \textbf{3})$, $L$ charges in $(\textbf{2}, \textbf{1})$, $M$ charges in $(\textbf{1}, \textbf{3})$, and $N$ charges in $(\textbf{1}, \textbf{1})$ representations of $SU(2)\times SU(3)$, the equations reduce to a homogeneous cubic Diophantine equation in $K+L+M+N-4$ variables.


title: PID Controller Optimization for Low-cost Line Follower Robots

abstract: In this paper, modification of the classical PID controller and development of open-loop control mechanisms to improve stability and robustness of a differential wheeled robot are discussed. To deploy the algorithm, a test platform has been constructed using low-cost and off-the-shelf components including a microcontroller, reflectance sensor, and motor driver. This paper describes the heuristic approach used in the identification of the system specifications as well as the optimization of the controller. The PID controller is analyzed in detail and the effect of each term is explained in the context of stability. Lastly, the challenges encountered during the development of controller and robot are discussed. Code is available at: https://github.com/sametoguten/STM32-Line-Follower-with-PID.


title: Extended virtual element method for two-dimensional linear elastic fracture

abstract: In this paper, we propose an eXtended Virtual Element Method (X-VEM) for two-dimensional linear elastic fracture. This approach, which is an extension of the standard Virtual Element Method (VEM), facilitates mesh-independent modeling of crack discontinuities and elastic crack-tip singularities on general polygonal meshes. For elastic fracture in the X-VEM, the standard virtual element space is augmented by additional basis functions that are constructed by multiplying standard virtual basis functions by suitable enrichment fields, such as asymptotic mixed-mode crack-tip solutions. The design of the X-VEM requires an extended projector that maps functions lying in the extended virtual element space onto a set spanned by linear polynomials and the enrichment fields. An efficient scheme to compute the mixed-mode stress intensity factors using the domain form of the interaction integral is described. The formulation permits integration of weakly singular functions to be performed over the boundary edges of the element. Numerical experiments are conducted on benchmark mixed-mode linear elastic fracture problems that demonstrate the sound accuracy and optimal convergence in energy of the proposed formulation.


title: APOGEE-2S view of the globular cluster Patchick 125 (Gran 3). New metallicity and elemental abundances from high-resolution spectroscopy

abstract: We present detailed elemental abundances, radial velocity, and orbital elements for Patchick~125, a recently discovered metal-poor globular cluster (GC) in the direction of the Galactic bulge. Near-infrared high-resolution ($R\sim22,500$) spectra of two members were obtained during the second phase of the Apache Point Observatory Galactic Evolution Experiment at Las Campanas Observatory as part of the sixteenth Data Release (DR 16) of the Sloan Digital Sky Survey. We investigated elemental abundances for four chemical species, including $\alpha$- (Mg, Si), Fe-peak (Fe), and odd-Z (Al) elements. We find a metallicity covering the range from [Fe/H] $= -1.69$ to $-1.72$, suggesting that Patchick~125 likely exhibits a mean metallicity $\langle$[Fe/H]$\rangle \sim -1.7$, which represents a significant increase in metallicity for this cluster compared to previous low-resolution spectroscopic analyses. We also found a mean radial velocity of 95.9 km s$^{-1}$, which is $\sim$21.6 km s$^{-1}$ higher than reported in the literature. The observed stars exhibit an $\alpha$-enrichment ([Mg/Fe]$\lesssim+0.20$, and [Si/Fe]$\lesssim +0.30$) that follows the typical trend of metal-poor GCs. The aluminum abundance ratios for the present two member stars are enhanced in [Al/Fe]$\gtrsim +0.58$, which is a typical enrichment characteristic of the so-called `second-generation' of stars in GCs at similar metallicity. This supports the possible presence of the multiple-population phenomenon in Patchick~125, as well as its genuine GC nature. Further, Patchick~125 shows a low-energy, low-eccentric ($<0.4$) and retrograde orbit captured by the inner Galaxy, near the edge of the bulge. We confirm that Patchick~125 is a genuine metal-poor GC, which is currently trapped in the vicinity of the Milky Way bulge.


title: A shadow perspective on equivariant Hochschild homologies

abstract: Shadows for bicategories, defined by Ponto, provide a useful framework that generalizes classical and topological Hochschild homology. In this paper, we define Hochschild-type invariants for monoids in a symmetric monoidal, simplicial model category $\mathsf V$, as well as for small $\mathsf V$-categories. We show that each of these constructions extends to a shadow on an appropriate bicategory, which implies in particular that they are Morita invariant. We also define a generalized theory of Hochschild homology twisted by an automorphism and show that it is Morita invariant. Hochschild homology of Green functors and $C_n$-twisted topological Hochschild homology fit into this framework, which allows us to conclude that these theories are Morita invariant. We also study linearization maps relating the topological and algebraic theories, proving that the linearization map for topological Hochschild homology arises as a lax shadow functor, and constructing a new linearization map relating topological restriction homology and algebraic restriction homology. Finally, we construct a twisted Dennis trace map from the fixed points of equivariant algebraic $K$-theory to twisted topological Hochschild homology.


title: Data-Efficient Deep Reinforcement Learning for Attitude Control of Fixed-Wing UAVs: Field Experiments

abstract: Attitude control of fixed-wing unmanned aerial vehicles (UAVs) is a difficult control problem in part due to uncertain nonlinear dynamics, actuator constraints, and coupled longitudinal and lateral motions. Current state-of-the-art autopilots are based on linear control and are thus limited in their effectiveness and performance. Deep reinforcement learning (DRL) is a machine learning method to automatically discover optimal control laws through interaction with the controlled system, which can handle complex nonlinear dynamics. We show in this paper that DRL can successfully learn to perform attitude control of a fixed-wing UAV operating directly on the original nonlinear dynamics, requiring as little as three minutes of flight data. We initially train our model in a simulation environment and then deploy the learned controller on the UAV in flight tests, demonstrating comparable performance to the state-of-the-art ArduPlane proportional-integral-derivative (PID) attitude controller with no further online learning required. Learning with significant actuation delay and diversified simulated dynamics were found to be crucial for successful transfer to control of the real UAV. In addition to a qualitative comparison with the ArduPlane autopilot, we present a quantitative assessment based on linear analysis to better understand the learning controller's behavior.


title: Seiberg-Witten maps and scattering amplitudes of NCQED

abstract: The connection between tree-level scattering amplitudes and the Seiberg-Witten (SW) map in the Moyal deformed U(1) noncommutataive quantum electrodynamics (NCQED) is studied. We show that in the minimal U(1) NCQED based on a reversible Seiberg-Witten (SW) map, SW map induced interactions cancel each other in all tree-level scattering amplitudes and leave them identical to the Moyal NCQED without SW map. On the other hand, the two-by-two Compton and light-by-light scattering amplitudes deviate from minimal model when irreversible SW map is used. Therefore the risibility of SW map and equivalence between NCQED before and after SW map manifest themselves as an identity between the tree-level scattering amplitudes.


title: A trapped ion quantum computer with robust entangling gates and quantum coherent feedback

abstract: Quantum computers are expected to achieve a significant speed-up over classical computers in solving a range of computational problems. Chains of ions held in a linear Paul trap are a promising platform for constructing such quantum computers, due to their long coherence times and high quality of control. Here we report on the construction of a small, five-qubit, universal quantum computer using $^{88}\text{Sr}^{+}$ ions in an RF trap. All basic operations, including initialization, quantum logic operations, and readout, are performed with high fidelity. Selective two-qubit and single-qubit gates, implemented using a narrow linewidth laser, comprise a universal gate set, allowing realization of any unitary on the quantum register. We review the main experimental tools, and describe in detail unique aspects of the computer: the use of robust entangling gates and the development of a quantum coherent feedback system through EMCCD camera acquisition. The latter is necessary for carrying out quantum error correction protocols in future experiments.


title: A fractional Borel-Pompeiu type formula for holomorphic functions of two complex variables

abstract: The present paper is a continuation of our work [11], where we introduced a fractional operator calculus related to a fractional ${\psi}-$Fueter operator in the one-dimensional Riemann-Liouville derivative sense in each direction of the quaternionic structure, that depends on an additional vector of complex parameters with fractional real parts. This allowed us also to study a pair of lower order fractional operators and prove the associated analogues of both Stokes and Borel-Pompieu formulas for holomorphic functions in two complex variables.


title: Extractors: Low Entropy Requirements Colliding With Non-Malleability

abstract: The known constructions of negligible error (non-malleable) two-source extractors can be broadly classified in three categories: (1) Constructions where one source has min-entropy rate about $1/2$, the other source can have small min-entropy rate, but the extractor doesn't guarantee non-malleability. (2) Constructions where one source is uniform, and the other can have small min-entropy rate, and the extractor guarantees non-malleability when the uniform source is tampered. (3) Constructions where both sources have entropy rate very close to $1$ and the extractor guarantees non-malleability against the tampering of both sources. We introduce a new notion of collision resistant extractors and in using it we obtain a strong two source non-malleable extractor where we require the first source to have $0.8$ entropy rate and the other source can have min-entropy polylogarithmic in the length of the source. We show how the above extractor can be applied to obtain a non-malleable extractor with output rate $\frac 1 2$, which is optimal. We also show how, by using our extractor and extending the known protocol, one can obtain a privacy amplification secure against memory tampering where the size of the secret output is almost optimal.


title: A Word on Machine Ethics: A Response to Jiang et al. (2021)

abstract: Ethics is one of the longest standing intellectual endeavors of humanity. In recent years, the fields of AI and NLP have attempted to wrangle with how learning systems that interact with humans should be constrained to behave ethically. One proposal in this vein is the construction of morality models that can take in arbitrary text and output a moral judgment about the situation described. In this work, we focus on a single case study of the recently proposed Delphi model and offer a critique of the project's proposed method of automating morality judgments. Through an audit of Delphi, we examine broader issues that would be applicable to any similar attempt. We conclude with a discussion of how machine ethics could usefully proceed, by focusing on current and near-future uses of technology, in a way that centers around transparency, democratic values, and allows for straightforward accountability.


title: Higgs-Chern-Simons gravity models in 2n+1 dimensions

abstract: We consider a family of new Higgs-Chern-Simons (HCS) gravity models in 2n+1 dimensions (n=1,2,3). This provides a generalization of the (usual) gravitational Chern-Simons (CS) gravitaties resulting from non- Abelian CS densities in all odd dimensions, which feature vector and scalar fields in addition to the metric. The derivation of the new HCS gravitational (HCSG) actions follows the same method as in the usual-CSG case resulting from the usual CS densities. The HCSG result from the HCS densities, which result through a one-step descent of the Higgs-Chern-Pontryagin (HCP), the latter being descended from Chern-Pontryagin (CP) densities in some even dimension. A preliminary study of the solutions of these models is considered, with exact solutions being reported for spacetime dimensions d = 3, 5.


title: An optical elevator for precise delivery of cold atoms using an acousto-optical deflector

abstract: We implement a simple method for fast and precise delivery of ultracold atoms to a microscopic device, i.e. a Fabry-Perot microcavity. By moving a single beam optical dipole trap in a direction perpendicular to the beam axis with an acousto-optical deflector, we transport up to 1 million atoms within 100$\,$ms over $1\,$cm. Under these conditions, a transport efficiency above $95\%$ is achieved with only minimal heating. The atomic cloud is accurately positioned within the microcavity and transferred into an intra-cavity optical lattice. With the addition of a secondary guiding beam, we show how residual sloshing motion along the shallow axis of the trap can be minimized.