title: Neural Machine Translation for South Africa's Official Languages

abstract: Recent advances in neural machine translation (NMT) have led to state-of-the-art results for many European-based translation tasks. However, despite these advances, there is has been little focus in applying these methods to African languages. In this paper, we seek to address this gap by creating an NMT benchmark BLEU score between English and the ten remaining official languages in South Africa.


title: Pump and Dumps in the Bitcoin Era: Real Time Detection of Cryptocurrency Market Manipulations

abstract: In the last years, cryptocurrencies are increasingly popular. Even people who are not experts have started to invest in these securities and nowadays cryptocurrency exchanges process transactions for over 100 billion US dollars per month. However, many cryptocurrencies have low liquidity and therefore they are highly prone to market manipulation schemes. In this paper, we perform an in-depth analysis of pump and dump schemes organized by communities over the Internet. We observe how these communities are organized and how they carry out the fraud. Then, we report on two case studies related to pump and dump groups. Lastly, we introduce an approach to detect the fraud in real time that outperforms the current state of the art, so to help investors stay out of the market when a pump and dump scheme is in action.


title: ImpactCite: An XLNet-based method for Citation Impact Analysis

abstract: Citations play a vital role in understanding the impact of scientific literature. Generally, citations are analyzed quantitatively whereas qualitative analysis of citations can reveal deeper insights into the impact of a scientific artifact in the community. Therefore, citation impact analysis (which includes sentiment and intent classification) enables us to quantify the quality of the citations which can eventually assist us in the estimation of ranking and impact. The contribution of this paper is two-fold. First, we benchmark the well-known language models like BERT and ALBERT along with several popular networks for both tasks of sentiment and intent classification. Second, we provide ImpactCite, which is XLNet-based method for citation impact analysis. All evaluations are performed on a set of publicly available citation analysis datasets. Evaluation results reveal that ImpactCite achieves a new state-of-the-art performance for both citation intent and sentiment classification by outperforming the existing approaches by 3.44% and 1.33% in F1-score. Therefore, we emphasize ImpactCite (XLNet-based solution) for both tasks to better understand the impact of a citation. Additional efforts have been performed to come up with CSC-Clean corpus, which is a clean and reliable dataset for citation sentiment classification.


title: An Investigation of COVID-19 Spreading Factors with Explainable AI Techniques

abstract: Since COVID-19 was first identified in December 2019, various public health interventions have been implemented across the world. As different measures are implemented at different countries at different times, we conduct an assessment of the relative effectiveness of the measures implemented in 18 countries and regions using data from 22/01/2020 to 02/04/2020. We compute the top one and two measures that are most effective for the countries and regions studied during the period. Two Explainable AI techniques, SHAP and ECPI, are used in our study; such that we construct (machine learning) models for predicting the instantaneous reproduction number ($R_t$) and use the models as surrogates to the real world and inputs that the greatest influence to our models are seen as measures that are most effective. Across-the-board, city lockdown and contact tracing are the two most effective measures. For ensuring $R_t<1$, public wearing face masks is also important. Mass testing alone is not the most effective measure although when paired with other measures, it can be effective. Warm temperature helps for reducing the transmission.


title: A framework for probabilistic weather forecast post-processing across models and lead times using machine learning

abstract: Forecasting the weather is an increasingly data intensive exercise. Numerical Weather Prediction (NWP) models are becoming more complex, with higher resolutions, and there are increasing numbers of different models in operation. While the forecasting skill of NWP models continues to improve, the number and complexity of these models poses a new challenge for the operational meteorologist: how should the information from all available models, each with their own unique biases and limitations, be combined in order to provide stakeholders with well-calibrated probabilistic forecasts to use in decision making? In this paper, we use a road surface temperature example to demonstrate a three-stage framework that uses machine learning to bridge the gap between sets of separate forecasts from NWP models and the 'ideal' forecast for decision support: probabilities of future weather outcomes. First, we use Quantile Regression Forests to learn the error profile of each numerical model, and use these to apply empirically-derived probability distributions to forecasts. Second, we combine these probabilistic forecasts using quantile averaging. Third, we interpolate between the aggregate quantiles in order to generate a full predictive distribution, which we demonstrate has properties suitable for decision support. Our results suggest that this approach provides an effective and operationally viable framework for the cohesive post-processing of weather forecasts across multiple models and lead times to produce a well-calibrated probabilistic output.


title: CMB Shadows: The Effect of Interstellar Extinction on Cosmic Microwave Background Polarization and Temperature Anisotropy

abstract: We evaluate the degradation of the accuracy of the component separation between the cosmic microwave background (CMB) and foreground components caused by neglect of absorption of the monopole component of the CMB by the galactic interstellar matter. The amplitude of the temperature anisotropy caused by the CMB shadow, due to dust components, is about 1 uK. This value is comparable to the required noise level necessary to probe non-Gaussianity studies with upcoming CMB experiments. In addition, the amplitude of the polarization caused by the CMB shadow due to dust is comparable to or larger than the RMS value of the CMB B-mode polarization, imprinted by primordial gravitational waves. We show that applying a single-power law model as the dust spectrum to observed multifrequency data introduces systematic errors, which are comparable to or larger than the required noise level for forthcoming CMB B-mode polarization experiments. Deducing the intrinsic spectrum of dust emission from the submillimeter waveband data reduces systematic error below the required noise level. However, this method requires dust temperature measurements with an accuracy of better than a few percent. We conclude that the CMB shadow due to dust must be considered in future CMB missions for achieving their targeted sensitivity. Our results will be important to detect the primordial CMB B-mode polarization, with the amplitude of the tensor-to-scalar ratio of r=10^{-3}.


title: Simplified ResNet approach for data driven prediction of microstructure-fatigue relationship

abstract: The heterogeneous microstructure in metallic components results in locally varying fatigue strength. Metal fatigue strongly depends on size and shape of non-metallic inclusions and pores, commonly referred to as "defects". Nodular cast iron (NCI) contains graphite inclusions (nodules) whose shape and frequency influence the fatigue strength. Fatigue strength can be simulated by micromechanical finite element models. The drawback of these models are the large computational costs. Therefore, we employ a data-driven machine learning methodology. More precisely, we utilize the simplified residual neural network (SimResNet) which was recently introduced (Herty et al., Kinetic Theory for Residual Neural Networks, 2020) to predict fatigue strength from metallographic data. For the training, we use fatigue data which is simulated with a micromechanical model and the shakedown theorem. The micromechanical models are derived directly from micrographs of nodular cast iron, respectively. The application of SimResNet shows a good performance to predict fatigue strength by local microstructures of nodular cast iron. We show several test cases. The simplified character of SimResNet enables fast predictions of fatigue by microstructures, even in comparision to classical residual neural networks.


title: A Large-Scale, Open-Domain, Mixed-Interface Dialogue-Based ITS for STEM

abstract: We present Korbit, a large-scale, open-domain, mixed-interface, dialogue-based intelligent tutoring system (ITS). Korbit uses machine learning, natural language processing and reinforcement learning to provide interactive, personalized learning online. Korbit has been designed to easily scale to thousands of subjects, by automating, standardizing and simplifying the content creation process. Unlike other ITS, a teacher can develop new learning modules for Korbit in a matter of hours. To facilitate learning across a widerange of STEM subjects, Korbit uses a mixed-interface, which includes videos, interactive dialogue-based exercises, question-answering, conceptual diagrams, mathematical exercises and gamification elements. Korbit has been built to scale to millions of students, by utilizing a state-of-the-art cloud-based micro-service architecture. Korbit launched its first course in 2019 on machine learning, and since then over 7,000 students have enrolled. Although Korbit was designed to be open-domain and highly scalable, A/B testing experiments with real-world students demonstrate that both student learning outcomes and student motivation are substantially improved compared to typical online courses.


title: Conservative two-stage group testing in the linear regime

abstract: Inspired by applications in testing for Covid-19, we consider a variant of two-stage group testing called "conservative" (or "trivial") two-stage testing, where every item declared to be defective must be definitively confirmed by being tested by itself in the second stage. We study this in the linear regime where the prevalence is fixed while the number of items is large. We study various nonadaptive test designs for the first stage, and derive a new lower bound for the total number of tests required. We find that a first-stage design as studied by Broder and Kumar (arXiv:2004.01684) with constant tests per item and constant items per test is extremely close to optimal for all prevalences, and is optimal in the limit as the prevalence tends to zero. Simulations back up the theoretical results.


title: Towards Socially Responsible AI: Cognitive Bias-Aware Multi-Objective Learning

abstract: Human society had a long history of suffering from cognitive biases leading to social prejudices and mass injustice. The prevalent existence of cognitive biases in large volumes of historical data can pose a threat of being manifested as unethical and seemingly inhuman predictions as outputs of AI systems trained on such data. To alleviate this problem, we propose a bias-aware multi-objective learning framework that given a set of identity attributes (e.g. gender, ethnicity etc.) and a subset of sensitive categories of the possible classes of prediction outputs, learns to reduce the frequency of predicting certain combinations of them, e.g. predicting stereotypes such as `most blacks use abusive language', or `fear is a virtue of women'. Our experiments conducted on an emotion prediction task with balanced class priors shows that a set of baseline bias-agnostic models exhibit cognitive biases with respect to gender, such as women are prone to be afraid whereas men are more prone to be angry. In contrast, our proposed bias-aware multi-objective learning methodology is shown to reduce such biases in the predictied emotions.


title: India nudges to contain COVID-19 pandemic: a reactive public policy analysis using machine-learning based topic modelling

abstract: India locked down 1.3 billion people on March 25, 2020 in the wake of COVID-19 pandemic. The economic cost of it was estimated at USD 98 billion, while the social costs are still unknown. This study investigated how government formed reactive policies to fight coronavirus across its policy sectors. Primary data was collected from the Press Information Bureau (PIB) in the form press releases of government plans, policies, programme initiatives and achievements. A text corpus of 260,852 words was created from 396 documents from the PIB. An unsupervised machine-based topic modelling using Latent Dirichlet Allocation (LDA) algorithm was performed on the text corpus. It was done to extract high probability topics in the policy sectors. The interpretation of the extracted topics was made through a nudge theoretic lens to derive the critical policy heuristics of the government. Results showed that most interventions were targeted to generate endogenous nudge by using external triggers. Notably, the nudges from the Prime Minister of India was critical in creating herd effect on lockdown and social distancing norms across the nation. A similar effect was also observed around the public health (e.g., masks in public spaces; Yoga and Ayurveda for immunity), transport (e.g., old trains converted to isolation wards), micro, small and medium enterprises (e.g., rapid production of PPE and masks), science and technology sector (e.g., diagnostic kits, robots and nano-technology), home affairs (e.g., surveillance and lockdown), urban (e.g. drones, GIS-tools) and education (e.g., online learning). A conclusion was drawn on leveraging these heuristics are crucial for lockdown easement planning.


title: IEEE 7010: A New Standard for Assessing the Well-being Implications of Artificial Intelligence

abstract: Artificial intelligence (AI) enabled products and services are becoming a staple of everyday life. While governments and businesses are eager to enjoy the benefits of AI innovations, the mixed impact of these autonomous and intelligent systems on human well-being has become a pressing issue. This article introduces one of the first international standards focused on the social and ethical implications of AI: The Institute of Electrical and Electronics Engineering (IEEE) Standard (Std) 7010-2020 Recommended Practice for Assessing the Impact of Autonomous and Intelligent Systems on Human Well-being. Incorporating well-being factors throughout the lifecycle of AI is both challenging and urgent and IEEE 7010 provides key guidance for those who design, deploy, and procure these technologies. We begin by articulating the benefits of an approach for AI centered around well-being and the measurement of well-being data. Next, we provide an overview of IEEE 7010, including its key principles and how the standard relates to approaches and perspectives in place in the AI community. Finally, we indicate where future efforts are needed.


title: Bluetooth Smartphone Apps: Are they the most private and effective solution for COVID-19 contact tracing?

abstract: Many digital solutions mainly involving Bluetooth technology are being proposed for Contact Tracing Apps (CTA) to reduce the spread of COVID-19. Concerns have been raised regarding privacy, consent, uptake required in a given population, and the degree to which use of CTAs can impact individual behaviours. However, very few groups have taken a holistic approach and presented a combined solution. None has presented their CTA in such a way as to ensure that even the most suggestible member of our community does not become complacent and assume that CTA operates as an invisible shield, making us and our families impenetrable or immune to the disease. We propose to build on some of the digital solutions already under development that, with addition of a Bayesian model that predicts likelihood for infection supplemented by traditional symptom and contact tracing, that can enable us to reach 90% of a population. When combined with an effective communication strategy and social distancing, we believe solutions like the one proposed here can have a very beneficial effect on containing the spread of this pandemic.


title: Avoiding Improper Treatment of Persons with Dementia by Care Robots

abstract: The phrase "most cruel and revolting crimes" has been used to describe some poor historical treatment of vulnerable impaired persons by precisely those who should have had the responsibility of protecting and helping them. We believe we might be poised to see history repeat itself, as increasingly human-like aware robots become capable of engaging in behavior which we would consider immoral in a human--either unknowingly or deliberately. In the current paper we focus in particular on exploring some potential dangers affecting persons with dementia (PWD), which could arise from insufficient software or external factors, and describe a proposed solution involving rich causal models and accountability measures: Specifically, the Consequences of Needs-driven Dementia-compromised Behaviour model (C-NDB) could be adapted to be used with conversation topic detection, causal networks and multi-criteria decision making, alongside reports, audits, and deterrents. Our aim is that the considerations raised could help inform the design of care robots intended to support well-being in PWD.


title: Kernel Analog Forecasting: Multiscale Test Problems

abstract: Data-driven prediction is becoming increasingly widespread as the volume of data available grows and as algorithmic development matches this growth. The nature of the predictions made, and the manner in which they should be interpreted, depends crucially on the extent to which the variables chosen for prediction are Markovian, or approximately Markovian. Multiscale systems provide a framework in which this issue can be analyzed. In this work kernel analog forecasting methods are studied from the perspective of data generated by multiscale dynamical systems. The problems chosen exhibit a variety of different Markovian closures, using both averaging and homogenization; furthermore, settings where scale-separation is not present and the predicted variables are non-Markovian, are also considered. The studies provide guidance for the interpretation of data-driven prediction methods when used in practice.

categories: math.ST math.DS physics.comp-ph physics.data-an stat.ML stat.TH


title: Comparative Analysis of Text Classification Approaches in Electronic Health Records

abstract: Text classification tasks which aim at harvesting and/or organizing information from electronic health records are pivotal to support clinical and translational research. However these present specific challenges compared to other classification tasks, notably due to the particular nature of the medical lexicon and language used in clinical records. Recent advances in embedding methods have shown promising results for several clinical tasks, yet there is no exhaustive comparison of such approaches with other commonly used word representations and classification models. In this work, we analyse the impact of various word representations, text pre-processing and classification algorithms on the performance of four different text classification tasks. The results show that traditional approaches, when tailored to the specific language and structure of the text inherent to the classification task, can achieve or exceed the performance of more recent ones based on contextual embeddings such as BERT.


title: Cyberbullying Detection with Fairness Constraints

abstract: Cyberbullying is a widespread adverse phenomenon among online social interactions in today's digital society. While numerous computational studies focus on enhancing the cyberbullying detection performance of machine learning algorithms, proposed models tend to carry and reinforce unintended social biases. In this study, we try to answer the research question of "Can we mitigate the unintended bias of cyberbullying detection models by guiding the model training with fairness constraints?". For this purpose, we propose a model training scheme that can employ fairness constraints and validate our approach with different datasets. We demonstrate that various types of unintended biases can be successfully mitigated without impairing the model quality. We believe our work contributes to the pursuit of unbiased, transparent, and ethical machine learning solutions for cyber-social health.


title: Smart Urban Mobility: When Mobility Systems Meet Smart Data

abstract: Cities around the world are expanding dramatically, with urban population growth reaching nearly 2.5 billion people in urban areas and road traffic growth exceeding 1.2 billion cars by 2050. The economic contribution of the transport sector represents 5% of the GDP in Europe and costs an average of US $482.05 billion in the United States. These figures indicate the rapid rise of industrial cities and the urgent need to move from traditional cities to smart cities. This article provides a survey of different approaches and technologies such as intelligent transportation systems (ITS) that leverage communication technologies to help maintain road users safe while driving, as well as support autonomous mobility through the optimization of control systems. The role of ITS is strengthened when combined with accurate artificial intelligence models that are built to optimize urban planning, analyze crowd behavior and predict traffic conditions. AI-driven ITS is becoming possible thanks to the existence of a large volume of mobility data generated by billions of users through their use of new technologies and online social media. The optimization of urban planning enhances vehicle routing capabilities and solves traffic congestion problems, as discussed in this paper. From an ecological perspective, we discuss the measures and incentives provided to foster the use of mobility systems. We also underline the role of the political will in promoting open data in the transport sector, considered as an essential ingredient for developing technological solutions necessary for cities to become healthier and more sustainable.


title: CrisisBERT: a Robust Transformer for Crisis Classification and Contextual Crisis Embedding

abstract: Classification of crisis events, such as natural disasters, terrorist attacks and pandemics, is a crucial task to create early signals and inform relevant parties for spontaneous actions to reduce overall damage. Despite crisis such as natural disasters can be predicted by professional institutions, certain events are first signaled by civilians, such as the recent COVID-19 pandemics. Social media platforms such as Twitter often exposes firsthand signals on such crises through high volume information exchange over half a billion tweets posted daily. Prior works proposed various crisis embeddings and classification using conventional Machine Learning and Neural Network models. However, none of the works perform crisis embedding and classification using state of the art attention-based deep neural networks models, such as Transformers and document-level contextual embeddings. This work proposes CrisisBERT, an end-to-end transformer-based model for two crisis classification tasks, namely crisis detection and crisis recognition, which shows promising results across accuracy and f1 scores. The proposed model also demonstrates superior robustness over benchmark, as it shows marginal performance compromise while extending from 6 to 36 events with only 51.4% additional data points. We also proposed Crisis2Vec, an attention-based, document-level contextual embedding architecture for crisis embedding, which achieve better performance than conventional crisis embedding methods such as Word2Vec and GloVe. To the best of our knowledge, our works are first to propose using transformer-based crisis classification and document-level contextual crisis embedding in the literature.


title: schuBERT: Optimizing Elements of BERT

abstract: Transformers \citep{vaswani2017attention} have gradually become a key component for many state-of-the-art natural language representation models. A recent Transformer based model- BERT \citep{devlin2018bert} achieved state-of-the-art results on various natural language processing tasks, including GLUE, SQuAD v1.1, and SQuAD v2.0. This model however is computationally prohibitive and has a huge number of parameters. In this work we revisit the architecture choices of BERT in efforts to obtain a lighter model. We focus on reducing the number of parameters yet our methods can be applied towards other objectives such FLOPs or latency. We show that much efficient light BERT models can be obtained by reducing algorithmically chosen correct architecture design dimensions rather than reducing the number of Transformer encoder layers. In particular, our schuBERT gives $6.6\%$ higher average accuracy on GLUE and SQuAD datasets as compared to BERT with three encoder layers while having the same number of parameters.


title: A Bandit Approach for Mode Selection in Ambient Backscatter-Assisted Wireless-Powered Relaying

abstract: Backscattering assisted wireless-powered communication combines ultralow-power backscatter transmitters with energy harvesting devices. This paper investigates the transmission mode selection problem of a hybrid relay that forwards data by switching between the active wireless-powered transmission and the passive ambient backscattering. It first presents a hybrid relay system model and derives its end-to-end success probability under theoretically optimal, but practically unrealistic, conditions. The transmission mode selection is then formulated as a stochastic two-armed bandit problem in a varying environment where the distributions of rewards are nonstationary. The proposed model selection scheme does not assume to have access to any channel states or network conditions, but merely relies on learning from past transmission records. Numerical analyses are performed to validate the proposed bandit-based mode selection approach.


title: Patient Similarity Analysis with Longitudinal Health Data

abstract: Healthcare professionals have long envisioned using the enormous processing powers of computers to discover new facts and medical knowledge locked inside electronic health records. These vast medical archives contain time-resolved information about medical visits, tests and procedures, as well as outcomes, which together form individual patient journeys. By assessing the similarities among these journeys, it is possible to uncover clusters of common disease trajectories with shared health outcomes. The assignment of patient journeys to specific clusters may in turn serve as the basis for personalized outcome prediction and treatment selection. This procedure is a non-trivial computational problem, as it requires the comparison of patient data with multi-dimensional and multi-modal features that are captured at different times and resolutions. In this review, we provide a comprehensive overview of the tools and methods that are used in patient similarity analysis with longitudinal data and discuss its potential for improving clinical decision making.


title: A Cross-Domain Approach to Analyzing the Short-Run Impact of COVID-19 on the U.S. Electricity Sector

abstract: The novel coronavirus disease (COVID-19) has rapidly spread around the globe in 2020, with the U.S. becoming the epicenter of COVID-19 cases since late March. As the U.S. begins to gradually resume economic activity, it is imperative for policymakers and power system operators to take a scientific approach to understanding and predicting the impact on the electricity sector. Here, we release a first-of-its-kind cross-domain open-access data hub, integrating data from across all existing U.S. wholesale electricity markets with COVID-19 case, weather, cellular location, and satellite imaging data. Leveraging cross-domain insights from public health and mobility data, we uncover a significant reduction in electricity consumption across that is strongly correlated with the rise in the number of COVID-19 cases, degree of social distancing, and level of commercial activity.


title: SCAT: Second Chance Autoencoder for Textual Data

abstract: We present a k-competitive learning approach for textual autoencoders named Second Chance Autoencoder (SCAT). SCAT selects the $k$ largest and smallest positive activations as the winner neurons, which gain the activation values of the loser neurons during the learning process, and thus focus on retrieving well-representative features for topics. Our experiments show that SCAT achieves outstanding performance in classification, topic modeling, and document visualization compared to LDA, K-Sparse, NVCTM, and KATE.


title: Robust Estimation for Linear Panel Data Models

abstract: In different fields of applications including, but not limited to, behavioral, environmental, medical sciences and econometrics, the use of panel data regression models has become increasingly popular as a general framework for making meaningful statistical inferences. However, when the ordinary least squares (OLS) method is used to estimate the model parameters, presence of outliers may significantly alter the adequacy of such models by producing biased and inefficient estimates. In this work we propose a new, weighted likelihood based robust estimation procedure for linear panel data models with fixed and random effects. The finite sample performances of the proposed estimators have been illustrated through an extensive simulation study as well as with an application to blood pressure data set. Our thorough study demonstrates that the proposed estimators show significantly better performances over the traditional methods in the presence of outliers and produce competitive results to the OLS based estimates when no outliers are present in the data set.


title: Detecting Adverse Drug Reactions from Twitter through Domain-Specific Preprocessing and BERT Ensembling

abstract: The automation of adverse drug reaction (ADR) detection in social media would revolutionize the practice of pharmacovigilance, supporting drug regulators, the pharmaceutical industry and the general public in ensuring the safety of the drugs prescribed in daily practice. Following from the published proceedings of the Social Media Mining for Health (SMM4H) Applications Workshop & Shared Task in August 2019, we aimed to develop a deep learning model to classify ADRs within Twitter tweets that contain drug mentions. Our approach involved fine-tuning $BERT_{LARGE}$ and two domain-specific BERT implementations, $BioBERT$ and $Bio + clinicalBERT$, applying a domain-specific preprocessor, and developing a max-prediction ensembling approach. Our final model resulted in state-of-the-art performance on both $F_1$-score (0.6681) and recall (0.7700) outperforming all models submitted in SMM4H 2019 and during post-evaluation to date.


title: Dissipative models of swell propagation across the Pacific

abstract: Ocean swell plays an important role in the transport of energy across the ocean, yet its evolution is still not well understood. In the late 1960s, the nonlinear Schr{\"o}dinger (NLS) equation was derived as a model for the propagation of ocean swell over large distances. More recently, a number of dissipative generalizations of the NLS equation based on a simple dissipation assumption have been proposed. These models have been shown to accurately model wave evolution in the laboratory setting, but their validity in modeling ocean swell has not previously been examined. We study the efficacy of the NLS equation and four of its generalizations in modeling the evolution of swell in the ocean. The dissipative generalizations perform significantly better than conservative models and are overall reasonable models for swell amplitudes, indicating dissipation is an important physical effect in ocean swell evolution. The nonlinear models did not out-perform their linearizations, indicating linear models may be sufficient in modeling ocean swell evolution.


title: Infinite-Duration All-Pay Bidding Games

abstract: In a two-player zero-sum graph game the players move a token throughout a graph to produce an infinite path, which determines the winner or payoff of the game. Traditionally, the players alternate turns in moving the token. In {\em bidding games}, however, the players have budgets, and in each turn, we hold an "auction" (bidding) to determine which player moves the token: both players simultaneously submit bids and the higher bidder moves the token. The bidding mechanisms differ in their payment schemes. Bidding games were largely studied with variants of {\em first-price} bidding in which only the higher bidder pays his bid. We focus on {\em all-pay} bidding, where both players pay their bids. Finite-duration all-pay bidding games were studied and shown to be technically more challenging than their first-price counterparts. We study for the first time, infinite-duration all-pay bidding games. Our most interesting results are for {\em mean-payoff} objectives: we portray a complete picture for games played on strongly-connected graphs. We study both pure (deterministic) and mixed (probabilistic) strategies and completely characterize the optimal sure and almost-sure (with probability $1$) payoffs that the players can respectively guarantee. We show that mean-payoff games under all-pay bidding exhibit the intriguing mathematical properties of their first-price counterparts; namely, an equivalence with {\em random-turn games} in which in each turn, the player who moves is selected according to a (biased) coin toss. The equivalences for all-pay bidding are more intricate and unexpected than for first-price bidding.


title: When Wireless Communication Faces COVID-19: Combating the Pandemic and Saving the Economy

abstract: The year 2020 is experiencing a global health and economic crisis due to the COVID-19 pandemic. Countries across the world are using digital technologies to fight this global crisis. These digital technologies, in one way or another, strongly rely on the availability of wireless communication technologies. In this paper, we present the role of wireless communications in the COVID-19 pandemic from different perspectives. First, we show how these technologies are helping to combat this pandemic, including monitoring of the virus spread, enabling healthcare automation, and allowing virtual education and conferencing. Also, we show the importance of digital inclusiveness in the pandemic and possible solutions to connect the unconnected. Next, we discuss the challenges faced by wireless technologies, including privacy, security, and misinformation. Then, we present the importance of wireless communication technologies in the survival of the global economy, such as automation of industries and supply chain, e-commerce, and supporting occupations that are at risk. Finally, we reveal that how the technologies developed during the pandemic can be helpful in the post-pandemic era.


title: Cooling of a Zero-Nuclear-Spin Molecular Ion to a Selected Rotational State

abstract: We demonstrate rotational cooling of the silicon monoxide cation via optical pumping by a spectrally filtered broadband laser. Compared with diatomic hydrides, SiO\+ is more challenging to cool because of its smaller rotational interval. However, the rotational level spacing and large dipole moment of SiO\+ allows direct manipulation by microwaves, and the absence of hyperfine structure in its dominant isotopologue greatly reduces demands for pure quantum state preparation. These features make $^{28}$Si$^{16}$O\+ a good candidate for future applications such as quantum information processing. Cooling to the ground rotational state is achieved on a 100 ms time scale and attains a population of 94(3)\%, with an equivalent temperature $T=0.53(6)$ K. We also describe a novel spectral-filtering approach to cool into arbitrary rotational states and use it to demonstrate a narrow rotational population distribution ($N\pm1$) around a selected state.


title: Gelfand-Tsetlin Crystals

abstract: We give a crystal structure on the set of Gelfand-Tsetlin patterns which parametrize bases for finite-dimensional irreducible representations of the general linear Lie algebra. The crystal data are given in closed form, expressed using tropical polynomial functions of the entries of the patterns. We prove that with this crystal structure, the natural bijection between Gelfand-Tsetlin patterns and semistandard Young tableaux is a crystal isomorphism.


title: Quantum Weak Equivalence Principle and the Gravitational Casimir Effect in Superconductors

abstract: We will use Fisher information to properly analyze the quantum weak equivalence principle. We argue that gravitational waves will be partially reflected by superconductors. This will occur as the violation of the weak equivalence principle in Cooper pairs is larger than the surrounding ionic lattice. Such reflections of virtual gravitational waves by superconductors can produce a gravitational Casimir effect, which may be detected using currently available technology.


title: A Rate-Distortion view of human pragmatic reasoning

abstract: What computational principles underlie human pragmatic reasoning? A prominent approach to pragmatics is the Rational Speech Act (RSA) framework, which formulates pragmatic reasoning as probabilistic speakers and listeners recursively reasoning about each other. While RSA enjoys broad empirical support, it is not yet clear whether the dynamics of such recursive reasoning may be governed by a general optimization principle. Here, we present a novel analysis of the RSA framework that addresses this question. First, we show that RSA recursion implements an alternating maximization for optimizing a tradeoff between expected utility and communicative effort. On that basis, we study the dynamics of RSA recursion and disconfirm the conjecture that expected utility is guaranteed to improve with recursion depth. Second, we show that RSA can be grounded in Rate-Distortion theory, while maintaining a similar ability to account for human behavior and avoiding a bias of RSA toward random utterance production. This work furthers the mathematical understanding of RSA models, and suggests that general information-theoretic principles may give rise to human pragmatic reasoning.


title: Morita isomorphism for Cuntz algebras

abstract: Let ${\rm Rep}\,{\cal O}_n$ denote the category of all nondegenerate $^*$ representations of the Cuntz algebra ${\cal O}_n$. For any $2\leq n,m<\infty$, we construct an isomorphism functor $F_{n,m}$ from ${\rm Rep}\,{\cal O}_m$ to ${\rm Rep}\,{\cal O}_n$.


title: The Confinement of the Heliosheath Plasma by the Solar Magnetic Field as Revealed by Energetic Neutral Atom Simulations

abstract: Traditionally, the solar magnetic field has been considered to have a negligible effect in the outer regions of the heliosphere. Recent works have shown that the solar magnetic field may play a crucial role in collimating the plasma in the heliosheath. Interstellar Boundary Explorer (IBEX) observations of the heliotail indicated a latitudinal structure varying with energy in the energetic neutral atom (ENA) fluxes. At energies ~1 keV, the ENA fluxes show an enhancement at low latitudes and a deficit of ENAs near the poles. At energies >2.7 keV, ENA fluxes had a deficit within low latitudes, and lobes of higher ENA flux near the poles. This ENA structure was initially interpreted to be a result of the latitudinal profile of the solar wind during solar minimum. We extend the work of Kornbleuth et al. (2018) by using solar minimum-like conditions and the recently developed SHIELD model. The SHIELD model couples the magnetohydrodynamic (MHD) plasma solution with a kinetic description of neutral hydrogen. We show that while the latitudinal profile of the solar wind during solar minimum contributes to the lobes in ENA maps, the collimation by the solar magnetic field is important in creating and shaping the two high latitude lobes of enhanced ENA flux observed by IBEX. This is the first work to explore the effect of the changing solar magnetic field strength on ENA maps. Our findings suggest that IBEX is providing the first observational evidence of the collimation of the heliosheath plasma by the solar magnetic field.


title: Establishing Trust in Online Advertising with Signed Transactions

abstract: Programmatic advertising operates one of the most sophisticated and efficient service platforms on the Internet. However, the complexity of this ecosystem is a direct cause of one of the most important problems in online advertising, the lack of transparency. This lack of transparency enables subsequent problems such as advertising fraud, which causes billions of dollars in losses. In this paper we propose Ads.chain, a technological solution to the lack-of-transparency problem in programmatic advertising. Ads.chain extends the current effort of the Internet Advertising Bureau (IAB) in providing traceability in online advertising through the Ads.txt and Ads.cert solutions, addressing the limitations of these techniques. Ads.chain is (to the best of the authors' knowledge) the first solution that provides end-to-end cryptographic traceability at the ad transaction level. It is a communication protocol that can be seamlessly embedded into ad-tags and the OpenRTB protocol, the de-facto standards for communications in online advertising, allowing an incremental adoption by the industry. We have implemented Ads.chain and made the code publicly available. We assess the performance of Ads.chain through a thorough analysis in a lab environment that emulates a real ad delivery process at real-life throughputs. The obtained results show that Ads.chain can be implemented with limited impact on the hardware resources and marginal delay increments at the publishers lower than 0.20 milliseconds per ad space on webpages and 2.6 milliseconds at the programmatic advertising platforms. These results confirm that Ads.chain's impact on the user experience and the overall operation of the programmatic ad delivery process can be considered negligible.


title: A Generating-Extension-Generator for Machine Code

abstract: The problem of "debloating" programs for security and performance purposes has begun to see increased attention. Of particular interest in many environments is debloating commodity off-the-shelf (COTS) software, which is most commonly made available to end users as stripped binaries (i.e., neither source code nor symbol-table/debugging information is available). Toward this end, we created a system, called GenXGen[MC], that specializes stripped binaries. Many aspects of the debloating problem can be addressed via techniques from the literature on partial evaluation. However, applying such techniques to real-world programs, particularly stripped binaries, involves non-trivial state-management manipulations that have never been addressed in a completely satisfactory manner in previous systems. In particular, a partial evaluator needs to be able to (i) save and restore arbitrary program states, and (ii) determine whether a program state is equal to one that arose earlier. Moreover, to specialize stripped binaries, the system must also be able to handle program states consisting of memory that is undifferentiated beyond the standard coarse division into regions for the stack, the heap, and global data. This paper presents a new approach to state management in a program specializer. The technique has been incorporated into GenXGen[MC], a novel tool for producing machine-code generating extensions. Our experiments show that our solution to issue (i) significantly decreases the space required to represent program states, and our solution to issue (ii) drastically improves the time for producing a specialized program (as much as 13,000x speedup).


title: On the Hilbert $2$-class field towers of some cyclotomic $\mathbb{Z}_2$-extensions

abstract: In this paper, we study the length of the $2$-class field towers and the structure of the Galois groups $\mathrm{Gal}(\mathcal{L}(K_n)/K_n)$ of the maximal unramified $2$-extensions of the layers $K_n$ of the cyclotomic $\mathbb{Z}_2$-extension of some special Dirichlet fields. The capitulation problem is investigated too.


title: Systematic Ensemble Model Selection Approach for Educational Data Mining

abstract: A plethora of research has been done in the past focusing on predicting student's performance in order to support their development. Many institutions are focused on improving the performance and the education quality; and this can be achieved by utilizing data mining techniques to analyze and predict students' performance and to determine possible factors that may affect their final marks. To address this issue, this work starts by thoroughly exploring and analyzing two different datasets at two separate stages of course delivery (20 percent and 50 percent respectively) using multiple graphical, statistical, and quantitative techniques. The feature analysis provides insights into the nature of the different features considered and helps in the choice of the machine learning algorithms and their parameters. Furthermore, this work proposes a systematic approach based on Gini index and p-value to select a suitable ensemble learner from a combination of six potential machine learning algorithms. Experimental results show that the proposed ensemble models achieve high accuracy and low false positive rate at all stages for both datasets.


title: Overview of heavy-flavour measurements in ALICE

abstract: ALICE is devoted to the study of the properties of the Quark-Gluon Plasma (QGP). This state of matter is created in ultra-relativistic heavy-ion collisions at the LHC. Heavy quarks are considered effective probes of the QGP since, due to their large masses, they are produced in hard scattering processes and experience the full evolution of the hot and dense medium while interacting with its constituents. The heavy-quark measurements provide insights on processes like in-medium energy loss and hadronization. Measurements in proton-proton collisions provide the baseline for interpreting heavy-ion collision results and constitute an excellent test of pQCD calculations. In addition, proton-nucleus collisions allow separating cold nuclear matter effects from those due to the deconfined strongly interacting matter created in heavy-ion collisions. In this contribution, an overview of recent ALICE results for open heavy flavours, quarkonia, and heavy-flavour jets is presented.


title: How hard is to distinguish graphs with graph neural networks?

abstract: A hallmark of graph neural networks is their ability to distinguish the isomorphism class of their inputs. This study derives hardness results for the classification variant of graph isomorphism in the message-passing model (MPNN). MPNN encompasses the majority of graph neural networks used today and is universal when nodes are given unique features. The analysis relies on the introduced measure of communication capacity. Capacity measures how much information the nodes of a network can exchange during the forward pass and depends on the depth, message-size, global state, and width of the architecture. It is shown that the capacity of MPNN needs to grow linearly with the number of nodes so that a network can distinguish trees and quadratically for general connected graphs. The derived bounds concern both worst- and average-case behavior and apply to networks with/without unique features and adaptive architecture -- they are also up to two orders of magnitude tighter than those given by simpler arguments. An empirical study involving 12 graph classification tasks and 420 networks reveals strong alignment between actual performance and theoretical predictions.


title: Memory Controlled Sequential Self Attention for Sound Recognition

abstract: In this paper we investigate the importance of the extent of memory in sequential self attention for sound recognition. We propose to use a memory controlled sequential self attention mechanism on top of a convolutional recurrent neural network (CRNN) model for polyphonic sound event detection (SED). Experiments on the URBAN-SED dataset demonstrate the impact of the extent of memory on sound recognition performance with the self attention induced SED model. We extend the proposed idea with a multi-head self attention mechanism where each attention head processes the audio embedding with explicit attention width values. The proposed use of memory controlled sequential self attention offers a way to induce relations among frames of sound event tokens. We show that our memory controlled self attention model achieves an event based F -score of 33.92% on the URBAN-SED dataset, outperforming the F -score of 20.10% reported by the model without self attention.


title: The Athena++ Adaptive Mesh Refinement Framework: Design and Magnetohydrodynamic Solvers

abstract: The design and implementation of a new framework for adaptive mesh refinement (AMR) calculations is described. It is intended primarily for applications in astrophysical fluid dynamics, but its flexible and modular design enables its use for a wide variety of physics. The framework works with both uniform and nonuniform grids in Cartesian and curvilinear coordinate systems. It adopts a dynamic execution model based on a simple design called a "task list" that improves parallel performance by overlapping communication and computation, simplifies the inclusion of a diverse range of physics, and even enables multiphysics models involving different physics in different regions of the calculation. We describe physics modules implemented in this framework for both non-relativistic and relativistic magnetohydrodynamics (MHD). These modules adopt mature and robust algorithms originally developed for the Athena MHD code and incorporate new extensions: support for curvilinear coordinates, higher-order time integrators, more realistic physics such as a general equation of state, and diffusion terms that can be integrated with super-time-stepping algorithms. The modules show excellent performance and scaling, with well over 80% parallel efficiency on over half a million threads. The source code has been made publicly available.


title: Stability of approximate group actions: uniform and probabilistic

abstract: We prove that every uniform approximate homomorphism from a discrete amenable group into a symmetric group is uniformly close to a homomorphism into a slightly larger symmetric group. That is, amenable groups are uniformly flexibly stable in permutations. This answers affirmatively a question of Kun and Thom and a slight variation of a question of Lubotzky. We also give a negative answer to Lubotzky's original question by showing that the group $\mathbb{Z}$ is not uniformly strictly stable. Furthermore, we show that $\text{SL}_{r}(\mathbb{Z})$, $r\geq3$, is uniformly flexibly stable, but the free group $F_{r}$, $r\geq 2$, is not. We define and investigate a probabilistic variant of uniform stability that has an application to property testing.


title: Structured Query-Based Image Retrieval Using Scene Graphs

abstract: A structured query can capture the complexity of object interactions (e.g. 'woman rides motorcycle') unlike single objects (e.g. 'woman' or 'motorcycle'). Retrieval using structured queries therefore is much more useful than single object retrieval, but a much more challenging problem. In this paper we present a method which uses scene graph embeddings as the basis for an approach to image retrieval. We examine how visual relationships, derived from scene graphs, can be used as structured queries. The visual relationships are directed subgraphs of the scene graph with a subject and object as nodes connected by a predicate relationship. Notably, we are able to achieve high recall even on low to medium frequency objects found in the long-tailed COCO-Stuff dataset, and find that adding a visual relationship-inspired loss boosts our recall by 10% in the best case.


title: Flexible Example-based Image Enhancement with Task Adaptive Global Feature Self-Guided Network

abstract: We propose the first practical multitask image enhancement network, that is able to learn one-to-many and many-to-one image mappings. We show that our model outperforms the current state of the art in learning a single enhancement mapping, while having significantly fewer parameters than its competitors. Furthermore, the model achieves even higher performance on learning multiple mappings simultaneously, by taking advantage of shared representations. Our network is based on the recently proposed SGN architecture, with modifications targeted at incorporating global features and style adaption. Finally, we present an unpaired learning method for multitask image enhancement, that is based on generative adversarial networks (GANs).


title: Gaussian 1-2-1 Networks with Imperfect Beamforming

abstract: In this work, we study bounds on the capacity of full-duplex Gaussian 1-2-1 networks with imperfect beamforming. In particular, different from the ideal 1-2-1 network model introduced in [1], in this model beamforming patterns result in side-lobe leakage that cannot be perfectly suppressed. The 1-2-1 network model captures the directivity of mmWave network communications, where nodes communicate by pointing main-lobe "beams" at each other. We characterize the gap between the approximate capacities of the imperfect and ideal 1-2-1 models for the same channel coefficients and transmit power. We show that, under some conditions, this gap only depends on the number of nodes. Moreover, we evaluate the achievable rate of schemes that treat the resulting side-lobe leakage as noise, and show that they offer suitable solutions for implementation.


title: Spatially Resolved Molecular Gas Properties of Host Galaxy of Type I Superluminous Supernova SN 2017egm

abstract: We present the results of CO(1-0) observations of the host galaxy of a Type I superluminous supernova (SLSN-I), SN2017egm, one of the closest SLSNe-I at z = 0.03063, by using the Atacama Large Millimeter/submillimeter Array. The molecular gas mass of the host galaxy is $M_{\rm gas} = (4.8 \pm 0.3) \times 10^9$ $M_{\odot}$, placing it on the sequence of normal star-forming galaxies in an $M_{\rm gas}$-star-formation rate (SFR) plane. The molecular hydrogen column density at the location of SN2017egm is higher than that of the Type II SN PTF10bgl, which is also located in the same host galaxy, and those of other Type II and Ia SNe located in different galaxies, suggesting that SLSNe-I have a preference for a dense molecular gas environment. On the other hand, the column density at the location of SN2017egm is comparable to those of Type Ibc SNe. The surface densities of molecular gas and the SFR at the location of SN2017egm are consistent with those of spatially resolved local star-forming galaxies and follow the Schmidt-Kennicutt relation. These facts suggest that SLSNe-I can occur in environments with the same star-formation mechanism as in normal star-forming galaxies.


title: Spin-polarized triplet supercurrent in Josephson junctions with perpendicular ferromagnetic layers

abstract: Josephson junctions containing three ferromagnetic layers with non-collinear magnetizations between adjacent layers carry spin-triplet supercurrent under certain conditions. The signature of the spin-triplet supercurrent is a relatively slow decay of the maximum supercurrent as a function of the thickness of the middle ferromagnetic layer. In this work we focus on junctions where the middle magnetic layer is a [Co/Pd]$_N$ multilayer with perpendicular magnetic anisotropy (PMA), while the outer two layers have in-plane anisotropy. We compare junctions where the middle PMA layer is or is not configured as a synthetic antiferromagnet (PMA-SAF). We find that the supercurrent decays much more rapidly with increasing the number $N$ of [Co/Pd] bilayers in the PMA-SAF junctions compared to the PMA junctions. Similar behavior is observed in junctions containing [Co/Ni]$_N$ PMA multilayers. We model that behavior by assuming that each Co/Pd or Co/Ni interface acts as a partial spin filter, so that the spin-triplet supercurrent in the PMA junctions becomes more strongly spin-polarized as $N$ increases while the supercurrent in the PMA-SAF junctions is suppressed with increasing $N$. We also address a question raised in a previous work regarding how much spin-singlet supercurrent is transmitted through our nominally spin-triplet junctions. We do that by comparing spin-triplet junctions with similar junctions where the order of the magnetic layers has been shuffled. The results of this work are expected to be helpful in designing spin-triplet Josephson junctions for use in cryogenic memory.


title: Spreading dynamics of infectious diseases on structured society with daily cycles

abstract: We are facing a common serious issue, infectious diseases, and trying to suppress the spreading of infection. We need less contact with each other to decrease the chance of infection, but this means loss of economic activity, as well. This tradeoff is inevitable in our society, because we still need direct communication and commuting, so far. The focus of our paper is the structure of society, on which we have direct contacts. We study on spreading process with artificial sosiety model, where each agent has daily cycle and go office and back home, every day. At the same time, infection spreads along SIR model. We show both slow infection and short commuting can be realized with some structures and vice versa. The most effective factor for such features is modularity of society. In highly modular society, agents live around the destined office, but agents commute long way to their office and can be infected fast, in not modular society. The first infection point is one more factor for the features. If the first infection takes place around the office, infection spreads slower. On the contrary, if the first one takes place far away from the office, infection can be fast. We show a design principle, high modularity and sparsely distributed offices, for good society and discuss on possible solutions in real society, where we live in.


title: The Extended Theory of Trees and Algebraic (Co)datatypes

abstract: The first-order theory of finite and infinite trees has been studied since the eighties, especially by the logic programming community. Following Djelloul, Dao and Fr\"uhwirth, we consider an extension of this theory with an additional predicate for finiteness of trees, which is useful for expressing properties about (not just datatypes but also) codatatypes. Based on their work, we present a simplification procedure that determines whether any given (not necessarily closed) formula is satisfiable, returning a simplified formula which enables one to read off all possible models. Our extension makes the algorithm usable for algebraic (co)datatypes, which was impossible in their original work due to restrictive assumptions. We also provide a prototype implementation of our simplification procedure and evaluate it on instances from the SMT-LIB.


title: Homotopy liftings and Hochschild cohomology of some twisted tensor products

abstract: The Hochschild cohomology of a tensor product of algebras is isomorphic to a graded tensor product of Hochschild cohomology algebras, as a Gerstenhaber algebra. A similar result holds when the tensor product is twisted by a bicharacter. We present new proofs of these isomorphisms, using Volkov's homotopy liftings that were introduced for handling Gerstenhaber brackets expressed on arbitrary bimodule resolutions. Our results illustrate the utility of homotopy liftings for theoretical purposes.


title: Millimeter Wave Remove UAV Control and Communications for Public Safety Scenarios

abstract: Communication and video capture from unmanned aerial vehicles (UAVs) offer significant potential for assisting first responders in remote public safety settings. In such uses, millimeter wave (mmWave) wireless links can provide high throughput and low latency connectivity between the UAV and a remote command center. However, maintaining reliable aerial communication in the mmWave bands is challenging due to the need to support high speed beam tracking and overcome blockage. This paper provides a simulation study aimed at assessing the feasibility of public safety UAV connectivity through a 5G link at 28 GHz. Real flight motion traces are captured during maneuvers similar to those expected in public safety settings. The motions traces are then incorporated into a detailed mmWave network simulator that models the channel, blockage, beamforming and full 3GPP protocol stack. We show that 5G mmWave communications can deliver throughput up to 1 Gbps with consistent sub ms latency when the base station is located near the mission area, enabling remote offloading of the UAV control and perception algorithms.


title: Structural evolution and skyrmionic phase diagram of the lacunar spinel GaMo$_4$Se$_8$

abstract: In the $AB_4Q_8$ lacunar spinels, the electronic structure is described on the basis of inter- and intra-cluster interactions of tetrahedral $B_4$ clusters, and tuning these can lead to myriad fascinating electronic and magnetic ground states. In this work, we employ magnetic measurements, synchrotron X-ray and neutron scattering, and first-principles electronic structure calculations to examine the coupling between structural and magnetic phase evolution in GaMo$_4$Se$_8$, including the emergence of a skyrmionic regime in the magnetic phase diagram. We show that the competition between two distinct Jahn-Teller distortions of the room temperature cubic $F\overline{4}3m$ structure leads to the coexistence of the ground state $R3m$ phase and a metastable $Imm2$ phase. The magnetic properties of these two phases are computationally shown to be very different, with the $Imm2$ phase exhibiting uniaxial ferromagnetism and the $R3m$ phase hosting a complex magnetic phase diagram including equilibrium N\'eel--type skyrmions stable from nearly $T$ = 28 K down to $T$ = 2 K, the lowest measured temperature. The large change in magnetic behavior induced by a small structural distortion reveals that GaMo$_4$Se$_8$ is an exciting candidate material for tuning unconventional magnetic properties $via$ mechanical means.


title: Coexistence of phases and interphase boundaries in BaTiO3

abstract: A theoretical analysis of the internal structure of interphase boundaries separating domains of coexisting phases are presented for the perovskite ferroelectric BaTiO3. The temperature dependence of interphase boundary widths and surface energies are calculated and compared with the corresponding parameters for different types of domain walls existing within the ferroelectric phases of BaTiO3.


title: Turing's Children: Representation of Sexual Minorities in STEM

abstract: We provide the first nationally representative estimates of sexual minority representation in STEM fields by studying 142,641 men and women in same-sex couples from the 2009-2018 American Community Surveys. These data indicate that men in same-sex couples are 12 percentage points less likely to have completed a bachelor's degree in a STEM field compared to men in different-sex couples; there is no gap observed for women in same-sex couples compared to women in different-sex couples. The STEM gap between men in same-sex and different-sex couples is larger than the STEM gap between white and black men but is smaller than the gender STEM gap. We also document a gap in STEM occupations between men in same-sex and different-sex couples, and we replicate this finding using independently drawn data from the 2013-2018 National Health Interview Surveys. These differences persist after controlling for demographic characteristics, location, and fertility. Our findings further the call for interventions designed at increasing representation of sexual minorities in STEM.


title: Scaling Blockchains Without Giving up Decentralization and Security

abstract: Public blockchains should be able to scale with respect to the number of nodes and to the transactions workload. The blockchain scalability trilemma has been informally conjectured. This is related to scalability, security and decentralization, stating that any improvement in one of these aspects should negatively impact on at least one of the other twos. In fact, despite the large research and experimental effort, all known approaches turn out to be tradeoffs. We theoretically describe a new blockchain architecture that scales to arbitrarily high workload provided that a corresponding proportional increment of nodes is provisioned. We show that, under reasonable assumptions, our approach does not require tradeoffs on security or decentralization. To the best of our knowledge, this is the first result that disprove the trilemma considering the scalability of all architectural elements of a blockchain and not only the consensus protocol. While our result is currently only theoretic, we believe that ot our approach may stimulate significant practical contributions.


title: Guessing Cost: Bounds and Applications to Data Repair in Distributed Storage

abstract: The guesswork refers to the distribution of the minimum number of trials needed to guess a realization of a random variable accurately. In this study, a non-trivial generalization of the guesswork called guessing cost (also referred to as cost of guessing) is introduced, and an optimal strategy for finding the $\rho$-th moment of guessing cost is provided for a random variable defined on a finite set whereby each choice is associated with a positive finite cost value (unit cost corresponds to the original guesswork). Moreover, we drive asymptotically tight upper and lower bounds on the logarithm of guessing cost moments. Similar to previous studies on the guesswork, established bounds on the moments of guessing cost quantify the accumulated cost of guesses required for correctly identifying the unknown choice and are expressed in terms of R\'enyi's entropy. Moreover, new random variables are introduced to establish connections between the guessing cost and the guesswork, leading to induced strategies. Establishing this implicit connection helped us obtain improved bounds for the non-asymptotic region. As a consequence, we establish the guessing cost exponent in terms of R\'enyi entropy rate on the moments of the guessing cost using the optimal strategy by considering a sequence of independent random variables with different cost distributions. Finally, with slight modifications to the original problem, these results are shown to be applicable for bounding the overall repair bandwidth for distributed data storage systems backed up by base stations and protected by bipartite graph codes.


title: Exploiting Multi-Layer Grid Maps for Surround-View Semantic Segmentation of Sparse LiDAR Data

abstract: In this paper, we consider the transformation of laser range measurements into a top-view grid map representation to approach the task of LiDAR-only semantic segmentation. Since the recent publication of the SemanticKITTI data set, researchers are now able to study semantic segmentation of urban LiDAR sequences based on a reasonable amount of data. While other approaches propose to directly learn on the 3D point clouds, we are exploiting a grid map framework to extract relevant information and represent them by using multi-layer grid maps. This representation allows us to use well-studied deep learning architectures from the image domain to predict a dense semantic grid map using only the sparse input data of a single LiDAR scan. We compare single-layer and multi-layer approaches and demonstrate the benefit of a multi-layer grid map input. Since the grid map representation allows us to predict a dense, 360{\deg} semantic environment representation, we further develop a method to combine the semantic information from multiple scans and create dense ground truth grids. This method allows us to evaluate and compare the performance of our models not only based on grid cells with a detection, but on the full visible measurement range.


title: Free Boundary Regularity of the Porous Medium Equation with nonlocal drifts in Dimension One

abstract: We study the free boundary of the porous medium equation with nonlocal drifts in dimension one. Under the assumption that the initial data has super-quadratic growth at the free boundary, we show that the solution is smooth in space and $C^{2,1}_{\loc}$ in time, and then the free boundary is $C^{2,1}_{\loc}$. Moreover if the drift is local, both the solution and the free boundary are smooth.


title: On a probabilistic local-global principle for torsion on elliptic curves

abstract: Let $m$ be a positive integer and let $E$ be an elliptic curve over $\mathbb{Q}$ with the property that $m\mid#E(\mathbb{F}_p)$ for a density $1$ set of primes $p$. Building upon work of Katz and Harron-Snowden, we study the probability that $m$ divides the the order of the torsion subgroup of $E(\mathbb{Q})$: we find it is nonzero for all $m \in \{ 1, 2, \dots, 10, 12, 16\}$ and we compute it exactly when $m \in \{ 1,2,3,4,5,7 \}$. As a supplement, we give an asymptotic count of elliptic curves with extra level structure when the parametrizing modular curve arises from the quotient by a torsion-free group of genus zero.


title: Federated Recommendation System via Differential Privacy

abstract: In this paper, we are interested in what we term the federated private bandits framework, that combines differential privacy with multi-agent bandit learning. We explore how differential privacy based Upper Confidence Bound (UCB) methods can be applied to multi-agent environments, and in particular to federated learning environments both in `master-worker' and `fully decentralized' settings. We provide a theoretical analysis on the privacy and regret performance of the proposed methods and explore the tradeoffs between these two.


title: Optimally Fast Soft Shadows on Curved Terrain with Dynamic Programming and Maximum Mipmaps

abstract: We present a simple, novel method of efficiently rendering ray cast soft shadows on curved terrain by using dynamic programming and maximum mipmaps to rapidly find a global minimum shadow cost in constant runtime complexity. Additionally, we apply a new method of reducing view ray computation times that pre-displaces the terrain mesh to bootstrap ray starting positions. Combining these two methods, our ray casting engine runs in real-time with more than 200% speed up over uniform ray stepping with comparable image quality and without hardware ray tracing acceleration. To add support for accurate planetary ephemerides and interactive features, we integrated the engine into celestia.Sci, a general space simulation software. We demonstrate the ability of our engine to accurately handle a large range of distance scales by using it to generate videos of lunar landing trajectories. The numerical error when compared with real lunar mission imagery is small, demonstrating the accuracy and efficiency of our approach.


title: Approximating The p-Mean Curve of Large Data-Sets

abstract: A set of piecewise linear functions, called polylines, $P_1,\ldots,P_L$ each with at most $n$ vertices can be simplified into a polyline $M$ with $k$ vertices, such that the Fr\'echet distances $\epsilon_1,\ldots,\epsilon_L$ to each of these polylines are minimized under the $L_p$ distance. We call $M$ for $L_p$ with $p\geq 1$ a $p$-mean curve ($p$-MC). We discuss $p\geq 1$, for which $L_p$ distance satisfies the triangle inequality and $p$-mean has not been discussed before for most values $p$. Computing the $p$-mean polyline is NP-hard for $L=\Omega(1)$ and some values of $p$, so we discuss approximation algorithms. We give a $O(n^2\log k)$ time exact algorithm for $L=2$ and $p\geq 1$. Also, we reduce the Fr\'echet distance to the discrete Fr\'echet distance which adds a factor $2$ to both $k$ and $\epsilon$. Then we use our exact algorithm to find a $3$-approximation for $L>2$ in $\operatorname{poly}(n,L)$ time. Our method is based on a generalization of the free-space diagram (FSD) for Fr\'echet distance and composable core-sets for approximate summaries.


title: Comparison of Information Structures for Zero-Sum Games and a Partial Converse to Blackwell Ordering in Standard Borel Spaces

abstract: In statistical decision theory involving a single decision-maker, an information structure is said to be better than another one if for any cost function involving a hidden state variable and an action variable which is restricted to be conditionally independent from the state given some measurement, the solution value under the former is not worse than that under the latter. For finite spaces, a theorem due to Blackwell leads to a complete characterization on when one information structure is better than another. For stochastic games, in general, such an ordering is not possible since additional information can lead to equilibria perturbations with positive or negative values to a player. However, for zero-sum games in a finite probability space, P\k{e}ski introduced a complete characterization of ordering of information structures. In this paper, we obtain an infinite dimensional (standard Borel) generalization of P\k{e}ski's result. A corollary is that more information cannot hurt a decision maker taking part in a zero-sum game. We establish two supporting results which are essential and explicit though modest improvements on prior literature: (i) a partial converse to Blackwell's ordering in the standard Borel setup and (ii) an existence result for equilibria in zero-sum games with incomplete information.


title: On the Convergence of Overlapping Schwarz Decomposition for Nonlinear Optimal Control

abstract: We study the convergence properties of an overlapping Schwarz decomposition algorithm for solving nonlinear optimal control problems (OCPs). The algorithm decomposes the time domain into a set of overlapping subdomains, and solves all subproblems defined over subdomains in parallel. The convergence is attained by updating primal-dual information at the boundaries of overlapping subdomains. We show that the algorithm exhibits local linear convergence, and that the convergence rate improves exponentially with the overlap size. We also establish global convergence results for a general quadratic programming, which enables the application of the Schwarz scheme inside second-order optimization algorithms (e.g., sequential quadratic programming). The theoretical foundation of our convergence analysis is a sensitivity result of nonlinear OCPs, which we call "exponential decay of sensitivity" (EDS). Intuitively, EDS states that the impact of perturbations at domain boundaries (i.e. initial and terminal time) on the solution decays exponentially as one moves into the domain. Here, we expand a previous analysis available in the literature by showing that EDS holds for both primal and dual solutions of nonlinear OCPs, under uniform second-order sufficient condition, controllability condition, and boundedness condition. We conduct experiments with a quadrotor motion planning problem and a PDE control problem to validate our theory; and show that the approach is significantly more efficient than ADMM and as efficient as the centralized solver Ipopt.


title: Hall effect in ferromagnetic nanomagnets: magnetic field dependence as an evidence of inverse spin Hall effect contribution

abstract: We measure magnetic field dependence of the Hall angle in a metallic ferromagnetic nanomagnet with stable local magnetic moments where the adopted mechanisms of Hall effect predict linear plus a constant dependence on the external field originating from the ordinary and anomalous Hall effects, respectively. We suggest that the experimentally observed deviations from this dependence is caused by the inverse spin Hall effect (ISHE) and develop a phenomenological theory, which predicts a unique nonlinear dependence of the ISHE contribution on the external magnetic field. Perfect agreement between theory and experiment supports the considerable role of the ISHE in the Hall transport in ferromagnetic metals.


title: Explaining Black Box Predictions and Unveiling Data Artifacts through Influence Functions

abstract: Modern deep learning models for NLP are notoriously opaque. This has motivated the development of methods for interpreting such models, e.g., via gradient-based saliency maps or the visualization of attention weights. Such approaches aim to provide explanations for a particular model prediction by highlighting important words in the corresponding input text. While this might be useful for tasks where decisions are explicitly influenced by individual tokens in the input, we suspect that such highlighting is not suitable for tasks where model decisions should be driven by more complex reasoning. In this work, we investigate the use of influence functions for NLP, providing an alternative approach to interpreting neural text classifiers. Influence functions explain the decisions of a model by identifying influential training examples. Despite the promise of this approach, influence functions have not yet been extensively evaluated in the context of NLP, a gap addressed by this work. We conduct a comparison between influence functions and common word-saliency methods on representative tasks. As suspected, we find that influence functions are particularly useful for natural language inference, a task in which 'saliency maps' may not have clear interpretation. Furthermore, we develop a new quantitative measure based on influence functions that can reveal artifacts in training data.


title: Radial perturbations of the scalarized black holes in Einstein-Maxwell-conformally coupled scalar theory

abstract: We perform the stability analysis for the scalarized charged black holes obtained from Einstein-Maxwell-conformally coupled scalar (EMCS) theory by employing the radial perturbations. The targeting black holes include a single branch of scalarized charged black hole with the coupling parameter $\alpha>0$ inspired by the constant scalar hairy black hole as well as infinite branches of $n=0(\alpha \ge 8.019),1(\alpha \ge 40.84),2(\alpha \ge 99.89),\cdots$ scalarized charged black holes found through the spontaneous scalarization on the Reissner-Nordstr\"om black hole. It turns out that the black hole in the single branch and the $n = 0$ black hole are stable against radial perturbations, while the $n = 1, 2$ excited black holes are unstable in the EMCS theory with both quadratic and exponential couplings.


title: Activation functions are not needed: the ratio net

abstract: A deep neural network for classification tasks is essentially consist of two components: feature extractors and function approximators. They usually work as an integrated whole, however, improvements on any components can promote the performance of the whole algorithm. This paper focus on designing a new function approximator. Conventionally, to build a function approximator, one usually uses the method based on the nonlinear activation function or the nonlinear kernel function and yields classical networks such as the feed-forward neural network (MLP) and the radial basis function network (RBF). In this paper, a new function approximator that is effective and efficient is proposed. Instead of designing new activation functions or kernel functions, the new proposed network uses the fractional form. For the sake of convenience, we name the network the ratio net. We compare the effectiveness and efficiency of the ratio net and that of the RBF and the MLP with various kinds of activation functions in the classification task on the mnist database of handwritten digits and the Internet Movie Database (IMDb) which is a binary sentiment analysis dataset. It shows that, in most cases, the ratio net converges faster and outperforms both the MLP and the RBF.


title: Phase transition induced by traffic lights on a single lane road

abstract: In this work we study the effect of a traffic light system on the flow of a single lane road by proposing a traffic model based on a cellular automaton that also includes behavioral considerations. We focus on the macroscopic characterization of the system by studying the changes in vehicle density and the occurrence of jams. In this context we observe and characterize a phase transition between the free flow and jammed states. This transition is induced by the instabilities originated by the vehicles stopping at the traffic lights. Moreover, we analyze the effect of these instabilities on the critical density of vehicles at which the transition occurs as a function of two parameters: (i) the in-flow of cars, (ii) the drivers' behavior. For the latter we observe that the traffic light perturbations feedback on the drivers behavior can lead the system to different scenarios, which are also analyzed.


title: A class of fractional p()-Kirchhoff type systems

abstract: This paper is concerned with an elliptic system of Kirchhoff type, driven by the variable-order fractional $p(x)$-operator. With the help of the direct variational method and Ekeland variational principle, we show the existence of a weak solution. This is our first attempt to study this kind of system, in the case of variable-order fractional variable exponents. Our main theorem extends in several directions previous results.


title: Trapping electrons in a room-temperature microwave Paul trap

abstract: We demonstrate trapping of electrons in a millimeter-sized quadrupole Paul trap driven at 1.6~GHz in a room-temperature ultra-high vacuum setup. Cold electrons are introduced into the trap by ionization of atomic calcium via Rydberg states and stay confined by microwave and static electric fields for several tens of milliseconds. A fraction of these electrons remain trapped longer and show no measurable loss for measurement times up to a second. Electronic excitation of the motion reveals secular frequencies which can be tuned over a range of several tens to hundreds of MHz. Operating a similar electron Paul trap in a cryogenic environment may provide a platform for all-electric quantum computing with trapped electron spin qubits.


title: The Open Algebraic Path Problem

abstract: The algebraic path problem provides a general setting for shortest path algorithms in optimization and computer science. This work extends the algebraic path problem to networks equipped with input and output boundaries. We show that the algebraic path problem is functorial as a mapping from a double category whose horizontal composition is gluing of open networks. We introduce functional open matrices, for which the functoriality of the algebraic path problem has a more practical expression.


title: Exactness of SWKB for Shape Invariant Potentials

abstract: The supersymmetry based semiclassical method (SWKB) is known to produce exact spectra for conventional shape invariant potentials. In this paper we prove that this exactness follows from their additive shape invariance.


title: W-Cell-Net: Multi-frame Interpolation of Cellular Microscopy Videos

abstract: Deep Neural Networks are increasingly used in video frame interpolation tasks such as frame rate changes as well as generating fake face videos. Our project aims to apply recent advances in Deep video interpolation to increase the temporal resolution of fluorescent microscopy time-lapse movies. To our knowledge, there is no previous work that uses Convolutional Neural Networks (CNN) to generate frames between two consecutive microscopy images. We propose a fully convolutional autoencoder network that takes as input two images and generates upto seven intermediate images. Our architecture has two encoders each with a skip connection to a single decoder. We evaluate the performance of several variants of our model that differ in network architecture and loss function. Our best model out-performs state of the art video frame interpolation algorithms. We also show qualitative and quantitative comparisons with state-of-the-art video frame interpolation algorithms. We believe deep video interpolation represents a new approach to improve the time-resolution of fluorescent microscopy.


title: Strongly non-quantitative classical information in quantum carriers

abstract: A simple method to enhance the quality of communication is to send a carrier with its copies. Classical information theory says that information behaves quantitatively under copying. In other words, if a carrier is more informatic than another carrier, it remains so when they are compared with their copies. Using the lens of quantum mechanics, we challenge this accepted fact of classical information theory. Specifically, we examine two quantum systems parameterized differently by the same random variable such that the first system alone offers a more accurate guess about the variable in any figure of merit, while the two copies of the second system together do more in some figures of merit than the two copies of the original system. This finding unveils a conceptual discrepancy between classical information and its carrier, and implies the possibility of hiding classical information in a form of quantum information.


title: Adaptive Multi-Trace Carving for Robust Frequency Tracking in Forensic Applications

abstract: In the field of information forensics, many emerging problems involve a critical step that estimates and tracks weak frequency components in noisy signals. It is often challenging for the prior art of frequency tracking to i)achieve a high accuracy under noisy conditions, ii)detect and track multiple frequency components efficiently, or iii)strike a good trade-off of the processing delay versus the resilience and the accuracy of tracking. To address these issues, we propose Adaptive Multi-Trace Carving (AMTC), a unified approach for detecting and tracking one or more subtle frequency components under very low signal-to-noise ratio (SNR) conditions and in near real time. AMTC takes as input a time-frequency representation of the system's preprocessing results (such as the spectrogram), and identifies frequency components through iterative dynamic programming and adaptive trace compensation. The proposed algorithm considers relatively high energy traces sustaining over a certain duration as an indicator of the presence of frequency/oscillation components of interest and track their time-varying trend. Extensive experiments using both synthetic data and real-world forensic data of power signatures and physiological monitoring reveal that the proposed method outperforms representative prior art under low SNR conditions, and can be implemented in near real-time settings. The proposed AMTC algorithm can empower the development of new information forensic technologies that harness very small signals.


title: Simulating the fabrication of aluminium oxide tunnel junctions

abstract: Aluminium oxide (AlO$_\mathrm{x}$) tunnel junctions are important components in a range of nanoelectric devices including superconducting qubits where they can be used as Josephson junctions. While many improvements in the reproducibility and reliability of qubits have been made possible through new circuit designs, there are still knowledge gaps in the relevant materials science. A better understanding of how fabrication conditions affect the density, uniformity, and elemental composition of the oxide barrier may lead to the development of lower noise and more reliable nanoelectronics and quantum computers. In this paper we use molecular dynamics to develop models of Al-AlO$_\mathrm{x}$-Al junctions by iteratively growing the structures with sequential calculations. With this approach we can see how the surface oxide grows and changes during the oxidation simulation. Dynamic processes such as the evolution of a charge gradient across the oxide, the formation of holes in the oxide layer, and changes between amorphous and semi-crystalline phases are observed. Our results are widely in agreement with previous work including reported oxide densities, self-limiting of the oxidation, and increased crystallinity as the simulation temperature is raised. The encapsulation of the oxide with metal evaporation is also studied atom by atom. Low density regions at the metal-oxide interfaces are a common feature in the final junction structures which persists for different oxidation parameters, empirical potentials, and crystal orientations of the aluminium substrate.


title: Symbolic Partial-Order Execution for Testing Multi-Threaded Programs

abstract: We describe a technique for systematic testing of multi-threaded programs. We combine Quasi-Optimal Partial-Order Reduction, a state-of-the-art technique that tackles path explosion due to interleaving non-determinism, with symbolic execution to handle data non-determinism. Our technique iteratively and exhaustively finds all executions of the program. It represents program executions using partial orders and finds the next execution using an underlying unfolding semantics. We avoid the exploration of redundant program traces using cutoff events. We implemented our technique as an extension of KLEE and evaluated it on a set of large multi-threaded C programs. Our experiments found several previously undiscovered bugs and undefined behaviors in memcached and GNU sort, showing that the new method is capable of finding bugs in industrial-size benchmarks.


title: Plateaux on generalized Stirling permutations and partial $\gamma$-positivity

abstract: We prove that the enumerative polynomials of generalized Stirling permutations by the statistics of plateaux, descents and ascents are partial $\gamma$-positive. Specialization of our result to the Jacobi-Stirling permutations confirms a recent partial $\gamma$-positivity conjecture due to Ma, Yeh and the second named author. Our partial $\gamma$-positivity expansion, as well as a combinatorial interpretation for the corresponding $\gamma$-coefficients, are obtained via the machine of context-free grammars and a group action on generalized Stirling permutations. Besides, we also provide an alternative approach to the partial $\gamma$-positivity from the stability of certain multivariate polynomials.


title: Almost Split Triangles and Morphisms Determined by Objects in Extriangulated Categories

abstract: Let $(\mathfrak{C},\mathbb{E},\mathfrak{s})$ be an Ext-finite, Krull-Schmidt and $k$-linear extriangulated category with $k$ a commutative artinian ring. We define an additive subcategory $\mathfrak{C}_r$ (respectively, $\mathfrak{C}_l$) of $\mathfrak{C}$ in terms of the representable functors from the stable category of $\mathfrak{C}$ modulo $\mathfrak{s}$-injectives (respectively, $\mathfrak{s}$-projectives) to $k$-modules, which consists of all $\mathfrak{s}$-projective (respectively, $\mathfrak{s}$-injective) objects and objects isomorphic to direct summands of finite direct sums of all third (respectively, first) terms of almost split $\mathfrak{s}$-triangles. We investigate the subcategories $\mathfrak{C}_r$ and $\mathfrak{C}_l$ in terms of morphisms determined by objects, and then give equivalent characterizations on the existence of almost split $\mathfrak{s}$-triangles.


title: One-sided version of Gale-Shapley proposal algorithm and its likely behavior under random preferences

abstract: For a two-sided ($n$ men/$n$ women) stable matching problem) Gale and Shapley studied a proposal algorithm (men propose/women select, or the other way around), that determines a matching, not blocked by any unmatched pair. Irving used this algorithm as a first phase of his algorithm for one-sided (stable roommates) matching problem with $n$ agents. We analyze a fully extended version of Irving's proposal algorithm that runs all the way until either each agent holds a proposal or an agent gets rejected by everybody on the agent's preference list. It is shown that the terminal, directed, partnerships form a stable permutation with matched pairs remaining matched in any other stable permutation. A likely behavior of the proposal algorithm is studied under assumption that all $n$ rankings are independently uniform. It is proved that with high probability (w.h.p.) every agent has a partner, and that both the number of agents in cycles of length $\ge 3$ and the total number of stable matchings are bounded in probability. W.h.p. the total number of proposals is asymptotic to $0.5 n^{3/2}$.


title: Deep Hierarchical Classification for Category Prediction in E-commerce System

abstract: In e-commerce system, category prediction is to automatically predict categories of given texts. Different from traditional classification where there are no relations between classes, category prediction is reckoned as a standard hierarchical classification problem since categories are usually organized as a hierarchical tree. In this paper, we address hierarchical category prediction. We propose a Deep Hierarchical Classification framework, which incorporates the multi-scale hierarchical information in neural networks and introduces a representation sharing strategy according to the category tree. We also define a novel combined loss function to punish hierarchical prediction losses. The evaluation shows that the proposed approach outperforms existing approaches in accuracy.


title: Efficient iterative thresholding algorithms with functional feedbacks and convergence analysis

abstract: An accelerated class of adaptive scheme of iterative thresholding algorithms is studied analytically and empirically. They are based on the feedback mechanism of the null space tuning techniques (NST+HT+FB). The main contribution of this article is the accelerated convergence analysis and proofs with a variable/adaptive index selection and different feedback principles at each iteration. These convergence analysis require no longer a priori sparsity information $s$ of a signal. %key theory in this paper is the concept that the number of indices selected at each iteration should be considered in order to speed up the convergence. It is shown that uniform recovery of all $s$-sparse signals from given linear measurements can be achieved under reasonable (preconditioned) restricted isometry conditions. Accelerated convergence rate and improved convergence conditions are obtained by selecting an appropriate size of the index support per iteration. The theoretical findings are sufficiently demonstrated and confirmed by extensive numerical experiments. It is also observed that the proposed algorithms have a clearly advantageous balance of efficiency, adaptivity and accuracy compared with all other state-of-the-art greedy iterative algorithms.


title: Safe Robot Navigation in Cluttered Environments using Invariant Ellipsoids and a Reference Governor

abstract: This paper considers the problem of safe autonomous navigation in unknown environments, relying on local obstacle sensing. We consider a control-affine nonlinear robot system subject to bounded input noise and rely on feedback linearization to determine ellipsoid output bounds on the closed-loop robot trajectory under stabilizing control. A virtual governor system is developed to adaptively track a desired navigation path, while relying on the robot trajectory bounds to slow down if safety is endangered and speed up otherwise. The main contribution is the derivation of theoretical guarantees for safe nonlinear system path-following control and its application to autonomous robot navigation in unknown environments.


title: Surrogate Assisted Optimisation for Travelling Thief Problems

abstract: The travelling thief problem (TTP) is a multi-component optimisation problem involving two interdependent NP-hard components: the travelling salesman problem (TSP) and the knapsack problem (KP). Recent state-of-the-art TTP solvers modify the underlying TSP and KP solutions in an iterative and interleaved fashion. The TSP solution (cyclic tour) is typically changed in a deterministic way, while changes to the KP solution typically involve a random search, effectively resulting in a quasi-meandering exploration of the TTP solution space. Once a plateau is reached, the iterative search of the TTP solution space is restarted by using a new initial TSP tour. We propose to make the search more efficient through an adaptive surrogate model (based on a customised form of Support Vector Regression) that learns the characteristics of initial TSP tours that lead to good TTP solutions. The model is used to filter out non-promising initial TSP tours, in effect reducing the amount of time spent to find a good TTP solution. Experiments on a broad range of benchmark TTP instances indicate that the proposed approach filters out a considerable number of non-promising initial tours, at the cost of omitting only a small number of the best TTP solutions.


title: A Scalable and Energy Efficient IoT System Supported by Cell-Free Massive MIMO

abstract: An IoT (Internet of things) system supports a massive number of IoT devices wirelessly. We show how to use Cell-Free Massive MIMO (multiple-input and multiple-output) to provide a scalable and energy efficient IoT system. We employ optimal linear estimation with random pilots to acquire CSI (channel state information) for MIMO precoding and decoding. In the uplink, we employ optimal linear decoder and utilize RM (random matrix) theory to obtain two accurate SINR (signal-to-interference plus noise ratio) approximations involving only large-scale fading coefficients. We derive several max-min type power control algorithms based on both exact SINR expression and RM approximations. Next, we consider the power control problem for downlink (DL) transmission. To avoid solving a time-consuming quasi-concave problem that requires repeat tests for the feasibility of a SOCP (second-order cone programming) problem, we develop a neural network (NN) aided power control algorithm that results in 30 times reduction in computation time. This power control algorithm leads to scalable Cell-Free Massive MIMO networks in which the amount of computations conducted by each AP does not depend on the number of network APs. Both UL and DL power control algorithms allow visibly improve the system spectral efficiency (SE) and, more importantly, lead to multi-fold improvements in Energy Efficiency (EE), which is crucial for IoT networks.